I was reading through a very interesting topic on
Database Sharding that seems to be designed for handling huge datasets and distributing them to various channels so that single system doesn't have to overload itself.
What I understand from the concept is either you can distribute the data to various nodes in horizontal manner that is increasing the capacity of processing with more number of devices and also it has virtually no limit on how far you go. Or one can simply start sharding vertically but in that you have to make the machine more powerful. Will it help in blockchain scaling?I think the concept is pretty straight. If we are already using huge data or collecting enormous data and perform the confirmations over blockchain then the nodes that are created getting filled quickly.
So if we do apply the horizontal sharding to the blockchain generated nodes then each node can further be divided into more data sets / nodes and thus processing could be accelerated based on more "machines" will be working on same problem.
If Data Sharding is already on the blockchain then how do we know that it is already implemented? Is there any example of such implementation to relieve the Blockchain Burden? I initially thought that Lightening Network is working on the similar processing however it seems that if Database sharding is implemented then it would be Layer one technology while LN is Layer two blockchain and works
"off-chain"What is database sharding?
Sharding is a method for distributing a single dataset across multiple databases, which can then be stored on multiple machines. This allows for larger datasets to be split into smaller chunks and stored in multiple data nodes, increasing the total storage capacity of the system. See more on the basics of sharding here.
Similarly, by distributing the data across multiple machines, a sharded database can handle more requests than a single machine can.
Sharding is a form of scaling known as horizontal scaling or scale-out, as additional nodes are brought on to share the load. Horizontal scaling allows for near-limitless scalability to handle big data and intense workloads. In contrast, vertical scaling refers to increasing the power of a single machine or single server through a more powerful CPU, increased RAM, or increased storage capacity.