Messing around with all this has also made me realize that the amount of robot traffic happening on websites like this one must be through the roof. I haven't looked at any stats, but it's gotta be going bananas.

It's not storing all this, some of it's doing in real time, and I can only imagine that the amount of electricity and bandwidth that's being take up just by robots crawling websites nowadays is crazy. At some point, it's going to be more than us.