Quote from: PrimeNumber7 on November 29, 2020, 10:23:57 PM

I had used AWS as an example because I believed you used it for some of your other projects.

Correct, loyce.club runs on AWS (sponsored).

Quote

Yes, transferring data to the internet is very expensive. You can use a CDN (content delivery network) to reduce costs a little bit. 5 TB of data is a lot.

I highly doubt I'd find a cheaper deal Cheesy

I hope not to use the full 5 TB though, I expect some overselling and don't want to push it to the limit.

Quote

I think you are proving my point. The more input you have, the more time it takes to process one additional input.

An exponential increase in processing time is to be expected. I consider the increase acceptable for scaling: if the number of addresses is 5 times larger than it is now (20 years from now?), it takes only 6 times more processing power.

Quote

The longer the list, the longer it will take to sort one additional line.

At some point a database might beat raw text sorting, but for now I'm good with this

Quote

Your local ISP might not like it very much if you are uploading that much data.

I should add a storage VPS to my shopping list. I now indeed have to transfer a large amount of data through my local internet, and it's terrible compared to server performance.

Quote from: NotATether on November 29, 2020, 11:06:07 PM

I meant on a VPS with another cloud provider with unmetered traffic, such as Hetzner.

I'm not using anything with "unmetered" traffic.

Still working on restoring all data from scratch. I'm curious to see if it matches any of the 2 existing files.
I don't really get the focus on data traffic though, right after I got a good deal on a new VPS. I'm good for now

Quote from: PrimeNumber7 on Today at 03:42:59 AM

I was under the impression that traffic out of the AWS network (for AWS) will count as egress traffic, and will be billed accordingly.

AWS charges $0.09/GB. I love how stable the server is though, it has never been down.