Quote from: LoyceV on June 06, 2021, 08:01:35 PM

Quote from: NotATether on June 06, 2021, 06:51:54 PM

I'm trying to figure out how much RAM it uses in the worst case.

I can limit sort's memory usage. I'm more worried about the grinding this causes on the hard drive. I have no idea how much data gets read and written to sort 30 GB, but I assume every bit gets pickup up at least several times.

Quote from: NotATether on June 12, 2021, 07:59:14 AM

Quote from: LoyceV on June 06, 2021, 08:01:35 PM

Quote from: NotATether on June 06, 2021, 06:51:54 PM

I'm trying to figure out how much RAM it uses in the worst case.

I can limit sort's memory usage. I'm more worried about the grinding this causes on the hard drive. I have no idea how much data gets read and written to sort 30 GB, but I assume every bit gets pickup up at least several times.

On second thought, I just had one of my servers' disks fail a couple days ago (all data was lost), so I'm not comfortable running these updating scripts on the rest of my hardware with all that grinding until I can set up a proper backup plan for my TBs of data.

Have you considered creating a script to update your existing list once you have a list of addresses? Your script could start at block_n and add an address if it is not already in your list. This should reduce read/write operations pretty significantly.