List of all Bitcoin addresses with a balance

Background

Quote from: LoyceV on May 15, 2020, 05:11:19 PM

There's another very useful data dump on Blockchair that deserves attention: blockchair_bitcoin_addresses_latest.tsv.gz!

On many occasions I found myself searching for a complete snapshot of all funded addresses, for instance to search for a balance when you only have a partial Bitcoin address. This file takes almost a day to download at 10 kB/s.

The data
See addresses.loyce.club. I keep a few snapshots of Blockchair's daily data.
Sample (sorted by balance, highest first (in satoshis)):

Code:

address balance
35hK24tcLEWcgNA4JxpvbkNkoAcDGqQPsP 25550215765875
3KZ526NxCVXbKwwP66RgM3pte6zW4gY1tD 10185724750535
37XuVSEpWW4trkfmvWzegTHQt7BdktSKUs 9450577254951
.......
m-3165957a315e3d9d2de76eccb1140cb8 1
127TnYq7APW8WfKewd7EdxA8gMUXEtr623 1
1E6NkSVsBewyz8Z8wJBYVTKgWmdqcUSWkS 1

This file is in CSV (Comma-Separated Values) format. It's probably too large (30 million rows) to import into a spreadsheet.

I create a new file with all funded addresses, without balances.
Sample (sorted in alphabetical order):

Code:

1111111111111111111114oLvT2
111111111111111111112BEH2ro
111111111111111111112xT3273
.......
s-f50ad3a190b77592ebbf4b2c8d43fbf7
s-f6ce9b42bc81cbe4f8851921772e2b28
s-f833988924e7be04662063dbac70a2f1

This file is in TEXT format. The first addresses are burn addresses, nobody can access those funds. I'm not sure what the weird "address" format at the end is.

Download speed should be around 1000 times faster than Blockchair. I don't offer uncompressed downloads.

How to use
The most likely use is to check a long list of Bitcoin addresses for a remaining balance.
On Linux, use this to find matching addresses:

Code:

comm -12 Bitcoin_addresses_June_09_2020.txt <(cat mylist.txt | sort | uniq)

Bitcoin_addresses_June_09_2020.txt: the extracted latest version downloaded from addresses.loyce.club.
mylist.txt: your own list of addresses, one address per line.

This takes only seconds to check millions of addresses. If your text file has Microsoft formatting, you may need to use this instead:

Code:

comm -12 Bitcoin_addresses_June_09_2020.txt <(cat mylist.txt | fromdos | sort | uniq)

Updates
I'll provide daily updates. I keep the 2 latest snapshots, then delete the oldest one.
I haven't fully tested this yet. I'll know in a few days if it works.

Credits
Blockchair Database Dumps has a staggering amount of data, easily accessible (at 10 kB/s) with daily updates. All data presented in this topic comes from Blockchair.

No spam please.
Self-moderated against spam. Discussion and questions are welcome.