I searched for an address I already have used in the forum and no mention was found. What could have gone wrong?
I found that most address' mentions on forums. People add it to profile and I just scan it.
Crawlers started a week ago and have about 30k popular addresses in the DB. All "not found" addresses stored in another table and will be restarted to search again. Also, I have limited server resources. It's my own startup based on my enthusiasm and cheap VPS.
My next step - collect TAGs for addresses and create an API interface.
I hope these functions will be useful.
Please write to us, if you have any ideas for site improvements.