Average Joes are not going to have to track all there btc spending. IRS has no way of tying you to a anonymous bitcoin address. Nor do they want to waste time on it. Pull your head out of your ass.
This is actually my personal feeling as well, unfortunately all the paranoia spread and I'm going to make an attempt to be legit. I already regret my decision fwiw. Time and money on CPA to work on this, my own time building spreadsheets, really a crap deal.