Firstly the wealth created by hard work doesn't go back to the people who did the work. The hardest workers in society are often the lowest paid, i.e. labourers.
Secondly holding bitcoins isn't doing nothing. While being merely an investment for some, for many of us holding bitcoins is political activism. It's a vote of no confidence in the financial system and a vote of no confidence in the political system (as bitcoin technology can lead to the development of a direct digital democracy). It's voting for a system that will facilitate freedom of speech (via the incentivzed decentralisation of the Internet) as well as the skirting unjust government sanctions that punish the poorest. It's a vote for a system that can build a truly democratic world that includes everyone. A vote for the reorganization of society into one that is capable of making decisions that lead to a sustainable future, which I argue is necessary for the survival of humanity and life on Earth. Bitcoin is a vital tool in saving the world, and in many other ways than these. Isn't this an activity worthy of being richly rewarded? Given the pointless 'hard work' so many people do I say people willing to take risks like this for the sake of the survival of their species are heroes worth decorating in robes of riches and glory. (excuse me for tooting my own horn...

)
Plus if bitcoin does continue as many are expecting (to tens of thousands of dollars per coin and up) that will be the biggest redistribution of wealth in the history of man kind, which given the current state of wealth disparity I say is a good thing.
Edit: Also a final point: since when is high economic activity good? We build products that are designed to break just to people have to buy another one. This 'economic growth at all costs' paradigm has resulted in taking us to the brink of a mass extinction. Take the floating island of rubbish the size of texas floating across the pacific right now. Do you really encourage the pointless hard work that fuels such a system? Bitcoin is about changing the system to eventually make it sustainable. It's like investing in the super-brain of humanity.