Bitcoin is not a recognized currency and is currently being considered as black money. The problem is that many use bitcoins for gambling and illegal trades as one can open a bitcoin wallet without any proof. This is the major reason, it's considered illegal.
Unfortunately, you are right.
but, if you only exchange bitcoin for your private purpose, without gambling or illegal trades involved, i don't see problem here.
I mean, you should have right and freedom to spend your own money in the way you want, if you don't break the law.
Gambling and illegal trades can be illegal but bitcoin shouldn't.