I just hope in few years there will be very secure and cheap hardware wallet, so everyone can safely use Bitcoin even on compromised computer. I think this will be next Bitcoin milestone.
It's
already being worked on. The price was listed as 1 BTC back when a bitcoin cost $100, but I don't know if they've since changed what they plan on charging for it or not.
Why couldn't you simply buy a new, cheap computer that has never been connected to the internet?
You can. There's nothing wrong with that approach, and it's what I plan on doing myself. But I suspect this a Trezor is cheaper if they keep the price the same, unless you get a computer used, it's likely going to cost a lot more than $100.