During years you will lose a big amount of dust by doing this. With an unique address, or only few addresses you won't lose those bitcoins.
This is not accurate.
Fees are based on outputs, not addresses. If I receive 100 transactions to 100 addresses and consolidate them in to one output, I the transaction size will be exactly the same as if I had received 100 transactions to the same addresses and was consolidating them in to one output. Using the same address to receive to over and over again doesn't save you anything in fees at all.
Using multiple address is not inconvenient or difficult at all, as you make it out to be. All good wallets will manage your addresses for you automatically - creating a new one every time you go to make a deposit, and automatically returning your change to a new one.