People can get details of how you spend your money. Using a public address as a public person let's everyone see what you are doing with your money.
That's not exactly true.
You can see that bitcoin went to another address, but addresses are mostly unknown and anonymous.
If you are paranoid, you can have a public through out address where you can receive money and them just "clean" those bitcoins in a bitcoin mixer, for example.