I think cash transactions will also have anonymity. When you trade paper money with the other party, the other party does not know any information about you. But if you pay electronically, the other party may know your information.
However, whether it is Bitcoin or cash, it needs to be properly stored. If you lose your bank card in cash, you can retrieve your bank card through your ID card. But if you lose your Bitcoin key, you can't get your money back.
These two currencies have their own advantages and disadvantages as you said, but to minimize risk it might be said that bitcoin is a little safer than fiat currency transactions but I believe that in this world there are no transactions that are 100% safe because of course there are loopholes that are indeed not perfect for every transaction that exists, whether it is safe or not, of course, all depends on us in storing financial information and also how we carry out these financial transactions.