You don’t have to physically carry it around.
You do not also have to physically carry cash around to spend it too, the same way with bitcoin. I do not see anything special or of advantage there to bitcoinif you are going to use that as a point. Another thing is that we do not have to see bitcoin as banks. Both of them operate differently. Bitcoin operates 24hrs and none stop but banks have restrictions with when and how to operate, days off, and middlemen.
Physical currencies too have the similar features. Over time everything have well advanced. Bitcoin wallet serves as one's own bank, because it is you who can control it. Banks are different, and OP have mentioned it just to indicate the reason that attracts.