But doing that seems like we're heading to a fiat-like currency too, right? Especially coins are off-blockchain so
anyone can produce as many physical bitcoins as they can given that validation is absent with physical bitcoins.

It would be similar to fiat but more like gold and silver coins mainly to be used as a barter system. It's necessary when people cannot access the internet and need to use their bitcoins. The anonymity would still exist and taxes could be avoided.
@bold: There could be a trademark or symbol like we have for gold coins so that nobody could make fake bitcoins and cheat users.