Starts ups looking for business loans often have little in the way of collateral to provide. Sure, the bank could come after you for damages if you default, but that's not the same as them having assets to back up the loans they provide.
At least in the juristictions I know, it's not easy for a startup without collateral to get a loan by a full-fledged bank. Most of the time they have to reccur to angel investment, venture capital and other "non-banking" financing methods, where risks for the financing parties are higher but they also participate in the company (with voting rights) they support. And this kind of investors/financial entities does not have the right to "print money" like banks have.
After all, nobody should forget that money is only a means of communication between consumers and producers. If there was a party which "prints out" values that are not reflecting the "real" state of the production sector, that would lead very likely to high inflation. That's basically what happened in Venezuela, Simbabwe or late-eighties Argentina where the Central Bank policy failed completely, or what happens to every shitcoin that has nothing to offer for the "money" they print.
PS: There is however a criticism to "fiat money" creation I support, and that's the
Cantillon Effect. Basically, it postulates that if there is inflation (even low), typically there will be a group who benefits first from a money supply increase, and those who benefit last will see their share of society's income and "prosperity" decreased.