It makes no sense that you won't use open source metamask wallet but you are willing to use some unknown closed source wallet  called infinity.

One more option you have is using hardware wallets that support WalletConnect (ledger live, safepal, ellipal, coolwallet, dcent...), however, I think that most of them are also closed source.