In your opinion and from what you mostly know maybe being more experienced in HW wallets, would that be a safe practice?
Nothing should be consider safe enough with ledger devices, and there were some cases of people losing their coins after they connected ledger with metamask wallet and gave permissions, even if ledger was not connected physically anymore.