But I have the feeling that the problem with the speed is not due to the hardware.
For example, if I open Ledger live without connecting the Ledger to my computer, my computer works very hard to synchronize my transactions until the program crashes.
I would switch from using Ledger Live that is known to have bugs, and use Electrum or Sparrow wallet connected with ledger, you can use that for Bitcoin.For example, if I open Ledger live without connecting the Ledger to my computer, my computer works very hard to synchronize my transactions until the program crashes.
Reducing number of mining rewards you receive should probably solve the problems, because ledger server probably considers many transactions similar as ddos attacks.
I will try to contact all other hardware wallets to find if they have similar issues with transactions.
I ordered a Ledger Nano X because I don't just manage BTC.
Oh no... I hope you won't have many issues with their crap battery and with other bugs this device have 
If it's not to late I would switch this to model S plus, or even better to some better open source hardware wallet.