I don't want to try anything else without someone else's input here. Anyone else have had this problem before?
Thousands of people have many issues with ledger nono X, it's one of the worst hardware wallets in the world.
Most problems are coming from bad battery and firmware issues, but in your case I would first make to sure to have latest firmware update and Bitcoin app in ledger live.
Ledger recently released new update and they changed a bunch of things, app size increased again for some coins
(surprise, surprise).
If everything is updated I would try connecting with some alternative software wallets that support ledger, for example Sparrow wallet.
I am in fact using a ledger nano x. ._.
Just my luck I guess hahah, I was a newbie when I got it and never even used it for it's true intended purpose like most of you guys on here do.