You've certainly taken the "not your keys not your crypto" thing to the next level!
I have a ledger but the repsonsibility scares me to death tbh so I still hold coins on an exchange too, which i know is terrible but I'd never forgive myself if I became one of those stories of a lost private key or password and losing everything I worked so hard for!
I'll be interested to see what others say here. What you've done seems sensible for sure, I just couldnt do it personally!
BTW I know what you mean about the freedom it gives you. I love the idea that BTC is the only currency that can be held and secured in the mind