but since it is pretty quick and easy to swap out apps when I need to (without changing keys or loosing any transaction info) it isn't that big of a deal.
Pretty much. You can change apps in about 20 seconds, so even if you are regularly using several different one, a price tag of 120 hardly seems worth it to save yourself a few seconds.
I'm sure I read somewhere about an update to Ledger Live being in the works, where if you tried to open a coin that wasn't installed, it would automatically uninstall other apps and install the app you need. But for the life of me I can't find anything about that now - maybe I'm making it up. Still, would be a nice feature.