Indeed I do share in this mixed feeling as, most of us Bitcoiners and investors in this field like to view and believe that the vulnerabilities that might exists within the system is one that haven’t got nothing to do with the security of whatever wallets there might be, used in securing and storing of our Bitcoin hodlings.
The singular idea that this could be exploited by quantum computation simply means, nothing is ever safe as, it doesn’t stop with Satoshi’s starch but, every other exposed public key like you’ve said is a target.

We hope not to get to that point though but like he said, hope isn’t a strategy however, we can only hold on to what we’ve got.