OP, your idea is not new.
There have been many proposals like this.
https://bitcointalk.org/index.php?topic=88208.0
https://www.scribd.com/document/317130737/Bitcoin-On-Chain-Pruning

The downside is that this has the same security assumptions as in SPV wallets.
I think it is worth it though.