SPV wallets already work the way you suggest. I first proposed Bloom filters in 2011 and they were implemented and launched at the start of 2013. These wallets (multibit/android/hive etc) already download the headers from the p2p network too.
So good thinking but I'd suggest doing more research before proposing other ideas that were already implemented years ago
