SegWit involves storing signatures of transactions separate from the transactions, and outside of blocks.
With SegWit, you can determine the UTXO by downloading the blockchain. With what the OP is proposing, it would not be realistic to not store the transactions even if they were stored outside the blocks.