But a non-listening node will not serve SPV nodes will it?
Why is this relevant? SPV nodes are harmful to the network, so serving them isn't helping the network.
But not even listening nodes necessarily serve SPV nodes. That's an additional feature called "BLOOM"..