I haven't felt any significant delay because usually the transaction will show up with zero confirmations within 5 minutes or so then I can rest assured that it is coming to me.
When blocks become persistently full, you will never be able to safely assume that a zero-conf transaction will ever get included in a block.
And that is a fact.