It fits the model of gold better. Gold doesn't get lost with no chance of being found again.
Why did Satoshi cap gold at 21 million? Was it arbitrary?
Yes I know the argument, any amount of a money is sufficient.
One benefit is it will keep the bounty on mining high, making it so that people will continue to drive the difficulty level high, making the block chain more secure. It does that without inflating.