Hoarding merit has no benefit. It's not a "waste" to spend it, that's the only way to use it.