If everyone gives up mining bitcoin will end up centralized.

If you hold a sizable amount of coin I think it's only wise to invest in network diversity a little bit. You will not get rich though, that's for sure.