I get up at 5am too. And it's also so I have time alone before anyone else gets up. The main reason is that I've set aside that time to game because if I game in the evening chances are I'll get interrupted by a family pet needing to go out, a child needing something, a phone call, my wife needing something etc. Being "on call" all the time doesn't give me time to really relax and get into anything because I'm constantly listening out for issues. At 5am to 7am it's quiet, no one is up, no one needs anything and I get that time to myself uninterrupted (most of the time). I'm not slightly on edge waiting for the next call of "Daaaaaaad?" or the sound of a dog scratching the door etc.
I'm a much happier person because of this, it doesn't hurt anyone so it's win, win for everyone. Everyone needs down time. Don't worry about it.