Yes it's all about context, if youre doing it to punish yourself that is obviously bad.
I do believe you can do it to test your self though, it can be great for discipline I also believe it generally has many health benefits and I don't belive our ancestors worried too much about their 3 meals/day