You certainly can install a system with just cli (command line interface) and it will work just fine.

For example Debian would be a good choice.

The biggest problem with cli system is configuring wifi. I do not know any easy way for a cli system to connect to wlan, doing it manually is HARD. So if you need that, then windowed system just might be easier.