Ubuntu is generally my go-to when it comes to server installs (it's most commonly used on production environments for websites/servers, etc)
If you're comfortable with only using command-line/terminal as well, you could probably find an faster OS.
They also have a custom server build:
https://ubuntu.com/download/server