Tunneling in would be an option but also opens up the risk if you have a keylogger or for some reason find yourself as a high priority target for somebody that they literally monitor your in real time. It may sound paranoid but it's actually a feature of many commercially available "RATs" aka remote administration tools. They can have 10,000 infected PCs, then begin filtering them by OS, location, installed software, visited websites, recorded keystrokes, etc and then getting screenshots every x seconds and real time keystrokes.

My current setup is a wireless mouse/keyboard dongle that I just unplug from the front of my main PC to my odroid and my monitor lets me switch between multiple inputs so I use that as my display, much easier than the days of messing with wires and constantly rotating usb plugs so until they'd fit