I started mining with VMs (USB devices only) so can separate access with VLAN tagging and ipfw. Is working well once set up and allows lightweight virtual machines.
Next need is USB-over-ethernet or USB/IP to support migration between servers possible.