You're right that Unity is the problem. Logout and back in with KDE or something else. I've used Xubuntu and Lubuntu from the beginning and they both work with the GUI client.