Actually never mind about the command line. Apparently it's not available for windows.
Just enter this in the python console: signtransaction('unsignedrawtransaction')
You'll have to import the keys to another wallet however. Supposedly you can use external keys by using signtransaction('unsignedrawtransaction', 'privkey=xxx') but for the life of me I can't get that to work.