I think bitcoin-qt can be used as portable client, you just need to run it with -datadir command line switch (make a .bat file or something) and it will work. It will be portable with the whole blockchain (about 8GB I think now), though.