Let me rephrase my previous argument: if you don't trust Ubuntu, don't install a wallet client there at all. Ubuntu maintainers may hide a bug or exploit which enables wallet stealing in any package.
And don't give me crap about it would be found -- it may be found, but as recent experience shows, it may take a long time.