Money is tainted with  sense of immorality because it has no immediate value beyond trade. If I trade a cow for ten chickens,  I'm getting ten chickens. That has a value that I can quantify. It's not just something tradable, it's also meat and eggs in its own right. Even gold or diamonds are only valuable because they're hard to find. That feels like an unstable value. So people don't trust it.