So the real problem is:
Do people really want other people to know what they are voting for?
Because that could lead them to problems... if you know what I am saying.
Yup thats very true. Maybe everyone could be given a private key known only to them, and they can vote using that.
But that would be risky as corruption could get the government to create fake keys and addresses.