I see 2 problems with this: first, not all users who voted the first time, will vote again. And worse: a forum poll can be voted by anyone, which opens it up to alt-abuse.
Well, I didn't remember that second point. They could start creating user just to vote in the poll.

So forget the idea! It won't be one of the best ideas!