They've asked me out before.  I politely say "no thanks, I'm straight" and consider it flattering.