Or it could be just you. To get a complete picture we would need one of your giggling co-workers to come here and give us the other side of the story.

I've worked with some terrible (professionally and otherwise) people and I don't recall it being a particularly male or female problem. Issues like that are best solved by talking to the boss or finding another job.