If it's in an wildly inappropriate context, her perception of you can switch from "like" to "dislike" quickly.

It's a factor, but lots of women have stories about attractive creeps.