I think that sums it up pretty well, and I think it’s a good point. Women have a tendency to view men’s behavior through the lens of how attractive they find the guy. More specifically, if a woman decides that a man is someone she would pretty much never consider as a romantic partner, then repeated advances by him are much more likely to be seen as creepy and offensive.
Of course men are biased too. Here’s a hypothetical for guys: Suppose you are at the mall and you wander into a Sharper Image store. You are looking at those cheesy hand held fans which spray water. All of a sudden, a woman who is there alone picks up a fan, playfully sprays water at your face, and giggles. Would you be more annoyed and offended if (1) she was fat, unattractive, and 45 years old; or (2) if she was a hottie?