Yes, men stick around longer to women they are attracted to. Men like attractive women. More so than Women like attractive Men. You may hate this fact, I can certainly understand, just like I hate the fact that women like tall guys and I'm only 5'9. You knew before you asked.
All guys belong to the same club.
The Shallow Men's Club. We don't need to get to know a woman to decide she is attractive. We know without one word spoken. We don't need to like a woman to imagine kissing her. We could care less if she can't read a word.