Unfortunately, yes, it does matter to some men. They want someone who’s attractive to their eyes. However, it all boils down to security and how a woman makes them feel about themselves.