One man in baseball cap looks out while two men look down.
Women look different directions.
He refers to men not women.
Men are looking around in the first sentence not women.
One man and two men cannot be referred to as being women.