Usually means that she is specifically not calling you a man. She might thing that you are immature, not taking responsibility for yourself. It is a put-down. She called you “Boy,” she meant you are immature or she is older than you are.