You should confront him about how those comments hurt you and say that you will not tolerate them. If he continues, then it's probably time to find a new relationship as it's unlikely he respects you and a sign of an unhealthy relationship.