He is either trying to reproach or humiliate you, or he’s joking. Depends on how he says that.