Remove the mail alias