Actually remove the message