Make sure that we don't add the wrong alerts