Safety check on alert removal