Delete alerts for a check when the check is being deleted