Remove alert, send notification