Delete an alert