Matching alerts are removed from alerts.csv