Allow resolving multiple alerts from a single call