Re-Add cancel alarms, this was removed & we have been getting weird alerts.

For the overhead involved, it's easier to cancel them.