Use mon_email and mon_pagerduty.