Add notificationMode option

The user can pass in a `notificationMode` setting, with four possible values.

always - always show a notification
change - show a notification on changed result
failChange - show a notification on fail or on first success after fail
failOnly - show a notification on all fails