New notifier for first failure.

It notifies as soon as the first failure happens. If nothing fails, it
notifies in the end.