Add some documentation around settings.
Use a boolean flag for indicating whether we notify on success.

If notification settings are provided, we should *always* notify on
failure. It's notifying on success that we'll want to turn on or off.
Since that's a simple boolean, it should be represented as such.