Add config for notifications

Rather than always showing notifications, they will default to off and
then can be enabled by the user using `force notify true`