Add a configure block/configuration reset

Also tests!
Fix default notification subject typo
Increase test coverage