SES-1825 : Add tests for fatal/non-fatal and active/inactive

This verifies that an exception is only thrown when the setting is
active (true) and non-fatal-error is not setup for the setting