Could you add a tearDown that sets the setting back to False. This way, if the test fails before resetting via the UI we still reset it.