Add check_on_save toggle to turn on and off check_on_save on the fly