When the test directory does not exist and the option is enabled, do not try to run the tests.