Skip tests that require a cache dir if it doesn't exist