Actually remove the cacheDir