Fix bug that cache was still used while config file didn't exist