Walk directories and build out a key value store based upon config files