Cleaning up the configuration directory structure.