Added a destructor for the configured client factory to remove config instances.