Clean up config directory.