Also set Directory in Config if --config used (fix #223)