Do not restart server before creating all config files