Only set admin server and password server if configured