Don't use getport if config.port is set.