Skip connectByPort tests if no port is specified in the config.