Patent ID: 12231290

Like reference characters refer to like elements throughout the figures and description.

DETAILED DESCRIPTION

This disclosure is directed to controller devices supporting edge computing. Edge computing may refer to a distributed architecture that reduces latency by hosting applications, data, and/or compute resources at locations geographically closer to end users (e.g., client devices). Cloud Networking services may be provided from the “cloud,” such that customers can avoid the overhead of managing the network infrastructure and services in their premises. Cloud Network services may provide network capabilities and resources on demand from the cloud. Cloud services may include, for example, security services or connectivity services (e.g., software-driven wide-area network (SD-WAN)) and may be provided from the cloud. Cloud services may be provided with 99.99999 . . . % of a service level agreement (SLA). Based on intent, a controller device (e.g., a central controller) may select resources, compile the intent, and generate a configuration to be applied to resources (e.g., implemented by network devices) that satisfies the intent and/or satisfies the SLA.

Edge Computing architecture may be implemented to improve a performance of an network, for example, to provide a faster responses time and/or higher data transfer rates (e.g., an amount of bandwidth). Edge Computing may move a computation away from a centralized cloud (e.g., a central controller) towards the “edge” of the network. The resources in the “edge cloud” may provide network services (e.g., computing services, security services, etc.) to a customer network. By moving network services to the edge of the network, the edge computing architecture may provide faster response times and/or higher data transfer rates. However, distributing the logic to different controllers (e.g., a central controller and one or more edge controllers) and network nodes may introduce one or more problems. For example, an edge controller may comprise one or more of: a compute constraint, an accessibility and/or operation constraint, and/or a remote management constraint. In some examples, the edge controller may comprise a connectivity issue, where, for example, the edge computing architecture may work with latency and/or jitter issues with the central controller.

In accordance with the techniques of the disclosure, an edge controller, rather than only the central controller, may be configured to monitor and manage resources to ensure that resources satisfy network performance parameters (e.g., SLA parameters). For example, the edge controller may receive resource allocation context indicating network performance parameters. In this example, the edge controller may, without further communication with the central controller, “move” a configuration of a resource when the resource is not meeting the network performance parameters. For instance, the edge controller may move routing for client devices for a tenant from a first virtual router to a second virtual router when SLA parameters for the tenant are not being satisfied by the first virtual router. Again, the edge controller may move routing for the client devices even when the edge controller is unable to communicate with the central controller, which may be referred to herein as “headless mode.” After moving the routing and/or once communication with the central controller is restored, the edge controller may synchronize with the central controller to notify the central controller of the change in configuration. In this way, the edge controller may help to ensure that resources satisfy network performance parameter even when connectivity between the central controller and the edge controller is lost, which may help to improve a performance (e.g., lower jitter, lower latency, higher bandwidth, higher reliability, higher throughput, etc.) of the network.

Again, the central controller may select resources, compile the intent, and generate a configuration to be applied to resources (e.g., a network device or a virtualized device) that satisfies a stateful intent and/or satisfies one or more network performance parameters. As such, the edge controller may move the configuration generated by the central controller (and resource allocation context) without managing stateful intents and/or a unified graph model, which may require a relatively high computational capacity. In this way, the edge controller may be implemented using lightweight stateless edge controllers. Moreover, as described herein, the edge controller may move, without prompting by the central controller, a configuration of a resource when the resource is not satisfying the network performance parameters, which may help to ensure that resources satisfy network performance parameter when connectivity between the central controller and the edge controller is lost. Ensuring that resources satisfy network performance parameter when connectivity between the central controller and the edge controller is lost may help to improve a performance (e.g., reduce an amount of lower jitter, lower an amount of latency, increase an amount of bandwidth, increase a reliability, etc.) of the network. In this way, the central controller may provide a management plane for the network and the edge controller may receive configurations from the central controller, which may reduce a complexity of the edge controller. For example, rather than compiling an intent to generate a configuration, the edge controller may move an existing configuration to available resources and output an indication of the move to the central controller, which may update a unified graph model for the network performance parameter.

FIG.1is a block diagram illustrating an example including network devices of an enterprise network2that are managed using a controller device10. Network elements14A-14G (collectively, “network elements14”) of enterprise network2include network elements interconnected via communication links to form a communication topology in order to exchange resources and information. Network elements14(also generally referred to as remote network devices) may include, for example, edge devices, routers, switches, gateways, bridges, hubs, servers, firewalls or other intrusion detection systems (IDS) or intrusion prevention systems (IDP), computing devices, computing terminals, printers, other network devices, or a combination of such devices. Edge devices may be configured for edge POP, which may indicate a location for network services running in a cloud for a given edge device. One or more edge controllers may be configured to manage resources. Edge devices may be configured to provide edge computing. Edge computing may refer to a distributed architecture that reduces latency by hosting applications, data, and/or compute resources at locations geographically closer to end users. While described in this disclosure as transmitting, conveying, or otherwise supporting packets, enterprise network2may transmit data according to any other discrete data unit defined by any other protocol, such as a cell defined by the Asynchronous Transfer Mode (ATM) protocol, or a datagram defined by the User Datagram Protocol (UDP). Communication links interconnecting network elements14may be physical links (e.g., optical, copper, and the like), wireless, or any combination thereof.

Enterprise network2is shown coupled to public network18(e.g., the Internet) via a communication link. Public network18may include, for example, one or more client computing devices. Public network18may provide access to web servers, application servers, public databases, media servers, end-user devices, and other types of network resource devices and content.

Controller device10is communicatively coupled to network elements14via enterprise network2. Controller device10, in some examples, forms part of a device management system, although only one device of the device management system is illustrated for purpose of example inFIG.1. Controller device10may be an example of a central controller. Controller device10may be coupled either directly or indirectly to the various network elements14. Once network elements14are deployed and activated, administrators12uses controller device10(or multiple such management devices) to manage the network devices using a device management protocol. One example device protocol is the Simple Network Management Protocol (SNMP) that allows controller device10to traverse and modify management information bases (MIBs) that store configuration data within each of managed network elements14. Another example device protocol may include NETCONF, however, techniques described herein may be used with other device protocols. Further details of the SNMP protocol can be found in Harrington et al., RFC 3411, “An Architecture for Describing Simple Network Management Protocol (SNMP) Management Frameworks,” Network Working Group, the Internet Engineering Task Force draft, December 2002, available at http://tools.ietf.org/html/rfc3411, the entire contents of which are incorporated herein by reference. Another example device protocol may include NETCONF, however, techniques described herein may be used with other device protocols. Further details of the NETCONF protocol can be found in Enns et al., RFC 6241, “Network Configuration Protocol (NETCONF),” Network Working Group, the Internet Engineering Task Force draft, June 2011, available at https://tools.ietf.org/html/rfc6241, the entire contents of which are incorporated herein by reference.

In common practice, controller device10, also referred to as a network management system (NMS) or NMS device, and network elements14are centrally maintained by an IT group of the enterprise. Administrators12interacts with controller device10to remotely monitor and configure network elements14. For example, administrators12may receive alerts from controller device10regarding any of network elements14, view configuration data of network elements14, modify the configurations data of network elements14, add new network devices to enterprise network2, remove existing network devices from enterprise network2, or otherwise manipulate the enterprise network2and network devices therein. Although described with respect to an enterprise network, the techniques of this disclosure are applicable to other network types, public and private, including LANs, VLANs, VPNs, and the like.

In some examples, administrators12uses controller device10or a local workstation to interact directly with network elements14, e.g., through telnet, secure shell (SSH), or other such communication sessions. That is, network elements14generally provide interfaces for direct interaction, such as command line interfaces (CLIs), web-based interfaces, graphical user interfaces (GUIs), or the like, by which a user can interact with the devices to directly issue text-based commands. For example, these interfaces typically allow a user to interact directly with the device, e.g., through a telnet, secure shell (SSH), hypertext transfer protocol (HTTP), or other network session, to enter text in accordance with a defined syntax to submit commands to the managed element. In some examples, the user initiates an SSH session15with one of network elements14, e.g., network element14F, using controller device10, to directly configure network element14F. In this manner, a user can provide commands in a format for execution directly to network element14.

Further, administrators12can also create scripts that can be submitted by controller device10to any or all of network elements14. For example, in addition to a CLI interface, network elements14also provide interfaces for receiving scripts that specify the commands in accordance with a scripting language. In a sense, the scripts may be output by controller device10to automatically invoke corresponding remote procedure calls (RPCs) on the managed network elements14. The scripts may conform to, e.g., extensible markup language (XML) or another data description language.

Administrators12uses controller device10to configure network elements14to specify certain operational characteristics that further the objectives of administrators12. For example, administrators12may specify, for network element14A, a particular operational policy regarding security, device accessibility, traffic engineering, quality of service (QoS), network address translation (NAT), packet filtering, packet forwarding, rate limiting, or other policies. Controller device10uses one or more network management protocols designed for management of configuration data within network elements14, such as the SNMP protocol or the Network Configuration Protocol (NETCONF) protocol or a derivative thereof, such as the Juniper Device Management Interface, to perform the configuration. In general, NETCONF provides mechanisms for configuring network devices and uses an Extensible Markup Language (XML)-based data encoding for configuration data, which may include policy data. NETCONF is described in Enns, “NETCONF Configuration Protocol,” Network Working Group, RFC 4741, December 2006, available at tools.ietf.org/html/rfc4741. Controller device10may establish NETCONF sessions with one or more of network elements14.

Controller device10may be configured to compare a new intent data model to an existing (or old) intent data model, determine differences between the new and existing intent data models, and apply the reactive mappers to the differences between the new and old intent data models. In particular, controller device10determines whether the new set of configuration data includes any additional configuration parameters relative to the old intent data model, as well as whether the new set of configuration data modifies or omits any configuration parameters that were included in the old intent data model.

The intent data model may be a unified graph model, while the low-level configuration data may be expressed in YANG, which is described in Bjorklund, “YANG—A Data Modeling Language for the Network Configuration Protocol (NETCONF),” Internet Engineering Task Force, RFC 6020, October 2010, available at tools.ietf.org/html/rfc6020. In some examples, the intent data model may be expressed in YAML Ain′t Markup Language (YAML). Controller device10may include various reactive mappers for translating the intent data model differences. These functions are configured to accept the intent data model (which may be expressed as structured input parameters, e.g., according to YANG or YAML). The functions are also configured to output respective sets of low-level device configuration data changes, e.g., device configuration additions and removals. That is, y1=f1(x), y2=f2(x), . . . yN=fN(x).

Controller device10may use YANG modeling for intent data model and low-level device configuration models. This data may contain relations across YANG entities, such as list items and containers. Conventionally, controller devices do not support configuration management functions in real time. As discussed in greater detail below, controller device10may convert a YANG data model into a database model, and convert YANG validations into data validations. Techniques for managing network devices using a graph model for high level configuration data is described in “CONFIGURING AND MANAGING NETWORK DEVICES USING PROGRAM OVERLAY ON YANG-BASED GRAPH DATABASE,” U.S. patent application Ser. No. 15/462,465, filed Mar. 17, 2017, the entire contents of which are hereby incorporated by reference.

Controller device10may receive data from one of administrators12representing any or all of create, update, and/or delete actions with respect to the unified intent data model. Controller device10may be configured to use the same compilation logic for each of create, update, and delete as applied to the graph model.

In general, controllers like controller device10use a hierarchical data model for intents, low-level data models, and resources. The hierarchical data model can be based on YANG or YAML. The hierarchical data model can be represented as a graph, as discussed above. Modern systems have supported intents to ease the management of networks. Intents are declarative. To realize intents, controller device10attempts to select optimal resources.

In accordance with the techniques of the disclosure, network element14A (e.g., an edge controller of network element14A) may receive, from controller device10(e.g., a central controller of controller device10), a plurality of configurations comprising a first configuration for provisioning a first set of network services at a first resource of the edge device and a second configuration for provisioning a second set of network services at the first resource, a first configuration group identifier identifying a configuration group for the first configuration, and a first network performance parameter for the configuration group. As described further herein the first configuration group identifier may identify a tenant and/or a branch for one or more client devices to be provided the first set of network services. The first network performance parameter may specify, for example, an amount of bandwidth, an amount of latency, a jitter, or another network performance parameter.

Network element14A may apply the plurality of configurations at the first resource. After applying the plurality of configurations to the first resource, network element14A may determine a performance factor (e.g., an amount of bandwidth, an amount of latency, and/or an amount of jitter) for the first resource providing the first set of network services to one or more client devices. Network element14A may determine that the performance factor does not satisfy the first network performance parameter. In response to a determination that the performance factor does not satisfy the first network performance parameter and that the first configuration group identifier identifies the configuration group for the first configuration, network element14A may move the first configuration from the first resource to a second resource of network element14A. For example, network element14A may remove the first configuration from the first resource and add the first configuration to the second resource. In this way, network element14A may be configured to help to ensure that resources satisfy network performance parameter even when connectivity between network element14A and controller device10is lost, which may help to improve a performance (e.g., reduce an amount of jitter, reduce an amount of latency, increase an amount of bandwidth, increase a reliability, etc.) of network2.

FIG.2is a block diagram illustrating an example set of components for controller device10ofFIG.1. In this example, controller device10includes control unit22, network interface34, and user interface36. Network interface34represents an example interface that can communicatively couple controller device10to an external device, e.g., one of network elements14ofFIG.1. Network interface34may represent a wireless and/or wired interface, e.g., an Ethernet interface or a wireless radio configured to communicate according to a wireless standard, such as one or more of the IEEE 802.11 wireless networking protocols (such as 802.11 a/b/g/n or other such wireless protocols). Controller device10may include multiple network interfaces in various examples, although only one network interface is illustrated for purposes of example.

Control unit22represents any combination of hardware, software, and/or firmware for implementing the functionality attributed to control unit22and its constituent modules and elements. When control unit22includes software or firmware, control unit22further includes any necessary hardware for storing and executing the software or firmware, such as one or more processors or processing units. In general, a processing unit may include one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or any other equivalent integrated or discrete logic circuitry, as well as any combinations of such components. Furthermore, a processing unit is generally implemented using fixed and/or programmable logic circuitry.

User interface36represents one or more interfaces by which a user, such as administrators12(FIG.1) interacts with controller device10, e.g., to provide input and receive output. For example, user interface36may represent one or more of a monitor, keyboard, mouse, touchscreen, touchpad, trackpad, speakers, camera, microphone, or the like. Furthermore, although in this example controller device10includes a user interface, administrators12need not directly interact with controller device10, but instead may access controller device10remotely, e.g., via network interface34.

Control unit22includes user interface module38, network interface module32, and management module24. Control unit22executes user interface module38to receive input from and/or provide output to user interface36. Control unit22also executes network interface module32to send and receive data (e.g., packets) via network interface34. User interface module38, network interface module32, and management module24may again be implemented as respective hardware units, or in software or firmware, or a combination thereof.

Functionality of control unit22may be implemented as one or more processing units in fixed or programmable digital logic circuitry. Such digital logic circuitry may include one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or any other equivalent integrated or discrete logic circuitry, as well as any combination of such components. When implemented as programmable logic circuitry, control unit22may further include one or more computer readable storage media storing hardware or firmware instructions to be executed by processing unit(s) of control unit22.

Control unit22executes management module24to manage various network devices, e.g., network elements14ofFIG.1. Management of a network device includes, for example, configuring the network devices according to instructions received from a user (e.g., administrators12ofFIG.1) and providing the user with the ability to submit instructions to configure the network devices. Management of a network device further includes upgrading the network device with updated software, such as an updated software image. In this example, management module24further includes partition recovery unit27and translation module28.

Management module24is configured to receive intent unified-graph-modeled configuration data for a set of managed network devices from a user, such as administrators12. Such intent unified-graph-modeled configuration data may be referred to as an “intent data model.” Over time, the user may update the configuration data, e.g., to add new services, remove existing services, or modify existing services performed by the managed devices. The unified intent data model may be structured according to, e.g., YANG or YAML. The graph model may include a plurality of vertices connected by edges in a hierarchical fashion. In YANG, edges of graph models are represented though “leafref” elements. In the case of YAML, such edges may be represented with a “ref” edge. Similarly, parent to child vertex relations can be represented with a “has” edge. For example, a vertex for Element A refers to a vertex for Element B using a has-edge can be understood to mean, “Element A has Element B.” In some examples, management module24also provides the user with the ability to submit reactive mappers that translation module28executes to transform the intent data model to device-specific, low-level configuration instructions.

Controller device10also includes configuration database40. Configuration database40may include a data structure describing managed network devices, e.g., network elements14. Configuration database40may act as an intent data store, which may be used to persist and manage collections of intent data models. For example, configuration database40may include information indicating device identifiers (such as MAC and/or IP addresses), device type, device vendor, devices species (e.g., router, switch, bridge, hub, etc.), or the like. Configuration database40also stores current configuration information (e.g., intent data model, or in some cases, both intent data model and low-level configuration information) for the managed devices (e.g., network elements14). Configuration database40may include a database that comprises a unified intent data model. In some examples, configuration database40may store a low level configuration that includes, for each respective owned resource of a set of owned resources, a pointer indicating an owner for the respective owned resources of network elements14.

Management module24may maintain a data structure in configuration database40. The data structure may include a plurality of vertices and a plurality of edges, each vertex of the plurality of vertices representing a respective network device of a plurality of network devices (e.g., network elements14) or a respective stateless intent of a plurality of stateless intents, and the plurality of edges defining relationships between the plurality of vertices. Management module24may receive an indication of a stateful intent. For example, management module24may receive intent unified-graph-modeled configuration data for a set of managed network devices from a user, such as administrator12.

Partition recovery unit27may be configured to receive a version number for a configuration at a resource (e.g., a resource provided by network element14A). Partition recovery unit27may compare the version number output by the resource and the configuration number for the configuration stored by partition recovery unit27. Partition recovery unit27may output a request for the configuration from the resource based on the comparison. For example, partition recovery unit27may output the request for the configuration from the resource when the version number output by the resource and the configuration number for the configuration stored by partition recovery unit27are different.

Partition recovery unit27may receive the configuration form the resource and update the configuration for the resource stored at partition recovery unit27based on the received configuration from the resource. For example, partition recovery unit27may set the configuration for the resource stored at partition recovery unit27to match the received configuration from the resource. Partition recovery unit27may update the version number for the configuration stored by partition recovery unit27based on received version number from resource. For example, partition recovery unit27may set the version number for the configuration stored by partition recovery unit27to match the received version number from resource. As such, network element14A may move the configuration generated by controller device10without managing stateful intents and/or a unified graph model, which may require a relatively high computational capacity. In this way, an edge controller of network element14A may be implemented using lightweight stateless edge controllers.

Although user interface36is described for purposes of example as allowing administrators12(FIG.1) to interact with controller device10, other interfaces may be used in other examples. For example, controller device10may include a representational state transfer (REST) client (not shown) that may act as an interface to another device, by which administrators12may configure controller device10. Likewise, administrators12may configure network elements14by interacting with controller device10through the REST client.

Management module24may model configuration database40as a graph database representing YANG configuration data elements. YANG specifies various types of data structures, including lists, leaflists, containers, containers with presence, and features. Management module24may model each of lists, containers, containers with presence, and features, as well as a top-level container, as vertices in a graph database. Alternatively, configuration database40may represent YAML configuration data elements.

After constructing a graph database, management module24may perform operations on data of the graph database. For example, management module24may map Netconf-based operations, such as get-config, get-config with filters, and edit-config, to graph query language queries, such as Gremlin queries. Gremlin is described in GremlinDocs at gremlindocs.spmallette.documentup.com and in github.com/tinkerpop/gremlin/wiki. Management module24may execute conditions mapped to vertices and edges of the graph database if the condition attributes are changed. In response to the conditions, management module24may process additional changes, handled as functions as discussed in greater detail below. Management module24may further update all changes in transaction semantics.

FIG.3is a conceptual diagram illustrating an example unified graph model60for an intent data model. The process illustrated inFIG.3may represent an example of how controller device10may generate an intent-generated configuration. Unified graph model60may be an example of a data structure stored by configuration database40ofFIG.2. Unified graph model60, in this example, includes nodes A62, B64, and C66, among others, which may represent respective network devices (e.g., network elements14). As shown, unified graph model60may include edges defining relationships between the plurality of nodes A62, B64, and C66. For instance, edges connecting node B64and node C66via LSP2 may define an RSVP LSP between node B64and node C66.

Initially, unified graph model60may not include VPN68, VPN72, and VPN78, nor optical80, lambda82, optical84, and lambda86. As a result of modifications through intent data model updates, node A62is coupled to node B64via VPN68and LSP170, node B64is coupled to node C66via VPN72and LSP274, and node C66is coupled to node A62via VPN78and LPS376. Furthermore, as a result of additional capacity being required as an optical intent, additional nodes optical80, lambda82, optical84, and lambda86are added between node B64and node C66.

Stateful business policies can be written on top of a stateless intent layer. For example, a user may state the intent “provide high bandwidth VPN connectivity between sites A, B, and C with bandwidth between A-B, B-C, C-A, . . . .” This may lead to various stateless intents. The stateful intent may be compiled into a L3VPN (overlay tunnel) and a transport mechanism between A-B, B-C, C-A that provides the bandwidth required. For example, the transport mechanism may include an RSVP LSP between A-B with 30 Mbps, an RSVP LSP between B-C with 50 Mbps, and an RSVP LSP between C-A with 80 Mbps. In this instance, the RSVP-LSP between C-A with 80 Mbps may need to be created. There could be a situation where more capacity is required, so there may yet be a further intent “optical intent: increase capacity between C-A.” If there is already a 70 Mbps connection for C-A, the stateless intent may provision a new 10G lambda between C-A on an optical network.

When realizing stateful intents, a controller device, such as controller device10, may need to account for existing stateless intents across endpoints, as well as the current state. In the above example, to perform the various intents, controller device10may query a connected graph (including stateless intents) and create/modify the stateless intents, as necessary. Techniques related to using unified graph models and intents are described in U.S. application Ser. No. 15/462,465, filed Mar. 17, 2017, which is incorporated by reference in its entirety. Thus, intent data models can be represented using unified graph models. When more use cases are added, the intent data model (i.e., the unified graph model) can be extended. Also, use of unified graph models allows for retrieval of intents based on endpoints (e.g., by querying the graph).

FIG.4is a conceptual diagram illustrating an example controller device and edge devices214A-214B (collectively, “edge devices214”) for ensuring that provisioned resources satisfy network performance parameters, in accordance with the techniques of the disclosure. Central controller210may be an example of controller device10ofFIG.1. AlthoughFIG.4illustrates two edge devices, central controller210may be connected to more than two edge devices or only one edge device. Edge devices214may represent examples of some of network elements14ofFIG.1. Edge controllers220,221may be separate machines and/or virtual machines configured to manage edge devices214and/or one or more virtual machines (e.g., virtual routers). While some examples refer to edge controller220, such examples may apply additionally, or alternatively, to edge controller221and/or to other edge controllers.

Central controller210(e.g., using centralized cloud management software implemented in circuitry) may provide a management plane for one or more network performance parameters. Central controller210may be configured to allow service subscriptions, intent policies, and/or intent SLA subscriptions.

Edge device214A may include resource222and resource223. Similarly, edge device214B may include resource224and resource225. Although edge devices214are shown to each include two resources, edge devices214may include more than two resources. Moreover, edge devices214may include a different number of resources. For instance, edge device214A may include ‘n’ number of resources and edge device214B may include ‘m’ number of devices, where m and n are different.

Edge controllers220and221may receive “intelligence” from central controller210and may provide data plane management. For example, central controller210may select resources, compile a stateful intent using a unified graph model, and generate a configuration to be applied to resources. The data plane management may be served by individual network devices, which may be implement resources222-225. Networking services (e.g., customer networking services) provided by edge device214A and/or edge device214B could be provided by virtualized devices (e.g., a vRouter or a virtual security appliance (vSRX)).

Edge controllers220and221may provide headless mode support. As used herein, headless mode support may comprise edge controllers220,221moving a configuration from one resource to another resource when the edge controller is unable to communicate with the central controller (e.g., headless mode”). Again, the configuration may configure the resource to perform network services for client devices (e.g., client devices at branches226-231). In some examples, each branch of branches226-231may represent a different geographical site. For example, branch227may represent one or more client devices in a second geographical location and branch226, where the first geographical location is geographically remote from the second geographical location. For example, a connectivity issue (e.g., loss of connection, relatively high latency, relatively low bandwidth, etc.) may occur between central controller210and edge controller220, as both may be deployed in different geographical locations.

During the connectivity issue between central controller210and edge controller220, the data planes between edge controller220and client devices of branches226-228may not be impacted. That is, edge device214A may provide services to client devices of branches226-228during the connectivity issue between central controller210and edge controller220. As such, resources222,223may provide network services (e.g., SLA for customer traffic) during the connectivity issue between central controller210and edge controller220. However, during headless mode, central controller210may not initiate actions to ensure that the network performance parameters are satisfied. In accordance with the techniques of the disclosure, edge controller220may itself initiate actions to ensure that the network performance parameters are satisfied. For example, edge controller220may initiate SLA actions to move a configuration for services (e.g., virtual routing, computing services, etc.) from resource222to resource223to help to ensure that the network performance parameters are satisfied. As used herein, an SLA action may refer to moving network services between resources when a network services parameter (e.g., an SLA) is not met for customer traffic. While SLA actions may be discussed with respect to SLA parameters, edge controller220may be configured to apply actions with respect to other network performance parameters.

Edge controller220and central controller210may be configured to address one or more of: network performance parameter (e.g., SLA) management for headless mode, stateless edge controller support, fault tolerance, or another issue. During network performance parameter (e.g., SLA) management for headless mode, a connectivity issue may occur between central controller210and an Edge POP provided by edge controller220, as central controller210and edge controller220may be deployed in different geographical locations. For example, edge controller220may be geographically proximate to edge device214A and geographically remote from central controller210. During the connectivity issue between central controller210and edge controller220, the data planes may not be impacted. However, during headless mode, central controller210may not initiate actions to ensure that the network performance parameters are satisfied. In accordance with the techniques of the disclosure, edge controller220may initiate actions to ensure that the network performance parameters are satisfied. For example, edge controller220may initiate SLA Actions to move a configuration for network services (e.g., virtual routing, computing services, etc.) from resource222to resource223to help to ensure that the network performance parameters are satisfied.

Edge controller220may be configured for stateless edge controller support. For example, edge controller220may be stateless and get intelligence (e.g., a configuration derived from a stateful intent) from the central controller210. For instance, controller device10may be configured to select resources, compile a stateful intent (e.g., a network performance parameter), and generate, using a unified graph model, a configuration to be applied to resources (e.g., a network element) that satisfies the intent and edge controller220may apply the configuration to resource222without using a stateful intent and/or unified graph model.

Edge controller220may be configured for fault tolerance. That is, edge controller220may be configured to provide an approach for CAP properties, which may refer to data consistency, availability, and partition tolerance between central controller210and edge controller220. Data consistency may refer to providing data such that the data is consistent across central controller210and edge controller220. Edge controller220may be configured to provide data consistency when there is partition as described below.

With partition tolerance, edge devices214may be deployed close to customers (e.g., client devices of branches226-231, and central controller210may be deployed at a central location. In this example, edge devices214may operate despite connectivity or messages being lost between edge controllers220,221and central controller210(e.g., headless mode). With partition tolerance, edge controller220may, once connectivity is established between edge controller220and central controller210, synchronize. For example, edge controller220may move a set of services from resource222to resource223during headless mode. To synchronize, edge controller220may output, to central controller210, an indication that the set of services from resource222to resource223. In this way, central controller210may update the graph model to specify that the set of services are provided by resource223.

Edge devices214should be configured to provide a high availability, irrespective of failures. That is, data planes (e.g., services provided by resources222-225) should be available even when the system is partitioned (e.g., headless mode). Edge controllers220,221may provide SLA management even when there is partition (e.g., headless mode). As used herein, SLA management may refer to a process to provide service level agreements based on customer subscribed properties.

In general, controllers (e.g., central controller210and/or edge controllers220,221) may provide the following functionality to provide network services. The controllers may manage data a model for tenants, a solution model, and/or tenant specific services. The controllers may orchestrate services (e.g., policies and tunnels) on the resources. The controllers may perform SLA management, such as, for example, monitoring resources (e.g., resources222-225) and take SLA actions based on a SLA policy and/or taking SLA action to re-provision the network. In some controller scenarios, the controller may provision network devices and update the internal states.

In accordance with the techniques of the disclosure, central controller210may manage the data model for tenants, a solution model, and/or tenant specific services. Central controller210may orchestrate edge resources (e.g., resources222-225) for the services and/or provide resource capacity planning. Edge Controllers220,221may be lightweight and provide health management of resources and/or SLA management. In some examples, edge controllers220,221may provide fault tolerance, for example, by providing eventual consistency, availability, and/or partition tolerance.

Central controller210may generate a policy configuration and tunnels on edge network devices214based on customer subscribed services and/or network performance parameters (e.g., SLA parameters). The service configuration per customer branch/site may be “namespaced” on a resource. For example, each service configuration per customer branch of branches226-231may include a “Config-group.”

Based on a stateful intent (e.g., the customer SLA policy), central controller210may provide the network performance parameters, such as, for example, SLA parameters (e.g., resource context and optimization parameters) to edge controllers220,221. Edge controllers220,221may manage the network performance parameters. For example, edge controllers220,221may provide the SLA management.

Edge controllers220,221may perform actions (e.g., SLA actions). Edge controllers220,221may move a configuration for services across resources222-225through a tenant and branch namespace (e.g., config-groups). For example, edge controller220may move a configuration for services comprising a config-group for a first tenant and branch226between resource222and resource223.

Central controller210and edge controllers220,221may manage network performance parameters (e.g., perform SLA management). The management of network performance parameters may include service-to-resource mapping and/or configuration regeneration deployment capabilities. Central controller210may read the service-to-resource mapping from datastores of central controller210. In headless mode, central controller210may read the service-to-resource mapping from resources222-225(e.g., seeFIG.5). After headless mode, the service-to-resource mappings may be synchronized from resources.

Central controller210may perform configuration regeneration and deployment. The configuration on the resources may be logically separated through Config-groups. Edge controllers220,221may include a lightweight configuration client that can move the configuration across devices through logical groups. In some examples, edge controllers220,221may not be configured to determine semantics of the configuration. For instance, edge controllers220,221may be lightweight and/or configured to implement stateless configuration and not stateful intent.

In some examples, central controller210may maintain the service-to-resource mapping state. In some examples, resources222-225may maintain the service-to-resource mapping state. Resources222-225may contain metadata of the services, for example, using a tenant and/or branch namespace in configuration (e.g., config-groups).

Central controller210may change the service-to-resource mapping when network services (e.g., service SLA properties) are changed. Edge controllers220,221may change the service-to-resource mapping (e.g., as part of SLA management), when one or more of resources222-225are not meeting network performance parameters (e.g., customer SLA requirements).

Edge controllers220,221may perform actions (e.g., SLA actions). For example, edge controllers220,22may move a configuration for services across resources222-225through a tenant namespace in configuration (e.g., config-groups).

Central controller210and edge controllers220,221may perform resynchronization steps to synchronize the state across central controller210and edge controllers220,221to achieve consistency as shown inFIG.5.

FIG.5is a conceptual diagram illustrating an example state flow for ensuring that provisioned resources satisfy network performance parameters, in accordance with the techniques of the disclosure. While the example ofFIG.5refers to edge controller220, the process performed by edge controller220may be performed by all edge controllers (e.g., edge controller221).

Central controller210and edge controller220may perform fault tolerance. For example, central controller210and edge controller220may be configured for partition tolerance, which may include instances where communication is disrupted between central controller210and edge controller220(e.g., headless mode) as follows. Edge controller220may, when partitioned (e.g., during headless mode), provide network performance parameters (e.g., SLA parameters) by, for example, moving a configuration for customer services across resources222-225and/or launch a new resource and move the configuration for the customer services to the new resource (250).

Central controller210may be available, though edge controller220may be partitioned from central controller210. For example, central controller210may be configured to allow customers to add new policies and/or update policies. However, the configuration for the network services may be provisioned, once resources222,223(e.g., network devices) are connected to central controller210.

In the example ofFIG.5, central controller210and edge controller220may perform partition recovery. When edge controller220is reconnecting to central controller210, central controller210may synchronize (252) the service-to-resource mappings from resources222,223(e.g., network devices). Central controller210may not provision the policy changes, until central controller210synchronizes the resource. For example, central controller210may use a configuration version capability on resources222,223to determine whether to synchronize the service-to-resource mappings from resources222,223. Central controller210may check if the network device version of the service-to-resource mappings is different from the controller version of the service-to-resource mappings to detect if the service-to-resource mappings are out-of-synch. If the service-to-resource mappings are out-of-synch, central controller210may synchronize the service-to-resource mappings (e.g., set the service-to-resource mappings stored by central controller210to the service-to-resource mappings of resources222-225) based on logical groups in configuration (e.g., config-groups). Central controller210may change the service-to-resource mapping using the service-to-resource mapping from resources222,223(254). For instance, central controller210may be configured to synchronize one or more service-to-resource mappings stored by central controller210with resource223in response to determining that a version number output by resource223does not match a corresponding version number for resource223that is stored by central controller210.

FIG.6is a conceptual diagram illustrating an example graph model300, in accordance with the techniques of the disclosure. Central controller210may generate a controller model, for example, graph model300. Central controller210may model controller data in graph model300. Centralized Controller210may manage a tenant and solution data model. The tenant and solution data model may include a tenant, network services (e.g., subscribed services) per customer branch with network performance parameters (e.g., SLA properties), and/or an edge resource (e.g., network devices providing resources222-225) providing the network service to the customer branch (e.g., branches226-231).

Graph model300may include two types of edges (e.g., arcs) between vertices/resources, which may include a reference-edge and a parent-child-edge. The reference-edge may create the reference edge between two resources. In some examples, a referrer object may include a ref property. The parent-child edge and/or a contains edge may create the parent-child edge between the parent and child resources. In some examples, the parent object includes a children property. In some examples, a resource fully qualified (FQ) name includes the parent FQ-Name.

In the example ofFIG.6, graph model300may represent Branch1 FQ-name::Tenant1: Branch1 where branch304(“branch 1”) references tenant302(“tenant 1”) and includes FQ-name, which may refer to a subscribed service. Similarly, graph model300may represent Branch2 FQ-name::Tenant1: Branch2 where branch306(“branch 2”) references tenant302(“tenant 1”) and includes FQ-name, which may refer to a subscribed service. In this example, graph model300may represent Branch3 FQ-name::Tenant2: Branch3 where branch310(“branch 1”) references tenant312(“tenant 2”) and includes FQ-name, which may refer to a subscribed service. In this example, branches304,306,310use network services provided by resource308.

Central controller210may perform service-to-resource mapping. For example, a resource (e.g., a network device) present in an edge device may be modeled in central controller210using graph model300. Branches304,306, and310may be associated with a resource (e.g., a network device) based on network performance parameters (e.g., SLA properties). In an edge controller (e.g., edge controller220,221), a same resource may provide network services for multiple branches and/or customer endpoints. Branches may have a reference association with the resources.

Central controller210may generate a network device configuration model for each resource. The resources may provide a NETCONF interface to manage the configuration on the resources. Central controller210may push each tenant associated configuration in a separate configuration group. In some examples, central controller210may generate the network device configuration with an indication of a version. When a configuration is changed, the version would be changed/incremented by the resource. Central controller210may maintain the version of the network device configuration stored by central controller210.

Central controller210may output a resource allocation context to the resources. For example, central controller210may allocate services to resources based on optimization parameters (e.g., load balancing between resources). In some examples, central controller210may generate the resource allocation context to include one or more of a resource context, one or more resource optimization parameters, and/or a resource association constraint.

The resource context may include allocation information for a resource. For example, the resource context may include a tenant name, a service, and an FQ name (e.g., Tenant Service FQ-Name). The request optimization parameters may include one or more parameters on which a network performance parameter (e.g., SLA property) is measured.

The resource association constraint may indication one or more constraints for moving a configuration for network services. For example, in some deployments, a resource cannot provide multi-tenancy, where the resource may only provide services to up to one tenant. Central controller210and the edge controller may assign the resources based on whether a resource cannot provide multi-tenancy. The resource association constraint may be a hierarchical request path. The hierarchical request path can be an FQ-Name of a branch. The hierarchical request path may signify the resource allocation constraints. For example, the hierarchical request path may be as follows.Request 1: Tenant1.Branch1Request 2: Tenant2. Branch5Request 3: Tenant1.Branch2

In this example, the edge controllers (e.g., edge controllers221,222) may provide network services for Request1 and Request3 using a first resource. However, the edge controllers may be configured to provide network services for Request2 by a second resource that is different than the first resource.

Central controller210may provide service orchestration. For example, central controller210may orchestrate the configuration on network devices based on policies (e.g., stateful intent). Central controller210may push the configuration for services in a separate group. For instance, the configuration group name may be “Tenant Service FQ-Name”. Central controller210may orchestrate the configuration within the “Tenant Service config group” based on tenant requirements (e.g., resource association constraint). An example configuration is as follows.

Configuration {group Customer1.Bangalore.SecurityService {// Services, Policies config}apply-groups Customer1..Bangalore;}

FIG.7is a conceptual diagram illustrating an example process for ensuring that provisioned resources satisfy network performance parameters, in accordance with the techniques of the disclosure. While the example ofFIG.7refers to edge controller220, the process performed by edge controller220may be performed, alternatively, or additionally, by one or more other edge controllers (e.g., edge controller221).

Edge Controller220may be lightweight and be configured to provide the health management of resources. Edge Controller220and resource223may be configured to provide SLA management. Based on a customer SLA policy, a central controller (e.g., central controller210) may provide SLA parameters (e.g., resource context and optimization parameters) to edge controller220. Edge controller220may provide the SLA management.

Edge controller220may provide SLA actions as follows. Edge controller220may derive the solution configuration namespace based on a resource allocation context. Based on the resource allocation context (e.g., resource optimization parameters), edge controller220(e.g., with management software executed by edge controller220) may move a configuration for services for a branch across resources based on a configuration namespace. Edge controller220may orchestrate the resources for network services based on a resource allocation context.

Edge controller220may be configured for partition tolerance. Edge controller220may be deployed geographically close to branches for customers and central controller210may be deployed on different clouds. In this example, edge controller220may continue to operate despite the connectivity or messages being lost between edge controller220to central controller210(e.g., headless mode may be supported at edge controller220). In this example, when the network performance parameter is not met for a customer, edge controller220may move a configuration for network services for a particular customer site workload/services to another resource (e.g., a new resource or an existing resource). For example, if the network performance parameter (e.g., a customer SLA) is not met, edge controller220may identify another resource. In this example, edge controller220may derive the solution configuration namespace based on resource allocation context, which may be provided by central controller210. Edge controller220may generate a “Config-Group” request based on the solution configuration namespace. Edge controller220may fetch the corresponding configuration from a resource currently assigned to provide the services (e.g., an existing resource). In this example, edge controller220may move the configuration to another resource (e.g., a new resource).

Edge controller220may provide the network services (e.g., SLA) for customer traffic even when connectivity is not present between edge controller220and central controller210. Central controller210may provide high availability (HA). If the connectivity is not present between central controller210and edge controller220, central controller210may add new branches and/or policies. These requests would be served as soon as edge controller220has completed moving services from a resource to another resource. Central controller210may maintain the service-to-resource mapping states as configured and as deployed. Once the configured service-to-resource mappings are provisioned, central controller210may move the states to the deployed configuration.

Edge controller220may be configured to provide high availability (HA). If the connectivity is not present between central controller210and edge controller220, edge controller220may operate in headless mode. For example, edge controller220may provide the management (e.g., SLA management) for the branches.

In the example ofFIG.7, edge controller220may detect an SLA threshold on a network device (402). For example, edge controller220may determine that resource222provides an amount of bandwidth to branch226that is less than the SLA threshold bandwidth. Edge controller220may generate a solution configuration namespace (404). For example, edge controller220may determine to move a configuration for providing the bandwidth to branch226from resource222.

Edge controller220may pick a network device based on the SLA properties (406). For example, edge controller220may pick resource223to provide the bandwidth to branch226. In some examples, edge controller220may generate a new resource (e.g., a virtual router) to provide the bandwidth to branch226. Edge controller220may create a configuration group and push the configuration (408). For example, edge controller220may move, using a configuration group, a set of configurations for providing the bandwidth to branch226from resource222to resource223. In some examples, edge controller220may move, using a configuration group, a set of configurations for providing the bandwidth to branch226from resource222to a new resource.

FIG.8is a conceptual diagram illustrating an example process for resynchronization of a state, in accordance with the techniques of the disclosure. While the example ofFIG.8refers to edge controller220, the process performed by edge controller220may be performed, alternatively, or additionally, by one or more other edge controllers (e.g., edge controller221).

Central controller210and edge controller220may be configured for partition recovery. Once the partition is recovered (e.g., once connectivity has been restored between central controller210and edge controller220), the state in central controller210and edge controller220may be resynched. As part of resyncing the state, central controller210may check if the configuration on the resources is the same as the version stored by central controller210. That is, central controller210may get the configuration version from resource223(502). For example, central controller210may determine that the configuration on the resource is the same as the version stored by central controller210based on the configuration version of the resource. That is, central controller210may compare the configuration version of the configuration for network services stored in central controller210and the version of the configuration for network services stored by resource223(504). If version stored by central controller210and of the configuration version of the resource are different, central controller201may receive the associated config group names from resource223(506). Central controller201may build the service-to-resource mappings. That is, central controller201may build branch associations and update the service-to-resource mappings (508). Central controller201may compare the model in central controller210and resync. That is, central controller201may mark resource223in synch (510), update the branch associations (e.g., a service-to-resource mapping) (512) with edge controller220, and push a configuration for policies and services to resource223(514).

Central controller201may be configured to deploy a controller state (e.g., policies and/or services). Central controller210may maintain network services and/or policy objects in a configured state. Central controller201may generate the configuration for these changes and deploy to one or more configurations at resources in edge devices214.

In accordance with the techniques of the disclosure, central controller210and edge controllers220,221may provide an approach to provide network services (e.g., SLA) in edge controller220,221with resource constraint semantics. In some examples, central controller210and edge controllers220,221may provide an approach to run light weight stateless edge controllers220,221to support an edge environment. In some examples, central controller210and edge controllers220,221may provide an approach to run edge controllers220,221in headless mode without compromising consistency, availability, and/or a partition tolerance. In some examples, central controller210and edge controllers220,221may provide an approach to run central controller210and edge controllers220,221in different locations with consistency.

FIG.9is a flow chart illustrating an example process for ensuring that provisioned resources satisfy network performance parameters, in accordance with the techniques of the disclosure.FIG.9is discussed with reference toFIGS.1-8for example purposes only.

An edge controller (e.g., edge controllers214) may receive, from a central controller (e.g., central controller210), a plurality of configurations comprising a first configuration for provisioning a first set of network services at a first resource of an edge device and a second configuration for provisioning a second set of network services at the first resource, a first configuration group identifier identifying a configuration group for the first configuration, and a first network performance parameter for the configuration (602). The central controller may generate the plurality of configurations using a stateful intent. In some examples, the central controller may generate the plurality of configurations using a unified graph model. A configuration group identifier may include one or more of a tenant name or a branch name. For example, the first configuration group identifier may comprise a tenant name. In some examples, the first configuration group identifier may comprise a branch name for the one or more client devices.

The edge controller may apply the plurality of configurations at the resource (604). For instance, edge controller220may output a plurality of configurations at resource222and resource222applies the plurality of configurations. After applying the plurality of configurations to the first resource, the edge controller may determine a performance factor for the first resource providing the first set of network services to one or more client devices (606). For example, the edge controller may determine an amount of bandwidth between the first resource and the one or more client devices. For instance, edge controller220may determine an amount of bandwidth between resource222and one or more client devices at branch226. In some examples, the edge controller may determine an amount of latency between the first resource and the one or more client devices. For instance, edge controller220may determine an amount of latency between resource222and one or more client devices at branch226. In some examples, the edge controller may determine an amount of jitter between the first resource and the one or more client devices. For instance, edge controller220may determine an amount of jitter between resource222and one or more client devices at branch226.

The edge controller may determine that the performance factor does not satisfy the first network performance parameter (608). For example, the edge controller may determine that the performance factor does not satisfy the first network performance parameter in response to a determination that an amount of bandwidth between the first resource and the one or more client devices is less than a bandwidth threshold specified by the performance factor. In some examples, the edge controller may determine that the performance factor does not satisfy the first network performance parameter in response to a determination that an amount of latency between the first resource and the one or more client devices is greater than a latency threshold specified by the performance factor. In some examples, the edge controller may determine that the performance factor does not satisfy the first network performance parameter in response to a determination that an amount of jitter between the first resource and the one or more client devices is greater than an amount of jitter threshold specified by the performance factor.

In response to a determination that the performance factor does not satisfy the first network performance parameter for the configuration group and that the first configuration group identifier identifies the configuration group for the first configuration, the edge controller may move the first configuration from the first resource to a second resource of the edge device based on receiving the first configuration group identifier for the first configuration (610). For example, the edge controller may remove the first configuration from the first resource and add the first configuration to the second resource.

In some examples, the edge controller may receive, from the central controller, a resource association constraint indicating one or more constraints for moving the first configuration. The edge controller may select the second resource based on the resource association constraint. For example, the edge controller may select the second resource instead of a third resource in response to determining that the third resource would provide network services to more than one tenant if the first configuration is moved to the third resource and that the third resource supports only one tenant and in response to determining that the second resource supports multi-tenancy.

In some examples, the edge controller may receive a second configuration group identifier identifying the configuration group for the second configuration that is the same configuration group for the first configuration. In this example, the edge controller may, in response to a determination that the performance factor does not satisfy the first network performance parameter for the configuration group and that the second configuration group identifier identifies the configuration group for the second configuration, move the second configuration from the first resource to the second resource of the edge device.

In some examples, the edge controller may receive a second configuration group identifier identifying a second configuration group for the second configuration that is different from the first configuration group for the first configuration. In this example, the edge controller may refrain from moving the second configuration from the first resource to the second resource of the edge device in response to determining the second configuration group identifier identifies the second configuration group for the second configuration. In this example, the edge controller may receive a second network performance parameter for a second configuration group indicated by the second configuration group identifier. After applying the plurality of configurations to the first resource, the edge controller may determine a second performance factor for the first resource providing the second set of network services to one or more second client devices. In response to a determination that the second performance factor does not satisfy the second network performance parameter and that the second configuration group identifier identifies the second configuration group for the second configuration, the edge controller may move the second configuration from the first resource to the second resource of the edge device. In response to the determination that the second performance factor does satisfy the second network performance parameter and that the second configuration group identifier identifies the second configuration group for the second configuration, the edge controller may refrain from moving the second configuration from the first resource to the second resource of the edge device.

In some examples, a resource may update a version number for the plurality of configurations in response to moving the first configuration from the first resource to the second resource. For example, the first resource may increment a version number for a plurality of configurations at the first resource in response to removing the first configuration from the first resource. In some examples, the second resource may increment a version number for the plurality of configurations at the second resource in response to adding the first configuration to the second resource. In this example, the resource may output, to the central controller, an indication of the version number.

In some examples, the edge controller may move the configuration in headless mode. For example, the edge controller may initiate the move of the configuration without communication with the central controller (e.g., central controller210). The edge controller may initiate the move of the configuration when the edge loses connectivity with the central controller.

Client devices may be geographically arranged at different branches (also referred to herein as “sites”). For example, one or more first client devices may be assigned to a first branch (e.g., branch226). In this example, one or more second client devices may be assigned to a second branch (e.g., branch227). In this example, to apply the plurality of configurations, the edge controller may apply the first configuration to the first resource to cause the first resource to provide the first set of network services to the one or more first client devices and apply the second configuration to the first resource to cause the first resource to provide the second set of network services to one or more second client devices assigned to a second branch. Again, the first branch may correspond to a geographical location different from the second branch. In some examples, the first branch and the second branch are assigned to a common tenant. For instance, the first branch may comprise one or more first client devices in a first office location for a tenant and the second branch may comprise one or more second client devices in a second office location for the tenant. In some examples, however, the first branch and the second branch are assigned to different tenants.

In some examples, the edge device is geographically closer to the one or more client devices than the central controller. For example, the edge device may be arranged on an “edge” of a network that is closest to the one or more client devices than other edge devices of the network and the central controller.

A resource may be a virtualized device or a network device. For example, the first resource may comprise a virtualized device (e.g., a virtual router). In some examples, the first resource may comprise a network device managed by the edge controller. For instance, the first resource may comprise a server configured to provide network services relating to providing computes to the one or more client devices. In some instances, the first resource may comprise a physical router or physical switch configured to provide networking services relating to network packet routing (e.g., a firewall).

FIG.10is a flow chart illustrating an example process for a central controller, in accordance with the techniques of the disclosure.FIG.10is discussed with reference toFIGS.1-9for example purposes only.

A central controller (e.g., central controller210) may receive a stateful intent from an administrator (702). The central controller may compile, using a unified graph model, the stateful intent into a configuration for a resource (704). In some examples, the central controller may generate a version number for the configuration. The central controller may output the configuration to an edge controller (e.g., edge controller220) to apply the configuration at a resource (706). In some examples, the central controller may output the version number for the configuration.

The central controller may receive a version number for the configuration at the resource (708). The central controller may compare the version number output by the resource and the configuration number for the configuration stored by the central controller (710). The central controller may output a request for the configuration from the resource based on the comparison (712). For example, the central controller may output the request for the configuration from the resource when the version number output by the resource and the configuration number for the configuration stored by the central controller are different.

The central controller may receive the configuration form the resource (714) and update the configuration for the resource stored at the central controller based on the received configuration from the resource (716). For example, the central controller may set the configuration for the resource stored at the central controller to match the received configuration from the resource. The central controller may update the version number for the configuration stored by central controller based on received version number from resource (718). For example, the central controller may set the version number for the configuration stored by central controller to match the received version number from resource.

FIG.11is a flow chart illustrating an example process for a resource, in accordance with the techniques of the disclosure.FIG.11is discussed with reference toFIGS.1-10for example purposes only.

A resource (e.g., resource222) may receive, from an edge controller (e.g., edge controller220) a set of configurations and a version number for a resource configuration (802). The resource may apply the set of configurations at the resource (804). The resource may receive an updated set of configurations from the edge controller (806). For example, the resource may receive an updated set of configurations from the edge controller that is in response to the resource not satisfying a network performance parameter. In accordance with the techniques of the disclosure, the resource may receive an updated set of configurations from the edge controller during headless mode.

The resource may apply the updated set of configurations (808) and update the version number for the resource configuration (810). For example, the resource may increment the version number for the resource configuration. The resource may output an updated version number for the resource configuration to the central controller (812). The resource may receive a request for the updated set of configurations from the central controller (814) and output an indication of the set of configurations to the central controller (816).

The techniques described in this disclosure may be implemented, at least in part, in hardware, software, firmware or any combination thereof. For example, various aspects of the described techniques may be implemented within one or more processors, including one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or any other equivalent integrated or discrete logic circuitry, as well as any combination of such components. The term “processor” or “processing circuitry” may generally refer to any of the foregoing logic circuitry, alone or in combination with other logic circuitry, or any other equivalent circuitry. A control unit comprising hardware may also perform one or more of the techniques of this disclosure.

Such hardware, software, and firmware may be implemented within the same device or within separate devices to support the various operations and functions described in this disclosure. In addition, any of the described units, modules or components may be implemented together or separately as discrete but interoperable logic devices. Depiction of different features as modules or units is intended to highlight different functional aspects and does not necessarily imply that such modules or units must be realized by separate hardware or software components. Rather, functionality associated with one or more modules or units may be performed by separate hardware or software components, or integrated within common or separate hardware or software components.

The techniques described in this disclosure may also be embodied or encoded in a computer-readable medium, such as a computer-readable storage medium, containing instructions. Instructions embedded or encoded in a computer-readable medium may cause a programmable processor, or other processor, to perform the method, e.g., when the instructions are executed. Computer-readable media may include non-transitory computer-readable storage media and transient communication media. Computer readable storage media, which is tangible and non-transitory, may include random access memory (RAM), read only memory (ROM), programmable read only memory (PROM), erasable programmable read only memory (EPROM), electronically erasable programmable read only memory (EEPROM), flash memory, a hard disk, a CD-ROM, a floppy disk, a cassette, magnetic media, optical media, or other computer-readable storage media. The term “computer-readable storage media” refers to physical storage media, and not signals, carrier waves, or other transient media.