Abstract:
In a communication network comprising nodes and links between the nodes, a controller node disseminates routing information including nodal routing tables. A nodal routing table for a given node comprises alternate routes from the given node to other nodes in the network. A controller of the network receives traffic information from nodes and, based on the received traffic information, determines a set of adaptive routing information corresponding to each said node and transmits each set of adaptive routing information to the respective node. Determining the set of adaptive routing information is performed according to a courteous routing scheme. The routing scheme is labeled as “courteous” because, in a contention state, a node-pair that would suffer the least by directing a part of its traffic away from a preferred path yields to node pairs that suffer more by redirecting their traffic. Courteous routing increases the payload throughput and decreases real-time processing effort. A node, having received the set of adaptive routing information, initializes a set of vacancy vectors. The vacancy vectors are used while allocating incoming connection requests to routes. While a connection is allocated to a route, the available capacity of the allocated route, as reported in the vacancy vector, is reduced by the load of the allocated connection.

Description:
FIELD OF THE INVENTION 
     The present invention relates to routing schemes in communication networks and, more particularly, to a courteous routing scheme. 
     BACKGROUND OF THE INVENTION 
     Routing in a telecommunication network is a critical function that shapes the design and operation of the network. The routing function in circuit-switched and data networks has been extensively studied. In particular, routing schemes in circuit-switched networks, such as the public switched telephone network (PSTN), have been enhanced over the past few decades. However, circuit-switched networks are not, at present, undergoing any significant changes, and currently-employed routing schemes, such as classical hierarchical routing and the variety of flat-routing schemes including those known as adaptive routing, dynamic routing and high-performance routing, are likely to remain unchanged. Data networks, in contrast, are undergoing significant changes. In particular, the Internet has experienced very rapid growth in coverage and capacity. In addition to coverage and capacity expansion, it is now widely recognized that quality control is a major requirement for an effective global Internet. The manner in which quality-of-service (QoS) and grade-of-service (GoS) are controlled is determined primarily by schemes employed for routing and traffic allocation. A node controlling QoS or GoS should have an ability to allocate traffic loads among alternative outgoing routes. 
     A network may be modeled as comprising nodes that are fully or partially interconnected by (transmission) links, where the links may have different capacities and different associated costs. As well, the number of links emanating from each node may vary from one node to another. The term “node”, as used herein, is used for a router or switch responsible for routing and traffic allocation. A route is a link or a chain of links connecting a source node to a sink node where a source node is the node supporting traffic sources (the origins of traffic) and a sink node is the node supporting traffic sinks (the destinations of traffic). A node functioning as a router determines a subjective “best route” to another node based on various factors which may be combined to determine a cost factor. The factors may include qualities such as reliability and delay. A node may function as a source node and a sink node for distinct streams of traffic. 
     A source node and a sink node form a “node-pair”. For a particular node-pair, each member of an associated “route set” is a different route between the source node and the sink node that comprise the node-pair. The routes within each route set may be selected to have different first links and may be ranked according to such criteria as total cost and route intersection levels. Conventionally, the route sets for different node-pairs are, however, determined independently without considering the level of intersection among routes connecting different sources to sinks. 
     Upon arrival of a connection request at a particular node, a controller of that particular node may allocate the requested connection to one of the routes in a route set associated with the node-pair comprising the particular node and the sink node specified by the connection request. In one routing scheme, the route to which the requested connection is allocated may be, for instance, the highest ranked route that has sufficient free capacity, where the routes of a route set are ranked by cost. 
     In many routing schemes, a particular route in a route set may further have an x associated “static route capacity” which is representative of the full capacity of the link in the route that has least capacity. By definition, the “full capacity” of a link is the maximum data rate that can be supported by the link. The static route capacity of a particular route in a route set may be included in the same data structure that identifies the path of each route in the route set, or may otherwise be made available to a source node. However, the full capacity of one link in the particular route may not always be available to a source node considering allocation of a connection to the particular route. 
     Traffic allocated to routes in distinct route sets may compete for the capacities of common links. This results in two undesirable effects. The first is that a high proportion of connection attempts may fail to use the best route, leading to use of other routes in respective route sets for the node-pairs and increasing the required computational effort. The second is that haphazard redirection of a connection away from its best route may lead to a connection being allocated to a next best route in a meager route set (i.e., a route set with few members). Where one connection between a first node-pair has been allocated to a first route, the next best route in the meager route set of a second node-pair may be significantly more costly than the next best route in the route set for the first node-pair. 
     SUMMARY OF THE INVENTION 
     The routing scheme of the present invention is called “courteous” because the node-pair that suffers the least by a diversion of a part of its traffic to a higher-cost route yields the use of a potentially overloaded link to node-pairs that suffer more by redirecting traffic. The method of the present invention involves providing nodes with route-adaptation information including a route set for each node-pair, and a load-adaptation vector to associate with each route set. A route set includes a number of alternate routes from a source node to a sink node and a load-adaptation vector influences the allocation of traffic to individual routes within the route set with which it is associated. The method uses a minimum-penalty criterion with minimum route-intersection to resolve conflicting objectives. The route-adaptation information may, periodically, be updated in response to a metric representative of traffic change exceeding a threshold. 
     In accordance with an aspect of the present invention there is provided, at a controller of a network, the network including nodes and links between the nodes, a method of distributing routing information to the nodes, the method including receiving traffic information from the nodes and, based on the received traffic information, determining adaptive routing information corresponding to each node. The method further includes transmitting to each node the corresponding adaptive routing information for use by each node in making traffic routing decisions. In a further aspect of the present invention, there is provided a software medium that permits a general purpose computer to carry out this method. 
     In accordance with a further aspect of the present invention there is provided, in a network including nodes interconnected by links, where each of the nodes has a route set corresponding to each other of the nodes in the network, and each route set comprises a set of routes to the each other of the nodes in the network, a method of route capacity allocation, including transmitting, to each of the nodes, node-specific adaptive routing information for use by each of the nodes in route capacity allocation, and receiving traffic information from the nodes. The method further includes, responsive to a determination that, based on the received traffic information and the node-specific adaptive routing information, traffic allocated to two or more routes having a common link may overload the common link, altering the node-specific adaptive routing information such that a proportion of traffic allocated to a given route of the two or more routes having the common link is re-directed to an alternate route where the given route is in a given route set in which a cost differential between the given route and the alternate route is a minimum. The method also includes transmitting the altered node-specific adaptive routing information to each of the nodes to which the altered node-specific adaptive routing information corresponds. 
     In accordance with a further aspect of the present invention there is provided, at a first node in a network, the network including nodes, links between the nodes and a controller, a method of allocating connection requests to routes, the method including receiving a load-adaptation vector, the load-adaptation vector corresponding to a route set including different routes between the first node and a second node in the network, each element in the load-adaptation vector corresponding to a unique route in the route set and having a value for influencing allocation of traffic to the unique route. The method also includes initializing a vacancy vector, receiving a request to connect the first node to the second node, the request having an associated load size and comparing an element in the vacancy vector to the load size. Where a given element in the vacancy vector exceeds or equals the load size, the method includes allocating the request to a route corresponding to the given element and reducing the available capacity indicated by the given element by the load size. In another aspect of the invention a node is provided for performing this method. In a further aspect of the present invention, there is provided a software medium that permits a general purpose computer to carry out this method. 
     Other aspects and features of the present invention will become apparent to those ordinarily skilled in the art upon review of the following description of specific embodiments of the invention in conjunction with the accompanying figures. 
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS 
     In the figures which illustrate example embodiments of this invention: 
     FIG. 1 is a schematic network of nodes representing a communications network; 
     FIG. 2 illustrates, in a flow diagram, a load-adaptation vector distribution method in an embodiment of the present invention; 
     FIG. 3 illustrates, in a flow diagram, a traffic measurement processing method as part of the method illustrated in FIG. 2; 
     FIG. 4 illustrates three exemplary traffic matrices in an embodiment of the present invention; 
     FIG. 5 illustrates, in a flow diagram, a load-adaptation vector determination method as part of the method illustrated in FIG. 3; 
     FIG. 6 illustrates, in a flow diagram, an overloaded link processing method as part of the method illustrated in FIG. 5; 
     FIG. 7 illustrates, in a flow diagram, a connection request processing method in an embodiment of the present invention; 
     FIG. 8 illustrates, in a flow diagram, a connection allocation method as part of the method illustrated in FIG. 7 in an embodiment of the present invention; 
     FIG. 9 is a schematic network of nodes representing a communications network; 
     FIG. 10 illustrates an independent routing table for the network of FIG. 9; 
     FIG. 11 illustrates a traffic matrix for the network of FIG. 9; 
     FIG. 12 illustrates a link load matrix for the network of FIG. 9 after load-adaptation vector initialization and mapping of a traffic matrix onto the highest ranked routes; 
     FIG. 13 illustrates a link load matrix for the network of FIG. 9 after processing of a list of potentially overloaded links; 
     FIG. 14 illustrates occupancy and vacancy vectors before and after the receipt of a new load-adaptation vector; 
     FIG. 15 illustrates, in a flow diagram, a traffic measurement processing method as part of the method illustrated in FIG. 2 in a second embodiment of the present invention; 
     FIG. 16 illustrates, in a flow diagram, an adaptive routing table determination method as part of the method illustrated in FIG. 15; and 
     FIG. 17 illustrates, in a flow diagram, an overloaded link processing method as part of the method illustrated in FIG.  16 . 
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
     FIG. 1 models a communication system as a graph  100  of nodes  102 A,  102 B,  102 C,  102 D and  102 E which are interconnected by payload links  120 . “Node”, as used herein, is another name for a router or switch. A number of subtending traffic sources and traffic sinks (work stations, servers, etc., not shown) may be connected to each of the nodes  102 . Each of the payload links  120  (shown in solid lines) in graph  100  may be representative of a single unidirectional link or two unidirectional links, one unidirectional link for each of the opposite directions. Each node  102 A,  102 B,  102 C,  102 D and  102 E is shown to comprise a corresponding node controller  106 A,  106 B,  106 C,  106 D and  106 E. An exemplary node controller  106 A is shown to comprise a memory  110 A and a processor  108 A loaded with traffic allocation software for executing a method of this invention from software medium  112 . Each node controller  106  communicates with a network controller  104  through a control channel  122  (shown in dashed lines). Network controller  104  is available to communicate with nodes  102  through a connection  124  to a port on node  102 E. The control channels  122  would typically be embedded in payload links  120 . Network controller  104  comprises a memory  116  and a processor  114  loaded with load-adaptation vector determining software for executing a method of this invention from software medium  118  which, like software medium  112 , could be a disk, a tape, a chip or a random access memory containing a file downloaded from a remote source. In a large-scale network, having, for example, several thousand nodes, network controller  104  may be distributed among nodes  102  and each control channel  122  may be a virtual channel within a payload link  120 . 
     In operation, a given node receives a request for a connection to a particular sink node and allocates traffic associated with the request to a route in a route set associated with the node-pair comprising the given node and the sink node. Where traffic load is a measure of capacity required by a connection, a divisible traffic load may be allocated to several different routes of a route set. The computation of capacity requirements, based on traffic-load characterization, is well known in the prior art. Since traffic between two nodes is usually divisible (i.e., comprising numerous connections that may be routed differently), and route capacity is typically at least two orders of magnitude larger than the capacity requirement of a connection, a load-adaptation coefficient may be associated with each route in a route set. Such a coefficient for a given route in the route set represents the fraction of the total node-pair traffic-load which is carried by the given route such that the sum of the coefficients for a given route set is unity. Thus, the load-adaptation coefficients for a five member route set denoted [R 1 , R 2 , R 3 , R 4 , R 5 ] may be [0.2, 0.1, 0.4, 0.05, 0.25] at one instant and, at another instant, the load-adaptation coefficients may change to [0.16, 0.24, 0.32, 0.0, 0.28]. A coefficient of zero may indicate that at least one link in the corresponding route is fully loaded or that the corresponding route is inoperable due to failure. Such a failure may be determined upon receipt of a link state change indication generated at a network controller in response to learning of a link failure. A coefficient, set to zero on a received indication of a link failure, is restored upon receipt of a link state change indication generated at a network controller in response to learning of a link recovery. A load-adaptation vector may be defined for each route set to combine load-adaptation coefficients and a node-pair traffic-load value. The node-pair traffic-load value is the lesser of the sum of the static route capacity of each route in the route set and an anticipated traffic load for the entire route set. Each element in a load-adaptation vector is the product of the node-pair traffic-load value and the load-adaptation coefficient specified for a respective route. For instance, if a node-pair traffic-load value is 50, measured in the same (arbitrary) traffic units used to quantify the load-adaptation vector, and the load-adaptation coefficients are [0.2, 0.1, 0.4, 0.05, 0.25], the corresponding load-adaptation vector would be [10.0, 5.0, 20.0, 2.5, 12.5]. A capacity vector may be generated at each node to indicate the capacity (measured in arbitrary traffic load units) of each direct link from another node. An exemplary capacity vector for a node in a ten node network may be [200, 0, 0, 100, 50, 70, 0, 100, 25, 50] where an element with a value of zero represents a lack of a direct link to the node corresponding to the element. The link capacity is always measured in bits per second. 
     A given node maintains a record of traffic allocated to each route in a route set in an occupancy vector. The given node also initializes a vacancy vector for a particular route set that provides an indication of available capacity for each route in the route set. A vacancy vector is based on a load-adaptation vector, received from a network controller, and a current occupancy vector. Initializing a vacancy vector involves setting each element of the vacancy vector equal to the difference between corresponding elements in the load-adaptation vector and the current occupancy vector, as discussed hereinafter in conjunction with FIG.  14 . Upon receiving a connection request, the given node allocates the request to the highest ranked route in the appropriate route set having sufficient remaining capacity. In the vacancy vector, the element corresponding to the route to which the connection has been allocated is reduced by the amount of traffic load requested in the connection request. Once the allocated connection has completed use of the route, the vacancy vector may be updated to reflect the return of available capacity to the formerly allocated route. The vacancy vector for a given route set is re-initialized each time a new load-adaptation vector is received from the network controller for the route set. 
     In overview, the method of the present invention initially involves allocation of traffic load in a “selfish” manner, that is, each stream of traffic is tentatively allocated to the best route from source to destination without regard for allocation of other streams to their respective best routes. Through such tentative allocation, potentially overloaded links may be identified. If potentially overloaded links are identified, the tentative traffic allocation is adapted such that some node-pairs, those which suffer least by a transfer of partial, or full, traffic load to higher-cost routes, yield the use of a potentially overloaded link to node-pairs that suffer more by redirecting traffic. 
     With reference to FIGS. 1 and 2, an overall routing table comprising independent route sets for each node-pair in graph  100  is formulated at network controller  104  (step  202 ). For a method of formulating an overall routing table comprising route sets which takes into account competition for the capacity of a given link between routes within a given route set, see U.S. patent application Ser. No. 09/405003, filed Sep. 27, 1999, and hereby incorporated by reference. Subsequent to overall routing table formation, a node-specific nodal routing table may be distributed (step  204 ), over a control channel  122 , to node controllers  106 A,  106 B,  106 C,  106 D and  106 E. A nodal routing table for a particular source node comprises a ranked route set corresponding to each sink node in graph  100 . Each route in a route set may be specified such that it includes identifiers of intermediate nodes, if any, between the source node and the sink node and, optionally, reserved capacity. Periodically, node controllers  106  may report traffic information to network controller  104  including traffic load to each other node. When a change in the capacity of a link occurs, node controllers  106  may also report this change to network controller  104 . Network controller  104  receives this traffic information (step  206 ) over a control channel  122 , from node controllers  106 A,  106 B,  106 C,  106 D and  106 E. The received traffic information may then be processed (step  208 ). Based on a traffic deviation metric (derived from the received traffic information)  5  exceeding a threshold, network controller  104  may update load-adaptation vectors (generally speaking, adaptive routing information). These updated load-adaptation vectors may then be transmitted to node controllers  106 A,  106 B,  106 C,  106 D and  106 E (step  210 ). 
     Step  208  of FIG. 2 is expanded upon in FIG.  3 . Network controller  104  (FIG. 1) receives a traffic load vector (step  206 , FIG. 2) from each node controller  106  indicating  10  expected traffic loads. Such a traffic load vector includes an element corresponding to each other node. Each element in a traffic load vector is representative of the average, or filtered, traffic load transmitted to the node corresponding to the element. These traffic load vectors are combined to create (step  302 ) a new traffic matrix such as that shown at  404  in FIG.  4 . The new traffic matrix is compared to a previous traffic matrix (step  304 ), such as that shown at  402  in FIG. 4, such that the comparing results in a traffic deviation metric Δ. The metric Δ is preferably normalized to lie in the range from 0.0 to 1.0. The traffic deviation metric is compared to a predetermined threshold (step  306 ). If the traffic deviation metric does not exceed the threshold, the traffic processing step is complete. However, if the traffic deviation metric exceeds the threshold, the set of load-adaptation vectors is updated (step  308 ) based on the new traffic matrix. A typical value of a normalized threshold is 0.05. 
     FIG. 4 illustrates a number of exemplary traffic matrices created (step  302 ) from received traffic-load vectors after successive time intervals. Traffic deviation metric Δ may be computed by summing the magnitude of change in traffic for each node-pair in a network. As such, traffic deviation metric Δ may be computed as        Δ   =         ∑   i                               ∑   j                                    y   ij     -     x   ij                    ∑   k                             c   k                                
     where y ij  is used to represent an element in a new traffic matrix corresponding to the traffic between source node i and sink nodej, x ij  is used to represent an element in a previous traffic matrix and C k  is used to represent the total access capacity of node k, i.e., the combined capacity provided to the traffic sources and sinks supported by node k. For example, the traffic deviation metric Δ computed through a comparison of traffic matrix  402  to traffic matrix  404  may be 20/80, where 80 is an exemplary total capacity of the network in question. Similarly, the traffic deviation metric Δ computed through a comparison of traffic matrix  404  to traffic matrix  406  is then 54/80 and the traffic deviation metric Δ computed through a comparison of traffic matrix  406  to traffic matrix  402  is 56/80. 
     FIG. 5 illustrates steps involved in a procedure, used in step  308  of FIG. 3, for determining load-adaptation vectors at network controller  104 . Once capacity vectors have been received from node controllers (step  502 ), the network controller can create a capacity matrix (step  504 ) indicating the capacity of each link. A load-adaptation vector is then initialized for each node-pair (step  506 ). In accordance with each initialized load-adaptation vector, all traffic is tentatively mapped to the highest ranked route in the corresponding route set in the overall routing table (step  507 ). The highest ranked route may be the shortest route, the minimum cost route or a “best” route dependent upon the manner in which the route set is ranked. Traffic loads, as recorded in the traffic matrix, are then allocated to routes according to the initialized load-adaptation vectors. Based on this allocation, a link load matrix may be generated to indicate the traffic load on each link. Using this link load matrix, potentially overloaded links are identified and used to form a list ranked from greatest to least excess load (step  508 ). The list created in step  508  is then processed to reduce, and, if possible, eliminate, traffic load in excess of the capacity of each of the links in the list (step  510 ). The goal of step  510 , then, is to minimize the quantity of links in the list. 
     The steps involved in processing the list of potentially overloaded links in step  510  of FIG. 5 are outlined in FIG.  6 . Initially, the link with the greatest potential overload is identified (step  602 ). Put another way, the link whose traffic load, if allocated according to initialized load-adaptation vectors, exceeds the capacity of the link by the greatest amount is identified. Once the link with the greatest potential overload is identified, those node-pairs having traffic loads allocated to routes which include the identified potentially overloaded link are identified (step  604 ). Procedures for identifying routes which include a particular link are known. The routes which have allocated loads and include the identified overloaded link are then considered to determine which of these routes has a minimum penalty alternate route (step  606 ). A penalty may be determined for reallocating a portion of the load on a route using the identified link to an alternate route (with the same source and sink) based on cost and available capacity on the alternate route as well as an amount of excess load on the identified link. If an alternate route is determined (step  608 ) to be available, i.e., to have sufficient free capacity, adjustments may be made to the load-adaptation vector corresponding to the node-pair having the minimum penalty alternate route (step  610 ). By way of these adjustments, all or part of the traffic load on a route using the identified link is tentatively reallocated to an alternate route and thus the tentative load on the overloaded link is reduced. Tentatively reallocating traffic from the route using the identified link to an alternate route may overload another link. Accordingly, care should be taken to select an alternate route that at least results in a net reduction of overload. Corresponding adjustments are also made to the traffic matrix and the link load matrix. Once the adjustments of step  610  are complete, the link in question may be re-examined to determine whether the link is still overloaded (step  614 ). If the link is still overloaded, those node-pairs having traffic load allocated to routes which include the identified link are again identified (step  604 ) and the process of reducing load on the overloaded link repeated. If the link is no longer overloaded, the link is removed from the list (step  616 ) and the list is reviewed (step  618 ). Removal of the link from the list (step  616 ) and review of the list (step  618 ) may also occur if an alternate route is determined not to be available in step  608 , in which case some connection requests must be rejected, as will be explained later. If the list is empty, the overloaded link processing is complete. However, if there exist further overloaded links, the procedure begins again by identifying the link with the greatest excess load (step  602 ). 
     At the end of this processing of potentially overloaded links, there may exist potentially overloaded links whose load may not be reduced. Load-adaptation vectors may identify routes using these potentially overloaded links so that nodes may reject connection requests, which would normally be allocated to these routes, based on a pre-established policy relating to such criteria as Quality of Service. 
     A traffic allocation method which is performed by a node controller is described in conjunction with FIG.  7 . Recall that a nodal routing table comprises a route set associated with each other node. For each route set in the nodal routing table of the node in question, whenever a load-adaptation vector is received, a vacancy vector is initialized (step  702 ) according to the values in this most recently received load-adaptation vector and corresponding values in the current occupancy vector. Vacancy vector initialization is discussed hereinafter in conjunction with FIG.  14 . Note that, like load-adaptation vectors, each vacancy vector has as many elements as the number of routes in a respective route set. Upon receiving a connection request (step  704 ), the vacancy vector is processed to allocate the connection request to a route in the route set (step  706 ). It is then determined whether a new set of load-adaptation vectors has arrived from the network controller (step  708 ). If a new set has arrived, the vacancy vectors are re-initialized (step  702 ). However, if there has been no change in the status of the load-adaptation vectors, the node controller deals with the next connection request based on the current vacancy vector (step  704 ). 
     The processing of a vacancy vector to allocate a connection to a route identified in step  706  of FIG. 7 is expanded upon in FIG.  8 . Given a traffic load associated with a received request for a connection between a source node and a sink node, the vacancy vector of the node-pair of interest is examined to determine whether any routes in the route set have capacity sufficient to carry the requested load (step  804 ). If sufficient capacity for the requested load is unavailable, the connection request is rejected (step  810 ). However, if the vacancy vector shows that sufficient capacity for the requested load is available, the connection is allocated to the highest ranked route, in the route set, which the vacancy vector shows as having available capacity (step  806 ). The element in the vacancy vector corresponding to the route allocated the connection is then reduced by the size of the requested load (step  808 ). 
     An example operation of the described system is given in conjunction with the network  900  in FIG. 9, wherein each of the links between nodes  902 A,  902 B,  902 C,  902 D and  902 E is shown to have associated cost in arbitrary cost units. For simplicity, it is assumed that each line connecting two nodes represents two unidirectional links in opposite directions and further that the two links have the same cost in each direction along the unidirectional links. It is further assumed that each unidirectional link has the same capacity, normalized to unity. 
     An overall routing table  1000  of independent route sets, that is, route sets determined without regard for traffic between other node-pairs, is illustrated in FIG.  10 . To create routing table  1000 , independent route sets have been determined for each node-pair (source and destination) in network  900  of FIG. 9. A method of determining independent route sets is described in U.S. patent application Ser. No. 09/405,003, filed Sep. 27, 1999. Once determined, routes for each node-pair are sorted by increasing order of route cost. Each route in routing table  1000  is an ordered list of nodes with an associated number indicating route cost. For brevity, a route such as  902 D- 902 C- 902 A is expressed as {DCA}. As it has been assumed that each unidirectional link has the capacity normalized to unity, each route in overall routing table  1000  has a capacity of unity. 
     A traffic matrix  1100 , in FIG. 11, quantifies a traffic demand for each possible end-to-end connection in network  900  of FIG.  9 . The representative traffic load is expressed in traffic matrix  1100  normalized to link capacity. A value of 1 indicates a requested bit rate equal to a link capacity. The load from a source node to a sink node can, of course, exceed a link capacity. Recall that link capacity itself is measured in bits per second. For example, traffic from  902 A to  902 D is 0.1 capacity units, which would correspond to one Gigabit per second if the link capacity is ten Gigabits per second. 
     A load-adaptation vector is initialized for each node-pair which has the effect of tentatively assigning the entire load between the two nodes (as reported in traffic matrix  1100 ) to the lowest-cost routes in each route set. For example, the load-adaptation vector for node-pair  902 A- 902 E is initialized to [0.5, 0.0] (the  902 A- 902 E route set has two routes) to correspond to a route set of [ACE, ABDE]. Tentatively, since the normalized traffic load is 0.5, 0.5 capacity units are assigned to each of link  902 A- 902 C and link  902 C- 902 E. The load-adaptation vector for node-pair  902 A- 902 C is initialized to [0.7, 0.0] to correspond to route set [AC, ABC]. Then 0.7 capacity units are added to link  902 A- 902 C bringing the total capacity assigned to link  902 A- 902 C to 1.2. The load on each link (link load) resulting from this “selfish” tentative assignment is shown in a link load matrix  1200  (FIG.  12 ), wherein links that do not exist are shown as blanks. Entries in link load matrix  1200  that exceed 1.0 capacity unit indicate overloaded links. Specifically, links  902 A- 902 C and  902 D- 902 B are overloaded. 
     A list of potentially overloaded links may be generated. In this example, processing of the list assumes that the traffic loads reported in traffic matrix  1100  can be split among several routes in arbitrary granularity (if a particular load is indivisible, it may be necessary to move the entirety of the load). The link with the highest excess load is link from  902 D to  902 B with a tentative load of 1.9 capacity units. According to the initialized load-adaptation vectors, traffic between node-pairs  902 D- 902 A,  902 D- 902 B and  902 E- 902 B is assigned to routes that include link  902 D- 902 B. 
     For each node-pair assigned to routes that include link  902 D- 902 B, a penalty is assessed for reassigning the node-pair traffic to an alternate route. A penalty is assessed to each alternate route. The penalty is the cost difference between the alternate route and the shortest route. The alternate routes for node-pairs  902 D- 902 A,  902 D- 902 B and  902 E- 902 B, and their associated penalties, are as follows: 
     
       
         
               
               
               
               
               
               
             
           
               
                   
               
               
                   
                   
                   
                   
                   
                 Penalty 
               
               
                 Source - 
                 Shortest 
                 SR 
                 Alternate 
                 AR 
                 (AR Cost - 
               
               
                 Destination 
                 Route (SR) 
                 Cost 
                 Routes (AR) 
                 Cost 
                 SR Cost) 
               
               
                   
               
             
             
               
                 902D-902A 
                 {DBA} 
                 14 
                 {DCA} 
                 18 
                  4 
               
               
                   
                   
                   
                 {DECA} 
                 23 
                  9 
               
               
                 902D-902B 
                 {DB} 
                  5 
                 {DCB} 
                 23 
                 18 
               
               
                   
                   
                   
                 {DECB} 
                 28 
                 23 
               
               
                 902E-902B 
                 {EDB} 
                 14 
                 {ECB} 
                 19 
                  5 
               
               
                   
               
             
          
         
       
     
     A minimum penalty may be identified in the above as corresponding to alternate route {DCA}. The traffic load on node-pair  902 D- 902 A, as determined from traffic matrix  1100 , is 0.3 capacity units. Further, from link load matrix  1200  it is seen that, on route {DCA}, 0.7 capacity units are available on link  902 D- 902 C and 0.4 capacity units are available on link  902 C- 902 A. Route {DCA} may be said to have 0.4 capacity units of excess capacity. The excess load on link  902 D- 902 B is 0.9 capacity units. The entire  902 D- 902 A traffic load (0.3 capacity units) may be assigned from route {DBA} to route {DCA}. In other words, the load-adaptation vector for node-pair  902 D- 902 A is changed from its initialized value of [0.3, 0.0, 0.0] to [0.0, 0.3, 0.0]. After the load on all links is adjusted accordingly, the load on link  902 D- 902 B is reduced from 1.9 to 1.6 capacity units. 
     The next node pair to be considered for reducing the potential overload on link  902 D- 902 B is  902 E- 902 B which has an alternate-route penalty of five cost units. The traffic demand for node pair  902 E- 902 B is 0.2 units and the second-best alternate route is {ECB}. The excess capacities in links  902 E- 902 C and  902 C- 902 B are 0.2 and 0.6, respectively. Therefore, 0.2 capacity units are allocated across route {ECB}, resulting in a change of load-adaptation vector for node-pair  902 E- 902 B from [0.2, 0] to [0, 0.2]. After the load on all links is adjusted accordingly, the load on link  902 D- 902 B is reduced from 1.6 to 1.4 capacity units, which still exceeds the physical capacity of the link by 0.4 capacity units. 
     The last node-pair to be considered is  902 D- 902 B which has two alternate routes {DCB} and {DECB}, the former incurring a lower penalty (18 cost units) than the latter (23 cost units). Link  902 D- 902 C has an excess capacity of 0.4 units and link  902 C- 902 B now has an excess capacity of 0.4 (after accounting for the re-routing of the 0.2 load units from {EDB} to {ECB}). Hence the excess load of 0.4 units on link  902 D- 902 B may be transferred to route { DCB }, resulting in a change of the respective load-adaptation vector from [1.4, 0.0, 0.0] to [1.0, 0.4, 0.0]. After the load on all links is adjusted accordingly, the load on link  902 D- 902 B is reduced from 1.4 to 1.0 capacity units. 
     The next most overloaded link is link  902 A- 902 C with a load of 1.2 capacity units. Traffic loads assigned to node-pairs  902 A- 902 C and  902 A- 902 E are identified as making use of link  902 A- 902 C. The alternate routes for these node-pairs and the associated penalties are: 
     
       
         
               
               
               
               
               
               
             
           
               
                   
               
               
                   
                   
                   
                   
                   
                 Penalty 
               
               
                 Source - 
                 Shortest 
                 SR 
                 Alternate 
                 AR 
                 (AR Cost - 
               
               
                 Destination 
                 Route (SR) 
                 Cost 
                 Routes (AR) 
                 Cost 
                 SR Cost) 
               
               
                   
               
             
             
               
                 902A-902C 
                 {AC} 
                  6 
                 {ABC} 
                 20 
                 14 
               
               
                 902A-902E 
                 {ACE} 
                 14 
                 {ABDE} 
                 23 
                  9 
               
               
                   
               
             
          
         
       
     
     The alternate route with the lowest cost penalty is {ABDE} with a penalty of 9 cost units. The traffic demand for node-pair  902 A- 902 E is 0.5 capacity units. The excess load on link  902 A- 902 C is 0.2 capacity units. However, excess capacity on alternate route {ABDE} is limited to the 0.1 capacity units on link  902 B- 902 D. Therefore, with the assumption of a divisible traffic load, 0.1 capacity units may be transferred from route {ACE} to route {ABDE}. 
     The excess load on link  902 A- 902 C is now 0.1 capacity units. The next alternate route with the lowest penalty, in fact, the only alternate route left, is route {ABC} with a penalty of 14 cost units and room for 0.2 capacity units. Traffic demand for node-pair  902 A- 902 C is 0.7 capacity units. Therefore, 0.1 capacity units may be transferred from route {AC} to route {ABC}. The load-adaptation vector for node-pair  902 A- 902 C is adjusted to [0.6, 0.1] and for node-pair  902 A- 902 E is adjusted to [0.4, 0.1]. 
     As the list of potentially overloaded links is now empty, the processing of overloaded links is complete. The adjusted tentative load on links in network  900 , due to courteous route assignment, is shown as link load matrix  1300 , in FIG.  13 . 
     Given the above processing, the following initial load-adaptation vectors (which are derived from FIG. 11) are modified to the following modified load-adaptation vectors: 
     
       
         
               
               
               
             
           
               
                   
               
               
                   
                 Initial Load- 
                   
               
               
                 Node-pair 
                 Adaptation Vector 
                 Modified Load-Adaptation Vector 
               
               
                   
               
             
             
               
                 902A-902C 
                 [0.7, 0.0] 
                 [0.6, 0.1] 
               
               
                 902A-902E 
                 [0.5, 0.0] 
                 [0.4, 0.1] 
               
               
                 902D-902A 
                 [0.3, 0.0, 0.0] 
                 [0.0, 0.3, 0.0] 
               
               
                 902D-902B 
                 [1.4, 0.0, 0.0] 
                 [1.0, 0.4, 0.0] 
               
               
                 902E-902B 
                 [0.2, 0.0] 
                 [0.0, 0.2] 
               
               
                   
               
             
          
         
       
     
     The load-adaptation vectors may then be distributed to the corresponding nodes. At node  902 A in network  900 , the first row of routing table  1000  (FIG.  10 ), which includes the route sets for node-pairs wherein node  902 A is the source, is received. Subsequently, a load-adaptation vector for each route set is received. A vacancy vector is then initialized for each node-pair (i.e., each route set) to equal the difference between a corresponding new load-adaptation vector and a current occupancy vector. If a request to connect node  902 A to node  902 C having an associated load size of 0.4 capacity units is then received, the first element in the vacancy vector for node-pair  902 A- 902 C is compared to the load size. Assuming an occupancy vector of [0.0, 0.0], the value of the first element in the vacancy vector (0.6) will exceed the load size (0.4). The connection request may therefore be allocated to the route corresponding to that element, {AC}. The available capacity of the first element is then reduced by the load size resulting in a vacancy vector corresponding to  902 A- 902 C of [0.2, 0.1] and a corresponding occupancy vector of [0.4, 0.0]. Note that, for a new load-adaptation vector to be accepted by a node controller, each element in the new load-adaptation vector must exceed or equal a corresponding element in a current occupancy vector. If an element in a new load-adaptation vector is less than a corresponding element in a current occupancy vector, the new load-adaptation vector is perceived to be erroneous and is rejected by the node controller. Until a new load-adaptation vector is accepted by the node controller, traffic on the links of the route corresponding to the load-adaptation vector element in question may experience blocking of the sort that occurs in current “selfish” networks. 
     In FIG. 14, an example is presented to illustrate changes in occupancy and vacancy vectors of node-pair  902 C- 902 B in response to receipt of a new load-adaptation vector. An arbitrary load unit is used in this illustration. Based on an original load-adaptation vector  1402 , traffic has been allocated to result in an occupancy vector  1404  and a corresponding vacancy vector  1406 . Upon receipt of a new load-adaptation vector  1412 , a new occupancy vector  1414  is unchanged from the original occupancy vector  1414 . However, a new vacancy vector  1416  is created with values representing the difference between the new load-adaptation vector  1412  and the occupancy vector  1414 . 
     Consider, with further regard to FIG. 14, a request to connect node  902 C to node  902 B having an associated load size of six capacity units. The routes may be seen to be ranked such that the highest ranked route is furthest to the left in FIG.  14 . The value (five) of the element, in the vacancy vector  1416 , corresponding to the highest ranked route, which is {CB}, is exceeded by the load size. Hence, if the connection request may be divided, five capacity units may be allocated to route {CB} and one capacity unit allocated to second ranked route {CAB}. However, if the request is indivisible, the entire request may be allocated to route {CAB}, which is ranked second, but can accommodate the entire request. 
     It is preferable that overall routing-table formulation (step  202 , FIG. 2) be performed with a frequency determined by planned network topology changes, for example the addition or removal of a node or the addition of new links to a node. It is further expected that new load-adaptation vector updating (step  308 , FIG. 3) will occur, when triggered by traffic deviation metric exceeding a threshold, with a much greater frequency (say, once every two seconds). 
     In another embodiment of the present invention, the adaptive routing information determined in step  208  (FIG.  2 ), based on received traffic information, takes the form of adaptive routing tables. The processing steps are illustrated in FIG.  15 . As in the processing of FIG. 3, initially a new traffic matrix is created (step  1502 ). The new traffic matrix may then be used to calculate a traffic deviation metric (step  1504 ) through comparison, described hereinbefore in conjunction with FIG. 3, with a previous traffic matrix. The traffic deviation metric is compared to a predetermined threshold (step  1506 ). If the traffic deviation metric does not exceed the threshold, the traffic processing is complete. However, if the traffic deviation metric exceeds the threshold, the set of adaptive routing tables is updated (step  1508 ). 
     FIG. 16 illustrates steps involved in a procedure, used in step  1508  of FIG. 15, for determining adaptive routing tables. Once capacity vectors have been received from node controllers (step  1602 ), the network controller can create a capacity matrix (step  1604 ) indicating the capacity of each link. Traffic is then allocated to the highest ranked route in corresponding route sets in the overall routing table (step  1606 ). Traffic loads, as recorded in the traffic matrix, are then allocated to routes according to the initialized load-adaptation vectors. Based on this allocation, a link load matrix may be generated to indicate the traffic load on each link. Using this link load matrix, potentially overloaded links are identified and used to form a list ranked from greatest to least excess load (step  1608 ). The list created in step  1608  is then processed to reduce, and, if possible, eliminate, traffic load in excess of the capacity of each of the links in the list (step  1610 ). The goal of step  1610 , then, is to minimize the quantity of links in the list. Processing of potentially overloaded links in step  1610  of FIG. 16 may be accomplished according to the flow diagram of FIG.  17 . Initially, the one link, in the list of potentially overloaded links, having the greatest potential overload is identified (step  1702 ). Node-pairs having route sets in which are routes including the identified link are then identified (step  1704 ). For each node-pair identified in step  1704  as employing the identified link, alternate routes from source node to sink node are considered. A penalty is assessed to each of the considered alternate routes based on a difference in cost relative to the route including the overloaded link and the load that may be transferred to the alternate route (step  1706 ). If an alternate route is determined to be available (step  1707 ), the alternate route may then be promoted to a rank above that of the route which includes the identified link (step  1708 ). Given the promotion in step  1708 , the route sets and link loads are updated (step  1710 ) thus reducing the amount of overload on the identified link by the capacity of the alternate route. Promoting an alternate route to a rank above that of the route which includes the identified link may overload another link. Accordingly, care should be taken to select an alternate route that at least results in a net reduction of overload. Once the updates of step  1710  are complete, the link in question may be re-examined to determine whether the link is still overloaded (step  1714 ). If the link is still overloaded, those node-pairs having traffic load allocated to routes which include the identified link are again identified (step  1704 ) and the process of reducing load on the overloaded link repeated. If the identified link is determined to no longer be overloaded, it is removed from the list of overloaded links (step  1716 ). If a test (step  1718 ) determines that overloaded links remain in the list, the process may begin again with the most overloaded link. Removal of the link from the list (step  1716 ) and review of the list (step  1718 ) may also occur if an alternate route is determined not to be available in step  1707 . If the list is determined in step  1718  to be empty, the overloaded link processing is complete. 
     Returning to FIG. 1, as will be apparent to a person skilled in the art, in a large-scale network, having, for example, several thousand nodes, network controller  104  may be distributed among nodes  102  and each control channel  122  may be a virtual channel sharing payload links  120 . Such a distributed network controller would comprise a number of coordinated network controllers, each attached to a node  102 . 
     In the case of a very large network, having several thousand nodes for example, the traffic matrices tend to be sparse. In such a case, efficient data structures, well known in the art, may be used to store traffic demand and link loads. 
     A person skilled in the art may now conceive of alternate structures and embodiments or variations of the above. All those which fall within the scope of the claims appended hereto are considered to be part of the present invention.