# Patent

## Title
Method for loop-free multipath routing using predecessor information

## Abstract

A method is described for routing network traffic based on distance information to provide multiple paths that need not have equal costs. The routing algorithm MPATH of the present method provide loop-free routing at every instant, without the need of internodal synchronization which spans more than a single hop. Paths are computed using shortest distances and predecessor information in the routing computation. The use of multiple-successors allows for load-balancing within the network. The algorithm is both distributed and scalable to large networks due to its use of only one-hop synchronization. A number of procedures are described by way of example, including path computation, main table updating, neighbor table updating, and a multipath (MPATH) algorithm.

## Background
CROSS-REFERENCE TO RELATED APPLICATIONS
This application claims priority from U.S. provisional application Ser. No. 60/239,420 filed on Oct. 10, 2000, incorporated herein by reference.


STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT
This invention was made with Government support under Grant No. F30602-97-2-0338, awarded by the Air Force Office of Scientific Research (AFOSR). The Government has certain rights in this invention.


REFERENCE TO A COMPUTER PROGRAM APPENDIX
Not Applicable
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention generally pertains to computing routes within a network, and more particularly to a routing algorithm for computing multiple loop-free routes between each source-destination pair.
2. Description of the Background Art
The most popular routing protocols used in today's internets are based on the exchange of vectors of distance, such as RIP and EIGRP; or topology maps, such as OSPF. It should be noted that RIP and a number of similar routing protocols which are based on the distributed Bellman-Ford algorithm (DBF) for shortest-path computation, suffer from the bouncing effect and counting-to-infinity problems, which limit their applicability to small networks using hop count as the measure of distance. While OSPF and algorithms based on topology-broadcast are hindered by excessive communication overhead, which forces the network administrators to partition the network into distinct areas which are interconnected by a backbone. As a result the use of OSPF leads to a complex solution, in terms of the required router configuration. The routing protocol EIGRP utilizes a loop-free routing algorithm called DUAL (Diffusing Update Algorithm), which is based on internodal coordination that can span multiple hops.
In addition to DUAL, several algorithms based on distance vectors have been proposed to overcome the counting-to-infinity problem of DBF. All of these algorithms rely on exchanging queries and replies along multiple hops, a technique that is sometimes referred to as diffusing computations, because it has its origin in Dijkstra and Scholten's basic algorithm.
A couple of routing algorithms have been proposed that operate using partial topology information to eliminate the main limitations of topology-broadcast algorithms. Furthermore, several distributed shortest-path algorithms have been proposed that use the distance and second-to-last hop to destinations as the routing information exchanged among nodes. These algorithms are often called path-finding algorithms or source-tracing algorithms. All of these algorithms eliminate DBF's counting to infinity problem, and some of them are more efficient than any of the routing algorithms based on link-state information proposed to date. Furthermore, LPA (the Loop-free Path-finding Algorithm) is maintained loop-free at every instant.
With the exception of DASM (Diffusing Algorithm for Shortest Multipath), all of the above routing algorithms focus on the provision of a single path to each destination. A drawback of DASM, however, is that it uses multi-hop synchronization, which limits its scalability. Recently a routing protocol referred to as MPDA (Multiple-path Partial-topology Dissemination Algorithm) has been proposed which is a method based on link-states that provides multiple loop-free path routing utilizing one-hop synchronization.
Therefore, a need exists for a routing protocol which is scalable, and provides multipath unequal cost routing based on distance vectors, which is assured to be loop-free. The present invention satisfies those needs, as well as others, and overcomes the deficiencies of previously developed protocols.
BRIEF SUMMARY OF THE INVENTION
The present invention is a routing method that determines multiple loop-free paths between source and destination pairs, which utilizes shortest distances and predecessor information in its route computation. A variant of MPDA is herein presented which is referred to as MPATH, which is a routing algorithm based on distance vectors that: (a) provides multiple paths of unequal cost to each destination that are free of loops at every instant, both in steady state as well as during network transitions, and (b) utilizes a synchronization mechanism that spans only one hop, which makes it more scalable than routing algorithms based on diffusing computations spanning multiple hops. MPATH is a path-finding algorithm, and differs from prior similar algorithms in the invariants used to ensure multiple loop-free paths of unequal cost. The peculiar differences between MPATH and MPDA is a result of the differences in the kind of information that nodes exchange.
An object of the invention is to provide a routing protocol for computing multiple routes of unequal cost.
Another object of the invention is to provide a routing protocol in which the routes are assured to be loop-free at every instant.
Another object of the invention is to provide a routing protocol that does not require internodal synchronization which spans greater than a single hop.
Another object of the invention is to provide a routing protocol of low complexity, wherein the requirements for storage, time, computation, and communication are minimized.
Another object of the invention is to provide a routing protocol which always converges to a shortest distant route.
Further objects and advantages of the invention will be brought out in the following portions of the specification, wherein the detailed description is for the purpose of fully disclosing preferred embodiments of the invention without placing limitations thereon.



BRIEF DESCRIPTION OF THE DRAWINGS
The invention will be more fully understood by reference to the following drawings which are for illustrative purposes only:
FIG. 1 is pseudocode for a path algorithm according to an aspect of the present invention, shown with an initialization procedure and a path routing algorithm to each destination.
FIG. 2 is pseudocode for a neighbor table update algorithm according to an aspect of the present invention.
FIG. 3A is a topology diagram within which table updates are exemplified according to an aspect of the present invention, shown with adjacent links and neighbor tables.
FIG. 3B is a topology diagram with a distance table for illustrating the table update procedure within an aspect of the present invention, shown with a table of preferred neighbors.
FIG. 4A is a topology diagram which exemplifies tie-breaking rules according to an aspect of the present invention, shown with unit link costs.
FIG. 4B is a topology diagram which exemplifies tie-breaking rules according to an aspect of the present invention, shown with costs of adjacent links and shortest-path trees of neighboring nodes.
FIG. 4C is a topology diagram which exemplifies tie-breaking rules according to an aspect of the present invention, showing a tie-break resolution.
FIG. 5 is pseudocode which exemplifies updating of the main table according to an aspect of the present invention.
FIG. 6 is pseudocode which exemplifies multipath routing according to an aspect of the present invention.



DETAILED DESCRIPTION OF THE INVENTION
Referring more specifically to the drawings, for illustrative purposes the present invention is embodied in the apparatus and methods generally shown in FIG. 1 through
FIG. 6. It will be appreciated that the apparatus may vary as to configuration and as to details of the parts, and that the method may vary as to the specific steps and sequence, without departing from the basic concepts as disclosed herein.
1. Distributed Multipath Routing Algorithm
1.1. Problem Formulation
A computer network is represented as a graph G=(N,L) where N is the set of nodes, typically routers, and L is the set of edges, links, connecting the nodes within the network. A cost is associated with each link that can change over time, but is always positive. Two nodes connected by a link are called adjacent nodes or neighbors. The set of all neighbors of a given node i is denoted by Ni. Adjacent nodes communicate with each other using messages and messages transmitted over an operational link are received with no errors, in the proper sequence, and within a finite timeframe. Furthermore, such messages are processed by the receiving node one at a time in the order received. A node detects the failure, recovery and link cost changes of each adjacent link within a finite time.
The goal of the present distributed routing algorithm is to determine at each node i the successor set of i for destination j, which we denote by Sji(t)Ni, such that the routing graph SGj(t) consisting of link set {(m,n)|n∈Sjm(t), m∈N} is free of loops at every instant t, even when link costs are changing with time. The routing graph SGj(t) for single-path routing is a sink-tree rooted at j, because the successor sets Sji(t) have at most one member. In multipath routing, there can be more than one member in Sji(t) therefore, SGj(t) is a directed acyclic graph with j as the sink node. There are potentially several SGj(t) for each destination j; however, the routing graph we are interested is defined by the successor sets Sji(t)={k|Djk(t)<Dji(t), k∈Ni}, where Dji is the shortest distance of node i to destination j, which is referred to as a shortest multipath routing graph for destination j.
After a series of link cost changes which leave the network topology in arbitrary configuration, the distributed routing algorithm should work to modify SGj in such a way that it eventually converges to the shortest multipath of the new configuration, without ever creating a loop in SGj during the process.
Since Djk is a local variable of node k, its value has to be explicitly or implicitly communicated to node i. If Djki is the value of Djk as known to node i, the problem now becomes one of computing Sji(t)={k|Djki(t)<Dji(t)}. However, because of non-zero propagation delays during network transitions, discrepancies can exist in the value of Djk and its copy Djki at i, which may cause loops to form in SGj(t). To prevent loops, therefore, additional constraints must be imposed when computing Sji. If the successor set at each node i for each destination j satisfies certain conditions called loop-free invariant conditions, then the snapshot at time t of the routing graph SGj(t) implied by Sji(t) is free of loops. The solution within the present invention solves this problem in two parts: (1) computing Dji using a shortest-path routing algorithm called PATH, and (2) extending it to compute Sji such that they satisfy loop-free invariant conditions at every instant.
1.2. Node Tables and Message Structures
As in DBF, nodes executing MPATH exchange messages containing distances to destinations. In addition to the distance to a destination, nodes also exchange the identity of the second-to-last node, also called predecessor node, which is the node just before the destination node on the shortest path. In this respect MPATH is similar to several prior algorithms but differs in its specification, verification and analysis and, more importantly, in the multipath operation described in the next section.
The following information is maintained at each node:
1. A Main Distance Table that contains Dji and pji, where Dji is the distance of node i to destination j and pji is the predecessor to destination j on the shortest path from i to j. The table also stores for each destination j, the successor set Sji, feasible distance FDji, reported distance RDji, and two flags “changed” and “report-it”.
2. A Main Link Table Ti that is the node's view of the network and contains links represented by (m, n, d) where (m, n) is a link with cost d.
3. A Neighbor Distance Table for neighbor k containing Djki and pjki where Djki is the distance of neighbor k to j as communicated by k, and pjki is the predecessor to j on the shortest path from k to j as notified by k.
4. A Neighbor Link Table Tki containing the view that neighbor k has of the network as known to i and contains link information derived from the distance and predecessor information in the neighbor distance table.
5. An Adjacent Link Table that stores the cost lki of adjacent link to each neighbor k. If a link is down its cost is infinity.
Nodes exchange information using update messages which have the following format:
1. An update message can one or more update entries. An update entry is a triplet [j,d, p], where d is the distance of the node sending the message to destination j and p is the predecessor on the path to j; and
2. Each message carries two flags used for synchronization: query and reply.
1.3. Computing Dji 
As mentioned earlier, the strategy within the present invention is to first design a shortest-path routing algorithm and then make the multipath extensions to it. This subsection describes our shortest-path algorithm PATH and the next subsection describes the multipath extensions. FIG. 1 illustrates pseudocode for an example of the PATH procedure. INIT-PATH is called at node startup to initialize the tables, distances are initialized to infinity and node identities are initialized to a null value. PATH is executed in response to an event that can be either a receipt of an update message from a neighbor, or detection of an adjacent link cost or link status (up/down) change. PATH invokes procedure NTU, described in FIG. 2, which first updates the neighbor distance tables and then updates Tki with links (m, n, d) where d=Dnki−Dmk1 and m=pnki. PATH then invokes procedure MTU, specified in FIG. 5, which constructs Ti by merging the topologies Tki and the adjacent links lki.
FIG. 3A and FIG. 3B illustrate updating of the main table 6 for an example network topology 2. FIG. 3A depicts adjacent links and neighbor tables 4 of node i, while FIG. 3B depicts the network topology 2 along with a table 6 of preferred neighbors along with the main link table of node i after merging the neighbor tables 4.
The merging process is straightforward if all neighbor topologies Tki contain consistent link information, but when two or more neighbors link tables contain conflicting information regarding a particular link, the conflict must be resolved. Two neighbor tables are said to contain conflicting information regarding a link, if either both report the link with different cost or one reports the link and the other does not. Conflicts are resolved as follows: if two or more neighbor link tables contain conflicting information of link (m, n), then Ti is updated with link information reported by the neighbor k that offers the shortest distance from the node i to the head node m of the link, such as lki+Dmki=min{lki+Dmki|k∈Ni}. Ties are broken in a consistent manner; one way is to break ties always in favor of lower address neighbor. Because i itself is the head of the link for adjacent links, any information about an adjacent link supplied by neighbors will be overridden by the most current information about the link available to node i.
FIG. 4A through FIG. 4C shows the significance of the tie-breaking rule. FIG. 4A depicts an example network topology 12 with unit link costs. FIG. 4B illustrates node i having the costs of its adjacent links and the shortest path trees 14 of its neighbors p and q. The distances of nodes x and y from i is identical through both neighbors p and q. FIG. 4C illustrates that if MTU breaks ties in an arbitrary manner while constructing Ti, it may choose p as the preferred neighbor for node x and choose q as the preferred neighbor for node y, which results in a graph 16 that has no path from i to j. It will be appreciated, therefore, that ties should not be broken in an arbitrary manner.
After merging the topologies, MTU runs Dijkstra's shortest path algorithm to find the shortest path tree and deletes all links from Ti that are not in the tree. Because there can be more than one shortest-path tree, while running Dijkstra's algorithm ties are again broken in a consistent manner. The distances Dji and predecessors pji can then be obtained from Ti. The tree is compared with the previous shortest path tree and only the differences are then reported to the neighbors. If there are no differences, no updates are reported. Eventually all tables converge such that Dji yields the shortest distances and all message activity ceases.
1.4. Computing Sji 
In this subsection, the final desired routing algorithm MPATH is derived by making extensions to PATH. MPATH computes the successor sets Sji by enforcing the Loop-free Invariant conditions described below and using a neighbor-to-neighbor synchronization.
Let an “estimate” of the distance of node i to node j, be referred to as the feasible distance, FDji; in a similar manner as FDji is equal to Dji when the network is in a stable state, but to prevent loops during periods of network transitions, it is allowed to temporarily differ from Dji. Loop-free invariant conditions can be expressed as follows:

FDji(t)≦Djik(t)k∈Ni  (1)

Sji(t)={k|Djik(t)<FDji(t)}  (2)

The invariant conditions (1) and (2) state that, for each destination j, a node i can choose a successor whose distance to j, as known to i, is less than the distance of node i to j that is known to its neighbors.
Theorem 1: If the LFI conditions are satisfied at any time t, the SGj(t) implied by the successor sets Sji(t) is loop-free.
Proof: Let k∈Sji(t) then from Eq. 2 it follows that:

Djki(t)<FDji(t)  (3)

At node k, because node i is a neighbor, from Eq. 1 above, it follows that:

FDjk(t)≦Djki(t)  (4)

Combining Eq. 3, and Eq. 4, it follows that:

FDjk(t)<FDji(t)  (5)

Eq. 5 states that, if k is a successor of node i in a path to destination j, then k's feasible distance to j is strictly less than the feasible distance of node i to node j. Now if the successor sets define a loop at time t with respect to node j, then for some node p on the loop, an absurd relation is arrived at wherein FDjp(t)<FDjp(t).

Therefore, the LFI conditions are sufficient for loop-freedom.

The invariants used in LFI are independent of whether the algorithm uses link states or distance vectors; in link-state algorithms, such as MPDA, the Djki are computed locally from the link-states communicated by the neighbors while in distance-vector algorithms, like the MPATH presented here, the Djki are directly communicated.
The invariants (1) and (2) suggest a technique for computing Sji(t) such that the successor graph SGj(t) for destination j is loop-free at every instant. The key is determining FDji(t) in Eq. (1), which requires node i to know Djik(t), the distance from node i to node j in the topology table Tik that node i communicated to neighbor k. As a result of non-zero propagation delays, Tik is a time-delayed version of Ti. It will be appreciated that, if node i delays updating of FDji with Dji until k incorporates the distance Dji in its tables, then FDji satisfies the LFI condition.
FIG. 6 exemplifies pseudocode for MPATH which enforces the LFI conditions by synchronizing the exchange of update messages among neighbors using query and reply flags. If a node sends a message with a query bit set, then the node must wait until a reply is received from all its neighbors before the node is allowed to send the next update message. The node is said to be in ACTIVE state during this period. The inter-neighbor synchronization used in MPATH spans only one hop, unlike algorithms that use diffusing computation that potentially span the whole network, such as DASM.
Assume that all nodes are in a PASSIVE state initially with correct distances to all other nodes and that no messages are in transit or pending to be processed. The behavior of the network where every node runs MPATH is such that when a finite sequence of link cost changes occurs in the network within a finite time interval, some or all nodes to go through a series of PASSIVE-to-ACTIVE and ACTIVE-to-PASSIVE state transitions, until eventually all nodes become PASSIVE with correct distances to all destinations.
Let a node in PASSIVE state receive an event resulting in changes in its distances to some destinations. Before the node sends an update message to report new distances, it checks if the distance Dji to any destination j has increased above the previously reported distance RDji. If none of the distances increased, then the node remains in PASSIVE state. Otherwise, the node sets the query flag in the update message, sends it, and goes into ACTIVE state. When in ACTIVE state, a node cannot send any update messages or add neighbors to any successor set. After receiving replies from all its neighbors, the node is allowed to modify the successor sets and report any changes that may have occurred since the time it has transitioned to ACTIVE state, and if none of the distances increased beyond the reported distance, the node transitions to PASSIVE state. Otherwise, the node sends the next update message with the query bit set and becomes ACTIVE again, and the whole cycle repeats. If a node receives a message with the query bit set when in PASSIVE state, it modifies its tables and then sends back an update message with the reply flag set. Otherwise, if the node happens to be in ACTIVE state, it modifies the tables but because the node is not allowed to send updates when in ACTIVE state, the node sends back an empty message with no updates but the reply bit set. If a reply from a neighbor is pending, when the link to the neighbor fails then an implicit reply is assumed, and such a reply is assumed to report an infinite distance to the destination. Because replies are given immediately to queries and replies are assumed to be given upon link failure, deadlocks due to inter-neighbor synchronization cannot occur. Eventually, all nodes become PASSIVE with correct distances to destinations.
2. Correctness of MPATH
The following properties of MPATH are to be proven: (1) MPATH eventually converges with Dji; giving the shortest distances and (2) the successor graph SGj is loop-free at every instant and eventually converges to the shortest multipath. PATH works essentially like PDA except that the kind of update information exchanged is different; PDA exchanges link-state while PATH exchanges distance-vectors with predecessor information. The correctness proof of PATH is identical to PDA and are reproduced here for correctness. The convergence of MPATH directly follows from the convergence of PATH because extensions to MPATH are such that update messages in MPATH are only delayed a finite amount of time.
Definitions: The n-hop minimum distance of node i to node j in a network is the minimum distance possible using a path of n hops, (links) or less. A path that offers the n-hop minimum distance is called n-hop minimum path. If there is no path with n hops or less from node i to j then the n-hop minimum distance from i to j is undefined. An n-hop minimum tree of a node i is a tree in which node i is the root and all paths of n hops or less from the root to any other node is an n-hop minimum path.
Let G denote the final topology of the network, as would be seen by an omniscient observer after all link changes have occurred. Without loss of generality, assume G is connected; if G is disconnected, the proof applies to each connected component independently.
It is presumed that a router i knows at least the n-hop minimum tree, if the tree contained in its main link table Ti is at least an n-hop minimum tree rooted at i in G, and there are at least n nodes in Ti that are reachable from the root i. Note that Ti is such that the links with head nodes that are more than n hops away from i may have costs that do not agree with the link costs in G.
Theorem 2: If node i has adjacent link costs that agree with G and for each neighbor k, Tki represents at least an (n−1)-hop minimum tree, then after the execution of MTU, the minimum cost tree contained in Ti is at least an n-hop minimum tree.
Proof: Let Hni denote an n-hop minimum tree rooted at node i in G and let Mni be the set of nodes that are within n hops from i in Hni. Let Dnij denote the distance of i to j in Hni. Let dij be the cost of the link i→j. Node i is called the head of the link i→j. The notation ij indicates a path from i to j of zero or more links; if the path has zero links, then i=j. The length of path ij is the sum of costs of all links in the path.

Property 1: From the principle of optimality (the sub-path of a shortest path between two nodes is also the shortest path between the end nodes of the sub-path), if H and H′ are two n-hop minimum trees rooted at node i and M and M′ are sets of nodes that are within n hops from i in H and H′ respectively, then M=M′=Mni and Mni≧n. For each j∈Mni the length of path ij in both H and H′ is equal to Dnij. For h≧n, Dhij≦Dnij.

Let Ai=k∈NiAki, where Aki is the set of nodes in Tki. Because Tki is at least an (N−1)-hop minimum tree and node i can appear at most once in each of Aki, each Aki has at least N−1 unique elements. Therefore, Ai has at least N−1 elements.
Let Mni be the set of n−1 nearest elements to node i in Ai. That is, MniAi, |Mni|=n−1, and for each j∈Mni, and ν∈Ai−Mni, min{Djki+lki|k∈Ni}≦min{Dνki+lki|k∈Ni}.
To prove the theorem it is sufficient to prove the following:


    1. Let Gni represent the graph constructed by MTU on lines 2 and 3. (i.e., before applying Dijkstra in line 4). For each j∈Mni there is a path ij in Gni such that its length is at most Dnij.
    2. After running Dijkstra on Gni on line 4 in MTU, the resulting tree is at least an n-hop minimum tree.


Let us first assume part 1 is true and prove part 2. From the statement in part 1 for each node j∈Mni there is a path ij in Gni with length at most Dnij. In the resulting tree after running Dijkstra, we can infer there is a path ij with length at most Dnij. Because there are n−1 nodes in Mni, the tree constructed has at least n nodes including node i. From property 1, it follows that the tree constructed is at least an n-hop minimum tree.
To prove part 1, order the nodes in Mni in non-decreasing order. The proof is by induction on the sequence of elements in Mni. The base case is true because for m1, the first element of Mi, lm1i=min{lki|k∈Ni} and lm1i=D1i,ms 1. As induction hypothesis, let the statement hold for the first m−1 elements of Mni. Consider the mth element j∈Mni. Let K be the highest priority neighbor for which Djki+lki=min{Djki+lki|k∈Ni}. At most m−1 nodes in TKi can have lesser or equal distance than j which implies path Kj exists with at most m−1 hops. Let ν be the neighbor of j in TKi. Then the path Kν→j has at most m−1 hops. Because TKi is at least a (n−1)-hop minimum tree, the link ν→j must agree with G. Since DνKi+lKi<DjKi+lKi, from the induction hypothesis there is a path iν in G, such that the length is at most Dni,ν.
The following now shows that the preferred neighbor for ν is also K, so that the link ν→j will be included in the construction of Gni thus ensuring the existence of the path ij in Gni. If some neighbor K′ other than K is the preferred neighbor for ν then one of the following two conditions should hold: (a) DνK′i+lK′i<DνKi+lKi or (b) DνK′i+lK′i=DνKi+lKi and priority of K′ is greater than priority of K.
Case (a): Because DjKi+lKi≦DjK′i+lK′i it follows that the path νj in TK′i, is greater than cost of ν→j in G which implies that TK′i, is not an (n−1) hop minimum tree, which contradicts the assumption. Therefore Dνki+lki=min{Dνki+lki|k∈Ni}.
Case (b): Let Qj be the set of neighbors that give the minimum distance for j, such as for each k∈Qj, Djki+lki=min{Djki+lki|k∈Ni}. Similarly, let Qνbe such that for each k∈Qν, Dνki+lki=min{Dνki+lki|k∈Ni}. If k∈Qνand k∉Qj, then it follows from same argument as in case (a) that νj in Tki is greater than cost of ν→j in G implying Tki is not a (n−1) hop minimum tree, which again is a contradiction of the assumption. Because K has the highest priority among all members of Qj and QνQj and k∈Qν, K also has the highest priority among all members of Qν. Therefore QνQj. Also, from the same argument it can be inferred that K∈Qν. This proves that ν→j will be included in the construction of Gni. Because Dni,ν+dνj=Dni,j in G, where dνj is the final cost of link ν→j, and length of iν in Gni less than or equal to Dni,νfrom the induction hypothesis, the length of iν in Gni is less than or equal to Dni,j. This proves part 1 of the theorem.
Theorem 3: A finite time after the last link cost change in the network, the main topology Ti at each node i gives the correct shortest paths to all known destinations.
Proof: The proof is identical to the proof of Theorem 2 and is performed by induction on tn, the global time when for each node i, Ti is at least an n-hop minimum tree. Because the longest loop-free path in the network has at most N−1 links where N is number of nodes in the network, tN−1 is the time when every node has the shortest path to every other node, wherein tN−1 should be shown to be finite. The base case of tN−1 is t1, the time when every node has a one-hop minimum distance and because the adjacent link changes are notified within finite time, t1<∞. Let tn<∞ for some n<N. Given that the propagation delays are finite, each node will have each of its neighbors n-hop minimum tree in finite time after tn. From Theorem 2 we can see that the node will have at least the (n+1)-hop minimum tree in finite time after tn. Therefore, tn+1<∞. From induction it will be appreciated that tN−1<∞.
A node generates update messages only to report changes in distances and predecessor, so after convergence no messages will be generated. The following theorems show that MPATH provides instantaneous loop-freedom and correctly computes the shortest multipath.
Theorem 4: For the algorithm MPATH executed at node i, let tn be the time when RDji is updated and reported for the nth time. Then, the following conditions always hold:

FDji(tn)≦min{RDji(tn−1),RDji(tn)}  (6)

FDji(t)≦FDji(tn)t∈[tn,tn+1]  (7)

Proof: From the working of MPATH in FIG. 6, it is observed that RDji is updated at line 3c when (a) the node goes from PASSIVE-to-ACTIVE because of one or more distance increases; (b) the node receives the last reply and goes from ACTIVE-to-PASSIVE state; (c) the node is in PASSIVE state and remains in PASSIVE state because the distance did not increase for any destination; and (d) the node receives the last reply but immediately goes into ACTIVE state. The reported distance RDji remains unchanged during the ACTIVE phase. Because FDji is updated at line 3a each time RDji is updated at line 3c, Eq. (6) follows. When the node is in ACTIVE phase, FDji may also be modified by the statement on line 3f, which implies Eq. (7).

Theorem 5: The safety property; at any time t, the successor sets Sji(t) which are computed by MPATH are loop-free.

Proof: The proof is based on showing that the FDji and Sji computed by MPATH satisfy the LFI conditions. Let tn, be the time when RDji is updated and reported for the nth time. The proof is by induction on the interval [tn,tn+1]. Let the LFI condition be true up to time tn, we show that:

FDji(t)≦Djik(t)t∈[tn,tn+1]  (8)

From Theorem 4 we have:

FDji(tn)≦min{RDji(tn−1),RDji(tn)}  (9)

FDji(tn+1)≦min{RDji(tn),RDji(tn+1)}  (10)

FDji(t)≦FDji(tn)t∈[tn,tn+1]  (11)

Combining the above equations we arrive at:

FDji(t)≦min{RDji(tn−1),RDji(tn)}t∈[tn,tn+1]  (12)

Let t′ be the time when a message sent by i at tn is received and processed by neighbor k. Because of the non-zero propagation delay across any link, t′ is such that tn<t′<tn+1 and because RDji is modified at tn and remains unchanged in (tn,tn+1) it follows that:

RDji(tn−1)≦Djik(t)t∈[tn,t′]  (13)

RDji(tn)≦Djik(t)t∈[tn,tn+1]  (14)

From Eq. (13) and (14):

min{RDji(tn−1),RDji(tn)}≦Djik(t)t∈[tn,tn+1]  (15)

From (12) and (15) the inductive step (8) follows. Because FDji(t0)≦Djik(t0) at initialization, from induction it is known that FDji(t)≦Djik(t0) for all t. Given that the successor sets are computed based on FDji(t), it follows that the LFI conditions are always satisfied. According to the Theorem 1 this implies that the successor graph SGj is always loop-free.

Theorem 6: Liveness property; a finite time after the last change in the network, the Dji gives the correct shortest distances and Sji={k|Djk<Dji, k∈Ni}.

Proof: The proof is similar to the proof of Theorem 4. The convergence of MPATH follows directly from the convergence of PATH because the update messages in MPATH are only delayed a finite time as allowed at line 4 in algorithm PATH. Therefore, the distances Dji in MPATH also converge to shortest distances. Because changes to Dji are always reported to the neighbors and are incorporated by the neighbors in their tables in finite time Djki=Djk, for k∈Ni after convergence. From line 3a in MPATH, it is observed that when node i becomes passive FDji=Dji holds true. Because all nodes are passive at convergence it follows that Sji={k|Djki<FDji, k∈Ni}={k|Djk<Dji, k∈Ni}.

3. Complexity Analysis

The main difference between PATH and MPATH is that the update messages sent in MPATH are delayed a finite amount of time in order to enforce the invariants. As a result, the complexity of PATH and MPATH are essentially the same and are therefore collectively analyzed.
The storage complexity is the amount of table space needed at a node. Each one of the Ni neighbor tables and the main distance tables has size of the order O(|N|) and the main link table Ti can grow, during execution of MTU, to size at most |Ni|times O(|N|). The storage complexity is therefore of the order O(|Ni||N|).
The time complexity is the time it takes for the network to converge after the last link cost change in the network. To determine time complexity it is assumed that the computation time is negligible in comparison with the communication time. If tn is the time when every node has the n-hop minimum tree, because every node processes and reports changes in finite time |tn+1−tn| is bounded. Let |tn+1−tn|≦θ for some finite constant θ. From theorem 3, the convergence time can be at most |N|θ and, hence, the time complexity is O(|N|).
The computation complexity is the time taken to build the node's shortest path tree in Ti from the neighbor tables Tki. Updating of Ti with Tki information is O(|Ni||N|) operation and running Dijkstra on Ti takes O(|Ni||N|log(|N|)). Therefore the computational complexity is O(|Ni||N|+|Ni||N|log(|N|)).
The communication complexity is the number of update messages required for propagating a set of link-cost changes. The analysis for multiple link-cost-changes is complex because of the sensitivity to the timing of the changes. So, therefore the analysis is provided only for the case of a single link-cost change. A node removes a link from its shortest path tree if only a shorter path using two or more links is discovered and the path is stored. Therefore, a removed link will not be added again to the shortest path which means that a link can be included and deleted from the shortest path by a node at most one time. It will be appreciated that since nodes report each change only once to each neighbor, that an update message can travel only once on a given link and therefore the number of messages sent by a node can be at most O(|E|).
For certain topologies and sensitively timed sequences of link cost changes the amount of communication required by PATH can be exponential. One industry example (Humblet) exhibits such behavior, and though PATH is different from the shortest-path algorithm utilized therein, it should be noted that PATH is not immune from such exponential behavior. However, it appears that such scenarios would require sensitively timed link-cost changes which are very unlikely to occur in practice. If necessary, a small hold-down time before sending update messages may be used to prevent such behavior.
Accordingly, it will be seen that this invention provides a routing algorithm based on distance information that provides multiple paths that need not have equal costs and that are loop-free at every instant, without requiring inter-nodal synchronization spanning more than one hop. The loop-free invariant conditions presented here are quite general and can be used with existing internet protocols. The multiple successors that MPATH makes available at each node can be used for traffic load-balancing, which is necessary for minimizing delays in a network as has been shown using other algorithms, such as MPDA. MPATH can therefore be used as an alternative to MPDA to get similar performance.
Although the description above contains many specificities, these should not be construed as limiting the scope of the invention but as merely providing illustrations of some of the presently preferred embodiments of this invention. Therefore, it will be appreciated that the scope of the present invention fully encompasses other embodiments which may become obvious to those skilled in the art, and that the scope of the present invention is accordingly to be limited by nothing other than the appended claims, in which reference to an element in the singular is not intended to mean “one and only one” unless explicitly so stated, but rather “one or more.” All structural, chemical, and functional equivalents to the elements of the above-described preferred embodiment that are known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be encompassed by the present claims. Moreover, it is not necessary for a device or method to address each and every problem sought to be solved by the present invention, for it to be encompassed by the present claims. Furthermore, no element, component, or method step in the present disclosure is intended to be dedicated to the public regardless of whether the element, component, or method step is explicitly recited in the claims. No claim element herein is to be construed under the provisions of 35 U.S.C. 112, sixth paragraph, unless the element is expressly recited using the phrase “means for.”

## Claims

1. A method for loop-free multipath routing of data in a network, comprising:
(a) maintaining at each node i in a network,
(i) a main distance table (MDT) containing Dji and pji, where Dji is the distance of node i to destination j and pji is the predecessor to destination j on the shortest path from i to j,
(ii) said MDT further containing, for each destination j, successor set Sji, feasible distance FDji, reported distance RDji, and flags designated as changed and report-it,
(iii) a main link table (MLT) Ti which is the node's view of the network and contains links represented by (m, n, d) where (m, n) is a link with cost d,
(iv) a neighbor distance table (NDT) for neighbor k containing Djki and pjki where Djki is the distance of neighbor k to j as communicated by k and pjki is the predecessor to j on the shortest path from k to j as notified by k,
(v) a neighbor link table (NLT)Tki which is the view that neighbor k has of the network as known to i and contains link information derived from the distance and predecessor information in the NDT, and
(vi) an adjacent link table (ALT) containing the cost lki of an adjacent link to each neighbor k, wherein said cost is infinity if a link is down;

(b) in response to receipt of an update message M from a neighbor k, detection of a change in cost of an adjacent link to k, or detection of a change in status of an adjacent link to k,
(i) updating the NDT and NLT for neighbor k with links (m, n, d) where d=Dnki−Dmki and m=pnki, and
(ii) constructing an MLT for neighbor k by merging topologies Tki and adjacent links lki; and

(c) routing data through a loop-free path in the network;
wherein at least one said loop-free path is determined using information in each of said tables at each node i.

2. A method as recited in claim 1, further comprising:
(d) for each destination j marked as changed, adding an update entry [j,Dji, pji] to a new message M′; and
(e) within a finite amount of time, sending message M′ to each neighbor k.

3. A method as recited in claim 2, wherein an update message comprises:
at least one update entry;
said update entry comprising a triplet [j,d,p], where d is the distance of the node sending the message to destination j and p is the predecessor on the path to j; and
flags for synchronization designated as query and reply.

4. A method as recited in claim 1, further comprising:
updating the MLT with link information reported by the neighbor k that offers the shortest distance from the node i to the head node m of the link if two or more NLTs contain conflicting information of link (m, n).

5. A method as recited in claim 1, further comprising:
after merging topologies Tki and adjacent links lki, running Dijkstra's shortest path algorithm to find the shortest path tree and deletes all links from the MLT that are not in the tree.

6. A method as recited in claim 5, further comprising:
obtaining distances Dji and predecessors pji from the MLT.

7. A method as recited in claim 6, further comprising:
comparing the tree with the previous shortest path tree and reporting only the differences to the neighbors.

8. A method as recited in claim 1, further comprising:
computing a successor set Sji by, for each destination j, allowing a node i to choose a successor having a distance to j as known to i that is less than the distance of node i to destination j that is known to a neighbor of node i.

9. A method as recited in claim 8, further comprising synchronizing the exchange of update messages among neighbors using query and reply flags contained within the messages.

10. A method as recited in claim 9, wherein if a node sends a message with a query flag set, said node must wait until a reply is received from all of said node's neighbors before said node is allowed to send the next update message.

11. A method as recited in claim 10, wherein said node is deemed to be in an ACTIVE state when said node sends a message with a query flag set.

12. A method as recited in claim 11, wherein said node is deemed to be in a PASSIVE state when said node has no message with a query flag set that is in transit or pending to be processed.

13. A method as recited in claim 12:
wherein if a node in a PASSIVE state receives an event resulting in changes in its distances to a destination, before the node sends an update message to report a new distance, said node checks if the distance Dji to any destination j has increased above the previously reported distance RDji;
wherein if no distance has increased, then said node remains in a PASSIVE state; and
wherein if a distance has increased, said node sets the query flag in the update message, sends said message, and goes into an ACTIVE state.

14. A method as recited in claim 11;
wherein a node in an ACTIVE cannot send any update messages or add neighbors to any successor set;
wherein after receiving replies from all its neighbors, the node is allowed to modify the successor sets and report any changes that may have occurred since the time it has transitioned to ACTIVE state; and
wherein if none of the distances increased beyond the reported distance, the node transitions to PASSIVE state.

15. A method as recited in claim 12:
wherein if a node receives a message with the query flag set when in PASSIVE state, said node modifies said node's tables and sends back an update message with the reply-flag set; and
wherein if a node receives a message with the query flag set when in ACTIVE stage, said node modifies said node's tables and sends back an empty message with no updates and with the reply flag set.

16. A method for loop-free multipath routing of data in a network, comprising:
(a) maintaining at each node i in a network,
(i) a main distance table (MDT) containing Dji and pji, where Dji is the distance of node i to destination j and pji is the predecessor to destination j on the shortest path from i to j,
(ii) said MDT further containing, for each destination j, successor set Sji, feasible distance FDji, reported distance RDji, and flags designated as changed and report-it,
(iii) a main link table (MLT) Ti which is the node's view of the network and contains links represented by (m, n, d) where (m, n) is a link with cost d,
(iv) a neighbor distance table (NDT) for neighbor k containing Djki and pjki where Djki is the distance of neighbor k to j as communicated by k and pjki is the predecessor to j on the shortest path from k to j as notified by k,
(v) a neighbor link table (NLT)Tki which is the view that neighbor k has of the network as known to i and contains link information derived from the distance and predecessor information in the NDT, and
(vi) an adjacent link table (ALT) containing the cost lki of an adjacent link to each neighbor k, wherein said cost is infinity if a link is down;

(b) in response to receipt of an update message M from a neighbor k, detection of a change in cost of an adjacent link to k, or detection of a change in status of an adjacent link to k,
(i) updating the NDT and NLT for neighbor k with links (m, n, d) where d=Dnki−Dmki and m=pnki, and
(ii) constructing an MLT for neighbor k by merging topologies Tki and adjacent links lki;

(c) for each destination j marked as changed, adding an update entry [j,Dji, pji] to a new message M′;
(d) within a finite amount of time, sending message M′ to each neighbor k; and
(e) routing data through a loop-free path in the network;
wherein at least one said loop-free path is determined using information in each of said tables at each node i.

17. A method as recited in claim 16, wherein an update message comprises:
at least one update entry;
said update entry comprising a triplet [j,d,p], where d is the distance of the node sending the message to destination j and p is the predecessor on the path to j; and
flags for synchronization designated as query and reply.

18. A method as recited in claim 16, further comprising:
updating the MLT with link information reported by the neighbor k that offers the shortest distance from the node i to the head node m of the link if two or more neighbor link tables contain conflicting information of link (m, n).

19. A method as recited in claim 16, further comprising:
after merging topologies Tki and adjacent links lki, running Dijkstra's shortest path algorithm to find the shortest path tree and deletes all links from the MLT that are not in the tree.

20. A method as recited in claim 19, further comprising:
obtaining distances Dji and predecessors pji from the MLT.

21. A method as recited in claim 20, further comprising:
comparing the tree with the previous shortest path tree and reporting only the differences to the neighbors.

22. A method for loop-free multipath routing of data in a network, comprising:
(a) maintaining at each node i in a network,
(i) a main distance table (MDT) containing Dji and pji, where Dji is the distance of node i to destination j and pji is the predecessor to destination j on the shortest path from i to j,
(ii) said MDT further containing, for each destination j, successor set Sji feasible distance FDji, reported distance RDji, and flags designated as changed and report-it,
(iii) a main link table (MLT) Ti which is the node's view of the network and contains links represented by (m, n, d) where (m, n) is a link with cost d,
(iv) a neighbor distance table (NDT) for neighbor k containing Djki and pjki where Djki is the distance of neighbor k to j as communicated by k and pjki is the predecessor to j on the shortest path from k to j as notified by k,
(v) a neighbor link table (NLT)Tki which is the view that neighbor k has of the network as known to i and contains link information derived from the distance and predecessor information in the NDT, and
(vi) an adjacent link table (ALT) containing the cost lki of an adjacent link to each neighbor k, wherein said cost is infinity if a link is down;

(b) in response to receipt of an update message M from a neighbor k, detection of a change in cost of an adjacent link to k, or detection of a change in status of an adjacent link to k,
(i) updating the NDT and NLT for neighbor k with links (m, n, d) where d=Dnki−Dmki and m=pnki,
(ii) constructing an MLT for neighbor k by merging topologies Tki and adjacent links lki;

(c) computing a successor set Sji by, for each destination j, allowing a node i to choose a successor having a distance to j as known to i that is less than the distance of node i to destination j that is known to a neighbor of node i; and
(d) routing data through a loop-free path in the network;
wherein at least one said loop-free path is determined using information in said tables at each node i.

23. A method as recited in claim 22, further comprising:
updating the MLT with link information reported by the neighbor k that offers the shortest distance from the node i to the head node m of the link if two or more NLTs contain conflicting information of link (m, n).

24. A method as recited in claim 22, further comprising:
after merging topologies Tki and adjacent links lki, running Dijkstra's shortest path algorithm to find the shortest path tree and deletes all links from the MLT that are not in the tree.

25. A method as recited in claim 24, further comprising:
obtaining distances Dji and predecessors pji from the MLT.

26. A method as recited in claim 25, further comprising:
comparing the tree with the previous shortest path tree and reporting only the differences to the neighbors.

27. A method as recited in claim 22, further comprising synchronizing the exchange of update messages among neighbors using query and reply flags contained within the messages.

28. A method as recited in claim 27, wherein if a node sends a message with a query flag set, said node must wait until a reply is received from all of said node's neighbors before said node is allowed to send the next update message.

29. A method as recited in claim 28, wherein said node is deemed to be in an ACTIVE state when said node sends a message with a query flag set.

30. A method as recited in claim 29, wherein said node is deemed to be in a PASSIVE state when said node has no message with a query flag set that is in transit or pending to be processed.

31. A method as recited in claim 30:
wherein if a node in a PASSIVE state receives an event resulting in changes in its distances to a destination, before the node sends an update message to report a new distance, said node checks if the distance Dji to any destination j has increased above the previously reported distance RDji;
wherein if no distance has increased, then said node remains in a PASSIVE state; and
wherein if a distance has increased, said node sets the query flag in the update message, sends said message, and goes into an ACTIVE state.

32. A method as recited in claim 29, wherein a node in an ACTIVE cannot send any update messages or add neighbors to any successor set.

33. A method as recited in claim 29:
wherein after receiving replies from all its neighbors, the node is allowed to modify the successor sets and report any changes that may have occurred since the time it has transitioned to ACTIVE state; and
wherein if none of the distances increased beyond the reported distance, the node transitions to PASSIVE state.

34. A method as recited in claim 30:
wherein if a node receives a message with the query flag set when in PASSIVE state, said node modifies said node's tables and sends back an update message with the reply flag set; and
wherein if a node receives a message with the query flag set when in ACTIVE stage, said node modifies said node's tables and sends back an empty message with no updates and with the reply flag set.

35. A method for loop-free multipath routing of data in a network, comprising:
(a) maintaining at each node i in a network,
(i) a main distance table (MDT) containing Dji and pji, where Dji is the distance of node i to destination j and pji is the predecessor to destination j on the shortest path from i to j,
(ii) said MDT further containing, for each destination j, successor set Sji, feasible distance FDji, reported distance RDji, and flags designated as changed and report-it,
(iii) a main link table (MLT) Ti which is the node's view of the network and contains links represented by (m, n, d) where (m, n) is a link with cost d,
(iv) a neighbor distance table (NDT) for neighbor k containing Djki and pjki where Djki is the distance of neighbor k to j as communicated by k and pjki is the predecessor to j on the shortest path from k to j as notified by k,
(v) a neighbor link table (NLT)Tki which is the view that neighbor k has of the network as known to i and contains link information derived from the distance and predecessor information in the NDT, and
(vi) an adjacent link table (ALT) containing the cost lki of an adjacent link to each neighbor k, wherein said cost is infinity if a link is down;

(b) in response to receipt of an update message M from a neighbor k, detection of a change in cost of an adjacent link to k, or detection of a change in status of an adjacent link to k,
(i) updating the NDT and NLT for neighbor k with links (m, n, d) where d=Dnki−Dmki and m=pnki,
(ii) constructing an MLT for neighbor k by merging topologies Tki and adjacent links lki, and
(iii) running Dijkstra's shortest path algorithm to find the shortest path tree and deletes all links from the MLT that are not in the tree;

(c) computing a successor set Sji by, for each destination j, allowing a node i to choose a successor having a distance to j as known to i that is less than the distance of node i to destination j that is known to a neighbor of node i; and
(d) routing data through a loop-free path in the network;
wherein at least one said loop-free path is determined using information in said tables at each node i.

36. A method as recited in claim 35, further comprising:
updating the MLT with link information reported by the neighbor k that offers the shortest distance from the node i to the head node m of the link if two or more NLTs contain conflicting information of link (m, n).

37. A method as recited in claim 36, further comprising:
obtaining distances Dji and predecessors pji from the MLT.

38. A method as recited in claim 37, further comprising:
comparing the tree with the previous shortest path tree and reporting only the differences to the neighbors.

39. A method as recited in claim 35, further comprising synchronizing the exchange of update messages among neighbors using query and reply flags contained within the messages.

40. A method as recited in claim 39, wherein if a node sends a message with a query flag set, said node must wait until a reply is received from all of said node's neighbors before said node is allowed to send the next update message.

41. A method as recited in claim 40, wherein said node is deemed to be in an ACTIVE state when said node sends a message with a query flag set.

42. A method as recited in claim 41, wherein said node is deemed to be in a PASSIVE state when said node has no message with a query flag set that is in transit or pending to be processed.

43. A method as recited in claim 42:
wherein if a node in a PASSIVE state receives an event resulting in changes in its distances to a destination, before the node sends an update message to report a new distance, said node checks if the distance Dji to any destination j has increased above the previously reported distance RDji;
wherein if no distance has increased, then said node remains in a PASSIVE state; and
wherein if a distance has increased, said node sets the query flag in the update message, sends said message, and goes into an ACTIVE state.

44. A method as recited in claim 41, wherein a node in an ACTIVE cannot send any update messages or add neighbors to any successor set.

45. A method as recited in claim 41:
wherein after receiving replies from all its neighbors, the node is allowed to modify the successor sets and report any changes that may have occurred since the time it has transitioned to ACTIVE state; and
wherein if none of the distances increased beyond the reported distance, the node transitions to PASSIVE state.

46. A method as recited in claim 42:
wherein if a node receives a message with the query flag set when in PASSIVE state, said node modifies said node's tables and sends back an update message with the reply flag set; and
wherein if a node receives a message with the query flag set when in ACTIVE stage, said node modifies said node's tables and sends back an empty message with no updates and with the reply flag set.

47. A method for loop-free multipath routing of data in a network, comprising:
(a) maintaining at each node i in a network,
(i) a main distance table (MDT) containing Dji and pji, where Dji is the distance of node i to destination j and pji is the predecessor to destination j on the shortest path from i to j,
(ii) said MDT further containing, for each destination j, successor set Sji, feasible distance FDji, reported distance RDji, and flags designated as changed and report-it,
(iii) a main link table (MLT) Ti which is the node's view of the network and contains links represented by (m, n, d) where (m, n) is a link with cost d,
(iv) a neighbor distance table (NDT) for neighbor k containing Djki and pjki where Djki is the distance of neighbor k to j as communicated by k and pjki is the predecessor to j on the shortest path from k to j as notified by k,
(v) a neighbor link table (NLT)Tki which is the view that neighbor k has of the network as known to i and contains link information derived from the distance and predecessor information in the NDT, and
(vi) an adjacent link table (ALT) containing the cost lki of an adjacent link to each neighbor k, wherein said cost is infinity if a link is down;

(b) in response to receipt of an update message M from a neighbor k, detection of a change in cost of an adjacent link to k, or detection of a change in status of an adjacent link to k,
(i) updating the NDT and NLT for neighbor k with links (m, n, d) where d=Dnki−Dmki and m=pnki,
(ii) constructing an MLT for neighbor k by merging topologies Tki and adjacent links lki;

(c) computing a successor set Sji by, for each destination j, allowing a node i to choose a successor having a distance to j as known to i that is less than the distance of node i to destination j that is known to a neighbor of node i;
(d) synchronizing the exchange of update messages among neighbors using query and reply flags contained within the messages; and
(e) routing data through a loop-free path in the network;
wherein at least one said loop-free path is determined using information in said tables at each node i.

48. A method as recited in claim 47, further comprising:
updating the MLT with link information reported by the neighbor k that offers the shortest distance from the node i to the head node m of the link if two or more NLTs contain conflicting information of link (m, n).

49. A method as recited in claim 47, further comprising:
after merging topologies Tki and adjacent links lki, running Dijkstra's shortest path algorithm to find the shortest path tree and deletes all links from the MLT that are not in the tree.

50. A method as recited in claim 49, further comprising:
obtaining distances Dji and predecessors pji from the MLT.

51. A method as recited in claim 50, further comprising:
comparing the tree with the previous shortest path tree and reporting only the differences to the neighbors.

52. A method as recited in claim 47, wherein if a node sends a message with a query-flag set, said node must wait until a reply is received from all of said node's neighbors before said node is allowed to send the next update message.

53. A method as recited in claim 52, wherein said node is deemed to be in an ACTIVE state when said node sends a message with a query flag set.

54. A method as recited in claim 53, wherein said node is deemed to be in a PASSIVE state when said node has no message with a query flag set that is in transit or pending to be processed.

55. A method as recited in claim 54:
wherein if a node in a PASSIVE state receives an event resulting in changes in its distances to a destination, before the node sends an update message to report a new distance, said node checks if the distance Dji to any destination j has increased above the previously reported distance RDji;
wherein if no distance has increased, then said node remains in a PASSIVE state; and
wherein if a distance has increased, said node sets the query flag in the update message, sends said message, and goes into an ACTIVE state.

56. A method as recited in claim 53, wherein a node in an ACTIVE cannot send any update messages or add neighbors to any successor set.

57. A method as recited in claim 53:
wherein after receiving replies from all its neighbors, the node is allowed to modify the successor sets and report any changes that may have occurred since the time it has transitioned to ACTIVE state; and
wherein if none of the distances increased beyond the reported distance, the node transitions to PASSIVE state.

58. A method as recited in claim 54:
wherein if a node receives a message with the query flag set when in PASSIVE state, said node modifies said node's tables and sends back an update message with the reply-flag set; and
wherein if a node receives a message with the query flag set when in ACTIVE stage, said node modifies said node's tables and sends back an empty message with no updates and with the reply flag set.