Source: https://patents.google.com/patent/US7768926B2/en
Timestamp: 2019-07-20 02:06:03
Document Index: 404530120

Matched Legal Cases: ['art” 401', 'art” 405', 'art” 405', 'art” 405', 'art” 405', 'art” 410', 'Application No. 095126422', 'Application No. 095126419']

US7768926B2 - Effective bandwidth path metric and path computation method for wireless mesh networks with wired links - Google Patents
Effective bandwidth path metric and path computation method for wireless mesh networks with wired links Download PDF
US7768926B2
US7768926B2 US11/618,073 US61807306A US7768926B2 US 7768926 B2 US7768926 B2 US 7768926B2 US 61807306 A US61807306 A US 61807306A US 7768926 B2 US7768926 B2 US 7768926B2
US11/618,073
US20070211636A1 (en
Bhargav Ramachandra Bellur
Jorjeta Gueorguieva Jetcheva
2006-03-09 Priority to IN627/DEL/2006 priority Critical
2006-03-09 Priority to IN627DE2006 priority
2006-12-29 Application filed by Firetide Inc filed Critical Firetide Inc
2007-03-04 Priority claimed from PCT/US2007/063247 external-priority patent/WO2007103837A1/en
2007-05-30 Assigned to FIRETIDE, INC. reassignment FIRETIDE, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BELLUR, BHARGAV RAMACHANDRA, SINGHAL, AMAR, JETCHEVA, JORGETA GUEORGUIEVA, PRAKASH, RAVI
2007-09-13 Publication of US20070211636A1 publication Critical patent/US20070211636A1/en
2008-09-16 Assigned to SAND HILL VENTURE DEBT III, LLC reassignment SAND HILL VENTURE DEBT III, LLC SECURITY AGREEMENT Assignors: FIRETIDE, INC.
2010-08-03 Publication of US7768926B2 publication Critical patent/US7768926B2/en
2013-02-04 Assigned to FIRETIDE, INC. reassignment FIRETIDE, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: SAND HILL VENTURE DEBT III, LLC
2019-06-21 Assigned to FIRETIDE, INC. reassignment FIRETIDE, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: SILICON VALLEY BANK
Enhanced mesh network performance is provided by computation of a path metric with respect to multi-hop paths between nodes in a mesh network and determination of a path through the mesh network that is optimal according to the path metric. Information is communicated in the mesh network according to the determined path. Nodes in the mesh network are enabled to communicate via one or more wireless links and/or one or more wired links. The path metric optionally includes an effective bandwidth path metric having elements (listed from highest to lowest conceptual priority) including an inverse of a sustainable data rate, a number of wireless links, and a number of wireless and wired links. The sustainable data rate is a measure of communication bandwidth that is deliverable by a path for a period of time. Accounting is made for interference between contiguous wireless links operating on the same channel.
India Application Serial No. 627/DEL/2006, filed Mar. 9, 2006, first named inventor Bhargav Ramachandra Bellur, and entitled EFFECTIVE BANDWIDTH PATH METRIC AND PATH COMPUTATION ALGORITHM FOR WIRELESS MESH NETWORKS WITH WIRED LINK.
Advancements in wireless networks are needed to provide improvements in performance, efficiency, and utility of use.
The invention may be implemented in numerous ways, including as a process, an article of manufacture, an apparatus, a system, a composition of matter, and a computer readable medium such as a computer readable storage medium or a computer network wherein program instructions are sent over optical or electronic communication links. In this specification, these implementations, or any other form that the invention may take, may be referred to as techniques. In general, the order of the steps of disclosed processes may be altered within the scope of the invention. The Detailed Description provides an exposition of one or more embodiments of the invention that enable improvements in performance, efficiency, and utility of use in the field identified above. The Detailed Description includes an Introduction to facilitate the more rapid understanding of the remainder of the Detailed Description. The Introduction includes Example Embodiments of systems, methods, and computer readable media in accordance with the concepts taught herein. As is discussed in more detail in the Conclusions, the invention encompasses all possible modifications and variations within the scope of the issued claims.
FIG. 1 illustrates an embodiment of a mixed wireless and wired mesh network.
FIG. 2 illustrates portions of the mesh network of FIG. 1 for an example calculation of an effective bandwidth metric.
FIG. 3 illustrates portions of the mesh network of FIG. 1 for an example calculation of optimal paths.
FIGS. 4A-D illustrate various aspects of an embodiment of a path computation technique.
FIG. 5 illustrates selected details of hardware aspects of an embodiment of a node.
FIG. 6 illustrates selected details of software aspects of an embodiment of a node.
A detailed description of one or more embodiments of the invention is provided below along with accompanying figures that illustrate the principles of the invention. The invention is described in connection with the embodiments. It is well established that it is neither necessary, practical, or possible to exhaustively describe every embodiment of the invention. Thus the embodiments herein are understood to be merely illustrative, the invention is expressly not limited to or by any or all of the embodiments herein, and the invention encompasses numerous alternatives, modifications and equivalents. To avoid monotony in the exposition, a variety of word labels (including but not limited to: first, last, certain, particular, select, and notable) may be applied to separate sets of embodiments; as used herein such labels are expressly not meant to convey quality, or any form of preference or prejudice, but merely to conveniently distinguish among the separate sets. Wherever multiple embodiments serve to illustrate variations in process, method, and/or program instruction features, other embodiments are contemplated that in accordance with a predetermined or a dynamically determined criterion perform static and/or dynamic selection of one of a plurality of modes of operation corresponding respectively to a plurality of the multiple embodiments. Numerous specific details are set forth in the following description to provide a thorough understanding of the invention. The details are provided for the purpose of example and the invention may be practiced according to the claims without some or all of the specific details. For the purpose of clarity, technical material that is known in the technical fields related to the invention has not been described in detail so that the invention is not unnecessarily obscured.
Enhanced mesh network performance is provided by computation of a path metric with respect to multi-hop paths between nodes in a mesh network and determination of a path through the mesh network that is optimal according to the path metric. Information, such as in the form of data packets, is communicated in the mesh network according to the determined path. Nodes in the mesh network are enabled to communicate via one or more wireless links, one or more wired links, or both. Each wireless link is tuned to a specific channel (i.e. the channel is assigned to or associated with the wireless link), and all wireless links use a single channel or alternatively various wireless links use a plurality of channels, such that communication is enabled to occur in parallel over the channels. The assignment of channels to wireless links is permanent, in some embodiments, or temporary (varying over time), in other embodiments.
The path metric optionally includes an effective bandwidth path metric having elements (listed from highest to lowest conceptual priority) including an inverse of a sustainable data rate, a number of wireless links, and a number of wireless and wired links. The sustainable data rate is a measure of communication bandwidth that is deliverable by a path for a significant period of time. A higher sustainable data rate indicates a relatively better path. The number of wireless links is a measure of the amount of wireless communication resources used along the path. A lower number of wireless links indicates a relatively better path. The number of wireless and wired links (or total links) is a measure of wireless and wired communication resources used along the path. A lower number of total links indicates a relatively better path.
The path through the mesh network is managed by one or more mesh routing protocols. The routing protocols optionally stores topological information about the mesh network according to links, where a link between a pair of nodes in the mesh network indicates the pair of nodes is enabled to communicate with each other. In some usage scenarios, a path between the pair of mesh nodes traverses other mesh nodes and thus includes one or more links. In other words, a path having a single link indicates the pair of mesh nodes are enabled to communicate directly with each other, and a path having two or more links indicates corresponding intermediary nodes. A routing protocol optionally computes a path between two mesh nodes based on links (and associated link characteristics) the routing protocol is aware of. The path computation optionally discovers a path having a highest (or relatively higher) throughput (or bandwidth). The path computation optionally finds a path having a lowest (or a relatively lower) traversal latency. The path computation optionally determines a path having a lowest (or relatively lower) packet loss. Various path computations are directed to select a path according to any computation of maximized bandwidth, minimized latency, and minimized packet loss, according to various embodiments. The computed path is then optionally used for delivering traffic between the nodes the path is between.
Links in a mesh network are wireless, wired, or both, and each node in the mesh implements any number and combination of wireless and wired interfaces. Transmissions via the wireless interfaces are broadcast in nature, so any two wireless interfaces that are tuned to the same channel and are within transmission range of each other optionally form a wireless link. Similarly, any two wired interfaces that are coupled together optionally form a wired link.
Wireless transmissions on the same channel interfere with each other when transmitting nodes are within interference range of each other. However, wireless transmissions on non-overlapping channels do not interfere with each other. Thus a node having more than one wireless interface, each assigned to a unique channel, is enabled to simultaneously communicate via each of the wireless interfaces. Wired transmissions, in contrast, do not interfere with transmissions on any other wired or wireless links.
Each link has an associated link metric or cost that reflects desirability of the link with respect to forwarding traffic, i.e. a link having a lower cost is relatively more attractive for communicating data. Some metrics have associated multiple characteristics or sub-metrics that are combinable in various ways to arrive at an overall link metric. Link sub-metrics include any combination of raw data rate, link utilization, tendency of the link to lose data (referred to as lossy-ness hereinafter), available bandwidth, and other characteristics of the link.
Various combinations of metrics and other relevant characteristics (such as current channel assignment) associated with each link are used by a mesh routing protocol to compute best or relatively better paths for delivering traffic between nodes of the mesh network. A path metric or cost is a function of the individual link metrics, costs, and characteristics associated with the links of the path. Various path metrics are computed for the same path according to differently chosen individual link metrics, costs, and characteristics, and differing manners of combining the individual link metrics, costs, and characteristics, according to various embodiments.
The path metric computation is performed for a mesh network having a known set of links, each operating according to a respective channel assignment, and each having respective associated cost metrics. The path metric computation provides a set of best paths from each node in the mesh network to all other nodes in the mesh network, i.e. the most efficient communication pathways between the nodes of the mesh network.
FIG. 1 illustrates an embodiment of a mixed wireless and wired mesh network having a collection of nodes each including at least one wireless interface (such as Node 100A having wireless interface 121A operating on channel 1). Some of the nodes include more than one wireless interface (such as Node 100S having wireless interfaces 121S and 122S operating on channels 1 and 2, respectively). Some of the nodes include a wired interface (such as Nodes 100C and 100S having respective wired interfaces coupled to wired link 110CS). Communications traveling via wireless links on the same channel (such as wireless links 111BS and 111DS on channel 2) may interfere with each other, but do not interfere with transmissions on other channels. Communications carried via wired links (such as via wired links 110CS and 110BE) do not interfere with each other or any other wireless link.
In the figure, element identifiers beginning with “100” are associated with nodes of the mesh network (such as Nodes 100A and 100B). Element identifiers beginning with “12” are representative of wireless interfaces, with the third character of the identifier describing a channel associated with the wireless interface, and the last character of the identifier indicating the node the wireless interface is included in. An example of a wireless interface identifier is wireless interface 125F operating on channel 5 and included in Node 100F. Element identifiers starting with “111” represent wireless links formed via wireless interfaces, with the fourth and last characters of the identifier indicating nodes the wireless link couples. An example of a wireless link is wireless link 111EH coupling Nodes 100E and 100H. Element identifiers starting with “110” are used for wired links, with the fourth and last characters of the identifier indicating nodes the wired link couples. An example of a wired link is wired link 110BE coupling Nodes 100B and 100E.
In concluding the introduction to the detailed description, what follows is a collection of example embodiments, providing additional description of a variety of embodiment types in accordance with the concepts taught herein; these examples are not meant to be mutually exclusive, exhaustive, or restrictive; and the invention is not limited to these example embodiments but rather encompasses all possible modifications and variations within the scope of the issued claims.
A first illustrative combination of a system comprising means for determining an effective wireless bandwidth for a path according to one of a plurality of techniques, the path having a length of contiguous wireless links; and means for selecting one of the techniques based at least in part on the length.
The first illustrative combination further comprising means for determining a best path through a mesh network that includes the contiguous wireless links. The foregoing illustrative combination further comprising means for routing traffic according to the best path. The foregoing illustrative combination wherein the mesh network includes a plurality of nodes. The foregoing illustrative combination wherein at least two of the nodes are enabled to route a portion of the traffic via a wired link. The foregoing illustrative combination wherein at least a pair of the nodes are enabled to route the portion of the traffic via a wireless link. The foregoing illustrative combination wherein the wireless link is one of the contiguous wireless links.
The first illustrative combination wherein the means for selecting selects a first one of the techniques if the length is less than a threshold. The foregoing illustrative combination wherein the means for selecting selects a second one of the techniques if the length is greater than the threshold. The foregoing illustrative combination wherein the means for selecting selects the second one of the techniques if the length is equal to the threshold.
The first illustrative combination wherein the means for determining comprises means for calculating the effective wireless bandwidth as a function of a reciprocal of an inverse effective data rate, the inverse effective data rate being a sum of respective reciprocal bandwidths corresponding to each of the contiguous wireless links.
The first illustrative combination wherein the means for determining comprises means for calculating the effective wireless bandwidth as a function of a plurality of inverse effective data rates, each of the inverse effective data rates corresponding to a respective set of contiguous wireless links, the sets of contiguous wireless links including all sequences of wireless links in the contiguous wireless links having a respective length equal to a threshold. The foregoing illustrative combination wherein the function selects a minimum bandwidth based at least in part on the inverse effective data rates. The foregoing illustrative combination wherein the minimum bandwidth corresponds to a minimum of reciprocals of the inverse effective data rates.
A second illustrative combination of a system comprising a processor; at least one interface coupled to the processor; wherein the processor is enabled to execute instructions to determine an effective wireless bandwidth of a path according to one of a plurality of techniques selected based at least in part on a length of the path; and wherein the path is via a plurality of contiguous wireless links equal in number to the length.
The foregoing illustrative combination wherein the interface is at least one of a wireless interface and a wired interface. The foregoing illustrative combination wherein the processor is further enabled to execute further instructions to determine a best path through a mesh network that includes the contiguous wireless links. The foregoing illustrative combination wherein the processor is further enabled to execute additional instructions to route traffic according to the best path. The foregoing illustrative combination wherein the processor is included in one of a plurality of nodes included in the mesh network. The foregoing illustrative combination wherein the at least one interface implements an endpoint of at least one link of the contiguous wireless links.
A third illustrative combination of a method comprising of computing an effective wireless bandwidth for a path according to one of a plurality of techniques selected based at least in part on a length of the path; and wherein the path is via a plurality of contiguous wireless links equal in number to the length.
A fourth illustrative combination of the third illustrative combination further comprising computing a best path through a mesh network that includes the contiguous wireless links. A fifth illustrative combination of the fourth illustrative combination further comprising routing traffic according to the best path.
A sixth illustrative combination of a computer readable medium having a set of instructions stored therein which when executed by a processing element causes the processing element to perform operations comprising computing an effective wireless bandwidth for a path according to one of a plurality of techniques selected based at least in part on a length of the path; wherein the path is via a plurality of contiguous wireless links equal in number to the length.
Any of the second, third, and sixth illustrative combinations, wherein a first one of the techniques is selected if the length is less than a threshold. The foregoing illustrative combination wherein a second one of the techniques is selected if the length is greater than the threshold. The foregoing illustrative combination wherein the second one of the techniques is selected if the length is equal to the threshold.
Any of the second, third, and sixth illustrative combinations, wherein at least one of the techniques includes calculating the effective wireless bandwidth as a function of a reciprocal of an inverse effective data rate, the inverse effective data rate being a sum of respective reciprocal bandwidths corresponding to each of the contiguous wireless links.
Any of the second, third, and sixth illustrative combinations, wherein at least one of the techniques includes calculating the effective wireless bandwidth as a function of a plurality of inverse effective data rates, each of the inverse effective data rates corresponding to a respective set of contiguous wireless links, the sets of contiguous wireless links including all sequences of wireless links in the contiguous wireless links having a respective length equal to a threshold. The foregoing illustrative combination wherein the function selects a minimum bandwidth based at least in part on the inverse effective data rates. The foregoing illustrative combination wherein the minimum bandwidth corresponds to a minimum of reciprocals of the inverse effective data rates.
A seventh illustrative combination of the sixth illustrative combination wherein the operations further comprise computing a best path through a mesh network that includes the contiguous wireless links. An eighth illustrative combination of the seventh illustrative combination wherein the operations further comprise routing traffic according to the best path.
Any of the fifth and eighth illustrative combinations, wherein the mesh network includes a plurality of nodes. The foregoing illustrative combination wherein at least two of the nodes are enabled to route a portion of the traffic via a wired link. The foregoing illustrative combination wherein at least a pair of the nodes are enabled to route the portion of the traffic via a wireless link. The foregoing illustrative combination wherein the wireless link is one of the contiguous wireless links.
A ninth illustrative combination of a system comprising means for evaluating a first cost associated with traversing a first path of links in a mesh network, the first path being associated with a source node and a destination node of the mesh network; means for evaluating a second cost associated with traversing a second path of links in the mesh network, the second path being associated with the source and the destination nodes; wherein the last link of the first path is a wired link; and wherein the last link of the second path is a wireless link.
The foregoing illustrative combination wherein the first cost is a first current cost and the first path is a first current path; and further comprising means for replacing a first minimum cost having an associated first best path with the first current cost and replacing the first best path with the first current path if the first current cost is less than the first minimum cost. The foregoing illustrative combination wherein the second cost is a second current cost and the second path is a second current path; and further comprising means for replacing a second minimum cost having an associated second best path with the second current cost and replacing the second best path with the second current path if the second current cost is less than the second minimum cost. The foregoing illustrative combination further comprising means for selecting a routing path that corresponds to the respective best path associated with the minimum of the first and the second minimum costs. The foregoing illustrative combination further comprising means for routing traffic along the routing path.
The ninth illustrative combination wherein the means for evaluating the first cost comprises means for determining an effective bandwidth for any contiguous wireless links along the first path. The ninth illustrative combination wherein the means for evaluating the second cost comprises means for determining an effective bandwidth for any contiguous wireless links along the second path.
A tenth illustrative combination of a system comprising a processor; at least one interface coupled to the processor; wherein the processor is enabled to execute instructions to determine respective first and second costs associated with traversing respective first and second paths of links in a mesh network; wherein the last link of the first path is a wired link; and wherein the last link of the second path is a wireless link.
The foregoing illustrative combination wherein the interface is at least one of a wireless interface and a wired interface. The foregoing illustrative combination wherein each of the paths are associated with a source node and a destination node. The foregoing illustrative combination wherein the first cost is a first current cost and the first path is a first current path; and wherein the processor is further enabled to execute further instructions to replace a first minimum cost having an associated first best path with the first current cost and to replace the first best path with the first current path if the first current cost is less than the first minimum cost. The foregoing illustrative combination wherein the second cost is a second current cost and the second path is a second current path; and wherein the processor is enabled to further execute additional instructions to replace a second minimum cost having an associated second best path with the second current cost and to replace the second best path with the second current path if the second current cost is less than the second minimum cost. The foregoing illustrative combination wherein the processor is further enabled to execute other instructions to select a routing path that corresponds to the respective best path associated with the minimum of the first and the second minimum costs.
The tenth illustrative combination wherein the first cost is calculated based at least in part on bandwidth reduction due to any contiguous wireless links along the first path. The tenth illustrative combination wherein the second cost is calculated based at least in part on bandwidth reduction due to any contiguous wireless links along the second path.
An eleventh illustrative combination of a method comprising evaluating respective first and second costs associated with traversing respective first and second paths of links in a mesh network; wherein the last link of the first path is a wired link; and wherein the last link of the second path is a wireless link.
The foregoing illustrative combination wherein each of the paths are associated with a source node and a destination node. The foregoing illustrative combination wherein the first cost is a first current cost and the first path is a first current path; and further comprising if the first current cost is less than a first minimum cost associated with a first best path, then replacing the first minimum cost with the first current cost and replacing the first best path with the first current path. The foregoing illustrative combination wherein the second cost is a second current cost and the second path is a second current path; and further comprising if the second current cost is less than a second minimum cost associated with a second best path, then replacing the second minimum cost with the second current cost and replacing the second best path with the second current path. The foregoing illustrative combination further comprising selecting a routing path that corresponds to the respective best path associated with the minimum of the first and the second minimum costs. The foregoing illustrative combination further comprising routing traffic along the routing path.
The eleventh illustrative combination wherein the evaluating of the first cost comprises determining an effective bandwidth for any contiguous wireless links along the first path. The eleventh illustrative combination wherein the evaluating of the second cost comprises determining an effective bandwidth for any contiguous wireless links along the second path.
A twelfth illustrative combination of a computer readable medium having a set of instructions stored therein which when executed by a processing element causes the processing element to perform operations comprising computing respective first and second costs associated with traversing respective first and second paths of links in a mesh network, each of the paths being associated with a source node and a destination node of the mesh network; wherein the last link of the first path is a wired link; and wherein the last link of the second path is a wireless link.
The foregoing illustrative combination wherein the first cost is a first current cost and the first path is a first current path; and wherein the operations further comprise if the first current cost is less than a first minimum cost associated with a first best path, then replacing the first minimum cost with the first current cost and replacing the first best path with the first current path. The foregoing illustrative combination wherein the second cost is a second current cost and the second path is a second current path; and wherein the operations further comprise if the second current cost is less than a second minimum cost associated with a second best path, then replacing the second minimum cost with the second current cost and replacing the second best path with the second current path. The foregoing illustrative combination wherein the operations further comprise selecting a routing path that corresponds to the respective best path associated with the minimum of the first and the second minimum costs. The foregoing illustrative combination wherein the operations further comprise routing traffic along the routing path.
The twelfth illustrative combination wherein the operations further comprise calculating a bandwidth reduction due to any contiguous wireless links along the first path. The foregoing illustrative combination wherein the first cost is based at least in part on the bandwidth reduction. The twelfth illustrative combination wherein the operations further comprise calculating a bandwidth reduction due to any contiguous wireless links along the second path. The foregoing illustrative combination wherein the second cost is based at least in part on the bandwidth reduction.
A thirteenth illustrative combination of a method comprising determining an effective wireless bandwidth for a path according to a first technique if a length of the path is less than a threshold; and determining the effective wireless bandwidth according to a second technique if the length is not less than the threshold; and wherein the path is via a plurality of contiguous wireless links equal in number to the length.
The thirteenth illustrative combination wherein the first technique comprises calculating the effective wireless bandwidth as a function of a reciprocal of an inverse effective data rate, the inverse effective data rate being a sum of respective reciprocal bandwidths corresponding to each of the contiguous wireless links.
The thirteenth illustrative combination wherein the second technique comprises calculating the effective wireless bandwidth as a function of a plurality of inverse effective data rates, each of the inverse effective data rates corresponding to a respective set of contiguous wireless links, the sets of contiguous wireless links including all sequences of wireless links in the contiguous wireless links having a respective length equal to the threshold. The foregoing illustrative combination wherein the function selects a minimum bandwidth based at least in part on the inverse effective data rates. The foregoing illustrative combination wherein the minimum bandwidth corresponds to a minimum of reciprocals of the inverse effective data rates.
A fourteenth illustrative combination of a method comprising determining a best path through a mesh network, the best path being via a plurality of wireless links; routing traffic via the best path; wherein the determining comprises computing an effective wireless bandwidth for a number of contiguous wireless links of the wireless links. The foregoing illustrative combination wherein the best path is further via at least one wired link.
The fourteenth illustrative combination wherein the computing of the effective wireless bandwidth comprises if the number of contiguous wireless links is less than a threshold, then determining the effective wireless bandwidth as a reciprocal of a sum of reciprocal bandwidths corresponding to each of the contiguous wireless links. The foregoing illustrative combination wherein the computing of the effective wireless bandwidth further comprises if the number of contiguous wireless links is not less than the threshold, then determining the effective wireless bandwidth according to a minimum of a set of sums, each of the set corresponding to a respective reciprocal of a respective sum of a respective set of reciprocal bandwidths for each possible path having a respective length equal to the threshold and being encompassed by the contiguous wireless links.
Any of the foregoing illustrative combinations referring to contiguous wireless links wherein the contiguous wireless links operate according to a single channel.
Any of the foregoing illustrative combinations referring to a threshold wherein the threshold is predetermined.
Effective Bandwidth Path Metric
A path metric along a path that includes wireless links is dependent on the level of wireless interference along the path because interference reduces throughput and increases packet latency and loss. Interference, in some usage scenarios, depends on the channel assignment of the wireless links and on the order of wireless and wired links along the path because a wired mesh link may separate the sequence of wireless links before the wired link in the path and the sequence of wireless links after the wired link in the path into non-interfering zones. Therefore, the path metric takes into account not only the individual metrics of each link along a path, but also the order the links appear along the path.
A path metric called “effective bandwidth” is defined that takes into account both wireless and wired links, and incorporates the available bandwidth along each link in the path along with effects of interference of consecutive wireless links in the path that are assigned to the same channel. A path computation technique is then defined that given a set of links, computes the best possible paths from a node to all other nodes reachable through the set of links, according to the effective bandwidth path metric. The path metric incorporates the effects of interference along a multi-hop path that includes wireless and wired links, where each node optionally has more than one wireless and/or wired interface.
The effective bandwidth path metric has three components, in lexicographic (or priority) order: inverse of the sustainable data rate, number of wireless links, and total number of links. The inverse of the sustainable data rate is the most significant component of the path metric and is a measure of the inverse of the data rate sustainable on the path. The metric incorporates the current data rate of each link along the path and also depends on the order in which wired and wireless communications links appear in the path, as well as the channel assigned to each wireless link. The lower the inverse of the sustainable data rate (e.g., the higher the sustainable data rate), the better the path.
The number of wireless links along a path is a measure of the amount of wireless communication resources that are used along the path, and reflects the level of interference generated in the network and possibly along the path itself, as well as the probability of packet loss. That is, the more wireless links a packet has to traverse, the more likely the packet will be dropped due to full router queues, or that the packet will collide with other packets if the link is wireless. The smaller the number of wireless links along a path, the more desirable the path.
The total number of links is the least significant part of the path metric, and is a measure of the amount of (wired and wireless) network resources that are used along the path and also reflects the probability of packet loss. The lower the total number of links in a path, the more desirable the path.
Conceptually the way two paths are compared according to the lexicographic ordering of the three components (inverse of the sustainable data rate, number of wireless links, and total number of links) is expressed by the following formula, where InvSR stands for inverse sustainable data rate, W stands for the number of wireless links and N stands for the total number of links along the path. To account for the dynamics of the wireless environment, the path computation technique optionally uses a threshold parameter Delta (e.g., Delta=0.1, 0.2, or some other similar small value) when comparing the reciprocal of the sustainable data rate. The path comparison formula for paths 1 and 2 having respective inverse sustainable data rates of InvSR1 and InvSR2, having respective numbers of wireless links of W1 and W2, and having respective total numbers of wireless links of N1 and N2 is:
(InvSR1, W1, N1)<(InvSR2, W2, N2) if
(InvSR1/InvSR2<(1−Delta)) OR
((1−Delta)<=InvSR1/InvSR2<=1) AND (W1<W2) OR
((1−Delta)<=InvSR1/InvSR2<=1) AND (W1==W2) AND (N1<N2)
Inverse Sustainable Data Rate Computation
The most significant component of the effective bandwidth metric, the inverse sustainable data rate, attempts to measure the effective bandwidth a path is enabled to carry for substantial periods of time.
The inverse sustainable data rate is computed based on the available bandwidth at each link. The available bandwidth is computed by a routing protocol or by a link layer based on information collected at the link layer and also optionally at a network layer. Possible inputs into the computation of the available bandwidth metric are raw data rate, link utilization, link availability, and lossy-ness. Information on the metric associated with a link and its channel assignment is discovered by the routing protocol along with discovering the link itself.
A path is divided into a set of segments (or sub-paths) such that the metric of each segment is computable independently of the metrics of the other segments, and the metric for the entire path is the minimum of the bandwidths of the segments. In some embodiments, segment boundaries are chosen to coincide with wired links, since in some usage scenarios the wired links separate a path into non-interfering segments.
Consider two nodes u and v coupled by link(u,v). Let B(u,v) denote available bandwidth on link(u,v). Consider a segment P* having n links such that the available bandwidth of the ith link is B(i), where 1<=i<=n. The links in the segment P* are divided into (m+1) different sets, where m is the total number of distinct wireless channels in use in the segment. Set 0 includes all wired links, and Set k includes all wireless links on channel k. For 0<=k<=m, let SR(P*, k) be the sustainable bandwidth across all the links within segment P* in Set k. Note that transmissions on a link in one set do not interfere with, and are independent of the transmissions on a link in any other set. Hence, the sustainable bandwidth across the segment P* is given by the minimum value of SR(P*, k), for 0<=k<=m. The minimum value represents the sustainable data rate across segment P* as a scalar value:
SR(P*)=minimum{0<=k<=m}SR(P*, k).
A vector representation of the sustainable data rate is a vector of size (m+1):
vectorSR(P*)=(SR(P*, 0), SR (P*,1) . . . SR(P*, m)).
First consider Set 0, i.e. all wired links within the segment P*. Since transmissions on wired links do not interfere with each other, the sustainable data rate across wired links in the segment P* is given by:
SR(P*, 0)=minimum{1<=i<=n such that link i is a wired link}B(i).
Next consider Set k, i.e. all wireless links within segment P* that are assigned to channel k. Let Assign(i, k) be a Boolean variable that is true if link i is assigned to channel k. Hence, the time required to transmit a bit across all the hops which are on channel k is given by:
T(P*,k)=sum{1<=i<=n such that Assign(i, k) is True}1/B(i).
In the worst case, all links that are assigned to channel k within the segment P* are within interference range of each other. Recall that the sustainable data rate across all the wireless links in Set k within the segment P* is given by SR(P*, k). Therefore, a lower bound on the sustainable data rate SR(P*, k) is given by the inequality SR(P*, k)>=1/T(P*, k). The inequality evolves into a strict equality whenever all the wireless links within a segment assigned to channel k interfere with one another. Hence:
1/SR(P*, k)<=sum{1<=i<=n such that Assign(i, k) is True}1/B(i )
In some usage scenarios, all the wireless links within a segment that are assigned to the same channel do not interfere with each other. This occurs, for example, when the links are not within interference range of one another. In some environments, the interference range is larger than the transmission range, and in some situations is twice as large as the transmission range. Assume that the bandwidth reduction (or degradation) across a sequence of wireless hops ceases (or is ignorable) after IntfHops hops, where IntfHops is a small integer, such as 4 or 5. See the section “Contiguous Wireless Links Sustainable Data Rate”, located elsewhere herein, for details of a computation of the sustainable data rate across a contiguous sequence of wireless links on the same channel assuming bandwidth degradation after IntfHops is ignorable.
Returning now to the decomposition of a path P into a series of segments P1, P2 . . . Ph, the scalar and vector representations of the sustainable data rate across the entire path P are respectively:
SR(P)=minimum(SR(P1), SR( P2) . . . SR(Ph)), and
vectorSR(P)=vectorMin(SR(P1), SR(P2) . . . SR(Ph));
where for two vectors vectorX=(X0, X1 . . . Xm) and vectorY=(Y0, Y1 . . . Ym) vectorMin=(minimum(X0, Y0), minimum (X1, Y1) . . . minimum (Xm, Ym)).
It is convenient to use the reciprocal of the sustainable data rate, termed the inverse of the sustainable data rate, and denoted InvSR:
InvSR(P*)=maximum{0<=k<=m}InvSR(P*, k), where
InvSR(P*, k)=1/SR(P*, k).
The scalar and vector representations are thus respectively:
InvSR(P)=maximum(InvSR(P1), InvSR(P2) . . . InvSR(Ph)), and
vectorInvSR(P)=vectorMax(InvSR( P1), InvSR(P2) . . . InvSR(Ph));
where for two vectors vectorX=(X0, X1 . . . Xm) and vectorY=(Y0, Y1 . . . Ym) vectorMax=(maximum(X0, Y0), maximum (X1, Y1) . . . maximum (Xm, Ym)).
FIG. 2 illustrates portions of the mesh network of FIG. 1 for an example calculation of an effective bandwidth metric. A five hop path is illustrated, from Node 100G to Node 100C, and is analyzed according to two segments: X (from Node 100G to Node 100B) and Y (from Node 100B to Node 100C). The sustainable data rate along the path is computed according to the two segments X and Y.
For segment X (from Node 100G to Node 100B):
InvSR(X, wired)=1/bandwidth(wired link 110BE); // Note that “wired” is also optionally known as channel 0
InvSR(X, channel 3)=1/bandwidth(wireless link 111DG)+1/bandwidth(wireless link 111DE); and
InvSRSegmentX=maximum(InvSR(X, wired), InvSR(X, channel 3)).
For segment Y (from Node 100B to Node 100C):
InvSR(Y, wired)=1/bandwidth(wired link 110CS);
InvSR(Y, channel 2)=1/bandwidth(wireless link 111BS); and
InvSRSegmentY=maximum(InvSR(Y, wired), InvSR(Y, channel 2)).
The (inverse of) the sustainable data rate for the entire path from Node 100G to Node 100C is thus the scalar value:
maximum(InvSRSegmentX, InvSRSegmentY).
The vector representation is:
vectorInvSR=(InvSR(wired), null, InvSR (channel2), InvSR(channel 3)),
where the null value corresponds to a lack of channel 1 along the path, and
InvSR(wired)=maximum(InvSR(X, wired), InvSR(Y, wired)).
The effective bandwidth metric calculation then combines the inverse sustainable data rate for the path along with the number of wireless and total links for the path. According to the path in FIG. 2, the number of wireless links along the path is three, and the total number of links is five.
An embodiment of a path computation technique is based on the foregoing effective bandwidth metric and computes optimal paths from a source node src to all other reachable nodes in a mesh network. The embodiment is described for a special case where each node of the mesh has at most one wireless interface and all of the wireless interfaces are assigned to the same channel.
The path computation technique maintains, for any node x, selected variables associated with up to two paths. For each of the paths, the variables maintained optionally include respective cost and predecessor information. In some embodiments, the variables maintained omit other information about the paths (such as nodes along each path). In the following discussion, a prefix of “0” denotes a wired (or Ethernet) interface while a prefix of “1” denotes a wireless interface. The paths are:
Path[0](x): The currently known minimum cost path from node src to node x such that the last link is an Ethernet link; and
Path[1](x): The currently known minimum cost path from node src to node x such that the last link is a wireless link.
Let Cost[i](x) denote the cost of the path Path[i](x), for i=0, 1. Cost[i](x) is represented by a 3-tuple where the first entry is a vector. Thus for i=0, 1:
Cost[i](x)=(vectorInvSR[i](x ), num_wireless_links[i](x), num_hops[i](x)).
The cost is alternatively represented by a 3-tuple where the first entry is a scalar value of the inverse of the sustainable data rate:
Cost[i](x)=(InvSR[i](x), num_wireless_links[i](x), num_hops[i](x)).
Let Cost(x) denote the lexicographic-computed minimum of Cost[0](x) and Cost[1](x). Hence:
Cost(x)=lexicographic_minimum(Cost[0](x), Cost[1](x)),
where lexicographic_minimum is computed according to the foregoing path comparison formula for paths having respective inverse sustainable data rates.
The path computation technique maintains predecessor information for paths Path[0](x) and Path[1](x). The representation of the predecessor of a node includes an identifier of a parent node and a type of shortest path from the parent node to the node (i.e. via a wired/Ethernet or wireless interface). Thus for i=0, 1 the predecessor at node x for Path[i](x) is given by:
Pred[i](x)=(parent[i](x), type_from_parent[i](x)).
Similar to Dijkstra's algorithm, the path computation technique proceeds by “marking” nodes one at a time. A set of “unmarked” nodes is maintained, and during each iteration a one node y among the unmarked nodes having the minimum Cost(y) is “marked”. Then variables Cost[0](x) and Cost[1](x) of all unmarked nodes that are neighbors of the marked node y are updated (or reduced) via a process termed relaxation (see the section “Path Computation Implementation”, located elsewhere herein, for more information). Appropriate variables are maintained and updated for up to two paths (corresponding to wired and wireless terminating links), thus enabling computation of an effective bandwidth path metric corresponding to possible optimal paths.
The computation also estimates bandwidth degradation across a contiguous sequence of wireless links by maintaining additional variables for a path ending in a wireless link:
WirelessHops[1](v)—Number of contiguous wireless links immediately preceding node v in the best known path to node v such that the last link is a wireless link; and
WirelessTotalInvSR[1](v)—Inverse of the sustainable data rate on the entire sequence of contiguous wireless links immediately preceding node v in the best known path to node v such that the last link is a wireless link.
In some embodiments, the path computation assumes that any two wireless links (of a contiguous sequence of wireless links) that are on the same channel do interfere with each other. Even though interference within a contiguous sequence of wireless links ceases (or in some circumstances is ignorable) after links are IntfHops apart, the assumption tends to penalize paths with more wireless links even when the paths have higher sustainable data rates than paths with fewer wireless links. The assumption is in addition to penalizing paths having a similar sustainable data rate but a higher number of wireless links (i.e. the number of wireless links is second in the lexicographic ordering associated with path comparison). Use of more wireless resources creates interference for nearby links and networks and in some usage scenarios is undesirable. In some embodiments, the path computation assumes a penalty on a path proportional to the number of wireless links in the path while assuming interference between wireless links is negligible after IntfHops. The proportional penalty reduces apparent sustainable data rate by a fixed value at each wireless link even though the respective wireless link do not, in some usage scenarios, reduce the sustainable data rate when there is no additional interference experienced. See the section “Contiguous Wireless Links Sustainable Data Rate”, located elsewhere herein, for further details.
FIG. 3 illustrates portions of the mesh network of FIG. 1 for an example calculation of optimal paths. For simplicity, the portion is shown with three of the nodes having only a single wireless interface and a fourth node having a pair of wireless interfaces. Three of the wireless interfaces operate on a single first channel (channel 2) and the remaining wireless interfaces operate on a non-interfering second channel (channel 1). The resulting communication pathways are three wireless links, two that interfere with each other (wireless links 111BK, and 111BS) and one that does not interfere with the others (wireless link 111ES). Further the portion is shown with only a single wired link (wired link 110BE). The optimal paths from a source node (Node 100S) to all other illustrated nodes (Nodes 100B, 100E, and 100K) are to be computed. The respective bandwidths assumed for the links are:
bandwidth(111BS)=40,
bandwidth(111ES)=30,
bandwidth(110BE)=30, and
bandwidth(111BK)=40.
The path computation considers two paths from Node 100S to Node 100B. The paths correspond to the previous link being a wired (Ethernet) link or the previous link being a wireless link. The variables corresponding to the first (previous link is wired) of the two paths are:
Path[0](Node 100B): [Node 100S]−[Node 100E]−[Node 100B] is a minimum cost path from Node 100S to Node 100B such that the previous link is an Ethernet link;
Cost[0](Node 100B)=(maximum(1/bandwidth(link 111ES), 1/bandwidth(link 110BE)), 1, 2); and
Pred[0](Node 100B)=(Node 100E, 1 (wireless)).
The variables corresponding to the second (previous link is wireless) of the two paths are:
Path[1](Node 100B): [Node 100S]−[Node 100B] is a minimum cost path from Node 100S to Node 100B such that the previous link is a wireless link;
Cost[1](Node 100B)=(1/bandwidth(link 111BS), 1, 1); and
Pred[1](Node 100B)=(Node 100S, null).
If bandwidth(link 111ES) is 30 and bandwidth(link 111BS) is 40, then in terms of the path metric, Path[1](Node 100B) has lower cost than Path[0](Node 100B) since 1/30 is greater than 1/40. However, because of interference between transmissions on two wireless links operating on the same channel (links 111BS and 111BK), the relative cost is reversed at Node 100K.
The path computation further considers two paths (with the previous link being respectively wired and wireless) from Node 100S to Node 100K. The variables corresponding to the first of the two paths (i.e. where the link preceding Node 100K is a wired link) are:
Path [0] (Node 100K): No path exists; and
Cost(Node 100K)=(vectorInfinity, Infinity, Infinity).
The variables corresponding to the second of the two paths (i.e. where the link preceding Node 100K is a wireless link) are selected from the minimum of two candidate paths:
Path[1](Node 100K): [Node 100S]−[Node 100B]−[Node 100K], i.e. Path[1](Node 100B) concatenated with link 111BK; and
Cost[1](Node 100K)=(1/bandwidth(link 111BS)+1/bandwidth(111BK), 2, 2), since transmissions on the two wireless links 111BS and 111BK do interfere with each other.
Candidate2:
Path[1](Node 100K): [Node 100S]−[Node 100E]−[Node 100B]−[Node 100K], i.e. Path[0](Node 100B) concatenated with link 111BK; and
Cost[1](Node 100K)=(maximum(1/bandwidth(link 111ES), 1/bandwidth(link 110BE), 1/bandwidth(link 111BK)), 2, 3).
If bandwidth(link 111BK) is 40, then the first candidate Cost(Node 100K) is ( 1/40+ 1/40, 2, 2) or ( 1/20, 2, 2). If bandwidth(link 110BE) is 30, then the second candidate Cost(Node 100K) is (maximum( 1/30, 1/30, 1/40), 2, 3) or ( 1/30, 2, 3). The minimum of the two candidates is selected as ( 1/30, 2, 3).
Path Computation Implementation
FIGS. 4A-D illustrate various aspects of an embodiment of the path computation technique. In the following description of FIGS. 4A-D and associated pseudo-code, it is useful to understand the following notational conventions and context:
G=(V, E): A directed weighted graph, with a vertex set V (corresponding to nodes of the mesh network) and an edge set E (corresponding to wired and wireless links of the mesh network;
src: The source node for which all shortest paths are being computed;
S: The set of nodes for which all shortest (best) paths have been determined;
Q: A queue containing all nodes from V not already in S (i.e. all nodes not having final best paths computed with respect to src);
Adj[v]: The neighbors of node v (i.e. those nodes reachable from v in one wired or wireless hop); and
b(u, v): The available link bandwidth on link(u, v).
The path metric corresponding to a path is a 3-tuple:
(vectorInvSR, num_wireless_links, num_hops)
vectorInvSR is a vector representation of the inverse of the sustainable data rate along the path—in a single wireless interface scenario, the vector is size 2 (i.e. m+1 where m is one) where member 0 of the vector denotes Ethernet (wired) and member 1 denotes wireless;
num_wireless_links is the number of wireless links along the path; and
num_hops is the total number of hops (or links), wired and wireless, along the path.
Let Cost[0](v) be the (current minimum) cost metric of the best known path to node v such that the last link is an Ethernet (or wired) link. Also:
Pred[0](v)=(parent[0](v), type_from_parent[0](v))
is the predecessor of node v for Path[0](v), where parent[0] (v) is the identifier of the parent node, and type_from_parent[0](v) indicates the type of path (i.e., Ethernet or wireless) to be taken from the parent.
Similarly, let Cost[1](v) be the (current minimum) cost metric of the best known path to node v such that the last link is a wireless link. Also:
Pred[1](v)=(parent[1](v), type_from _parent[1](v))
is the predecessor of node v for Path[1](v). For a path ending in a wireless link, two additional variables are maintained:
WirelessHops[1](v) is the number of contiguous wireless links immediately preceding node v in the best known path to node v such that the last link is a wireless link; and
WirelessTotalInvSR[1](v) is the inverse of the sustainable data rate on the entire sequence of contiguous wireless links immediately preceding node v in the best known path to node v such that the last link is a wireless link.
Let Cost(v) denote the minimum of Cost[0](v) and Cost[1](v). Thus:
Cost(v)=minimum(Cost[0](v), Cost[1](v))
using the foregoing lexicographic-computed comparison for 3-tuples.
FIG. 4A illustrates a top-level flow diagram of an embodiment of the path computation. Flow begins (“Start” 401) and continues to set various variables relating to the computation to starting values (“Initialize” 402). It is then determined if there are any remaining nodes to process (“More Nodes?” 403). If not (“No” 403N), then processing is complete (“End” 499). If so (“Yes”, 403Y), then processing continues to select another node to process (“Next Node” 404). Best path information for all nodes adjacent to the selected node (i.e. one link away according to the topology of the mesh network) is then updated (“Process Node Neighbors” 405). Processing then flows back to determine if there are additional nodes to process (“More Nodes” 403).
Processing relating to “Initialize” 402 is described by the following pseudo-code:
For each node v in V {
vectorInvSR[0](v) = vectorInfinity;
num_wireless_links[0](v) = Infinity;
num_hops[0](v) = Infinity;
vectorInvSR[1](v) = vectorInfinity;
num_wireless_links[1](v) = Infinity;
num_hops[1](v) = Infinity;
parent[0](v) = null;
type_from_parent[0](v) = NA;
parent[1](v) = null;
type_from_parent[1](v) = NA;
vectorInvSR[0](src) = 0;
num_wireless_links[0](src) = 0;
num_hops[0](src) = 0;
vectorInvSR[1](src) = 0;
num_wireless_links[1](src) = 0;
num_hops[1](src) = 0;
WirelessHops[1](src) = 0;
WirelessTotalInvSR[1](src) = 0;
S = nil;
where vectorInvSR is of size two and all elements therein are set to either zero or infinity as appropriate.
Processing relating to “More Nodes?” 403 is described by the following pseudo-code:
Processing relating to “Next Node” 404 is described by the following pseudo-code:
S = AddNode(S, u);
Q = DeleteNode(Q, u);
where u is a node (or vertex in a directed graph context) such that:
Cost(u)=minimum(Cost(v)) over all vertices v in Q.
In other words, u denotes the recently marked vertex.
FIG. 4B illustrates an embodiment of processing associated with “Process Node Neighbors” 405 of FIG. 4A. Processing begins (“Start” 405A) and continues to check if all neighbor nodes have been completed (“All Processed?” 405B). If so (“Yes” 405BY), then processing is complete (“End” 405Z). If not (“No” 405BN), then processing proceeds to select a remaining node (“Next Neighbor Node” 405C). Flow then continues to determine whether the link type associated with the selected node is wired (i.e. Ethernet) or wireless (“Link Type?” 405D). If the link is wired (“Wired” 405D0), then flow proceeds to determine if the link enables a better path than previously known (“Evaluate Wired Link” 405E). If the link is wireless (“Wireless 405D1), then flow continues to determine if the link enables a better path than what has been discovered before (“Evaluate Wireless Link” 405F). Processing to evaluate a wireless link is slightly different than processing a wired link, as described with respect to the FIG. 4C. After completing evaluation of the link (via either of “Evaluate Wired Link” 405E or “Evaluate Wireless Link” 405F) flow proceeds back to determine if more remain to be processed (“All Processed?” 405B).
Processing associated with “All Processed?” 405B is described by the following pseudo-code:
For each node v in Adj[u]
where processing associated with “Next Neighbor Node” 405C skips node v if v is already present in S.
Processing associated with “Link Type?” 405D is described by the following pseudo-code:
If (type of link(u, v) == Ethernet) {process according to 405E};
If (type of link(u, v) == wireless) {process according to 405F};
FIG. 4C illustrates an embodiment of processing associated with either of “Evaluate Wired Link” 405E and “Evaluate Wireless Link” 405F of FIG. 4B. Processing begins (“Start” 405EF.1) and proceeds to determine if a new best path is available based on a link currently being evaluated. The currently evaluated link is processed twice, according to two contexts, a first context where the last link in the path thus far is a wired link, and a second context where the last link in the path thus far is a wireless link. The first context (“Evaluate Wired Last Link Path” 405EF.2) and the second context (“Evaluate Wireless Last Link Path” 405EF.3) are evaluated independently and in any order (such as in parallel as illustrated), in some embodiments. After the evaluations, the minimum of the two is chosen (“Select Minimum” 405EF.4). Processing then continues to determine if a new best path has been discovered (“Better?” 405EF.5). If not (“No” 405EF.5N), then processing is complete (“End” 405EF.99). If so (“Yes” 405EF.5Y), then flow continues to save new information based on the new path (“Update Parent, Cost, Type” 405EF.6). Processing is then complete (“End” 405EF.99).
While the illustrated flow is representative of processing for either of a wired (or Ethernet) link and a wireless link, the wireless link processing is modified from and is described herein after the wired link processing. Processing associated with “Start” 405EF.1 during evaluation of a wired link is described by the following pseudo-code:
current_metric = Cost[0](v);
Processing associated with “Evaluate Wired Last Link Path” 405EF.2 further during evaluation of a wired link is described by the following pseudo-code:
candidate_metric0 = Cost[0](u);
candidate_metric0.vectorInvSR[0 := Ethernet] = maximum(1/b(u,v),
candidate_metric0.vectorInvSR[0 := Ethernet]);
candidate_metric0.num_hops += 1;
Processing associated with “Evaluate Wireless Last Link Path” 405EF.3 is described by the following pseudo-code:
candidate_metric1 = Cost[1](u);
candidate_metric1.vectorInvSR[0 := Ethernet] = maximum(1/b(u,v),
candidate_metric1.vectorInvSR[0 := Ethernet]);
candidate_metric1.num_hops += 1;
Processing associated with “Select Minimum” 405EF.4 is described by the following pseudo-code:
min_metric = minimum(candidate_metric0, candidate_metric1);
Processing associated with “Better?” 405EF.5 is described by the following pseudo-code:
If(min_metric < current_metric)
Processing associated with “Update Parent,Cost,Type” 405EF.6 is described by the following pseudo-code:
parent[0](v) = u;
If(candidate_metric0 == min_metric)
Cost[0](v) = candidate_metric0;
type_from_parent[0](v) = 0 // Ethernet (wired) link
If(candidate_metric1 == min_metric)
Cost[0](v) = candidate_metric1;
type_from_parent[0](v) = 1 // Wireless link
The foregoing completes the processing during evaluation of a wired link.
Processing associated with a wireless link is a variation compared to the processing associated with a wireless link, as the following pseudo-code illustrates. Processing associated with “Start” 405EF.1 during evaluation of a wireless link is described by the following pseudo-code:
current_metric = Cost[1](v);
Processing associated with “Evaluate Wired Last Link Path” 405EF.2 further during evaluation of a wireless link is described by the following pseudo-code:
candidate_metric0.vectorInvSR[1 := Wireless] = maximum(1/b(u,v),
candidate_metric0.vectorInvSR[1 := Wireless]);
candidate_metric0.num_wireless_links += 1;
InvB1 = candidate_metric1.vectorInvSR[1 := Wireless];
InvB2 = Wireless_TotalInvSR[1](u) + 1/b(u,v);
candidate_metric1.vectorInvSR[1 := Wireless] = maximum(InvB1,
InvB2);
candidate_metric1.num_wireless_links += 1;
IF[min_metric < current_metric)
parent[1](v) = u;
Cost[1](v) = candidate_metric0;
type_from_parent[1](v) = 0 // Ethernet (wired) link
WirelessHops[1](v) = 1;
WirelessTotalInvSR[1](v) = 1/b(u,v)
Cost[1](v) = candidate_metric1;
type_from_parent[1](v) = 1 // Wireless link;
WirelessHops[1](v) = 1 + WirelessHops[1](u);
WirelessTotalInvSR[1](v) = WirelessTotalInvSR[1](u) + 1/b(u,v)
The foregoing completes the processing during evaluation of a wireless link.
Contiguous Wireless Links Sustainable Data Rate
Evaluating bandwidth of a set of contiguous wireless links includes computing an effective bandwidth metric by assuming a wireless link interferes only with other wireless links that are on the same channel and within IntfHops wireless links away. In some embodiments, results of the computation is used in evaluating paths (such as computations performed with respect to one or more elements of FIG. 4B and FIG. 4C). In some embodiments, the results is used by a routing protocol that compares paths to each other and computes the effective bandwidth metric for respective paths.
FIG. 4D illustrates an embodiment of processing associated with determining an effective sustainable data rate along a contiguous sequence of wireless links. Processing begins (“Start” 410) and proceeds to determine if the number of contiguous links equals or surpasses a threshold (“>=IntfHops Links?” 411). If not (“no” 411N), then adding reciprocal bandwidths over the path being processed is sufficient (“Sum Inverse Rates” 412) to determine an effective (inverse) data rate and processing is then complete (“End” 498).
If the threshold is met or exceeded (“Yes” 411Y), then an effective (inverse) bandwidth is computed for every contiguous sequence of wireless links within the path having a length equal to the threshold, and the minimum chosen as the effective (inverse) data rate. Processing for the sequences begins by determining if more sequences remain to be processed in the path (“Another Sequence?” 421). If not (“No” 421), then the smallest data rate of all of the sequences is chosen (“Select Minimum” 422). Processing is then complete (“End” 498). If more sequences remain to be processed (“Yes” 421Y), then flow continues to determine another sequence to process (“Next Sequence” 423). The effective (inverse) data rate for the next sequence is then computed (“Determine Inverse Rate” 424) and then processing flows back to determine if further sequences remain (“Another Sequence?” 421).
Pseudo-code implementing operations according to FIG. 4D corresponds to the function Wireless_InvSR_Function that receives two arguments:
vectorInvSR is a vector denoting the reciprocal of available bandwidth along each link of a contiguous sequence of wireless links of length p=|vectorInvSR|, where the ith entry of the vector is denoted InvSR(i), for i=1, 2 . . . p; and
b(l) is available bandwidth of the wireless link appended at the end of the path.
The pseudo-code also refers to:
IntfHops is an (assumed or estimated) number of hops beyond which there is no additional bandwidth degradation due to interference between contiguous wireless links operating on the same channel, and in some scenarios is a small integer such as 4 or 5.
Processing associated with “>=IntfHops Links?” 411 is described by the following pseudo-code:
If(p < IntfHops)
If(p >= IntfHops)
Processing associated with “Sum Inverse Rates” 412 is described by the following pseudo-code:
FinalInvSR = 1/b(l) + sum{i=1 to p} InvSR(i)
return FinalInvSR
Processing associated with “Another Sequence?” 421, “Select Minimum” 422, “Next Sequence” 423, and “Determine Inverse Rate” 424 in combination is described by the following pseudo-code:
InvSR(p+1) = 1/b(l); // Append entry 1/b(l) at the end of the InvSR vector,
resulting in a vector size of p+1
FinalInvSR = sum{i=1 to IntfHops} InvSR(i)
For(j = 1; j <= p+1 − IntfHops; ++j) {
CandidateInvSR = 0;
For (i =1; i <= IntfHops; ++i)
CandidateInvSR += InvSR(j+i)
If(CandiadateInvSR > FinalInvSR)
FinalInvSR = CandiadteInvSR
FIG. 5 illustrates selected details of hardware aspects of an embodiment of a node. The illustrated node includes Processor 510 coupled to various types of storage, including volatile read/write memory (Memory Banks 501A and 501) via Dynamic Randomly Accessible read/write Memory (DRAM) Memory Interface 502, and non-volatile read/write memory (FLASH 503 and Electrically Erasable Programmable Read Only Memory (EEPROM) 504). The processor is further coupled to Ethernet Interface 521 providing a plurality of Ethernet Ports 522 for establishing wired links, and via PCI Interface 505 to Wireless Interfaces 525A and 525B for providing radio communication of packets for establishing wireless links. In some embodiments, one or more of the wireless interfaces are compatible with an IEEE 802.11 wireless communication standard (such as any of 802.11a, 802.11b, and 802.11g). In some embodiments, one or more of the wireless interfaces operate (in conjunction with any combination of other hardware and software elements) to collect statistics with respect to neighboring nodes of a mesh. The statistics include any combination of signal strength and link quality, in various embodiments. In some embodiments, one or more of the wireless interfaces are configurable to drop all packets below a settable Received Signal Strength Indicator (RSSI) threshold. In some embodiments, one or more of the wired interfaces are 10 Mb, 100 Mb, 1 Ggb or 10 Gb compatible. Node implementations include any combination of wireless and wired interfaces, such as only a single wireless (or wired) interface, or one of each type, or two of each type. Other equivalent embodiments of a node are contemplated, as the illustrated partitioning is only one example.
The illustrated node optionally functions as any one of the mesh nodes illustrated in FIG. 1 (such as any of Node A 100A, Node S 100S, and so forth). The illustrated wireless interfaces of FIG. 5 enable communication between nodes and provide low-level transport for packets moving between elements of the mesh, such as by implementing wireless interfaces 121S and 122S associated with Node S 100S of FIG. 1. The Ethernet ports of FIG. 5 provide for wired communication between nodes, such as for implementing wired link 110CS associated with Node C 100C and Node S 100S of FIG. 1.
In operation the processor fetches instructions from any combination of the storage elements (DRAM, FLASH, and EEPROM) and executes the instructions. Some of the instructions correspond to execution of software associated with operations relating to processing for effective bandwidth path metric computation and path computation using the metric.
FIG. 6 illustrates selected details of software aspects of an embodiment of a node. The illustrated software includes Network Management System (NMS) Manager 650 interfacing to Network Interface Manager 640 and Fault, Configuration, Accounting, Performance, and Security (FCAPS) Manager 630. In some embodiments, the NMS interfaces between management software operating external to the node and software operating internal to the node (such as various applications and FCAPS). The Network Interface Manager manages physical network interfaces (such as the Ethernet and Wireless Interfaces). The Network Interface Manager assists the NMS in passing dynamic configuration changes (as requested by a user) through the management software to FCAPS. In some embodiments, FCAPS includes functions to store and retrieve configuration information, and FCAPS functions serve all applications requiring persistent configuration information. FCAPS, in some embodiments, assists in collecting fault information and statistics and performance data from various operating modules of the node. FCAPS optionally passes any portion of the collected information, statistics, and data to the NMS.
Kernel Interface 601 interfaces the Managers to Routing and Transport
Protocols layer 610 and Flash File System module 602. The Routing Protocols include all or portions of processing relating to effective bandwidth path metric computation and path computations using the metric, as well as general processing relating to operation as a node of the mesh and forwarding packets. The Transport Protocols include TCP and UDP. The Flash File System module interfaces to Flash Driver 603 that is illustrated conceptually coupled to FLASH file hardware element 503A that is representative of a flash file system stored in any combination of FLASH 503 and EEPROM 504 of FIG. 5. Layer-2 Abstraction Layer 611 interfaces the Routing and Transport Protocols to Ethernet Driver 621 and Radio Driver 625. The Ethernet Driver is illustrated conceptually coupled to Ethernet Interface 521 of FIG. 5. The Radio Driver is illustrated conceptually coupled to Wireless Interfaces 525, representative of Wireless Interfaces 525A and 525B of FIG. 5. In some embodiments, the software also includes a serial driver. The software is stored on a computer readable medium (such as any combination of the DRAM, FLASH, and EEPROM elements of FIG. 5), and is executed by the processor of FIG. 5. The partitioning illustrated in FIG. 6 is an example only, and many other equivalent arrangements of layers and modules are contemplated.
It will be understood that many variations in construction, arrangement and use are possible consistent with the teachings and within the scope of the claims appended to the issued patent. For example, interconnect and function-unit bit-widths, clock speeds, and the type of technology used may generally be varied in each component block. The names given to interconnect and logic are merely illustrative, and should not be construed as limiting the concepts taught. The order and arrangement of flowchart and flow diagram process, action, and function elements may generally be varied. Also, unless specifically stated to the contrary, the value ranges specified, the maximum and minimum values used, or other particular specifications (such as number and type of wired and wireless interfaces; and the number of entries or stages in registers and buffers), are merely those of the illustrative embodiments, may be expected to track improvements and changes in implementation technology, and should not be construed as limitations.
at least one interface coupled to the processor;
wherein the processor is enabled to execute instructions
to determine respective first and second current costs associated with traversing respective first and second current paths of links in a mesh network, each of the current paths being associated with a source node and a destination node of the mesh network,
to replace a first minimum cost having an associated first best path with the first current cost and to replace the first best path with the first current path if the first current cost is less than the first minimum cost, and
to replace a second minimum cost having an associated second best path with the second current cost and to replace the second best path with the second current path if the second current cost is less than the second minimum cost;
wherein the last link of the first current path is a wired link and the last link of the second current path is a wireless link; and
wherein at least one of the first and the second current costs is calculated based at least in part on bandwidth reduction due to any contiguous wireless links along at least one of the first and the second current paths.
2. The system of claim 1, wherein the at least one interface is at least one of a wired interface and a wireless interface.
3. The system of claim 1, wherein the processor is further enabled to execute other instructions to select a routing path that corresponds to the respective best path associated with the minimum of the first and the second minimum costs.
4. The system of claim 1, wherein the interface is a first wireless interface and further comprising a second wireless interface coupled to the processor.
5. The system of claim 4, wherein the processor and the wireless interfaces are implemented in a node of the mesh network, and at least one of the wireless interfaces is active along at least one of the paths.
6. The system of claim 1, wherein at least one of the paths includes a series of segments.
7. The system of claim 6, wherein at least one specific path includes a series of segments, and the specific path is one of the current paths or one of the best paths.
8. The system of claim 7, wherein at least one of the segments has at least one wireless sub-segment and at least one wired sub-segment.
9. The system of claim 8, wherein at least one of the at least one wireless sub-segment and the at least one wired sub-segment have at least two links.
evaluating, at least in part via at least one processor, respective first and second current costs associated with traversing respective first and second current paths of links in a mesh network;
if the first current cost is less than a first minimum cost associated with a first best path, then, at least in part via the at least one processor, replacing the first minimum cost with the first current cost and replacing the first best path with the first current path;
if the second current cost is less than a second minimum cost associated with a second best path, then, at least in part via the at least one processor, replacing the second minimum cost with the second current cost and replacing the second best path with the second current path;
wherein at least one of the first and the second current costs is calculated, at least in part via the at least one processor, based at least in part on bandwidth reduction due to any contiguous wireless links along at least one of the first and the second current paths.
11. The method of claim 10, further comprising selecting, at least in part via the at least one processor, a routing path that corresponds to the respective best path associated with the minimum of the first and the second minimum costs.
12. The method of claim 11, further comprising, at least in part via the at least one processor, directing routing of traffic along the routing path.
13. The method of claim 10, wherein the evaluating comprises determining, at least in part via the at least one processor, an effective bandwidth for any contiguous wireless links along any of the first and the second current paths.
14. The method of claim 13, wherein the effective bandwidth of each respective contiguous wireless link is a function of at least one of an inverse sustainable data rate, a count of wireless links, and a count of wired and wireless links.
15. The method of claim 10, wherein the evaluating is implemented by executing programmed instructions by the at least one processor, and at least one of the paths comprises at least one node that comprises the at least one processor.
16. The method of claim 15, wherein the at least one node comprises at least one of an Ethernet compatible interface associated with the wired link and an 802.11 compatible interface associated with the wireless link.
17. A computer readable medium having a set of instructions stored therein which when executed by a processing element causes the processing element to perform operations comprising:
for each path of a plurality of paths from a first node in a mesh network to each of a respective plurality of other nodes in the mesh network, computing an effective wireless bandwidth according to a first technique if a number of contiguous wireless links along each path is less than a threshold;
computing the effective wireless bandwidth for each path according to a second technique if the number is greater than the threshold;
identifying a best computed path of the plurality of paths, the best computed path of the plurality of paths having the maximum bandwidth of the computed effective wireless bandwidths, wherein each best computed path is respectively the most efficient communication pathway known between the first node and each of the other nodes;
at least in part enabling delivering traffic between the first node and a second node of the other nodes via the most efficient pathway known in accordance with the identifying;
wherein the first technique comprises calculating a first effective wireless bandwidth as a first function of a reciprocal of an inverse resultant data rate, the inverse resultant data rate being a sum of respective reciprocal bandwidths corresponding to each of the contiguous wireless links; and
wherein the second technique comprises calculating a second effective wireless bandwidth as a second function of a plurality of inverse effective data rates, each of the inverse effective data rates corresponding to a respective set of contiguous wireless links, the sets of contiguous wireless links comprising all sequences of wireless links in the contiguous wireless links having a respective length equal to the threshold.
18. The computer readable medium of claim 17, wherein the first function is a reciprocal function.
19. The computer readable medium of claim 17, wherein the second function is a minima function.
20. The computer readable medium of claim 17, the operations further comprising computing the effective wireless bandwidth according to the second technique if the number is equal to the threshold.
21. The computer readable medium of claim 17, the operations further comprising computing a best path through a mesh network that comprises the contiguous wireless links, the best path being determined at least in part according to the effective wireless bandwidth.
22. The computer readable medium of claim 21, the operations further comprising routing traffic according to the best path.
23. The computer readable medium of claim 22, wherein the mesh network comprises a node that comprises the processor.
means for determining an effective wireless bandwidth for a path according to one of a plurality of techniques, the path having a length of contiguous wireless links;
means for selecting one of the techniques based at least in part on the length;
means for determining a best path through a mesh network that includes the contiguous wireless links and at least one wired link;
means for routing traffic according to the best path; and
wherein the means for selecting selects a first one of the techniques if the length is less than a threshold, and selects a second one of the techniques if the length is greater than the threshold.
the first technique comprises means for calculating the effective wireless bandwidth as a reciprocal of an inverse resultant data rate, the inverse resultant data rate being a sum of respective reciprocal bandwidths corresponding to each of the contiguous wireless links; and
the second technique comprises means for calculating the effective wireless bandwidth as a function of a plurality of inverse effective data rates, each of the plurality of inverse effective data rates corresponding to a respective set of contiguous wireless links, the sets of contiguous wireless links including all sequences of wireless links in the contiguous wireless links having a respective length equal to the threshold.
26. The system of claim 25, wherein the function calculates the effective wireless bandwidth corresponding to a minimum of reciprocals of the plurality of inverse effective data rates.
27. The system of claim 24, wherein the at least one wired link is interfaced to a node of the mesh network that is also an endpoint of the contiguous wireless links.
28. The system of claim 27, wherein the contiguous wireless links are a first set of contiguous wireless links, the wired link is a first wired link, and the first set of contiguous wireless links and the first wired link in combination are a first segment; and the mesh network further includes a second segment having a second set of contiguous wireless links and a second wired link.
29. The system of claim 27, wherein the wired link is a first wired link; and the first set of contiguous wireless links, the first wired link, and a second wired link contiguous with the first wired link are in combination a segment.
US11/618,073 2006-03-09 2006-12-29 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links Active 2028-07-25 US7768926B2 (en)
IN627/DEL/2006 2006-03-09
IN627DE2006 2006-03-09
TW100107207A TWI430621B (en) 2006-03-09 2007-02-27 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
TW096106783A TWI343199B (en) 2006-03-09 2007-02-27 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
GB0817802A GB2449826B (en) 2006-03-09 2007-03-04 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
CN2007800127496A CN101421982B (en) 2006-03-09 2007-03-04 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
PCT/US2007/063247 WO2007103837A1 (en) 2006-03-09 2007-03-04 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
CA2645336A CA2645336C (en) 2006-03-09 2007-03-04 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
US12/845,669 US8498211B2 (en) 2006-03-09 2010-07-28 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
US13/952,078 US9240947B2 (en) 2006-03-09 2013-07-26 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
US14/997,879 US9979654B2 (en) 2006-03-09 2016-01-18 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
US15/984,617 US20190124008A1 (en) 2006-03-09 2018-05-21 Effective Bandwidth Path Metric and Path Computation Method for Wireless Mesh Networks with Wired Links
US12/845,669 Continuation US8498211B2 (en) 2006-03-09 2010-07-28 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
US13/952,078 Continuation US9240947B2 (en) 2006-03-09 2013-07-26 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
US20070211636A1 US20070211636A1 (en) 2007-09-13
US7768926B2 true US7768926B2 (en) 2010-08-03
ID=38478811
US11/618,073 Active 2028-07-25 US7768926B2 (en) 2006-03-09 2006-12-29 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
US12/845,669 Active 2027-08-04 US8498211B2 (en) 2006-03-09 2010-07-28 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
US13/952,078 Active US9240947B2 (en) 2006-03-09 2013-07-26 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
US14/997,879 Active US9979654B2 (en) 2006-03-09 2016-01-18 Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
US15/984,617 Pending US20190124008A1 (en) 2006-03-09 2018-05-21 Effective Bandwidth Path Metric and Path Computation Method for Wireless Mesh Networks with Wired Links
US (5) US7768926B2 (en)
CN (1) CN101421982B (en)
CA (1) CA2645336C (en)
GB (2) GB2449826B (en)
TW (2) TWI343199B (en)
US20110075566A1 (en) * 2006-03-09 2011-03-31 Bhargav Ramachandra Bellur Effective Bandwidth Path Metric and Path Computation Method for Wireless Mesh Networks with Wired Links
US20140126415A1 (en) * 2011-07-25 2014-05-08 Sony Corporation Communication apparatus, communication method, and communication system
US7801023B2 (en) * 2007-09-25 2010-09-21 Alcatel Lucent Mechanism for efficient endpoint discriminator allocation for APS protected MLPPP bundles on distributed routing systems
US8199655B2 (en) 2009-08-21 2012-06-12 Verizon Patent And Licensing Inc. Optimized layer-2 network switching systems and methods
US20150046558A1 (en) * 2013-03-15 2015-02-12 Google Inc. System and method for choosing lowest latency path
CA2902439A1 (en) 2013-03-15 2014-09-25 Vivint, Inc Bandwidth estimation based on location in a wireless network
JP6512282B2 (en) 2015-03-18 2019-05-15 日本電気株式会社 Communication apparatus, available band calculation system, available band calculation method and program
US10142909B2 (en) * 2015-10-13 2018-11-27 The Board Of Trustees Of The University Of Alabama Artificial intelligence-augmented, ripple-diamond-chain shaped rateless routing in wireless mesh networks with multi-beam directional antennas
WO2018187094A1 (en) * 2017-04-06 2018-10-11 Common Networks, Inc. Systems and methods for networking and wirelessly routing communications
US20060083255A1 (en) 2004-10-18 2006-04-20 Alcatel Allocating bridge priorities in bridged network
US20060256724A1 (en) 2005-05-10 2006-11-16 Luca Martini Method of determining transit costs across autonomous systems
US20070184864A1 (en) 2004-03-17 2007-08-09 Koninklijke Philips Electronics, N.V. Making time-of-flight measurements in master/slave and ad hoc networks by eaves-dropping on messages
WO2007103837A1 (en) 2006-03-09 2007-09-13 Firetide, Inc. Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
WO2008046089A2 (en) 2006-10-13 2008-04-17 Firetide, Inc. Mesh node mobility across static and mobile mesh networks
2006-12-29 US US11/618,073 patent/US7768926B2/en active Active
2007-02-27 TW TW096106783A patent/TWI343199B/en active
2007-02-27 TW TW100107207A patent/TWI430621B/en active
2007-03-04 CA CA2645336A patent/CA2645336C/en active Active
2007-03-04 CN CN2007800127496A patent/CN101421982B/en active IP Right Grant
2007-03-04 GB GB0817802A patent/GB2449826B/en active Active
2007-03-04 GB GB1016025A patent/GB2471411B/en active Active
2010-07-28 US US12/845,669 patent/US8498211B2/en active Active
2013-07-26 US US13/952,078 patent/US9240947B2/en active Active
2016-01-18 US US14/997,879 patent/US9979654B2/en active Active
2018-05-21 US US15/984,617 patent/US20190124008A1/en active Pending
US20080112422A1 (en) 2005-07-21 2008-05-15 Jorjeta Jetcheva Method for Enabling the Efficient Operation of Arbitrarily Interconnected Mesh Networks
US20090190531A1 (en) 2006-10-13 2009-07-30 Jorjeta Jetcheva Mesh Node Mobility Across Static and Mobile Mesh Networks
Akyildiz et al, A Survey on Wireless Mesh Networks, IEEE, 8 pages, Sep. 2005. *
Ashwin Sridharan, et al.; On the Impact of Aggregation on the Performance of Traffic-Aware Routing. In proceedings of the 17th International Teletraffic Congress, Salvador da Bahia, Brazil, Sep. 2001, 13 pgs.
Bruno et al, Mesh Networks: Commodity Multihop Ad Hoc Networks, IEEE, 9 pages, Mar. 2005. *
David A. Maltz, et al.; The Effects of On-Demand Behavior in Routing Protocols for Multi-Hop Wireless Ad Hoc Networks. IEEE Journal on Selected Areas in Communications Special Issue on Mobile and Wireless Networks, Aug. 1999, 20 pgs.
David B. Johnson, et al.; The Dynamic Source Routing Protocol for Mobile Ad Hoc Networks; IETF MANET Working Group, Feb. 21, 2002, 85 pgs (pp. i-81).
International Preliminary Report and Written Opinion for PCT/US2007/063247, mailed Sep. 9, 2008; 6 pgs.
Jorjeta G. Jetcheva, et al.; Design and Evaluation of a Metropolitan Area Multitier Wireless Ad Hoc Network Architecture; Proceedings of the 5th IEEE Workshop on Mobile Computing Systems and Applications (WMCSA 2003), IEEE, Monterey, CA, Oct. 2003, 12 pgs.
Jorjeta G. Jetcheva, et. al.; A Simple Protocol for Multicast and Broadcast in Mobile Ad Hoc Networks, Jul. 20, 2001, 14 pgs. (pp. i-11).
Jorjeta G. Jetcheva, et. al.; Adaptive Demand-Driven Multicast Routing in Multi-Hop Wireless Ad Hoc Networks. In proceedings of the ACM Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), Long Beach, CA, Oct. 2001, 12 pgs.
Jorjeta G. Jetcheva, et. al.; The Adaptive Demand-Driven Multicast Routing Protocol for Mobile Ad Hoc Networks, Jul. 13, 2001, 67 pgs. (pp. i-63).
Josh Broch et al.; A Performance Comparison of Multi-Hop Wireless Ad Hoc Network Routing Protocols. Proceedings of the Fourth Annual ACM/IEEE International Conference on Mobile Computing and Networking, ACM, Dallas, TX, Oct. 1998, 13 pgs.
Nina Taft et al.; Understanding Traffic Dynamics at a Backbone POP. SPIE ITCOM+ OPTICOMM Workshop on Scalability and Traffic Control in IP Networks, Denver, CO, Aug. 2001, 7 pgs.
Raniwala et al, Architecture and Algorithms for an IEEE 802.11-Based Multi-Channel Wireless Mesh Networks, IEEE, 12 pages, 2005. *
Search Report for Patent Application ROC (Taiwan) Patent Application No. 095126422 (Translation), Date of Completion: Feb. 26, 2009; 1 pg.
Search Report ROC (Taiwan) Patent Application No. 095126419 (Translation), Date of Completion of the search: Apr. 28, 2009; 2 pgs.
Supratik Bhattacharyya, et al.; Geographical and Temporal Characteristics of Inter-POP Flows: View from a Single POP. European Transactions on Telecommunications (ETT), vol. 13, No. 1. pp. 5-22, Jan./Feb. 2002, 18 pgs.
Supratik Bhattacharyya, et al.; POP-Level and Access-Link-Level Traffic Dynamics in a Tier-1 POP. ACM SIGCOMM Internet Measurement Workshop (IMW), San Francisco, Nov. 2001, 15 pgs.
Yih-Chun Hu, et al.; Efficient Security Mechanisms for Routing Protocols; (Slightly revised post-proceedings version of Cite No. C3, web-published at http://www.monarch.cs.rice.edu/papers.html), Feb. 2003. 17 pgs.
US8498211B2 (en) * 2006-03-09 2013-07-30 Firetide, Inc. Effective bandwidth path metric and path computation method for wireless mesh networks with wired links
US9912587B2 (en) * 2011-07-25 2018-03-06 Sony Corporation Communication apparatus, communication method, and communication system
US20160366059A1 (en) 2016-12-15
US20190124008A1 (en) 2019-04-25
US20070211636A1 (en) 2007-09-13
CA2645336C (en) 2014-04-22
CN101421982B (en) 2012-03-14
CA2645336A1 (en) 2007-09-13
US9240947B2 (en) 2016-01-19
US8498211B2 (en) 2013-07-30
TW201134146A (en) 2011-10-01
GB0817802D0 (en) 2008-11-05
GB2471411A (en) 2010-12-29
TWI430621B (en) 2014-03-11
US20140185454A1 (en) 2014-07-03
GB2471411B (en) 2011-03-30
US9979654B2 (en) 2018-05-22
CN101421982A (en) 2009-04-29
US20110075566A1 (en) 2011-03-31
GB2449826B (en) 2010-12-01
TW200742350A (en) 2007-11-01
GB201016025D0 (en) 2010-11-10
TWI343199B (en) 2011-06-01
GB2449826A (en) 2008-12-03
Le et al. 2009 DCAR: Distributed coding-aware routing in wireless networks
JP4098772B2 (en) 2008-06-11 Admission control in a mobile ad hoc network
CN1750514B (en) 2011-05-18 System and method for quality routing using weighted cumulative expected transmission time metric
US8578015B2 (en) 2013-11-05 Tracking traffic in a mobile ad hoc network
US7616961B2 (en) 2009-11-10 Allocating channels in a mobile ad hoc network
EP0662760A2 (en) 1995-07-12 Highly dynamic destination-sequenced destination vector routing for mobile computers
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BELLUR, BHARGAV RAMACHANDRA;PRAKASH, RAVI;SINGHAL, AMAR;AND OTHERS;REEL/FRAME:019356/0548;SIGNING DATES FROM 20070402 TO 20070410
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BELLUR, BHARGAV RAMACHANDRA;PRAKASH, RAVI;SINGHAL, AMAR;AND OTHERS;SIGNING DATES FROM 20070402 TO 20070410;REEL/FRAME:019356/0548