# Patent

## Title
Reachability detection in trill networks

## Abstract

One embodiment of the present invention provides a system for testing reachability between two nodes within a network. During operation, the system transmits a network-testing request frame from a source node to a destination node, and in response to receiving a network-testing response frame corresponding to the request frame, the system determines reachability of the destination node. The network-testing request or response frame is not processed on an Internet Protocol (IP) layer.

## Background
RELATED APPLICATIONS
This application claims the benefit of U.S. Provisional Application No. 61/350,827, entitled “Reachability Detection in TRILL Networks,” by inventors Suresh Vobbilisetty, Phanidhar Koganti, and Arun Mahajan, filed 2 Jun. 2010, and U.S. Provisional Application No. 61/380,814, entitled “Reachability Detection in TRILL Networks,” by inventors Suresh Vobbilisetty, Phanidhar Koganti, and Arun Mahajan, filed 8 Sep. 2010, the disclosures of which are incorporated by reference herein.
The present disclosure is related to U.S. patent application Ser. No. 12/725,249, entitled “REDUNDANT HOST CONNECTION IN A ROUTED NETWORK,” by inventors Somesh Gupta, Anoop Ghanwani, Phanidhar Koganti, and Shunjia Yu, filed 16 Mar. 2010;
U.S. patent application Ser. No. 12/730,749, entitled “METHOD AND SYSTEM FOR EXTENDING ROUTING DOMAIN TO NON-ROUTING END STATIONS,” by inventors Pankaj K. Jha and Mitri Halabi, filed 24 Mar. 2010; and
U.S. patent application Ser. No. 13/087,239, entitled “VIRTUAL CLUSTER SWITCHING,” by inventors Suresh Vobbilisetty and Dilip Chatwani, filed Apr. 14, 2011.
the disclosures of which are incorporated by reference herein.


BACKGROUND
1. Field
The present disclosure relates to network monitoring and troubleshooting. More specifically, the present disclosure relates to a method for detecting reachability in a network implementing the Transparent Interconnection of Lots of Links (TRILL) protocol.
2. Related Art
As more mission-critical applications are being implemented in data communication networks, high-availability operation is becoming progressively more important as a value proposition for network architects. It is often desirable to divide a conventional aggregated link (from one device to another) among multiple network devices, such that a node failure or link failure would not affect the operation of the multi-homed device.
Meanwhile, layer-2 (e.g., Ethernet) networking technologies continue to evolve. More routing-like functionalities, which have traditionally been the characteristics of layer-3 (e.g., IP) networks, are migrating into layer-2. Notably, the recent development of the Transparent Interconnection of Lots of Links (TRILL) protocol allows Ethernet switches to function more like routing devices. TRILL overcomes the inherent inefficiency of the conventional spanning tree protocol, which forces layer-2 switches to be coupled in a logical spanning-tree topology to avoid looping. TRILL allows routing bridges (RBridges) to be coupled in an arbitrary topology without the risk of looping by implementing routing functions in switches and including a hop count in the TRILL header. Like any other type of network, a TRILL network needs to be monitored and maintained to ensure its proper operation. However, at present, TRILL networks lack many of the network control and management functions available in layer-3 networks.
SUMMARY
One embodiment of the present invention provides a system for testing reachability between two nodes within a network. During operation, the system transmits a network-testing request frame from a source node to a destination node, and in response to receiving a network-testing response frame corresponding to the request frame, the system determines reachability of the destination node. The network-testing request or response frame is not processed on an Internet Protocol (IP) layer.
In a variation on this embodiment, the network-testing request or response frame includes an Ethernet frame.
In a further variation, the Ethernet frame includes a field which indicates that the Ethernet frame is an Operation, Administration, and Management (OAM) frame.
In a variation on this embodiment, the system further executes a network-testing command which includes an address of the destination node.
In a variation on this embodiment, the network-testing request or response frame is a Transparent Interconnection of Lots of Links (TRILL) frame.
In a further variation, the network-testing request or response frame includes TRILL headers comprising the address of the destination node in an outer media access control (MAC) destination address (DA) field.
In a further variation, the network-testing request or response frame includes TRILL headers and an encapsulated Ethernet frame, and the Ethertype field of the encapsulated Ethernet frame specifies that the network-testing request frame is a TRILL OAM frame.
In a further variation, the encapsulated Ethernet frame includes a TRILL OAM header field.
In a further variation, the TRILL OAM header field includes an operation code (opcode) field, and wherein the opcode field specifies whether a TRILL OAM frame is a request or response frame.
In a further variation, the TRILL OAM header field includes a transaction identifier, and a network-testing request frame and a corresponding response frame have the same transaction identifier.
In a variation on this embodiment, the system further determines a round trip time between the time when the network-testing request frame is transmitted and the time when the response frame is received.



BRIEF DESCRIPTION OF THE FIGURES
FIG. 1 illustrates an exemplary TRILL network (prior art).
FIG. 2 presents a diagram illustrating the format of an exemplary protocol data unit (PDU) for the Transparent Interconnection of Lots of Links (TRILL) protocol (prior art).
FIG. 3 presents a diagram illustrating the format of an exemplary TRILL PDU used for Operations, Administration, and Maintenance (OAM) purposes in accordance with an embodiment of the present invention.
FIG. 4A presents a diagram illustrating the details of the TRILL OAM (TOAM) header in accordance with an embodiment of the present invention.
FIG. 4B presents a diagram illustrating the TOAM header of an exemplary reachability-testing request packet in accordance with an embodiment of the present invention.
FIG. 4C presents a diagram illustrating the TOAM header of an exemplary reachability-testing response packet in accordance with an embodiment of the present invention.
FIG. 5 presents a time-space diagram illustrating the process of testing reachability between two TRILL nodes (RBridges) in accordance with an embodiment of the present invention.
FIG. 6 presents a diagram illustrating the architecture of an exemplary TRILL network node enabling the reachability-testing operation in accordance with an embodiment of the present invention.
FIG. 7A presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that initializes the reachability test in accordance with an embodiment of the present invention.
FIG. 7B presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that responds to the reachability test in accordance with an embodiment of the present invention.
FIG. 8A presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that initializes the reachability test in accordance with an embodiment of the present invention.
FIG. 8B presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that responds to the reachability test in accordance with an embodiment of the present invention.
FIG. 9A presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that initializes the reachability test in accordance with an embodiment of the present invention.
FIG. 9B presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that responds to the reachability test in accordance with an embodiment of the present invention.
FIG. 10 presents a state diagram of an exemplary reachability-testing finite state machine (FSM) in accordance with an embodiment of the present invention.



In the figures, like reference numerals refer to the same figure elements.
DETAILED DESCRIPTION
The following description is presented to enable any person skilled in the art to make and use the invention, and is provided in the context of a particular application and its requirements. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the present invention. Thus, the present invention is not limited to the embodiments shown, but is to be accorded the widest scope consistent with the claims.
Overview
In embodiments of the present invention, the problem of testing reachability between two TRILL nodes is solved by allowing a source node to send a reachability-test request packet to the destination node and determining whether a response packet from the destination node is received. The reachability-testing packet includes an optional source TRILL address, a destination TRILL address, and a transaction identifier which is incremented each time such a packet is sent. The transaction identifier can associate a response packet with a request packet. After receiving a valid request, the destination node converts the request packet into a response packet while keeping the same transaction identifier, and sends it back to the source node. Upon receiving a valid response that matches an outstanding request, the initiator of the reachability testing displays the successful arrival of the response, and identifies the destination along with the round trip time in the display.
Although the present disclosure is presented using examples based on the TRILL protocol, embodiments of the present invention are not limited to TRILL networks, or networks defined in a particular Open System Interconnection Reference Model (OSI reference model) layer.
In this disclosure, the term “RBridge” refers to routing bridges, which are bridges implementing the TRILL protocol as described in IETF draft “RBridges: Base Protocol Specification,” available at http://tools.ietf.org/html/draft-ietf-trill-rbridge-protocol-16, which is incorporated by reference herein. Embodiments of the present invention are not limited to the application among RBridges. Other types of switches, routers, and forwarders can also be used.
The term “end station” refers to a network device that is not TRILL-capable. “End station” is a relative term with respect to the TRILL network. However, “end station” does not necessarily mean that the network device is an end host. An end station can be a host, a conventional layer-2 switch, an IP router, or any other type of network device. Additionally, an end station can be coupled to other switches, routers, or hosts further away from the TRILL network. In other words, an end station can be an aggregation point for a number of network devices to enter the TRILL network.
The term “dual-homed end station” refers to an end station that has an aggregate link to two or more TRILL RBridges, where the aggregate link includes multiple physical links to the different RBridges. The aggregate link, which includes multiple physical links, functions as one logical link to the end station. Although the term “dual” is used here, the term “dual-homed end station” does not limit the number of physical RBridges sharing the aggregate link to two. In various embodiments, other numbers of physical RBridges can share the same aggregate link. Where “dual-homed end station” is used in the present disclosure, the term “multi-homed end station” can also be used.
The terms “frame” or “packet” refer to a group of bits that can be transported together across a network. “Frame” should not be interpreted as limiting embodiments of the present invention to layer-2 networks. “Packet” should not be interpreted as limiting embodiments of the present invention to layer-3 networks. “Frame” or “packet” can be replaced by other terminologies referring to a group of bits, such as “cell” or “datagram.”
OAM in TRILL Network
FIG. 1 illustrates an exemplary TRILL network (prior art). As illustrated in FIG. 1, a TRILL network includes six RBridges, 101, 102, 103, 104, 105, and 106. End station 113 is coupled to RBridge 102; end station 114 is coupled to RBridge 103; and end station 115 is coupled to RBridge 105. End stations 111 and 112 are both dual-homed and coupled to RBridges 104 and 105.
It is important to provide Operations, Administration, and Maintenance (OAM) services in a TRILL network. After the initialization of a TRILL network, a network administrator or a user may want to test the reachability between two RBridges within the network. However, unlike layer-3 (such as IP) networks for which a number of OAM protocols have been developed, there is no protocol available for implementing OAM in TRILL. To address such an issue, embodiments of the present invention provide a method and apparatus for implementing OAM in a TRILL environment.
Because each node within a TRILL network runs the TRILL protocol on its ports to facilitate transport of frames (which can be Ethernet or other types of frames) within and across the network, an OAM packet exchanged between the nodes also needs to conform to the TRILL protocol. FIG. 2 presents a diagram illustrating the format of an exemplary protocol data unit (PDU) for the Transparent Interconnection of Lots of Links (TRILL) protocol (prior art). For Ethernet-based TRILL, PDU 200 is an encapsulated Ethernet frame that includes an outer Ethernet header 202, a 2-byte Ethertype field 204, a TRILL header 206, an inner Ethernet header 208, an Ethernet payload 210, and a 4-byte frame check sequence (FCS) field 212.
Outer Ethernet header 202 includes a 6-byte outer MAC destination address (DA) field, a 6-byte outer MAC source address (SA) field, and a 4-byte outer virtual local area network (VLAN) tag field. The outer MAC DA field and the outer MAC SA field specify the next hop RBridge and the transmitting RBridge, respectively, and the outer VLAN tag includes an outer VLAN ID (specified by the designated RBridge for the link onto which the TRILL frame is being sent) and a priority field. Ethertype field 204 specifies that Ethertype is TRILL.
TRILL header 206 includes a 2-bit version (V) field, a 2-bit reserved (R) field, a 1-bit multi-destination (M) field, a 5-bit options length (OL) field, a 6-bit hop count (HC) field, a 2-byte egress RBridge nickname field, and a 2-byte ingress RBridge nickname field. The V field specifies the version of the TRILL-encapsulated frame. If an RBridge determines that the V field in a received TRILL frame has an unrecognized value, the RBridge can optionally discard that frame. The multi-destination field indicates whether the frame is to be delivered to a class of destination end stations via a distribution tree. The OL field specifies the length of an optional field, which indicates optional capabilities used by the TRILL frame, in units of 4 octets. If OL is zero, there are no options present. Otherwise, the options follow immediately after the ingress RBridge nickname field. The hop count field specifies the number of hops a TRILL frame has experienced. An RBridge decrements the hop count of a received frame, and drops frames received with a hop count of zero. The value of the egress Rbridge nickname field depends on the value of the M field. If M=0, the frame is a unicast frame, and the egress RBridge nickname field specifies the egress RBridge. If M=1, the frame is a multi-destination frame, and the egress RBridge nickname field contains a nickname specifying the distribution tree selected to be used to forward the frame.
Inner Ethernet header 206 includes a 6-byte inner MAC DA field, a 6-byte inner MAC SA field, and a 4-byte inner VLAN tag field. The inner MAC DA field and inner MAC SA field specify the destination and source, respectively, of the inner frame, and the inner VLAN tag field contains the VLAN tag information associated with the native frame when it was ingressed.
Ethernet payload 210 includes a 2-byte Ethertype/length field specifying the Ethertype of the original payload, and a variable-length original Ethernet payload field. FCS field 212 contains the computed FCS of the TRILL frame, which is used to detect frame corruptions due to bit errors on a link. Note that the FCS normally changes on encapsulation, decapsulation, and every TRILL hop due to changes in the outer DA and SA addresses and the decrement of the hop count.
To implement OAM in a TRILL network, embodiments of the present invention provide TRILL OAM packets that can be exchanged between two TRILL nodes, thus allowing a system administrator to check on continuity and reachability, and to measure the performance of the TRILL network. For example, in order to test the reachability between two nodes within a TRILL network, an OAM packet can be generated and transmitted from a node with a specified source MAC address to a node with a specified destination MAC address. After receiving such a packet, the destination node can return it to its initiator which facilitates measurement of the round trip time. A successful return (or response) of the OAM packet indicates a proper reachability between the source node and the destination node. Note that, although such an operation is similar to a ping operation used in an Internet Protocol (IP) network, an IP ping cannot be used in the TRILL environment because the IP ping relies on the sending and receiving of an Internet Control Message Protocol (ICMP) packet which is not compatible with TRILL. Furthermore, an IP ping command can only test reachability on the IP layer, which does not always reflect the reachability on the TRILL layer
FIG. 3 presents a diagram illustrating the format of an exemplary TRILL PDU used for Operations, Administration, and Maintenance (OAM) purposes in accordance with an embodiment of the present invention. TRILL-OAM (TOAM) PDU 300 contains fields common to a TRILL PDU, including the outer Ethernet header, the TRILL header, the inner Ethernet header, and the FCS. In addition, the Ethertype/length field of the Ethernet payload within TRILL-OAM PDU 300 is set as TOAM to specify that the TRILL PDU is a TRILL-OAM PDU. The OAM-specific information is carried in the original Ethernet payload field, including a TOAM header field and a payload field.
FIG. 4A presents a diagram illustrating the details of the TOAM header in accordance with an embodiment of the present invention. The first octet of TOAM header 400 includes information regarding level and version, with the higher 3 bits of the first octet dedicated to level information, and the lower 5 bits of the first octet dedicated to version information. The second octet of TOAM header 400 specifies the operation code (opcode) of the current TOAM PDU. The third octet of TOAM header 400 is the flag field, which is used by certain types of TOAM PDUs as specified by the opcode. The fourth octet of TOAM header 400 specifies the offset of the first type-length-value (TLV) field, in units of octets. The length of the next field varies with the opcode. In one embodiment, the next field also includes possible TLV fields. TOAM header 400 also includes an end TLV with its type set as 0, indicating the end of TOAM header 400.
As mentioned previously, to test reachability between two nodes, the system can transmit a reachability-testing request packet from a source node to a destination node, and wait for a reachability-testing response packet returned from the destination node. In one embodiment, both the request and response packets are TRILL-OAM packets, which are distinguishable from each other by the opcode.
FIG. 4B presents a diagram illustrating the TOAM header of an exemplary reachability-testing request packet in accordance with an embodiment of the present invention. TOAM header 402 includes common TOAM header fields, such as the level/version field, the opcode field, flags, the first TLV offset field, and the end TLV. Note that the opcode is set as 3, indicating this TOAM packet is a reachability-testing request packet. The first TLV offset is set as 4, indicating that the beginning of the first TLV starts 4 bytes after this field. Between the first TLV offset field and the first TLV (which, in this case, is the end TLV) is a 4-byte transaction identifier (ID) field. The transaction ID increments each time a reachability-testing request packet is sent, and can be used to associate a response with a request.
FIG. 4C presents a diagram illustrating the TOAM header of an exemplary reachability-testing response packet in accordance with an embodiment of the present invention. Similar to TOAM header 402, TOAM header 404 includes common TOAM header fields and a 4-byte transaction ID field. Note that the opcode is set as 2, indicating this TOAM packet is a reachability-testing response packet. The transaction ID of a response packet is the same as the request packet.
FIG. 5 presents a flowchart illustrating the process of testing reachability between two TRILL nodes (RBridges) in accordance with an embodiment of the present invention. During operation, the source node generates a reachability-testing request packet (also called an l2ping packet), identified by its opcode in the TOAM header (operation 502). In one embodiment, an operator command, such as a command line interface (CLI) command, is used to generate this packet. In a further embodiment, the command line for generating a reachability-testing packet has the following format: l2ping IP|FCoE|MAC <options>.
The l2ping command results in an l2ping request packet, which can be different from the ping packet used in the IP network, being sent. Selection of IP|FCoE|MAC operand indicating the type of network under tested. If IP is selected, the system will send the l2ping packet treating the network as IP over TRILL. In such a case, the l2ping command can have the following format: l2ping IP--domain<domain id>--s<packet-size>--c<packet-count>--i<interval>--p<pattern>, where domain is a 16-bit valid switch domain-id for the destination node, s specifies the size of the l2ping packet, c specifies the number of l2ping packets that will be sent (the default value is 5), i specifies the time interval between successive l2ping packets (the default value is 1 second), and p specifies the “pad” bytes used to fill the packet. If FCoE is selected, the system will send the l2ping packet treating the network as Fibre Channel over Ethernet (FCoE) over TRILL. In such a case, the l2ping command can have the following format: l2ping FCoE--domain<domain id>--s<packet-size>--c<packet-count>--i<interval>--p<pattern>.
If MAC is selected, the system will send the l2ping packet treating the network as a MAC layer, and the l2ping command can have the following format: l2ping MAC {--src_mac<src_mac>}-dst_mac<dst_mac>--vlan<vlan>--ingress_port<ingress_port>--domain<domain id>--s<packet-size>--c<packet-count>--i<interval>--p<pattern>. Src_mac specifies the MAC address of the source node, which is optional. If the source MAC address is specified, it has to be either a MAC address that has been learned by the RBridge or the RBridge's own MAC address. If the source MAC address is not specified, then the system will use the RBridge's own MAC address when constructing the l2ping packet. Dst-mac specifies the MAC address of the destination node, vlan specifies the VLAN ID, and ingress_port specifies the ingress port number. The rest of the command line is similar to that of the l2ping command used for IP and FCoE. In one embodiment, the l2ping MAC command results in a reachability-testing request TOAM packet being sent from the source node to the destination node. The opcode within the TOAM is set as 3 (as shown in FIG. 4B) indicating the packet is a reachability-testing request packet. The outer MAC DA and the outer MAC SA fields within the TOAM packet are set as the destination and source MAC addresses specified by the l2ping command, respectively. As a result, the packet will be routed to the node specified by that destination MAC address. The system also assigns a transaction ID, which increments each time a request packet is sent, to the l2ping request packet. Note that the inclusion of the source MAC address allows a user to test reachability between two remote nodes; that is, a user can instruct a remote source node to send an l2ping packet to a remote destination node.
The l2ping request packet is then transmitted from source node 500 to a destination node 530 (operation 504). Note that appropriate routing is performed by each intermediate node, such as nodes 510 and 520, before the l2ping request packet reaches destination node 530. In addition, each intermediate node decrements the hop counts of the l2ping request packet. Upon the transmission of the l2ping packet, initiating node 500 starts a timer with a predetermined value (operation 506). Note that, if the timer expires before an l2ping response packet is received by initiating node 500, an error message will be generated indicating that a response has not been received within the time window specified by the predetermined timer value (operation 508).
Once destination node 530 receives the l2ping request packet (operation 512), it generates an l2ping response packet based on the l2ping request packet (operation 514). The l2ping response packet has a similar format as the request packet. In one embodiment, the response packet is a reachability-testing response TOAM packet. The opcode within the TOAM is set as 2 (as shown in FIG. 4C) indicating the packet is a reachability-testing response packet. The transaction ID within the response packet is kept the same as that of the request packet, and the outer MAC DA and SA of the response packet are set as the outer MAC SA and DA of the request packet, respectively. In one embodiment, the inner MAC DA and SA are also switched when a request packet is converted into the response packet. Subsequently, destination node 530 sends the response packet back to source node 500 (operation 516). Upon receiving the response packet (operation 518), source node 500 matches the received response packet to one of the outstanding request packets based on the transaction ID (operation 522), and displays the successful arrival of the response packet (operation 524). The displayed result identifies the destination node along with the round trip time statistics. If the transaction ID of the received response packet does not match any of the outstanding request packets, the response packet is discarded.
FIG. 6 presents a diagram illustrating the architecture of an exemplary TRILL network node enabling the reachability-testing operation in accordance with an embodiment of the present invention. TRILL network node 600 includes a reachability-testing initiating mechanism 602 configured to initiate a reachability test and a reachability-testing response mechanism 604 configured to respond to the reachability-testing request. Reachability-testing initiating mechanism 602 includes a command-receiving mechanism 606, a request-generation mechanism 608, a request-transmission mechanism 610, a response-receiving mechanism 612, a timer 614, and a display mechanism 616. Reachability-testing response mechanism 604 includes a request-receiving mechanism 618, a response-generation mechanism 620, and a response-transmission mechanism 622.
During operation, command-receiving mechanism 606 receives a reachability-testing command, which can be from a remote host. Upon receiving the command, request-generation mechanism 608 generates a reachability-testing request packet using parameters specified by the command. Request-transmission mechanism 610 transmits the request packet to the destination node and starts timer 614. If timer 614 expires before a corresponding response packet is received by response-receiving mechanism 612, an error message is displayed by display mechanism 616. If a valid response is received by response-receiving mechanism 612, then display mechanism 616 will display the arrival of the response packet along with the round trip time statistics. Request-receiving mechanism 618 is configured to receive a reachability-testing request packet, and response-generation mechanism 620 is configured to generate a reachability-testing response packet upon the receipt of a request packet. In one embodiment, response-generation mechanism 620 generates the response packet by switching the source MAC address and the destination MAC address of the received request packet while keeping the transaction ID unchanged. The generated response packet is then transmitted to the initiating node specified by the destination MAC address included in the response packet.
Packet Flow Option 1
FIG. 7A presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that initializes the reachability test in accordance with an embodiment of the present invention. During operation, a reachability-testing request command is executed via a CLI module 702 running on a processor, invoking a configuration background process (also called a daemon) confD 704 developed by the Tail-f Systems of Round Hill, Va. ConfD 704, in turn, executes the command based on a predetermined set of rules. The confD-Gateway does the translation, creates a message, and dispatches it to a WAVE daemon, dcmD 706. In dcmD 706, a plugin 708, specific to that command, is invoked to validate the data that has been entered. Plugin 708 then sends a message to a TRILL OAM daemon, toamD 710, which runs in the user space, to execute the reachability-testing request. A reachability-testing finite state machine (FSM) 712 creates a reachability-testing request packet, starts a timer, and communicates with the kernel via a socket interface 714 using a newly created socket family, such as AF_TOAM or AF_PACKET. The created request packet makes its way through the high-speed-link (HSL) and the application-specific integrated circuit (ASIC) driver 716, and then goes out on the wire. When a reachability-response packet is received, it gets to HSL and ASIC driver 716 and the kernel, and then the response packet reaches reachability-testing FSM 712 running in toamD 710 via socket interface 714. The reachability-response packet is processed by toamD 710, and the response is sent to display 718.
FIG. 7B presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that responds to the reachability test in accordance with an embodiment of the present invention. During operation, the target of the reachability test receives a reachability-testing request packet, which makes its way to the kernel via HSL and ASIC driver 716. The request packet then reaches toamD 710 via socket interface 714. ToamD 710 processes the received request packet and generates a reachability-testing response packet based on the request packet. The response packet is sent back via socket interface 714 to the kernel. Subsequently, the response packet is sent out on the wire via HSL and ASIC driver 716.
This option generates and processes reachability-testing request and response packets using a daemon (toamD) running in the user space. Such an approach makes debugging easier. However, a new daemon needs to be invoked, and communication is needed between the dcmD plugin specified for the reachability-testing command and the newly invoked daemon; such requirements occupy resources and increase system complexity.
Packet Flow Option 2
FIG. 8A presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that initializes the reachability test in accordance with an embodiment of the present invention. During operation, a reachability-testing request command is executed via a CLI module 802 running on a processor, invoking a configuration background process (also called a daemon) confD 804. ConfD 804, in turn, executes the command based on a predetermined set of rules. The confD-Gateway does the translation, creates a message, and dispatches it to a WAVE daemon, dcmD 806. In dcmD 806, a plugin 808, specific to that command, is invoked to validate the data that has been entered. Plugin 808 invokes a worker thread, which runs in the user-space, to execute the reachability-testing request. The worker thread then communicates with the kernel via a socket interface 810 using a newly created socket family, such as AF_TOAM or AF_PACKET. The HSL module 812 in the kernel invokes reachability-testing FSM 814, which creates the reachability-testing request packet. The created request packet makes its way through HSL module 812 and ASIC driver 816, and then goes out on the wire. When a reachability-response packet is received, it gets to ASIC driver 816 and HSL module 812 in the kernel. Subsequently, the response packet gets to reachability-testing FSM 814, which processes the response and sends it to display 818.
FIG. 8B presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that responds to the reachability test in accordance with an embodiment of the present invention. During operation, the target of the reachability test receives a reachability-testing request packet, which makes its way to HSL module 812 via ASIC driver 816. HSL module 812 then invokes a reachability-testing responder module 820, which processes the request packet and generates a reachability-testing response packet. The response packet is sent back to HSL module 812 and ASIC driver 816 before it goes out on the wire.
This option does not require a new daemon to be invoked. However, generating the request and processing the response partially occur in the kernel space, which makes debugging more difficult.
Packet Flow Option 3
FIG. 9A presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that initializes the reachability test in accordance with an embodiment of the present invention. During operation, a reachability-testing request command is executed via a CLI module 902 running on a processor to invoke a configuration background process (also called a daemon), such as confD 904. ConfD 904, in turn, executes the command based on a predetermined set of rules. The confD-Gateway does the translation, creates a message, and dispatches it to a WAVE daemon, dcmD 906. In dcmD 906, a plugin 908, specific to that command, is invoked to validate the data that has been entered. Plugin 908 invokes a worker thread, which runs in the user-space, to execute the reachability-testing request by invoking reachability-testing FSM 910. Reachability-testing FSM 910 creates the reachability-testing request packet, starts a timer, and communicates with the kernel via a socket interface 912 using a newly created socket family, such as AF_TOAM or AF_PACKET. The created request packet makes its way through HSL and ASIC driver 914, and then goes out on the wire. When a reachability-response packet is received, it gets to the kernel via HSL module and ASIC driver 914. Subsequently, the response packet gets to reachability-testing FSM 910 via socket interface 912, which processes the response and sends it to display 916.
FIG. 9B presents a diagram illustrating the detailed flow of the reachability-testing request and response packets within a TRILL network node that responds to the reachability test in accordance with an embodiment of the present invention. During operation, the target of the reachability test receives a reachability-testing request packet, which makes its way to HSL module and ASIC driver 914. Through socket interface 912, the request packet arrives at a reachability-testing responder module 918, which processes the request packet and generates a reachability-testing response packet. The response packet is then sent back to HSL module and ASIC driver 914 before it goes out on the wire.
This option integrates the advantages of both previous options. No additional daemon is needed as the process runs in the dcmD context, and debugging is easier as the process is running in the user space.
Reachability-Testing FSM
FIG. 10 presents a state diagram of an exemplary reachability-testing finite state machine (FSM) in accordance with an embodiment of the present invention. Reachability-testing FSM 1000 includes three states: initial state 1002, ready state 1004, and wait-for-response state 1006.
After system initialization, FSM 1000 moves from initial state 1002 to ready state 1004. During operation, a reachability-testing user command causes FSM 1000 to move from ready state 1004 to wait-for-response state 1006. Valid events in wait-for-response state 1006 include user termination, arrival of a response, and command times out. These valid responses cause the system to display the result of the reachability test, clean up the data structures, and return to ready state 1004. On the other hand, an invalid event will cause the system to clean up the data structure, and return to ready state 1004. Note that, at any given time, a number of simultaneous reachability-testing requests can exist as long as the number does not exceed a predetermined threshold. To implement FSM 1000, the system can allocate individual data blocks, each representing the states and other aspects of a reachability-testing request.
The methods and processes described herein can be embodied as code and/or data, which can be stored in a computer-readable non-transitory storage medium. When a computer system reads and executes the code and/or data stored on the computer-readable non-transitory storage medium, the computer system performs the methods and processes embodied as data structures and code and stored within the medium.
The methods and processes described herein can be executed by and/or included in hardware modules or apparatus. These modules or apparatus may include, but are not limited to, an application-specific integrated circuit (ASIC) chip, a field-programmable gate array (FPGA), a dedicated or shared processor that executes a particular software module or a piece of code at a particular time, and/or other programmable-logic devices now known or later developed. When the hardware modules or apparatus are activated, they perform the methods and processes included within them.
The foregoing descriptions of embodiments of the present invention have been presented only for purposes of illustration and description. They are not intended to be exhaustive or to limit this disclosure. Accordingly, many modifications and variations will be apparent to practitioners skilled in the art. The scope of the present invention is defined by the appended claims.

## Claims

1. A method, comprising:
processing a command to test reachability in a Transparent Interconnection of Lots of Links (TRILL) network, wherein the command specifies a type of layer two or layer three network operating on top of the TRILL network;
generating a network-test request flame based at least on the specified type of layer two or layer three network operating on top of the TRILL network and an address of a destination node;
transmitting a network testing request frame from a source node to a destination node; and
in response to a network-testing response frame corresponding to the network-testing request frame, determining reachability of the destination node.

2. The method of claim 1, wherein the network-testing request frame or the network-testing response frame includes an Ethernet frame.

3. The method of claim 2, wherein the Ethernet frame includes a field which indicates that the Ethernet frame is an Operation, Administration, and Management (OAM) frame.

4. The method of claim 1, wherein the network-testing request frame or the network-testing response frame is a Transparent Interconnection of Lots of Links (TRILL) frame.

5. The method of claim 4, wherein the network-testing request frame or the network-testing response frame includes TRILL headers comprising an address of the destination node in an outer media access control (MAC) destination address (DA) field.

6. The method of claim 4, wherein the network-testing request frame or the network-testing response frame includes TRILL headers and an encapsulated Ethernet frame, and wherein an Ethertype field of the encapsulated Ethernet frame specifies that the network-testing request frame or the network-testing response frame is a TRILL OAM frame.

7. The method of claim 6, wherein the encapsulated Ethernet frame includes a TRILL OAM header field.

8. The method of claim 7, wherein the TRILL OAM header field includes an operation code (opcode) field, and wherein the opcode field specifies whether a TRILL OAM frame is a request frame or a response frame.

9. The method of claim 7, wherein the TRILL OAM header field includes a transaction identifier, and wherein the network-testing request frame and the corresponding network-testing response frame have the same transaction identifier.

10. The method of claim 1, further comprising determining a round trip time between the time when the network-testing request frame is transmitted and the time when the network-testing response frame is received.

11. A switch, comprising:
a processing mechanism configured to process a command to test reachability in a Transparent Interconnection of Lots of Links (TRILL) network, wherein the command specifies a type of layer two or layer three network operating on top of the TRILL network;
a packet generator configured to generate a network-test request flame based at least on the specified type of layer two or layer three network operating on top of the TRILL network and an address of a destination node; and
a transmission mechanism configured to transmit a network testing request frame from a source node to a destination node; and
a determination mechanism configured to determine, in response to receiving the network-testing response frame corresponding to the network-testing request frame, reachability of the destination node.

12. The switch of claim 11, wherein the network-testing request frame or the network-testing response frame includes an Ethernet frame.

13. The switch of claim 11, wherein the Ethernet frame includes a field which indicates that the Ethernet frame is an Operation, Administration, and Management (OAM) frame.

14. The switch of claim 11, wherein the network-testing request frame or the network-testing response frame is a Transparent Interconnection of Lots of Links (TRILL) frame.

15. The switch of claim 14, wherein the network-testing request frame or the network-testing response frame includes TRILL headers comprising an address of the destination node in an outer media access control (MAC) destination address (DA) field.

16. The switch of claim 14, wherein the network-testing request or response frame includes TRILL headers and an encapsulated Ethernet frame, and wherein an Ethertype field of the encapsulated Ethernet frame specifies that the network-testing request frame or the network-testing response frame is a TRILL OAM frame.

17. The switch of claim 16, wherein the encapsulated Ethernet frame includes a TRILL OAM header field.

18. The switch of claim 17, wherein the TRILL OAM header field includes an operation code (opcode) field, and wherein the opcode field specifies whether a TRILL OAM frame is a request frame or a response frame.

19. The switch of claim 17, wherein the TRILL OAM header field includes a transaction identifier, and wherein the network-testing request frame and the corresponding network-testing response frame have the same transaction identifier.

20. The switch of claim 11, further comprising a round trip time calculator configured to calculate the round trip time between the time when the network-testing request frame is transmitted and the time when the network-testing response frame is received.

21. An apparatus, comprising:
means for processing a command to test reachability in a Transparent Interconnection of Lots of Links (TRILL) network, wherein the command specifies a type of layer two or layer three network operating on top of the TRILL network;
means for generating a network-test request frame based at least on the specified type of layer two or layer three network operating on top of the TRILL network and an address of a destination node;
means for transmitting a network testing request frame from a source node to a destination node; and
means for, in response to a network-testing response frame corresponding to the network-testing request frame, determining reachability of the destination node.