FAIL-OVER SWITCHING SYSTEM

Abstract: A fail-over switch (100, 102) for use in a data storage system that connects each of a plurality of data storage devices (112) to each of two communication paths (126, 128). The switch (100, 102) may route requests to either of the two communication paths (126, 128). Switching may be accomplished by two switches (100, 102) connected to each other and each in connection with one of the two communication paths (126, 128). With one data storage controller (90) in communication with the data storage devices (112) over a first path (126) and a second data storage controller (92) in communication with the data storage devices (112) over a second path (128), the fail-over switch (100, 102) may be used upon detection of a malfunction on one path to switch a controller into connection with the remaining operable path so as to share that path with the other controller.

Description: Fail-Over Switching System Technical Field The present invention relates to having redundant communication pathway loops in a data storage system such that it one communication pathway becomes disabled. communications may be routed over an alternate pathway. In particular, the invention includes a tail-over switch in a system having multiple storage device controllers separately communicating over the redundant loops such that it a loops becomes disabled, the affected data storage device controller may re-route its communications by sharing the alternate loop. Background ot the Invention The present invention relates to providing access to redundant pathways connected to a plurality ot data storage devices There are many well-known methods in the prior art tor etfecting such redundant access For example, a libre channel arbitrated loop has been designed for use on two communication loops connected to a plurality ot data storage devices. Each loop is typically independently controlled, and in systems offeπng high- availabihty ot the storage devices, the system may compensate tor tailed components There are many ditterent solutions in the pπor art tor allowing such high-availability, but these solutions have tocused upon having redundant disks, so that a disk may be hot-swapped if it fails, as well as redundant controller cards, processors, power supplies, tans. etc. that may be hot-swapped with a new unit it the old one tails These solutions do not address the problem ot a communication path that tails, while the controlling hardware remains intact Such a problem may occur if the physical cable connection is pulled loose, breaking one of the fibre loops in a dual-loop fibre channel system. One conventional solution is to require that a secondary data storage controller handle the input/output processing of data requests through a redundant path to replace the primary controller attached to the now-defunct communication path. Information relating to the fiber-channel architecture may be found in American National Standards Institute (ANSI) standard X3.232-1994 promulgated by ANSI Committee X3T9.3 on Fibre Channel This reference is incorporated herein by reference Summary of the Invention The present invention may be used to provide high-availability to data storage devices. Preferred embodiments of the invention focus on allowing the interconnection of a pair of data storage controllers, each of which is connected to a separate communication path, and in which each path is in communication with an array of data storage devices. The data storage devices each have a communication port tor receiving each communication path being utilized by the invention. In this embodiment, if the first fail-over switch is unable to communicate the data request to a storage device over the first communication path, the first tail-over switch may route the data request over the second communication path. In preferred embodiments, a fail-over switch has several components. There is an incoming data terminal lor receiving a data request for transmission to the plurality ot storage devices; an outgoing data terminal for receiving a response to the data request: a transmission terminal tor communicating, over the first communication path, the data request to the plurality ot storage devices: a response terminal for receiving, over the first communication path, data from the plurality ot storage devices: a bypass-transmission terminal tor communicating, over the second communication path, the data request to the plurality ol storage devices: a bypass-response terminal for receiving, over the second communication path, data from the plurality of storage devices: and a switch that individually and selectively connects the first and second communication paths to the other terminals. In preferred embodiments, the switch has a tirst bypass switch for selectively connecting the incoming data terminal to the transmission terminal or to an intermediate node, and a second bypass switch for selectively connecting the intermediate node to the bypass-transmission terminal or to the outgoing data terminal. In a particular embodiment, the first and the second communication paths are configured as loops, where the data traveling on the loop is in one direction around the loop. In this embodiment, the first fail-over switch has a transmission and a response terminal, and a bypass-transmission and a bypass-response terminal, so that the first path loop begins and ends with the transmission and response terminals, and the second path loop begins and ends with the bypass-transmission and bypass-response terminals. In a further embodiment, there are two tail-over switches, each in communication with one of the communication paths, as well as with each other. Preferably each switch has an incoming and outgoing port, and ihe first and the second communication paths are configured as loops that begin and end with these ports ot the first and second fail-over switches. There are also two data storage controllers, one connected to each of the fail-over switches, where all data requests tor a particular path would be made through the data storage controller attached to that path Preferably, communications between the controllers and the switches would be over two senal pathways, where the first seπal pathway is connected to an incoming terminal, and the second serial pathway is connected to an outgoing terminal. In this preterred embodiment, the first and second fail-over switches are connected so that a data request may be selectively routed through the first fail-over switch over the first communication path, or through the first and second fail-over switches to the second communication path. In this embodiment, the data storage controllers also function as routers so as to connect the outgoing terminal ot the second switch to the incoming terminal of the second switch and loop data received lrom the first switch back to the second switch's transmission terminal. Similarly, responses to the forwarded request may be routed back to the first switch ' s outgoing terminal when received from the second communication path. The two data storage controllers of the system have a direct communication connection between them. If communications along one ot the communication paths to the storage devices is disrupted, the data storage device controllers would communicate directly to request permission to share the remaining active communicauon path. Once authorized, the tail-over switches would be configured to route communications from each ot the storage controllers over the active communication path. The present invention advantageously permits both storage controllers to continue operating despite loss of one of the communication paths, thus providing high-availability to the data storage devices without having to utilize complex and costly fibre channel concentrators/hubs. Other objects and advantages ot the invention will become apparent during the following description of the presently preterred embodiments oi the invention taken in conjunction with the drawings. Brief Description of the Drawings FIG. 1 is a schematic block diagram ot a fail-over switching system of the present invention. FIG. 2 is a schematic block diagram of a fail-over switching system of the present invention for use with a single data storage controller. FIGS. 3a and 3b are schematic diagrams showing the circuitry and behavior respectively of a prior art port bypass circuit. Detailed Description of Preferred Embodiments It is intended that a data storage system will be configured with storage devices, where each storage device is connected to multiple different communication pathways. Data controllers are assigned to specified data storage devices and one of the pathways. The data controller handles data requests and responses respectively to and from the assigned storage devices over that pathway. It is contemplated that the present invention will act as a bridge between the communication pathways such that if one pathway fails, then the affected data controller will be able to route its data requests over another available pathway. Thus the present invention may be used to provide high-availability of a plurality of data storage devices. In preferred embodiments, the storage devices have two communications ports for connection to two pathways. In alternate embodiments, a multiplexing protocol may be used to allow connecting multiple communication paths to a connection port. FIG. 1 shows a preferred embodiment of the present invention as configured from the interconnection of two fail-over switches 100, 102. In a preferred embodiment, there is a dedicated data storage controller 90. 92 for each fail-over switch, where the dedicated controller processes all data requests intended for the communication path to which the fail- over switch is attached, and where the controller may configure the fail-over switch to utilize its bypass terminals. Data requests for a data storage device 112 can be sent by the first data storage controller 90 to a first incoming terminal 104 on the first fail-over switch 100 for transmission over a first communication path 126. In preferred embodiments, the first communication path is a loop in which data travels serially from point-to-point in a single direction around the loop. Data requests for a different data storage device 112 may be sent by the second data storage controller 92 on a second incoming terminal 108 for transmission over a second communication path 128. In preferred embodiments, the second communication path is also a loop. The first and second communication paths may connect to numerous data storage devices limited by the speed of the path and the desired system speed. With a current Fibre Channel loop over one hundred data storage devices could be connected. Typically, the first data storage controller and the second data storage controller are assigned to different storage devices to avoid arbitration and contention issues. The data storage controllers 90, 92 receive responses to their requests respectively from the switches' outgoing terminals 106, 110. Each tail-over switch has a transmission terminal 200 and a response terminal 202 for connection to opposite ends ot the communication path loop. The fail-over switches may advantageously be switched to provide an alternate connection to an alternate loop. Each ot the tail-over switches include a bypass- transmission terminal 114 and a bypass-response terminal 116 tor completing the alternate connection. The bypass terminals of the two switches are cross-wired to each other so that the bypass-transmission terminal ot one switch is connected to the bypass-response terminal ot the other If communication ot the first data storage controller 90 over the first communication path 126 is interrupted, the data storage controllers may communicate with each other through a direct peer-to-peer communication link 150. The second data storage controller connected to an active communication path will diagnostically check the first data storage controller to ascertain whether the problem being expeπenced is actually the malfunction of the data storage controller rather than ot its communication pathway. Only if the data storage controller checks out satisfactorily will the first switch 100 be directed to bypass its ordinarily assigned communication path and to route data requests through the second switch 102. Once communications have been re-routed, then both data storage controllers will be operating over the second communication path 128 The switches can handle the failure of either communication path, switching the data storage controllers both into connection with the remaining active path. In accordance with the presently preterred embodiment, each fail-over switch includes two port bypass circuits. Under normal circumstances, a first bypass circuit 130 connects the first incoming terminal 104 to the transmission terminal 200 The response terminal 202 is connected to an intermediate node 132 A second bypass circuit 228 connects the intermediate node 132 to the outgoing terminal 106 Thus, communications of the data storage controller 90 take place over the first communication path 126. When the first communication path 126 is being bypassed, the first port bypass circuit 130 severs the communication link between the first incoming terminal 104 and the transmission terminal 200. The iirst incoming terminal 104 is connected to the intermediate node 132. The data request received on the incoming terminal 104 is routed through the intermediate node 132 ot the switch to the bypass-transmission terminal 114. The bypass- terminal 114 is connected to the second switch ' s 102 incoming bypass-response terminal 116. The data received upon the bypass-response terminal 116 is transmitted to the outgoing terminal 110 of the second data storage controller, and this data is automatically routed back to the incoming terminal 108 of the second controller. The automatic routing is practiced in the presently preferred embodiment in accordance with the protocol of the Fibre Channel arbitrated loop. Based upon the Fibre Channel protocol, devices connected to the communication pathway arbitrate tor the right to transmit over the pathway. The winner of the arbitration may then send out a request to communicate with another device connected to the pathway The requested device sends an acknowledgment and a point-to-point data path between the two devices is then formed All other devices on the pathway are required by the Fibre Channel specification to passively forward any data communications not intended for them, in effect, making all connectors to the pathway repeaters for all other connections on the pathway In this fashion, when the first data storage controller is added to the second communication pathway 128. and the first storage controller has won an arbitration request to communicate with a data storage device, the second data storage controller passively forwards data received on the second switch ' s 102 outgoing terminal 110 that was not intended for it back to the incoming terminal 108 The forwarded data may then be processed upon the second communication path 128. Similarly, returning data from the second communication path 128 is directed by the second tail-over switch 102 from the response terminal 202 through the intermediate node 132 to the switch ' s bypass-transmission terminal 114 The bypass-transmission terminal 114 is connected to the bypass-response terminal 116 ot the first switch, and the data is made available to the first data storage controller at the outgoing terminal 106. FIG. 2 shows the first tail-over switching system with only one data storage controller 90. The fail-over switch 100 puts the data storage controller 90 in communication with the first communication path 126 or the second communication path 128. The second communication path 128 must be routed through a second tail-over switch 102 or directly connected to the second path 128. Data is transmitted by the first tail-over switch 100 to the first communication path from a transmission terminal 200. Data is received from the loop over response terminal 202. When the fail-over switch is in its normal state, received data is directed through the intermediate node 132 across the second port bypass circuit 228 to the outgoing terminal 106. When the fail-over switch is switched, the first port bypass circuit 130 connects the incoming terminal 104 to the intermediate node 132. Data is transmitted to the second communication path 128 from bypass-transmission terminal 114. Data is received over bypass-response terminal 116 Thus, the fail-over switch permits communications by the data storage controller to proceed over either of the first communications loop 126 or the second communication loop 128. Thus, a problem on either loop can be accommodated by switching onto the other loop. Referπng in greater detail to FIG. 2, the incoming terminal 104 is connected to a data-in port 210 of the first port bypass circuit 130 A data-out port 216 of the first port bypass circuit 130 is connected to the transmission terminal 200 The response terminal 202 is connected to a response-in port 220 of the first port bypass circuit. A response-out port 224 of the first port bypass circuit is connected to a data-in port 226 ot the second port bypass circuit 228. The term intermediate node 132 as used herein refers to the connection between the two port bypass circuits 130. 228. The bypass-transmission terminal 114 is connected to a data-out port 232. The bypass-response terminal 116 is connected to the response-in port 236. A response-out port 240 is connected to the outgoing terminal 106 of the first fail-over switch 100. T e state of the port bypass circuits is controlled by the data storage controller 90. Although there need not be a direct connection to accomplish the control, lines 242 and 244 are shown to represent the control by the data storage controller 90 over the fail-over switches. Various intermediate controllers may be used to carry out the instructions from the data storage controllers in alternate embodiments. When a fail-over switch is in a switched bypass mode, communication through the incoming 104 and outgoing 106 terminals is routed through the bypass-transmission 114 and bypass-response 116 terminals instead of through the transmission 200 and response 202 terminals. As indicated hereinabove, in preferred embodiments, the transmission 200 and response 202 terminals would be in direct communication with the first communication path 126. while the bypass-transmission 114 and bypass-response 116 terminals may require communications to be routed through other hardware (e.g. the second fail-over switch 102 of FIG. 1 ) to reach the second communication path 128. FIG. 3a shows a logical circuit diagram of a pπor-art port bypass circuit 300. FIG. 3b shows a behavioral diagram of " such a port bypass circuit. These port bypass circuits may be used to make the fail-over switches used in the present invention. A port bypass circuit has two modes ot operation, the first being a pass-through mode, and the second being a bypass- mode. The mode is controlled by the status of a control line 302 shown in FIG. 3a. If the control line indicates the pass-through mode, then data on a data transmission line 312 connected to the switch ' s data-in port 304 passes through the switch to exit on the switch ' s data-out port 310. In pass-through mode, response data is received on the switch ' s response- in port 306. and this data passes through the switch to a data response line 314 that is connected to the switch ' s response out port 308. When the control 302 indicates the bypass- mode, then data entering the switch ' s data-in port 304 is routed directly to the switch's response-out port 308. thus bypassing the data-out 310 port. Though the embodiments hereinbefore descπbed are preferred, many modifications and refinements which do not depart from the true spiπt and scope of the invention may be conceived by those skilled in the art. It is intended that all such modifications, including but not limited to those set forth above, be covered by the following claims.

Claims: What is claimed is 1 A data storage system comprising a a first and a second communication path. b a plurality of data storage devices, each storage device having a first and a second port respectively in communication with the first and the second communication path: and c a first fail-over switch for routing a data request to the plurality ot data storage devices, wherein the switch is in communication with the first and the second communication path. wherein if the first fail-over switch is unable to communicate the data request to a storage device over the first communication path the first fail-over switch may be switched to route the data request over the second communication path 2 A system according to claim 1 , the system lurther comprising the first fail-over switch having a transmission and a response terminal, and a bypass-transmission and a bypass- response terminal, wherein the first and the second communication paths are configured as loops, the first path loop respectively beginning and ending with the transmission and the response terminals, and the second path loop respectively beginning and ending with the bypass-transmission and the bypass-response terminals 3 A system according to claim 2. wherein the data traveling on the loop is in one direction around the loop 4 A system according to claim 3, wherein the communication link between either data storage device port and the communication path to which it is linked further includes a port bypass circuit as part ot the communication link, so as to allow the communication link to be bypassed upon operation of the port bypass circuit 5 A system according to claim 4, the system further comprising a data storage controller in communication with the first fail-over switch, communicating with the data storage devices through the first fail-over switch 6. A system according to claim 5, wherein the communication path between the data storage controller and the first tail-over switch comprises two pathways, the first pathway connected to an incoming terminal, and the second pathway connected to an outgoing terminal. 7. A system according to claim 1 , wherein the first fail-over switch comprises: a.an incoming data terminal for receiving a data request for transmission to the plurality of storage devices; b.an outgoing data terminal lor receiving a response to the data request: c.a transmission terminal for communicating, over the first communication path, the data request to the plurality ot storage devices: d a response terminal tor receiving, over the first communication path, data from the plurality of storage devices: e.a bypass-transmission terminal for communicating, over the second communication path, the data request to the plurality of storage devices: f.a bypass-response terminal for receiving, over the second communication path, data from the plurality ot storage devices; g.a bypass switch that individually and selectively connects the first and second communication paths to the incoming and outgoing data terminals 8. A system according to claim 7, wherein the bypass switch comprises: a. a first switch for selectively connecting the incoming data terminal to the transmission terminal or to an intermediate node; and b.a second switch for selectively connecting the intermediate node to the bypass- transmission terminal or to the outgoing data terminal. 9. A system according to claim 7, the first fail-over switch further comprising two port bypass circuits configured so as to have a first and a second state, where the first state allows communication between the incoming and outgoing terminals respectively with the transmission and response terminals, and where the second state allows communication between the incoming and outgoing terminals respectively with the bypass-transmission and bypass-response terminals, wherein: a.for the first port bypass circuit. l.the incoming data terminal is connected to a data-in port. 11. a data-out port is connected to the transmission terminal, in. a response-in port is connected to the response terminal, and lv.the response-out port is connected to the data-in port of the second port bypass circuit: and b.for the second port bypass circuit. l.a response-in port is connected to the bypass-response terminal, a. a data-out port is connected to the bypass-transmission terminal, and m.a response-out port is connected to the outgoing data terminal. 10. A data storage system compπsing: a.a first and a second communication path: b.a plurality ot data storage devices, each storage device having a first and a second port respectively in communication with the first and the second communication path: and c.a first and a second fail-over switch for routing a data request to the plurality ot data storage devices, the first fail-over switch being in communication with the first communication path and the second fail-over switch being in connection with the second communication path: the first and second fail-over switches being connected to each other so that a data request routed through the first tail-over switch may be selectively directed over the first communication path, or through the second fail-over switch over the second communication path. 11.A system according to claim 10, the system further comprising the first tail-over switch having an incoming and outgoing port, and the first and the second communication paths being configured as loops with the first communication path loop beginning and ending at the first tail-over switches and the second communication path loop beginning and ending at the second communication path loop. 12. A system according to claim 10. wherein the communication link between the data storage device port and the communication path to which the port communicates includes a port bypass circuit so as to allow the communication link to be bypassed upon operation of the port bypass circuit. 13. A system according to claim 10. the system further comprising a first and a second data storage controller respectively in communication with the first and the second fail-over switch, wherein all data requests to the data storage devices are made through the data storage controllers. 14. A system according to claim 13. wherein the communication path between the data storage controller and its respective fail-over switch compπses two pathways, the first pathway carrying signals from the data storage controller and the second pathway carrying signals to the data storage controller. 15. A system according to claim 10. each fail-over switch having a first and a second port bypass circuit. 16. A system according to claim 10. wherein both the first and the second fail-over switches comprise: a.an incoming data terminal for receiving a data request tor transmission to the plurality of storage devices; b.an outgoing data terminal for receiving a response to the data request: c.a transmission terminal for communicating the data request to the plurality of storage devices, such transmission being over the first communication path for the first fail- over switch, and over the second communication path for the second fail-over switch: d.a response terminal for receiving data from the plurality of storage devices, such response being over the first communication path for the first fail-over switch, and over the second communication path for the second fail-over switch: e.a bypass-transmission terminal for communicating the data request to the plurality of storage devices, such transmission being over the second communication path for the first circuit, and over the first communication path for the second circuit; l.a bypass-response terminal for receiving data from the plurality ot storage devices. such receipt being received over the second communication path for the first fail-over switch, and over the first communication path for the second fail-over switch; g.a first switch that individually and selectively connects the first and second communication paths to the incoming and outgoing data terminals of the first fail-over switch; h.a second switch that individually and selectively connects the first and second communication paths to the incoming and outgoing data terminals of the second fail-over switch. 17. A system according to claim 16. wherein each ot the first and second switches compπse: a. a first bypass switch for selectively connecting the incoming data terminal to the transmission terminal or to an intermediate node; and b.a second bypass switch for selectively connecting the intermediate node to the bypass-transmission terminal or to the outgoing data terminal. 18. A system according to claim 10. the system further comprising a first and a second data storage controller respectively in communication with the first and the second fail-over switch, wherein all data requests to the data storage devices are made through the data storage controllers. 19. A data storage system comprising: a first single directional data loop; a second single directional data loop; a plurality of data storage devices connected to said first single directional data loop and said second single directional data loop; a first fail-over switch having a transmission terminal and a response terminal connected to opposite ends of said first single directional data loop and having a bypass response terminal and a bypass transmission terminal; a second fail-over switch having a transmission terminal and a response terminal connected to opposite ends of said second single directional data loop and having a bypass response terminal coupled to the bypass transmission terminal of said first fail-over switch and a bypass transmission terminal coupled to the bypass response terminal of said first tail- over switch: a first data storage controller connected by two pathways to said first fail-over switch so that said first data storage controller can be added to said first single directional data loop through the transmission terminal and the response terminal of said first tail-over switch: a second data storage controller connected by two pathways to said second fail-over switch so that said second data storage controller can be added to said second single directional data loop through the transmission terminal and the response terminal of said second fail-over switch: and wherein said first tail-over switch and said second fail-over switch may be switched so that said first data storage controller is switched out of connection with said first single directional data loop and into connection with said second single directional data loop through the bypass response terminals and the bypass transmission terminals ot the first and second fail-over switches and the transmission terminal and the response terminal of said second fail-over switch. 20 The data storage system of claim 19 further compπsing a peer-to-peer communication link connected between said first data storage controller and said second data storage controller 21 A method tor recovering from a malfunctioning communication path comprising the steps of: providing a first data storage controller having communication access to a plurality of data storage devices over a first communication path and a second data storage controller having communication access to the plurality of data storage devices over a second communication path; detecting a malfunction over the first communication path; requesting access to the second communication path: and switching the first data storage controller into communication access with the plurality of storage devices over the second communication path such that the first and second data storage controllers share use of the second communication path. 22. The method of claim 21 wherein said step of requesting access comprises communicating between the first data storage controller and the second data storage controller over a direct peer-to-peer communication link. 23. The method of claim 22 further comprising a step ot receiving approval on the peer- to-peer communication link to access the second communication path. 24. The method of claim 21 wherein the first and second communication paths are each serial communication loops and wherein said step ot switching comprises uncoupling the first data storage controller trom two ends of the first communication path and coupling the first data storage controller with the second communication path through two terminals of a switch in the second data storage controller

Inventors: BAILEY BRIAN K, BLEIWESS SCOTT, ESPY JAMES W, EVERDELL PETER, SOLOMON ROBERT C, BAILEY, BRIAN, K., BLEIWESS, SCOTT, ESPY, JAMES, W., EVERDELL, PETER, SOLOMON, ROBERT, C.
Applicants: DATA GENERAL CORP, DATA GENERAL CORPORATION
Application year: 1997
Main classification: G06F11
IPC codes: G06F11, G06F13