SCALABLE FAULT TOLERANT NETWORK INFORMATION SERVER

Abstract: The information server system provides a scalable expansion capability, due to the implementation of a unique mid-plane connector board for all components of the information server system that allows for multiple mirrored components to significantly improve fault tolerance of the server system. An integrated diagnostics monitoring subsystem eliminates the incompatibility problems previously associated with performing diagnostics of the server system. A method is also provided for increasing the throughput rate of the user communications interface by installing a hash table database in the end user computer system to bypass a similar but slower function in the end user modem, to place the bulk of the transmission reception load on the main CPU, and synchronizing the modem with the transmission speed of the server unit.

Description: SCALABLE FAULT TOLERANT NETWORK INFORMATION SERVER BACKGROUND OF THE INVENTION Field of the Invention: This invention relates to a high speed, microprocessor based fault tolerant mass storage information server system, and more particularly concerns an integrated, fault tolerant, four-way mirrored Internet server system, including hot swappable components connected to a midplane connector, combining communication, routing and switching functions with scalable storage, and an integrated system monitoring diagnostics computer subsystem. Description of Related Art: Conventional information server systems, including Internet server systems, have been able to provide only limited scalability to accommodate increased storage requirements, and have typically required a power-down of the information server system to facilitate installation of additional disk storage devices or communications components. The shut down and installation of additional or replacement components to an information server system commonly requires a significant amount of system administrator personnel time and resources to facilitate system maintenance, and for such tasks as expansion of storage space, repair, and routine maintenance, such as optimization and system monitoring. Conventional information server systems also have limited fault tolerance, and typically employ a disk array server which incorporates extra disk space substantially in excess of that needed by the information server system. The extra disk space is incorporated into such systems by the addition of disk storage devices. However, conventional backplane technology typically has been limited to allowing up to eight disk drives in an individual server. Multiple server units could be linked to increase the capacity of an information server system, and this type of multiple server configuration also allowed only a limited amount of fault tolerance. Typically, if one server failed, information directed to the server would be directed to the next server in line for the registration, and so on from one server to the next. However, each time the information was rerouted, timing out was required, resulting in compounding of delays as information was transferred from one server to another. Prior art systems also balanced the load among clustered servers by utilizing a load balancing program, which, however, required an operator to manually run a diagnostics program on each server and manually switch servers. Depending upon the nature of a component failure, corrective action with prior art systems can include removal and replacement of a completely or partially failed device. Such system maintenance typically requires that the entire server system be taken off-line, and powered down before the physical replacement operation can be performed. Some information server systems permit "hot swapping," the removal and replacement of a component in a system while the power is on and the system is operating. Such systems still typically require considerable hands-on intervention of the system administrator personnel to manually manipulate the hardware interfaces and operating system software for purposes of physically and logically reintegrating the newly replaced disk device or other component into the server system. The process of logical reintegration of even a "hot swappable" component into a server system typically requires a significant portion of the CPU and memory resources of the server system. For installation of a disk storage device, such resources are needed to reallocate the available free disk space into the logical disk configuration of the server, and to redistribute the multiple copies of the information stored on the server across the new and remaining physical and logical disk drives. Such demands on the resources of the server system can temporarily severely decrease the performance of the information server system. There is therefore clearly a need for a fault tolerant information server system that allows for the rapid removal of failed or failing components, and the integration of either replacement components or additional components into the server system, while the power is on and the system is operating, without a significant drain upon the resources of the server system. With reference to Fig. 1, illustrating a prior art server hardware configuration, a conventional information server system includes a variety of components from different manufacturers and utilizing different protocols, frequently causing incompatibility problems in performing diagnostics of the entire server system. Such a server system typically is connected to receive user calls, forwarded to the server system by a central office (CO) through a normal telephone line (POTS) carrier line to a modem, such as a modem available from U.S. Robotics, for example, interfaced with a terminal server such as those provided by Livingston, for example, and a hub for connecting several computers or networks together, such as those provided by Kingston, for example. The hub is connected to a communications system, such as that provided by CISCO, and a router such as that provided by ADTR-AN, which is in turn interfaced to the network (WWW). Such prior art network interface systems have serious limitations in their adaptability and flexibility, and must be directly managed by skilled personnel who are knowledgeable about how to effectively maintain availability of the network interface in the face of the complex relationships of the hardware used. Often, the only way to achieve reasonable reliability is to provide large amounts of redundancy as well. All of the above contributing to a great deal of expense in the requisition and maintenance of a network interface system. The present invention solves these and many other problems. SUMMARY OF THE INVENTION Briefly, and in general terms, the present invention provides for an information server system that provides a wide array of reconfigurable options as well as scalable expansion capability, due to the implementation of a unique mid-plane connector board for all components of the information server system. The information server system can thus be readily assembled and integrated with multiply mirrored components to significantly improve fault tolerance of the server system. In addition, the information server system of the invention provides an integrated diagnostics computer subsystem and fully hot swappable components that eliminate problems of degradation of server system performance by replacement or addition of components to the server system. In addition, the integrated diagnostics computer subsystem eliminates the incompatability problems previously associated with performing diagnostics on the server system. The rate of end user communications reception can also advantageously be increased by a method for installing a hash table database in the end user computer system to bypass a similar but slower function in the end user modem, to place the bulk of the transmission reception load on the main CPU, and synchronizing the modem with the transmission speed of the server unit. The invention accordingly provides for an information server system having a scalable, modular, fault tolerant, hot swappable architecture of a plurality of components for interfacing with a computer network such as the Internet, comprising a central processing unit, a communications interface subsystem connected to the central processing unit, a mass storage subsystem connected to the central processing unit, and a diagnostics computer subsystem connected to the central processing unit for monitoring when one of the plurality of components of the information server system is removed or added. In a presently preferred embodiment, the information server system further comprises a mid-plane connector board having a plurality of sockets for connecting the components on each side of the mid-plane connector board, and the components of the information server system are currently preferably connected to the mid-plane connector board of the information server system by interface cards. In a preferred aspect of the invention, the interface cards comprise circuitry to sense when the interface cards are failing or are being removed, and to generate a signal to the diagnostics subsystem of the information server system indicating that the component connected to the connector board by the interface card is to be taken off line, to allow the information server system to switch the components off as they are taken off-line, and to switch them on as they are placed online, allowing the information system to be fully hot-swappable. Each the component preferably has a unique electronic serial number recognized by the diagnostics subsystem, allowing the components to be integrated into the information server system. In a currently preferred aspect, the information server system comprises multiply mirrored components to significantly improve fault tolerance of the information server system. The mid-plane connector board accordingly preferably has upper and lower sets of sockets, allowing for components to be mirrored left and right, and top and bottom, to significantly increase fault tolerance of the information server system. A plurality of mid-plane connector boards can be provided, allowing for expansion and scalability of the system. In one presently preferred embodiment, the mass storage subsystem comprises a plurality of disk storage devices, and each of the plurality of disk storage devices is mounted on a bypass interface card that connects to a mid-plane connector board having a plurality of sockets for connecting interface cards for components on each side of the mid-plane connector board. The bypass interface cards are sequentially connectable together by jumper cables, so that a plurality of disk storage devices can be connected together. In a currently preferred aspect, the bypass interface cards include circuitry to sense when a bypass interface card is failing or is being removed, and to generate a signal to the diagnostics subsystem of the information server system indicating that the disk storage device connected to the connector board by the bypass interface card is to be taken off line, to allow the information server system to switch the disk storage components off as they are taken off-line, and to switch them on as they are placed on-line, allowing the information system to be fully hot-swappable. In one presently preferred embodiment, the mass storage subsystem comprises a fibre channel disk storage device array subsystem. A presently preferred aspect of the information server system is that each of the components of the information server system has a unique serial number, and the diagnostics computer subsystem monitors the serial numbers for the components on-line. In another preferred aspect, the diagnostics computer subsystem is connected to a plurality of temperature sensors that are provided to monitor temperature zones throughout the information server system. In another preferred aspect of the invention, the information server system comprises a fan, and the diagnostics computer subsystem is connected to the fan for monitoring the fan speeds. In yet another preferred aspect, the information server system comprises a power supply, and the diagnostics computer subsystem is connected to the power supply for monitoring the electronic signature of the power supply. The present invention also provides for a method for increasing the throughput rates of a user computer having a communications interface via a network with a host server system, the user computer communications interface including a modem of the type utilizing a database hash table for decryption of encrypted data received from the host server system. The method comprises the steps of installing a supplementary database hash table in the user computer to replace the function of the hash table in the modem, accessing the supplementary hash table installed in the computer for decryption of encrypted data received from the host server system, and synchronizing the modem with the transmission speed of the host server system. In one preferred aspect of the method, the step of synchronizing the modem with the transmission speed of the host server system comprises gradually increasing the setting of the throughput rate of the modem along with that of data transmission from the host server system. In another preferred aspect of the method, the step of synchronizing the modem with the transmission speed of the host server system further comprises detecting the throughput transmission rate change with a phase lock loop, in order to synchronize the user computer communications interface with the throughput rate of data transmissions from the host server. These and other aspects and advantages of the invention will become apparent from the following detailed description and the accompanying drawings, which illustrate by way of example the features of the invention. BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a schematic diagram of a prior art information server configuration; Fig. 2 is a schematic diagram of server hardware configuration according to the invention; Fig. 3 is a schematic diagram of a user interface with a central office connected via a network to an information server system; Fig. 4 is a schematic diagram of an integrated information server 7 system according to the present invention; Fig. 5 is a more detailed schematic diagram of the integrated information server system of Fig. 4 according to the present invention; Fig. 6 is a more detailed schematic diagram of a typical embodiment of the integrated information server system of Fig. 4 according to the present invention; and Fig. 7 is a graph illustrating the synchronization of a user communications interface with increased information server system transmission speeds according to the method of the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Some conventional information server systems have limited fault tolerance, requiring the complete power-down of the information server system to repair component failures and permit the installation of additional devices. Conventional backplane technology also has limited the degree to which multiple mirroring of components can be provided in an individual server. While multiple server units could be linked, this type of multiple server configuration allowed only a limited amount of fault tolerance. Conventional information server systems are also commonly assembled from components from a multiplicity of non-standardized sources, and incompatability problems have commonly been encountered in performing diagnostics of such information server systems. The speed of transmission of network information to a user communications interface is also commonly limited by the capacity of the modems utilized at the user interface. As is illustrated in the drawings, the invention is embodied in an improved information server system with a scalable, modular, fault tolerant, hot swappable architecture for interfacing with a network such as the Internet. Fig. 2 is an illustration of a presently preferred server configuration, having one administrative server, 50 term servers, an email server, a news server and a web server, 50 term servers, 2016 modems, and 84 channel banks, connected to the network (WWW) by a digital server unit (DSU) and a router at one side, and 8 connected to a central office and to the Internet user by routers and a DSU at the other side. In addition to such information server systems being assembled from components from a multiplicity of varied sources, system administrator personnel commonly utilize different types of proprietary software programs to perform diagnostics on the system, requiring different adapter configurations. A need exists to eliminate the incompatability problems previously associated with performing diagnostics of an information server system. The present invention solves those problems. In addition, despite advances in speed and capacity of information server systems, the speed of transmission of network information is commonly limited by the capacity of the modems utilized at the user interface. With reference to Fig. 3, the client or user computer system is typically connected via a modem to the central office (CO), connected via a network to an information server system. The user modem contains a digital signal processing (DSP) chip and software installed in the DSP chip, containing a hash table encrypting an X-Y lookup table, such as for common characters transmitted. The hash table in the modem contains an array of pointers indexed by a hash function, used in a hashing scheme to provide rapid access to data items which are distinguished by a key. However, the size of the hash table in common modems is severely limited, thus, limiting the degree of compression that can be accomplished, and therefore the speed of the modem. Carrier transmission speeds can be increased by providing expensive, higher capacity modems, to provide significant transmission speed increases over normal telephone lines, such as is accomplished with Tl carriers, for example. However, it would be desirable to provide a server system and method implemented by the server system to allow a user computer and modem to receive transmissions from server systems at significantly higher speeds, without the need for physically replacing or upgrading a user modem with a more expensive, higher capacity modem. Referring to Fig. 4, the information server system 10 of the invention is typically connected to a fibre channel disk storage device array subsystem 12 connected to the information server subsystem by an integral Fibre Channel architecture compatible, high speed physical and virtual backplane bus and Intelligent Input/Output (I 2 O) bus to an external bus 14. The information server further incorporates secondary subsystems including, but not limited to, a communications interface subsystem 16, a disk array controller subsystem 18, and a single board high speed computer (SBC) 20 utilizing a computer industry standard operating system software program, such as, for example, the operating system available under the trade name "WINDOWS NT" from Microsoft Corporation. The fibre store disk storage device array subsystem preferably utilizes an integrated, fault tolerant and scalable disk storage design, with a plurality of disk storage devices 22, with each disk storage device mounted on a bypass interface card 24 that connects to a unique vertical mid-plane connector board 26. Each mid-plane connector board advantageously has sockets 28 for connecting interface cards for components on each side of the mid-plane connector board, and each mid-plane connector board further can have upper and lower sets of sockets, allowing for components to be mirrored left and right, and top and bottom, to significantly increase fault tolerance of the information server system. Multiple mid-plane connector boards can be utilized in the information server system, allowing for expansion and scalability of the system. Each of the bypass interface cards are sequentially connectable together by jumper cables, so that any number of disk storage devices can be connected together to make the configuration scalable to up to any needed mass storage configuration, limited only by the size of space available for disk storage provided by the physical server case framework. As is further explained in greater detail below, the diagnostics subsystem monitors the serial numbers for the components on-line, and monitors when a component is removed or added. Each bypass interface card preferably includes circuitry to sense when a bypass interface card is failing or is being removed, and to generate a signal to the diagnostics subsystem of the information server system indicating that the individual is to be taken offline, to allow the information server system to switch the disk storage components off as they are taken off-line, and to switch them on as they are placed on-line, allowing the information system to be fully hot-swappable. Referring to Fig. 5, the information server system 10 typically is connected between users calling using the SS7 protocol, forwarded to the server system by a central office (CO) 30 through a Tl carrier line to a first interface board 10 32 that performs the functions of a digital service unit/channel service unit (DSU/CSU). The information server system is also connected to the network (WWW) 34 via a second interface board 36. The first interface board is connected to a communications subsystem board, or communication board 38, which in turn also communicates with the second interface board to the network. A typical information server system includes six dedicated communication cards. The communication board and second interface board perform the routing functions of the information server system. The central processing unit (CPU) 40 is typically connected to receive input from a CD-ROM drive 42 and floppy disk drive 44, and communicates with the communication board and a fibre channel controller (FC) 46 for controlling the fibre channel 48, allowing the CPU to interface with the hard drives 22. The system diagnostics monitoring subsystem 50 is connected to monitor the interface boards, the communication board, the CPU, the FC and fibre channel, as well as the hard drives, and includes an LCD VGA touch screen 52, a PCMCIA modem 54 for remote access, and a 10/100 NIC card 56. The dedicated system diagnostics monitoring subsystem 50 thus monitors all the cards and communications systems, over the I 2 O. The system diagnostics monitoring subsystem 50 preferably comprises dual, left and right mirrored computers, each having a VGA LCD touch screen 52 for displaying a menu system for a complete diagnostics routine, with two computer interface cards on one mid-plane connector board, each card having a top and a bottom and left and right sections. The system diagnostics monitoring computers are typically connected to the front of the mid-plane connector board, and the I/O ports for the system diagnostics monitoring computers are typically connected at the back of the mid-plane connector board. A PCMCIA modem is provided to interface with the server system for remote access. Otherwise, all functions and tests can be performed via the touch screen. The diagnostic suite is preferably programmed in the integrated diagnostics subsystem, and eliminates the incompatability problems previously associated with performing diagnostics of the server system. As is illustrated in greater detail in Fig. 6, a typical configuration for the information server system of the invention includes a computer board 58, typically 11 containing two mirrored CPU's 40, the system diagnostics monitoring subsystem 50, sections for dual power supplies 60, a back plane 62 with slots for power, and 5 peripheral slots (0-4) 64, including a slot 66 for a CD-ROM drive, fiber store mass storage subsystem 12 with dual power supplies (not shown), including multiple hard drives 22 on the bypass interface carrier board interfacing with the CPU's by a fiber channel 48. The hard drives preferably conduct predictive algorithms to transfer data to the other drives and shut down when they are about to fail. The information server case also preferably includes a CD-ROM drive 42 and floppy disk drive 44. Multiple modular interface boards 70 and modular communications boards 72 perform the routing functions of the information server system, and are preferably Field Programmable Gate Array (FPGA) based to be software configurable, and identified by serial number, allowing upgrades to be downloaded to the communications modules. The interface boards and communications modules are also preferably hot swappable modules that allow the information server system to be expandable without the need to reconfigure the system. The diagnostics subsystem is also connected to as many as 40 temperature sensors, or more, to monitor temperature zones throughout the information server system. Typically four sensors are provided on each bypass interface card. In addition, the diagnostics subsystem is connected to the fans (not shown) and power supplies for monitoring the fan speeds and electronic signatures of the power supplies, i.e., by sampling the current drawn and voltage drop across the components, and comparing these measurements against measurements made when the units were new. If the electronic signature of a component varies by greater than 20%, the component is taken offline. The fan and power supply components are also preferably hot swappable, so that once they are identified as failed and offline, they can readily be replaced, without requiring any down time for the server unit. The communications interface subsystem communicates with other subsystems of the information server on the above described buses and incorporates any combination of a number of widely available interface and communications tertiary subsystem circuit boards. The interface boards incorporate, among other components, digital service unit (DSU) framers which can include, for example, T-l 12 communications compatible DSU's such as the Model No. DS2152 chip set from Dallas Semiconductor Corp. The communications boards incorporate, among other components, multi-channel communications processors which can include, for example, the four channel "Quick-Chip" communications processor from Motorola Corp. The communications circuit board also includes onboard buffer memory and a high speed, fiber channel compatible, optical bus for intra-server-component high speed data communications, as well as fiber channel compatible compactPCI bridge circuitry such as the bridge chip set available from Tundra. Additionally, for improved communications diagnostic, status and monitoring capabilities, the communications board incorporates a bit error rate tester (BERT) chip set, such as the device available as Model No. DS2172 from Dallas Semiconductor, configured for communications with the SBC and operating system software, via the I 2 O bus. The communications interface subsystems are adaptable for compatibility with other network and telecommunications architectures, protocols and topologies, including, but not limited to, T-3, DS-3, OC-3 c , OC-12 c , OC-192 c , FDDI, SONET, SCSI, TCP/IP, HiPPI and ATM. In another aspect of the method of the invention for increasing the throughput rates of standard user communications interface, the present invention addresses the problem of enlarging the size of the hash table utilized by the user interface to allow significantly compression of the information being transferred, and consequently significant modem speed increases that can currently commonly only be achieved by installing a higher capacity modem with a larger hash table. According to the method of the invention, when the user logs on to the host server system, the host server system transfers an autoexec file to the user computer system, and instructs the user to turn off the computer, and to run the autoexec file on start up. The autoexec file installs a database hash table in the computer to replace the function of the hash table in the modem, and modifies the modem to access the hash table installed in the computer, placing the load of the hash table encryption on the main CPU, permitting expansion and updating and upgrading of an extended hash table to include commonly used terms, such as Internet terms, for example. As is illustrated in Fig. 7, in order to synchronize the modem with the server unit, the setting of the 13 throughput rate 74 of the modem is gradually increased along with that of the transmission, ultimately allowing for approximately a quadrupling of the speed of the modem. The user modem detects the throughput transmission rate change with a phase lock loop, in order to synchronize the user communications interface with the increased throughput rate of the transmissions from the host server. The operating system software incorporates enhancements adding functionality directed to control of the communications interface, disk array controller and single board computer. The SBC can include any of a wide number of suitable devices, including, but not limited to, the CompactPCI CPU Board with Pentium processor, Model No. ZT 5510, available from Ziatech Corporation. Modifications to enhance performance of the ZT 5510 can include an onboard 40 Mb flash memory card for permanent storage of the non-reconfigurable portions of the operating system software, and an onboard removable PCMCIA 40 Mb flash memory card, "D2 FlashDisk" available from Sundisk Corporation, for read writeable storage of the reconfigurable portions of the system software. It will be apparent from the foregoing that while particular forms of the invention have been illustrated and described, various modifications can be made without departing from the spirit and scope of the invention. Accordingly, it is not intended that the invention be limited, except by the appended claims.

Claims: 14 WHAT IS CLAIMED IS: 1. An information server system having a scalable, modular, fault tolerant, hot swappable architecture of a plurality of components for interfacing with a computer network such as the Internet, comprising: a central processing unit; a communications interface subsystem connected to the central processing unit; a mass storage subsystem connected to the central processing unit; and a diagnostics computer subsystem connected to the central processing unit for monitoring when one of the plurality of components of the information server system is removed or added. 2. The information server system of Claim 1, further comprising a mid-plane connector board having a plurality of sockets for connecting the interface cards for the components on each side of the mid-plane connector board. 3. The information server system of Claim 2, wherein the plurality of components of the information server system are connected to the mid-plane connector board of the information server system by interface cards. 4. The information server system of Claim 3, wherein said interface cards comprise circuitry to sense when the interface cards are failing or is being removed, and to generate a signal to the diagnostics subsystem of the information server system indicating that the component connected to the connector board by the interface card is to be taken offline, to allow the information server system to switch the components off as they are taken off-line, and to switch them on as they are placed on-line, allowing the information system to be fully hot-swappable. 5. The information server system of Claim 4, wherein each said component has a unique electronic serial number, allowing the components to be integrated into the information server system. 6. The information server system of Claim 5 , wherein said information 15 server system comprises multiply mirrored components to significantly improve fault tolerance of the information server system. 7. The information server system of Claim 2, wherein said mid-plane connector board has upper and lower sets of sockets, allowing for components to be mirrored left and right, and top and bottom, to significantly increase fault tolerance of the information server system. 8. The information server system of Claim 7, comprising a plurality of mid-plane connector boards, allowing for expansion and scalability of the system. 9. The information server system of Claim 1, wherein said mass storage subsystem comprises a plurality of disk storage devices. 10. The information server system of Claim 9, wherein each of said plurality of disk storage devices is mounted on a bypass interface card that connects to a mid-plane connector board having a plurality of sockets for connecting interface cards for components on each side of the mid-plane connector board. 11. The information server system of Claim 10, wherein each of said bypass interface cards are sequentially connectable together by jumper cables, so that a plurality of disk storage devices can be connected together. 12. The information server system of Claim 11, wherein each of said bypass interface cards include circuitry to sense when a bypass interface card is failing or is being removed, and to generate a signal to the diagnostics subsystem of the information server system indicating that the disk storage device connected to the connector board by the bypass interface card is to be taken off line, to allow the information server system to switch the disk storage components off as they are taken off-line, and to switch them on as they are placed on-line, allowing the information system to be fully hot-swappable. 16 13. The information server system of Claim 1, wherein said mass storage subsystem comprises a fibre channel disk storage device array subsystem. 14. The information server system of Claim 1, wherein each of said components of the information server system has a unique serial number, and said diagnostics computer subsystem monitors the serial numbers for the components online. 15. The information server system of Claim 1, further comprising a plurality of temperature sensors to monitor temperature zones throughout the information server system. 16. The information server system of Claim 1, further comprising a fan, and wherein said diagnostics computer subsystem is connected to the fan for monitoring the fan speeds. 17. The information server system of Claim 1, further comprising a power supply, and wherein said diagnostics computer subsystem is connected to the power supply for monitoring the electronic signature of the power supply. 18. A method for increasing the throughput rates of a user computer having a communications interface via a network with a host server system, the user computer communications interface including a modem of the type utilizing a database hash table for decryption of encrypted data received from the host server system, the method comprising the steps of: installing a supplementary database hash table in the user computer to replace the function of the hash table in the modem; accessing the supplementary hash table installed in the computer for decryption of encrypted data received from the host server system; and synchronizing the modem with the transmission speed of the host server system. *" 3 toy PCT/US99/07284 17 19. The method of Claim 18, wherein said step of synchronizing the modem with the transmission speed of the host server system comprises gradually increasing the setting of the throughput rate of the modem along with that of data transmission from the host server system. 20. The method of Claim 19, wherein said step of synchronizing the modem with the transmission speed of the host server system further comprises detecting the throughput transmission rate change with a phase lock loop, in order to synchronize the user computer communications interface with the throughput rate of data transmissions from the host server.

Inventors: DELLACONA RICHARD, DELLACONA, RICHARD
Applicants: DELLACONA RICHARD, QUAD RESEARCH, DELLACONA, RICHARD
Application year: 1999
Main classification: G06F11
IPC codes: G06F3, G06F11, H04L29