System and method for distributed console server architecture

The present disclosure relates to a distributed console server system. The system may have a server and a software module loaded onto the server for communications with a plurality of remote devices within a data center. A remote serial port unit may be included which is in communication with the server and which is controlled in part by the server and the software module. The remote serial port unit may be in communication with the plurality of remote devices. The remote serial port unit may include at least one of a first module including a plurality of RJ45 ports, or a second module including a plurality of USB ports.

FIELD

The present disclosure relates to systems and methods for interfacing with the serial consoles of various data center infrastructure devices and information technology devices, and more particularly to a system and method that uses custom configurable remote serial port units and related software that runs on a management server, for communicating with the remote serial port units.

BACKGROUND

Serial port devices are widely used in modern day data centers. At the present time there is a need for a scalable serial port solution along with a unified approach to serial console management. A component that enables a unified approach to serial console management would have particular appeal for administrators of medium size, large and very large datacenters, where dozens, hundreds or even thousands of serial port devices may be in use. Such very large scale data centers are presently operated by corporations such as Google Inc., Apple Inc., Facebook Inc., and the LinkedIn Corporation.

It would also be desirable to decrease (or at least maintain) the current cost per serial port for the hardware being used, while offering advanced software features that can be easily implemented in a unified, scalable serial port solution. A new serial port architecture and solution would provide data center management professionals a greater degree of integration with their own software tools and easy management of the new serial port solution and connected target devices.

Still further, it would be desirable to provide serial port hardware devices that can be easily and quickly reconfigured with different combinations of RJ-45 ports and USB ports to enable the data center professional to adapt the devices to the changing needs of a modern day data center.

SUMMARY

In one aspect the present disclosure relates to a distributed console server system. The system may comprise a server and a software module loaded onto the server for communications with a plurality of remote devices within a data center. A remote serial port unit may be included which is in communication with the server and which is controlled in part by the server and the software module. The remote serial port unit may be in communication with the plurality of remote devices. The remote serial port unit may include at least one of a first module including a plurality of RJ45 ports, or a second module including a plurality of USB ports.

In another aspect the present disclosure relates to a distributed console server system comprising a server and a software module. The software module may be loaded onto the server for communications with a plurality of remote devices within a data center. A remote serial port unit may be included which is in communication with the server. The remote serial port unit may be controlled in part by the server and the software module. The remote serial port unit may have a front panel and a rear panel, and may be in communication with the plurality of remote devices. The remote serial port unit may further include a first RJ45 module including a plurality of RJ45 ports accessible from the front panel, a first USB module including a plurality of USB ports accessible from the front panel, and at least one of a second RJ45 module or a second USB module accessible from the rear panel.

In another aspect the present disclosure relates to a method for forming a distributed console server for use in a data center. The method may comprise providing a server, and a software module loaded on the server for communications with a plurality of remote devices within the data center. The method may further involve using a remote serial port unit to communicate with the server, and where the remote serial port unit is controlled in part by the server and the software module. The method may further include using the remote serial port unit to communicate with the plurality of remote devices, and using at least one of a first module including a plurality of RJ45 ports or a second module including a plurality of USB ports, configured within the remote serial port unit, to communicate with the plurality of remote devices.

DETAILED DESCRIPTION

Referring toFIG. 1there is shown one embodiment of a console server system10in accordance with the present disclosure. The system10in this example makes use of a software module12to implement a control and management plane (hereinafter simply “software12”) on a management server16, and one or more hardware devices in the form of remote serial port units14a,14band14c. While three remote serial port units (“RSPUs”)14a-14chave been shown, it will be appreciated that a greater or lesser plurality of RSPUs14could be used to form the system, and the system10is therefore not limited to use with any specific number of RSPUs14.

The management server16uses the software12to communicate with and control each of the RSPUs14a-14cvia a network17and the well-known Ethernet protocol. The network17may be either a production network or a management network, but in most instances the RSPUs14will be coupled to network switches15and will be communicating with the serial console ports of various infrastructure devices (e.g., power distribution units (PDUs)), Computer Room Air Conditioners (CRACs), uninterruptible power supplies (UPSs), as well as various information technology (IT) devices (e.g., servers, storage devices, network switches, routers, etc.), and therefore the network17will in most applications be a management network. However, the system10is not limited to any specific type of communications network, or any specific network communications protocol. It will also be understood that the network switches15and the network17are not part of the system10. An optional configuration may have a copy of the software12installed on an additional server16′ to provide for failover protection.

A significant advantage of the system10is that the system is easily scalable to meet the changing needs of the modern day data center. Removing the required software for communicating and controlling each RSPU14a-14cfrom the RSPUs, and using the software12instead on a conventional management server16, has a number of important advantages. The fact that the software12is operated on the management server16(i.e., a standard server) not only contributes to ease in scalability of the system10, but also allows the software12to run on virtualized servers, thus offering greater flexibility to the data center administrator. Running the software12on the management server16, especially in a virtualized environment, also enables strategies for load balancing and server failover, with multiple servers running the software12in parallel. Furthermore, since the code for the software12is compiled and run on a standard server, no cross compiler and tool chain is needed. Still further, running the software12on a standard server will enable libraries to be used for serial port integration on user applications (i.e., actually not only serial port, but any managed target device). These libraries could be “Glib-style” for C applications, a set of C++ or Python objects, or even a Java package if needed, or any popular Web technology for Web-based applications. And since the system10has the software12“decoupled” from the RSPUs14a-14c(i.e., from the firmware associated with each RSPU14), this helps to ensure that the great majority of new software releases and/or updates can be simply software-based. It is expected that only in rare instances would the RSPUs14require a true firmware update.

Still another advantage of separating the software12and running the software on the management server16is the ability to leverage the increased computing power and memory capacity that typically exists on a conventional server. Running the software12on the management server16means that a much more powerful CPU, with considerably greater memory, is now available to run user applications in connection with the software12.

Referring further toFIG. 1, RSPU14ain this example has 96 serial ports total available for use, while RSPU14bhas been configured with 80 serial ports total, and RSPU14chas been configured with 56 ports total. As will be explained in the following paragraphs, another significant advantage is that the RSPUs14a-14care readily scalable and re-configurable by the use of hot swappable serial port modules. This makes the RSPUs14readily adaptable to the changing needs in a data center. However, it will be appreciated that the RSPUs14a-14cdo not need to be configured as hot swappable modules, although it is anticipated that having hot swappable capability is likely to be considered an especially convenient feature for many users.

Referring toFIGS. 2 and 3, one configuration of RSPU14ais shown. The RSPU14ahas a housing20with a rear panel20ashown inFIG. 2, and a front panel20bshown inFIG. 3. InFIG. 2the rear panel20aincludes two independent, hot-swappable power supply modules22, a first hot-swappable RJ-45 serial port module24having 16 RJ-45 ports24a, a second hot-swappable RJ-45 serial port module26having 16 RJ-45 ports26a, and a hot-swappable USB serial port module28having 16 USB serial ports28a. A sensor port30may be included for connecting an external sensor (e.g., temperature, humidity, air flow, etc.), and an Ethernet port32for coupling the RSPU14adirectly to the management server16, to a network router or to one of the network switches15. The front panel20bof RSPU14ain this example includes a third hot-swappable, RJ-45 serial port module34with 16 RJ-45 ports34a, a fourth hot-swappable RJ-45 serial port module36with 16 RJ-45 ports36a, and a second hot-swappable USB serial port module38with 16 USB ports38a. Thus, RSPU14ain this example has a total of 64 RJ-45 serial ports available for use and a total of 32 USB serial ports available for use. The form factor of the housing20in this example is a “1-U” form factor enabling the RSPU14ato be supported in 1 RU of a standard computer equipment rack. However, it will be appreciated that the RSPUs14may be configured with other form factors, and thus the RSPUs are not limited to any specific form factor.

It will also be appreciated that the RJ-45 serial port modules24,26,34and36are all identical in construction, while the USB serial port modules28and38are identical in construction. This enables easy hot swapping of all of the RJ-45 serial port modules24,26,34and36, as well as the USB serial port modules28and38. This also produces a fully modular construction for the RSPU14a, with different combinations of RJ-45 and USB serial port modules being selectable by the user to meet the expanding/changing needs of a data center.

Referring toFIG. 4, RSPU14is shown with a slightly different serial port module configuration and has been denoted with reference number14a′. Power supply modules22in this example are both included, as are sensor port30and Ethernet port32, but instead of using 16 port serial port modules, six independent 8 port serial port modules are used. Thus, 8 port RJ-45 serial port modules40,42and44are used, while 8 port USB serial port modules46,48and50are used.

FIG. 5shows a more detailed illustration of one of the 16 port RJ-45 serial port modules24fromFIG. 2. In this example the 16 port RJ-45 serial port module24includes the 16 RJ-45 ports24a(shown in simple diagrammatic form in this Figure), in addition to a USB connector24b. A plurality of integrated circuits24care used along with a processor24d. The processor24dcommunicates with the integrated circuits24cand also with the USB connector24bto help implement selection of, and communication with, specific ones of the RJ-45 ports24a. Processor24dcan be an IC device such as an FPGA with embedded CPU core and miscellaneous logic in order to simplify the hardware and minimize materials cost. Integrated circuits24may be composed of memory IC's, serial transceivers and miscellaneous logic. The USB connector24benables the entire 16 port RJ-45 serial port module24to be plugged into a backplane or motherboard, and provides data and control signals, as well as DC power, to the module24a. The USB connector24benables the module24ato be hot swappable, and thus quickly and easily installed and removed from a backplane or motherboard, and reinserted at a different location on the backplane or motherboard, or even used in a different RSPU14. However, it will be appreciated that the use of a USB backplane is not absolutely necessary; any backplane technology could be incorporated in place of the USB connection, such as a PCIE, standard data bus, etc. In fact, a backplane is not even necessary. The RSPUs14could just as easily be configured with “fixed” RJ-45 serial port modules mounted on a printed circuit assembly (PCA) mounted within the housing20. Again, however, it is expected that the modular approach using hot swappable RJ-45 modules is likely to be the most desirable configuration for most users.

FIG. 6shows a high level plan view of the 8 port RJ-45 serial port module40fromFIG. 4. The module40is similar to module24in that it includes 8 RJ-45 ports40a, a USB connector40b, a plurality of integrated circuits40cand a processor40d. The functions of the USB connector40b, the integrated circuits40cand the processor40dare identical to that described for module24.

FIG. 7shows a high level plan view of an RSPU100showing one example of how a main board102(e.g., backplane or motherboard) may be used to accommodate both 8 and 16 port serial port modules, whether they be RJ-45 port versions or USB port versions. The main board102in this example includes a plurality of 12 USB connectors1021-10212, along with a plurality of integrated circuits104and a processor106. Two independent power supplies22are also included, and the RJ-45 sensor port30is also visible in this plan view.

The RSPU100in the example configuration shown inFIG. 7includes one of the 16 port RJ-45 serial port modules24, one of the 16 port USB serial port modules38, and one of the 8 port RJ-45 serial port modules40, all connected via their USB connectors24b,38band40b, respectively, to USB connectors1028,10212and1029, respectively, of the main board102. Modules24,38and40are accessible from a back panel108of the RSPU100. From a front panel110of the RSPU100, one 16 port RJ-45 port serial module24, one 16 port USB serial port module38and one 8 port USB serial port module46are accessible and coupled via their respective USB connectors24b,38band46bwith USB connectors1021,1023and1028, respectively, on the main board102. The RSPU100thus forms an 80 port unit. This configuration leaves room for one additional 8 port serial port module (either RJ-45 or USB, such as module40or46) at location112, accessible via the back panel108and connectable via the USB connector10210. It also leaves room for one additional 8 port serial module (either RJ-45 or USB, such as module40or46), accessible from the front panel110, at location114. If an even greater number of USB connectors are provided on the main board102, then it would be possible to make use of 4 port modules as well with the RSPU100. In this example, there is physical space to and one more USB connector on the main board102to make use of a 4 port serial module (either RJ-45 or USB). FromFIG. 7, it will be appreciated that the RSPU100may be configured in wide variety of different configurations to best utilize the available serial port modules24,38,40and46and to best meet the needs of connecting to the serial console ports of the target devices.

Referring toFIG. 8, another embodiment of an RSPU200is shown in accordance with the present disclosure. The RSPU200in this example has a housing202providing a zero-U form factor, while still providing 96 total serial ports. In this example the RSPU200includes four 16 port RJ-45 serial port modules24and two 16 port USB serial port modules38. Two independent power supplies204are included which may be functionally identical to power supplies22, but modified to accommodate the zero-U form factor of the housing202. A sensor port206and an Ethernet in/out port208are also included in this example.

Still another advantage of the system10and the use of the RSPUs14is the benefit of serial port consolidation. Once consolidated, the serial ports can be split into groups of arbitrary sizes to easily accommodate the needs of cloud services hosts that rent their infrastructure by eliminating physical boundaries and facilitating dynamic access control lists. This feature may be of particular interest to very large scale datacenter operators. It also helps to eliminate the problem of trying to manage access control lists on individual remote access appliances, which is generally not a viable solution for dynamic environments where who has access to which serial port may constantly vary.

Since the software12of the system10runs on a regular server, implementing service processor management using the system10, via a remote access appliance, is not only possible but highly desirable. This opens the possibility of using the system10to help implement serial, power and cooling system management for data center IT devices and infrastructure devices. Thus, the system10may help a data center manager to implement a broad range of infrastructure management services for those IT and infrastructure devices having a serial console port.

Another advantage of the system10is that the various RSPU modules14all make use of the well-known USB communications protocol. USB is a proven and stable technology and is in presently in use with most IT and infrastructure devices. USB connectors and the USB protocol are also are ideally suited for implementing hot-swappable modules.

Still another advantage is that with the software12, as more RSPUs14are added, the newly available ports of each RSPU may automatically be presented on a graphical user interface provided by the software12. There is no need for a new version of the software12or for console server reconfiguration and/or configuration alignment.