# Patent

## Title
Universal conduction cooling platform

## Abstract

Disclosed is an embodiment of a module for insertion between a first shelf and a second shelf of a rack based processing system. The module includes a first thermal plate substantially parallel to a second thermal plate. An inner surface of the first thermal plate faces an inner surface of the second plate and an outer surface of each of the first and second thermal plates faces opposite to the respective inner surfaces. Each thermal plate is configured to thermally couple to one or more component units locatable between the inner surfaces of the first and second thermal plates.

## Background
RELATED APPLICATIONS
This application is related to application Ser. No. 12/840,871 (now U.S. Pat. No. 8,410,364), Ser Nos. 12/840,808, 12/840,857 (now U.S. Pat. No. 8,259,450, Ser. Nos. 12/840 842, and 12/840,824 (now U.S. Pat. No. 8,411,440), each filed Jul. 21, 2010, and incorporated herein by reference in its entirety.
FIELD
This application relates to embodiments pertaining to rack mounted computer system, and in particular, a conduction cooling platform.
BACKGROUND
Current standard rack configurations are measured in rack-units (RUs). For example, a blade server may have a rack unit measuring 19 inches wide and having a pitch of 1.75 inches in height. A common computer rack form-factor is 42 RU high, which is a factor in limiting the density or number of components directly mountable into a rack. Higher density component systems are desirable since they require less space per rack enclosure and ultimately less space within the building housing the enclosures. Often these buildings must include high price high maintenance false floors to accommodate the mass of cabling and the delivery of chilled air and power to the enclosures. Another factor in determining component density is the pitch of the rack unit as often limited by the space required for component heat sinks and associated cooling components (e.g., fans).
Of particular concern is the cooling of the rack's components. During operation, the electrical components produce heat, which a system must displace to ensure the proper functioning of its components. In addition to maintaining normative function, various cooling methods, such as liquid or air cooling, are used to either achieve greater processor performance (e.g., overclocking), or to reduce the noise pollution caused by typical cooling methods (e.g., cooling fans and heat sinks). A frequently underestimated problem when designing high-performance computer systems is the discrepancy between the amount of heat a system generates, particularly in high performance and high density enclosures, and the ability of its cooling system to remove the heat uniformly throughout the rack enclosure.
SUMMARY
In an example embodiment, a module for insertion between a first shelf and a second shelf of a rack based processing system is provided. The module includes a first thermal plate substantially parallel to a second thermal plate. An inner surface of the first thermal plate faces an inner surface of the second plate and an outer surface of each of the first and second thermal plates faces opposite to the respective inner surfaces. Each thermal plate is configured to thermally couple to one or more component units locatable between the inner surfaces of the first and second thermal plates.
In another example embodiment, a conduction cooling apparatus for a rack based processing system is provided. The apparatus includes a frame, a plurality of shelves, a plurality of bays and a module unit. The frame includes a module insertion area on a first side of the rack. The plurality of shelves are positioned within the frame and coupled to a coolant source. Each shelf has a first surface and a second surface and is configured to permit coolant flow between the first and second surfaces. Among the plurality of shelves, each is positioned substantially parallel to each other and substantially perpendicular to a plane of the first side of the rack. In the plurality of bays, each bay defined by a volume of space between adjacent ones of the plurality of shelves. The module unit is configured to be inserted into a bay of the plurality of bays. The module unit includes a first thermal plate substantially parallel to a second thermal plate. An inner surface of the first thermal plate faces an inner surface of the second plate and an outer surface of each of the first and second thermal plates faces opposite to the respective inner surfaces. Each thermal plate is configured to thermally couple to one or more component units locatable between the inner surfaces of each thermal plate.
In another exemplary embodiment, a method of cooling one or more component units in a frame of a rack based processing system is provided. The method includes providing coolant to a plurality of shelves coupled within the frame and cooling the one or more component units coupled to a module unit inserted between a first shelf and a second shelf. Each shelf includes a first surface and a second surface having coolant flowing therebetween. Each module unit includes a first plate substantially parallel to a second plate. Each module also includes one or more component units locatable between each parallel plate providing a thermal coupling of the one or more component units to at least one of the first shelf and the second shelf.



BRIEF DESCRIPTION OF THE DRAWINGS
The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings in which:
FIG. 1 illustrates an embodiment of a rack system including a cooled universal hardware platform;
FIG. 2 illustrates a portion of the side of the rack system and the cooled universal hardware platform, according to one embodiment;
FIG. 3 illustrates a rack system and specifically the rear portion and the open side of the rack and the cooled universal hardware platform according to an exemplary embodiment;
FIG. 4 illustrates an embodiment of a cooled partition found within the rack system;
FIG. 5 illustrates an embodiment of several cooled partitions making up the module bays as viewed outside of the rack system;
FIGS. 6 and 7 illustrate embodiments of a module fixture that includes circuit cards and components that make up a functional module in a service unit;
FIGS. 8 and 9 illustrate embodiments of the module fixture from a side view in a compressed and uncompressed state respectively;
FIGS. 10 and 11 illustrate embodiments of a module fixture for a rack power board insertable into the rack power section of the rack system according to an exemplary embodiment;
FIG. 12, which includes FIGS. 12A and 12B, shows an example of a thermal plate that includes a frame and a heat exchanger insert according to an exemplary embodiment;
FIG. 13, which includes FIGS. 13A and 13B, shows an example of a thermal plate having a frame including multiple insert receptacles for supporting a corresponding number of heat exchanger inserts according to an exemplary embodiment; and
FIG. 14 illustrates an example of using airflow for cooling according to an exemplary embodiment.



DETAILED DESCRIPTION
Although an embodiment of the present invention has been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
Embodiments of the present invention generally relate to an architecture for a scalable modular data system. In this regard, embodiments of the present invention relate to a rack system (e.g., rack system 10) that may contain a plurality of service units or modules. The rack system described herein provides physical support, power, and cooling for the service units or modules contained therein. The rack system also provides a set of interfaces for the service units or modules including mechanical, thermal, electrical, and communication protocol specifications. Moreover, the rack system described herein may be easily networked with a plurality of instances of other rack systems to create the highly scalable modular architecture referenced above.
Each service unit or, module that may be housed in the rack system provides some combination of processing, storage, and communication capacity enabling the service units to provide functional support for various computing, data processing and storage activities (e.g., as servers, storage arrays, network switches, etc.). However, embodiments of the present invention provide a mechanical structure for the rack system and the service units or modules that provides for efficient heat removal from the service units or modules in a compact design. Thus, the amount of processing capability that can be provided for a given amount of energy consumption may be increased.
FIG. 1 illustrates an embodiment of a rack system 10. Rack system 10 includes a rack power section 19 and a universal hardware platform 21. The universal hardware platform 21 includes a universal backplane mounting area 14. The rack system 10 has a perimeter frame 12 having a height ‘H’ width ‘W’ and depth ‘D.’ In one embodiment, the perimeter frame 12 includes structural members around the perimeter of the rack system 10 and is otherwise open on each vertical face. In other embodiments some or all of the rack's faces or planes may be enclosed, as illustrated by rack top 16.
The front side of the rack, rack front 18, may include a multitude of cooled partitions substantially parallel to each other and at various pitches, such as pitch 22 (P), where the pitch may be equal to the distance between the first surface of one cooled partition to the second surface of an adjacent cooled partition. The area or volume between each partition defines a module bay, such as module bay 24 or module bay 26. Each module bay may have a different size based on their respective pitches, such as pitch 22 corresponding to module bay 26 and pitch 23 corresponding to module bay 24. It can be appreciated that the pitch may be determined any number of ways, such as between the mid lines of each partition or between the inner surfaces of two consecutive partitions. In one embodiment, the pitch 22 is a standard unit of height, such as 0.75 inches, and variations of the pitch, such as pitch 23, may be a multiple of the pitch 23. For example, pitch 23 is two times the pitch 22, where pitch 22 is the minimum pitch based on module or other design constraints.
The rack system 10, and specifically the universal hardware platform 21, may be configured to include a multitude of service units. Each service unit may provide a combination of data processing capacity, data storage capacity, and data communication capacity. In one embodiment the rack system 10 provides physical support, power, and cooling for each service unit that it contains. A service unit and its corresponding service unit backplane correspond to a rack unit model. The rack unit model defines a set of interfaces for the service unit, which include mechanical, thermal, electrical, and communication-protocol specifications. Thus, any service unit that conforms to the interfaces defined by a particular rack unit model may be installed and operated in a rack system that includes the corresponding service unit backplane. For example, the service unit backplane mounts vertically to the universal backplane mounting area 14 and provides the connections according to the rack unit model for all of the modules that perform the functions of the service unit.
Cluster unit 28 is an example of a service unit configured to provide processing and switching functions to sixteen data nodes. In this embodiment, the cluster unit 28 spans over three module bays, module bays 30, and includes eight processing modules and a cluster switch. Specifically, the cluster unit 28 includes the four processing modules 32 (PM1-PM4) in the first module bay, a cluster switch 34 (CS1) in the second module bay, and the remaining processing modules 36 (PM5-PM8) in the third module bay.
Each of these modules may slide into their respective slots with the module bay and connect into a service unit backplane, such as cluster unit backplane 38. The cluster unit backplane 38 may be fastened to the perimeter frame 12 in the universal backplane mounting area 14. The combination of the cluster switch 34 and the cluster unit backplane 38 in this embodiment has the advantage of signal symmetry, where the signal paths of the processing modules 32 and 36 are equidistant to the cluster switch 34.
In one embodiment, the cluster switch 34 has 8 network lines exiting out of the front of the cluster switch 34 at a forty-five degree angle toward each side of the rack front 18, see for example network lines 37. For simplicity, only one cluster switch (e.g., cluster switch 34) is shown, however it can be appreciated that a multitude of cluster switches may be included in the rack system 10. Thus, the network lines for every installed cluster switch may run up the perimeter frame 12 and exit the rack top 16 in a bundle, as illustrated by net 52.
In various embodiments, some or all of the service units, such as the cluster unit 28 including the processing modules 32 and the cluster switch 34, are an upward-compatible enhancement of mainstream industry-standard high performance computing (HPC)-cluster architecture, with x86—64 instruction set architecture (ISA) and standard Infiniband networking interconnects. This enables one hundred percent compatibility with existing system and application software used in mainstream HPC cluster systems and is immediately useful to end-users upon product introduction, without extensive software development or porting. Thus, implementation of these embodiments includes using commercial off the shelf (COTS) hardware and firmware whenever possible, and does not include any chip development or require the development of complex system and application software. As a result, these embodiments dramatically reduce the complexity and risk of the development effort, improve energy efficiency, and provide a platform to enable application development for concurrency between simulation and visualization computing to thereby reducing data-movement bottlenecks. The efficiency of the architecture of the embodiments applies equally to all classes of scalable computing facilities, including traditional enterprise-datacenter server farms, cloud/utility computing installations, and HPC clusters. This broad applicability maximizes the ability for significant improvements in energy and environmental efficiency of computing infrastructures. However, it should be noted that custom circuit and chip designs could also be used in the disclosed rack system design, but would not likely be as cost effective as using COTS components.
Returning to the discussion of FIG. 1, the cluster unit backplane 38 may be a single circuit board with connectors corresponding to their counterpart connectors on each module of the cluster unit 28, and the cluster unit backplane 38 may have a height of approximately the height of the (three) module bays 30. In other embodiments, the cluster unit backplane 38 may be composed of two or more circuit boards with corresponding connectors, or the cluster unit backplane 38 may be single circuit board that supports two or more cluster units (e.g., cluster unit 28) over a multitude of module bays.
The optional rack power section 19 of the rack system 10 may include rack power and management unit 40 composed of two rack management modules 44 and a plurality of rack power modules 46 (e.g., RP01-RP16). In another embodiment, the rack management modules 44 and a corresponding rack management backplane (not shown) may be independent of the rack power unit 40 and may be included in the universal hardware platform 21. In one embodiment, there may be two modules per module bay, such as the two rack power modules in module bay 24 and the two rack management modules 44 in module bay 26.
The rack management modules 44 may provide network connectivity to every module installed in the rack system 10. This includes every module installed in the universal hardware platform 21 and every module of the rack power section 19. Management cabling 45 provides connectivity from the rack management modules 44 to devices external to the rack system 10, such as networked workstation or control panel (not shown). This connectivity may provide valuable diagnostic and failure data from the rack system 10 and in some embodiments provide an ability to control various service units and modules within the rack system 10.
As with the backplane boards of the universal hardware platform 21, the back plane area corresponding to the rack power section 19 may be utilized to fasten one or more backplane boards. In one embodiment, a rack power and management backplane 42 is a single backplane board with connectors corresponding to their counterpart connectors on each of the rack management modules 44 and the rack power modules 46 of the rack power and management unit 40. The rack power and management backplane 42 may then have a height of approximately the height of the collective module bays corresponding to the rack power and management unit 40. In other embodiments, the rack power and management backplane 42 may be composed of two or more circuit boards with corresponding connectors.
In one embodiment, the rack power modules 46 are connected to the power inlet 48 (See e.g., FIGS. 2 and 3), which may be configured to receive three-phase alternating current (AC) power from a source external to the rack system 10. The rack power modules 46 convert the three-phase AC into direct current (DC). For example, the rack power modules 46 may convert a 480 volt three-phase AC input to 380 volt DC for distribution in the rack system 10. In one embodiment, the DC voltage from the rack power modules 46 is connected to power bus 67 (See e.g., FIGS. 2 and 3) running down from the rack power and management backplane 42 to other service unit backplanes, such as the cluster unit backplane 38.
The rack system 10 may include a coolant system having a coolant inlet 49 and coolant outlet 50. The coolant inlet 49 and the coolant outlet 50 are connected to piping running down through each partition's coolant distribution nodes (e.g., coolant distribution node 54) to provide the coolant into and out of the cooled partitions. For example, coolant (refrigerant R-134a) flows into the coolant inlet 49, through a set of vertically spaced, 0.1 inch thick horizontal cooled partitions (discussed below with reference to FIGS. 3 and 4) and out of the coolant outlet 50. The coolant may be provided, for example, from a building chiller unit. As discussed above, the space between each pair of adjacent cooled partitions is a module bay. Waste heat is transferred via conduction, first from the components within each module (e.g., processing modules 32) to the module's top and bottom surfaces, and then to the cooled partitions at the top and bottom of the module bay (e.g., module bays 30). Other coolant distribution methods and hardware may also be used without departing from the scope of the embodiments disclosed herein.
Thus, embodiments of the rack system 10 including one or all of the compact features based on modularity, cooling, power, pitch height, processing, storage and networking provide, among others, energy efficiency in system manufacturing, energy efficiency in system operation, cost efficiency in system manufacturing and installation, cost efficiency in system maintenance, space efficiency of system installations, and environmental impact efficiency throughout the system lifecycle.
FIG. 2 illustrates a portion of the side of the rack system 10, according to one embodiment. FIG. 2 shows the rack power section 19 and the universal hardware platform 21 as seen form an open side and rear perspective of the rack system 10. The three module bays of the module bays 30 are made up of four cooled partitions, cooled partitions 201, 202, 203, and 204. Each module bay includes two partitions, in this embodiment an upper and a lower partition. For example, module bay 65 is the middle module bay of the three module bays, module bays 30, and has cooled partition 202 as the lower cooled partition and 203 as the upper cooled partition. As will be discussed in further detail below, functional modules may be inserted into module bays, such as module bay 65, and thermally couple to the cooled partitions to cool the modules during operation.
The coolant distribution node 54 is illustrated on cooled partition 204, and in this embodiment, is connected to the coolant distribution nodes of other cooled partitions throughout the rack via coolant pipe 61 running up the height of the rack and to the coolant outlet 50. Similarly, coolant pipe 63 (See e.g., FIG. 5) is connected to the opposite end of each of the cooled partitions at a second coolant distribution node and the coolant inlet 49.
The perimeter frame 12 of the rack system 10 may include a backplane mounting surface 62 where the service unit backplanes are attached to the perimeter frame 12, such as the cluster unit backplanes 38 and 43 of the universal hardware platform 21, and the rack power and management backplane 42 of the rack power section 19. In various embodiments, the backplane mounting surface 62 may include mounting structures that conform to a multiple of a standard pitch size (P), such as pitch 22 shown in FIG. 1. The mounting structures on the surface of the service unit backplanes as well as the backplanes themselves may be configured to also conform with the standard pitch size. For example, the cluster unit backplane 38 may have a height of approximately the height of module bays 30 corresponding to a pitch of 3 P, and accordingly the structures of the backplane mounting surface 62 are configured to align with the mounting structures of the cluster unit backplane 38.
In various embodiments, the mounting structures for the backplane mounting surface 62 and the service units (e.g., cluster unit 28) may be magnetic, rails, indentations, protrusions, bolts, screws, or uniformly distributed holes that may be threaded or configured for a fastener (e.g., bolt, pin, etc.) to slide through, attach or snap into. Embodiments incorporating the mounting structures set to a multiple of the pitch size have the flexibility to include a multitude of backplanes corresponding to various functional types of service units that may be installed into the module bays of the universal hardware platform 21 of the rack system 10.
When mounted, the service unit backplanes provide a platform for the connectors of the modules (e.g., processing modules 36 of service unit 28) to couple with connectors of the service unit backplane, such as the connectors 64 and 66 of the cluster unit backplane 38 and the connectors associated with the modules of cluster unit 28 described above. The connectors are not limited to any type and may be, for example, an edge connector, pin connector, optical connector, or any connector type or equivalent in the art. Because multiple modules may be installed into a single module bay, the cooled partitions may include removable, adjustable or permanently fixed guides (e.g., flat brackets or rails) to assist with the proper alignment of the modules with the connectors of the backplane upon module insertion. In another embodiment, a module and backplane may include a guide pin and corresponding hole (not shown), respectively, to assist in module alignment.
FIG. 3 is an embodiment of rack system 10 illustrating the rear portion and the open side of the rack. As shown, FIG. 3 only represents a portion of the entire rack system 10, and specifically, only portions of the rack power section 19 and the universal hardware platform 21. This embodiment illustrates the power inlet 48 coupled to a power bus 67 via the rack power and management backplane 42, which as previously mentioned may convert AC power from the power inlet 48 to DC power for distribution to the service units via the service unit backplanes of the universal hardware platform 21.
In one embodiment, the power bus 67 includes two solid conductors; a negative or ground lead and a positive voltage lead connected to the rack power and management backplane 42 as shown. The power bus 67 may be rigidly fixed to the rack power and management backplane 42 or may only make electrical connection but be rigidly fixed to the backplanes as needed, such as the cluster unit backplanes 38 and 43. In another embodiment where DC power is supplied directly to the power inlet 48, the power bus 67 may be insulated and rigidly fixed to the rack system 10. Regardless of the embodiment, the power bus 67 is configured to provide power to any functional type of backplane mounted in the universal hardware platform 21. The conductors of the power bus 67 may be electrically connected to the service unit backplanes by various connector types. For example, the power bus 67 may be a metallic bar which may connect to each backplane using a bolt and a clamp, such as a D-clamp.
FIG. 3 also illustrates another view of the cooled partitions of the rack system 10. This embodiment shows the coolant distribution node 54 that is part of the cooled partitions shown, such as the cooled partitions 201, 202, 203, and 204 of module bays 30, and also shows a side view of the middle module bay, module bay 65. As discussed above, the coolant distribution node 54 may be connected to the coolant distribution nodes of the other cooled partitions via coolant pipes 61 and 63 (see e.g., FIGS. 2 and 5) running up the rack and to the coolant inlet 49 and the coolant outlet 50.
FIG. 4 is an embodiment of a cooled partition 59. The cooled partition 59 includes coolant distribution nodes 541 and 542, which are connected to the coolant inlet 49 and the coolant outlet 50, respectively. The cooled partition 59 internally includes channels (not shown) that facilitate coolant flow between each coolant distribution node 541 and 542 to cool each side of the cooled partition 59. The internal channels may be configured in any suitable way known in the art, such as a maze of veins composed of flattened tubing, etc. The coolant distribution nodes 541 and 542 may include additional structures to limit or equalize the rate and distribution of coolant flow along the each axis of the coolant distribution node and through the cooled partition. Additionally, the coolant inlet 49 and the coolant outlet 50 may be caddy-corner or diagonal to each other depending on the rack design and the channel design through the cooled partition 59.
In another embodiment, the cooled partition 59 may be divided into two portions, partition portion 55 and partition portion 57. Partition portion 57 includes existing coolant inlet 49 and coolant outlet 50. However, the partition portion 55 includes its own coolant outlet 51 and coolant inlet 53. The partition portions 55 and 57 may be independent of each other and have their own coolant flow from inlet to outlet. For example, the coolant flow may enter into coolant inlet 49 of partition portion 57, work its way through cooling channels and out o the coolant outlet 50. Similarly, coolant flow may enter coolant inlet 53 of partition portion 55, through its internal cooling channels and out of coolant outlet 51. In another embodiment, the coolant inlet 49 and the coolant inlet 53 may be on the same side of the partition portion 55 and the partition portion 57, respectively. Having the coolant inlets and outlets on opposite corners may have beneficial cooling characteristics in having a more balanced heat dissipation throughout the cooled partition 59.
In another embodiment, the partition portions 55 and 57 are connected such that coolant may flow from one partition portion to the next either through one or both of the coolant distribution nodes 541 and 542 and through each partition portions' cooling channels. In this embodiment, based on known coolant flow characteristics, it may be more beneficial to have the coolant inlet 49 and the coolant inlet 53 on the same side of the partition portion 55 and the partition portion 57, and similarly the outlets 50 and 51 on the side of the partition portions 55 and 57.
FIG. 5 is an embodiment of the cooled partitions 201, 202, 203, and 204 of module bays 30 outside of the rack system 10 and provides another illustration of the module bay 65. Each cooled partition may have the same functionality as described in FIG. 4 with respect to cooled partition 59. Each cooled partition is physically connected by the coolant pipe 61 and the coolant pipe 63, which provide system wide coolant flow between all cooled partitions within the rack system 10. As with the cooling partition 59 of FIG. 4, in another embodiment the cooled partitions 201, 202, 203, and 204 may have an additional coolant outlet 51 and coolant inlet 53 and associated piping similar to coolant pipes 61 and 63. In other embodiments, the configuration of the inlets and outlets may vary depending on the desired coolant flow design. For example, the two inlets may be on opposite diagonal corners or on the same side depending on the embodiment designed to, such as including partition portions, etc., as discussed above with reference to FIG. 4.
In one embodiment, the bottom and top surfaces of the cooled partitions 201, 202, 203, and 204 are heat conductive surfaces. Because coolant flows between these surfaces they are suited to conduct heat away from any fixture or apparatus placed in proximity to or in contact with either the top or bottom surface of the cooled partitions, such as the surfaces of cooled partitions 202 and 203 of module bay 65. In various embodiments, the heat conductive surfaces may be composed of many heat conductive materials known in the art, such as aluminum alloy, copper, etc. In another embodiment, the heat conductive surfaces may be a mixture of heat conducting materials and insulators, which may be specifically configured to concentrate the conductive cooling to specific areas of the apparatus near or in proximity to the heat conductive surface.
FIGS. 6 and 7 are each embodiments of a module fixture 70 that may include circuit cards and components that make up a functional module in a service unit, such as the four processing modules 32 insertable into the module bay 65 as discussed with reference to FIGS. 1, 2, and 5. The module fixture 70 includes thermal plates 71 and 72, fasteners 73, tensioners 741 and 742, component 75, connector 76, connector 77, and component boards 78 and 79.
In one embodiment, the component boards 78 and 79 are a multi-layered printed circuit board (PCB) and are configured to include connectors, nodes and components, such as component 75, to form a functional circuit. In various embodiments, the component board 78 and the component board 79 may have the same or different layouts and functionality. The component boards 78 and 79 may include the connector 77 and the connector 76, respectively, to provide input and output via a connection to the backplane (e.g., cluster unit backplane 38) through pins or other connector types known in the art. Component 75 is merely an example component and it can be appreciated that a component board may include many various size, shape, and functional components that still may receive the unique benefits of the cooling, networking, power and form factor of the rack system 10.
The component board 78 may be mounted to the thermal plate 71 using fasteners 73 and, as discussed below, will be in thermal contact with at least one and preferably two cooled partitions when installed into the rack system 10. In one embodiment, the fasteners 73 have a built in standoff that permits the boards' components (e.g., component 75) to be in close enough proximity to the thermal plate 71 to create a thermal coupling between the component 75 and at least a partial thermal coupling to the component board 78. In one embodiment the component board 79 is opposite to and facing the component board 78 and may be mounted and thermally coupled to the thermal plate 72 in a similar fashion as component board 78 to thermal plate 71.
Because of the thermal coupling of the thermal plates 71 and 72—which are cooled by the cooling partitions of the rack system 10—and the components of the attached boards, (e.g., component board 78 and component 75) there is no need to attach a heat-dissipating component, such as a heat sink, to the components. This allows the module fixture 70 to have a low profile permitting a higher density or number of module fixtures, components, and functionality in a single rack system, such as the rack system 10 and in particular the portion that is the universal hardware platform 21.
In another embodiment, if a component height is sufficiently higher than another component mounted on the same component board, the lower height component may not have a sufficient thermal coupling to the thermal plate for proper cooling. In this case, the lower height component may include a heat-dissipating component 802 (as shown in FIG. 8) to ensure an adequate thermal coupling to the thermal plate.
In one embodiment, the thermal coupling of the thermal plates 71 and 72 of the module fixture 70 is based on direct contact of each thermal plate to their respective cooled partitions, such as the module bay 65 which include cooled partitions 203 and 204 shown in FIGS. 2, 3, and 5 above. To facilitate the direct contact, thermal plates 71 and 72 may each connect to an end of a tensioning device, such as tensioners 741 and 742. In one embodiment, the tensioners are positioned on each side and near the edges of the thermal plates 71 and 72. For example, tensioners 741 and 742 may be springs in an uncompressed state resulting in a module fixture height h1, as shown in FIG. 6, where h1 is larger than the height of the module bay 65 including cooled partitions 203 and 204.
FIG. 7 illustrates the module fixture 70 when the thermal plates 71 and 72 are compressed towards each other to a height of h2, where h2 is less than or equal to the height or distance between the cooled partitions 203 and 204 of the module bay 65. Thus, when the module fixture is inserted into the module bay 65 there is an outward force 80 and an outward force 81 created by the compressed tensioners 741 and 742. These outward forces provide a physical and thermal contact between the cooled partitions 203 and 204 and the thermal plates 71 and 72. As coolant flows through each partition, as described with respect to FIG. 5, it conductively cools the boards and components of the module fixture 70.
The tensioners 741 and 742 may be of any type of spring or material that provides a force creating contact between the thermal plates and the cooling partitions. The tensioners 741 and 742 may be located anywhere between the thermal plates 71 and 72, including the corners, the edges or the middle, and have no limit on how much they may compress or uncompress. For example, the difference between h1 and h2 may be as small as a few millimeters or as large as several centimeters. In other embodiments, the tensioners 741 and 742 may pass through the mounted component boards or be between and couple to the component boards or any combination thereof. The tensioners may be affixed to the thermal plates or boards by any fastening hardware, such as screws, pins, clips, etc.
FIGS. 8 and 9 are embodiments of the module fixture 70 from a side view in a compressed and uncompressed state respectively. As shown in FIGS. 6 and 7 the connectors 76 and 77 do not overlap, and in this embodiment, are on different sides as seen from the back plane view. FIGS. 8 and 9 further illustrate the connectors 76 and 77 extend out from the edge of the thermal plates 71 and 72 such that they may overlap the thermal plates when the module fixture 70 is compressed down to the height of h2. For example, the connector 76 of the bottom component board 79, when compressed, is relatively flush with the thermal plate 71 on top and the connector 77 of the top component board 78 is relatively flush with the thermal plate 72 on the bottom. In this particular embodiment, the connectors 76 and 77 will determine the minimum h2, or in other words how much the fixture 70 may be compressed. The smaller the fixture 70 may be compressed the smaller the pitch (P) may be between cooling partitions and the higher the density of functional components per rack system, and specifically the universal hardware platform 21 portion of the rack system 10.
FIGS. 10 and 11 are each embodiments of a module fixture 89 for a rack power board insertable into the rack power section 19 of the rack system 10. The module fixture 89 includes a thermal plates 87 and 88, fasteners 83, tensioners 841 and 842, component 85, connector 86, and component board 82.
Thus, in a similar way as described above with respect to the module fixture 70 in FIGS. 6 and 7, when the module fixture is inserted into a module bay in the rack power section 19 there is an outward force 90 and an outward force 91 created by the compressed tensioners 841 and 842. These outward forces provide a physical and thermal contact between the cooled partitions of the rack power section 19 and the thermal plates 87 and 88. Therefore, the component board 82 and components (e.g., component 85) of the module fixture 89 are conductively cooled as coolant flows through the relevant cooled partitions.
In some embodiments, such as those shown in FIGS. 6 to 11, the thermal plates (e.g., thermal plates 71 and 72 and thermal plates 87 and 88) may be comprised of unitary structures made from heat conducting materials (e.g., aluminum alloys, copper, etc.). However, in some alternative embodiments, thermal plates may be provided from a combination of components. In this regard, for example, some embodiments may provide thermal plates that include a frame and a heat exchanger coupled to the frame. FIG. 12, which includes FIGS. 12A and 12B, shows an example of a thermal plate 100 that includes a frame 102 and a heat exchanger insert 104.
FIG. 12A illustrates a top view of the thermal plate 100. Meanwhile, FIG. 12B illustrates a cross section of the thermal plate 100 taken along line 106-106′. The frame 102 may be constructed to extend around the perimeter of the heat exchanger insert 104 to provide a support platform 108 to support edges of the heat exchanger insert 104, while enabling a large portion of the surface area of the heat exchanger insert 104 to come into contact with a cooling shelf 110 of a cooling partition (e.g., cooling partition 59) to facilitate heat transfer. In some embodiments, although the frame 102 may be rigidly constructed, the heat exchanger insert 104 may be made from a flexible material such that the heat exchanger insert 104 may be bowed outward with respect to an inner side of the thermal plate 100, which may be proximate to components of a module fixture (e.g., components of a component unit including a component board upon which components are mounted). The heat exchanger insert 104 may be any material or structure that is conducive to conducting heat in an efficient manner. Thus, for example, in some cases, the heat exchanger insert 104 may be embodied as a flat heat pipe.
The bowing, which is illustrated in FIG. 12B, may provide a contact bias between an outer surface of the thermal plate 100 and the cooling shelf 110. The contact bias may enable a majority of the heat exchanger insert 104 to be in contact with the cooling shelf 110 to increase heat transfer away from components of the module fixture for removal via thermal coupling with the cooling shelf 110. In some embodiments, a thermal conducting filler material may be placed between components of the module fixture and the heat exchanger insert 104 to further facilitate heat transfer away from the components. Moreover, whether a component side or non-component side of the component board of the component unit is proximate to the heat exchanger insert 104, the heat exchanger insert 104 may efficiently remove heat from the component unit.
Although the thermal plate 100 of FIG. 12 includes a single heat exchanger insert 104, multiple heat exchanger inserts may be provided in alternative embodiments. FIG. 13, which includes FIGS. 13A and 13B, shows an example of a thermal plate 120 having a frame 122 including multiple insert receptacles for supporting a corresponding number of heat exchanger inserts 124 to illustrate such an alternative embodiment. The multiple insert receptacles may take the form substantially of a window frame structure where each of the “window panes” correspond to heat exchanger inserts 124. In this regard, FIG. 13A illustrates a top view of the thermal plate 120. Meanwhile, FIG. 13B illustrates a cross section of the thermal plate 120 taken along line 126-126′. The frame 122 may be constructed such that the insert receptacles extend around the perimeter of each respective one the heat exchanger inserts 124 to provide a support platform 128 to support edges of the heat exchanger inserts 124, while enabling a large portion of the surface area of the heat exchanger inserts 124 to come into contact with a cooling shelf 130 of a cooling partition (e.g., cooling partition 59) to facilitate heat transfer.
Similar to the embodiment above, the frame 122 may be rigidly constructed and the heat exchanger inserts 124 may be made from a flexible material such that the heat exchanger inserts 124 may be bowed outward with respect to an inner side of the thermal plate 120. The inner side of the thermal plate 120 may be proximate to components of a module fixture and may be thermally coupled to the components via a thermal conducting filler as described above. However, in some embodiments, the components may be mounted to the frame 122 and heat may be passed from the frame to the heat exchanger inserts 124 so that the heat exchanger inserts 124 act as a heat spreader to more efficiently dissipate heat away from the components.
As shown in FIG. 13B, the bowing of the heat exchanger inserts 124 may provide a contact bias between an outer surface of the thermal plate 120 and the cooling shelf 130. The contact bias may enable a majority of the heat exchanger inserts 124 to be in contact with the cooling shelf 130 to increase heat transfer away from components of the module fixture for removal via thermal coupling with the cooling shelf 130. Moreover, whether a component side or non-component side of the component board of the component unit is proximate to the heat exchanger inserts 124, the heat exchanger inserts 124 may efficiently remove heat from the component unit.
In an exemplary embodiment the module fixture 89 of FIGS. 10 and 11 or the module fixture 70 of FIGS. 6 to 10 may be inserted into one of the bays (e.g., module bay 65) of FIG. 5. The tensioners (e.g., tensioners 841 and 842 of FIGS. 10 and 11 or tensioners 741 and 742 of FIGS. 6 to 10, respectively) may bias thermal plates associated with each respective module fixture outward to initiate contact between the corresponding thermal plates and the corresponding sides of each cooled partition (e.g., cooled partition 59) of the bays. The cooling provided to the cooled partition 59 may be provided by virtue of passing coolant (e.g., a refrigerant, water, and/or the like) from the coolant inlet 49 to the coolant outlet 50. However, in an alternative embodiment, airflow may be allowed to pass (or forced) through the bays as is shown in FIG. 14.
In any case, some exemplary embodiments may provide for mechanisms by which to provide efficient heat removal from module fixtures in a rack system capable of supporting a plurality of processing components. Accordingly, a relatively large capacity for reliable computing may be provided and supported in a relatively small area due to the ability to efficiently cool the electrical components within the rack system.
Although an embodiment of the present invention has been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
The Abstract of the Disclosure is provided to comply with 37 C.F.R. §1.72(b), requiring an abstract that will allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate embodiment.

## Claims

1. A module for insertion between a first shelf and a second shelf of a rack based processing system, the module comprising: a first thermal plate substantially parallel to a second thermal plate, an inner surface of the first thermal plate facing an inner surface of the second plate and an outer surface of each of the first and second thermal plates facing opposite to the respective inner surfaces; the first thermal plate thermally coupled to a first component unit located between the inner surfaces of the first and second thermal plates; the second thermal plate thermally coupled to a second component unit located between the inner surfaces of the first and second thermal plates; and the first component unit and the second component unit each including a component board and one or more components; wherein the module comprises one or more tensioning units directly mechanically coupled to the first and second component units and located between the first and second thermal plates, the one or more tensioning units configured to generate a bias that urges the first thermal plate away from the second thermal plate, wherein the one or more tensioning units are springs.

2. The module of claim 1, wherein the first component unit is mounted to the inner surface of the first thermal plate.

3. The module of claim 1, wherein the first component unit has a component side and a non-component side, and the inner surface of the first thermal plate is thermally coupled to the component side of the first component unit.

4. The module of claim 3, wherein the component side of the first component unit includes a heat transfer device configured to transfer heat from a first component to the first thermal plate.

5. The module of claim 1, wherein, when inserted between the first shelf and the second shelf of the rack based processing system, the module is configured to transfer heat away from the first and second thermal plates via a cooling source coupled to the first shelf and the second shelf.

6. The module of claim 1, wherein a distance between the first thermal plate and the second thermal plate is variable.

7. The module of claim 1, wherein at least one of the first and second thermal plates comprises a frame and a heat exchanger coupled to the frame.

8. The module of claim 7, wherein the frame comprises multiple insert receptacles, each of which is configured to receive a corresponding one of a plurality of heat exchanger inserts.

9. The module of claim 7, wherein the heat exchanger comprises a flat heat pipe.

10. The module of claim 7, wherein the frame is rigid and the heat exchanger is flexible.

11. The module of claim 1, including a thermal conducting filler between the first component unit and the inner surface of the first thermal plate.

12. A module for insertion between a first shelf and a second shelf of a rack based processing system, the module comprising:
a first thermal plate substantially parallel to a second thermal plate, an inner surface of the first thermal plate facing an inner surface of the second plate and an outer surface of each of the first and second thermal plates facing opposite to the respective inner surfaces;
each thermal plate configured to thermally couple to one or more component units locatable between the inner surfaces of the first and second thermal plates; and wherein:
at least one of the first and second thermal plates comprises a frame and a heat exchanger coupled to the frame;
the frame is rigid and the heat exchanger is flexible;
the flexible heat exchanger is configured to bow such that the outer surface of the first and the second thermal plates are bowed outward with respect to the inner surface; and
outwardly bowed surfaces of each thermal plate when inserted between the first shelf and the second shelf of the rack based processing system provide a contact bias between the outer surface of each thermal plate and a corresponding one of the first shelf and the second shelf and provide thermal coupling between the flexible heat exchanger and at least one of the component units.

13. A conduction cooling apparatus for a rack based processing system, the apparatus comprising: a frame including a module insertion area on a first side of the rack; a plurality of shelves within the frame and coupled to a coolant source, each shelf having a first surface and a second surface and configured to permit coolant flow between the first and second surfaces, the plurality of shelves being positioned substantially parallel to each other and substantially perpendicular to a plane of the first side of the rack; a plurality of bays, each bay defined by a volume of space between adjacent ones of the plurality of shelves; and a module unit inserted into a bay of the plurality of bays, the module unit including: a first thermal plate substantially parallel to a second thermal plate, an inner surface of the first thermal plate facing an inner surface of the second plate and an outer surface of each of the first and second thermal plates facing opposite to the respective inner surfaces; each thermal plate thermally coupled to a component unit located between the inner surfaces of each thermal plate; wherein each component unit includes a component board and one or more components; the first thermal plate thermally coupled to a first shelf that defines the bay; and the second thermal plate thermally coupled to a second shelf that defines the bay, the module unit further comprising one or more tensioning units directly mechanically coupled to a respective component unit and located between the first and second thermal plates, the one or more tensioning units configured to generate a bias that urges the first thermal plate away from the second thermal plate.

14. The apparatus of claim 13, wherein a first component unit has a component side and a non-component side, and the inner surface of the first thermal plate is thermally coupled to the component side of the first component unit.

15. The apparatus of claim 13, wherein at least one of the first and second thermal plates comprises a frame and a heat exchanger coupled to the frame.

16. The apparatus of claim 15, wherein the frame is rigid and the heat exchanger is flexible.

17. A method of cooling one or more component units in a frame of a rack based processing system, the method comprising: providing coolant to a plurality of shelves coupled within the frame, wherein each shelf includes a first surface and a second surface, the coolant flowing between the first and the second surfaces; and cooling the one or more component units of a module unit inserted between a first shelf and a second shelf, wherein: each component unit includes a component board and one or more components; each module unit further includes a first plate substantially parallel to a second plate; the one or more component units are located between each parallel plate providing a thermal coupling of the one or more component units to at least one of the first shelf and the second shelf; and the first plate and the second plate are separated by a distance h and the distance h between the first plate and the second plate is configured to be adjustable.

18. The method of claim 17, including connecting the rack based processing system to a building chiller unit to provide the coolant.