Source: https://patents.google.com/patent/US8886985B2/en
Timestamp: 2019-09-23 08:13:15
Document Index: 781478059

Matched Legal Cases: ['Application No. 2008359227', 'Application No. 200980149075', 'application No. 200980142324', 'Application No. 200880129788', 'Application No. 200880129788', 'Application No. 200980142324', 'application No. 200880131103', 'application No. 2011', 'application No. 09822648', 'application No. 09716608', 'application No. 2011']

US8886985B2 - Automatic discovery of physical connectivity between power outlets and IT equipment - Google Patents
Automatic discovery of physical connectivity between power outlets and IT equipment Download PDF
US8886985B2
US8886985B2 US12/168,504 US16850408A US8886985B2 US 8886985 B2 US8886985 B2 US 8886985B2 US 16850408 A US16850408 A US 16850408A US 8886985 B2 US8886985 B2 US 8886985B2
US12/168,504
US20100005331A1 (en
2008-07-07 Application filed by Raritan Americas Inc filed Critical Raritan Americas Inc
2008-07-08 Assigned to RARITAN AMERICAS, INC. reassignment RARITAN AMERICAS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: YANG, ALLEN, SOMASUNDARAM, SIVA
2010-01-07 Publication of US20100005331A1 publication Critical patent/US20100005331A1/en
2012-09-10 Assigned to RARITAN AMERICAS, INC., RARITAN, INC., RIIP, INC. reassignment RARITAN AMERICAS, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: WELLS FARGO BANK, NATIONAL ASSOCIATION
2014-11-11 Publication of US8886985B2 publication Critical patent/US8886985B2/en
2015-10-08 Assigned to RIIP, INC., RARITAN TECHNOLOGIES, INC.,, RARITAN INC, RARITAN AMERICAS, INC., reassignment RIIP, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: PNC BANK NATIONAL ASSOCIATION
This application relates to U.S. patent application Ser. No. 12/112,435, entitled, “System and Method for Efficient Association of a Power Outlet and Device,” filed on Apr. 30, 2008, now U.S. Pat. No. 8,713,342 issued on Apr. 29, 2014, and to U.S. patent application Ser. No. 12/044,530, entitled, “Environmentally Cognizant Power Management”, filed on Mar. 7, 2008, now U.S. Pat. No. 8,671,294 on Mar. 11, 2014, both of which are assigned to the same assignee and which are incorporated herein by reference.
The invention relates generally to the field of power management in data centers and more specifically to the automatic discovery of connectivity relationships between power outlets and IT equipment, and to methods of operating data centers having automatic connectivity discovery capabilities.
One intelligent power device of the above-described type is the Dominion PX Intelligent Power Distribution Unit (IPDU), developed and sold by Raritan Corp. of Somerset, N.J. The Dominion PX IPDU offers increased operational and monitoring capabilities at each of the AC power outlets included in the device. Generally, these capabilities will include the ability to turn an outlet on and off, and also provide power consumption measurements for that outlet, among other features. It is desirable for the intelligent power device or equipment monitoring the intelligent power device to know what specific equipment is at the other end of a power cable plugged into each outlet of the intelligent power device.
Further, network administrators are often required to maintain the power connectivity topology of a data center. One method for maintaining a power connectivity topology is with a spreadsheet or in a centralized configuration database, which the network administrator updates from time to time. Other data center asset management systems are also available to track the physical power connectivity relationship relying on manual input of physical connections using bar code readers and serial numbers in the nameplate. Data, once inputted, can be presented to topology rendering engines, which can present topologies as reports or as topology maps for intuitive visualization. In large data centers, which can contain thousands of servers, manually maintaining the data center power topology is a tedious and error-prone task.
Nevertheless, the importance of maintaining accurate and up-to-date power topologies is increasing in the field of network administration and management. As the cost of computing decreases, the cost of power usage by the data center becomes a cost-driver. Reducing power consumption is, therefore, an object of concern for network administrators. Likewise, recent green initiatives have provided incentive to reduce power usage in the data center. Organizations, such as Green Grid, publish data center energy efficiency metrics. Data centers measure themselves against these metrics in evaluating efficiency. All of these data center management requirements benefit from a highly accurate data center power topology.
There are known certain automatic discovery topology tools for networks. These tools like ping, tracert, and mping, disclose logical connectivity maps for networks; however, they do not provide for automatic discovery of physical connectivity between IT equipment and power outlets. At present, the only way to determine what equipment is associated with specific outlets of a power distribution device is to have that information manually entered.
A system and method according to the principles of the invention automatically discovers a physical connectivity topology for information technology (IT) equipment in a data center. The topology displays the connection between IT equipment and power outlets. A system according to the principles of the invention applies a set of heuristics to identify candidate power outlets for individual servers or other IT equipment. In one aspect, for a particular piece of equipment, the candidate outlets are selected based upon physical proximity to the IT equipment. These candidates are iteratively narrowed based upon theoretical power consumption data, actual power consumption data, CPU utilization, and correlation of state change events.
Physical location can be determined using various technologies, such as ultrasound sensing or RFID. This information can then be used to augment the physical connectivity between the server and power outlets. In a typical situation, the power consumption data as provided by the IT equipment vendors can be used to narrow candidate outlets by systematically comparing the outlets that fall within the operating range provided by the vendor. This name plate data typically exceeds the actual power consumption and may not narrow the candidate outlets to a conclusive mapping. In these cases, actual data can further narrow the candidate outlets. CPU utilization data for the servers can be collected over a time interval and quantized to reduce noise and other artifacts. Actual power consumption over the same time period is collected from candidate power outlet using an appropriate IPDU. Pattern matching between quantized CPU utilization and power consumption graphs identifies matches. Further, state changes reflected in power and CPU utilization data further narrow the candidate power outlets for given IT equipment. Quantized CPU utilization and power consumption data can also be used for these comparisons. Where heuristics narrow the candidates, but do not converge, the administrator can view utilization graphs and other data outputs to make subjective conclusions as to the best outlet candidate for a piece of IT equipment.
A system and method for providing automatic identity association between an outlet of an intelligent power distribution unit and a target device, such as a computer server, which is powered by that outlet can include a power management unit or power distribution unit which implements data collection at the power outlet. The IT equipment's power requirement profiles prescribed by the equipment vendors as well as the actual usage patterns measured over time are correlated with power consumption patterns detected on the candidate power outlets. Further correlations are made between the time sequence of certain state changes on the IT equipment, such as server turn on and off, server computing work load changes and virtual machine migration. These state changes can be detected by a monitoring system and are reflected in actual power utilization changes on the power outlets. The heuristic rules and indicators are applied iteratively until the candidate number of power outlets matches the number of power supply units on the IT equipment.
The discovery of physical connectivity topology according to the principles of the invention maintains a high degree of integrity. In addition to key indicators such as actual CPU utilization and power consumption, other indicators characteristic of the particular functionality of given IT equipment can further identify candidate power outlets. Furthermore, interfaces can be used to permit administrators to verify the power matching by actual inspection of CPU utilization and power consumption usage graphs for the IT equipment and the discovered power outlet.
FIG. 1 illustrates a system according to the principles of the invention;
FIG. 2 shows another system according to the principles of the invention;
FIG. 5 shows an exemplary graph for a single intelligent power unit over a twenty-four hour period according to the principles of the invention;
FIG. 6 shows an exemplary graph of CPU and power utilization for a single intelligent power unit over a three hour period according to the principles of the invention;
FIG. 7 shows an exemplary graph of CPU and processed view of the data for a single intelligent power unit over a three hour period according to the principles of the invention;
FIG. 9 shows an exemplary flow diagram of the auto association framework according to the principles of the invention, and
FIG. 10 shows an exemplary flow diagram of an auto association algorithm according to the principles of the invention.
FIG. 1 discloses a system 100 according to the principles of invention. The system 100 includes N racks of IT equipment, of which three racks 102, 104, 106 are illustrated, of the ye that may be typically employed in a data center. These racks can hold any number of various types of IT equipment including servers, routers, and gateways. By way of example, rack 102 illustrates two vertically mounted power strips 114, 116, each of which include eight power receptacles, and to which the power supplies of the IT equipment are physically connected. Other racks in the data center have similar power outlet units, which can be mounted in a variety of configurations.
In this exemplary system 100, these power strips are of the type that can provide power consumption data and other functionality, such as the Dominion PX IPDU provided by Raritan Corp. of Somerset, N.J. Alternatively, these units can be referred to as power distribution units or PDUs. These power distribution units provide TCP/IP access to power consumption data and outlet level switching, and can provide alerts via SNMP and email for events like exceeded threshold or once on/off power cycling. PDUs integrate with a wide variety of KVM switch solutions, such as the Dominion KX2 and Paragon II KVM switches provided by Raritan Corp. Racks 104, 106 maybe similarly equipped. PDUs are often highly configurable, and these exemplary power distribution units 114, 116 interface directly with a Power Manager 108. Power Manager 108 maybe an element management system that can configure multiple IPDUs in the electrical power distribution network. The Power Manager can also collect the IT utilization information provided by the IPDU. The exemplary Power Manager 108 maybe equipped to provide remote access to the Administrator 112 and can address power distribution units 114, 116 through Internet Protocols. The Power Manager 108 can be configured to discover and aggregate data in Database 110 which provides data for the heuristics applied according to the principles of the invention. As will be explained below, this data includes actual power consumption data, IT equipment specifications, CPU utilization data, theoretical power consumption data, and state change events on the IT equipment.
The switch 204 is further interconnected with a data store 202 for storing and retrieving data useful in determining the physical connectivity of IT equipment to power outlets. This data includes but is not limited to power failure reference signatures, theoretical power signatures, actual power signatures, actual power data and other associations. The power distribution manager 206 further interfaces with the KVM switch 204 providing the Administrator 208 with the ability to access from the remote location power distribution unit data from various power distribution units located on racks 220, 222, 224. Another database 216 is accessible over the IP network 212 to store physical location data as pertains to IT equipment and power outlets. A change alert server 218 is also optionally connected and accessible over the KVM switch 204. In operation, data from the racks and power distribution units in the data center is collected and stored over the IP network and selectively accessible to the Administrator 208. The power distribution center and reporting equipment access the data and implements the methods according to the invention to identify physical connectivity between IT equipment and power outlets. The KVM switch 204 can be used to actively connect to the server to be associated as this will increase utilization at the server. Administrators can use this KVM approach to improve the connectivity discovery on selected servers that may provide similar power signatures in regular operation.
In each of the above systems 100, 200, power distribution units and KVM switches and/or other administrator appliances or servers are programmed to collect data for storing in databases for later use and for applying correlation heuristics. The data acquired through the monitoring can be classified into two major categories. One is the time series information that provides the value of the data at any instant of the time. Secondly, the time stamped events that effect both the IT and power systems. Examples of the latter include the reboot of the sever machine and startup of the server. Among the different data attributes useful to a correlation method according to the principles of the invention are data related to the theoretical power usage requirements of particular IT equipment, the actual power consumption data at particular power outlets as measured over time, actual CPU utilization data for servers in the data center collected over time, and physical distance relationships between identified servers and identified power outlets. In addition to this data, other useful characterizing data can be obtained and stored in the data stores. This data could include data characteristics for a particular type of IT equipment found in the data center. For example, email servers, web servers, routers and the like often have identifiable characteristics depending upon their particular usage in the data center which include data related to temperature, CPU utilization, changes of state from on to off, any other characteristic that may be identifying either alone or in combination with other server characteristics.
A number of indicators that can be used in the heuristic process include power usage name plate values, actual power consumption patterns, the time sequence of IT equipment state change events, and the physical location of the IT equipment in relation to the power outlets. So, for example, assuming a set of 20 candidate power outlets for a given piece of IT equipment, a subset are eliminated because they are not within a certain physical distance of the IT equipment. This indicator leverages the typical practice of locating servers within a specified maximum distance of its outlet. The name plate information is used to group the servers by their average power consumption levels and the pattern matching algorithm can match the selected subset of servers to determine the electrical power outlets only if the power values overlap. For example, if a power outlet has delivered M watts of power and the sever has the maximum name plate power as N watts and if M>>N then there is no correlation between the power outlet in question and the server. Of the remaining candidate outlets, a heuristic is applied to identify and correlate actual CPU utilization with actual power consumption at the power outlet. This reduces the number of candidate outlets to an identified set. If it does not, then an additional heuristic is applied to determine actual state changes as reflected in CPU utilization graphs and power consumption graphs. Additional heuristics could be applied by analyzing IT utilization over a day with a histogram. The time series data can be transformed into other domains in the frequency or spatial domain to improve the correlation within the context of power characteristics.
In one aspect of the invention, the first candidate of potential outlets for a particular server is identified through IP addressing. The number of IPUs in the electrical distribution can be discovered using different methods based on their capabilities. In the case of a Raritan DPX, the IPMI discovery will provide enough information about the presence and configuration of these units. Similarly the network management technologies provide capabilities to discover the server system details including the network IP address that can be used to monitor and measure the IT utilization over a network. Using the IP address, data is collected from servers and from power outlet units. The data is aggregated in the data store. The data collection methodologies available for the proposed invention include SNMP, IPMI, WMI and WS-MAN. All these standard management interfaces provide remote monitoring capabilities useful for this invention. The data is time-stamped so that power usage, CPU usage and events can be correlated between different candidate power outlets and different IT equipment.
FIGS. 3A, 3B and 3C show three exemplary graphs 302, 304, 306 demonstrating one aspect of the heuristics that can be applied according to the principles of the invention. The graph 302 of FIG. 3A shows CPU utilization (Y axis) over time (X axis). The CPU utilization data is raw, unquantized data, and represents all cores in the candidate IT equipment under consideration. The unquantized data is somewhat noisy, and may be suboptimal for correlating with other data. Graph 304 of FIG. 3B shows the same data as quantized to remove artifacts and noise. In this example, the usage values are approximately quantized to integer values 1 and 2, although other quantization methods can be employed without departing from the principles of the invention. Here again the usage data corresponds to all cores for the candidate IT equipment. FIG. 3C graph 306 shows the actual power consumption of the candidate outlet over the same time period with time tracked using time stamps applied during data collection. There is an event change demonstrating a change in CPU utilization, as shown by arrows 308 and 310. Likewise, in the power consumption graph 306, the data reveals a power spike at 312. This spike 312 potentially correlates with the events in core utilization 308, 310 for the unquantized and quantized graphs. Time stamp comparison of the events is another data indicator that can be used to correlate this candidate IT equipment to the candidate power outlet.
FIG. 4 shows exemplary utilization data graphs 402, 404 and corresponding histograms 406, 408 which can be used to correlate candidate power outlets to IT equipment in the heuristics according to the principles of the invention. Graph 402 represents raw utilization data for all cores of a piece of IT equipment over a whole day, where the utilization values fall from approximately zero to approximately 100. The raw utilization data is not easily mined for indicators that can be used to correlate to candidate power outlets. The utilization histogram 406 categorizes the utilization based upon the frequency of the utilization at particular selected values. The histogram, therefore, depicts how often the IT equipment was used at a particular level over a given period.
FIG. 6 shows an example of CPU and power utilization for a three-hour period. Data 601 represents the CPU utilization over the three-hour period. In this exemplary embodiment, the sum of all processor cores in a particular server includes all four cores in this processor, so the total value needs is divided by four to represent utilization as a percentage of power. Data 602 represents the power utilization for the server over the same period as logged by a PDU. As can be seen by data 601 and 602, both the CPU utilization and power steadily increase over time. As seen by data 602, the server consumes an average of 178 Watts for the average CPU utilization of 27.90 as indicated by data 601.
FIG. 7 shows an example of CPU utilization and a corresponding histogram of processed data, emphasizing the low utilization of the server. Data 701 shows the server activity and how active the server is over a given period of time. According to the principles of the current invention, and as can be seen from data 701, the transformation of the time series information from the server utilization or PDU can be useful when correlating based on data values. Data 702, is exemplary of the histogram based approach for converting the time series data 701 into a utilization context. Histogram data 702 may be correlated with a histogram of PDU utilization in accordance with the principles of the present invention.
FIG. 9 shows an exemplary flow diagram 900 of the heuristic auto-association framework in accordance with an embodiment of the present invention. Once started, step 901 retrieves environmental components of the system. Specifically, at step 901, the auto-association framework gathers configuration information regarding the servers and PDUs in the system and downloads that configuration information for storage in step 902. Step 903 determines if all configuration information has been collected. If there is additional configuration information to gather, steps 901 and 902 are repeated until the process is complete. During step 904, the utilization measurements from the identified servers and PDUs are collected and stored in a database at step 906. Steps 904 and 906 will be repeated until terminated by a user in step 905.
1. A method for operating a discovery system in a data center having a plurality of servers powered via a plurality of power supply outlets, the method comprising of steps of:
selecting a feasible set of candidate power supply outlets for at least one of the servers connected to at least one of the plurality power supply outlets, the feasible set being a subset of the plurality of power supply outlets;
collecting power consumption data for the feasible power outlets over time and central processing unit utilization data for the at least one server during an overlapping time by a data collection module of the discovery system;
storing the information collected by a data collection module of the discovery system;
correlating the CPU utilization data to the power consumption data for candidate pairings of feasible power supply outlets with the at least one server by a correlation engine of the discovery system according to a first set of metrics;
determining whether correlations according to the first set of metrics indicate that the at least one server is associated with one or more of the set of feasible power supply outlets; and
correlating the CPU utilization data to the power consumption data by the correlation engine according to a second set of metrics when the correlation according to the first set of metrics is insufficient to determine an association.
2. The method of claim 1 wherein the step of selecting the feasible set of power supply outlets includes the substep of selecting power supply outlets that are located within a specified distance from the at least one server.
3. The method of claim 1 further comprising the step of correlating the power consumption data to theoretical power consumption data for the at least one server by the correlation engine of the discovery system.
5. The method of claim 1 wherein at least one of the correlating steps includes the substep of quantizing the CPU utilization data.
6. The method of claim 1 wherein at least one of the correlating steps includes the substep of time-stamping the power consumption data and the CPU utilization data.
7. The method of claim 1 wherein at least one of the correlating steps includes the substep of correlating state changes between the CPU utilization data and the power consumption data.
8. The method of claim 1 further comprising the step of correlating the power consumption data to theoretical power consumption data for the at least one server in the correlation engine of the discovery system,
wherein the step of selecting the feasible set of power supply outlets step includes the substep of selecting power supply outlets that are located within a distance from the at least one server,
wherein the collecting step includes the substep of specifying an IP address for the at least one server and
wherein at least one of the correlating steps includes the substeps of
quantizing the CPU utilization data,
time-stamping the power consumption data and the CPU utilization data, and
correlating state changes between the quantized CPU utilization data and the power consumption data.
9. The method according to claim 1, wherein the second set of metrics includes metrics selected from the group consisting of CPU utilization level histograms, CPU utilization wavelets, and processor type.
10. The method according to claim 1 wherein the first set of metrics includes quantized CPU utilization data.
11. The method of claim 1 wherein the step of selecting the feasible, set of power supply outlets includes the substeps of:
determining a historical average power delivery by each of the plurality of power supply outlets,
determining a name plate power consumption by the at least one server, and
selecting power supply outlets having a historical average power delivery that is less than the name plate power consumption for the at least one server.
12. A system for automatically discovering the connectivity of servers to a plurality of power outlets in a data center comprising:
a data collection module interfaced with power supply outlets and IT equipment, the data collection module operable to collect actual power usage for power supply outlets and CPU usage from IT equipment;
a data store having the information collected by the data collection module; and
a correlation engine operable select a feasible set of candidate power supply outlets and correlate the CPU usage data with actual power usage data to identify a piece of IT equipment connected to one of the power supply outlets, the feasible set of power supply outlets being a subset of the plurality of power supply outlets,
wherein the correlation engine determines whether correlations according to a first set of metrics indicate that the at least one server is associated with one or more of the set of feasible power supply outlets, and in addition determines correlations according to a second set of metrics when the correlations according to the first set of metrics are insufficient to determine an association.
13. The system according to claim 12, wherein the second set of metrics includes metrics selected from the group consisting of CPU utilization level histograms, CPU utilization wavelets, and processor type.
14. The method according to claim 12 wherein the first set of metrics includes quantized CPU utilization data.
15. A method for monitoring racks of IT equipment by a discovery system, comprising the steps of:
aggregating CPU usage data for the IT equipment in a database of the discovery system;
selecting a feasible set of candidate power supply outlets for an IT server located in the rack of IT equipment, the feasible set being a subset of a plurality of power supply outlets;
correlating CPU usage for the IT server with actual power usage of a candidate power strip by a correlation engine of the discovery system according to a first set of metrics, wherein the correlating steps include the substep of identifying state changes for the IT equipment;
determining whether the correlations according to the first set of metrics indicate that the IT server is associated with one of the set of feasible power supply outlets, and
16. The method according to claim 15, wherein the second set of metrics includes metrics selected from the group consisting of CPU utilization level histograms, CPU utilization wavelets, and processor type.
17. The method according to claim 15 wherein the first set of metrics includes quantized CPU utilization data.
18. The method of claim 15 wherein the step of selecting the feasible, set of power supply outlets includes the substeps of:
determining a name plate power consumption by the IT server, and
19. The method of claim 15 wherein the step of selecting the feasible set of power supply outlets includes the substep of selecting power supply outlets that are located within a specified distance from the IT server.
US12/168,504 2008-07-07 2008-07-07 Automatic discovery of physical connectivity between power outlets and IT equipment Active 2030-12-06 US8886985B2 (en)
AU2008359227A AU2008359227B2 (en) 2008-07-07 2008-07-08 Automatic discovery of physical connectivity between power outlets and it equipment
JP2011517390A JP5284469B2 (en) 2008-07-07 2008-07-08 Automatic discovery of physical connectivity between the power outlet and it equipment
CN200880131103.4A CN102165644B (en) 2008-07-07 2008-07-08 Automatic discovery of physical connectivity between power outlets and IT equipment
EP08781503.1A EP2311145B1 (en) 2008-07-07 2008-07-08 Automatic discovery of physical connectivity between power outlets and it equipment
CA2730165A CA2730165C (en) 2008-07-07 2008-07-08 Automatic discovery of physical connectivity between power outlets and it equipment
US20100005331A1 US20100005331A1 (en) 2010-01-07
US8886985B2 true US8886985B2 (en) 2014-11-11
US12/168,504 Active 2030-12-06 US8886985B2 (en) 2008-07-07 2008-07-07 Automatic discovery of physical connectivity between power outlets and IT equipment
EP0766098A1 (en) 1995-09-29 1997-04-02 Square Co., Ltd. System and method for generating three-dimensional position data
US20020156600A1 (en) 2001-04-24 2002-10-24 Her-Lin Chang Unattendant data center environment protection, control, and management system
US6476728B1 (en) 1998-11-16 2002-11-05 Canon Kabushiki Kaisha Power consumption management apparatus and method
US20040051397A1 (en) 2000-12-22 2004-03-18 Asko Juntunen Intelligent power distribution system with a selectable output voltage
EP1489719A2 (en) 2003-06-20 2004-12-22 Matsushita Electric Industrial Co., Ltd. Energy management system, energy management method, and unit for providing information on energy-saving recommended equipment
US20060072271A1 (en) 2004-10-05 2006-04-06 Ofi, Inc. Electrical power distribution system
US20060103504A1 (en) 2004-11-12 2006-05-18 Afco Systems Development, Inc. Tracking system and method for electrically powered equipment
GB2423168A (en) 2005-02-11 2006-08-16 Dell Products Lp Managing software updates in multiple virtual machines
WO2006089905A1 (en) 2005-02-25 2006-08-31 European Aeronautic Defence And Space Company - Eads France Locating a non-destructive control probe
US20060259621A1 (en) 2005-05-16 2006-11-16 Parthasarathy Ranganathan Historical data based workload allocation
US20070019626A1 (en) 2005-07-04 2007-01-25 Saurav Lahiri System, method, and apparatus for discovering a new server connected within an automated data center
WO2007021392A2 (en) 2005-08-17 2007-02-22 Sun Microsystems, Inc. Inferential power monitor without voltage/current transducers
WO2007072458A2 (en) 2005-12-23 2007-06-28 Nxp B.V. Performance analysis based system level power management
GB2437846A (en) 2006-05-05 2007-11-07 Dell Products Lp Power Allocation Management in an Information Handling System
US20090207694A1 (en) 2008-02-20 2009-08-20 Guigne Jacques Y Ultrasonic in-building positioning system based on phase difference array with ranging
US20090262604A1 (en) 2006-08-30 2009-10-22 Junichi Funada Localization system, robot, localization method, and sound source localization program
WO2010048205A1 (en) 2008-10-20 2010-04-29 Raritan Americas, Inc. System and method for automatic determination of the physical location of data center equipment
US7853816B2 (en) 2006-06-07 2010-12-14 Nec Corporation Apparatus, system and method for monitoring and managing the supply of power to a plurality of units connected to a power supply
WO2004074983A2 (en) 2003-02-14 2004-09-02 Intel Corporation Enterprise power and thermal management
US20080170471A1 (en) 2005-02-25 2008-07-17 European Aeronautic Defence And Space Company- Eads France Localization of a Non-Destructive Testing Probe
US20070040582A1 (en) 2005-08-17 2007-02-22 Gross Kenny C Inferential power monitor without voltage/current transducers
Moore et al., "Weatherman: Automated, online, and predictive thermal mapping and management for data centers," Jan. 1, 2006, Autonomic Computing, 2006. ICAC '06. IEEE International Conference on Dublin, Ireland Jun. 13-16, 2006.
Office Action mailed on Nov. 3, 2010 in related U.S. Appl. No. 12/044,530.
Office Action, mailed on Aug. 20, 2013, in related U.S. Appl. No. 12/044,530.
Office Action, mailed on Jun. 28, 2011, in related U.S. Appl. No. 12/044,530.
Office Action, mailed on Nov. 22, 2013, in related U.S. Appl. No. 12/112,435.
Office Action, mailed on Nov. 7, 2013, in related U.S. Appl. No. 13/790,601.
Office Action, mailed on Oct. 22, 2013, in related U.S. Appl. No. 12/044,530.
Office Actions, mailed on Apr. 19, 2013, in related U.S. Appl. No. 13/790,601.
Office Actions, mailed on Dec. 10, 2012, in related U.S. Appl. No. 12/603,322.
Office Actions, mailed on Dec. 13, 2011 and Sep. 14, 2012, in related U.S. Appl. No. 12/603,322.
Office Actions, mailed on Dec. 7, 2011 and Jun. 28, 2012, in related U.S. Appl. No. 12/582,480.
Office Actions, mailed on Jan. 10, 2014 and Mar. 18, 2014, in related U.S. Appl. No. 12/582,480.
Office Actions, mailed on Jun. 16, 2011 and Feb. 23, 2012, in related U.S. Appl. No. 12/112,435.
Office Actions, mailed on May 24, 2013, in related U.S. Appl. No. 12/582,480.
Office Actions, mailed on Nov. 16, 2012 and Jul. 17, 2013, in related U.S. Appl. No. 12/112,435.
Office Actions, mailed on Sep. 13, 2013 and Sep. 27, 2013, in related U.S. Appl. No. 12/582,480.
Raghavendra et al., "No "Power" Struggles: Coordinated Multi-level Power Management for the Data Center," http://www.hpl.hp.com/echreports/2007/HPL-2007-194.pdf, Mar. 1, 2008.
The Australian Office Action, issued on Mar. 22, 2013, in the related Australian Patent Application No. 2008359227.
The Chinese Office Action, issued on Apr. 26, 2013, in the related Chinese Patent Application No. 200980149075.3.
The Chinese Office Action, issued on Dec. 11, 2013, in the related Chinese application No. 200980142324.6.
The Chinese Office Action, issued on Dec. 18, 2013, in the related Chinese Patent Application No. 200880129788.9.
The Chinese Office Action, issued on Feb. 16, 2013, in the related Chinese Patent Application No. 200880129788.9.
The Chinese Office Action, issued on Nov. 5, 2012, in the related Chinese Patent Application No. 200980142324.6.
The English translation of the Chinese Office Action by the Chinese Intellectual Property Office, issued on Jan. 14, 2013, in the related Chinese patent application No. 200880131103.4.
The English translation of the Japanese Office Action issued on Jun. 18, 2013 in the related Japanese application No. 2011-533304.
The extended European Search Report by the European Patent Office, issued on Aug. 2, 2012, in the related European patent application No. 09822648.3.
The extended European Search Report by the European Patent Office, issued on Jan. 16, 2012, in the corresponding European patent application No. 09716608.6.
The International Search Report and Written Opinion by the International Searching Authority, issued on Apr. 21, 2009, in the PCT application No. PCT/US09/36299.
The International Search Report and Written Opinion by the International Searching Authority, issued on Aug. 7, 2008, in the PCT application No. PCT/US08/05533.
The International Search Report and Written Opinion by the International Searching Authority, issued on Dec. 18, 2009, in the PCT application No. PCT/US09/61354.
The International Search Report and Written Opinion by the International Searching Authority, issued on Nov. 25, 2009, in the PCT application No. PCT/US09/61521.
The International Search Report and Written Opinion by the International Searching Authority, issued on Sep. 8, 2008, in the PCT application No. PCT/US08/069422.
The Japanese Office Action issued on Aug. 20, 2013 in the related Japanese application No. 2011-532336.
EP2311145A1 (en) 2011-04-20
Bunke et al. 2007 A graph-theoretic approach to enterprise network dynamics
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SOMASUNDARAM, SIVA;YANG, ALLEN;REEL/FRAME:021203/0125;SIGNING DATES FROM 20080703 TO 20080707
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SOMASUNDARAM, SIVA;YANG, ALLEN;SIGNING DATES FROM 20080703 TO 20080707;REEL/FRAME:021203/0125