# Presentation: 733338

## CTO Challenge

**CTO Challenge**

**   **
**William Tschudi**
- _[wftschudi@lbl.gov](mailto:wftschudi@lbl.gov)_
**510-495-2417**** **
**February 27, 2008**

##  	Selected LBNL Data Center findings

** ****	****Selected LBNL Data Center findings**
**   ****	****Future bold moves**

## Benchmarks of energy end use

## Overall electrical power use 

- Courtesy of Michael Patterson, Intel Corporation

## Your mileage will vary

- The relative percentages of the energy doing computing varied considerably.

## High level metric— Ratio of electricity delivered to IT equipment

**Average .57**

- Higher is better

- Source:  LBNL Benchmarking

## High level metric— 

**Average .57**

- Source:  LBNL Benchmarking

- CTO Challenge – get everyone to this level

## On-line profiling tool: “Data Center Pro”

**Notes:**
Now that I’ve discussed how the PEP tool fits into our tool strategy,  I want to take you through a brief overview of the PEP Tool.

The PEP tool is a tool that takes a plant-wide approach to energy savings and looks at both equipment efficiency and operation practices to identify savings opportunities.  

Users input plant data that includes :
equipment information that describes the plant’s operation and production, 
energy costs and usage from monthly fuel and electric bills as well as energy generation and exportation information.
operation practices information

The PEP Tool uses this data to:
provide plant-wide energy maps for electricity, fuel, & steam to describe the plant’s energy flow and usage.  
identify where energy efficiency opportunities exist 
give the user an idea of the magnitude of the savings associated with these opportunities
compare the plant’s practices to industry recognized best practices

## DOE Save Energy Now Data Center program

- Major Program Elements
- 1.	Develop and test “DC Pro” Software using
- 	 pilot energy assessments
- 2.	Create consensus metrics
- 3.	Create and publicize Save Energy Now case studiesbased on pilot energy assessments
- 4.	Create best practice information and a training curriculum
- 5.	Develop Qualified Specialists program for Data Centers
- 6.	Create guidelines for “Best-in-Class” data center within various classes of data centers, including strategies for incorporating distributed generation technologies

## 	  Federal Energy  Management   Program

- 	  **Federal Energy  Management ****  Program**
- Best practicesshowcased at Federal data centers
- Pilot adoption of Best-in-Class guidelines at Federal data centers
- Adoption of to-be-developed industry standard for Best-in-Class at newly constructed Federal data centers

**EPA**
- Metrics
- Server performancerating & ENERGY STAR label
- Data center performance benchmarking

**Industrial Technologies Program**
- Tool suite & metrics
- Energy baselining
- Training
- Qualified specialists
- Case studies
- Certification of continual improvement
- Recognition of high energy savers
- Best practice information
- Best-in-Class guidelines

**Industry**
- Tools
- Metrics
- Training
- Best practice information
- Best-in-Class guidelines
- IT work productivity standard

## Energy assessment tools

*Data Center Assessment Output*
- Overall energy performance (baseline) of data center
- Performance of IT & infrastructure subsystems compared to benchmarks
- Prioritized list of energy efficiency actions and their savings, in terms of energy cost ($), source energy (Btu), and carbon emissions (Mtons)

***IT Module***
- Servers
- Storage & networking
- Software

***Power Systems***
- UPS
- Distribution

***Cooling***
- Air Mgmt
- CRAC/CRAH
- AHU
- Chillers

***On-Site Gen***
- Renewables
- Co-gen

## Energy efficiency opportunities are everywhere

- Server Load/ComputingOperations

- Cooling Equipment

- Power Conversion & Distribution

- AlternativePower Generation

- High voltage distribution
- Use of DC power
- Highly efficient UPS systems
- Efficient redundancy strategies

- Load management
- Server innovation

- Energy efficiency opportunities are everywhere

- Better air management
- Better environmental conditions
- Move to liquid cooling
- Optimized chilled-water plants
- Use of free cooling

- On-site generation
- Waste heat for cooling
- Use of renewable   energy/fuel cells

**Notes:**
Power Conversion: Potential for 10 to 30% improvement

Server Load/Computing: Potential for 30 to 50% improvement (check EPA report)
Load management
Virtualization
Sleep modes
Load shifting
Server innovation
Chip design
Efficient power supplies
Semiconductor materials

Cooling:  Potential for 30 to 50% improvement (check EPA report)

Alternative Power Generation: 
On-site generation (eliminates    transmission losses)
  CHP applications
  Use of waste heat for cooling
  Use of renewable energy (could couple   with DC power distribution systems)
  PV
  Fuel cells

## HVAC best practices

- Air Management
- Air Economizers
- Humidification Control
- Centralized Air Handlers
- Low Pressure Drop Systems
- Fan Efficiency

- Cooling Plant Optimization
- Water Side Economizer
- Variable Speed Chillers
- Variable Speed Pumping
- Direct Liquid Cooling

## Electrical best practices

- UPS systems
- Self-generation
- AC-DC distribution
- Standby generation

## Best practices and IT equipment 

- Power supply efficiency
- Standby/sleep power modes
- IT equipment fans
- Virtualization
- Load shifting

## Best Practices—Cross-cutting and misc. issues

- Motor efficiency
- Right sizing
- Variable speed drives
- Lighting
- Maintenance
- Continuous Commissioning and Benchmarking

- Heat Recovery
- Building Envelope
- Redundancy Strategies

## Design guidelines for ten best practices were developed

- Guides available through LBNL’s website & PG&E’s Energy Design Resources website

## Broaden recommended and allowable ranges of environmental conditions
Debunk contamination and ESD fears
Move to liquid cooling
Integrate computing equipment and the building
Minimize power conversion loss -  end to end
Facilitate IT – Facilities – CFO understanding

- Debunk contamination and ESD fears
- Move to liquid cooling
- Integrate computing equipment and the building
- Minimize power conversion loss -  end to end
- Facilitate IT – Facilities – CFO understanding

- CTO Challenge – Some bold steps to improve energy efficiency (and save your customers money)

## Broaden recommended and allowable ranges of environmental conditions

HVAC can be greatly reduced if higher temperatures can be used for cooling IT equipment (using air or liquid)
ASHRAE addressing this but not based upon science
IT equipment operating at 80o F or higher has huge energy implications

- HVAC can be greatly reduced if higher temperatures can be used for cooling IT equipment (using air or liquid)
- ASHRAE addressing this but not based upon science
- IT equipment operating at 80o F or higher has huge energy implications

- CTO Challenge

## Temperature guidelines – at the inlet to IT equipment

- ASHRAE Allowable Maximum

- ASHRAE Allowable Minimum

- ASHRAE Recommended Maximum

- ASHRAE Recommended Minimum

## Humidity guidelines – at the inlet to IT equipment

- ASHRAE Allowable Maximum

- ASHRAE Allowable Minimum

- ASHRAE Recommended Maximum

- ASHRAE Recommended Minimum

## CTO challenge:  Broaden environmental conditions

- ASHRAE Allowable Maximum

- ASHRAE Allowable Minimum

- ASHRAE Recommended Maximum

- ASHRAE Recommended Minimum

## Metric 1.2 for planned LBNL supercomputer facility

**Metric 1.2 for planned LBNL supercomputer facility**

**Average of Facilities Measured-1.74**

**Total Power/IT Power**

## Debunk contamination and ESD fears
Direct use of outside air for cooling can result in large HVAC savings but fears of contamination hinder its adoption
LBNL studies suggest this should not be a problem
Failure data due to contamination has been requested – none has been produced
ESD is poorly understood.

- Direct use of outside air for cooling can result in large HVAC savings but fears of contamination hinder its adoption
- LBNL studies suggest this should not be a problem
- Failure data due to contamination has been requested – none has been produced
- ESD is poorly understood.

- CTO Challenge

## Outdoor measurements

**IBM Standard**

**EPA Annual Health Standard**

**EPA 24-Hour Health Standard**

***and***** ASHRAE Standard**

## Measurements inside the centers

**IBM Standard**

**EPA Annual Health Standard**

**EPA 24-Hour Health Standard**

***and***** ASHRAE Standard**

## Move to liquid cooling
Liquid can remove 3500 times as much heat as air
Liquid cooling could eliminate (or greatly reduce) the need for chillers
Liquid is creeping in now – how to accelerate it?

- Liquid can remove 3500 times as much heat as air
- Liquid cooling could eliminate (or greatly reduce) the need for chillers
- Liquid is creeping in now – how to accelerate it?

- CTO Challenge

## Integrate computing equipment and the building
Often multiple fans in series
air and liquid cooling
High delta T is efficient
Eliminate boxes
Control HVAC from servers on board sensors (Demo being planned)

- Often multiple fans in series
- air and liquid cooling
- High delta T is efficient
- Eliminate boxes
- Control HVAC from servers on board sensors (Demo being planned)

- CTO Challenge

## 
Minimize power conversion loss - end to end
On site generation
Distribute high voltage AC or DC
Eliminate conversions with use of DC
Insist on high efficiency power supplies and UPS
Optimize DC conversions in the box
AC to the chip?
Redundancy 

- Minimize power conversion loss - end to end
- On site generation
- Distribute high voltage AC or DC
- Eliminate conversions with use of DC
- Insist on high efficiency power supplies and UPS
- Optimize DC conversions in the box
- AC to the chip?
- Redundancy

- CTO Challenge

## Measured UPS efficiency 

- Measured UPS efficiency

- Redundant Operation

## Data Center power conversions

**Power Distribution Unit (PDU)**

**Server**

**Uninterruptible Power Supply (UPS)**

- AC

- DC

- AC

- DC

## UPS factory measurements 

- UPS factory measurements

**Typical Operation**

## Power supply efficiency

- Typical operation

## Facilitate IT – Facilities – CFO understanding
 Disconnect between facilities and IT
 Operating budget vs capital budget
 Operating cost equals or exceeds capital cost of IT equipment
 How to get CFO’s engaged?

-  Disconnect between facilities and IT
-  Operating budget vs capital budget
-  Operating cost equals or exceeds capital cost of IT equipment
-  How to get CFO’s engaged?

- CTO and CFO Challenge

## 

websites: http://hightech.lbl.gov/datacenters/
http://www1.eere.energy.gov/industry/saveenergynow/partnering_data_centers.html

**websites: **http://hightech.lbl.gov/datacenters/
- http://www1.eere.energy.gov/industry/saveenergynow/partnering_data_centers.html