ENERGY STAR Server Meeting:
Product Families, Dataset Assembly,Progress
March 11, 2011
RJ Meyers
Una Song
US Environmental Protection Agency
ENERGY STAR Program1

AgendaTime (all EST)Topic

9:00‐9:15

Meeting Introduction

9:15 – 10:45

Product families introduction

10:45‐11Break

11:00‐12:30

Dataset Assembly

12:30‐1:15
1:15 ‐ 2:00

Lunch(Continued) Dataset Assembly
SERT progress update from EPA and stakeholder
input
Remaining topics, meeting summary and closing

2:00 – 3:00
3:00 – 3:30

2Remote Attendees• Call in and Live Meeting information available on theENERGY STAR Computer Servers PD page:– www.energystar.gov/productdevelopment– Revisions to Existing Specifications• Audio provided via conference call in:Call in:+1.877.423.6338 (inside US)+1.571.281.2578 (outside the US)

Code:693908• Phone lines will remain on mute during presentations, opened
during discussion (please keep phone lines on mute unlessspeaking)• Please refer to the agenda for approximate discussion timing3

Product Families for ComputerServers
Evan Haines
ICF Internationalehaines@icfi.com

4Revising the Product FamilyStructure• Remains a priority revision for EPA– Create a better balance between testingburden and confidence in representative data
than is present in Version 1.0– Limit missed opportunities to identify
equipment capable of meeting ENERGYSTAR efficiency levels and feature
requirements– Ensure test points deliver a broad set ofefficiency data from SERT
5

Experience in Version 1• Pre-defined Server Configurations– Effectiveness• Presence of pre-defined configurations allows
alignment of testing and marketing of qualification– Observations• Limits to representative testing have moderate effect onENERGY STAR traffic• Straightforward for EPA to implement – one model
number equals one product• In other programs where representative testing applies
in this model, EPA has worked with stakeholders tocreate clear “range” qualification listings
6Experience in Version 1• Customer-configured Servers– Effectiveness• Challenging both in testing and marketing of products• Shifts qualification activity back to specificconfigurations– Observations• Remains a challenge to implement for EPA• Stakeholders have referenced internal methods ofmodeling power consumption, but are limited in sharing
details publically• The client Computer program implements “worst-case”
testing approach, but Servers have significantly more
configurability and component power deltas
75-point approach• EPA proposes “bookending” product families withfive representative tests• All configurations within a product family would
share a set of core characteristics• Qualification listings would contain– References to the actual configurations tested– A configuration identifier that could be referenced by apurchaser for the actual configurations tested AND allother configurations a manufacturer asserts asmeeting the applicable ENERGY STAR requirements8Common Product Family
Attributes• Same model line
• Same form factor (with commonmotherboard)• Common Power Supply (PSU)
characteristics - discussed further insubsequent slides

95-point Product Family StructureHigh-end – Minimum
Configuration
This test point is likely to be a
performance-oriented systemoutfitted with the least number ofcomponents available in the family.

Δ Purchase
Considerations

High-end – Maximum
Configuration
This test point is likely to be a
performance-oriented systemoutfitted with the greatest number ofcomponents available in the family.

Typical ConfigurationThe vendor-selected componentsthat represent highest-volume
deployed configuration.

Low-end – Maximum
Configuration
This test point is likely to be a costconscious system outfitted with thegreatest number of components
available in the family.

Low-end – Minimum
Configuration
This test point is likely to be a costconscious system outfitted with theleast number of components
available in the family.
Δ Power10

Power• The horizontal vector
represents shifts in
power – same as V1
High-end – Minimum
Configuration
This test point is likely to be a
performance-oriented systemoutfitted with the least number ofcomponents available in the family.

Δ Purchase
ConsiderationsHigh-end – Maximum
Configuration
This test point is likely to be a
performance-oriented systemoutfitted with the greatest number ofcomponents available in the family.

Typical Configuration
The vendor-selected componentsthat represent highest-volume
deployed configuration.

Low-end – Minimum Configuration
This test point is likely to be a costconscious system outfitted with theleast number of components
available in the family.

Low-end – Maximum
Configuration
This test point is likely to be a costconscious system outfitted with thegreatest number of components
available in the family.
ΔPower– Minimum Power:
minimum configurationthat is able to boot andexecute supported OSs– Maximum Power:
vendor-selectedcombination ofcomponents thatmaximize power usage
within the Product
Family once assembledand operated
11

Purchase Decisions

High-end – Minimum
Configuration
This test point is likely to be a
performance-oriented systemoutfitted with the least number ofcomponents available in the family.

Δ Purchase
ConsiderationsHigh-end – Maximum
Configuration
This test point is likely to be aperformance-oriented systemoutfitted with the greatest number ofcomponents available in the family.

Typical Configuration
The vendor-selected componentsthat represent highest-volume
deployed configuration.

Low-end – Minimum Configuration
This test point is likely to be a costconscious system outfitted with theleast number of components
available in the family.

Low-end – Maximum
Configuration
This test point is likely to be a costconscious system outfitted with thegreatest number of components
available in the family.
ΔPower• The vertical vector
represents shifts inpurchasing priorities– High-end: highest-priceor highest-performancecomputing platform– Low-end: lowest-pricecomputing platform(likely also more
moderate performance,trading performance forsystem cost)12Outcomes• For Partners– In pre-configured purchase model where groups ofconfigurations share common attributes or are built on acommon platform, may reduce testing burden– In customer-configurable model, allows a range of configurations• For EPA
– Maintains correspondence between test data and represented
configurations– Reduces potentially duplicative testing and reporting– Creates structure to get a broad set of active mode data
disclosure• For Customers– Provides a bracket to show where their desired configuration
may fall13

Example – CPU Components
Product NameWatts

CoresPrice

3.6 GHz, 6MB Cache

130 Watts

4C$ 1,663.00

3.2 GHz, 6MB Cache

105 Watts

6C$ 1,663.00

3.2 GHz, 4MB Cache

105 Watts

4C$ 1,440.00

3.0 GHz, 6MB Cache

95 Watts

4C$ 1,440.00

2.4 GHz, 6MB Cache

95 Watts

6C$ 1,219.00

2.6 GHz, 4MB Cache

95 Watts

4C$996.00

2.2 GHz, 4MB Cache

95 Watts

6C$

996.001.8 GHz, 4MB Cache

80 Watts

6C$774.00

2.2 GHz, 4MB Cache

80 Watts

4C$551.00

2.2 GHz, 4MB Cache

60 Watts

4C$551.00

1.8 GHz, 4MB Cache

80 Watts

2C$478.00

1.6 GHz, 4MB Cache

40 Watts

4C$471.00

40 Watts

2C$

440.001.2 GHz, 4MB Cache

60 Watts

4C$387.00

1.5 GHz, 4MB Cache

80 Watts

2C$219.00

Energy Efficient

Energy Efficient

2.0 GHz, 4MB Cache• CPU vendor offers widerange of CPU options– Binning– Bonding Options• Server vendor will selectseveral CPU options– Varying price andperformance points

Energy Efficient

14

Example – CPU Components
Product NameWatts

CoresPrice

3.6 GHz, 6MB Cache

130 Watts

4C$ 1,663.00

3.2 GHz, 6MB Cache

105 Watts

6C$ 1,663.00

3.2 GHz, 4MB Cache

105 Watts

4C$ 1,440.00

3.0 GHz, 6MB Cache

95 Watts

4C$ 1,440.00

2.4 GHz, 6MB Cache

95 Watts

6C$ 1,219.00

2.6 GHz, 4MB Cache

95 Watts

4C$996.00

2.2 GHz, 4MB Cache

95 Watts

6C$996.00

1.8 GHz, 4MB Cache

80 Watts

6C$774.00

2.2 GHz, 4MB Cache

80 Watts

4C$

2.2 GHz, 4MB Cache

60 Watts

4C80 Watts

2C

1.6 GHz, 4MB Cache– Constrained by server design– Offer several price points– Fit with overall server portfolio
Watts

CoresPrice

3.2 GHz, 6MB Cache

105 Watts

6C$ 1,663.00

551.003.0 GHz, 6MB Cache

95 Watts

4C$ 1,440.00$

551.002.6 GHz, 4MB Cache

95 Watts

4C$996.00$478.00

2.2 GHz, 4MB Cache

60 Watts

4C$551.00

Energy Efficient

1.8 GHz, 4MB Cache• Example: Server vendor
selects six CPU types

Product Name

Energy Efficient

40 Watts

4C$471.00

1.8 GHz, 4MB Cache

80 Watts

2C$478.00

40 Watts

2C$440.00

1.5 GHz, 4MB Cache

80 Watts

2C$219.00

1.2 GHz, 4MB Cache

60 Watts

4C$387.00

1.5 GHz, 4MB Cache

60 Watts

2C$

219.00

Energy Efficient

2.0 GHz, 4MB Cache
Energy Efficient

15

Example – CPU Components
Product Name

Watts

Cores

Price

3.2 GHz, 6MB Cache

105 Watts

6C$ 1,663.00

3.0 GHz, 6MB Cache

95 Watts

4C$ 1,440.00

2.6 GHz, 4MB Cache

95 Watts

4C$

996.002.2 GHz, 4MB Cache

60 Watts

4C$551.00

1.8 GHz, 4MB Cache

80 Watts

2C$478.00

1.5 GHz, 4MB Cache

80 Watts

2C$219.00

Energy Efficient• CPU alone brings 24
possible configurations• Add in– Memory options (3-4 types)– Power Supply Options (1 – 2types)– Storage Options (3-4 types)• Possible configurations
can grow into the 1,000’s– 6 CPU Types– 1 to 4 Sockets

16

Example: Full Configuration•Server Common Product Family
Attributes:
–––•

–––•

1 or 2 - (Single or Redundant) PowerSupplies
5 - I/O Expansion Slots
4 - 3.5” HDD Slots
12 - Memory (DIMM) Slots

CPU Options:–––

1.5 GHz / 4MB Cache / 2 Core / 80W
1.8 GHz / 2MB Cache / 2 Core / 80W
2.2 GHz / 4MB Cache / 4 Core / 60W

Memory Options (per DIMM):––––

Model Line: A1234 Server
Form Factor: Rack-mounted
Motherboard: Model MB1203 w/ 4 CPU
Sockets

Other Characteristics:–••

Storage:––––•

256 MB
1 GB - LV (Low Voltage)*
2 GB
8 GB

750 GB / 10,000 RPM / SAS / 3.5”
1 TB/ 7,200 RPM / SAS / 3.5”
1.5 TB / 5,600 RPM / SATA / 3.5”
260 GB / SSD / SAS / 3.5”

Power Supply:––500 W Universal, Single or Redundant
750 W Universal, Single or Redundant

Energy Optimized–––2.6 GHz / 4MB Cache / 4 Core / 95W
3.0 GHz / 6MB Cache / 4 Core / 95W*
3.2 GHz / 6MB Cache / 6 Core / 105W

17

Example: Full Configuration
High-end – Minimum Configuration

High-end – Maximum Configuration

1x 2.2 GHz, 4 MB Cache, 4 Core CPU
1x 1 GB LV Memory
1x 260 GB, SAS SSD
Single 750W Power Supply

4x 3.2GHz, 6MB Cache, 6 Core CPU
12 x 8 GB Memory
4x 750 GB, 10K SAS HDDs
Redundant 750W Power Supplies

Typical Configuration
Δ Purchase
Considerations

4x 2.6GHz, 4MB Cache, 2 Core CPU
10x 2GB Memory
2x 1TB, 7.2K SAS HDDs
Redundant 500W Power Supplies

Low-end – Minimum Configuration

Low-end – Maximum Configuration

1x 1.5GHz, 4MB Cache, 2 Core CPU
2x 256MB Memory
1x 1.5TB, 5.6K SATA HDDs
Single 500W Power Supply

4x 1.8GHz, 2MB Cache, 2 Core CPU
12x 2GB Memory
4x 1.5TB, 5.6K SATA HDDs
Redundant 500W Power Supplies
Δ Power18

Role of PSUs
• ENERGY STAR PSU
efficiency criteria ensure areasonably flat load curve
above 20%
• Across a product family, theidle power point may fall
below 15%, leading tolarger variations between
products• Risk: wide variations inpower due to Idle load point
limit representation of thetest data
19

Discussion

20Assembling a Dataset for
Version 2
Evan Haines
ICF International
ehaines@icfi.com

21Version 2 Dataset• EPA is assembling a dataset for all servers inthe program scope:– 1-4 processor sockets– rack-mounted, pedestal, and blade form factors• EPA’s scope for this effort includes blade
servers and 3-4 socket servers. This data will
be utilized to assess Idle requirements (levelsand/or reporting) in light of changes to theproduct family structure22Version 2 Dataset• Primary use of the dataset will be to reevaluate the structure for product families
that is currently in effect in the Version 1.0
ENERGY STAR Servers Specification• Idle State and Full Load power data for each
unit under test, with accompanying
configuration details– Active/SERT data NOT being collected at thistime23

Configuration Variations• Processor– System speed (e.g., FSB, memory controllerspeed)– For Typical Configuration, impact of unpopulatedsocket• PSU– Use typical options available to customers– Report rationale for PSU selection (e.g., onlyoption available for product family, sized to therated power)24

Configuration Variations• Storage (HDD or SSD)
– Select options available to the customer that
represent a variety of common end
configurations• Memory– Consider several vintages of memory
technology such that EPA can evaluate theimpact of new memory technologies onoverall server efficiency
25

Configuration Variations• I/O– For this effort, EPA
specifies minimal I/O
capability– EPA anticipates limited
support for testing
performance of I/O inSERT– Review of V1 adderstructure• I/O dataset plus power
spec data at Idle fordevices• Drivers for power
differences in hardware

V1 I/O Dataset – Power Range
Examples10 Gbit Ethernet
Idle Power Draw

4.9 - 20.8 W

Power per Port

2.47 – 20.77 W

Fibre Channel
Idle Power Draw

3.8 – 37.4 W

Power per Port

2.72 – 37.4 W

RAID
Idle Power Draw

13.8 – 27.3 W

Power per Port

1.71 – 2.3 W

26

Documentation Updates• Accompanying theProduct Family
Discussion document
was a summary ofrevisions relevant todataset assembly27Documentation Updates• Definitions – Updated
based on stakeholder
feedback to Draft 1 andsubsequent comments• Qualifying Products –Provided as areminder, but matches
proposal from Draft 128

Documentation Updates• Test Method –– Updates based on Draft
1 feedback– Blade testing• N, N-1 format (removedsingle blade testing)• Manufacturer
recommendations forlocation of installedblades• Clarified blade chassis
loading to account for
power domains
29

Timing• March – May: Dataset assembly period for
1S-2S, 3S-4S systems and blade servers• May - June: Data analysis• Late June onward: Specification drafting
process
30

Discussion

31

Update: SERTEvan Haines
ICF International
ehaines@icfi.com

32

SERT Update• Development status and items for review• Details on upcoming review opportunities
and milestones– Participation process– Prerequisites• Open discussion
33

Status• Version 3 of the Design Document
released yesterday– Link continues to be live on ENERGY STARwebsite:• http://www.spec.org/sert/docs/SERTDesign_Doc.pdf• Notes from SPEC on content updates:– More detail in Workload and Worklet
descriptions
34

SERT Tentative Schedule
Pre-Release
Alpha testing planned to
begin in March 2011.
Subsequent dates
dependent on successful
completion of prior phase.

Alpha
Participation

Beta1
Participation

Beta2
Participation

Release Candidate
Participation- SPEC members, EPA
and/or their agents- Expanded participation toinclude some Stakeholders- Expanded participation toinclude all Stakeholders- Expanded participation to
include all who purchase aSERT license- Must have an accepted
SPECpower_ssj2008
result- Must have an accepted
SPECpower_ssj2008
result- Must have accepted power
analyzer and temperature
sensor- Must have accepted power
analyzer and temperature
sensor- Must commit to provide
feedback- Must commit to provide
feedback- Must commit to provide
feedback- Must commit to provide
feedback- Must commit to sharenumerical results w/SPEC(not public)- Must commit to sharenumerical results w/SPEC(not public)- Must commit to sharenumerical results w/EPAand SPEC (not public)- Must commit to sharenumerical results w/EPAand SPEC (not public)Proposed testing prerequisites –Alpha and Beta 1• To ensure effective and efficient testing of
pre-release versions of the tool, testing
entities must have some experience in thebenchmarking process• SPEC proposed a set of related qualities:– Experience running SPECpower_ssj(generate consistent, valid results)– Possession of appropriate temperature andpower analyzer equipment (Beta 2 onward)
36

Getting Involved• EPA will notify
stakeholders inadvance of testing
opportunities• Tentative process tosign up to participate:• Contact EPA atservers@energystar.gov– Interest in testing– Capability to run test(contact/organizational
info, experience andequipment)– EPA will inform SPEC ofinterested participants– Participants will be
forwarded Beta test
agreement documents– A test kit will be provided
upon approval
37

Discussion

38

Action Items and Closing
Thoughts

39

References and Resources• ENERGY STAR Computer Server
specification revision:
http://www.energystar.gov/index.cfm?c=revisi
ons.computer_servers• Version 1.1 (current) ENERGY STAR
Computer Server specification:
http://www.energystar.gov/ia/partners/product_specs/program_reqs/Computer_Servers_Pr
ogram_Requirements.pdf
40

Thank you!
RJ Meyers

Una Song

EPA, ENERGY STAR(202) 343-9923
Meyers.Robert@epa.gov

EPA, ENERGY STAR(202) 343-9024
Song.Una@epa.gov

Evan Haines
ICF International(781) 676-4081
Ehaines@icfi.com

BizhanZhumagali
ICF International(202) 572-9448
Bzhumagali@icfi.com

Al Thomason
TBWC, LLC
(503) 708-7881
thomasonw@gmail.com

41