ENERGY STAR® Program Requirements
Product Specification for
Data Center Storage
Eligibility Criteria
Draft 2, Version 2.0

12

Following is the Draft 2, Version 2.0 ENERGY STAR Product Specification for Data Center Storage. A
product shall meet all of the identified criteria if it is to earn the ENERGY STAR.

3

1

4

DEFINITIONS
A. Product Types:

5
6
7
8
9
10
11
12
13
14

1) Storage Product: A fully-functional storage system that supplies data storage services toclients and devices attached directly or through a network. Components and subsystems thatare an integral part of the storage product architecture (e.g., to provide internal
communications between controllers and disks) are considered to be part of the storage
product. In contrast, components that are normally associated with a storage environment at
the data center level (e.g., devices required for operation of an external SAN) are notconsidered to be part of the storage product. A storage product may be composed ofintegrated storage controllers, storage devices, embedded network elements, software, andother devices. For purposes of this specification, a storage product is a unique configurationof one or more SKUs, sold and marketed to the end user as a Storage Product.

15
16
17
18
19
20

2) Storage Device: A collective term for disk drives (HDDs), solid state drives (SSDs), tapes
cartridges, and any other mechanisms providing non-volatile data storage. This definition is
specifically intended to exclude aggregating storage elements such as RAID array
subsystems, robotic tape libraries, filers, and file servers. Also excluded are storage devices
which are not directly accessible by end-user application programs, and are instead
employed as a form of internal cache.

21
22
23

3) Storage Controller: A device for handling storage request via a processor or sequencer
programmed to autonomously process a substantial portion of I/O requests directed tostorage devices (e.g., RAID controllers, filers).

24

B. Storage Product Connectivity:25261) Direct-attached Storage (DAS): One or more dedicated storage devices that are physicallyconnected to one or more servers.

27282) Network Attached Storage (NAS): One or more dedicated storage devices that connect to a
network and provide file access services (File I/O) to remote computer systems.

29
30
31
32
33
34

3) Storage Area Network (SAN): A network whose primary purpose is the transfer of data
between computer systems and storage products. A SAN consists of a communication
infrastructure, which provides physical connections, and a management layer, whichorganizes the connections, storage controllers / devices, and computer systems so that datatransfer is secure and robust. The term SAN is usually (but not necessarily) identified withblock I/O services rather than file access services.

35

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 1 of 16

C. Capacity Optimizing Methods (COMs)1: The reduction of actual data stored on storage devices
through a combination of hardware and / or software. Common COMs include:

36
37
38
39
40

1) Thin Provisioning: A technology that allocates the physical capacity of a volume or file system
as applications write data, rather than allocating all the physical capacity at the time ofprovisioning.

41
42
43

2) Data Deduplication: The replacement of multiple copies of data – at variable levels of
granularity – with references to a shared copy in order to save storage space and/or
bandwidth.

44
45
46
47

3) Compression: The process of encoding data to reduce its size. For the purpose of thisspecification, only lossless compression (i.e., compression using a technique that preserves
the entire content of the original data, and from which the original data can be reconstructed
exactly) is recognized.

48
49
50

4) Delta Snapshots: A type of point-in-time copy that preserves the state of data at an instant intime by storing only those blocks that are different from an already existing full copy of thedata.
D. Storage Taxonomy1: A categorization scheme for use in segmenting the data center storage
market by end-use application and key product characteristics. The major categories of thetaxonomy that are referenced in this document are as follows:

51
52
53
54
55
56
57
58
59

1) Disk Set Online Storage: Storage products that are intended to service a mixture of Random
and Sequential I/O requests with a short response time. All data stored in Disk Set Online
storage must be accessible MaxTTFD ≤ 80 ms, unless the storage product is in a Deep Idle
state. Disk set Online storage is typically comprised of one or more HDDs and a storage
controller, and provides primary data storage to supplement a Computer Server’s internal
memory.

60
61
62
63
64

2) Disk Set Near-online Storage: Storage products that are intended to service a mixture ofRandom and Sequential I/O requests with a short to moderate response time. Disk Set Nearonline storage products offer an asymmetrical response; a portion of data may be accessible
MaxTTFD ≤ 80 milliseconds, while other data may be accessible MaxTTFD > 80
milliseconds.

65
66
67
68
69
70

3) Removable and Virtual Media Library (RVML) Set Virtual Media Library: Storage productsthat are intended to service primarily Sequential I/O, with a short response time. The media in
a Virtual Media Library (e.g., HDD, optical disk) is not designed to be physically removed fromthe system. All data stored in the Virtual Media Library must be assessable MaxTTFD ≤ 80
ms, unless the storage product is in a Deep Idle state. Virtual Medial Libraries are intended
primarily for moderate and long-term data storage.

71
72
73
74
75

4) RVML Set Removable Media Library: Storage products that are intended to service primarily
Sequential I/O, with a moderate to long response time. The media (e.g., tape cartridge,
optical disk) in a Removable Media Library is designed to be physically removed from thestorage product. Removable Media Libraries are intended primarily for long term dataarchiving

1

The ENERGY STAR storage taxonomy and COM references in this document are consistent with theterminology developed by the Storage Networking Industry Association Green Storage Initiative as
defined in “SNIA EmeraldTM Power Efficiency Measurement Specification” Version 4.0. Further detail may
be found at www.snia.org/green.

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 2 of 16

76
77
78
79
80
81

5) Non-volatile Solid State (NVSS) Set Disk Access Storage: Storage products that are intended
to service a mixture of Random and Sequential I/O requests with a short response time. Alldata stored in NVSS Set Disk Access Online storage must be accessible MaxTTFD ≤ 80 ms,
unless the storage product is in a Deep Idle state. NVSS Set Disk Access Online storage istypically comprised of one or more SSDs and a storage controller, and provides primary data
storage to supplement a Computer Server’s internal memory.

82
83
84
85
86
87

6) NVSS Set Memory Access Storage: Storage products that are intended to service a mixtureof Random and Sequential I/O requests with a short response time. All data stored in NVSS
Set Memory Access Online storage must be accessible MaxTTFD ≤ 80 ms, unless thestorage product is in a Deep Idle state. NVSS Set Memory Access Online storage is typicallycomprised of one or more banks of Solid State Storage devices and a storage controller, andprovides primary data storage to supplement a Computer Server’s internal memory.

88
89
90
91

Note: EPA is proposing to adopt the revised SNIA storage taxonomy definitions recently finalized throughthe SNIA Emerald Version 4.0 specification development process. Maintaining alignment with thesedefinitions ensures industry and purchasers continue to define these products in the same way based on
clear technical characteristics.

92
93
94
95
96
97
98
99

E. Other Data Center Equipment:1) Computer Server: A computer that provides services and manages networked resources forclient devices (e.g., desktop computers, notebook computers, thin clients, wireless devices,
PDAs, IP telephones, other computer servers and other network devices). A computer serveris sold through enterprise channels for use in data centers and office/corporate environments.
A computer server is primarily accessed via network connections, versus directly-connecteduser input devices such as a keyboard or mouse. For purposes of this specification, a productmust meet all of the following criteria to be considered a computer server:

100

i)

is marketed and sold as a Computer Server;

101
102

ii)

is designed for and listed as supporting computer server operating systems (OS) and/or
hypervisors;

103
104

iii) is targeted to run user-installed applications typically, but not exclusively, enterprise innature;105106iv) provides support for error-correcting code (ECC) and/or buffered memory (including bothbuffered DIMMs and buffered on board (BOB) configurations)

107v) is packaged and sold with one or more ac-dc or dc-dc power supplies; and

108
109

vi) is designed such that all processors have access to shared system memory and are
visible to a single OS or hypervisor.

110
111
112
113
114

2) Network Equipment: A device whose primary function is to provide data connectivity among
an arbitrary combination of devices connected to its several ports. Data connectivity isachieved via the routing of data packets encapsulated according to Internet Protocol, Fibre
Channel, InfiniBand or other standard protocol. Examples of network equipment commonly
found in data centers are routers and switches.

115
116
117

3) Blade Storage: A storage product that is designed for use in a blade chassis. A blade storage
product is dependent upon shared blade chassis resources (e.g., power supplies, cooling) for
operation.

118
119
120

4) Cache: Temporary storage used to transparently store transitory data and which is notdirectly addressable by end-user applications. Primarily used for expediting access to or from(typically) slower devices.

121
122

F. Capacity: Capacity is reported in units of either binary bytes (1 MiB = 1,048,576 Byte) or decimalbytes (1 MB = 1,000,000 Byte).

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 3 of 16

123
124
125
126
127

1) Assigned Capacity: The amount of space on a system or data container which has beenallotted to be written by an end user or application. (Note: For thin provisioning systems, anassigned capacity number represents a promise that that amount of space will be provided on
demand; usable capacity is allocated as the container is written too. For fully-provisioned
systems, usable capacity must be committed at the same time the container is allocated.)

128
129

2) Effective Capacity: The amount of data stored on a storage product, plus the amount of
unused formatted capacity in the system.

130
131
132
133
134
135
136

3) Formatted (Usable) Capacity: The total amount of bytes available to be written after a storage
product or storage device has been formatted for use (e.g., by an object store, file system or
block services manager). Formatted capacity is less than or equal to raw capacity. It does notinclude areas set aside for system use, spares, RAID parity areas, checksum space, host- orfile system-level remapping, "right sizing" of disks, disk labeling and so on. However,formatted capacity may include areas that are normally reserved – such as snapshot setasides – if these areas may be configured for ordinary data storage.

1374) Free Space: The amount of unused, formatted capacity as reported by the storage product.

138
139
140
141
142

5) Raw (Addressable) Capacity: The sum total amount of addressable capacity of the storage
devices in a storage product. The raw capacity of a storage device is commonly understood
to be the number of bytes available to be written via SCSI or equivalent protocol. It does notinclude unaddressable space, ECC (error correcting code) data, remap areas, inter-sector
gaps, etc.

143

G. Operational States:

1441) Active State: The state in which a storage product is processing external I/O requests.

145
146
147
148

2) Idle State: An operational state in which the storage product is capable of completing I/Otransactions, but no active I/Os are requested or pending. The system may, however, be
servicing self-initiated I/Os from background data protection and cleansing, and otheroperations not initiated by the user.

149
150
151
152
153

i)

Ready Idle: The state in which a storage product is able to respond to arbitrary I/Orequests within the MaxTTFD limits for its taxonomy category, but is not receiving
external I/O requests. The storage product may perform routine housekeeping tasks
during Ready Idle, provided such operations do not compromise the product’s ability tomeet MaxTTFD requirements.

154
155
156
157
158
159

ii)

Deep Idle: A state in which one or more storage product components or subsystems havebeen placed into a low-power state for purpose of conserving energy. A storage productin Deep Idle may not be able to respond to I/O requests within the MaxTTFD limits for its
taxonomy category, and may need to perform a managed ‘wake-up’ function in order toreturn to a Ready Idle or Active State. Deep Idle capability must be a user-selected,
optional feature of the storage product.

160
161
162
163
164

H. Power Supply Unit (PSU): A device that converts ac or dc input power to one or more dc power
outputs for the purpose of powering a storage product. A storage PSU must be self-contained
and physically separable from the system and must connect to the system via a removable orhard-wired electrical connection. Note: Storage PSUs may be Field Replaceable Units (FRUs),
but in some cases may be further integrated with the storage product.

165
166

1) Ac-dc Power Supply: A PSU that converts line-voltage ac input power into one or more dc
power outputs.

167
168
169
170
171

2) Dc-dc Power Supply: A PSU that converts line-voltage dc input power to one or more dc
power outputs. For purposes of this specification, a dc-dc converter (also known as a voltage
regulator) that is internal to a storage product and is used to convert a low voltage dc (e.g., 12V dc) into other dc power outputs for use by storage product components is not considered a
dc-dc power supply.

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 4 of 16

172
173
174
175
176
177
178
179

3) Single-output Power Supply: A PSU that is designed to deliver the majority of its rated output
power to one primary dc output. Single-output PSUs may offer one or more standby outputs
that remain active whenever connected to an input power source. For purposes of thisspecification, the total rated power output from all additional PSU outputs that are not primaryor standby outputs shall be less than or equal to 20 watts. PSUs that offer multiple outputs atthe same voltage as the primary output are considered single-output PSUs unless those
outputs (1) are generated from separate converters or have separate output rectification
stages, or (2) have independent current limits.

180
181
182
183
184
185

4) Multi-output Power Supply: A PSU that is designed to deliver the majority of its rated output
power to more than one primary dc output for the purpose of powering a storage product.
Multi-output PSUs may offer one or more standby outputs that remain active wheneverconnected to an input power source. For purposes of this specification, the total rated power
output from all additional PSU outputs that are not primary and standby outputs must be
greater than or equal to 20 watts.

186
187

5) Redundant Power Supplies: Two or more PSUs that are configured to maintain uninterrupted
output load in the event of failure of one PSU.

188
189

I.

190
191
192

Product Family: A group of models/configurations that share a set of common attributes that arevariations on a basic design.
1) Common Product Family Attributes: A set of features common to all models/configurations
within a product family that constitute a common basic design. All models/configurations
within a product family must share the following:

193

i)

made by the same manufacturer;

194

ii)

be from the same model line or machine type;195iii) utilize the same model of storage controller;

196iv) fall under the same taxonomy category; and197v) contain equal or greater amount of cache than the corresponding certified configuration.

198
199
200
201
202

2) Optimal Configuration: A product configuration which is representative of a product’s
maximum peak energy efficiency performance (performance/watt) for a given workload type.
This configuration represents all products certified within the family under the associatedworkload type specified. This configuration is provided by the manufacturer and may be
optimized for the following workload types:

203
204

i)

Transaction (Block I/O products only): A workload optimized for random I/O usage
measured in I/O per second per watt;

205
206

ii)

Streaming (Block I/O products only): A workload optimized primarily for sequential I/O
usage, measured in MiB per second per watt;

207
208

iii) Composite (File I/O products only): A workload optimized for mixed I/O usage, measured
in MiB per second per watt.

209
210
211
212
213

J.

Other Definitions:
1) Scale-Up Storage: A storage product comprised of a discreet storage controller (with orwithout redundancy), which has a full view of all the storage devices in the storage product.
Incremental storage capacity is added by the addition of storage devices under the controlof the existing storage controller.

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 5 of 16

214
215
216
217
218
219
220

2) Scale-Out Storage: A storage product capable of being comprised of two or more discreet
storage controllers (with or without redundancy), combined with an overall integration or
aggregation function resulting in a single storage product view for attached servers. Eachdiscreet storage controller often has a partial view to a partition of the overall system's
storage devices, but this is not a fixed requirement. Incremental storage capacity is addedby the addition of storage devices under the control of the existing storage controller(s)and/or addition of additional storage devices along with additional controller(s).

221
222
223
224

3) Field-replaceable Unit (FRU): A unit, or component of a system that is designed to be
replaced “in the field;” i.e., without returning the system to a factory or repair depot. Field
replaceable units may either be customer-replaceable, or their replacement may require
trained service personnel.

225
226
227
228

4) High-availability (HA): The ability of a system to perform its function continuously (without
interruption) for a significantly longer period of time than the reliabilities of its individualcomponents would suggest. High availability is most often achieved through failure
tolerance.

229
230

5) Maximum Time to First Data (MaxTTFD): The maximum time required to start receiving
data from a storage product to satisfy a read request for arbitrary data.

231
232
233

6) RAS Features: An acronym for reliability, availability, and serviceability features. RAS issometimes also expanded to RASM, which adds “Manageability” criteria. The three primary
components of RAS as related to storage products are defined as follows:

234
235
236
237
238

i)

Reliability Features: Features supporting a storage product’s ability to perform its
intended function without interruption due to component failures. Technologies applied toincrease reliability include: component selection (MTBF), redundancy (both at a micro
and macro levels), temperature and/or voltage de-rating, error detection and correction
technologies.

239
240

ii)

Availability Features: Features that support a storage product’s ability to maximize normal
operating time and minimize planned and unplanned down time.

241
242

iii) Serviceability Features: Features that support a storage product’s ability to be serviced(e.g., hot-plugging).

243
244
245

iv) Advanced Data Recovery Capability: A collective term used in this specification to refer toerror detection and correction features such as RAID, mirroring / grid technology, or othercomparable advanced error detection and recovery systems

246
247
248
249

v) Non-disruptive Serviceability: Support for continued availability of data and response
times during all FRU and service operations; including break/fix, code patches,
software/firmware upgrades, configuration changes, data migrations, and system
expansion.

2507) Block I/O Loads:

251
252
253
254

i)

Random Read: Any I/O load in which consecutively issued read requests do not specify
adjacently addressed data. The term random I/O is commonly used to denote any I/Oload that is not sequential, whether or not the distribution of data locations is indeed
random.

255
256
257
258

ii)

Random Write: Any I/O load whose consecutively issued write requests do not specify
adjacently addressed data. The term random I/O is commonly used to denote any I/Oload that is not sequential, whether or not the distribution of data locations is indeed
random.

259
260iii) Sequential Read: An I/O load consisting of consecutively issued read requests toadjacently addressed data.

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 6 of 16

261
262

iv) Sequential Write: An I/O load consisting of consecutively issued write requests toadjacently addressed data.

263
264

v) Hot Band: An I/O load consisting of a collection of read and write requests that models
areas of higher frequency I/O activity over the addressed data.

2658) File I/O Loads:

266

i)

DATABASE: An I/O load that simulates an OLTP database Table and Log file scenario.

267
268

ii)

Software (SW) Build: An I/O load that simulates a large software project compilation orbuild phase of an EDA workflow.

269
270

iii) Video Data Acquisition (VDA): An I/O load that simulates acquisition of data from a
temporarily volatile source such as surveillance or big data ingestion.

271
272

iv) Virtual Desktop Infrastructure (VDI): An I/O load that simulates the workload generated bya hypervisor to support a heavy steady-state knowledge worker workload.

2739) Response Time: The time required for the UUT to complete an I/O request.

27410) Unit Under Test (UUT): The storage product being tested.

275

2

CERTIFYING PRODUCTS

276

2.1

Included Products

277
278

2.1.1

Products that meet all of the following conditions are eligible for ENERGY STAR certification,with the exception of products listed in Section 2.2:

279

i.

meet the definition of a Storage Product provided in Section 1 of this document;

280
281

ii.

are comprised of one or more SKUs and be able to be purchased in a single order from astorage product vendor;

282
283

iii.

are characterized within the Disk Set Online categories 2, 3, or 4 and NVSS Set Disk Access
categories Online 2, 4 or 4 with the following additional criteria;

284a) contain a controller with advanced data recovery capability

285b) support Block I/O and/or File I/O storage functions; and286c) implement scale-up or scale-out storage.

287

Excluded Products

2.2

288
289
290

2.2.1

Products that are covered under other ENERGY STAR product specifications are not eligible
for certification under the ENERGY STAR Data Center Storage specification. The full list of
specifications currently in effect can be found at www.energystar.gov/specifications.

291

2.2.2

The following products are specifically excluded from certification under this specification:

292

i.

Personal / Portable Data Storage Products;

293

ii.

Computer Servers;

294

iii.

Blade Storage Products;

295

iv.

Direct Attached Storage Products

296

v.

Storage Products capable of only object based storage;

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 7 of 16

297
298
299
300

vi.

Storage devices in the following categories of the taxonomy: Disk Set Near-Online, RVML Set
Removable Media Library, RNML Set Virtual Media Library and NVSS Set Memory Access.

Note: EPA has updated Section 2.1.1.iii and Section 2.2.2.vi to harmonize with the updated SNIA
taxonomy terminology. The effective scope of Draft 2 remains the same as proposed in Draft 1.

301

302

3

CERTIFICATION CRITERIA

303

3.1

Significant Digits and Rounding

304

3.1.1

All calculations shall be carried out with directly measured (unrounded) values.

305
306

3.1.2

Unless otherwise specified, compliance with specification limits shall be evaluated using
directly measured or calculated values without any benefit from rounding.

307
308
309

3.1.3

Directly measured or calculated values that are submitted for reporting on the ENERGY STAR
website shall be rounded to the nearest significant digit as expressed in the corresponding
specification limit.

310

3.2

Power Supply Requirements

311
312
313
314
315

3.2.1

Power Supply Units (PSUs): PSUs used in storage products eligible under this specification
shall meet the following requirements when tested using the EPRI Generalized Internal Power
Supply Efficiency Test Protocol, Rev. 6.7.1 (available athttps://www.plugloadsolutions.com/docs/collatrl/print/Generalized_Internal_Power_Supply_Effi
ciency_Test_Protocol_R6.7.1.pdf).

316
317
318

3.2.2

Efficiency and Power Factor in Primary Embedded Equipment: Embedded PSUs that power
primary components of the storage product, including controllers and drawers, must meet therequirements in Table 1 and Table 2.

319
320
321
322

i.

Efficiency: A storage product PSU shall meet efficiency requirements as specified in Error!
Reference source not found..
Table 1: Efficiency Requirements for PSUs
20%
50%
Power Supply Type
Rated Output Power
Load Load

100%
Load

Multi-output(Ac-Dc)All Output Levels

88%

92%

88%

Single-output(Ac-Dc)All Output Levels

90%

94%

91%

323
324
325

Note: Stakeholders commented that the relevant 80Plus equivalent level for 230V redundant power
supplies should apply to each single and multi-output power supplies. In Draft 1, the multi-output
requirement references the 80Plus Gold 230V non-redundant equivalent level.

326
327
328
329

EPA has confirmed the frequency of multi-output IPSs with redundancy features in the storage market
and therefore supports maintaining consistency between the two types of IPS output. As a result, themulti-output requirements in Table 1 have been revised to align with the 80Plus equivalent 230V
redundant requirements.

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 8 of 16

330
331

ii.

332

Power Factor: A storage product PSU shall meet power factor requirements as specified inTable 2.
Table 2: Power Factor Requirements for PSUs
20%
50%
PSU Type
Rated Output Power
Load Load
Redundant and NonRedundant Capable
All Output Levels
0.80
0.90
PSU

333
334

100%
Load
0.95

iii. Embedded PSUs that do not power primary components of the storage product are notsubject to PSU requirements.

Power Modeling Requirements

335

3.3

336
337
338
339
340
341
342
343

Note: EPA has engaged in further discussion with stakeholders about the relevancy of power modelingtools that generate energy use estimates based on real world usage rather than maximum power draw.
The group determined that it is not appropriate to require real world energy modeling at this time , asmodeling is still being refined and most do not have full confidence in the results yet. As such, EPA is
proposing to remove the power modeling requirements in Draft 2. However, the Agency would like tocontinue engaging with stakeholders regarding other potential uses for power modeling tools at the
datacenter level and how the ENERGY STAR program and manufacturers can help educate customers
on how to use these tools to save energy.

344

3.4

345
346
347
348

3.4.1

349

Energy Efficiency Active State Requirements for Block I/O Systems
To certify for ENERGY STAR, each Optimal Configuration point submitted for a block I/O
storage product or storage product family must meet the following applicable active state
requirements in Table 3 for each workload type for which it is certified.
Table 3: Active State Requirements for Block I/O Storage Products
Minimum
Specific
Applicable Units
Workload Type
Performance/Watt
Workload Testof Ratio
Ratio
Transaction
Hot Band
28.0
IOPS/watt
Streaming
Sequential Read
2.3
MiBS/watt
Streaming
Sequential Write
1.5
MiBS/watt

350
351
352
353
354

3.4.2

An Optimal Configuration point submitted for a streaming workload must meet either thesequential read or sequential write requirement in Table 3 above, but is not required to meetthat value for both workload tests. Both test values will be reported and displayed publicly
regardless of whether they meet the criteria in Table 3.

355
356

Note: EPA received stakeholder feedback on both the proposed transaction and streaming requirements
in Draft 1.

357
358
359
360

A first concern was that the Draft 1 transaction requirements did not provide a path to certification fortransaction optimized products that use a mixture of HDD and SSD technology unless there was a 7.2k
HDD variation of the product that met the criteria. This is problematic as for transaction workloads,
combined products with 10k and 15k HDDs and SDDs are an attractive choice for efficiency and cost.

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 9 of 16

361
362
363
364
365
366
367
368
369
370

EPA reviewed the data set and agrees with the concern expressed by stakeholders. As a result, EPA has
proposed in Section 3.5.3.ii below that configurations may be tested with a mixture of HDD and SDD
storage devices, often referred to as hybrid storage products. By allowing hybrid storage products tocertify as ENERGY STAR, EPA’s analysis shows that the data now supports a more challenging
transaction requirement of 28 IOPS/watt which still allows a small portion of lower cost 10k HDD onlytransaction products to continue to earn the ENERGY STAR under Version 2.0 but the majority ofcertified products will be more efficiently designed hybrid SSD/HDD and all SSD based products.. Thisaligns with EPA’s desire to highlight for purchasers higher efficiency SSDs while allowing the continued
use of lower cost HDDs in configurations that are still relatively efficient for transaction workloads,
typically through a hybrid approach.

371
372

A second concern was that Draft 1 streaming requirements do not allow 7.2k HDD based products tomeet the requirements because 10k and 15k HDD data in the data set artificially raised the Draft 1 level

373
374
375
376
377

EPA has reviewed the data and proposed revised streaming requirements that specifically target the 7.2k
HDD product offerings. EPA acknowledges that the 10k and 15k HDD data in the data set appears tohave been submitted as superfluous data that was part of transaction optimized products, and that thesedata points do not represent real world steaming optimized products. EPA anticipates that the revisedlevels will allow roughly 31% of 7.2k HDD based products to meet the requirements.

378
379
380

3.5
3.5.1

381
382
383
384
385
386
387
388
389

Energy Efficiency Feature Requirements
To certify for ENERGY STAR, a storage product must contain the following feature,
implemented as specified:
i.

3.5.2

Adaptive Active Cooling: Primary components of a storage product must utilize adaptive
cooling technologies that reduce the energy consumed by the cooling technology inproportion to the current cooling needs to the storage product. (e.g., reduction of variable
speed fan or blower speeds at lower ambient air temperature). This requirement is notapplicable to devices that employ passive cooling.
A storage product shall make available to the end user configurable / selectable features listed
in Table 4 in quantities greater than or equal to those listed in Table 5.
Table 4: Recognized COM Features
FeatureVerification Requirement
COM: Thin Provisioning
SNIA verification test
COM: Data Deduplication
SNIA verification test
COM: Compression
SNIA verification test
COM: Delta Snapshots
SNIA verification test

390
391
392

Table 5: COM Requirements for Disk Set and NVSS Disk Set Access Online 2, 3 and 4 Systems
Minimum number ofStorage ProductCOMs required to be
Categorymade available
Online 2
1
Online 32Online 4
3

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 10 of 16

393
394

Note: EPA has revised the title of Table 5 to cover both Disk Set and NVSS Disk Set Access storage
products.

395

3.6

396
397

3.6.1

398

Information Reporting Requirements
Active and Idle State Efficiency Disclosure: To certify for ENERGY STAR, all active and idle
state test results based on workload tests listed in Table 6 or Table 7 shall be reported:
Table 6: Required Workload Tests for all Block I/O Configurations
Workload Test
Hot BandRandom Read
Random Write
Sequential Read
Sequential Write
Ready Idle2

399

Table 7: Required Workload Tests for all File I/O Configurations
Workload TestDATABASE
SW Build
VDA
VDI
Ready Idle3

400
401
402

3.6.2

403

404
405
406
407
408
409
410

Workload Weighting Requirements: The weighted percentages shown in Table 8 or Table 9
shall be used to calculate the appropriate Optimal Configuration point for a given storage
product.

Table 8: Workload Weighting Requirements for all Block I/O Systems
Transaction
Streaming
Workload Test
Capacity Optimization
Optimization
Optimization
Hot Band100%0%0%Sequential Read
0%
50%
0%
Sequential Write
0%
50%
0%
Ready Idle
0%
0%
100%
Example: To optimize for a streaming workload, manufacturers should identify a system configurationand storage device count where the weighted sum (per Table 7) of the Sequential Read and Sequential
Write results are maximized. The resulting storage device count should be used as the streaming
optimization point for ENERGY STAR testing and certification. The same weighting of the sums should
also be used for subsequent certification measurements (e.g. determining optional flexible or mixedcertification ranges).
2

SNIA defined workload tests in Table 6, Table 7, and through the rest of this document can be found in
the “SNIA EmeraldTM Power Efficiency Measurement Specification” Version 4.0. Further detail may befound at www.snia.org/green.

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 11 of 16

411

Table 9: Workload Weighting Requirements for all File I/O Systems
Transaction
Streaming
Composite
Workload Test
Optimization
Optimization
Optimization
DATABASE
50%0%0%SW Build
0%
0%
100%
VDA
0%
100%
0%
VDI
50%
0%
0%

412
413
414

3.6.3

Testing Data Requirements for all Scale-up Storage Products:: The following test data isrequired for each configuration submitted for certification as ENERGY STAR:

415

i.

416
417
418
419
420
421
422
423
424
425

ii.

426

v.

The manufacturer must choose a workload type for testing from 1.I.2.

The manufacturer must choose a single type of or combination of hard disk storage devices
and solid state storage devices which result in the highest work/watt for that workload type.
The amount of solid state storage devices in the tested configuration in a hybrid disk/solidstate configuration cannot exceed 30% of the addressable storage being represented by solidstate unless the product is testing with only solid state devices in which all devices in theconfiguration shall be solid state devices.
iii. For the chosen workload type, physical data for all measurements listed in Table 6 or Table 7
shall be submitted for a manufacturer determined Optimal Configuration point Additionally:
iv. To certify additional workload types, repeat the above starting at 3.5.3.i for a different
workload.

427
428
429
430

The following rules apply to all testing above:(a) Verification testing of COM features (Table 4) specified by the storage product shall be
executed at least once using storage devices of the vender’s choice. Once verified there
is no requirement to re-execute the COM verification testing procedure with different
storage devices.

431

Note: EPA is proposing the following changes to the Test Data Requirement section above:

432
433
434
435
436
437
438
439
440
441
442
443

Specified in Section 3.5.3.ii that optimal configurations may contain a mixture of hard disk storage devices
only, solid state storage devices only or a combination of hard disk storage and solid state storage
devices where the maximum percentage of addressable space provided by solid state devices cannot
exceed 30% of the product’s total addressable space. This allows manufacturers to test hybrid HDD/SSD
products which are efficient and prevalent on the market now while ensuring that the SSD portion of the
product does not dominate the test results of the optimal configuration. In recent discussions with
manufacturers, a 30% cap on SSD capacity in hybrid systems was agreed to be a reasonable proxy forcommonly sold hybrid HDD/SSD configurations in the market today. Setting this cap will also enable EPA
and stakeholders to create a dataset of comparable products that will support future evaluation ofefficiency too. EPA welcomes stakeholder feedback on this approach as well as any supporting data thatshows that a percentage different than 30% is more appropriate as a cap for the amount of SSD capacity
permitted in a hybrid HDD/SSD optimal test point configuration.

444
445

In addition, EPA removed Section 3.5.3.v.b) as it pertained to products optimized to the capacity
configuration which was removed in Draft 1

446
447

3.6.4

Testing Data Requirements for all Scale-out Storage Products: The following test data isrequired for each configuration submitted for certification as ENERGY STAR:

448

i.

All testing and data requirements of Sections 3.5.3 shall be followed.

449

ii.

When testing, the smallest marketed quantity of storage controllers / nodes shall be tested.

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 12 of 16

450
451
452

iii. Additional systems with a larger quantity of storage controllers may be optionally submitted.
3.6.5

453
454
455
456

Data for display on the ENERGY STAR website shall be submitted for each ENERGY STAR
certified storage product or storage product family.
i.

3.6.6

Whenever possible, Partners should also provide a hyperlink to a more detailed power
calculator on their website that purchasers can use to understand power and performancedata for specific configurations within the product family.
The following information will be displayed on the ENERGY STAR website:

457

i.

Product model name, model number, and SKU or other configuration identification number;

458

ii.

A list of important product characteristics, including;459(a) System configuration and tested I/O type;460(b) Storage controller details (e.g. model name and number);

461(c) Software configuration and transfer protocols used in testing;462(d) Storage controller power supply information;

463(e) Storage device drawer power supply information;

464(f) Storage devices used per optimization points;

465(g) Input power and environmental characteristics during testing;

466(h) System power optimization capabilities;

467(i) Inlet air temperature and power consumption reporting capabilities.

468
469

iii. A list of optimal configurations of certified product families; and disclosure of the time periodused for data averaging.

470
471

iv. A list of power management and other power saving features available and enabled bydefault;

472

v.

473

vi. For product families, a list of certified storage products within the family; and

474
475

vii. Energy Efficiency Performance data (performance/watt) for required active and idle state test
reporting specified in Table 10 or Table 11 below:

476

Specified thermal measurements conducted during testing;

Table 10: Active and Idle State Efficiency Block I/O Test Results Displayed
Transaction
Streaming
Capacity
Workload Test
Optimization
Optimization
Optimization
Hot Band

Yes

No

No

Random Read

Yes

No

No

Random Write

Yes

No

No

Sequential Read

No

Yes

No

Sequential Write

No

Yes

No

Ready Idle

Yes

Yes

Yes

477

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 13 of 16

478

Table 11: Active and Idle State Efficiency File I/O Test Results Displayed
Transaction
Streaming
Composite
Workload Test
Optimization
Optimization
Optimization
DATABASE

Yes

No

No

SW Build

No

No

Yes

VDA

No

Yes

No

VDI

Yes

No

No

Ready Idle

Yes

Yes

Yes

479
480
481

3.6.7

482

The following test information shall be submitted as part of the certification process, but will not
be displayed on the ENERGY STAR website:i.

Discrete power and performance data for all tested configurations;

483

3.7

Standard Performance Data Measurement and Output Requirements

484
485
486

3.7.1

Data Elements: Disk Set and NVSS Disk Set Access Online 3 and Online 4 storage products
shall be capable of measuring and reporting the following data elements at the storage productlevel:

487
488
489
490

i.

Input Power, in watts. Input power measurements must be reported with accuracy within±5% of the actual value for measurements greater than 200 W, through the full range of
operation. For measurements less than or equal to 200 W, the accuracy must be less thanor equal to 10 W multiplied by the number of installed PSUs; and

491

ii.

Inlet Air Temperature, in degrees Celsius, with accuracy of ± 2°C.

492

3.7.2

Reporting Implementation:

493
494

i.

Data shall be made available in a published or user-accessible format that is readable bythird-party, non-proprietary management systems;

495
496

ii.

Data shall be made available to end users and third-party management systems over a
standard network connection;

497
498
499

iii.

Data shall be made available via embedded components or add-in devices that are
packaged with the storage product (e.g., a service processor, embedded power or thermal
meter or other out-of-band technology, or pre-installed OS);

500
501

iv. When an open and universally available data collection and reporting standard becomes
available, manufacturers should incorporate the universal standard into their products.

502

v.

503

3.7.3

Inlet air temperature data shall be reported for the controller chassis only.

Sampling Requirements:

504
505

i.

Input power: Input power measurements must be sampled internally to the storage productat a rate of greater than or equal to 1 measurement per contiguous 10 second period.

506
507

ii.

Inlet air temperature: Inlet air temperature measurements must be sampled internally to thestorage product at a rate of greater than or equal to 1 measurement every 10 seconds.

508
509
510

iii.

Timestamping: Systems that implement time stamping of environmental data shall sample
internally to the storage product data at a rate of greater than or equal to 1 measurement
every 30 seconds.

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 14 of 16

511
512
513
514
515
516

iv.

3.7.4

Management Software: All sampled measurements shall be made available to externalmanagement software either via an on-demand pull method, or via a coordinated pushmethod. In either case the system’s management software is responsible for establishingthe data delivery time scale while the storage product is responsible to assuring datadelivered meets the above sampling and currency requirements.

Documentation Requirements: The following information shall be included in the data submission:

517
518

i.
ii.

Guaranteed accuracy levels for power and temperature measurements, and
The time period used for data averaging (if present).

519

Note: EPA has proposed the following three changes in Section 3.8:

520
521

- Updated the Online 3 and Online 4 references to include both Disk Set and NVSS Disk Set Accessstorage product types, aligning with the new taxonomy proposed above.

522- Removed any remaining references to “optional” in criteria relating to inlet air temperature reporting.

523- Clarified that reporting inlet air temperature at the controller chassis location(s) only.

524

4

525

4.1

526
527

TESTING
Test Methods

4.1.1

Test methods identified in Table 12 shall be used for purposes of evaluating active and idle
state storage product energy efficiency.

528

Table 12: Test Methods for ENERGY STAR Certification
Product Type
Test Method
All

ENERGY STAR Test Method for Data Center Storage Equipment,
Rev. April 2019.

529
530
531

Note: EPA anticipates the full adoption of SNIA’s new Emerald V4 test and measurement specification
within an updated draft of the ENERGY STAR Test Method for Data Center Storage to be released with
the Final Draft of this specification.

532

4.2

533

Number of Units Required for Testing

4.2.1

Representative Models shall be selected for testing per the following requirements:

534
535
536

i.

For certification of an individual product model, a product configuration equivalent to thatwhich is intended to be marketed and labeled as ENERGY STAR is considered theRepresentative Model;

537
538
539
540

ii.

For certification of a product family one or more Optimization Configurations shall be tested
and submitted. Within the family covered by one or more Optimal Configurations,manufacturers continue to be held accountable for any efficiency claims made about theirproducts, including those not tested or for which data was not reported;

541
542

5

EFFECTIVE DATE
5.1.1

Effective Date: The Version 2.0 ENERGY STAR Data Center Storage specification shall take

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 15 of 16

543
544
545
546

effect on TBD. To certify for ENERGY STAR, a product model shall meet the ENERGY STAR
specification in effect on its date of manufacture. The date of manufacture is specific to each
unit and is the date on which a unit is considered to be completely assembled.
Note: EPA anticipates completing this specification development effort in the spring of 2020.

547
548
549
550
551

552
553

5.1.2

6

Future Specification Revisions: EPA reserves the right to change this specification should
technological and/or market changes affect its usefulness to consumers, industry, or theenvironment. In keeping with current policy, revisions to the specification are arrived at throughstakeholder discussions. In the event of a specification revision, please note that the ENERGYSTAR certification is not automatically granted for the life of a product model.

CONSIDERATIONS FOR FUTURE REVISIONS
TBD

554

ENERGY STAR Program Requirements for Data Center Storage – Eligibility Criteria

Page 16 of 16