Next Generation Computing Systems
パネル討論：新時代におけるマルチコア戦略

Multicore:an IBM’s Perspective
May 13, 2008
Toshi Sanuki, Ph.D.
Next Generation Computing Systems
Yamato Laboratory, IBM-Japan

2008-05-13 for IEICE-ICD & IPSJ-ARC© 2008 IBM Corporation

Next Generation Computing Systems

Key Industry Trends
 More transistors and slower clocks mean multicore designs
and more parallelism required Thicker “memory wall” means that communication efficiency
will be even more essential
 Limitations of commodity processors will further increase
heterogeneity and system complexity

Source:Jack Dongarra, et al, “The Impact of Multicore on Computational Science Software”
http://www.ctwatch.org/quarterly/articles/2007/02/the-impact-of-multicore-on-computational-science-software/1/
2

2008-05-13 for IEICE-ICD & IPSJ-ARC© 2008 IBM Corporation

Next Generation Computing Systems

Example of IBM’s Multicore Processors
POWER5POWER6Z10 EC PU

BlueGene/P

Xbox360 CPU

Cell/B.E.

Technology

130nm

65nm

65nm

90nm

90nm

90nm (1st Gen)Die Size (mm2)

389

341

465

169

165

235

Transistor (M)

250

790

994

208

168

241

ISA Type

Homogeneous

Homogeneous

Homogeneous

Homogeneous

Homogeneous

HeterogeneousCores/Chip2244

39 (1PPE+8SPE)

Threads/Core22

112PPE:2 / SPE:1

L1 Cache (KB)

I:64, D:32

I:64, D:64 /core

I:64, D:128
L1.5: 3,072 /PU

I:32, D:32/core

I:32, D:32 /core

PPE:I/D: 32
SPE: LS 256

L2 Cache (MB)

1.9 (Shared)

8 (4/Core)48 / Book

0.002 / Chip

1 (Shared)

PPE: 0.5

L3 Cache (MB)32 (External)

32 (External)~352G /Book

8 (Shared)----

Clock (GHz)

1.9 - 2.3

>5.0

4.4

0.85

3.2

>3.2

Target System
3General Purpose Servers

2008-05-13 for IEICE-ICD & IPSJ-ARC

Workload Optimized Systems© 2008 IBM Corporation

Next Generation Computing Systems

Momentum for Heterogeneity Mixed compute power, ISA, etc.
 Specialization (accelerators), driven by performance & efficiency– e.g., Cell-blades, Roadrunner, GameFrame, lots more…
Software Enablement Complexity

Monolithic

P

Multicore
Homogeneous

PGeneral
purpose ISAPPPSingle ISA

MulticoreNon-homogeneous

PP

Single ISA,different
performanceP

Multicorewith
Reconfigurable
HardwareMulticoreMulti-ISAPP

QR

Multiple ISA(CPU, GPU, DSP, …)

PP

QX

ISA plus
reconfigurable logic

 SW challenge:– Integrated programming model (not just accelerate through I/O)
4

2008-05-13 for IEICE-ICD & IPSJ-ARC© 2008 IBM Corporation

Next Generation Computing Systems

IBM SDK for Multicore Acceleration:
Software Enablement for Multicore Memory-Hierarchy Systems
Allow programming without awareness of ISA, architecture differencesSupport hybrid programming model (PPE-SPE, X86-Cell/B.E.)
Applications
Libraries
DaCS

IDE

ALF

Topology
Process
Management

Process
Management
Error
Handling

Data
Partitioning

OthersWorkload
Distribution

Compilers(Single/Dual)

gdb

Synchronization

Send / Receive

Remote DMA

Mailbox

Error HandlingTraceanalysis

Tooling
Platform
DMA5Mailbox

2008-05-13 for IEICE-ICD & IPSJ-ARC

PCIeDriverOpen
MPISocketsetc© 2008 IBM Corporation

Next Generation Computing Systems

Typical Multicore Exploitation Techniques
Existing Applications
Automatic and efficient exploitation ofparallelism through compiler, operating
system and hardware support
Technology to boost utilization throughconsolidation
Leverage middleware and OScontainers
New tools, reuseable software
components, pre-tuned for multicore,
incremental use of patterns

New (Emerging) Applications
The “accelerator” pattern– Fundamental programming models andlanguages designs to support
heterogeneous, asynchronous
processor complexes

The streaming pattern– Programming models for streaming
applications– Optimized runtimes for processing ofmassive data streams

New programming models:– Multicore concurrency at a Java level(e.g. X10)
– New models built to assume massive
concurrency

More integrated approach6

2008-05-13 for IEICE-ICD & IPSJ-ARC© 2008 IBM Corporation

Next Generation Computing Systems

Holistic Approach Becomes More Crucial
SW People

Operations
Applications
Language/Programming Models
Libraries
Compiler/Tools
Application Server/Middleware
Core Run-time
Operating System
Virtualization/Hypervisor
Interconnect
ISA
Micro-architecture
LayoutDesign Rules/Style
Process/Materials/Physics

HW People

Holistic
View

Example: IBM BlueGene has its own stack with large performance boost from working across layers.
7

2008-05-13 for IEICE-ICD & IPSJ-ARC© 2008 IBM Corporation

Next Generation Computing Systems

Expectations to Academia (in Japan)
 Measurement / Evaluation methodology for Multicore Era– Benchmarking for emerging workloads• Still LINPACK in Top500?

 Application ideas Global Presence and Leadership– Global collaboration:• e.g., Sony-Toshiba-IBM collaboration created Cell/B.E. innovation.
– Different ideas and Multi-disciplinary stimulations

8

2008-05-13 for IEICE-ICD & IPSJ-ARC© 2008 IBM Corporation

Next Generation Computing Systems

Thank You!

92008-05-13 for IEICE-ICD & IPSJ-ARC© 2008 IBM Corporation

Next Generation Computing Systems

Special Notes© Copyright International Business Machines Corporation 2008, All Rights Reserved
This document was developed for IBM offerings in the United States as of the date of publication. IBM may not make these offerings available in other countries, and theinformation is subject to change without notice. Consult your local IBM business contact for information on the IBM offerings available in your area. In no event will IBM beliable for damages arising directly or indirectly from any use of the information contained in this document.
Information in this document concerning non-IBM products was obtained from the suppliers of these products or other public sources. Questions on the capabilities of nonIBM products should be addressed to the suppliers of those products.
IBM may have patents or pending patent applications covering subject matter in this document. The furnishing of this document does not give you any license to thesepatents. Send license inquires, in writing, to IBM Director of Licensing, IBM Corporation, New Castle Drive, Armonk, NY 10504-1785 USA. All statements regarding IBM
future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. The information contained in this document has notbeen submitted to any formal IBM test and is provided "AS IS" with no warranties or guarantees either expressed or implied.
All examples cited or described in this document are presented as illustrations of the manner in which some IBM products can be used and the results that may beachieved. Actual environmental costs and performance characteristics will vary depending on individual client configurations and conditions.
IBM Global Financing offerings are provided through IBM Credit Corporation in the United States and other IBM subsidiaries and divisions worldwide to qualified commercial
and government clients. Rates are based on a client's credit rating, financing terms, offering type, equipment type and options, and may vary by country. Other restrictions
may apply. Rates and offerings are subject to change, extension or withdrawal without notice.
IBM is not responsible for printing errors in this document that result in pricing or information inaccuracies.
All prices shown are IBM's United States suggested list prices and are subject to change without notice; reseller prices may vary.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
Many of the features described in this document are operating system dependent and may not be available on Linux. For more information, please check:
http://www.ibm.com/systems/p/software/whitepapers/linux_overview.html
Any performance data contained in this document was determined in a controlled environment. Actual results may vary significantly and are dependent on many factors
including system hardware configuration and software design and configuration. Some measurements quoted in this document may have been made on development-levelsystems. There is no guarantee these measurements will be the same on generally-available systems. Some measurements quoted in this document may have been
estimated through extrapolation. Users of this document should verify the applicable data for their specific environment.
The following terms are trademarks of International Business Machines Corporation in the United States and/or other countries: alphaWorks, BladeCenter, Blue Gene,
ClusterProven, developerWorks, e business(logo), e(logo)business, e(logo)server, IBM, IBM(logo), ibm.com, IBM Business Partner (logo), IntelliStation, NUMA-Q,
PartnerWorld, PowerPC, PowerPC(logo), pSeries, TotalStorage, xSeries; Advanced Micro-Partitioning, eServer, Micro-Partitioning, NUMACenter, On Demand Business logo,OpenPower, POWER, Power Architecture, Power Everywhere, Power Family, Power PC, PowerPC Architecture, POWER5, POWER5+, POWER6, POWER6+, System z,
System z10, z10, Redbooks, System p, System p5, System Storage, VideoCharger, Virtualization Engine.
A full list of U.S. trademarks owned by IBM may be found at: http://www.ibm.com/legal/copytrade.shtml.
Cell Broadband Engine and Cell Broadband Engine Architecture are trademarks of Sony Computer Entertainment, Inc. in the United States, other countries, or both.
Xbox 360 is a trademark of Microsoft Corporation.
Rambus is a registered trademark of Rambus, Inc.
XDR and FlexIO are trademarks of Rambus, Inc.
UNIX is a registered trademark in the United States, other countries or both.
Linux is a trademark of Linus Torvalds in the United States, other countries or both.
Fedora is a trademark of Redhat, Inc.
Microsoft, Windows, Windows NT and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries or both.
Intel, Intel Xeon, Itanium and Pentium are trademarks or registered trademarks of Intel Corporation in the United States and/or other countries.
AMD Opteron is a trademark of Advanced Micro Devices, Inc.
Java and all Java-based trademarks and logos are trademarks of Sun Microsystems, Inc. in the United States and/or other countries.
TPC-C and TPC-H are trademarks of the Transaction Performance Processing Council (TPPC).
SPECint, SPECfp, SPECjbb, SPECweb, SPECjAppServer, SPEC OMP, SPECviewperf, SPECapc, SPEChpc, SPECjvm, SPECmail, SPECimap and SPECsfs are trademarksof the Standard Performance Evaluation Corp (SPEC).
Other company, product and service names may be trademarks or service marks of others.

10

2008-05-13 for IEICE-ICD & IPSJ-ARC© 2008 IBM Corporation