[添付資料3-1-2] SS研 Grid Computing 2004 WG フォーラム資料

2004/12/1

1

サイエンティフィック・システム研究会 グリッドコンピューティングフォーラム2

世界におけるグリッドプロジェクト例•USA- Extensible Teragrid Facility (ETF)- DOE Science Grid
- Open Science Grid (OSG)• EU FP6- EGEE- DEISA- CoreGRID- UNIGRIDS・・・・・・・・・・・・• UK- e-Science• France- ACI Grid
- Grid5000• Germany- D-Grid-VIOLA
・・・・・・・・・・・・
他にも Nordugrid, SweGrid(Sweden)INFN grid (Italy）など。

欧米におけるグリッドプロジェクトについて

２００４年１２月１日
情報・システム研究機構 国立情報学研究所
リサーチグリッド連携研究センター
三浦 謙一

34Teragrid Network Topology

米国- Extensible Teragrid Facility (ETF)- DOE Science Grid
- Open Science Grid (OSG)

540Gbps

LA-HubCHICAGO-HubIU
30Gbps30GbpsPurdue30Gbps32 Pentium4
52 2p Madison
20 2p Madison
Myrinet96 Pentium4
64 2p Madison
Myrinet

100 TB DataWulf

96 GeForce4 Graphics Pipes
20 TB

Caltech

ORNL
TACC

ANL
30Gbps

1.1 TF
Power4Federation

128 2p Madison
256 2p Madison
Myrinet500 TB FCS SANSDSC(San Diego)
Source: Peter Beckman, ANL

256 2p Madison
667 2p Madison
Myrinet230 TB FCS SAN

NCSA(Urbana,IL)

30Gbps

16 2p (ER)Madison
Quadrics

750 4pAlpha EV68
Quadrics75 TB Storage

6DOE Science Grid

TeraGrid(ETF）からCyberInfrastructureへ

128p
EV7Marvel

4p VisPSC(Pittsburgh)

[添付資料3-1-2] SS研 Grid Computing 2004 WG フォーラム資料

2004/12/1

7

8Griphyn,iVGDL,PPDGからOpen Science Grid(OSG)へ• Building a community driven engineered Grid infrastructure for large-scalescience:– Building from Grid3, a 25 site >3000 CPU loosely coherent grid
infrastructure through partnering of NSF iVDGL, GriPHyN, DOE PPDG,
US LHC software and computing.
– Commitment from US LHC Tier-1 and Tier-2 centers and DOE
Laboratories to make resources accessible by and make contributions tothe consortium - esp LHC ramp up over the next 4+ years.
– Peering with other Grids, especially EGEE/LCG in Europe.
– Partnering with Grid infrastructures in the US especially TeraGrid as wellas university campus Grids.
– Reaching out to scientific communities beyond the original physics drivers:e.g., biology, chemistry, astronomy.
– Outreach & education to enable remote and small community
participation.

910

EU Framework Program 6 (FP6)ヨーロッパ

インフラ整備研究開発

eInfrastructure - Grids
Next generation Grid RI

1112

世界におけるグリッド研究開発状況（ﾖｰﾛｯﾊﾟ)EGEE (Enabling Grids for E-Science in Europe) の例

orktwneing

specifi

Supercomputers(DEISA)resne earc
tw ho r rekin su
g & lts
Gr fromidre IST
sear (e.gch .
)operational support
federating NIcstraining
e rv
i ce
s

pan-european grid
(EGEE)(SEE-GRID)

jiesv itcti
AAAhacrea
middleware
rest
global file systemoin(international dimension: participation of US, Russian, … organisations; links tointernational initiatives, e.g. cyberinfrastructure/Teragrid)Operations
CenterResourceCenter(Processors,disks)
Grid server Nodes
Resource
CenterResource
CenterResource
CenterRegional
Support Regional
Support

予算:３２Ｍ Ｅｕｒｏ（２００４）
参加機関:＞７０
計算機資源:
３０８４ ＣＰＵｓ（当初）Regional
８７６８ ＣＰＵｓ（Ｍｉｄ ２００５）
SupportCenter＞１０(Support for Applications アプリ分野：Local Resources)
主なアプリ：高ｴﾈﾙｷﾞｰ物理学向け
データグリッド
ネットワーク：ＧＥＡＮＴ－ＮＲＥＮｓ（１０Ｇｂｐｓ）
プロジェクト開始時期：２００４年４月
中心的機関: ＣＥＲＮ（ジュネーブ）Regional
Support

[添付資料3-1-2] SS研 Grid Computing 2004 WG フォーラム資料

13

データグリッド （ CERN LHC）
~PByte/sec

Online System

The DEISA (Distributed European Infrastructure forSupercomputer Applications) の例

event
simulation

event
reconstruction

human=2m

CMS detector: 15m X 15m X 22m

High bandwidth vpn- qos(NREN-GEANT

12,500 tons, $700M.

~2.5 Gbits/sec

Tier 1
GermanRegional Center

French RegionalCenter14

世界におけるグリッド研究開発状況（ﾖｰﾛｯﾊﾟ)~100
MBytes/sec

Tier 0 +1

2004/12/1

Italian Center

予算:１８Ｍ Ｅｕｒｏ
参加機関:11
計算機資源（Phase 1）：
AIX Super-Cluster （4 sites)
４０００ CPUｓ（24Tflops）

National computing facility

FermiLab, USA
Regional Center

Japanese
Regional Center~0.6-2.5 Gbps

analysis

Tier2 Center
Tier2 Center
Tier2 Center
Tier2 Center
Tier2 Center

Tier 2~0.6-2.5 Gbps

Tier 3
InstituteInstitute Institute~0.25TIPS

Physics data cache

CERN/CMS data goes to 6-8 Tier 1 regional centers,
and from each of these to 6-10 Tier 2 centers.

InstitutePhysicists work on analysis “channels” at 135
institutes. Each institute has ~10 physicists working
on one or more channels.

100 - 1000
Mbits/sec

Courtesy
HarveyNewman,CalTech andCERN

Tier 4IDRIS

Extended Grid services

Garching

2000 physicists in 31 countries are involved in this20-year experiment in which DOE is a major player.

Workstations

ネットワーク：ＧＥＡＮＴ－ＮＲＥＮｓ（１０Ｇｂｐｓ）
プロジェクト開始時期：２００４年5月
運用開始時期： Q1 2005 (Phase1)
Q3 2005(Phase 2)
中心的機関: IDRIS(ﾌﾗﾝｽ）

JulichCINECAPhase1 SuperCluster (Q1 2005)

15

DEISA参加機関（当初）

16

DEISA – Phases 1 (Q1 2005) andPhase 2 (Q3 2005)
Phase 1: AIX Super-Cluster:4000 processors (5 to 8 Gf per processor)
24 Teraflops integrated peak performance
125 cabinets spread over 3 countries (Germany,France, Italy)
IBM systems : 690, 690+, 655+
Diversified configurations
Phase 2 ( Q3 2005):
Incorporation of other sites (CSC, SARA) andother partners.
heterogeneous extension (SARA Linux ALTIX SGI
platform to start, vector platforms, …)
Higher VPN bandwidth (10 Gb or more across platforms).
The Geant2 infrastructure is critical for DEISA.

17

FP6： New Grid Research Projects
2002-2006
Total EU Funding:
52 M€

K-WF Grid
Knowledge based
workflow &collaboration

UniGridS
Extended OGSA
Implementation basedon UNICORE

HPC4U
Fault tolerance,
dependability
for Grid

CoreGRID:
An NoE operated as a Research Laboratory
Scientific Advisory Board

GRIDCOORD
Building the ERA
in Grid research

Grid-based generic enabling
application technologies tofacilitate solution of industrial
problems
SIMDATEU-driven Grid services
architecture for businessand industry
NEXTGRID

Mobile Grid architectureand services for dynamicvirtual Organisations
AKOGRIMO

European-wide virtual laboratory for longer term Grid
research - foundation for next generation Grids
COREGRID

18

Members
GeneralAssembly
inteliGRID
Semantic Grid
based virtual organisations

Provenance
Provenance for Grids

CoreGRID
Institutes

Specific Task Forces

Monitoring Committee
Administrative &Financial Co-ordinator
B. Le Dantec (ERCIM)

OntoGrid
Knowledge Services forthe semantic Grid

DataminingGrid
Datamining
tools & services

Industrial Advisory Board

ScientificCo-ordinator
T. Priol (INRIA)

Knowledge &Data Management

SystemArchitecture

D. Talia (U. Calabria)

A. Andrzejak (ZIB)

R. Yahyapour(U. Dortmund)

Programming
Model

Resource
Management

PSE, tools and
GRID systems

M. Danelutto (U. Pisa)

L. Matyska (U. Masaryk)

Scheduling

V. Getov (U. Wesminster)

Spreading Excellence

Integrated Activities

P. Guisset (CETIC)

S. Gorlatch (U. Munster)

Collaboration Gateway
W. Ziegler (FhG)

NoE:Network of Excellence

Steering
Committee

[添付資料3-1-2] SS研 Grid Computing 2004 WG フォーラム資料

2004/12/1

19

CoreGrid Work Packages (研究項目)• 42 partners• 18 Countries

Jointly Executed Research
Programming
ModelSystem
Architecture

ResourceManagement

Scheduling

PSE, tools and
GRID systems

Distributed DataManagement

Basic Component
Model

GRID architecture
definition

Monitoring
Services

Multi-level
Scheduling

Generic Platform

Information &Knowledge Mgt.

HierarchicalComponent Model

Experimental &Benchmarking Env.

Checkpointing
Services

Workflow
Scheduling Strategies

Mediator
Components

Data Mining &Knowledge Discovery

Advanced
Component Model

Scalable GRID
Services

Workflow
Services

Fault-tolerance &Reliability

Integrated Toolkit

Adaptive GRID

Accounting and User
Management

Evaluation &Benchmarking

Advanced Tools andEnvironments

Dependability
in GRIDsIC
RAL-CCLRC
U. Belfast
U. Cambridge
U. Cardiff
U. Manchester
U. Newcastle
U. Wesminster(1 from S. America)

Knowledge &Data Management

20

CoreGRID 参加機関• 118 Researchers• 199 PhD Students

VTT

KTH
SICS
FhG
FZ-Julich
HLRS
PSC
U. Munster
CYFRONET
U. Dortmund
U. Passau
Masaryk U.
ZIBEPFL
SZTAKI
UASF

Delft U.
Vrije U.
U. Chile

Models for Scheduling
Parallel Applications

INRIA
CNRS
ERCIM
U. Coimbra

Data Management &Scheduling
Performance
Prediction

CETIC
UCL

UPC

CNR-ISTIINFN
U. Calabria
U. Lecce
U. Pisa

CLPP-BAS

ICS-FORTH

U. Cyprus2122

UniGrids 概要
Uniform
Interface to
Grid Services• OGSA• compliant• Unicore• Interoperability– 6th Framework Programme of the European Commission– 2nd Call of the IST 2003-2004 Workprogramme• Objective: GRID-based systems and solving complex problems– Instrument:
STReP– Duration:
24 months– Start:July 2004– Effort:
297 PM (12 developer + 0,375 manager)– Costs:
3.0 M€– Grant:
1.9 M€• Standardisations• Higher Level Services• Visualisation & steering• Access toremotedevices• Access to
distributeddata• Application Domains• Bio molecular andcomputational biology• Problem Solving
Environments ingeophysical depth
imaging byoil companies

23

UniGrids 参加機関
Research Centre Jülich(Project manager)
Consorzio Interuniversitario
per il Calcolo Automatico
dell’Italia Nord Orientale
Fujitsu Laboratories of Europe
University of Warsaw
Intel GmbH
University of Manchester

T-Systems SfR

24

UNIGRIDS: Work Packages- Technology Foundations（Fujitsu Lab. Europe)- Interoperability（Intel)- Grid Economics（U. Manchester)- Higher-level Services(ICM)- Applications(CINECA)
Molecular modelling
Genomic and proteonomic similarity searches
Oil reservoir modelling
Automotive industry
Aerospace industry- Standardisation(Research Centre Juelich)- Dissemination & Exploitation(U. of Manchester)- Collaboration(Research Centre Jülich)

[添付資料3-1-2] SS研 Grid Computing 2004 WG フォーラム資料

UK:The e-Science Centres

25

Computer Science Research in Grid
(Geographic view)（Phase1 から Phase 2へ)
e-Science
Institute

Globus Alliance2004/12/1

26

Bordeaux: Grid Net. with Std. TCP
Grenoble: Metascheduler, DGrid

Lille

Open
Middleware
Infrastructure
Institute

GridOperations
CentreDigital
CurationCentreLille: Workflow language & interpreter

Orsay

RennesBordeaux?

Nancy

Lyon
Grenoble

Toulouse

CeSC (Cambridge)

Nice/sophia

Lyon: GridRPC, H. P. Networking,Scheduling on heterogeneous res.
Nancy: online data compression, reallife experiments of sched. Algorithm.
Nice: Middleware for OO dist. syst.
Orsay: DesktopGrid, F. T. MPI, Virtual.
Rennes: network prot. unification
layer, code coupling with CORBA, P2P
Toulouse: Sparse Matrix and the Grid

EGEE

French ACI Grid Incentive

27

ACI GRID projects••• Programme Director : Thierry Priol• Scientific council : Brigitte Plateau• Budget: ~8 M€* (including 8 PhD grants)•••– This is incentive funding !

• Call for proposals :•– 2001 : 2,25 M€, 18 funded projects– 2002 : 3 M€, ~ 12 funded projects– 2003 : 1 M€, ~ 5 funded projects (Grid’5000)– 2004 : 1 M€, ~ 6 funded projects (Grid’5000)••

Peer-to-Peer– CGP2P (F. Cappello, LRI/CNRS)
Application Service Provider– ASP (F. Desprez, ENS Lyon/INRIA)
Algorithms– TAG (S. Genaud, LSIIT)– ANCG (N. Emad, PRISM)– DOC-G (V-D. Cung, UVSQ)Compiler techniques– Métacompil (G-A. Silbert, ENMP)
Networks and communication– RESAM (C. Pham, ENS Lyon)– ALTA (C. Pérez, IRISA/INRIA)
Visualisation– EPSN (O. Coulaud, INRIA)
Data management– PADOUE (A. Doucet, LIP6)– MEDIAGRID (C. Collet, IMAG)
Tools– DARTS (S. Frénot, INSA-Lyon)– Grid-TLSE (M. Dayde, ENSEEIHT)

••

•

•

* Computing and network infrastructures, permanent researchers salaries already paid by the state28

Code coupling– RMI (C. Pérez, IRISA)– CONCERTO (Y. Maheo, VALORIA)– CARAML (G. Hains, LIFO)
Applications– COUMEHY (C. Messager, LTHE) - Climate– GenoGrid (D. Lavenier, IRISA) Bioinformatics– GeoGrid (J-C. Paul, LORIA) - Oil reservoir– IDHA (F. Genova, CDAS) - Astronomy– Guirlande-fr (L. Romary, LORIA) Language– GriPPS (C. Blanchet, IBCP) -Bioinformatics– HydroGrid (M. Kern, INRIA) - Environment– Medigrid (J. Montagnat, INSA-Lyon) MedicalGrid Testbeds– CiGri-CIMENT (L. Desbat, UjF)
– Mecagrid (H. Guillard, INRIA)– GLOP (V. Breton, IN2P3)– GRID5000 (F. Cappello, INRIA)
Support for disseminations– ARGE (A. Schaff, LORIA)– GRID2 (J-L. Pazat, IRISA/INSA)– DataGRAAL (Y. Denneulin, IMAG)

Many are continuing their work through the Grid’5000 project

Grid’5000 in November’2004

Grid’5000Pau

29

Grid eXplorer
Grid 5000 nodes

3 (soon 4) 1 Gb/sec ; may evolve to 10 Gb/s

30

The German E-Science Programme• A 5 years programme starting 2004
• Proposed funding scheme– Government: 100 MEuro– Research communities: 100 MEuro– Industry: 100 MEuro– Equal funding of middleware and applications
development– No funding of infrastructure hardware
components, operations and networking cost[添付資料3-1-2] SS研 Grid Computing 2004 WG フォーラム資料

2004/12/131• Initially driven by the HGF
Rostock
centers and the DFNKiel
Hamburg
Global Upstream
Verein (2002)
Oldenburg
Braunschweig
Hannover• Meanwhile: More than 100
BerlinBielefeld
further partners inEssen
Göttingenacademia and industry
Leipzig
St. Augustin
DresdenMarburg
Ilmena• Aim at a coordination ofu
AachenGrid activities in Germany
Erlangen• Deployment of a new
Karlsruh
Regensburg
generation networking
Kaiserslauterne
Stuttgart
Garching
infrastructure(Example: Project VIOLA)• Promotion of open10 Gbit/s
standards for interfaces and2,4 Gbit/s
protocols (GGF)
622 Mbit/s
MagdeburgFrankfu
rtWürzburg

HeidelbergAugsburg

32

Timeline

A German Grid Initiative: D-GRID• 2003: Steering committee established(Prof.Hegering, Prof.Hiller, Prof.Maschuw,Prof.Reinefeld, Prof.Resch)• 2004: Preparation of a scientific programme(Presentation in June)• 2004: Call for development of generic middleware
components• 2005: Call for development of prototypical applications• 2007: Production quality national grid infrastructure• 2008: Commercial uptake of services

3334

VIOLA:
Vertically Integrated Optical testbed for Large Applications•••

Partially funded by Federal Ministry of Education and Research
Budget: 16 M€, 27,5 PJ/aGrant period: May 2004 – April 2007••To serve as a platform for D-Grid – the German e-Science initiative
Deployment of a UNICORE-based Compute Grid with Meta-Schedulingcapabilities (compute & network resources) on the testbed•

Consortium:––––––––––––• Programme available in summer• Gap analysis• Matrix structure: 6 Communities aregathering requirements in 5 working groups

NIC, Research Centre Jülich
Fraunhofer Institute for Media Communication
Fraunhofer Institute for Algorithms and Scientific Computing
Research Centre caesar
University of Bonn
Technical University Bonn-Rhein-Sieg
Technical University of Aachen (RWTH)
T-Systems International
DFN – German Science Network (consortium leader)
AlcatelSiemens
GasLINE (associated)

3536

Optical Testbed
Core Infrastructure

Environmental Sciences:

Material Science & Engineering:

Simulation / Visualization

Technical Simulations

Grid-Middleware and -Services(Secure access, Scheduling, Communication, I/O, Tools)
Control Plane(Bandwidth and QoS reservation, user-network-interface)
Network components (SDH/Ethernet Switches/Router)
optical fiber infrastructureDissemination / Co-operation

Networks

Middleware Applications

Project structure: Vertical Integration

10 Gbit/s Ethernet +10 Gbit/s SDH
10 Gbit/s SDH
2x1 Gbit/s Ethernet
JülichAachenSankt Augustin

BonnFrankfurt

Nürnberg/Erlangen

Hardware Vendors• Riverstone• Alcatel• Siemens• Sycamore• ADVA

[添付資料3-1-2] SS研 Grid Computing 2004 WG フォーラム資料

The Grid.it National Project
TORINOPISAPERUGIA38

仮想天文台（ Virtual Observatory)

HPC, Parallel Programming, Grid computing,
Scientific libraries, Data base and knowledge discovery,
Earth Observation, Computational chemistry,
Image processing, …
R&D on next generation tools

PADOVA
BOLOGNAGENOVA37

CNR & University

MILANO
PAVIA

世界中に分散した膨大な天体観測の画像データベースをインターネットでオンライン接続して仮想的な「デジタル宇宙」を創り出す- インタラクティブなサーチ・マッチング・可視化
全天のサーベイ:
全天40,000 平方度 を 2 兆個の画素 （＠ 1 平方秒角）
One band4 テラバイト（TB)
Multi-wavelength10-100 テラバイト（TB)
Time dimension>> 10 ペタバイト（PB)

Grid infratsructure(INFN-Grid, DataGrid, DataTage-science applications: Astrophysics,Bioinformatics, Geophysics, …

NAPOLI

BARI

野辺山
SDSS
スバル
ALMA

National eInfrastructure

ASI

Funding: €8.1 M
3-Year Project
CNIT
R&D on opticalStart-up: November 2002 networking
UR INFN : €1.58M
MATERALECCECAGLIARI

COSENZAIRAS 25μ-

INFN & University

ROMA

2004/12/1

2MASS 2μDSS Optical~1TB/年~5TB/年~20TB/年>1PB/年 （予想）

IRAS 100μ- 国際協力が不可欠
日本： JVO（Japan Virtual Observatory）
米国： NVO（National Virtual Observatory）
英国； Astro-grid

Applications of Earth
Observation

WENSS 92cm

PALERMO

注：テラ = １兆 （１０の１２乗）
ペタ = １０００兆 （１０の１５乗）

NVSS 20cm（Courtesy:Dr.Jim Gray, Microsoft） ROSAT ~keV GB 6cm

3940

かに星雲を異なった波長で観測すると・・・・(参考：NAREGI Software Stack）
Grid-Enabled Nano-Applications

X-ray,optical,infrared, andradio
views of the nearby
Crab Nebula, which is
now in a state of chaotic
expansion after asupernova explosion
first sighted in 1054
A.D. by Chinese
Astronomers.

Packaging

Crab star1053 AD

GridProgramming-Grid RPC
-Grid MPI

Grid Visualization

Super Scheduler

Distributed
Information Service（Globus,Condor,UNICOREÎGlobus,Condor,UNICOREÎOGSA)
OGSA)
Grid VM
High-Performance & Secure Grid Networking

SuperSINETNIIIMS

ResearchOrganizations

Computing Resources
Slide courtesy of Robert Brunner @ CalTech.

Grid PSE

Grid Workflowetc