A Large Ion Collider Exp. at CERN

page 2√s = 8 TeV in proton + proton√sNN = 2.76 TeV on Pb + Pb
√sNN = 5.02 TeV on p + Pb
√sNN at LHC = 28 x RHIC =320 x SPS = 1000 x AGS
LHCb

ALICECMSATLAS understand ”strong” QCD, and reveal dynamics at early Universe.
Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

The ALICE Experiment at Point-2
The ALICE Experiment

36 countries, 132 institutions, 1,200 members as of 2013

Central barrel & forward detectors
17 sub-detectors installed for the 1st LHC run
Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

ALICE-Japan as of Apr. 20139 faculty members and22 graduate students fromHiroshima, Tokyo and Tsukuba Universities.

page 3

ALICE Data Stream to Tape

page 4

Run plan:••p+p in 107 sec (7 months)
A+A in 106 sec (1 months)

Raw data: 2.5 PB/year••

2x108 events/year for A+A
12.5 MB/event

Event Summary Data•

3 MB/event for A+A

Analysis Object Data•300 KB/event for A+A

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

Vasco Barroso - “ALICE moves into warp drive” - CHEP 2012

ALICE Live of p+Pb Event

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

page 5

Typical LHC Year

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

page 6

Data Samples as of Today

page 7This is my private compilation and can be different from official numbers.
year

collisions# of events recorded on tape2013

p+Pb/Pb+p @5.02TeV

140M minimum bias and about 10M events with specific triggers out ofLint=31.94 nb-1 delivered in 4 weeks.

2012

p+p @8TeV

2012

p+Pb@5.02TeV

2011

Pb+Pb @2.76TeV/A

2011

p+p @7TeV

2010

p+p @2.76TeV

2010

Pb+Pb @2.76TeV/A

30M events in minimum bias trigger

2010

p+p @7TeV

800M events in minimum bias trigger
50M events in muon triggers
20M events in high Nch triggers

2010

p+p @900GeV

8M events in minimum bias trigger

2009

p+p @2.36TeV

40k events in minimum bias trigger

2009

p+p @900 GeV

300k events in minimum bias trigger

Continuing p+p data taking until X’mass shutdown (Wk 50)
Lint=2.47 pb-1 recorded out of 3.49 pb-1 triggered as of Oct. 11.
1.8M events during the pilot run in Sept.
132M events in various triggers in 3.2PB (24MB/event) in 24days
Lint=143.6 µb-1
109 events in minimum bias trigger at 10kHz in 100 days
Lint=2 pb-1 for rare triggers
74M events in minimum bias trigger in 35 hours
10M events and Lint=18 nb-1 for rare triggers

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

ALICE Computing Model
tapeDAQ
DAQ
DAQ

T2filecat.

DAQ
DAQ
DAQT1ESD

DAQ
DAQ
DAQ

DAQ

quickanalysis

diskbuffer

DAQ
DAQ
DAQ

T0CAF

1st pass/pilot

ESD

reconstruction

T#: Tier-#
CAF: CERN Analysis Facility
ESD: Event Summary data
AOD: Analysis Object Data
MC: Monte Carlo Data

ESD

AOD

MC

AOD
DAQ
DAQ
DAQ

full/partial
export

DAQ
DAQ
DAQ
CPU

page 8

T2

DAQ
DAQ
DAQ

T1ESD

AOD

reconstruction/organized analyses

ESD

MC
DAQ
DAQ
DAQ

T2

AOD

MC production/organized/user
analysesMC

ALICE VO
1 T0 (CERN)
7 T1 (France, Germany, Italy, Korea, Netherland, Nordic, UK)
73 T2 over 4 continents

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

ALICE Tiers

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

page 9

ALICE Tier-2 at Hiroshima
The ALICE LCG site “JP-HIROSHIMA-WLCG” with grid
middleware EMI-1 on SLC5 until the last week.
LCG service; APEL, sBDII, CREAM-CE, XROOTD, DPM-SE,
VOBOX… minimum LCG service at minimum cost
WN resources; 1164 Xeon-cores in total
Xeon5355(4cores@2.6GHz) x 2cpu x 32boxes &Xeon5365(4cores@3.0GHz) x 2cpu x 20blades &Xeon5570(4cores@2.9GHz) x 2cpu x 26blades &Xeon5670(6cores@2.9GHz) x 2cpu x 3blades &Xeon5660(6cores@2.8GHz) x 2cpu x 42bladesStorage cap; 408TB disks on 6 servers and no MS
Around 2/3 resource deployed in the ALICE GRID
Network B/W: 1Gbps on 40Gbps-SINET4 in JapanWLCG support by ASGC in Taiwan
ALICE associated Tier-1 in Lyon
Responsible by Prof. Toru Sugitate
Operated by TS and 中宮義英, and remote technicalsupports by a part-time SE of 創夢(株)in Tokyo
Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

page 10

New Configuration from Feb. 2012page 11

 Secure/Robust subnets
 10Gbps local connection (part.)
 Space/Energy saving
Hiroshima 40Gbps
DCXeon X5570 @2.9G

DMZ

10Gbps

1Gbps
KEK
HS-L3-01

Cataly 3560E

Xeon X5660 @2.8G

Xeon X5660 @2.8G

Fortigate 200B

Xeon X5660 @2.8G

Xeon X5660 @2.8G

Local cluster• 300 Xeon cores
w/ 1GB/core• 192 TB storagew/ Raid6

HiNET

FW

TRUSTED
10GbpsL3

Nexus 5596/2248x2

GRID
siteBDII/APEL

Equal Logic PS6510E
2T SATA x 48 w/RAID6WN

ALICE-T2• 864 Xeon coresw/ 2GB/core• 144 + 72 TB storagew/ Raid6

VOBOX
CREAM-CE
Xrootd/DPM-SE
NFS

Xeon X5660 @2.8G

Xeon X5355 @2.7G

Xrootd-servers

Xeon L5420@2.5G
Xeon X5460@3.2G

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

JCS RVAX-4U
1TB SATA x 144 w/RAID6

JP-HIROSHIMA-WLCG
Job # 800

Queue Job

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

 864 Xeon-cores in CRAEM-CE.
 Xrootd disk storage of 177 TB
in 4 disk servers.
 Stably accepting over 800
jobs and process around5000 jobs a day, corresponding to about 2%
contribution to entire ALICE.

page 12

Network Speed and Traffics

page 13

 Network speed varies
from time to time?
 Slow connection from/tothe world, especially theout-going traffic?
 Appreciate any help totune/train the network
routing/performance!!
Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

SINET-4 to SINET-X

page 14

 Present: 1Gbps-MPLS H27/end:SINET-4 >> SINET-X
 H26/summer:
campus LAN replace>> 10Gbps to the DC

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

Computing Resources Scrutiny Group 2012page 15
ALICE has historically faced a lack of computing resources. Partly because of insistence by the CRSG,
ALICE lowered its requests in order to better reflect the anticipated resources. However, in 2012 …….
Fair share (based on M&O A sharing)

CPU (K HEPSPEC06)

Disk (TB)

Tape (TB) T2s rescue T1s for CPU !
 Large disk and tape deficit in T1s
 After LS2 : Tape +163 PB (× 3) Disk +125 PB (× 2)
Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

Pledged resources (2012 data from REBUS)

CPU (K HEPSPEC06)

Disk (TB)

Tape (TB)

Fair Share of Computing Resources

page 16

MB has approved “The Funding Agency will provide computing resources (CPU and disk) in a quantity greater than or equal tothe fraction of the total resources required, minus the pledged CERN contribution, in proportion to its M&O-A contribution relative
to the total ALICE M&O-A minus the CERN M&O-A…. The computing shares approved by the Computing RRB will then become
the minimal resource requirements for each institution.”

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

ALICE Upgrade Planpage 17

By PG in CB in Oct. 2012
Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

Summary
 ALICE GRID
 Process 50k jobs in 7 T1’s and about 80 T2’s
 Need more CPU/Disks (x2) /Tapes (x3) Eg. to Japan; 180TB >> 500TB. << pledge later Pressure to Japan to sign up WLCG << pending Another pressure to migrate a Torrent type software << Refused!!
 Hiroshima Tier-2
 Accepts over 800 jobs stably, and process around 5000 jobs a day, corresponding to about 2% contribution to the entire ALICE.
 Hiroshima is now under migration of EMI-2 on SL64, except VOBOX.
 Trace network and tune up speed to increase productivity, but…
 Merits of 1st Asian Tier-1 unseen yet
 Need “expertized” manpower / understanding inside collabration /cooperation with outside groups Declare a 10Gbps connection to the DC in SINET-X
 LCG operation
 Thanks to EGI for their frequent requests to up-to-date.
 SLC4 >> SLC5 >> SL6
 gLite 3.1 >> gLite 3.2 >> EMI-1 >> EMI-2
 Many security patch requests
 Thanks to 創夢(株) for their remote SE.
Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

page 18

Sites under SAM/GGUS by EGI

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013

page 19

page 20

Toru Sugitate/ Hiroshima Univ./ WLCG Meeting in Tokyo/ Apr.12, 2013