# Presentation: 713992

## Distributed IT Infrastructure for U.S. ATLAS

**Rob Gardner**
**Indiana University**
- DOE/NSF Review of U.S. ATLAS and CMS Computing Projects
- Brookhaven National Laboratory
- NOVEMBER 14-17, 2000

## Outline

- Requirements
- Approach
- Organization
- Resource Requirements
- Schedule
- Fallback Issues

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## Distributed IT Infrastructure

- A wide area computational infrastructure for U.S. ATLAS
- A network of distributed computing devices
- A network of distributed data caches & stores
- Connectivity
- Physicists with data (laptop scale sources: **LOD**)
- Computers with data (at all scales)
- Physicists with each other (collaboration)
- Distributed information, portals
- Efforts
- Data Grid R&D
- Strategic “remote” sites (Tier 2s)
- Distributed IT support at the Tier 1 center

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## Requirements

- Access
- Efficient access to resources at the Tier 1 facility
- Data distribution to remote computing devices
- Information
- A secure infrastructure to locate, monitor and manage collections of distributed resources
- Analysis planning framework
- Resource estimation
- “Matchmaker” tools to optimally connect physicist+CPU+data+etc...
- Scalable
- Add arbitrary large numbers of computing devices as they become available
- Add arbitrarily large numbers of data sources as they become available

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## Approach

- ~5 strategic remote sites (Tier 2s)
- Scale of each facility:
- MONARC estimates
- ATLAS NCB/WWC (World Wide Computing Group)
-  National Tier 1 facility
- 209 Spec95
- 365 Online disk
- 2 PB  tertiary
- Tier 2 = Tier 1 * 20%

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## Role of Tier 2 Centers

- User Analysis
- Standard configuration optimized for analysis at the AOD level
- ESD objects required for some analysis
- Primary Resource for Monte Carlo Simulation
- “Spontaneous” production level ESD skims  (autonomy)
- Data distribution caches
- Remote data stores
- HSM serve to archive AODs
- MC data of all types (GEN, RAW, ESD, AOD, LOD) from all Tier 2’s & users

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## Typical Tier 2

- CPU: 50K SpecInt95                                		(t1: 209K)
- Commodity Pentium/Linux
- Estimated 144 Dual Processor Nodes    		(t1: 640)
- Online Storage: 70 TB Disk                    		(t1: 365)
- High Performance Storage Area Network
- Baseline: Fiber Channel Raid Array

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## ‘Remote’ Data Stores

- Exploit existing infrastructure
- mass store infrastructure at 2 of the 5 Tier 2 centers
- Assume existing HPSS or equivalent license, tape silo, robot
- Augment with drives, media, mover nodes, and disk cache
- Each site contributes 0.3-0.5 PB store
- AOD archival, MC ESD+AOD archival

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## Organization

- Facilities Subproject 2.3.2

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## Personnel

**	****	****	****MANPOWER ESTIMATE SUMMARY IN FTEs**
- 	WBSNo:	2	Funding Type:	Infrastructure	11/13/00 8:08:38 PM
- 	Description:	US ATLAS Computing	Institutions:	All	Funding Source :	All
- 		*FY 01*	*FY 02*	*FY 03*	*FY 04*	*FY 05*	*FY 06*	*Total*
- IT I		1.0	4.0	6.0	10.0	10.0	7.0	38.0
- IT II		.0	1.0	2.0	2.0	5.0	5.0	15.0
- Physicist	1.0	1.0	1.0	1.0	1.0	.0	5.0
**TOTAL LABOR**	2.0	6.0	9.0	13.0	16.0	12.0	58.0

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## Tier 2 Costs

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## Schedule

- R&D Tier 2’s – FY ‘01 & FY ‘02
- Initial Development & Test, 1% to 2% scale
- Start Grid testbed:  ATLAS-GriPhyN
- Data Challenges – FY ‘03 & FY ‘04
- Production Tier 2’s  – FY ‘04 & FY ‘05
- Operation – FY ‘05, FY ‘06 & beyond
- Full Scale System Operation, 20% (‘05) to 100% (‘06)  (as for Tier 1)

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## Testbed   ‘01

**UC Berkeley**
**LBNL-NERSC**

**Brookhaven**
**National**
**Laboratory**

**Indiana **
**University**

**Boston **
**University**

**Argonne**
**National**
**Laboratory**

- HPSS sites

**U Michigan**

**University of**
**Texas at**
**Arlington**

**Testbed   ‘01**

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000

## Fallback Issues

-  Impact of limited support for a planned distributed infrastructure?
- Several scenarios of course are possible
- US ATLAS will face a serious shortfall in analysis capability
- Shortfall in simulation capacity
- Analysis groups will have less autonomy
- University groups likely augment their facilities through supplemental requests, and large scale proposals to establish multidisciplinary “centers”
- We could end up with 1 Tier 1 and 32 “Tier 2” centers
- An incoherent, messy infrastructure, difficult to manage
- Not the best way to optimize physics discovery

- Rob Gardner       Tier 2 Plan for U.S. ATLAS

- November  14-17, 2000