# Presentation: 536921

## TheParticle Physics Data GridCollaboratory Pilot

**Richard P. Mount**
**For the PPDG Collaboration**
**DOE SciDAC PI Meeting**
**January 15, 2002**

## sin(2) = 0.59 ± 0.14 (statistical)  ± 0.05 (systematic)

- sin(2******) = 0.59 ± 0.14 (statistical)  ± 0.05 (systematic)

**Observation of *****CP***** violation in the *****B******0***** meson system.   ****(Announced July 5, 2001)**

- 32 million *B**0* – anti-*B**0* pairs studied:  these are the July 2001 plots after months of analysis

## The Top Quark Discovery (1995)

## Quarks Revealed: structure      inside Protons & Neutrons

- 1990 Nobel Prize in Physics

## Scope and Goals

**Who:**
- OASCR (Mary Anne Scott) and HENP (Vicky White)
- Condor, Globus, SRM, SRB (PI, Miron Livny, U.Wisconsin)
- High Energy and Nuclear Physics Experiments - ATLAS, BaBar, CMS, D0, JLAB, STAR (PIs Richard Mount, SLAC and Harvey Newman, Caltech)
- Project Coordinators:  Ruth Pordes, Fermilab and Doug Olson, LBNL
**Experiment data handling requirements today :**
- Petabytes of storage,  Teraops/s of computing, Thousands of users,
- Hundreds of institutions, 10+ years of analysis ahead
**Focus of PPDG:**
- Vertical Integration of Grid middleware components into HENP experiments’ ongoing work
- Pragmatic development of common Grid services and standards – data replication, storage and  job management, monitoring and planning.

## The Novel Ideas

-  Deployment of  Grid technologies  and services in production (24x7) environments with stressful performance needs.
-  Collaborative development of Grid middleware and extensions between application and middleware groups – leading to pragmatic and least risk solutions.
-  HENP experiments extend their adoption of common infrastructures to higher layers of their data analysis and processing applications.
-  Much attention paid to integration, coordination, interoperability and interworking with emphasis on incremental deployment of increasingly functional working systems.

**The Novel Ideas**

## Impact and Connections

- _IMPACT_.
- Make Grids usable and useful for the real problems facing international physics collaborations and for the average scientist in HENP.
- Improving the robustness, reliability and maintainability of Grid software through early use in production application environments.
- Common software components that have general applicability and contributions to standard Grid middleware.
- _Connections_
- DOE Science Grid will deploy and support Certificate Authorities and develop Policy documents.
- Security and Policy for Group Collaboration provides Community Authorization Service.
- SDM/SRM working with PPDG on common storage interface APIs and software components.
- Connections with other SciDAC projects (HENP and non-HENP).

## Challenge and Opportunity

**Challenge and Opportunity**

## The Growth of “Computational Physics” in HENP

- ~500 people (BaBar)

- ~10 people

- ~7 Million Lines of Code (BaBar)

- ~100k LOC

**Notes:**
The role of computation in experimental HENP has grown steadily over the last 30 years and the rate of growth is increasing.  Between the detector and computing hardware and the physics analysis and results lies an ever growing area of intellectually challenging computational science.  The principle challenges are:
 - Large-scale data management
 - Worldwide collaboration (or in modern parlance “Grids”)
 - Feature extraction and simulation.
To set the scale, in 1971 a typical large experiment might involve 10 physicist and required as much as 100k lines of Fortran code.  In 2001 a typical large experiment involves 500 physicists who create 7 million lines of C++, Perl and Java code.  The large experiments of 2011 will each involve 2000 physicists.

## The Collaboratory Past

**30 years ago an HEP “collaboratory” involved:**
- Air freight of bubble chamber film (*e.g.* CERN to Cambridge)
**20 years ago:**
- Tens of thousands of tapes
- 100 physicists from all over Europe (or US)
- Air freight of tapes, 300 baud modems
**10 years ago:**
- Tens of thousands of tapes
- 500 physicists from US, Europe, USSR, PRC ...
- 64k bps leased lines and air freight

## The Collaboratory Present and Future

**Present:**
- Tens of thousands of tapes
- 500 physicists from US, Europe, Japan, FSU, PRC ...
- Dedicated intercontinental links at up to 155/622 Mbps
- Home brewed, experiment-specific, data/job distribution software (if you’re lucky)
**Future (~2006):**
- Tens of thousands of tapes
- 2000 physicists from, worldwide collaboration
- Many links at 2.5/10 Gbps
- The Grid

## End-to-End Applications& Integrated Production Systems 

- to allow thousands of physicists to share data & computing resources for scientific processing and analyses

**Operators & Users**

**Resources: Computers, **
**Storage, Networks**

**  ****PPDG Focus**:
** ****Robust Data Replication**
**- Intelligent Job Placement **
**  ****and Scheduling**
**- Management of Storage **
**  ****Resources**
**- Monitoring and Information **
**  ****of Global Services**

**Relies on Grid infrastructure:**
**- Security & Policy**
** ****High Speed Data Transfer**
**- Network management**

**Put to good**
**use by the**
**Experiments**

## Project Activities to date – “One-to-one”Experiment – Computer Science developments

- Replicated data sets for science analysis
- BaBar – SRB
- CMS – Globus, European Data Grid
- STAR – Globus
- JLAB – SRB
-    _[http://www.jlab.org/hpc/WebServices/GGF3_WS-WG_Summary.ppt](http://www.jlab.org/hpc/WebServices/GGF3_WS-WG_Summary.ppt)_
- Distributed Monte Carlo simulation job production and management
-  ATLAS – Globus, Condor
- _[http://atlassw1.phy.bnl.gov/magda/dyShowMain.pl](http://atlassw1.phy.bnl.gov/magda/dyShowMain.pl)_
-  D0 – Condor
-  CMS – Globus, Condor, EDG – SC2001 Demo
- _[http://www-ed.fnal.gov/work/SC2001/mop-animate-2.html](http://www-ed.fnal.gov/work/SC2001/mop-animate-2.html)_
- Storage management interfaces
- STAR – SRM
- JLAB – SRB

## Cross-Cut – all collaborator - activities

**Certificate Authority** policy and authentication –  working  with the SciDAC Science Grid, SciDAC Security and Policy for Group Collaboration and ESNET to develop policies and procedures.  PPDG  experiments will act as early testers and adopters of the CA.
- 	_[http://](http://www.envisage.es.net/)__[www.envisage.es.net](http://www.envisage.es.net/)__[/](http://www.envisage.es.net/)_
**Monitoring **of  networks, computers, storage and applications  – collaboration with GriPhyN. Developing use cases and requirements; evaluating and analysing existing systems  with many components – D0 SAM, Condor pools etc. SC2001 demo:
- 	 _[http://www-iepm.slac.stanford.edu/pinger/perfmap/iperf/anim.gif](http://www-iepm.slac.stanford.edu/pinger/perfmap/iperf/anim.gif)_.
**Architecture** components and interfaces – collaboration with GriPhyN. Defining services and interfaces for analysis, comparison,  and discussion with other architecture definitions such as the European Data Grid.
- 	_[http://www.griphyn.org/mail_archive/all/doc00012.doc](http://www.griphyn.org/mail_archive/all/doc00012.doc)_
**International test beds** – iVDGL and experiment applications.

## Common Middleware Services

**Robust file transfer and replica services**
- SRB  Replication Services
- Globus replication services
- Globus robust file transfer
- GDMP application replication layer -  common project between European Data Grid Work Package 2 and PPDG.
**Distributed Job Scheduling and Resource Management:**
- Condor-G, DAGman, Gram; Sc2001 demo with GriPhyN
- _[http://www-ed.fnal.gov/work/sc2001/griphyn-animate.html](http://www-ed.fnal.gov/work/sc2001/griphyn-animate.html)_
**Storage Resource Interface and Management**
- Common API with EDG, SRM
**Standards Committees**
- Internet2 HENP Working  Group
- Global Grid Forum

## Grid Realities

**BaBar Offline Computing Equipment****Bottom-up Cost Estimate (December 2001)****(Based only on costs we already expect)****(To be revised annually)**

## Grid Realities

## PPDG World

**An Experiment**

** ****PPDG**

**HENP Grid**

** ****SciDAC connections**