# Presentation: 116049

## Putting It All Together: Grid 2003 Example

- Jennifer M. Schopf
- Argonne National Laboratory
- UK National eScience Centre

## Using the Globus Toolkit:How it Really Happens

- Implementations are provided by a mix of
- Application-specific code
- “Off the shelf” tools and services
- Tools and services from the Globus Toolkit
- Tools and services from the Grid community (compatible with GT)
- Glued together by...
- Application development
- System integration

## Grid2003: An Operational Grid

**Grid2003: An Operational Grid**
**28 sites (2100-2800 CPUs) & growing**
**10 substantial applications + CS experiments**
**Running since October 2003, still up today**

**Korea**

**http://www.ivdgl.org/grid2003**

**Notes:**
Application driven!

## Grid2003 Project Goals

- Ramp up U.S. Grid capabilities in anticipation of LHC experiment needs in 2005.
- Build, deploy, and operate a working Grid.
- Include all U.S. LHC institutions.
- Run real scientific applications on the Grid.
- Provide state-of-the-art monitoring services.
- Cover non-technical issues (e.g., SLAs) as well as technical ones.
- Unite the U.S. CS and Physics projects that are aimed at support for LHC.
- Common infrastructure
- Joint (collaborative) work

## Grid2003 Applications

- 6 VOs, 10 Apps +CS
- CMS proton-proton collision simulation
- ATLAS proton-proton collision simulation
- LIGO gravitational wave search
- SDSS galaxy cluster detection
- ATLAS interactive analysis
- BTeV proton-antiproton collision simulation
- SnB biomolecular analysis
- GADU/Gnare genone analysis
- And more!

## ExampleGrid2003Workflows

- Genome sequence analysis

- Physics
- data
- analysis

- Sloan digital sky survey

## Grid2003 Requirements

- General Infrastructure
- Support Multiple Virtual Organizations
- Production Infrastructure
- Standard Grid Services
- Interoperability with European LHC Sites
- Easily Deployable
- Meaningful Performance Measurements

## Grid 2003 Components

- Computers & storage at 28 sites (to date)
- 2800+ CPUs
- Uniform service environment at each site
- Set of software that is deployed on every site
- Pacman installation system enables installation of numerous other VDT and application services
- Global & virtual organization services
- Certification & registration authorities, VO membership services, monitoring services
- Client-side tools for data access & analysis
- Virtual data, execution planning, DAG management, execution management, monitoring
- IGOC: iVDGL Grid Operations Center

## SW Components: Security 

- GT Components
- GSI
- Community Authorization Service (CAS)
- MyProxy
- Related Components
- GSI-OpenSSH

## SW Components: Job Submission

- GT components
- pre-ws GRAM
- Condor-G
- Related components
- Chimera – Virtual Data Management
- Pegasus – Workflow Management

## CondorG

**CondorG**

- The Condor project has produced a “helper front-end” to GRAM
- Managing sets of subtasks
- Reliable front-end to GRAM to manage computational resources
- Note: this is not Condor which promotes high-throughput computing, and use of idle resources

## Chimera “Virtual Data”

- Captures both logical and physical steps in a data analysis process.
- Transformations (logical)
- Derivations (physical)
- Builds a catalog.
- Results can be used to “replay” analysis.
- Generation of DAG (via Pegasus)
- Execution on Grid
- Catalog allows introspection of analysis process.

- Galaxy cluster
- size distribution

- Sloan Survey Data

## Pegasus Workflow Transformation

- Converts Abstract Workflow (AW) into Concrete Workflow (CW).
- Uses Metadata to convert user request to logical data sources
- Obtains AW from Chimera
- Uses replication data to locate physical files
- Delivers CW to DAGman
- Executes
- Publishes new replication and derivation data in RLS and Chimera (optional)

- ChimeraVirtual DataCatalog

- ReplicaLocationService

- MetadataCatalog

- StorageSystem

- StorageSystem

- StorageSystem

- ComputeServer

- ComputeServer

- ComputeServer

- ComputeServer

- DAGman

- Condor

*  *

*t*

## SW Components: Data Tools

- GT Components
- GridFTP (old)
- Replica Location Service (RLS)
- Related components
- ISI Metadata Catalog Service

## MCS - Metadata Catalog Service

- A stand-alone metadata catalog service
- Stores system-defined and user-defined attributes for logical files/objects
- Supports manipulation and query
- Integrated with OGSA-DAI
- OGSA-DAI provides metadata storage
- When run with OGSA-DAI, basic Grid authentication mechanisms are available

## SW Components: Monitoring

- GT components
- MDS2 (basically equivalent to MDS4 index server)
- Related components
- 8 other tools including Ganglia, MonALISA, home grown add-ons

## Ganglia Cluster Monitor

- Ganglia is a toolkit for monitoring clusters and aggregations of clusters (hierarchically).
- Ganglia collects system status information and makes it available via a web interface.
- Ganglia status can be subscribed to and aggregated across multiple systems.
- Integrating Ganglia with MDS services results in status information provided in the proposed standard GLUE schema, popular in international Grid collaborations.

## MonALISA

- Supports system-wide, distributed monitoring with triggers for alerts
- Java/JINI and Web services
- Integration with Ganglia, queuing systems, etc.
- Client interfaces include Web and WAP
- Flexible registration and proxy mechanisms support look-ups and firewalls

## Grid2003 Operation

- All software to be deployed is integrated in the Virtual Data Toolkit (VDT) distribution.
- Each participating institution deploys the VDT on their systems, which provides a standard set of software and configuration.
- A core software team (GriPhyN, iVDGL) is responsible for integration and development.
- A set of centralized services (e.g., directory services, MyProxy service) is maintained Grid-wide.
- Applications are developed with VDT capabilities, architecture, and services directly in mind.

## Grid2003 Metrics

| Metric | Target | Achieved |
| --- | --- | --- |
| Number of CPUs | 400 | 2762 (28 sites) |
| Number of users | > 10 | 102+ |
| Number of applications | > 4 | 10 (+CS) |
| Number of sites running concurrent apps | > 10 | 17 |
| Peak number of concurrent jobs | 1000 | 1100  |
| Data transfer per day | > 2-3 TB | 4.4 TB max |

## Transition to GT4

- Data Tools
- _Now:_ GT2 GridFTP, GT2 RLS,  MCS
- _Soon:_ GT4 GridFTP server is in VDT 1.1.3, currently being tested on (smaller) Grid3 testbed, rollout “very soon”
- Job Submission
- _Now:_ GT2 GRAM, Condor-G, Chimera & Pegasus
- _Soon:_ Pegasus/Chimera now interacts correctly with GT4 GRAM, being tested on small scale, roll out Summer (?)

## Transition to GT4 (cont)

- Monitoring
- Now: 9 tools including MDS2, Ganglia, MonALISA, home grown add-ons
- Soon: Discussions started to have MDS4 as a higher level interface to other tools, ongoing

## Grid2003 Summary

- Working Grid for wide set of applications
- Joint effort between application scientists, computer scientists
- Globus software as a starting point, additions from other communities as needed
- Transitioning to GT4 one component at a time

## So How Can You Use GT4For Your Application?

- Testing and feedback
- Users, developers, deployers: plan to use the  software & provide feedback
- Tell us what is missing, what performance you need, what interfaces & platforms, ...
**Come to the Thursday and Friday of this week**
- Ideally, also offer to help meet needs (-:
- Related software, solutions, documentation
- Adapt your **tools** to use GT4
- Develop new GT4-based **components**
- Develop GT4-based **solutions**
- Develop **documentation** components

## How To Get Involved

- Download the software and start using it
**http://www.globus.org/toolkit/**
- Provide feedback
- Join **gt4-friends@globus.org** mail list
- File bugs at **http://bugzilla.globus.org**
- Review, critique, add to documentation
- Globus Doc Project: **http://gdp.globus.org**
- Tell us about your GT4-related tool, service, or application
- Email **info@globus.org**

## Thanks to:

- Material over the last 2 days compliments of: Bill Allcock, Malcolm Atkinson, Charles Bacon, Ann Chervenak, Lisa Childers, Neil Chue Hong, Ian Foster, Jarek Gawor, Carl Kesselman, Amy Krause, Lee Liming, Jennifer Schopf, Kostas Tourlas, and all the Globus Alliance folks we’ve forgotten to mention
- Globus Alliance developers at Argonne, U.Chicago, USC/ISI, NeSC,EPCC, PDC, NCSA
- Other partners in Grid technology, application, & infrastructure projects
- NeSC admin and systems staff
- And thanks to  DOE, NSF (esp. NMI and TeraGrid programs), NASA, IBM, and the UK eScience Program for generous support

## For More Information

- Globus Toolkit
- www.globus.org/toolkit
- Grid EcoSystem
- www-unix.grids-center.org/
- 			r6/ecosystem/

- 2nd Edition
- www.mkp.com/grid2

## And before we go...

- Don’t forget your comments form
- Please make sure your SW for tomorrow is running
- 9am start on Wednesday!