# Presentation: 398766

## Open Science Grid.. An introduction

- Ruth Pordes
- Fermilab

## Introducing myself

- I have been at Fermilab for 25 years (well and 2 years in the “pioneer” ‘70s).
- I started working on data acquisition for High Energy Physics experiments; worked as a “builder” of the Sloan Digital Sky Survey;  managed the DART project for a common data acquisition system for 6 experiments at Fermilab; co-coordinated the CDF/D0 Joint Run II offline projects; co-coordinated the Particle Physics Data Grid SciDAC I collaboratory and introduced Trillium - iVDGL, GridPhyN, PPDG - ad-hoc collaboration from which Open Science Grid derives.
- Now I am variously an Associate Head of the Computing Division at Fermilab, Executive Director of the Open Science Grid, and US CMS Grid Services and Interfaces Coordinator.

## Scope of OSG

## Who is OSG ?

- Many DOE Labs and DOE/NSF sponsored University IT facilities.
- Grid technology groups: Condor, Globus, SRM, NMI.
- Large global physics collaborations:  US ATLAS, US CMS, LIGO, CDF, D0, STAR
- Smaller research collaborations: SDSS, DES, GADU,
- Partnerships e.g. TeraGrid, European Grids, Regional/Campus Grids e.g. Texas, Wisconsin...
- Education projects e.g. I2U2.

##  Current OSG deployment 

- 96 Resources across
- production & integration infrastructures - increase of about 10 in last 6 months. Note first UK site : Star in Birmingham

- 27 Virtual Organizations including operations and monitoring groups - increase of about 5 in last 6 months

- ~15,000 CPUs
- ~6 PB MSS
- ~4 PB disk

## OSG Funding

- OSG will be co-funded by DOE and NSF for 5 years at $6M/year starting in Sept ‘06
- Includes major deliverables for US LHC, LIGO and STAR; well used by CDF and D0;
- Commitment to engage communities beyond Physics.
- Commitment to collaborate with EGEE and TeraGrid.
- Consortium policies are to be open to participation by all researchers.
- Project responsibilities are to operate, protect, extend and support the Distributed Facility for the Consortium.

## OSG Consortium

## OSG & Outside-of-physics Communities

**Genome analysis GADU** project re-analyses publicly available genome databases and makes usable, annotated, summaries for researchers
- >100 **Nanotechnology** **Biomoca **jobs -- that run from 10-40 days -- are being executed on LIGO, ATLAS and CMS sites.
- We are discussing partnership with the Northwest Indiana Computing Grid (NWICG) -- which would bring in  **Gaussian.**
- Alan Blatecky’s group at RENCI is porting the “award winning **Bioportal**” to OSG.
- The **P-Grade portal** running a version of **CHARMM **molecular dynamics simulation package.
- Work on **Campus Grids** enabling Crimson Grid, NWICG, New York State Grid (NYSG) , GPN (Nebraska Education/Training grid) partnerships. (Note: Partners do not have to contribute resources; collaboration can equally be in software, procedures, education, training, security etc.)

## OSG Metrics - Sept 2006

| Compute sites | 59 |
| --- | --- |
| Storage sites | 11 (3 have  tape and 8 are disk only) |
| Accessible CPUs (excluding those in partner Campus Grids) | 15K Commodity linux boxes |
| Custodial Storage | 6 Petabytes (owned by specific VOs and in general non-sharable) |
| Disk storage and caches | 2 PB |
| Data transfer (include from CERN to Tier-1s and Tier-1s to Tier-2s) |  ~2-5Gbits/sec |
| Number of registered VOs (including operations/monitoring) | 28 (4 Education projects + 7 Outside-of-physics.) |
| Number of simultaneiously running jobs | 3K-4K |
| CPUhours per day | 50K |

##  High Throuhgput Data Transfer

- OSG must deliver petabytes of data moved and stored (and removed) for the US LHC in 2008.
- LIGO data scales will increase (factor of 10?) in 2009.

- 1 GBit/sec

- Last 3 months throughput to US CMS Tier-2s:

## The big three run continuously

- CMS

- CDF

- ATLAS

- 3500

## Mix of smaller VOs..

- 600

## What is the OSG?

## Compute Elements

- Processing Farms accessed through GRAM and supporting job execution through one of 5 different batch systems.
- Priorities and policies through assignment of Group/VO Roles mapped to accounts and batch queue priorities.

- Commodity
- Linux Farms;
-  & Disk.
- optional MSS

- From ~20 CPUs in
- Department Computers
- To 10,000 CPU SuperComputer

- Any
- University Local
- Batch System

- OSG CE
- gateway

- OSG & the
- Wide Area Network

## Storage Elements

- Storage Services - access storage through Storage Resource Manager (SRM) interface and GridFtp.
- Allocation of shared storage through agreements between Site and VO(s) facilitated by OSG.

- Mass Storage
- Systems And
- Disk Caches

- From 20 GBytes Disk Cache
- To 4 Petabyte Robotic
- Tape Systems

- Any
- Shared Storage

- OSG SE
- gateway

- OSG & the
- Wide Area Network

## Virtual Organizations (VOs)

- OSG Infrastructure trades in Groups not Individuals.
- Virtual Organization Management services allow registration, administration and control of members of the group.
- Facilities trust and authorize VOs.
- Storage and Compute Services prioritize according to VO group.

- Set of  Resources that
- Trust the VO

- VO
- Management Service

- OSG & the
- Wide Area Network

- VO
- Middleware &
- Applications

## Common Grid Infrastructure

- Overlaid by VO Grid Systems and Environments

- OSG provides gridwide monitoring, information, validation, accounting services.

## Network Connectivity

- Well network provisioned sites e.g. connected to Starlight to low bandwidth  connections e.g. Taiwan
- Connectivity ranges from full-duplex, outgoing only, to fully behind firewalls.
- Expect more focus on network issues as data aspects become more important.

## Middleware

## OSG Middleware

- Infrastructure

- Applications

- VO Middleware

- Core grid technology distributions:
- Condor, Globus, Myproxy

**Virtual Data Toolkit (VDT) ** core technologies + software needed by stakeholders: e.g.VOMS, CEMon VDS, MonaLisa, VO-Privilege.

**OSG Release Cache:**
- VDT +  OSG specific configuration + utilities.

**ATLAS **Panda, DQ etc

**CMS **cmssw, LFC, etc.

**Bio **blast, charmm etc.

**LIGO **LDR, Catalogs etc.

- User Science Codes and Interfaces

- Existing Operating, Batch systems and Utilities.

- OSG Middleware is deployed on existing farms and storage systems.
- OSG Middleware interfaces to the existing installations of OS, utilities and batch systems.
- VOs have VO scoped environments  in which they deploy applications (and other files), execute code and store data.
- VOs are responsible for and have control over their end-to-end distributed system using the OSG infrastructure.

## What is the VDT?

- A collection of software
- Grid software (Condor, Globus and lots more)
- Virtual Data System (Origin of the name “VDT”)
- Utilities
- Built for >10 flavors/versions of Linux
- An easy installation
- Goal: Push a button, everything just works
- Two methods:
- Pacman: installs and configures it all
- RPM: installs some of the software, no configuration
- A support infrastructure

- Build Software

## Software Release Process

- Gather requirements

- Build software

- Test

- Validation test bed

- ITB Release Candidate

- VDT Release

- Integration test bed
- (test services, system,
- applications,interoperability)

- OSG Release

- Time

-    Decrease errors in production
-    Make installations easy, quick and
- 	foolproof.
-    Make releases and updates faster
-    Support different sub-sets of software
- 	for different purposes.

- Integration Testbed, ~15 sites, includes application people.

## What software is in the VDT?

- Security
- VOMS (VO membership)
- GUMS (local authorization)
- mkgridmap (local authorization)
- MyProxy (proxy management)
- GSI SSH
- CA CRL updater
- Monitoring
- MonaLISA
- gLite CEMon
- Accounting
- OSG Gratia
- Support
- Apache,Tomcat
- MySQL (with MyODBC)
- Non-standard Perl modules
- Wget
- Squid
- Logrotate, Configuration Scripts

- Job Management
- Condor (& Condor-G & Condor-C)
- Globus GRAM
- Data Management
- GridFTP (data transfer)
- RLS (replication location)
- DRM (storage management)
- Globus RFT
- Information Services
- Globus MDS
- GLUE schema & providers
- Client tools
- Virtual Data System
- SRM clients (V1 and V2)
- UberFTP (GridFTP client)
- Developer Tools
- PyGlobus, PyGridWare
- Testing
- NMI Build & Test, VDT Tests

## Due diligence to Security

- Risk assessment, planning, Service auditing and checking
- Incident response, Awareness and Training, Configuration management,
- User access Authentication and Revocation, Auditing and analysis.* *End to end *trust* in quality of code executed on remote CPU -signatures?
- Identity and Authorization: Extended X509 Certificates
- OSG is a founding member of the US TAGPMA.
- DOEGrids provides script utilities for  bulk requests of Host certs, CRL checking etc.
- VOMS extended attributes and infrastructure for Role Based Access Controls.

## One Grid Among Many

## Grid - of - Grids

## FermiGrid Exemplar Campus Grid

**FermiGrid**

- Existing

- New Resources to be added to “Common”

- Enables efficiencies in resources, effort and expertise.

## Bridging Campus Grid  to OSG: GLOW

- Dispatch jobs from local security, job, storage infrastructure and “uploading” to wide-area infrastructure.

## Communicationwww.opensciencegrid.orghttp://vdt.cs.wisc.eduhttp://osg.ivdgl.org/twiki/bin/view 

## Training - e.g. Grid Summer Workshop Year 4

- Hands on.Technical trainers.Nice Setting (Padre Island).Students got their own applications to run on OSG!

## Science Grid This Week

**Broad set of activities**
- (Katie Yurkewicz)
- News releases, PR, etc.
- Science Grid This Week,  1.5 years (>1000  subscribers)

- www.interactions.org/sgtw

## Summary

- OSG provides some core services and software, provides a distributed facility for its stakeholders, and partners with other projects to share experience and collaborate in several different areas.