# Presentation: 369998

## Using The Virtual Data GridFor Discovery in Science EducationA partnership of GriPhyN, iVDGL, and Quarknet

- Presented by Mike Wilde
- Argonne National Laboratory
- Grid Physics Network – GriPhyNInternational Virtual Data Grid Laboratory – iVDGL

- Photon Lepton 2003 – Fermilab – 14 August 2003

## Vision of the Grid Physics Network

- Enhance scientific productivity through...
- Discovery and analysis of data at petabyte scales
- Using a worldwide data grid as a scientific workstation
*The key to this approach is Virtual Data – creating and managing datasets through decriptions and workflow “recipes”*

## Virtual Data Capabilities

- Discovery: Data and program discovery
- Explanation and validation: provenance
- Workflow: Structured paradigm for organizing, locating, specifying, & producing scientific datasets
- Forming new workflow
- Building new workflow from existing patterns
- Managing change
- Planning and scheduling

## Virtual Data in CMS HEP Analysis

**mass = 200**
**decay = WW**
**stability = 1**
**LowPt = 20**
**HighPt = 10000**

**mass = 200**
**decay = WW**
**stability = 1**
**event = 8**

**mass = 200**
**decay = WW**
**stability = 1**
**plot = 1**

**mass = 200**
**decay = WW**
**plot = 1**

**mass = 200**
**decay = WW**
**event = 8**

**mass = 200**
**decay = WW**
**stability = 1**

**mass = 200**
**decay = WW**
**stability = 3**

**mass = 200**

**mass = 200**
**decay = WW**

**mass = 200**
**decay = ZZ**

**mass = 200**
**decay = bb**

**mass = 200**
**plot = 1**

**mass = 200**
**event = 8**

- ...The scientist
- adds a new
- derived data
- branch...

- ...and continues to
- investigate...

- Search for
- WW decays of
- the Higgs Boson
- and where only
- stable, final state
- particles are
- recorded:**  stability = 1**

- Scientist discovers
- an interesting result – wants to know how
- it was derived.

*Work and slide by*
*Rick Cavanaugh and*
*Dimitri Bourilkov,*
*University of Florida*

## Example:Sloan Galaxy Cluster Analysis

- Galaxy cluster
- size distribution

- DAG

- Example:Sloan Galaxy Cluster Analysis

- Sloan Data

- Jim Annis, Steve Kent, Vijay Sehkri, Neha Sharma, Fermilab, Michael Milligan, Yong Zhao, Chicago

## Virtual Data Grid

## VDL: A Language to DescribeData Transformations

- Transformation
- Abstract template of program invocation
- Similar to "function definition"
- Derivation
- Formal invocation of a Transformation
- Similar to "function call"
- Store past and future:
- A record of how data products were generated
- A recipe of how data products can be generated
- Invocation
- Record of a Derivation execution

## Describing Dependencies

- TR tr1(in a1, out a2) {
-     app = "/usr/bin/app1";
-     argument stdin = ${a1};
-     argument stdout = ${a2}; }
- TR tr2(in a1, out a2) {
-     app = "/usr/bin/app2";
-     argument stdin = ${a1};
-     argument stdout = ${a2}; }
- DV x1->tr1(a1=@{in:file1}, a2=@{out:file2});
- DV x2->tr2(a1=@{in:file2}, a2=@{out:file3});

- file1

- file2

- file3

- x1

- x2

**Notes:**
Explicit dependencies.

## Vision for Grid-QuarkNet Collaboration

- Quarknet supplies GriPhyN with simplified but realistic challenge problems
- GriPhyN provides a Virtual Data Laboratory to QuarkNet
- QuarkNet students and teachers generate reams of test data and science applications
- iVDGL Open Science Grid provides the Grid execution environment
- GriPhyN and iVDGL get valuable user feedback

## Discover Data and Processes

## View Derivation Processes

## Describe New Transformations

*Screen mockup*

## Describe New Derivations

## Derive Datasets from VDL Definitions

## View Datasets

## Project Status and Next Steps

- Initial portal prototype progressing rapidly
- Implementation by Yong Zhao, University of Chicago
- Quarknet team already developing apps and datasets for Z-zero and Cosmic Ray Detectors
- Next iVDGL rollout - Grid3 – under way, will be available for QuarkNet use
- QuarkNet feedback will provide valuable guidance to GriPhyN CS Research

## Acknowledgements

- GriPhyN, iVDGL, and QuarkNet are supported by the National Science Foundation

- The Globus Project and QuarkNet are supported in part by the US Department of Energy,Office of Science