# Presentation: 657832

## Grid Enabling Open Science

- Computation Institute
- Argonne National Lab & University of Chicago

- Grid Enabling Open Science

**Notes:**
Keynote, German eScience Conference, Baden Baden

## Abstract

-    Rapid advances in both science and information technology are driving the emergence of "eScience.” Grid technologies play a crucial role in eScience by enabling resource and service federation across organizational boundaries, supporting on-demand access to computing resources, and allowing the formation and operation of distributed, multi-organizational collaborations. eScience and Grid also require new tools, infrastructure, and policies. I will discuss opportunities, achievements, and challenges in these related areas.

## What is the Grid?

-   “**The Grid** is an international project that looks in detail at a terrorist cell operating on a global level and a team of American and British counter-terrorists who are tasked to stop it”

- Gareth Neame, BBC's head of drama

## Well, Not Exactly!

-   “**The Grid** is an international project that looks in detail at scientific collaborations operating on a global level and a team of computer scientists who are tasked to enable it”

- At least, that’s where it started ...

##    When power transmission became (quasi-)ubiquitous ...

-    When power transmission became (quasi-)ubiquitous ...

## We No Longer Had to Travel to Power Plants

## We Invented New Tools

## We Worked in New Ways

-     As **telecommunications**

- become (quasi-)ubiquitous

## We Can Access Computing on Demand  

**Public PUMA Knowledge Base**
- Information about proteins analyzed against ~2 million gene sequences

**Back Office****Analysis on Grid**
- Millions of BLAST, BLOCKS, etc., onOSG and TeraGrid

- Natalia Maltsev et al.,** **http://compbio.mcs.anl.gov/puma2

**Notes:**
Using Grid3 and TeraGrid:
  a) 2.1 million sequences: (February 2005)
	BLAST:  Took about 7days.
	LOCKS: Took about 8 days.
b) 2,314,886 sequences: (May 2005)
	BLAST : took 8 days 16 hours.
	BLOCKS : Took 10 days
There were many smaller runs involving genomes between 1000 to 4000 sequences.
Grid3 and TeraGrid (NCSA and SDSC) resources were used.

200-250 processors.
13M sequences processed in one year.

- Bennett Berthenthal et al., www.sidgrid.org

- We Can Invent New Tools

- We Can Work in New Ways:
- Access Grid and SARS

## Grid:Unifying Concept & Technology

- Computers, storage, data, people, ...
- Resources can be distributed, heterogeneous
**Networks & protocols** provide the connectivity
**Software** provides the “glue”

- Grid:Unifying Concept & Technology

## Technology, Infrastructure, & Standards

- Applications

- Technology, Infrastructure, & Standards

- Resources

**integration**

**interoperability**

- User-level Middleware and Tools

- System-level Common Infrastructure

*For example*

## Emergence of New Problem Solving Methodologies

- <0

- 1700

- 1950

- 1990

- eScience: When brute force doesn’t work anymore (Szalay)

**Notes:**
Aristotle, Leibniz, von Neuman, Gray

Theory=math
Simulation = math + CS
Data = bits and algorithms, i.e., CS.

Different disciplines advanced to different stages: e.g., parking still empirical (-:

## First Generation Grids:Batch Computing

- First Generation Grids:**Batch Computing**

-   Focus on aggregation of many resources for massively (data-)parallel applications

- EGEE

## Second Generation Grids:Service-Oriented Science

- Empower many more users by enabling on-demand access to **services**
- Grids become an enabling technology for **service oriented science** (or business)
- Grid infrastructures host services
- Grid technologies used to build services

- “Service-Oriented Science”, *Science*, 2005

*Science*
*Gateways*

## “Web 2.0”

- Software as services
- Data- & computation-richnetwork services
- Services as platforms
- Easy composition of services to create new capabilities (“mashups”)—that themselves may be made accessible as new services
- Enabled by massive infrastructure buildout
- Google projected to spend $1.5B on computers, networks, and real estate in 2006
- Many others are spending substantially
- Paid for by advertising

- Declan
- Butler,
- Nature

**Notes:**
Services
Composition
Infrastructure

## Service-Oriented Science:E.g., Virtual Observatories

**Data Archives**

- Gateway

- Figure: S. G. Djorgovski

## Service-Oriented Science

- People **create** services (data or functions) ...
- which I **discover** (& decide whether to use) ...
- & **compose** to create a new function ...
- & then **publish** as a new service.
-  *I find “someone else” to ****host**** services, **so I don’t have to become an expert in operating* *services & computers!*
-  *I hope that this “someone else” can ****manage**** security, reliability, scalability, ...*

- !

- !

- “Service-Oriented Science”, *Science*, 2005

## Skyserver Sessions(Thanks to Alex Szalay)

## Service-Oriented Science& Cancer Biology

*caBIG: sharing of infrastructure, applications, and data. *

**Data**
**Integration!**

- Service-Oriented Science& Cancer Biology

**Notes:**
I would mention data integration here: integration of different data types: tissue, (pre)clinical, genomics, proteomics....

## Cancer Bioinformatics Grid

**NCICB**

**Research**
**Center**

***Grid-Enabled Client***

**Research**
**Center**

**Tool 1**

**Tool 2**

**Tool 3**

**Tool 4**

***Grid Data Service***

***Analytical Service***

***Grid Portal***

*All Globus-based,*
*by the way ...*

- “Grids are not just communities of     computers, but communities of   researchers, of people.”
- 	— Peter Arzberger

## PRAGMA

- New communities:

## Grids are Communities ...

- Based on (technology-mediated) trust
- Common goals
- Processes and policies
- Reward systems
- That share resources
- Computers
- Data
- Sensor networks
- Services
- Supported by software and standards

## GlobalCommunity

- GlobalCommunity

## Globus Downloads Last 24 Hours

## Towards Open eScience

- Natural disasters

- Sustainable energy

- Disease

- Climate change

**Notes:**
Life and nature: structures, processes and interactions
Matter and universe: origins, structure, manipulation & futures; interactions, systems and context
Humanity: creativity, socialization and community

## Science 1.0  Science 2.0

- Megabytes & gigabytes
- Tarballs
- Journals
- Individuals
- Community codes
- Supercomputer centers
- Makefile
- Computational science
- Mostly physical sciences
- 1000s of computationalists
-  Government funded

-  Terabytes & petabytes
-  Services
-  Wikis
-  Communities
-  Science gateways
-  Campus & national grids ...
-  Workflow
-  Science as computation
-  All sciences (& humanities)
-  Millions of researchers
-  Government funded

## Thanks!

- DOE Office of Science
- NSF Office of Cyberinfrastructure
- Colleagues at Argonne, U.Chicago, USC/ISI, and elsewhere
- Many members of the German DGrid community

## Summary

- Technology exponentials are transforming the nature of research
- Data-, compute-, & communication-intensive approaches are increasingly influential
- Grid is a unifying concept & technology
- Federation & on-demand access to resources
- An enabler of “service-oriented science”
- Transforms how we conduct research & communicate results
- Demands new reward structures, training, & infrastructure

- For more information: **http://ianfoster.typepad.com**