# Presentation: 034850

## PDQ Overview

**PDQ Overview**

**WHO WE ARE**
**Expedition Leads****:  **Ian Foster, ANL  and  Robert Brunner, NCSA
**Coordinator:  **Veronika Nefedova, ANL
**Site/Subproject leads: **Tom DeFanti, UIC; Miron Livny; U.Wisconsin-Madison; Ray Plante, NCSA; Natalia Maltsev, ANL; Nagiza Samatova, ORNL
**Partners: **Bob Wilhelmson, MEAD, Dennis Gannon, Portals, Rob Gardner, U. Chicago, Paul Avery, U. Florida,  Mike Wilde, ANL, Jens Voeckler, U. Chicago
**For more information:** http://www.mcs.anl.gov/pdq

- Used Condor and Stork technologies, managed by DAGMan, to move 3 TB of DPOSS astronomical imaging data.
- Wisconsin's DiskRouter system was deployed on StarLight's data clusters for PDQ experiments. StarLight also serves as a high bandwidth testbed for Quanta and GridFTP for experimentation with new protocols for multi-gigabit PDQ data delivery. (_[www.](http://www.startap.net/starlight)__[startap](http://www.startap.net/starlight)__[.net/starlight](http://www.startap.net/starlight)_)

**Radio Astronomy**
- The aim of this work is to integrate Grid-based data management into radio astronomy pipelines:first the BIMA Image Pipeline, next the VLA pipeline which manages data between the NRAO archive and platforms used for processing at NCSA.
-  **Virtual Astronomy**
- The aim of this work is to utilize Grid-based data management for various astrophysical data archives (SDSS (EDR only), DPOSS, 2MASS, NVSSS, FIRST, and ROSAT within the NCSA domain).  Once this is done, we will develop and deploy several archive services, including complex spatial queries and data federation functionality.

**Bioinformatics**
- We are applying existing virtual data techniques to the labor-intensive process of gathering genomic data from multiple sources, reformatting that data, and transforming it for insertion into the ANL sequence database, to enable the recording and tracking of the processes of comparative genome analysis .

**OUR APPLICATIONS**

**MEAD**
- We are implementing basic data movement and traditional management technologies. Next, we will focus on metadata organization and retrieval as well as distributed data management, using strategies and capabilities used in other related efforts (e.g. use of OGSA-DAI technology in the ESG project).

**GriPhyN**
- We are exploiting first PACI and then TeraGrid resources to enable computations at least one order of magnitude larger than currently feasible. One example of target computations is galaxy cluster detection in SDSS data.

- Developed and customized many Grid Tools for our Applications: Virtual Data Toolkit (Chimera), Reliable File Transfer (RFT), GridFTP
- Deployed Grid Tools on the production systems at NCSA, ANL, SDSC and FNAL

**SOME OF OUR ACHIEVEMENTS **

- Grid-enabled several Bioinformatics applications (such as Blast and GADU) and achieved x5 times acceleration of computations in the production run.
- Developed several Bioinformatics tools for computationally-intensive genome analysis (PhyloBlocks, SVMMER, PAT, BloBla)

**OUR GOAL**
- We aim to achieve the technical advances, technology deployment, and application integration required to enable data-intensive applications to harness Alliance and TeraGrid resources, thus transforming these systems from potential Grid resources into demonstrably effective Grid powerhouses.