Performance Expedition Reports

Expedition Name: **Performance**

1\. Subproject Name: **Performance Analysis**

Partners (funded and unfunded): **Valerie Taylor (Texas A& M)**

Subproject Overview

Milestones, Deliverables, and Progress to date (accomplishments)

+---+------------------------+------+-------+-----------+--------------+
| * | **Performance          | *    | **Tue | **Working | **Taylor     |
| * | Analysis**             | *Tue | 9/30  | with the  | (Texas       |
| 2 |                        | 1    | /03** | MEAD      | A&M)**       |
| * |                        | 0/1/ |       | exp       |              |
| * |                        | 02** |       | edition** |              |
+---+------------------------+------+-------+-----------+--------------+
| 3 | > Make PAIDE available | Tue  | Tue   | C         |              |
|   | > to the Alliance      | 10/  | 12/   | ompleted. |              |
|   | > community            | 1/02 | 31/02 | See the   |              |
|   |                        |      |       | link      |              |
|   |                        |      |       | Prophesy  |              |
|   |                        |      |       | of Tools  |              |
|   |                        |      |       | webpage.  |              |
+---+------------------------+------+-------+-----------+--------------+
| 4 | > Begin analyzing the  | Tue  | Tue   |           |              |
|   | > MEAD codes; explore  | 10/  | 12/   |           |              |
|   | > the use of data      | 1/02 | 31/02 |           |              |
|   | > partitioning for     |      |       |           |              |
|   | > distributed systems  |      |       |           |              |
|   | > with the MEAD codes  |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 5 | > Make Prophesy        | Wed  | Mon   | C         |              |
|   | > Database available   | 1/   | 3/    | ompleted. |              |
|   | > to the community;    | 1/03 | 31/03 | See the   |              |
|   | > continue work with   |      |       | link      |              |
|   | > MEAD codes           |      |       | Prophesy  |              |
|   |                        |      |       | of Tools  |              |
|   |                        |      |       | webpage.  |              |
+---+------------------------+------+-------+-----------+--------------+
| 6 | > Release the          | Tue  | Mon   | C         |              |
|   | > automated modeling   | 4/   | 6/    | ompleted. |              |
|   | > component of         | 1/03 | 30/03 | See the   |              |
|   | > Prophesy to the      |      |       | link      |              |
|   | > community            |      |       | Prophesy  |              |
|   |                        |      |       | of Tools  |              |
|   |                        |      |       | webpage.  |              |
+---+------------------------+------+-------+-----------+--------------+
| 7 | > Obtain initial       | Tue  | Mon   |           |              |
|   | > performance analysis | 4/   | 6/    |           |              |
|   | > and static load      | 1/03 | 30/03 |           |              |
|   | > balancing results    |      |       |           |              |
|   | > from the MEAD codes  |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 8 | > Continue work with   | Tue  | Tue   |           |              |
|   | > different modeling   | 7/   | 9/    |           |              |
|   | > techniques to be     | 1/03 | 30/03 |           |              |
|   | > incorporated into    |      |       |           |              |
|   | > Prophesy; continue   |      |       |           |              |
|   | > work with the MEAD   |      |       |           |              |
|   | > codes                |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+

User communities

MEAD expedition

Technical Reports and Publications

-   Valerie Taylor, Xingfu Wu, Jonathan Geisler, and Rick Stevens, Using
    Kernel Couplings to Predict Parallel Application Performance, *Proc.
    of the 11th IEEE International Symposium on High-Performance
    Distributed Computing (HPDC 2002)*.

-   Prophesy: An Infrastructure for Performance Analysis and Modeling of
    Parallel & Distributed Applications, Research Exhibit, SC2002.

-   Z. Lan and V. Taylor, A Novel Dynamic Load Balancing Scheme for
    Parallel Systems, Journal of Parallel and Distributed Computing, vol
    62/12 pp. 1763 - 1781, 2002.

-   Z. Lan and V. Taylor, Exploring Cosmology Applications on
    Distributed Environments, To Appear in the Journal of Future
    Generation of Computer Systems, 2003.

-   Valerie Taylor, Xingfu Wu, and Rick Stevens, Isocoupling: Measuring
    and Predicting the Performance of Parallel and Grid Applications,
    Technical Report.

2\. Subproject Name: **PAPI**

Partners (funded and unfunded): **Jack Dongarra (UTK)**

Subproject Overview

Milestones, Deliverables, and Progress to date (accomplishments)

+---+------------------------+------+-------+-----------+--------------+
| * | **PAPI**               | *    | **Tue | **Coll    | **Dongarra   |
| * |                        | *Tue | 9/30  | aborating | (Tennessee), |
| 9 |                        | 1    | /03** | with NCSA | Moore        |
| * |                        | 0/1/ |       | to        | (            |
| * |                        | 02** |       | support   | Tennessee)** |
|   |                        |      |       | use of    |              |
|   |                        |      |       | PAPI and  |              |
|   |                        |      |       | PAP       |              |
|   |                        |      |       | I-related |              |
|   |                        |      |       | tools by  |              |
|   |                        |      |       | the       |              |
|   |                        |      |       | Community |              |
|   |                        |      |       | Ap        |              |
|   |                        |      |       | plication |              |
|   |                        |      |       | Codes     |              |
|   |                        |      |       | Expe      |              |
|   |                        |      |       | dition.** |              |
+---+------------------------+------+-------+-----------+--------------+
| 1 | > Port PAPI to the     | Tue  | Tue   | Initial   |              |
| 0 | > Intel Itanium2       | 10/  | 12/   | port has  |              |
|   | > (McKinley) processor | 1/02 | 31/02 | been      |              |
|   |                        |      |       | completed |              |
|   |                        |      |       | and was   |              |
|   |                        |      |       | included  |              |
|   |                        |      |       | in PAPI   |              |
|   |                        |      |       | 2.3.1     |              |
|   |                        |      |       | released  |              |
|   |                        |      |       | in        |              |
|   |                        |      |       | November  |              |
|   |                        |      |       | 2002. The |              |
|   |                        |      |       | Itanium2  |              |
|   |                        |      |       | port will |              |
|   |                        |      |       | be        |              |
|   |                        |      |       | further   |              |
|   |                        |      |       | refined   |              |
|   |                        |      |       | for the   |              |
|   |                        |      |       | PAPI 3.0  |              |
|   |                        |      |       | release.  |              |
+---+------------------------+------+-------+-----------+--------------+
| 1 | > Complete the PAPI    | Tue  | Tue   | Completed |              |
| 1 | > User\'s Guide        | 10/  | 12/   | and and   |              |
|   |                        | 1/02 | 31/02 | released  |              |
|   |                        |      |       | with PAPI |              |
|   |                        |      |       | 2.3.1.    |              |
+---+------------------------+------+-------+-----------+--------------+
| 1 | > Release PAPI version | Tue  | Tue   | Still     |              |
| 2 | > 3                    | 12/3 | 12/   | under     |              |
|   |                        | 1/02 | 31/02 | dev       |              |
|   |                        |      |       | elopment. |              |
|   |                        |      |       | PAPI      |              |
|   |                        |      |       | version 3 |              |
|   |                        |      |       | is a      |              |
|   |                        |      |       | complete  |              |
|   |                        |      |       | rewrite   |              |
|   |                        |      |       | that will |              |
|   |                        |      |       | be more   |              |
|   |                        |      |       | flexible  |              |
|   |                        |      |       | and have  |              |
|   |                        |      |       | lower     |              |
|   |                        |      |       | overheads |              |
|   |                        |      |       | than the  |              |
|   |                        |      |       | current   |              |
|   |                        |      |       | version.  |              |
|   |                        |      |       | We backed |              |
|   |                        |      |       | off to    |              |
|   |                        |      |       | release   |              |
|   |                        |      |       | 2.3.1 for |              |
|   |                        |      |       | November  |              |
|   |                        |      |       | 2003. We  |              |
|   |                        |      |       | hope to   |              |
|   |                        |      |       | release   |              |
|   |                        |      |       | version 3 |              |
|   |                        |      |       | beta by   |              |
|   |                        |      |       | May 2003. |              |
+---+------------------------+------+-------+-----------+--------------+
| 1 | > Add multiprocess     | Wed  | Mon   |           |              |
| 3 | > capability for the   | 1/   | 3/    |           |              |
|   | > Dynaprof dynamic     | 1/03 | 31/03 |           |              |
|   | > instrumentation tool |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 1 | > Compare counting vs. | Wed  | Mon   |           |              |
| 4 | > sampling modes of    | 1/   | 3/    |           |              |
|   | > using the Itanium    | 1/03 | 31/03 |           |              |
|   | > processor            |      |       |           |              |
|   | > performance          |      |       |           |              |
|   | > monitoring unit      |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 1 | > Investigate the use  | Wed  | Mon   |           |              |
| 5 | > of Event Address     | 1/   | 3/    |           |              |
|   | > Registers and event  | 1/03 | 31/03 |           |              |
|   | > qualification        |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 1 | > Design and implement | Tue  | Mon   | Started.  |              |
| 6 | > a papirun utility    | 4/   | 6/    |           |              |
|   |                        | 1/03 | 30/03 |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 1 | > Prototype            | Tue  | Mon   |           |              |
| 7 | > implementation of    | 4/   | 6/    |           |              |
|   | > new PAPI features    | 1/03 | 30/03 |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 1 | > Release PAPI 3.5     | Tue  | Tue   |           |              |
| 8 | > with additional      | 9/3  | 9/    |           |              |
|   | > features; Document   | 0/03 | 30/03 |           |              |
|   | > thef use of PAPI and |      |       |           |              |
|   | > related tools with   |      |       |           |              |
|   | > applications         |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+

User communities

Community Application Codes expedition

Technical Reports and Publications

-   Jack Dongarra, Allen Malony, Shirley Moore, Philip Mucci, and Sameer
    Shende, \"Performance Instrumentation and Measurement for Terascale
    Systems\", submitted to International Conference on Computational
    Science (ICCS 2003)

-   Jack Dongarra, Kevin London, Shirley Moore, Philip Mucci, Daniel
    Terpstra, Haihang You, and Min Zhou, \"Experiences and Lessons
    Learned with a Portable Interface to Hardware Performance
    Counters\", International Parallel and Distributed Processing
    Symposium (IPDPS 2003), Nice, France, April 2003 (to appear)

3\. Subproject Name: **Performance Tools for Parallel and Grid
Computing**

Partners (funded and unfunded): **Dan Reed (UIUC/NCSA)**

Subproject Overview

Milestones, Deliverables, and Progress to date (accomplishments)

+---+------------------------+------+-------+-----------+--------------+
| * | **Performance Tools    | *    | **Tue | ** **     | **Reed       |
| * | for Parallel and Grid  | *Tue | 9/30  |           | (            |
| 1 | Computing**            | 1    | /03** |           | UIUC/NCSA)** |
| 9 |                        | 0/1/ |       |           |              |
| * |                        | 02** |       |           |              |
| * |                        |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 2 | > Deploy latest        | Tue  | Tue   | C         |              |
| 0 | > version of SvPablo   | 12/3 | 12/   | ompleted. |              |
|   | > on IA-64 clusters    | 1/02 | 31/02 |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 2 | > Port the PCF tool to | Tue  | Tue   | Not       |              |
| 1 | > the IA-64            | 10/  | 12/   | c         |              |
|   | > environment          | 1/02 | 31/02 | ompleted; |              |
|   |                        |      |       | some      |              |
|   |                        |      |       | a         |              |
|   |                        |      |       | dditional |              |
|   |                        |      |       | tests     |              |
|   |                        |      |       | with PCF  |              |
|   |                        |      |       | on IA-64  |              |
|   |                        |      |       | are       |              |
|   |                        |      |       | needed; a |              |
|   |                        |      |       | more      |              |
|   |                        |      |       | realistic |              |
|   |                        |      |       | c         |              |
|   |                        |      |       | ompletion |              |
|   |                        |      |       | date      |              |
|   |                        |      |       | would be  |              |
|   |                        |      |       | 2/28/03.  |              |
+---+------------------------+------+-------+-----------+--------------+
| 2 | > Present              | Tue  | Tue   | Partially |              |
| 2 | > mini-tutorials on    | 10/  | 12/   | complete; |              |
|   | > SvPablo and PCF to   | 1/02 | 31/02 | I believe |              |
|   | > Alliance users       |      |       | that the  |              |
|   |                        |      |       | two       |              |
|   |                        |      |       | E         |              |
|   |                        |      |       | xpedition |              |
|   |                        |      |       | events    |              |
|   |                        |      |       | that are  |              |
|   |                        |      |       | being     |              |
|   |                        |      |       | p         |              |
|   |                        |      |       | rogrammed |              |
|   |                        |      |       | for April |              |
|   |                        |      |       | would be  |              |
|   |                        |      |       | our best  |              |
|   |                        |      |       | chance to |              |
|   |                        |      |       | complete  |              |
|   |                        |      |       | it (by    |              |
|   |                        |      |       | 04/30/03) |              |
+---+------------------------+------+-------+-----------+--------------+
| 2 | > Perform SvPablo      | Wed  | Mon   | Started   |              |
| 3 | > instrumentation and  | 1/   | 3/    | as        |              |
|   | > characterization of  | 1/03 | 31/03 | scheduled |              |
|   | > TPM code             |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 2 | > Install PCF at       | Wed  | Mon   | Not       |              |
| 4 | > NCSA\'s IA-64        | 1/   | 3/    | started   |              |
|   | > cluster              | 1/03 | 31/03 | because   |              |
|   |                        |      |       | it        |              |
|   |                        |      |       | depends   |              |
|   |                        |      |       | on        |              |
|   |                        |      |       | task-21.  |              |
+---+------------------------+------+-------+-----------+--------------+
| 2 | > Update SvPablo       | Wed  | Mon   | Not       |              |
| 5 | > installation,        | 1/   | 3/    | started   |              |
|   | > compatible with      | 1/03 | 31/03 | because   |              |
|   | > PAPI-3.0             |      |       | it        |              |
|   |                        |      |       | depends   |              |
|   |                        |      |       | on        |              |
|   |                        |      |       | task-12.  |              |
+---+------------------------+------+-------+-----------+--------------+
| 2 | > Improve TPM code     | Tue  | Mon   |           |              |
| 6 | > performance          | 4/   | 6/    |           |              |
|   |                        | 1/03 | 30/03 |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 2 | > Perform SvPablo      | Tue  | Mon   |           |              |
| 7 | > instrumentation and  | 4/   | 6/    |           |              |
|   | > characterization of  | 1/03 | 30/03 |           |              |
|   | > nano biology code    |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 2 | > Instrument PCF and   | Tue  | Mon   | Started   |              |
| 8 | > conduct I/O          | 4/   | 6/    | before    |              |
|   | > characterization of  | 1/03 | 30/03 | the       |              |
|   | > AIPS++               |      |       | planned   |              |
|   |                        |      |       | starting  |              |
|   |                        |      |       | date.     |              |
+---+------------------------+------+-------+-----------+--------------+
| 2 | > Update of SvPablo    | Tue  | Mon   |           |              |
| 9 | > and PCF              | 4/   | 6/    |           |              |
|   | > installations on     | 1/03 | 30/03 |           |              |
|   | > NCSA\'s IA-64        |      |       |           |              |
|   | > cluster              |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 3 | > Improve nano-biology | Tue  | Tue   |           |              |
| 0 | > code performance;    | 7/   | 9/    |           |              |
|   | > improve AIPS++ I/O   | 1/03 | 30/03 |           |              |
|   | > performance; update  |      |       |           |              |
|   | > SvPablo and PCF      |      |       |           |              |
|   | > installations on     |      |       |           |              |
|   | > NCSA\'s IA-64        |      |       |           |              |
|   | > cluster              |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+

User communities

Technical Reports and Publications

-   Charng-da Lu and Daniel A. Reed, \"Compact Application Signatures
    for Parallel and Distributed Scientific Codes,\" Proceedings of
    SC\'2002,Baltimore, MD, November 2002. Supported by NSF under grants
    EIA-99-72884,ASC-97-20202 and Alliance PACI cooperative Agreement,
    and by DOE under contracts W-7405-ENG-36, LLNL-B341494,
    DEFC02-01ER41205 and LLNL B505214.

-   Celso L. Mendes and Daniel A. Reed, \"Monitoring Large Systems via
    Statistical Sampling,\" Proceedings of LACSI Symposium 2002, Santa
    Fe,NM, October 2002. Supported by NSF under grant EIA-9975020 and by
    DOE under contract W-7405-ENG-36.

-   Daniel A. Reed, Celso L. Mendes and Charng-da Lu. \"Intelligent Grid
    Application Tuning and Adaptation\". Chapter in Foster & Kesselman
    \"The Grid: Blueprint for a New Computing Infrastructure\", 2nd
    edition, 2003 (in preparation). Supported by NSF under grants
    EIA-99-72884, ASC-97-20202 and Alliance PACI cooperative Agreement,
    and by DOE under contracts W-7405-ENG-36, LLNL-B341494,
    DEFC02-01ER41205 and LLNL B505214.

4\. Subproject Name: **Compiler and Programming System Technologies for
DTF**

Partners (funded and unfunded): **Kennedy (Rice),Fowler (Rice)**

Subproject Overview

Milestones, Deliverables, and Progress to date (accomplishments)

+---+------------------------+------+-------+-----------+--------------+
| * | **Compiler and         | *    | **Tue | Working   | **Kennedy    |
| * | Programming System     | *Tue | 9/30  | with the  | (            |
| 3 | Technologies for DTF** | 1    | /03** | MEAD      | Rice),Fowler |
| 1 |                        | 0/1/ |       | e         | (Rice)**     |
| * |                        | 02** |       | xpedition |              |
| * |                        |      |       | on        |              |
|   |                        |      |       | pe        |              |
|   |                        |      |       | rformance |              |
|   |                        |      |       | tuning of |              |
|   |                        |      |       | climate   |              |
|   |                        |      |       | codes     |              |
+---+------------------------+------+-------+-----------+--------------+
| 3 | > Demonstrate NCOMMAS  | Mon  | Fri   | Completed |              |
| 2 | > and tools in         | 11/1 | 11/   |           |              |
|   | > Alliance booth at    | 8/02 | 22/02 |           |              |
|   | > Supercomputing 2002. |      |       |           |              |
|   | > Demonstrate          |      |       |           |              |
|   | > performance tools    |      |       |           |              |
|   | > and transformation   |      |       |           |              |
|   | > technology in Rice   |      |       |           |              |
|   | > booth                |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 3 | > Release a completely | Tue  | Tue   | C         |              |
| 3 | > open source version  | 12/3 | 12/   | ompleted. |              |
|   | > of HPCView suite.    | 1/02 | 31/02 | See the   |              |
|   | > Release an open      |      |       | link      |              |
|   | > source replacement   |      |       | HPCView   |              |
|   | > for bloop that runs  |      |       | of Tools  |              |
|   | > on Itanium2          |      |       | webpage.  |              |
+---+------------------------+------+-------+-----------+--------------+
| 3 | > Extend documentation | Tue  | Tue   | A draft   |              |
| 4 | > of Open64-based      | 10/  | 12/   | of the    |              |
|   | > infrastructure for   | 1/02 | 31/02 | docu      |              |
|   | > source-to-source     |      |       | mentation |              |
|   | > transformation       |      |       | is        |              |
|   | > infrastructure       |      |       | included  |              |
|   |                        |      |       | in the    |              |
|   |                        |      |       | dist      |              |
|   |                        |      |       | ribution. |              |
|   |                        |      |       | We are    |              |
|   |                        |      |       | working   |              |
|   |                        |      |       | on        |              |
|   |                        |      |       | reo       |              |
|   |                        |      |       | rganizing |              |
|   |                        |      |       | the       |              |
|   |                        |      |       | dis       |              |
|   |                        |      |       | tribution |              |
|   |                        |      |       | and       |              |
|   |                        |      |       | ins       |              |
|   |                        |      |       | tallation |              |
|   |                        |      |       | p         |              |
|   |                        |      |       | rocesses. |              |
|   |                        |      |       | A         |              |
|   |                        |      |       | revision  |              |
|   |                        |      |       | of the    |              |
|   |                        |      |       | docu      |              |
|   |                        |      |       | mentation |              |
|   |                        |      |       | will be   |              |
|   |                        |      |       | part of   |              |
|   |                        |      |       | this.     |              |
+---+------------------------+------+-------+-----------+--------------+
| 3 | > Hold                 | Mon  | Fri   | Being     |              |
| 5 | > workshop/tutorial in | 5/2  | 5/    | planned.  |              |
|   | > conjunction with     | 6/03 | 30/03 |           |              |
|   | > Alliance All Hands   |      |       |           |              |
|   | > Meeting              |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 3 | > Demonstrate          | Tue  | Mon   |           |              |
| 6 | > source-to-source     | 4/   | 6/    |           |              |
|   | > transformation       | 1/03 | 30/03 |           |              |
|   | > technology to        |      |       |           |              |
|   | > generate code        |      |       |           |              |
|   | > compatible with the  |      |       |           |              |
|   | > SHMOD library        |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 3 | > Port                 | Tue  | Tue   |           |              |
| 7 | > source-to-source     | 9/3  | 9/    |           |              |
|   | > transformation tools | 0/03 | 30/03 |           |              |
|   | > for use with NCOMMAS |      |       |           |              |
|   | > and other            |      |       |           |              |
|   | > applications to use  |      |       |           |              |
|   | > Open-64              |      |       |           |              |
|   | > infrastructure;      |      |       |           |              |
|   | > release on Web site  |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+

User communities

MEAD expedition

Technical Reports and Publications

-   John Mellor-Crummey, Robert Fowler, Gabriel Marin, and Nathan
    Tallent. HPCView: A tool for top-down analysis of node
    performance.The Journal of Supercomputing, 23, 81-101, 2002. Special
    Issue with selected papers from the 2001 Los Alamos Computer Science
    Institute Symposium.

-   Robert Fowler, John Mellor-Crummey, Guohua Jin and Apan Qasem, \"A
    Source-to-source Loop Transformation Tool\", poster session, Los
    Alamos Computer Science Institute Symposium, Santa Fe, NM, Oct,
    2002.

5\. Subproject Name: **SHMOD**

Partners (funded and unfunded): **Paul Woodward (Univ. of Minnesota)**

Subproject Overview

Milestones, Deliverables, and Progress to date (accomplishments)

+---+------------------------+------+-------+-----------+--------------+
| * | **SHMOD**              | *    | **Tue | **Working | **Woodward   |
| * |                        | *Tue | 9/30  | with the  | (            |
| 3 |                        | 1    | /03** | MEAD      | Minnesota)** |
| 8 |                        | 0/1/ |       | e         |              |
| * |                        | 02** |       | xpedition |              |
| * |                        |      |       | and the   |              |
|   |                        |      |       | team at   |              |
|   |                        |      |       | Rice      |              |
|   |                        |      |       | Univ      |              |
|   |                        |      |       | ersity.** |              |
+---+------------------------+------+-------+-----------+--------------+
| 3 | > Demonstrate          | Wed  | Fri   | C         |              |
| 9 | > fault-tolerant       | 10/  | 12/   | ompleted. |              |
|   | > execution of NCOMMAS | 1/02 | 31/02 |           |              |
|   | > under the SHMOD      |      |       |           |              |
|   | > framework on Titan   |      |       |           |              |
|   | > cluster              |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 4 | > Make available on    | Tue  | Mon   | Expected  |              |
| 0 | > Web SHMOD library    | 1/   | 3/    | c         |              |
|   | > for Titan cluster,   | 1/03 | 31/03 | ompletion |              |
|   | > sPPM example code    |      |       | 3/31/03.  |              |
|   | > with SHMOD, and      |      |       |           |              |
|   | > documentation.       |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 4 | > Demonstrate and      | Tue  | Mon   | Expected  |              |
| 1 | > document high        | 4/   | 4/    | c         |              |
|   | > parallel performance | 1/03 | 30/03 | ompletion |              |
|   | > of PPM and NCOMMAS   |      |       | 4/30/03.  |              |
|   | > codes on an IA-64    |      |       |           |              |
|   | > cluster.             |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 4 | > Demonstrate          | Tue  | Mon   | Expected  |              |
| 2 | > on-demand computing  | 5/   | 9/    | c         |              |
|   | > capability using PPM | 1/03 | 30/03 | ompletion |              |
|   | > and NCOMMAS in SHMOD |      |       | 9/30/03.  |              |
|   | > framework.           |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 4 | > Demonstrate backfill | Tue  | Tue   | Expected  |              |
| 3 | > time skewing using   | 9/3  | 9/    | c         |              |
|   | > either PPM or        | 0/03 | 30/03 | ompletion |              |
|   | > NCOMMAS on IA-64     |      |       | 2/28/04.  |              |
|   | > cluster.             |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 4 | > Demonstrate and      | Tue  | Tue   | Expected  |              |
| 4 | > document high        | 9/3  | 9/    | c         |              |
|   | > parallel performance | 0/03 | 30/03 | ompletion |              |
|   | > of PPM and NCOMMAS   |      |       | 8/31/04.  |              |
|   | > codes using SHMOD on |      |       | Refined   |              |
|   | > TeraGrid.            |      |       | SHMOD     |              |
|   |                        |      |       | library,  |              |
|   |                        |      |       | s         |              |
|   |                        |      |       | implified |              |
|   |                        |      |       | example   |              |
|   |                        |      |       | code, and |              |
|   |                        |      |       | pr        |              |
|   |                        |      |       | ecompiler |              |
|   |                        |      |       | tool to   |              |
|   |                        |      |       | ease      |              |
|   |                        |      |       | pr        |              |
|   |                        |      |       | ogramming |              |
|   |                        |      |       | burden    |              |
|   |                        |      |       | available |              |
|   |                        |      |       | on Web    |              |
|   |                        |      |       | 9/30/04.  |              |
+---+------------------------+------+-------+-----------+--------------+

User communities

TeraGrid

Technical Reports and Publications

6\. Subproject Name: **Parallel Performance**

Partners (funded and unfunded): **Bill Gropp (ANL)**

Subproject Overview

Milestones, Deliverables, and Progress to date (accomplishments)

+---+------------------------+------+-------+-----------+--------------+
| * | **Parallel             | *    | **Tue | ** **     | **Gropp      |
| * | Performance**          | *Tue | 9/30  |           | (ANL)**      |
| 4 |                        | 1    | /03** |           |              |
| 5 |                        | 0/1/ |       |           |              |
| * |                        | 02** |       |           |              |
| * |                        |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 4 | > ***(1) Parallel      | Tue  | Tue   |           |              |
| 6 | > Numerical            | 10/  | 9/    |           |              |
|   | > Libraries***         | 1/02 | 30/03 |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 4 | > Measure PETSc        | Wed  | Mon   | Waiting   |              |
| 7 | > performance on IA 64 | 1/   | 3/    | for       |              |
|   | > platforms. Identify  | 1/03 | 31/03 | access to |              |
|   | > key under-performing |      |       | IA64      |              |
|   | > operations           |      |       | nodes     |              |
+---+------------------------+------+-------+-----------+--------------+
| 4 | > Develop new viewers  | Tue  | Tue   | Half      |              |
| 8 | > for PETSc vectors    | 10/  | 12/   | done.     |              |
|   | > using NETCDF format  | 1/02 | 31/02 |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 4 | > Optimize vector      | Tue  | Mon   |           |              |
| 9 | > scatter operations   | 4/   | 6/    |           |              |
|   | > in PETSc             | 1/03 | 30/03 |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 5 | > Develop IA 64        | Tue  | Tue   |           |              |
| 0 | > optimized            | 7/   | 9/    |           |              |
|   | > implementations of   | 1/03 | 30/03 |           |              |
|   | > key PETSc            |      |       |           |              |
|   | > operations.          |      |       |           |              |
|   | > Integrate these into |      |       |           |              |
|   | > the PETSc source     |      |       |           |              |
|   | > tree and test        |      |       |           |              |
|   | > against applications |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 5 | > ***(2) Parallel I/O  | Tue  | Tue   |           |              |
| 1 | > and PVFS***          | 10/  | 9/    |           |              |
|   |                        | 1/02 | 30/03 |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 5 | > Port available       | Tue  | Mon   |           |              |
| 2 | > performance          | 10/  | 3/    |           |              |
|   | > benchmarks from      | 1/02 | 31/03 |           |              |
|   | > Parallel I/O         |      |       |           |              |
|   | > Benchmarking         |      |       |           |              |
|   | > Consortium           |      |       |           |              |
|   | > (PIOBench) to IA-64  |      |       |           |              |
|   | > platform; Evaluate   |      |       |           |              |
|   | > PVFS and ROMIO       |      |       |           |              |
|   | > performance on IA64  |      |       |           |              |
|   | > platform using       |      |       |           |              |
|   | > performance          |      |       |           |              |
|   | > benchmarks; identify |      |       |           |              |
|   | > potential            |      |       |           |              |
|   | > improvements         |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 5 | > Improve PVFS and     | Tue  | Mon   |           |              |
| 3 | > ROMIO                | 4/   | 6/    |           |              |
|   | > implementations      | 1/03 | 30/03 |           |              |
|   | > based on Q2          |      |       |           |              |
|   | > findings; Identify   |      |       |           |              |
|   | > applications that    |      |       |           |              |
|   | > might benefit from   |      |       |           |              |
|   | > PVFS                 |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 5 | > Expand collection of | Tue  | Tue   |           |              |
| 4 | > available PIOBench   | 7/   | 9/    |           |              |
|   | > benchmarks; Evaluate | 1/03 | 30/03 |           |              |
|   | > application          |      |       |           |              |
|   | > performance on top   |      |       |           |              |
|   | > of PVFS; identify    |      |       |           |              |
|   | > potential            |      |       |           |              |
|   | > improvements in PVFS |      |       |           |              |
|   | > and possible         |      |       |           |              |
|   | > improvements to      |      |       |           |              |
|   | > application          |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+

User communities

Technical Reports and Publications

7\. Subproject Name: **Parallel Virtual File System V2 Development**

Partners (funded and unfunded): **Walther Ligon (Clemson)**

Subproject Overview

Milestones, Deliverables, and Progress to date (accomplishments)

+---+------------------------+------+-------+-----------+--------------+
| * | **Parallel Virtual     | *    | **Tue | ** **     | **Ligon      |
| * | File System V2         | *Tue | 9/30  |           | (Clemson)**  |
| 5 | Development**          | 1    | /03** |           |              |
| 5 |                        | 0/1/ |       |           |              |
| * |                        | 02** |       |           |              |
| * |                        |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 5 | > Implementation and   | Tue  | Wed   | C         |              |
| 6 | > coding of server     | 10/  | 1     | ompleted. |              |
|   | > request engine and   | 1/02 | /1/03 |           |              |
|   | > system interface.    |      |       |           |              |
|   | > Refinement of        |      |       |           |              |
|   | > transport modules    |      |       |           |              |
|   | > (BMI, Trove, and     |      |       |           |              |
|   | > Flows).              |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 5 | > Testing and          | Wed  | Mon   |           |              |
| 7 | > integration of       | 1/   | 3/    |           |              |
|   | > transport modules    | 1/03 | 31/03 |           |              |
|   | > including data       |      |       |           |              |
|   | > distribution and     |      |       |           |              |
|   | > request processing   |      |       |           |              |
|   | > modules. Testing and |      |       |           |              |
|   | > integration of       |      |       |           |              |
|   | > server request       |      |       |           |              |
|   | > engine with job and  |      |       |           |              |
|   | > transport modules.   |      |       |           |              |
|   | > Testing and          |      |       |           |              |
|   | > integration of       |      |       |           |              |
|   | > system interface     |      |       |           |              |
|   | > with job and         |      |       |           |              |
|   | > transport modules.   |      |       |           |              |
|   | > Code reviews.        |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 5 | > First end-to-end     | Tue  | Mon   |           |              |
| 8 | > system. Extensive    | 4/   | 6/    |           |              |
|   | > testing and          | 1/03 | 30/03 |           |              |
|   | > debugging,           |      |       |           |              |
|   | > refinement. Adding   |      |       |           |              |
|   | > features.            |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 5 | > Target date for      | Tue  | Tue   |           |              |
| 9 | > first release.       | 7/   | 9/    |           |              |
|   | > Performance studies  | 1/03 | 30/03 |           |              |
|   | > and tuning. User     |      |       |           |              |
|   | > documentation        |      |       |           |              |
|   | > development and      |      |       |           |              |
|   | > testing.             |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+

User communities

Technical Reports and Publications

8\. Subproject Name: **Monitoring and Discovery Service (MDS) extensions
for the Alliance and TeraGrid**

Partners (funded and unfunded): **Jennifer Schopf (ANL)**

Subproject Overview

Milestones, Deliverables, and Progress to date (accomplishments)

+---+-------------------+------+------+--------------------+-----------+
| * | **Monitoring and  | *    | *    | ** **              | **Schopf  |
| * | Discovery Service | *Tue | *Tue |                    | (ANL),    |
| 6 | (MDS) extensions  | 1    | 9    |                    | Evard     |
| 0 | for the Alliance  | 0/1/ | /30/ |                    | (ANL)**   |
| * | and TeraGrid**    | 02** | 03** |                    |           |
| * |                   |      |      |                    |           |
+---+-------------------+------+------+--------------------+-----------+
| 6 | > Implement a     | Tue  | Tue  | Completed. See the |           |
| 1 | > \"software\"    | 10/  | 12/3 | link               |           |
|   | > information     | 1/02 | 1/02 | http://www.the     |           |
|   | > provider to     |      |      | codefactory.org/md |           |
|   | > allow listing   |      |      | s/info-providers/. |           |
|   | > in the MDS      |      |      |                    |           |
|   | > basic           |      |      |                    |           |
|   | > information     |      |      |                    |           |
+---+-------------------+------+------+--------------------+-----------+
| 6 | > Supplying       | Wed  | Mon  | Well underway.     |           |
| 2 | > flexible php    | 1/   | 3/3  |                    |           |
|   | > scripts to the  | 1/03 | 1/03 |                    |           |
|   | > teragrid for    |      |      |                    |           |
|   | > ease of access  |      |      |                    |           |
|   | > to MDS data.    |      |      |                    |           |
+---+-------------------+------+------+--------------------+-----------+
| 6 | > Define any      | Tue  | Mon  |                    |           |
| 3 | > needed new      | 4/   | 6/3  |                    |           |
|   | > information     | 1/03 | 0/03 |                    |           |
|   | > providers for   |      |      |                    |           |
|   | > use by the      |      |      |                    |           |
|   | > TeraGrid        |      |      |                    |           |
+---+-------------------+------+------+--------------------+-----------+
| 6 | > Implement       | Tue  | Tue  |                    |           |
| 4 | > another         | 7/   | 9/3  |                    |           |
|   | > identified      | 1/03 | 0/03 |                    |           |
|   | > information     |      |      |                    |           |
|   | > provider, as    |      |      |                    |           |
|   | > prioritized by  |      |      |                    |           |
|   | > the operations  |      |      |                    |           |
|   | > group           |      |      |                    |           |
+---+-------------------+------+------+--------------------+-----------+

User communities

TeraGrid

Technical Reports and Publications

-   Neill Miller and Jennifer M. Schopf, Extending the Globus Monitoring
    and Discovery Service for Usability, refereed poster, GlobusWorld,
    January, 2003.

9\. Subproject Name: **The Design of TeraGrid Applications with Optimal
Performance and High Performance**

Partners (funded and unfunded): **Mary Vernon (Wisconsin)**

Subproject Overview

Milestones, Deliverables, and Progress to date (accomplishments)

+---+------------------------+------+-------+-----------+--------------+
| * | **The Design of        | *    | **Tue | ** **     | **Vernon     |
| * | TeraGrid Applications  | *Tue | 9/30  |           | (            |
| 6 | with Optimal           | 1    | /03** |           | Wisconsin)** |
| 5 | Performance and High   | 0/1/ |       |           |              |
| * | Performance**          | 02** |       |           |              |
| * |                        |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 6 | > Transfer results for | Tue  | Tue   |           |              |
| 6 | > scheduling with more | 10/  | 12/   |           |              |
|   | > accurate requested   | 1/02 | 31/02 |           |              |
|   | > runtimes to NCSA     |      |       |           |              |
|   | > cluster scheduling   |      |       |           |              |
|   | > team                 |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 6 | > Complete the         | Wed  | Mon   |           |              |
| 7 | > optimization of      | 1/   | 3/    |           |              |
|   | > Cen/Ostriker\'s      | 1/03 | 31/03 |           |              |
|   | > cosmology code on    |      |       |           |              |
|   | > the O2000            |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 6 | > Complete second      | Tue  | Mon   |           |              |
| 8 | > phase of scheduling  | 4/   | 6/    |           |              |
|   | > results for the      | 1/03 | 30/03 |           |              |
|   | > TeraGrid; complete   |      |       |           |              |
|   | > specification of     |      |       |           |              |
|   | > optimized MPI        |      |       |           |              |
|   | > implementation of    |      |       |           |              |
|   | > the cosmology code   |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+
| 6 | > Complete the         | Tue  | Tue   |           |              |
| 9 | > optimized on-demand  | 7/   | 9/    |           |              |
|   | > scheduling for the   | 1/03 | 30/03 |           |              |
|   | > SHMOD applications;  |      |       |           |              |
|   | > explore the          |      |       |           |              |
|   | > optimization of one  |      |       |           |              |
|   | > other significant    |      |       |           |              |
|   | > performance          |      |       |           |              |
|   | > expedition code      |      |       |           |              |
+---+------------------------+------+-------+-----------+--------------+

User communities

Technical Reports and Publications

Samios, C. (Babis) and M. K. Vernon, \"Modeling the Throughput of TCP
Vegas\", to appear in Proc. ACM SIGMETRICS 2003 Int\'l. Conf. on
Measurement and Modeling of Computer Systems (SIGMETRICS 2003), San
Diego, June 2003.

10\. Paul Bode, bode@astro.princeton.edu \# Phone (609) 258-3702 \# FAX
258-1020

User communities:

Cosmology

Technical Reports and Publications

\"The Cluster Mass Function from Early SDSS Data: Cosmological
Implications\" Bahcall, N.A., Dong, F., Bode, P., & SDSS Collaboration
(March 2003) The Astrophysical Journal, v585, in press online at
http://arXiv.org/abs/astro-ph/?0205490

\"Tree\--Particle\--Mesh: an adaptive, efficient, and parallel code for
collisionless cosmological simulation\" Bode, P., & Ostriker, J.P.
(March 2003) The Astrophysical Journal Supplement Series v145, in press.