**CDIGS Management Meeting**

**Feb 23, 2007**

**Discussion topics:**

-   Introduction of Dan Fraser

-   Management transition

-   Proposed Report format changes

-   Review of Accomplishments

-   Proposed reporting schedule change (Monthly meetings, Bi-monthly
    reports)

-   Time to meet together

-   Approval of Annual Report

-   Setup next meeting

**Accomplishments:**

***(1) Metrics:***

-   Metrics reports now available via browser interface at
    <http://incubator.globus.org/metrics>

-   Southern Florida University team (independently funded) performing
    more detailed analysis of metrics database.

    -   Some of this work is targeted to be incorporated into the Globus
        metrics code base.

    -   Plan to submit a joint ANL/FSU paper to the Grid 2007 conference
        in September.

-   Reporter module added to MPIG, next generation of MPICH-G2

    -   Integrated with MPIG Code

    -   Packet Handler added to listener service

-   Expanded community -- TeraGrid has deployed a Metrics Listener
    service, collecting data from deployed TG services.

    -   Based on their new experience, they have provided feedback and
        improvement contributions.

-   Community Expansion \-- DEISA & PRAGMA have begun considering use of
    Metrics mechanism for tracking internal usage.

-   Establishing an operations plan for the Globus listener service

    -   Support/monitoring/problem resolution

    -   Requirements/procedures for upgrades to minimize service
        disruption

    -   Data archiving

    -   Capacity plan

-   Upgrading production listener service to add MPIG packet handler

-   Adding MPIG report generators to monthly report runs

***(2) [Release](http://snipurl.com/zxyt) Planning***

-   Set dates and started GT4 release process

    -   4.0.4 (2/22/07)

    -   4.1.1 (3/16/07)

    -   4.0.5 (3/30/07)

    -   4.1.2, 4.1.3, 4.2 (TBD)

***(3) Key community interactions***

-   Founded 2 new Globus Incubator projects for a total of 17.

    -   GridShib integrates a federated authorization infrastructure
        (Shibboleth) with Grid technology (the Globus Toolkit) to
        provide attribute-based authorization for distributed scientific
        communities.

    -   Workflow Enactment Engine Project (WEEP) aims to implement an
        easy to use and manage workflow enactment service for WS-I/WSRF
        services and orchestrate the services using BPEL. The workflow
        engine is built up of several components that collectively
        represent the core architecture and follows the recommendations
        of the [Workflow Reference Model](http://www.wfmc.org/). The
        WEEP API is completely developed from scratch, mastering the
        latest Java technologies, Web and Grid standards. This project
        was founded by the Institute of Scientific Computing, University
        of Vienna.

-   Ongoing mentoring of Incubator projects (DDM, Introduce, Gridway),
    and encouragement of new Incubators (SGAS, China GridFTP Client).

    -   Support for Gridway to integrate with GT nightly build + test.

-   TeraGrid support (GridFTP, WS-GRAM, GSI, MDS, WebMDS)

    -   New WebMDS view for TeraGrid that displays a list of available
        resources and the EPRs that can be used to access those
        resources via WSRF services \*1, 3
        <http://mds.teragrid.org:8080/webmds/webmds?info=indexinfo&xsl=sgservicetablexsl>

    -   Working with TeraGrid to supply portal data through MDS4 --
        almost completed, currently being rolled out \*1,3

    -   Working with TeraGrid to use index service for CTSS kit
        registration \*1, \*3

    -   Ongoing weekly discussions with TeraGrid Portal Group for
        MDS4-Portal interactions \*3

-   OSG Support

    -   Multiple patches with bug fixes and new features for inclusion
        in VDT 1.6.0

    -   Ongoing regular attendance at OSG meetings and conference calls.
        Frequent meetings with OSG executives.

-   Other Community Support

    -   Adding support for suppressing the publication of aggregator
        configuration elements in aggregator service group registry
        entries, in response to ChinaGrid meeting, completed but for
        documentation. \*1

    -   Adding Subscription/Notification support for RPProvider RP
        Implementations, in response to ChinaGrid meeting, completed but
        for documentation. \*1

    -   Participated in EGEE design team meeting, Bologna, active EGEE
        design\
        team topics include testing and evaluation of GRAM4 for
        possible\
        inclusion in the glite infrastructure and virtualization
        solutions\
        within EGEE

    -   Participated in the LCG virtualization workshop for LCG site
        admins,\
        gave a talk presenting the GT Workspace Service and discussed\
        requirements with LCG admins, participated in drafting workshop
        summary.

    -   Generalizing ESG information providers and trigger scripts for
        inclusion in standard MDS4 releases, including extended email
        trigger functionality and credential expiration time trigger.

    -   Initiated a collaboration with the GT4 GridWay project aiming to
        use\
        the meta-scheduling capabilities of the GridWay scheduler to
        schedule\
        workspaces to accommodate the needs of specific applications;
        gave a\
        talk about the workspace service at the Spanish Middleware
        Initiative\
        Workshop
        (<http://asds.dacya.ucm.es/GridMiddleware/programa5.php>) and\
        worked out the details of proposed scenarios with the GridWay
        team

    -   Initiated interactions with NCAR applications and MSI
        communities\
        aiming to provide images for those communities and start running
        them. This project also co-sponsored the design work going into
        the\
        workspace release 1.2.2 (released beginning of January 2007)
        including\
        primarily support for IP address delivery to workspaces and
        improved\
        testing and usability (changelog is available at\
        <http://workspace.globus.org/vm/TP1.2.2/index.html>.

    -   OMII-Europe outreach meetings & discussion

    -   Discussions with Earth System Grid, Open Science Grid, Petascale
        Data Institute, Center for Enabling Distributed Petascale
        Science groups at the SciDAC PI Meeting in Atlanta, GA, February
        4-5, 2007.

    -   Ongoing support for applications that use RLS and DRS, including
        LEAD, GEON, LIGO, SCEC, ESG.

    -   Met with Karan Bhatia of the GEON project at SC 2006 conference
        in Tampa, FL, to discuss ongoing use of DRS in 2007.

    -   Met with Beth Plale of LEAD project at SC 2006 conference in
        Tampa, FL, to discuss ongoing use of RLS and DRS in 2007.

    -   Support for LEAD users who have encountered problems on 64-bit
        clients with the current Java interface. (These problems should
        be eliminated when the new client is available.)

    -   Continued support for LIGO users of RLS

-   Supercomputing '06 booth delivered over 28 different presentations
    on all aspects of the Globus Toolkit, the Globus community and
    Incubator projects. This conference provided the opportunity for
    over 60 meetings with teams and collaborators around the world.

***(4) Answered support emails on various forums***

-   webmaster@globus, discuss@globus, gt4-friends@globus, \*-dev@globus,
    \*-user\*globus...

-   We also monitor the following mailing lists due to our involvement
    in these projects: osg-integration, osg-interoperability,
    tg-gateway, tg-interop-wg, tg-software, tg-wg (\*1, 2, 3)

***(5) Outreach through scholarly works, standardization efforts and
presentations***

-   Chaired the first IEEE/ACM International Workshop on Virtualization
    Technologies in Distributed Computing.

    -   Kate Keahey Interview in Grid Today Nov 13, 2006.
        <http://www.gridtoday.com/grid/1086063.html>.

-   Created a new GT Security Tutorial, delivered to OGSA-DAI partners.

-   Talk on Globus Data Services (current and future directions) at
    Fermi National Laboratory, October 27, 2006

-   Talks on Globus Data services in ANL booth at SC2006 Conference in
    Tampa, Florida

-   Discussions at SC2006 Conference on use of Globus data services
    within NAREGI project, Earth System Grid, LEAD project, GEON project

-   Presented paper on ESG use of MDS monitoring capabilities:
    "Monitoring the Earth System Grid with MDS4," Ann Chervenak,
    Jennifer M. Schopf, Laura Pearlman, Mei-Hui Su, Shishir Bharathi,
    Luca Cinquini, Mike D'Arcy, Neill Miller, David Bernholdt, 2nd IEEE
    Intl. Conference on e-Science and Grid Computing (e-Science 2006),
    Dec. 4-6, 2006, Amsterdam, Netherlands.

-   Talk on Globus Data Services (current and future directions) at
    Teragrid Data Meeting in San Diego, January 9-11, 2007.

-   Talk on Globus Data Services (future directions) by at Earth System
    Grid meeting in Boulder, CO, January 17-19, 2007.

-   Paper accepted to the CCGrid 2007 Conference: "Design of a Scalable
    Peer-to-Peer Information System Using the GT4 Index Service",
    Shishir Bharathi, Ann Chervenak

-   GridFTP Tutorial submitted to the 2007 Linux HPC conference.

-   Paper on "Lots of Small File" optimizations in GridFTP submitted to
    TeraGrid '07.

-   Paper on MDS4 use in TeraGrid submitted to TG2007 conference.

-   Whitepaper on Globus troubleshooting work in progress.

-   Chaired ongoing OGF participation and contributions to OGSA-DMI,
    created the first rough draft of a standardized RFT interface.

-   Ongoing discussion of GLUE Schema

-   Participation in OGF GIN-Info group

-   Joined the OGF Build & Test Community Group

***(6) Documentation Related Work***

-   Improved documentation of listener service and report generators

    -   How to build the listener service code

    -   How to add a handler for a new packet type

-   Created <http://incubator.globus.org/metrics> website

    -   Public face for Metrics code, reports

    -   Aimed at expanding use of Metrics code (listener, reporter
        modules, and analysis tools)

    -   One immediate outcome was a useful discussion of Incubator &
        dev.globus test case

-   Created
    <http://www.globus.org/toolkit/docs/development/modifying.html> to
    guide new developers in modifying the toolkit source.

```{=html}
<!-- -->
```
-   Moving new information provider documentation to common template for
    IPs \*1

-   Wrote Easy-how-to for triggers, updating example and going through
    last revision \*1,4

-   Documentation for file scraping using UsefulRP

-   Added attribute and server sections to the XIO driver development
    guide.

-   Created Howtos/index for Java WS Core testing out using docbook
    \<indexterm\> tags

-   Created web presence for GlobusWorld 2006 and SC 2006

-   API reference: learned how to generate doxygen for our API
    reference.

-   Updated presentations page with GW and SC talks, other updates

-   Creating howtos/Indexes for all components

-   Releasing 4.0.4

-   Working on test environments for 4.0

-   Designing a better way of version controlling docs that will use\
    branches instead of our current \'copy\' method.

-   Auto bug frags for release information based on a way to grab
    certain info automatically from bugzilla to populate some sections
    of release notes.

-   Documenting internal processes for docs (including creating your
    own\
    test environment with 4.0)

-   Improving the flow, scanability and usefulness of documentation -\
    especially in these areas:

    -   Key Concepts guides - Making sure there is enough high-level\
        information to help new users shorten the learning curve by
        adding more\
        and better graphics and making sure they address all components
        within a\
        \"family\" of components.

    -   Creating top-level Command line Reference that includes all\
        command line tools available for all projects in a GT
        distribution.

    -   For certain high level \'how-tos\' that involve multiple
        components\
        of the Globus toolkit, we may need to provide top-level
        \'recipes\'.

***(7) Evolve and enhance GT functionality and performance***

-   Designed a new API for Java based RLS clients to improve usability,
    reduce common errors of users of the API, and to conform more
    closely to Java programming conventions

-   Designed a pure Java based RLS client \-- unlike current Java/JNI
    client that depends on the native client libraries

-   Created a GPT project, build scripts, and packaging for the new RLS
    client

-   Reverse engineering of the RLS wire protocol designed by original
    RLS developer

-   Developed a backward compatible wrapper around the new RLS API to
    allow existing users to migrate with minimal code change.

-   Created a GPT project, build scripts, and packaging for a unit test
    suite for the new RLS client.

-   Designing the next generation of DRS, in which replication will be
    more policy-driven.

-   New Java based RLS client is intended to improve usability, reduce
    common errors of users of the API.

-   The backward compatible wrapper around the new RLS API provides
    usability improvements by allowing existing users to migrate with
    minimal code change.

-   Created the G-Fork, parallel forking framework, similar to inetd,
    but with communication capabilities to enable GridFTP to better
    manage connections and resources.

-   Created GridFTP SSH capabilities to enable users to utilize either
    SSH or GSI for access to Grid FTP.

-   Modified FTP test suite to handle sshftp

-   Fixed delayed PASV implementation in GridFTP server and added the
    client implementation.

-   Started exploring virtual machine technologies for deploying
    GridFTP.

-   Fixed C WS Core XML bindings generation and message parsing bugs.

-   Fixed C WS Core build runtime issues on OS-X

```{=html}
<!-- -->
```
-   Completing the Java client for RLS

-   Exploring the possibility of extending DRS to include a DMIS and/or
    and SRM interface.

-   Designing next-generation DRS, which is intended to replicate based
    on user-defined policies.

-   Adding usage stats for queries, in addition to already logging
    registration \*1,2

-   Creating Archiver prototype \*1

-   Webservice interface to triggers, close to alpha.

```{=html}
<!-- -->
```
-   Use of local transport whenever possible (eg communication within
    container)

\* In addition to CDIGS, some accomplishments funded in part by:

1\. NMI: Performance Inside: Performance Monitoring and Diagnosis for
NMI Software and Applications

2\. ITR: Image-based Biophysical Modeling: Scalable Registration and
Inversion Algorithms and Distributed Computing

3\. TeraGrid

4\. DOE: Scidac

5: NIH/NCR: caBIG