# Proforma-3: CDF Future Plans -- The Seamless Use of SAMGrid within PPDG and EGEE -- The Glasgow Post.

## Main Objectives

A continuing overarching goal of the Tevatron groups on GridPP has been
to make SAM not only operate in a Grid-like fashion, but to fully adopt
the Grid paradigm along with the existing Grid middleware. In this
context the CDF group has accomplished a great deal in the last three
years. As pointed out in our original proposal, the GridPP project has
not only caused the full integration of CDF into the standard SAM
format, but the CDF GridPP group members have contributed in significant
ways toward the development of job-submission tools which follow the
Grid jobs-to-data philosophy (called JIM).

The main objectives of this post will be two fold:

-   To contribute to the implementation of the jobs-to-data system (JIM)
    as a production data handling system, in fact making it the data
    handling system for the CDF experiment. This will also include
    elements of evaluation of EGEE and PPDG tools that are just
    finishing their development phases for integration into the CDF data
    handling system. Emphasis will be placed on tools related to replica
    and metadata catalogues.

-   As this system becomes the primary tool for CDF data handling, it
    will be necessary to supply user support and system support for the
    community of users. In this case it is important that the user
    support remain close to the users themselves, so we expect that the
    post holder will be primarily acting in a UK support role since the
    working relationship developed in GridPP between the various
    University groups throughout the UK has been so strong that we
    expect to supply support in a sensible manner based more on need
    than physical location.

## Abstract

This proposal outlines the programme of work expected from the
continuation of the GridPP Glasgow CDF post through September 2007. The
work program starts with the implementation of the FNAL system of data
handling (called JIM) in the first year. The second and third years
involve the evaluation and integration of fully developed Grid
infrastructure from EGEE and/or PPDG into the CDF data handling
environment with emphasis on keeping elements that work well and also
reporting back to the community as to the effectiveness of those tools.
The second and third years also contain an element of system support for
the UK user community.

## Principle Investigators

Principal Investigator: Dr. Richard St. Denis, Senior Lecturer\
Glasgow University

Department of Physics and Astronomy\
Kelvin Building\
Glasgow G12 8QQ

<r.stdenis@physics.gla.ac.uk>

Co-Investigator: Prof. Tony Doyle\
Glasgow University

Department of Physics and Astronomy\
Kelvin Building\
Glasgow G12 8QQ

a.doyle@physics.gla.ac.uk

## Deliverables from Proforma-2

The deliverables split into two categories. Ongoing support of the Grid
system for the CDF groups and the additional deliverables associated
with the integration of our development system into production by the
user community.

### Ongoing Support Deliverables

The post holder will be expected to take part in the support of both the
JIM/SAM software for the UK community and the system support of our
externally funded equipment (from the JIF). Our past experience has
indicated that this requires an average of between 0.1 and 0.2 FTE over
the course of any given year and is highly dependent on the exact phase
of software integration in the project. We believe that as we move
toward a production system it would be remiss of us to ignore this
requirement in an operational system of data handling. Our deliverables
regarding automated reporting of system usage (see early deliverables
below) are an attempt to quantify the needs of the user community and
therefore act as an indicator of the system support needed. The Glasgow
post holder is expected to spend part of their time in this aspect of
the work plan.

-   Release a document that describes the pattern of supported releases
    of SAMGrid Services over the last 6 months and longer-range release
    plan, amended as needed.

-   Summary document of usage and performance statistics for Grid
    including addition of new facilities.

-   Document the achieved performance against high-level metrics.

-   Product improvement where metrics show serious operational issues.

-   Documentation and maintenance of Adaptor code for CDFRunJob.
    Eventually as we move to Grid dataflow management tools, will
    produce documentation of how that is done and maintain that code as
    well.

### Listed Deliverables

Below are reproduced all of the deliverables from the CDF Proforma-2.

-   Oct 04

    -   Participation with Data Storage and Management group on
        evaluation report of EDG/EGEE and SAM/JIM software relevant to
        metadata work.

    -   Evaluation of EDG/EGEE file catalogue software relevant to SAM.

```{=html}
<!-- -->
```
-   April 05

    -   Documentation and release of Adaptor code for CDFRunJob.

    -   Contribution to design for separation of Metadata Catalogue
        service and API from SAM Schema into a (logically) separate
        Oracle schema; evaluation of the object transfer protocol:
        CORBA, Web Services.

    -   Explore freeware design option for separation of Metadata
        Catalogue and API from SAM Schema.

    -   Contribute to definition of interfaces between the architectural
        layers relevant to Metadata Catalogue and API; coordination of
        the definition with Data Storage and Management group with
        forward look to deployment of common software.

-   Sept 05

    -   Release of Separated Metadata Catalogue and associated API.

    -   Modification of definition of interfaces for Replica and
        Metadata Catalogues in cooperation with Data Storage and
        Management group.

-   April 06

    -   Evaluation and Design of project endpoint implementation of
        Catalogues as distributed database services implemented in
        appropriate DBMS, such as XML, or freeware databases, compliant
        with Grid standards and LHC. It is assumed that this is the EGEE
        software, including the VDT packaging of Condor and Globus, as
        vetted by the Data Storage and Management group.

    -   A standards document describing these interfaces.

-   Sept. 06

    -   Prototype of Separated Grid Metadata Catalogue

    -   Necessary modifications and release of a new version of the
        Standards Document on interfaces.

-   April 07

    -   Production Release of Grid Metadata Catalogue

    -   Necessary modifications and release of a new version of the
        Standards Document on interfaces.

-   Sept. 07

    -   Final evaluation of LHC/Grid components in SAM.

## Name of Post Holder

M. Burgon-Lyon

Glasgow University

m.burgon-lyon@physics.gla.ac.uk

## Skills of Present post holder

M. Burgon-Lyon has been collaborating with ScotGrid as well as members
of Computing Division (CD) at Fermi National Accelerator Laboratory to
create the SAMGrid system for CDF, D0, and now MINOS and phenomenology.
All of the GridPP1 milestones in our project have been completed as
demonstrated in Proforma-1. She has been a crucial element of the
design/development cycle where by the end of the GridPP project we will
have migrated (integrated) this system to CDF production with complete
jobs-to-data capability. She is an expert in installation of the CDF
software environment, the SAM software environment. She is also expert
at installing and operating JIM software including the Globus toolkit,
with emphasis on GridFTP, grid certificate procurement, installation and
debugging. She is very talented at outlining the problems to be solved
and executing a plan. She is excellent at proposing and setting up Linux
system configurations and adapting both the system and the Grid software
such that they function together. She is dedicated and enthusiastic
about the Grid project and determined to see success.

## Effort at Glasgow and in the UK in support of the work programme

In the GridPP1 project we have been able to work successfully with all
the groups in CDF and D0 in the UK: Oxford, UCL, Lancaster and Imperial
college. This has created a very fruitful collaboration and sharing of
different ideas, particularly between CDF and D0, that has resulted in a
more general, robust product for both Experiments. Here we emphasize
first the qualifications of Glasgow personnel in supporting the
post-holder and then we describe our connections with other groups in
the UK.

### Glasgow Support

The personnel, physics and management of the Glasgow staff together with
the talents of the post-holder, M. Burgon-Lyon, set the stage for the
choice of deliverables for this project.

#### Personnel

R. St. Denis (Glasgow-CDF) is co-leader of the SAMGrid Project, former
leader of the CDF Database project, co-leader of the CDF Data Handling
group, and a member of the PPDG steering committee. T. Doyle is GridPP
project leader and PI for the ScotGrid project and works in
collaboration with the Glasgow E-Science centre directed by R. Sinnott.
G. McCance is co-leader of the Data Management project and has lead
development of the replica catalogue services, Spitfire as well as the
optimisation modelling in OptorSim. P. Millar is the GridPP data
management work group leader on the Technical board. W. Bell had CDF
data analysis experience and coded Spitfire and OptorSim with G.
McCance. This work was done together with Grid graduate students David
Cameron and Caitriana Nicholson.

#### Physics

The physics analysis at Glasgow places relevant demands on the Grid
technologies being developed with real data and requirements on Monte
Carlo stemming from real data analysis. The CDF-Glasgow group analyses
involves b physics, in particular, the b hadronic trigger, and puts the
strongest demands possible on the data handling needed for
reconstruction, ntuples production, and Monte Carlo production since it
involves the largest datasets. S. D'Auria is responsible for half of the
production of CDF b Monte Carlo and is utilizing SAMGrid for data and
job management. A.S. Thompson has provided the physics programming
examples from the CDF software environment and assists in getting
Production reconstruction executables running with SAMGrid. He also is
very knowledgeable about SAM internals. Physics efforts involving
high-resolution studies of reconstruction of mass states from b quarks
in top and Higgs have direct application to LHC and explore the
bookkeeping (metadata cataloguing) necessary to interrelate a variety of
calibration streams of data necessary to obtain the best mass
resolution.

#### Management

The SAMGrid project serves CDF, D0, MINOS, and Phenomenology. The
SAMGrid Management team consisting of two co-project leaders, R. St.
Denis from CDF and W. Merritt from D0 and the technical coordinators
with R. Kennedy from CDF and S. Veseli from D0.

This group sets priorities, identifies subprojects and oversees the
coordination of resources from GridPP, PPDG, Fermilab, Universities
participating in CDF and D0 and external grants such as DOE small
business initiatives (SBIR). The SAMGrid Project leaders are also
members of the GridPP steering committee. References to the ARDA-based
matrix of services matched to supporting groups, agencies or individual
institutes may be found in the Proforma-2 associated with this bid.

### UK collaboration

Dave Evans was working at Imperial, has moved to Glasgow for a short
time to transfer his knowledge on workflow management RunJob and will
continue development of the workflow management at Imperial with D.
Colling, in close collaboration with P. Love and I. Bertram at
Lancaster. They will continue to develop RunJob and we will use this
product. They will bring Grid standards into the workflow management and
we will pick that up as well.

We work seamlessly with S. Stonjek at Oxford who has worked on
distribution of SAMGrid installations and support of users throughout
GridPP1 and will work on local replica catalogues in GridPP2 as well as
instrumentation and diagnostics for SAM. Dr. D. Waters at UCL and Dr. B.
T. Huffman of Oxford have worked closely with us in running physics
applications and in developing code for SAM usage in CDF. We have also
close ties with Dr. P. Clarke through UKLight/ESLEA.

### Rationale for deliverables

The specific choice of deliverables for the project now follows based on
the personnel, physics and management of the Glasgow staff and the UK
groups in general.

-   M Burgon-Lyon's experience with SAMGrid together with the
    significant Glasgow talent, experience and management effort in Grid
    Data Management and the Glasgow experience in CDF databases and
    SAMGrid management motivates the deliverable for evaluation of a
    fusion of the Grid and SAMGrid technologies. This work will be done
    in a group that includes S. Stonjek and the FNAL database experts as
    well as the Glasgow gridPP Spitfire time. Developments in SAM local
    replica management and Grid local replica management will be
    considered simultaneously with the metadata catalogues.

-   M Burgon-Lyon's experience with the JIM portion of SAMGrid leads
    naturally to including the workflow management developments from
    Imperial College and adapted for CDF by D. Evans. She will continue
    to follow developments that he and the D0 GridPP groups make in
    development of RunJob and Grid Workflow management.

-   S.D'Auria's responsibilities regarding CDF B Monte Carlo stresses
    the volume of data that must be moved and provides an expert
    resource that can provide working CDF code. His ATLAS involvement
    provides motivation to invest in LHC Grid tools and his analysis
    involves the largest datasets, thus also stressing the system. It is
    therefore natural for M. Burgon-Lyon to ensure that JIM and the
    workflow management systems can be used, and to obtain user feedback
    from S. D'Auria.

-   A.S.Thompson's expertise in CDF Monte Carlo generators, offline code
    and installation, production reconstruction management provides an
    expert resource that can provide working analysis and reconstruction
    software. His ATLAS participation in data challenges allows him to
    see both systems in CDF and ATLAS and to suggest the best solutions.
    His analysis interests in top and electroweak physics stresses the
    need for accurate metadata.

-   The progressive work on metadata catalogue capitalizes on M.
    Burgon-Lyon's SAM experience, R. St. Denis's database expertise and
    the Spitfire developments.

-   Leadership in the SAMGrid project by R. St.Denis ensures tight
    coordination of these deliverables with the rest of the SAMGrid
    effort. Excellent relations with the Fermilab Database group and
    their freeware development team motivate the schema development
    efforts.

## Additional Support

### Non-GridPP Travel

Since unfunded manpower is requested as information, further support to
this project, external to the GridPP line, should also be documented. We
do so here.

The importance of this support cannot be understated for this project.
In particular the effect of approximately £20,000 per anum of LTA
available to directly benefit the UK groups working on SAM has been the
primary source of funding that allows R. St. Denis to assume his leading
project role. In addition, the leveraging of FNAL money for the visiting
scientist position for Stonjek would have been unlikely had he been
unable to clearly demonstrate his worth and quickly become a positive
influence at FNAL. These two factors were key in convincing the
collaboration to adopt SAM and move to Grid with all deliberate speed.
The success of that accomplishment over our 450 collaborators and 45
institutions world-wide demonstrates a substantial cost-benefit ratio
for these posts.

The Grid Project Management Board has consistently refused to fund any
LTA travel on the grounds of fiscal responsibility despite strong
advocacy by the Grid Project Manager. We have recently been officially
informed that 'there exists no justification' for the level of support
that we have enjoyed so far. We submit to the committee and referees
that the entire CDF submission is a strong testament to the necessity of
Long Term Attachments on projects of such a highly distributed nature as
Grid. We ask the funding agency to review it's position regarding the
level of money available for Long Term Attachments for all Grid
positions and projects, as we are convinced by our own direct experience
that projects other than ours could be significantly moved forward with
even a small increase in this form of funding. Cost neutrality might
still be maintainable if the acceptable conference list were reviewed in
concert.

This is support, which is mentioned nowhere else in the project
documentation, is reported below. These support levels are for the life
of this project.

  --------------------- -------------------------------------- -----------
  Source of Support     Description of Support                 Amount (£)

  Joint Infrastructure  Storage Systems in the U.S.            300,000
  Fund                                                         

  Joint Infrastructure  Cluster Systems in the U.K.            350,000
  Fund                                                         

  Joint Infrastructure  LTA for funded GridPP posts            50,000
  Fund                                                         

  Joint Infrastructure  LTA for un-funded GridPP posts         30,000
  Fund                                                         

  Joint Infrastructure  Project-related Workshop/meeting       \~5,000
  Fund                  attendance                             
  --------------------- -------------------------------------- -----------

This proposal is unique in that it involves operational experiments
using production grid software. It requires significant management
interaction at FNAL and hence we bid for £20,000 per annum travel
against the contingency money for hardware for Dr. R. St.Denis to
support his leadership role in Grid.

### TestBed Hardware

In order to be able to develop the metadata catalogue we request a 2
machines that can contain a middleware servers (such as apache for web
services solution or Corba for the present SAM solution) plus two
machines to act as SAM stations. Two machines would be used for
development and two for integration of software prior to a release to
production. The multiple machines allow for development to remain
uninterrupted when the integration testing is done. The integration
machines would also be available for testing in cooperation with the
replica location work being done at Oxford and UCL. We also will need a
laptop that can be used for trips to other locations in the UK as well
as at Glasgow and Fermilab. We therefore bid for £5000 to cover the cost
of these machines.

### Salary Increments for Excellence

The potential for promotion based on exceptional work and an increased
leadership role within GridPP2 for Morag Burgon-Lyon would require
additional funding beyond the anticipated spine point increments.