**Technical Progress Report**

  -----------------------------------------------------------------------
  **02.01 PHYSICS\
  Jul-Sep 2004**

  -----------------------------------------------------------------------

**2.1 Subsystem Manager\'s Summary**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Complete event generation  1-Jul-04       20-Oct-04        31-Jul-04      Completed
  for DC2                                                                   

  complete Production for    5-Feb-05       \--              5-Feb-05       On Schedule
  Rome                                                                      

  start DC3 event generation 1-Dec-05       1-Jul-04         1-Dec-05       On Schedule
  -------------------------- -------------- ---------------- -------------- ----------------

**Ian Hinchliffe (Lawrence Berkeley Laboratory)**\
Event Generation for DC2 was completed on 31 July. This was somewhat
later than orginally planned. The delays are due to the overall atlas
schedule; the tools necessary for the generation were supplied in time
to meet the original scehdule.\
\
Almost immediately, work began on the event generation to produce data
to be used for analyses to be presented at the Physics meeting in Rome
in June 2005.\
\
It is intended to use Sherpa for this production (for the first time).
Much interaction with the authors has been required to facilitate its
inteegration into Athena.\
\
Jimmy will also be used for the first time. The interface to athena has
been implimented, updated and validated to ensure that all the necessary
parameters can be parsed correctly.\
\
Interactions with the LCG Genser project have continued as they continue
to develop. The new structure function package LHAPdf is being
supported. The atlas interfaces will need to be modified to take this
into account

**Technical Progress Report**

  -----------------------------------------------------------------------
  **02.02 SOFTWARE\
  Jul-Sep 2004**

  -----------------------------------------------------------------------

**2.2 Subsystem Manager\'s Summary**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  DC2 Phase 1 (simulation)   1-Apr-04       \--              1-Sep-04       Completed
  starts                                                                    

  DC2 Phase 2                1-Jun-04       \--              1-Dec-04       Delayed (See #1)
  (reconstruction) starts                                                   

  Software Release 9         15-Jun-04      \--              15-Nov-04      Delayed (See #2)

  Software deployed for      30-Jun-04      \--              30-Nov-04      Delayed (See #3)
  reconstruction of DC2 and                                                 
  CTB data                                                                  

  Integrated software        28-Jul-04      \--              28-Jul-04      Completed
  available for CTB                                                         

  DC2 phase2                 31-Jul-04      \--              15-Feb-05      Delayed (See #4)
  (reconstruction) ends                                                     

  Software deployed for      1-Dec-04       \--              15-Feb-05      Delayed (See #5)
  Mar-2005 Physics Workshop                                                 

  Computing Model Paper      31-Dec-04      \--              31-Dec-05      Delayed (See #6)

  Software available for DC3 30-Sep-05      \--              30-Dec-05      Delayed (See #7)
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Delayed pending availability of all software components\
\
**Note #2**  Delayed awaiting completion of several software components\
\
**Note #3**  DC2 has been delayed. CTB software available but being
optimized\
\
**Note #4**  Delayed due to delayed start of phase-2\
\
**Note #5**  Delayed awaiting completion of many software components\
\
**Note #6**  Delayed due to DC2\
\
**Note #7**  DC2 delayed\.... DC3 delayed\
\
\
**Srini Rajagopalan (Brookhaven National Laboratory)**\
The primary focus during this quarter was the start up of the DC2
simulation production \-- though delayed due to many reasons including
continued developments to the simulation programs. The digitization
software has also been released and the reconstruction software for DC2
exercises is now scheduled for October 2004. Core software delivered by
U.S. include the infrastructure for pile-up event (overlay of multiple
events) production, event mixing infrastructure and the much awaited
event persistency. Persistency of Event data has been demonstrated
relying on LCG based POOL framework. In addition to the Data Challenge,
much of the required software for the Combined Test-Beam has been
delivered. The U.S. continues to play a major role in not only the core
software, but reconstruction, simulation and establishing the framework
for physics analysis effort.\
\
**2.2.1 Coordination**\
**2.2.2 Core Services**\
**2.2.2.1 Framework**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Object Browser Integrated  30-Mar-04      \--              30-Nov-04      Delayed (See #1)
  with Analysis Tools                                                       

  Pile-up Support for DC2    30-Mar-04      \--              30-Aug-04      Completed (See
  Production                                                                #2)

  Support for Reconstruction 30-Mar-04      \--              30-Jul-05      Delayed (See #3)
  on Demand                                                                 

  Evaluate Mech for Job      30-Jun-04      \--              30-Dec-04      Delayed (See #4)
  Config/History                                                            

  Pile-up Support for DC2    30-Jun-04      30-Oct-04        30-Sep-04      Completed
  Production Validated                                                      

  Integration of Seal        30-Sep-04      \--              30-Sep-05      Delayed (See #5)
  plug-in Mechanism                                                         

  Support Physics Analysis   30-Sep-04      \--              30-Sep-04      Delayed (See #6)

  Synchronize Gaudi Release  30-Sep-04      \--              30-Sep-04      Delayed (See #7)
  with                                                                      

  History & Property Mech    30-Dec-04      \--              30-Dec-04      On Schedule
  Integ                                                                     

  Support for Reconstruction 30-Dec-04      30-Dec-04        30-Dec-05      Delayed (See #8)
  on Demand                                                                 
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  delayed to release 10 cycle for lack of manpower\
\
**Note #2**  DC2 start delayed to September. Memory optimization yet to
perform.\
Core software effort for pile-up work complete. There may be changes
required once support for Truth information propagation is added. Those,
if any, will be added as a new task\
\
**Note #3**  rescheduled for lack of manpower both in Atlas and in the
rest of the Gaudi project.\
\
**Note #4**  Priority lowered, not needed before DC3\
\
**Note #5**  Done for dictionary loading. Priority lowered for
integration in Gaudi\
\
**Note #6**  this is a priority for release 10. We will study the new
requirements arising from the first round of analysis code in release 9\
\
**Note #7**  porting to Gaudi release 15 has been delayed to mantain a
stable developers environment during the completion of DC2. Should be
done by release 10 (Feb 05)\
\
**Note #8**  very low priority. The LHCb solution in Gaudi is not
directly reusable in our code. Delay perhaps indefinetely\
\
**2.2.2.2 EDM Infrastructure**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Prototype Support for      30-Sep-03      \--              30-Mar-05      Delayed (See #1)
  Integer Keys                                                              

  Support for Persistent     30-Dec-03      \--              30-Sep-04      Completed
  Inter-Object Relationships                                                

  Support for History        30-Mar-04      \--              30-Mar-05      Delayed (See #2)
  Objects                                                                   

  Integrate CLID Database    30-Jun-04      \--              30-Jun-05      Delayed (See #3)
  Generation                                                                

  Integration with           30-Jun-04      \--              30-Jun-05      Delayed (See #4)
  POOL-Cache Manager                                                        

  Data Objects Fully         30-Sep-04      30-Sep-04        31-Dec-04      Delayed (See #5)
  Accessible from                                                           
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  HLT group agreed to reschedule this non-vital performance
optimization.\
\
**Note #2**  transient part complete but no persistency yet. Rescheduled
to DC3\
\
**Note #3**  delayed to DC3\
\
**Note #4**  this in a non critical optimization, that will probably
will be delayed or even canceled\
\
**Note #5**  access to Data Object from python prompt soon to appear in
the repository\
\
**2.2.2.3 Detector Description**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Accelerated Access to      30-Mar-04      \--              30-Sep-04      Completed
  Geometry Tree                                                             

  Geometry Configuration     30-Jun-04      \--              1-Sep-04       Completed
  System Available                                                          

  Native GeoModel Material   30-Jun-04      30-Jun-04        30-Jun-05      Delayed (See #1)
  Integration Service                                                       
  Available                                                                 
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  This milestone relates to services provided for the purpose
of track reconstruction. It has been delayed because simulation issues
are\
considered more pressing.\
\
**2.2.2.4 Graphics**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Deployment of Graphics for 30-Mar-04      \--              30-Sep-04      Completed
  use in 2004 Test-Beam Runs                                                

  Integration of Graphic     30-Mar-04      \--              30-Dec-04      Delayed (See #1)
  Tools within Athena                                                       
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Plans for this have still not gathered maturity, while a
tool integrated with Athena is highly desirable. The U.S. has no
participation in this effort.\
\
**2.2.2.5 Analysis Tools**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Deployment of an Analysis  30-Mar-04      30-Sep-04        31-Dec-04      Delayed (See #1)
  Framework with Basic                                                      
  Functionalities                                                           
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Significant progress has been made in the deployment of an
Analysis Framework. A prototype is expected to be deployed for DC2 by
Sep 2004.\
Further delays in DC2 and release 9 push this to year end\
\
**2.2.2.6 Grid Integration**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Integration with Ganga     30-Sep-03      30-Sep-04        30-Sep-05      Delayed (See #1)

  Prototype Implementation   30-Sep-03      30-Sep-04        30-Sep-05      Delayed (See #2)
  for Grid Monitoring                                                       
  Architecture                                                              

  Integration with           30-Mar-04      30-Sep-04        30-Sep-05      Delayed (See #3)
  Distributed File                                                          
  Replication Service                                                       
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  This activity is partly covered under Distributed Analysis
Tools and a prototype is expected to be deployed for use in DC3.\
\
**Note #2**  This is work is partly covered under Grid Tools and
Services to provide monitoring of jobs submitted on the Grid. No
capability within Athena exists due to lack of any assigned resources.\
\
**Note #3**  The integration has been delayed due to lack of manpower.
Work on standalone distributed file replication services are in progress
and needs to be completed before an integration with Athena can be
established.\
\
**2.2.3 Database**\
**David Malon (ANL)**\
The preponderance of U.S. database effort in this reporting period has
been devoted to development of the capabilities necessary to allow ATLAS
to prototype the data flow aspects of its computing model in Data
Challenge 2. The international ATLAS schedule for that Data Challenge
has been slipping substantially, but the database components\--and the
U.S. components in particular\--are on schedule to be ready well before
they will be needed for deployment in an ATLAS Tier 0/Tier 1 exercise.\
\
**2.2.3.1 Server and Services**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Replication Machinery for  30-Mar-04      \--              10-Dec-04      Delayed (See #1)
  Database-Resisdent Data                                                   
  Sufficient for DC2                                                        

  Embedded Server Support    30-Jun-04      \--              29-Oct-04      Delayed (See #2)
  and Extraction Protocols                                                  

  Evaluation of Distributed  30-Sep-04      \--              26-Nov-04      Delayed (See #3)
  Oracle Deplayment                                                         
  Possibilities                                                             

  Define relational client   31-Oct-04      \[New\]          31-Oct-04      On Schedule
  library interface                                                         

  Prototype relational       30-Nov-04      \[New\]          30-Nov-04      On Schedule
  client library                                                            
  implementation                                                            

  Support distributed        31-Mar-05      \[New\]          31-Mar-05      On Schedule
  database deployment for                                                   
  DC2                                                                       
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  awaiting Orsay components for updating tag databases\
\
Replication machinery sufficient for DC2 conditions data is complete.\
\
**Note #2**  delayed because unneeeded for DC2. DC2-critical activities
have been given priority.\
\
**Note #3**  awaiting launch of recently-endorsed LHC-wide distributed
database deployment projectg\
\
**2.2.3.2 Common Data Management**

  ------------------------------ -------------- ---------------- -------------- ----------------
  **Milestone**                  **Baseline**   **Previous**     **Forecast**   **Status**

  Initial Suite of ATLAS POOL    30-Jul-03      \--              7-Jan-05       Delayed (See #1)
  Acceptance Tests                                                              

  Athena I/Fs for Physical       30-Sep-03      \--              25-Jan-05      Delayed (See #2)
  Placement Control Defined                                                     

  Athena/POOL Support for        30-Sep-03      \--              25-Jan-05      Delayed (See #3)
  Physical Placement Control                                                    
  Delivered                                                                     

  Content                        30-Mar-04      \--              15-Oct-04      Delayed (See #4)
  Characterization/Aggregation                                                  
  Model                                                                         

  Strategy for Transaction       30-Mar-04      \--              15-Oct-04      Delayed (See #5)
  Granularity                                                                   

  Schema Evolution Requiements   30-Jun-04      \--              15-Oct-04      Delayed (See #6)
  Defined                                                                       

  Support for Multiple           30-Jun-04      \--              25-Feb-05      Delayed (See #7)
  Transaction Contexts                                                          

  POOL multi-catalog support     31-Jul-04      \[New\]          31-Jul-04      Completed

  Refactor PoolSvc/OutStream     31-Jul-04      \[New\]          31-Jul-04      Completed
  sharable properties                                                           

  Support for Placement Control  30-Sep-04      \--              25-Jan-05      Delayed (See #8)

  Test Suite for Prototype POOL  30-Sep-04      \--              25-Jan-05      Delayed (See #9)
  Schema Evolution                                                              

  Support for Cross-Type         30-Dec-04      \--              30-Dec-04      On Schedule
  Conversion                                                                    

  Documentation Stand-down       11-Jan-05      \[New\]          11-Jan-05      On Schedule

  Athena user access to POOL     31-Jan-05      \[New\]          31-Jan-05      On Schedule
  configuration options                                                         
  ------------------------------ -------------- ---------------- -------------- ----------------

**Note #1**  Delayed to correspond to POOL Spring 2004 release with new
functionality.\
New plan is to integrate these with DC2 readiness tests.\
\
**Note #2**  Pending January 2004 DC2 event store readiness workshop.\
Delayed until after DC2.\
\
**Note #3**  Pending January 2004 DC2 event store readiness workshop.\
Delayed until after DC2.\
\
**Note #4**  delayed until after DC2\
\
**Note #5**  delayed until after DC2\
\
**Note #6**  delayed until after DC2\
\
**Note #7**  delayed until after DC2\
\
**Note #8**  Delayed until after DC2.\
\
**Note #9**  delayed until after DC2 and POOL 2 release\
\
**2.2.3.3 Event Store**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Athena SEAL/POOL           30-Sep-03      \--              16-Jul-04      Completed (See
  Demonstrably Capable of                                                   #1)
  Supporting Prototype Event                                                
  Model                                                                     

  Support for                30-Mar-04      \--              2-Jul-04       Completed (See
  Collection-Level and                                                      #2)
  Subsample Extraction                                                      

  Deep Copy Support for      30-Jun-04      \--              30-Sep-04      Completed (See
  Event Extraction                                                          #3)

  Tier 0 readiness tests     31-Jul-04      \[New\]          31-Jul-04      Completed
  defined                                                                   

  Depth-of-Copy Support for  30-Sep-04      \--              30-Sep-04      Completed (See
  Event Extraction                                                          #4)

  Unique EDO Identification  30-Sep-04      15-Oct-04        28-Feb-05      Delayed (See #5)
  Infrastructure                                                            

  Tier 0 readiness tests     1-Oct-04       \[New\]          1-Oct-04       On Schedule
  passed                                                                    

  Database Tier 0 exercise   24-Nov-04      \[New\]          24-Nov-04      On Schedule
  complete                                                                  

  Database Support for       30-Dec-04      \--              30-Dec-04      On Schedule
  Express Streams                                                           
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Delayed pending outcome of ATLAS DC2 event model task force
(Spring 2004)\
\
Some compromises to the event model were needed to compensate for
POOL/ROOT limitations and some custom converters were needed for
difficult constructs, but an EDM sufficient for DC2 has been
demonstrated.\
\
**Note #2**  Delayed pending delivery of POOL utilities.\
\
POOL utilities have been delivered.\
\
**Note #3**  This work is nearly complete, with some POOL collections
and StoreGate integration tasks remaining.\
\
**Note #4**  Utilities and tests have been delivered for two levels of
extraction.\
More general mechanisms will be introduced later.\
\
**Note #5**  Delayed until after DC2.\
\
**2.2.3.4 Non-Event Data Management**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Generalized Support for    30-Dec-03      \--              30-Mar-04      Completed
  NOVA Loading from Non-AGE                                                 
  Sources                                                                   

  Generation of Transient    30-Mar-04      \--              30-Mar-04      Completed
  NovaObject Classes from                                                   
  Structure Definitions                                                     

  NOVA Schema Definition     30-Jun-04      \--              30-Jun-04      Completed
  Consistent with Event                                                     
  Store Data                                                                

  Maintain NOVA through      30-Jun-05      \[New\]          30-Jun-05      On Schedule
  period of geometry                                                        
  database transition                                                       
  -------------------------- -------------- ---------------- -------------- ----------------

**2.2.3.5 Collections, Catalogs, Metadata**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Athena Interface for       30-Sep-03      \--              28-May-04      Completed
  Writing/Reading                                                           
  Event-Level Metadata                                                      
  (tags)                                                                    

  Collection Cataloging      30-Sep-03      30-Jul-04        31-Jan-05      Delayed (See #1)
  Deployed                                                                  

  Athena                     30-Dec-03      \--              15-Oct-04      Delayed (See #2)
  Interface/Read/Write                                                      
  Access to Collection-Level                                                
  Metadata                                                                  

  Collection Merging         30-Dec-03      \--              2-Jul-04       Completed
  Deployed                                                                  

  Collect                    30-Mar-04      \--              10-Dec-04      Delayed (See #3)
  Replication/Distribution                                                  
  Infrastructure Deployed                                                   

  Integration of Collection  30-Mar-04      30-Jul-04        10-Dec-04      Delayed (See #4)
  Support & Bookkeeping                                                     

  Support for Collection     30-Mar-04      \--              2-Jul-04       Completed
  Subsetting (skims) based                                                  
  upon Server-Side                                                          
  Processing                                                                

  Attribute Lists Capable of 30-Jun-04      \--              30-Jun-04      Completed
  Supporting File/Location                                                  
  Lists                                                                     

  Content                    30-Jun-04      \--              15-Oct-04      Delayed (See #5)
  Categories/Aggregates                                                     
  Represented in Event-Level                                                
  Metadata                                                                  

  Collection integration     31-Jul-04      \[New\]          31-Jul-04      Completed
  with Athena registration                                                  
  streams                                                                   

  Regression tests for       31-Jul-04      \[New\]          31-Jul-04      Completed
  collection utilities                                                      

  Collection integration     15-Oct-04      \[New\]          15-Oct-04      On Schedule
  with ATLAS physics tags                                                   
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Moved to Summer 2004 in the POOL work plan; ATLAS-specific
work will\
probably not be a U.S. responsibility (Grenoble should do this).\
\
POOL has added a model collection catalog to its 2004 work plan. ATLAS
will wait for this.\
\
**Note #2**  Pending January 2004 DC2 event store readiness workshop.\
Delayed until after DC2. Not needed for combined test beam because this
metadata will also be available from the conditions database.\
\
**Note #3**  Joint U.S./Orsay responsibility, on the critical path for
DC2.\
\
Delayed corresponding to ATLAS DC2 Phase II delays\
\
**Note #4**  Principally a Grenoble responsibility, with some U.S.
involvement on the collections end. On the critical path for DC2.\
\
**Note #5**  Delayed until after DC2.\
\
**2.2.4 Application Software**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Geometry Model Based       30-Sep-03      30-Oct-04        30-Dec-04      Delayed (See #1)
  Detector Description used                                                 
  for Reconstruction                                                        

  ATLAS Complete GEANT4      30-Dec-03      \--              30-Dec-04      Delayed (See #2)
  Validation                                                                

  Prototype Definition of    30-Dec-03      \--              30-Jul-04      Completed
  AOD                                                                       

  Prototype Definition of    30-Dec-03      \--              30-Jul-04      Completed
  ESD                                                                       

  Prototype Definition of    30-Dec-03      30-Jul-04        30-Jul-05      Delayed (See #3)
  Event-Level Physics                                                       
  Metadata (tag)                                                            

  RTF Recommendations        30-Dec-03      30-Jul-04        30-Dec-04      Delayed (See #4)
  Implemented                                                               

  Extract Module Alignment   30-Mar-04      30-Jul-04        30-Dec-04      Delayed (See #5)
  Constants                                                                 

  Combined Testbeam Event    30-Jun-04      \--              30-Sep-04      Completed
  Display Available                                                         

  Initial Implementation of  30-Jun-04      \--              30-Nov-04      Delayed (See #6)
  AOD and ESD Available                                                     

  Initial Implementation of  30-Jun-04      \--              30-Nov-04      Delayed (See #7)
  ESRAT Completed                                                           

  Support for Alignment in   30-Jun-04      \--              30-Dec-04      Delayed (See #8)
  Readout Elements                                                          

  Access to Alignment in     30-Sep-04      \--              30-Sep-04      Delayed (See #9)
  Reconstruction                                                            

  Second Version of Combined 30-Sep-04      \--              30-Sep-04      Completed
  Testbeam Implementation                                                   
  Available                                                                 
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Completed except for Caloriemter which have been postponed
to July 2004.\
\
**Note #2**  Many phased of the G4 validation ongoing. First phase of
comparison of basic results with G3 completed. Full G4 validation
integrating new G4 software and DC2 results expected end of the year.\
\
**Note #3**  Awaiting outcome of AOD-ESD task force\
\
**Note #4**  Well in progress. Calorimeter completed, RTF recommended
EDM for Tracking delayed due to lack of manpower\
\
**Note #5**  Delayed from lack of information from all sub-systems\
\
**Note #6**  Delayed pending recommendations for AOD-ESD task force\
\
**Note #7**  This has been delayed with a formation of a search
committee and call for nominations.\
\
**Note #8**  Delayed due to lack of sufficient manpower\
\
**Note #9**  Some alignment information is already existing in Athena.
Other delayed due to either lack of information and appropriate
conditions infrastructure to save these time-varying alignment
constants\
\
**2.2.4.1 Simulation**

  --------------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**                     **Baseline**   **Previous**     **Forecast**   **Status**

  Validate pile-up                  15-Jul-04      \--              15-Dec-04      Delayed (See #1)

  US DC2 Production Commitment      15-Aug-04      15-Sep-04        15-Dec-04      Delayed (See #2)
  completed for                                                                    
  simulation/digitization/pile-up                                                  
  --------------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  DC2 delayed\
\
**Note #2**  DC2 delayed\
\
**2.2.4.3 Combined Reconstruction**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  US DC2 production          15-Oct-04      \--              15-Dec-04      Delayed (See #1)
  commitment for                                                            
  reconstuction completed                                                   
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  DC2 delayed\
\
**2.2.4.4 Analysis**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Form US Atlas Analysis     1-Jul-04       \--              1-Jul-04       Completed
  Support Group                                                             

  Deliver PhysicsAnalysis    15-Jul-04      \--              15-Jul-04      Completed
  prototype.                                                                

  First analysis results     1-Dec-04       \--              1-Dec-04       On Schedule
  from DC2 data                                                             

  First round of collecting  1-Dec-04       \--              1-Aug-04       Completed
  user input for Analysis                                                   
  Support.                                                                  

  Validate GEANT4 Physics    15-Dec-04      \--              15-Dec-04      On Schedule
  with DC2 data                                                             
  -------------------------- -------------- ---------------- -------------- ----------------

**2.2.4.6 Combined Testbeam Software**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  First CTB data available   15-Sep-04      \--              15-Sep-04      Completed
  with preliminary analysis                                                 

  Final CTB data available   15-Dec-04      \--              15-Dec-04      On Schedule
  with preliminary analysis                                                 

  Final CTB data available   15-Dec-04      \--              15-Dec-04      On Schedule
  with prelimminary analysis                                                
  -------------------------- -------------- ---------------- -------------- ----------------

**2.2.5 Software Support**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Testing Releases with New  30-Jul-03      \--              31-Dec-04      Delayed (See #1)
  Compiler Versions                                                         

  Release Version 3.0 of     1-Jul-04       \--              1-Jul-04       Completed
  NICOS nightly control                                                     
  system                                                                    

  Create new (4.0) version   30-Nov-04      \[New\]          30-Nov-04      On Schedule
  of NICOS for incremental                                                  
  nightly builds                                                            

  Install and support ATLAS  31-Dec-04      \--              31-Dec-04      On Schedule
  releases and associated                                                   
  external software at BNL                                                  

  Support of ATLAS software  31-Dec-04      \--              31-Dec-04      On Schedule
  nightly builds at BNL and                                                 
  CERN                                                                      
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  The Milestone was delayed because new compiler versions
were not available.\
In September new gcc 3.2.3 complier became available and the
experimental nightly builds of ATLAS software were started with gcc
3.2.3.\
\
\
**Alexander Undrus (Brookhaven National Laboratory)**\
During this quarter more reliable \"local\" scheme for nightly builds of
ATLAS software at CERN was implemented: the builds are performed on a
local disk and then copied to AFS area for worldwide use. As a result
the nightly builds became more stable, with the number of failed (due to
technical reasons) releases dropped from 15% to about 2%. The creation
of doxygen documentation is started for each nightly build. The number
of nightly integration tests were increased to 40.\
At BNL new ATLAS software releases were promptly installed, usually in
one to two days after CERN installation. The mirrors of ATLAS CVS
repository and ATLAS nightly builds were supported.

**Technical Progress Report**

  -----------------------------------------------------------------------
  **02.03 FACILITIES\
  Jul-Sep 2004**

  -----------------------------------------------------------------------

**2.3 Subsystem Manager\'s Summary**\
**2.3.1 Tier 1 Facility**\
**2.3.1.1 Management/Administration**\
**Bruce Gibbard (Brookhaven National Laboratory)**\
At the beginning of the reporting period Alexander Withers, a new hire,
began work at the Tier 1 center. He will be involved in work associcate
with monitoring and resource management of the Linux farms. Also during
the reporting period Rich Baker left BNL and Razvan Popescu was selected
to replace him as the US ATLAS Facilities Deputy Manager.\
\
**2.3.1.2 Tier 1 Fabric Infrastructure**\
**Bruce Gibbard (Brookhaven National Laboratory)**\
During the reporting period additional air conditioning was installed in
the US ATLAS area of the computing facility. This equipment was purchase
out of Laboratory GPP funds and corresponded to increases driven
primarily by the growth in the size of the ATLAS Linux processor farm.
This should be adequate to meet cooling needs for the next few years.
The rapid growth in need for redundant infrastructure servers (GridFTP,
SRM, DB, etc.) which has been demonstrated by DC2 operations has lead to
reorganization of the support for such servers to both strengthen their
cyber security and streamline their hardware maintenance and system
administration.\
\
**2.3.1.3 Tier 1 Linux Systems**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Initial dCache             15-Dec-04      \[New\]          15-Dec-04      On Schedule
  Functionality Operational                                                 
  -------------------------- -------------- ---------------- -------------- ----------------

**Bruce Gibbard (Brookhaven National Laboratory)**\
Using funds available late in the fiscal year, 32 to additional dual
processor 3.1GHz nodes were purchased and put into service with the
primary objective of enhancing the compute resources available to
individual and small group users. These nodes are being procured with 2
GBytes of memory. 48 similar nodes procured earlier with 1 GByte were
upgraded to 2 GBytes reflecting the observed appetite of Athena for
memory. The new 32 nodes will actually be received and commissioned
early in the next quarter.\
\
During the reporting period in discussion with the DC2 production team
and representative individual users a set of condor based queues
reflecting agreed priorities where established. These will assign
priorities to three groups of users (DC2 production, individual US ATLAS
users, and general Grid3 users) across three groups of Linux modes
(48x3.1 GHz machines, 32x3.1 GHz machines and 48x700 MHz machines).\
\
**2.3.1.5 Tier 1 Wide Area Services**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  HRM / SRM operational for  1-Nov-04       \[New\]          1-Nov-04       On Schedule
  HPSS access                                                               

  dCache SRM operational     15-Dec-04      \[New\]          15-Dec-04      On Schedule

  Robust Data Transfer       1-Feb-05       \[New\]          1-Feb-05       On Schedule
  Service Challenge I                                                       
  complete                                                                  
  -------------------------- -------------- ---------------- -------------- ----------------

**2.3.1.6 Tier 1 Operations**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  DC2 Tier 0 - Tier 1        31-Dec-04      \[New\]          31-Dec-04      On Schedule
  exercise complete                                                         
  -------------------------- -------------- ---------------- -------------- ----------------

**Bruce Gibbard (Brookhaven National Laboratory)**\
During the reporting period the Tier 1 facility was operated in support
of production for Data Challenge 2 (DC2) as well as in support of a
growing number of individual and small groups of users. A call up list
was established to assure that issues with in the facility affecting DC2
could be effectively dealt with on a 7x24 basis. This call up list was
communicated to the IGOC at Indiana and worked well. During this period
the Tier 1 was one of the leading produces of DC2 data with in the US
Grid and the US Grid produced approximately 30% of the compute cycles
delivered to ATLAS although its assign level of delivery was only 20% of
the total.\
\
**2.3.2 Tier 2 Facilities**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Tier 2 Fabric Upgrade      25-Mar-04      \--              25-Mar-04      Completed
  Fully Operationsl for DC2                                                 

  Permanent Tier 2 Sites A & 1-Jul-04       1-Nov-04         1-Jan-05       Delayed (See #1)
  B Selection Complete                                                      
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Uncertainty regarding the funding mechanism for Tier 2\'s
delay action in this area. The selection process is now back on track
but for 3 sites instead of 2 and with a delay in completion of four
months.\
\
**2.3.2.1 Tier 2-A \"Currently Indiana/Chicago Prototype\"**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  UC Tier2 prototype Center  1-May-04       \--              1-Jun-04       Completed (See
  deployed and DC2 ready                                                    #1)
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Final DC2 configuration delayed by NFS fileserver problems.
The basic cluster was functional during the current period and performed
adequately. There were problems with the machine room air conditionin
that caused some downtimes; this was mitigated by replacement of
compressors serving the space.\
\
**2.3.2.2 Tier 2-B \"Currently Boston Prototype\"**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  BU Tier 2 Fabric Upgrade   5-Mar-04       \--              5-Apr-04       Completed
  for DC2 Complete                                                          
  -------------------------- -------------- ---------------- -------------- ----------------

**Saul Youssef (Boston University)**\
During this quarter, in addition to routine operations, we went through
an extensive planning exercise with colleagues in Physics, the Center
for Computationas Science and Scientific Computing and Visualization
center in order to be ready to expand over the next few years. We
secured\
\
a) Space for an expanded Tier 2 center in the Physics Research Building\
b) Made preliminary plans for power, air conditioning, networking and
physical security\
c) Agreements with other groups at BU who are interested in contributing
resources\
d) Coordination with Harvard re: a large storage facility to be
associated with our site via the 144 fiber NoX metro ring.\
d) Approval of the plans from the University\
\
**2.3.3 Wide Area Network**\
**2.3.4 Grid Tools & Services**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  GCE 2.0: DC2 Alpha         1-Feb-04       1-May-04         1-Jun-04       Completed (See
                                                                            #1)

  GCE 2.0: DC2 Delivery      1-Mar-04       15-May-04        1-Jul-04       Completed (See
                                                                            #2)
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Initial milestone delayed by serveral factors - problems
with the ATLAS software distribution kit, Pacman3-beta, and problems
with large scale DC2 job testing.\
\
**Note #2**  Reverted GCE-Server and Capone back to Pacman2 packaged
based system. Capone functionality in full end to end system of
production system brought into functionality during this period.\
\
**2.3.4.1 Grid Infrastructure**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Capone Distributed         1-Apr-04       \--              1-Apr-04       Completed
  Processing Design                                                         

  Capone Distributed         1-Apr-04       \--              1-Apr-04       Completed
  Processing Design                                                         

  VDC schema for DC2         1-Apr-04       \--              1-Apr-04       Completed
  transformations deployed,                                                 
  ready for DC2                                                             

  VDC schema for DC2         1-Apr-04       \--              1-Apr-04       Completed
  transformations deployed,                                                 
  ready for DC2                                                             
  -------------------------- -------------- ---------------- -------------- ----------------

**Rob Gardner (University of Chicago)**\
Development Test Grid (DTG) was re-organized to work with the Grid3dev
software environment. This work was done with USCMS, iVDGL and others.\
A parallel development environment with VOMS, MDS, Ganglia is used.\
\
Oversight from from Ed May of Argonne laboratory continues.\
\
Machines from the DTG are from ANL, UC, and IU.\
\
**2.3.4.2 Workflow Services**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Capone \"stub\" prototype  31-Mar-04      \--              31-Mar-04      Completed
  delivered                                                                 

  Delivery of DC2 ready      1-May-04       \--              1-Jul-04       Completed (See
  Capone + GCE system                                                       #1)
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Full end-to-end functionality of integrated services (VDC,
RLS, DQ, Windmill, Capone, GCE) complted during by this milestone.\
\
\
**Rob Gardner (University of Chicago)**\
Implementation of first instance of Grid3 executor, Capone. Specific\
components delivered:\
\
\* message passing interface - done\
\* job submission modules - done, for Grid3 submission as well as stub.\
\* job monitoring components - significantly improved job satus
monitoring which scales (improved interaction with Condor-G)\
\* job schedulers (several algorithms impleted; a shortcoming is that
they do not use dynamic information such as queue depth).\
\
\
Work continued on development of GCE (Grid Component Environment) based
tools for job submission to Grid3 sites.\
\
**2.3.4.3 Data Services**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  RLS services deployed at   30-Apr-04      30-Apr-04        30-May-04      Completed (See
  to US ATLAS locations                                                     #1)

  VDC services deployed,     1-Jun-04       \--              1-Jun-04       Completed (See
  development and productoin                                                #2)
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  We started with two, jointly registered RLS services. We
found interference with Don Quijote, its interactions (heavier than
expected) which was solved with RLS patches from the ISI/Globus group,
and using a single RLS server.\
\
**Note #2**  Production VDC server deployed at BNL.\
\
**2.3.4.4 Monitoring Services**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  Capone Job Monitor         1-Aug-04       \[New\]          15-Aug-04      Completed (See
                                                                            #1)
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  A Capone-viewer of the ATLAS production database was
developed by a. Vanaichine. These are a set of php-myAdmin queries
tailored to provide pertinent information about job and failure
statistics by Capone submitter and Grd3 site.\
\
**2.3.4.5 Production Frameworks**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  DC2 message schema         1-Apr-04       \--              1-Jun-04       Completed (See
  implemented in                                                            #1)
  Grid3/Capone execution                                                    
  system                                                                    

  Capone grid submission at  1-Jun-04       \[New\]          1-Jul-04       Completed (See
  DC2 scale                                                                 #2)
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Several changes and ambiguities in the ATLAS messaging
delayed completion of the message parsing interface in Capone. Finished
when schema stabilized.\
\
**Note #2**  Scalability test with actual DC2 workflow and significant
scale.\
\
**2.3.4.6 Analysis Frameworks**\
**Rob Gardner (University of Chicago)**\
US ADA Progress report\
2004 quarter 3\
David Adams\
November 17, 2004\
\
There was significant progress in US contributions to ADA (ATLAS\
distributed analysis) in the third quarter of 2004. Version 0.92\
of DIAL was released with the following enhancements:\
1. The mechanism for creating gsoap-based web services was\
improved so it is now easy to add new services and clients.\
A single executable is the basis for all services.\
2. The handling of external packages was greatly improved.\
3. The problem causing crashes in the previous version was\
traced back to use of a ROOT executable built without\
the pthread library.\
4. The first DC2 transformations were provided.\
\
The ARDA architecture and draft of the ARDA design documents were\
released during the quarter. We invested considerable effort into\
understanding these documents and how to fit ARDA into the ADA\
model. We wrote extensive responses to both documents.\
\
The GANGA python wrappers for the DIAL classes wer completed, most\
notably finding a connection between python print method and the\
C++ ouput stream.\
\
For more information on all the above, see the ADA home page\
http://www.usatlas.bnl.gov/ADA\
\
**2.3.5 Grid Production**

  -------------------------- -------------- ---------------- -------------- ----------------
  **Milestone**              **Baseline**   **Previous**     **Forecast**   **Status**

  DC2 GTS Version Ready for  1-Apr-04       \--              2-Jul-04       Completed
  Production                                                                

  Start ATLAS DC2            1-Apr-04       \--              24-Jun-04      Completed

  DC2 50% Complete           15-Jun-04      \--              7-Oct-04       Delayed (See #1)

  Start DC2 on Grid3         24-Jun-04      \--              14-Jul-04      Completed

  DC2 Production Goals       27-Aug-04      \--              15-Dec-04      Delayed (See #2)
  Achieved                                                                  

  Computing Model Document   3-Jan-05       \--              3-Jan-05       On Schedule
  Complete                                                                  
  -------------------------- -------------- ---------------- -------------- ----------------

**Note #1**  Startup delay plus other factors is will delay DC2 about
3.5 months.\
\
**Note #2**  Overall ATLAS DC2 schedule has slipped 3.5 months.\
\
\
**Kaushik De (University of Texas at Arlington)**\
DC2 production started during this period. All the necessary software
and hardware were deployed and brought on line. The production team
worked closely together with the GTS team to make the transition from a
development to a production system. Grid3 resources from ATLAS and
non-ATLAS sites were fully used for DC2. The new production system
evolved into a fully functioning system, with many iterations to improve
performance. Many problems were discovered and solved with the software
and hardware infrastructure as we ramped up to production scale. There
were some delays with systems not fully in U.S. control. Overall, DC2
was a success in the U.S. and met all major objectives.

**Technical Progress Report**

  -----------------------------------------------------------------------
  **02.09 SUPPORT\
  Jul-Sep 2004**

  -----------------------------------------------------------------------

**2.9 Subsystem Manager\'s Summary**\
**Jim Shank (Boston University)**\
SubSystem Manager\'s summary July-Sept., 2004\
\
This quarter the main activity was the massive production for the ATLAS
Data Challenge 2 (DC2). This involved getting the Grid3 environment set
up to run the ATLAS generation and simulation software. This was done on
approximately 15 of the Grid3 sites that were selected for the most
compatibility (OS, WAN access from compute elements, etc.). During this
quarter we succeeded in doing 80% of the CPU-intensive Geant4 simulation
part of DC2 that was assigned to us by agreement with ATLAS. Many
problems with grid middleware, software distribution, DB servers and
other components were encountered and solved. Much of this experience is
needed to prepare the important Computing Model document which is now on
schedule for completion at the end of CY 2004.\
\
In addition, the Combined Test Beam (CTB) continued in this quarter and
a branch of the ATLAS software has been used for the processing and
analysis of this data. Improvements/bug fixes in this branch have
continued in this quarter and are expected to continue throughout the
testbeam period up to Nov., 2004.