# Presentation: 367786

## BNL’s Role in ATLAS

**Howard Gordon**
**DOE Annual HEP Review**
**Brookhaven National Lab**
**April 17-19, 2006**

## LHC Machine Status from Dashboard

**LHC Machine Status from Dashboard**

## Lyn Evans said in 2/06, the objective for 2007 is 75 ns operation with 1032

**Lyn Evans said in 2/06, the objective for 2007 is 75 ns operation with 10****32**

## BNL’s Role in ATLAS

**Overview of BNL Role in ATLAS ****	****	****	****H. Gordon**
**U.S. ATLAS Analysis Support Center**
**BNL Role in US ATLAS Management**
**BNL Role in Construction & Research program **
**Construction/Installation/Commissioning/**
**	****ATLAS Upgrade****	****	****	****  ****	****          ****	****D. Lissauer**
**Construction / Installation / Commissioning:**
**Liquid argon calorimeter**
**Cathode strip chambers (Muon system)**
**ATLAS Technical Coordination**
**ATLAS upgrade – Tracking/Calorimeter/Muons**
**Upgrade Project Office; Tracking; LAr**
**ATLAS Computing****	****	****	****	****	****T. Wenaus**
**Tier I Center**
**Core Software**
**Physics****	****	****   ****	****	****	****           ****	****K. Cranmer**
**Reconstruction – system specific**
**Physics Analysis**
**Plus Parallel Session III (Theory)**
**Early Physics with ATLAS and LHC; (F. Paige)**
**Implications of non-universal masses: a step beyond mSUGRA: (T. Krupovnickas)**

## General Approach

**Construction responsibility matched to unique technical capability at BNL.**
**Physics & Instrumentation Division were pioneers in R&D for both LAr calorimeter and cathode strip chambers. **
**Contribution to the analysis builds on:  detector expertise in the calorimeter and muon systems and Core software strength.**
**Much of computing and software aims at insuring that the U.S. can easily access the ATLAS data:  data management, Tier 1 and Tier 2’s**
**ATLAS upgrade concentrates on the tracking system and Calorimeter readout where we take advantage of unique developments. Major role in overall optimization via Upgrade PO activities. **

##   SUSY  could  be  found  quickly if  isolated from SM backgrounds  

- ~ 1 yr at 1034:
- up to 2.8 TeV

- ~ 1 yr at 1033:
- up to 2.3 TeV

- ~ 1 mo. at 1033:
-    up to 2 TeV

- Reach of Multijet + ETmiss
- search

******  ****SUSY  could  be  found  quickly if  isolated from SM backgrounds**

**A Supersymmetry Discovery Could Come Soon****We need to work hard to understand the backgrounds**

- ATLAS SUGRA Pt. 6

**Meff = ********p****T****(j****i****) + E****T****miss**

**This was the older S/B**

## We now believe SUSY may need a Lepton Trigger 

**ackground**

**Signature for SUSY from Multi-jets and Missing E****T**** is more robust if a lepton is required.**
**Using more modern generators indicates that the background in the no-lepton channel is higher than we thought.**

## Frank Paige had a significant role in this strategy

- 100 fb-1
- LHC Point 5

-  **Example Reconstruction **
**Of a SUSY Decay Chain**

## The ATLAS Detector

- ATLAS is being assembled in its cavern at CERN

## BNL Deliverables to the  ATLAS Experiment

- Barrel Cryostat and utilities (BNL)

- CSC (BNL)

## Barrel TileCal and Liquid Argon at z=0

- Status 8 November 2005

## Leading BNL Roles in ATLASNew since 2005 

**K. Assamagan****	****	****Analysis Tools Coordinator **
**Kyle Cranmer         ****	**_**Co-Coordinator of ATLAS Jet/E**__**T**__**Miss trigger                **_**	****	****	**_**software**_
**B. Gibbard****	****	****International Computing Board (and Grid ****	****	****	****	****Deployment Board)**
**H. Gordon****	****	****ATLAS Executive Board, National Contact ****	****	****	****Physicist **
**F. Lanni****	****	****	****LAr Upgrade Coordinator**
**D. Lissauer****	****	****Leader of Technical Coordination Project Office ****	****	****	****	****(Task A)**
**	****	****	****	**_**Head of Project Office for the Upgrade**_
**H. Ma****	****	****	****LAr Database Coordinator**
**	****	****	****	**_**Co-Coordinator of LAr Commissioning Analysis**_
**S. Rajagopalan****	****	****LAr Calorimeter Performance Co-Coordinator ****	****	****	****Event Data Model Architecture**
**	****	****	****	****LAr Management Group**
**	****	****	****	****ATLAS Computing and Software Management ****	****	****	****Groups**
**T. Wenaus****	****	****ATLAS Database Project Co-Leader ****	**
**H. Takai****	****	****	****Co-Coordinator Heavy Ion Physics Group**
**V. Polychronakos****	****Cathode Strip Chamber Leader**

## BNL Roles in U.S. ATLAS

**H. Gordon, **_**Construction Project Manager**_**; **
**Deputy Research Program Manager**
**S. Rajagopalan, Software Subsystem Manager, WBS 2.2**
**T. Wenaus, **_**Distributed Software Manager, WBS 2.2.4**_
**A. Undrus, **_**Software Infrastructure, WBS 2.2.6**_
**H. Ma, **_**BNL Analysis Support Center Coordinator, WBS 2.2.7.1**_
**B. Gibbard, Computing Facilities Manager, WBS 2.3 (R. Popescu, Deputy)**
**P. Nevski, Grid Production, WBS 2.3.4**
**D. Lissauer, Technical Coordination Subsystem Manager WBS 3.9**
**T. Maeno, K. Assamagan – **_**Analysis Support Group**_
**K. Cranmer, **_**Trigger Forum**_**; F. Paige, **_**SUSY Forum**_

## (1) Analysis Support Group

**ASG membership:**
**ASG chair  (S. Willocq, U. Mass. Amhearst)**
**ASC coordinators  (J. Proudfoot @ ANL, H. Ma @ BNL, S. Loken @ LBNL)**
**CERN contact person**
**Support contacts:**
**	****- Software framework (Athena, CMT, how to run, etc.)**
**	****- Data management (incl. database)**
**	****- Distributed software (incl. grid)**
**	****- Software releases (incl. kit installation)**
**	****- Physics analysis tools (ESD/AOD/TAG, tools, etc.)**
**	****- Generators/Simulation**
**	****- InDet tracking, b-tagging & vertexing**
**	****- MuSpec tracking & muon ID**
**	****- LAr calorimetry & e/gamma ID**
**	****- Hadron calorimetry & jets/Etmiss/tau**
**	****- Trigger**

- Detector
- performance
- support

## (2) Analysis Support Centers (ASC)

**Main task:**
**Provide US ATLAS physicists with regional resources, tutorials, support, leadership and focal point for meetings**
**3 ASCs:**
**Argonne National Lab:  Midwest region**
**Brookhaven National Lab:  Eastern region**
**Lawrence Berkeley National Lab:  Western region **
**Choice of 3 centers is motivated by the ability to tap into the considerable infrastructure and human resources available at those laboratories**
**Also, it facilitates access to support and expertise for US physicists at ‘nearby’ Universities**

## (2) Analysis Support Centers

**ASC Role:  the following is to be made available**
**Infrastructure:**
**Office space for visitors**
**Access to networking, printers, stationary, copy/fax/coffee machines**
**Secretarial assistance**
**Meeting rooms for tutorials and face-to-face analysis meetings**
**Video and phone conferencing facilities**
**Software support:  Requires 1 new FTE at each ASC**
**General software (framework, how to run jobs, etc.)**
**Physics analysis tools**
**Distributed analysis, grid use**
**Liaison to computing facilities**

## (2) Analysis Support Centers

**ASC Role (cont’d):**
**Expertise:**
**Basic software support as indicated above**
**Some members of the ASG will be stationed at an ASC,****this reinforces areas of expertise that already exists regionally:**
**ANL: Hadron calorimetry, jet reconstruction & calibration**
**BNL: LAr calorimetry, e/gamma ID, trigger for e/gamma, jets, missing E****T****+ regional groups for Muon tracking and ID, analysis tools, b-tagging**
**LBNL: Inner Detector tracking, b-tagging, vertexing**
**Physics analysis through ASC physicist involvement in ATLAS physics**
**Coordination:**
**ASC coordinators oversee local support activities**
**ASG chair coordinates the activities at the 3 ASCs:**
**Tutorial and analysis support coordination across ASCs**
**Monthly meeting between ASC coordinators and ASG chair**
**Compilation of ASC-use metrics to assess effectiveness**

## BNL ASC MOU section

## BNL ASC MOU Section

## (3) Analysis Forums

**Main task: **
**Provide US ATLAS physicists with a forum for discussion and exchange of information, and to stimulate activity**
**AF membership:**
**Analysis forums are led by ‘*****forum conveners*****’ who:**
**Call for presentations to regular video/phone meetings**
**Make sure work is presented in ATLAS-wide meetings**
**Provide input to computing Resource Allocation Committee (RAC)**
**Notes:**
**AFs are not substitutes for ATLAS working groups**
**AFs have no approval power (ATLAS working groups do) **
**Participation in AFs is not mandatory**
**AF meetings need to be informal, stimulate discussion & collaboration**

## (3) Analysis Forums

**Analysis Forums: **
**InDet tracking, b-tagging & vertexing**
**MuSpec tracking & muon ID**
**LAr calorimetry & e / gamma ID**
**Hadron calorimetry & jets / Etmiss / tau**
**Trigger**
**Standard Model & Higgs Physics**
**Beyond the Standard Model Physics**
**Notes:**
**One forum convener for each of the forums 1-5**
**Two forum conveners for each of the forums 6-7**
**Physics forums could split into smaller units to maintain smaller, informal nature of each forum (would need only one convener per forum then)**

- Detector
- performance

- Physics

## Typical Tutorial by K. Assamagan

**AnalysisTutorial1105 **
_**[Introduction - What to do before coming to the Tutorial](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Introduction_What_to_do_before_c)**_** **
_**[Set up CMT](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Set_up_CMT)**_** **
_**[Setup for the release 11.0.41](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Setup_for_the_release_11_0_41)**_** **
_**[Run Time Setup](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Run_Time_Setup)**_** **
_**[The Next Time You Login](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#The_Next_Time_You_Login)**_** **
_**[Install Atlantis on your laptop](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Install_Atlantis_on_your_laptop)**_** **
_**[Get The Necessary Files](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Get_The_Necessary_Files)**_** **
_**[Run the ](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Run_the_AnalysisSkeleton_for_100)**__**[AnalysisSkeleton](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Run_the_AnalysisSkeleton_for_100)**__**[ for 100 Events](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Run_the_AnalysisSkeleton_for_100)**_** **
_**[More Information](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#More_Information)**_** **
_**[Event Selection, Display and Visualization](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Event_Selection_Display_and_Visu)**_** **
_**[Event Selection](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Event_Selection)**_** **
_**[Use the ](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Use_the_AthenaAwareNTuple_for_Ev)**__**[AthenaAwareNTuple](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Use_the_AthenaAwareNTuple_for_Ev)**__**[ for Event Selection](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Use_the_AthenaAwareNTuple_for_Ev)**_** **
_**[Selecting Events at the AOD, ESD and RDO Levels](https://twiki.cern.ch/twiki/bin/view/Atlas/AnalysisTutorial1105#Selecting_Events_at_the_AOD_ESD)**_** **
**Passing Selected Events to Event Display **
**Event Display and Visualization **
**1. Getting started with atlantis: Looking at AOD events **
**2. Interactive athena/atlantis **
**3. Use the athena vertexing tools from within atlantis **
**Distributed Analysis **
**Analysis on CSC samples using DQ2 **
**How to run customized Athena to the Grid (OSG) **
**Event View**

## ATLAS Physics Analysis Tools led by K. Assamagan

- Objectives:
-  Propose a unified, baseline framework for Analysis
- Common classes in the analysis domain
- Tools to build these objects
- General/common tools for analysis
- Navigations and Associations from ROOT NTuple back to AOD, ESD, and the Raw Data
- Tools to select the events of interest
- Event Display and visualization tools
- Tools for interactive analysis in ATHENA
- Tools for user analysis in the Distributed Analysis Environment
- Concrete, thorough analysis examples
- Tools for Multi-variate Analysis – Discriminant Analysis/Maximum Likelihood Analysis
- Analysis Model: how all the above tools are integrated to define a model for how to do analysis on ATLAS data
- ESD/AOD analysis to ROOT NTuple
- Concept of the EventView – tools for user analysis dependent, self consistent and exhaustive view of the Event, containing mutually exclusive, reconstructed, final state particles
- Interactions with combined performance groups & physics groups
- Interaction with the user – use support
- Common look and feel to the user
- BNL is heavily involved in the development of these analysis tools and the analysis model:
- Overall coordination of various efforts
- Event Data Model for Analysis
- Distributed Analysis Tools
- Analysis Model – Event View

## Typical Activities of LAr Calorimeter Performance Coordinator, S. Rajagopalan

**Set Priorities for the upcoming software release version 12.0.0**
**Review of the action items from the recently concluded calorimeter trigger workshop (end of January)**
**Organize a trigger software code review**
**Update on the status of incorporating realistic geometries in simulation.**
**Update on the status of usage of the new conditions database architecture**
**Plan to incorporate schema evolution for calorimeter data classes.**
**Plans and follow up from the Commissioning Expert Week**
**Defining a series of readiness notes for Calorimeter performance. These notes are to be completed in one year time ensuring the calorimeter software is ready for data taking.**
**Defining a procedure to nominate speakers for upcoming conferences.**

## U.S. ATLAS Project and Research Program Management

**BNL is the Host Lab for the 33 U.S. institutions in ATLAS**
**We have (almost) constant reviews**
**We are active in the transition from a successful Construction Project to the Research Program which includes:**
**Construction Project achieve CD-4A Sept. 30, 2005 – 97% + Complete**
**M&O – consisting of pre-operations and commissioning**
**Highlight LAr M&O**
**Technical Coordination and New Upgrade Project Office**
**Computing: Highlight PanDa and Service Challenge 4**
**Upgrade R&D: Highlight StripPixel**
**We are responsible for (monthly and quarterly) reports, budgets, MOUs, and other exercises**

## Research Program Organization 

## Safety

**David Lissauer (BNL) is the leader of the ATLAS Technical Coordination (TC) Project Office (Activity A).  The Project Office includes the ATLAS GLIMOS and therefore David participates in formal and informal meetings on safety issues.  **
**Many U.S. leaders are involved in the preparation of many of the Work Packages which address risks and mitigation as well as training requirements.  **
**There is a safety professional  stationed in the Cavern, who is independent of ATLAS. He spends full time supervising all operations and looks for ways to reduce risk as well as enforcing safety rules - such as the wearing of required safety clothing.**
**Recently, ATLAS TC has applied the same procedures used in the Cavern to other areas where ATLAS work is being done - such as building 180. There is a Territorial Safety Officer (TSO) for each area who is a member of ATLAS TC.  The TSO is responsible in these other locations and performs the same functions as 4) above.**
**We have tasked Steve Kane, who is our U.S. ATLAS Project Engineer and a certified safety professional, to review all ATLAS Work Packages (WP) where any U.S. worker could be involved.  The purpose of the WP review will be to recommend what U.S. actions might be necessary, and alert the U.S. ATLAS Research Program Manager and Deputy Research Program Manager of the issues which need to be dealt with.  The Deputy will interact with CERN and ATLAS management as appropriate to deal with the issues and follow up with the U.S. ATLAS Level 2 Managers and institutional representatives whose workers will be affected.**
**The review will include requirements for any additional safety training for U.S. workers.  **

## LAr FEBs and Power Supply System 

- Front End Boards (FEB) in System Crates

## FEB Production @ BNL(updated April 2006)

**Assembly of analog components (PA, LSB) and cooling.**
**839 boards (>~50% of total production)**
**Status: shortage of 25Ohm 5mA preamplifiers prevented us from completion in Feb 2006. Missing about ~200 PAs (without counting spares). **
**Delivered to CERN: 830 boards **
**All EMB boards delivered**
**All EMEC boards delivered**
**9 FCAL board missing**
**Completion: June 06**
**Low Voltage DC/DC converters are now being retrofitted and are working fine – **

## BNL LAr M&O Tasks

**LVPS Commissioning**
**Front-End Crate [FEC] Cooling Commissioning**
**Front-End Detector Control System Commissioning [DCS]**
**Front-End Installation and Commissioning**
**Cryostat and proximity service commissioning**
**Cryogenics**
**Databases**
**Phase-III Analysis Commissioning**
**(David Lissauer will go into more detail on these points)**

- Topics

## Cathode Strip Chambers (CSC)

- CSCs fabrication was completed at BNL in 2005 and sent to CERN.
- At right is a chamber in its frame at CERN in pre-operation.

## Technical Coordination (TC) organization 

**ATLAS management**

*C) Systems  Construction Liaison*

*E) Common systems  *

***D) Electronics and Signal processing**** ****Ph. Farthouat***

***G) Logistics + experimental areas***
***INIGO-GOLFIN***

***activities***

***[spokesperson ***
*** ******deputy spokesperson***
*** ******resources co-ordinator***
*** ******technical co-ordinator ]***

***[activity managers,***
*** ******ATLAS management ]***
*** ***

***A) TC Project Office. ******D. Lissauer***

***B) CERN Divisional Relations. ******M. Nessi***

***F1) Integration***
***M. Hatch***

***F2)Installation***
***G. Tappern***

## US Involvement

***US Physicists Involved in TC:***
***	******D. Lissauer******	******- TC   Activity A, Placement Strategy (BNL)***
***	******M. Shupe******	******	******- Radiation/Activation Studies (Arizona)***
***	******J. Bensinger******	******- Forward Muon Integration (Brandeis)***
***	******B. Stanek******	******- ******	******- Movements (ANL)***
***	******M. Sharp******	******	******- Installation Data Base (Nevis@ CERN)***
***TC Support @ CERN:***
***	******K. Pommes******	******	******	******Project Management – Eng.***
***	******T. Klioutchnikova ******	******	******	******Senior Designer – Conf. Control***
***	******A. Foussard******	******	******	******Installation Feet/Magnet. ***
***BNL:***
***	******S. Norton******	******	******	******	******Senior Designer – Conf. Control***
***	******A. Gordeev******	******	******	******Engineer – Access***
***	******J. Farrell******	******	******	******	******Designer***
***ANL:***
***	******J. Grudzinski ******	******	******	******Movements/FEA Calc. ***
***LBL:***
***	******E. Anderson******	******	******	******Pixel/Beam Interface.***
***	******	***

## Upgrade Project Office (PO) (D. Lissauer, head)

*** ******ATLAS upgrade PO is being established to implement the  ATLAS organization for the upgrade R&D.***
***Planning, Review, Configuration Control, Safety, Infrastructure Services, Integration***
***2. Resources from the collaboration will be needed to fill key positions in the upgrade plan. (As manpower become available in the institutions please contact us to see how best to integrate the effort – especially from outside institutions)***
***3. The PO will play an active role in maintaining the R&D focused on the ATLAS upgrade needs.****** ***

- Tracking R&D for Upgrade

## New Software Project: Panda

**PanDA – Production and Distributed Analysis system**
**Project started Aug 17, 2005**
**Baby Panda growing!**
**New system developed ****by U.S. ATLAS team**
**Rapid development from scratch**
**Leverages DC2/Rome experience**
**Lack of scalability**
**Inspired by Dirac & other systems: pilot jobs in each site**
**Already in use for CSC production in the U.S.**
**Better scalability/usability compared to DC2 system**
**Will be available for distributed analysis users in few months**
**One-stop shopping for all ATLAS computing users in U.S.**
**Co-leader: T. Wenaus**

## US ATLAS Tier 1 Service Challenge Participation

**BNL’s current connection is 20 Gb/s via ESNET – but not redundant **
**Need to insure ESNET upgrade in FY07**
**BNL Contributed to the Service Challenge 4 from the beginning**

- BNL is participating like other world centers.

- BNL

## Conclusions

**BNL is playing a leading role in U.S. ATLAS and ATLAS overall:**
**Physics**
**Management**
**Detector Construction/Technical ****Coordination ******** Installation******** Commissioning ********M&O**
**Computing**
**Upgrade R&D**
**The erosion of the “Core Research” Program support prevents us from reaching our full potential**
**BNL has little flexibility**