# Presentation: 328280

## Grid Computing Activities in the DØ Southern Analysis Region (DØSAR)

** **

## DØ Southern Analysis Region (DØSAR)

**DØ ****S****outhern ****A****nalysis ****R****egion (DØSAR)**

**Consortium coordinating activities to maximize computing and analysis resources**
**UTA, OU, LTU, LU,**** ****SPRACE, Tata,**** ****KSU, KU, ****UMiss, CSF**
**MC farm clusters – dedicated and multi-purpose, rack mounted and desktop, 10’s-100’s CPU’s**
**http://www-hep.uta.edu/d0-sar/d0-sar.html**

## DØSAR

**The first US Region**

## SAR Computing Resources

| Institutions | CPU(GHz) [future] | Storage (TB) | People |
| --- | --- | --- | --- |
| Cinvestav | 13 | 1.1 | 1F+? |
| Langston | 22 | 1.3 | 1F+1GA |
| LTU | 25+[12] | 1.0 | 1F+1PD+2GA |
| KU | 12 | ?? | 1F+1PD |
| KSU | 40 | 1.2 | 1F+2GA |
| OU | 19+270 (OSCER) | 1.8 + 120(tape) | 4F+3PD+2GA |
| Sao Paulo | 60+[120] | 4.5 | 2F+Many |
| Tata Institute | 52 | 1.6 | 1F+1Sys |
| UTA | 430 | 74 | 2.5F+1sys+1.5PD+3GA |
| Total | 943 [1075] | 85.5 +
120(tape) | 14.5F+2sys+6.5PD+10GA |

## McFarm

**McFarm**

**Hi-level production manager layered on runjob, SAM, and optional batch system**
**Set of daemon and utility scripts on job server**
**Parallelizes request**
**Fetches input files from SAM**
**Distributes jobs**
**Stores metadata and merged tmb’s in SAM**
**Retries on action failure**
**Archives request jobs**
**Informs operator of status and problems (and solutions)**

## McFarm cont’d

**McFarm cont’d**

**Highly automated system minimizes maintenance and operations time **
**Until now used primarily for Monte Carlo production**
**Certified as production manager for reprocessing**
**Being modified to handle tmb fixing**
**Flexible, dependable, productive, efficient**
**Interfaces to extensive monitoring tools**
**Robustness and good error recovery**

## DØSAR Monitoring Software

- Ganglia resource monitoring
- Contains 6 farms (358 cpus), including Tata institute
- McFarmGraph: MC production job monitoring system using gridftp
- Provides detailed information for a MC request
- McPerM: MC Farm Performance Monitoring

## MC Job Status Monitoring: McFarmGraph

_**[MC Job Status Monitoring: ](http://hepfm000.uta.edu/cgi-bin/filter.cgi?genpage,mcp14,SWIFT-HEP)**__**[McFarmGraph](http://hepfm000.uta.edu/cgi-bin/filter.cgi?genpage,mcp14,SWIFT-HEP)**_

## Performance Monitor

**Performance Monitor**

## Farm Performance Monitor: McPerM

- Data organized in directory based xml database
- Local UTA farms only at the moment

## Grid Enabling DSAR

**Grid Enabling D********SAR**

- Continue production and prepare for SamGrid/runjob stable operation
- McFarm requires local pre-staged D release, minbias, cardfiles, runjob and root access  McFarm will be phased out
- Initiate McFarm production via SamGrid framework
- Replace runjob jobmanager with JMM  4 files replaced, re-tailor jim_config, the rest is the same
- Successful submission of requests via SamGrid to JMM exec sites (UTA-RAC, LTU, LU, will add OU)
- In process of installing SamGrid/runjob exec site on OSCER – generic cluster w/o root access, firewall issues

## DØSAR Accomplishments

**DØSAR Web page now presents the “How to” for DØ SAR IACs**
**At 3rd workshop**
**Total 32 participants (16 remote + 16 local)**
**Total of 24 talks (8 Physics + 16 technical)**
**Four analyses are in progress in various IACs**
**And DØSAR Grid MC production operation was begun! **
**Client sites: LTU, LU, OU and UTA**
**Submission sites: LU and Fermilab**
**Execution sites w/ JMM: LTU, LU, UTA Swift and RAC**
**See the table for actual accomplishments**

## First D0SAR Grid MC Production

- 6 Official MC requests have been submitted to various farms through SAM/Grid

| Req. ID | Nevt | Submitter | Client Site | Exec. Site |
| --- | --- | --- | --- | --- |
| 12377 | 50k | HWK | heppc32 (UTA) | caps10 (LTU) |
| 12378 | 50k | HWK | heppc32 (UTA) | Swift (UTA) |
| 12379 | 50k | JMS | luhep03 (LU) | UTA – RAC  |
| 12380 | 50k | HWK | heppc32
(UTA) | luhep03 (LU) |
| 12381 | 50k | HS | ouhep0 (OU) | Swift (UTA) |
| 12382 | 50k | ZDG | caps10 (LTU) | UTA – RAC  |

## D0SAR MC Delivery Stat. (as of May 10)

*D0 Grid/Remote Computing April 2004                                                                                                                                                           Joel Snow  Langston University*

**D0SAR MC Delivery Stat. (as of May 10)**

| Institution | Inception  | NMC (TMB) x106 |
| --- | --- | --- |
| LTU | 6/2003 | 0.4 |
| LU | 7/2003 | 2.3 |
| OU | 4/2003 | 1.6 |
| Tata | 6/2003 | 2.2 |
| SPRACE | 4/2004 | 0.6 |
| UTA-HEP | 1/2003 | 3.6 |
| UTA–RAC | 12/2003 | 8.2 |
| D0SAR Total | As of 5/10/04 | 18.9 |

## DSAR Plans

**D********SAR Plans**

**D********SAR VO – authorization and resource coordination management in region**
**Establish Client and Exec sites SPRACE, KSU and KU, CSF, Miss, ...**
**SG McFarm ******** runjob**
**Bring OSCER up; obtain and deploy (3yr) ~256 CPU Opteron cluster at OU ****(DOE EPSCOR HEP OU,OSU,LU)**
**3 Postdocs/IT, 2 Grad students**
**Deploy ~64 CPU Itanium2 cluster at OSCER ****(NSF MRI grid research)**
**Utilize MonaLisa for monitoring**

## Conclusions

*                                                                                                                                                      *

**Conclusions**

- DØSAR has considerable resources used in an  effective manner
- Generated and delivered a total of 18.9M MC events
- TMB Fixing in progress at UTA-RAC
- Plan to participate in re-processing
- DØSAR is moving to SG/runjob
- McFarm  SG/McFarm  SG/runjob
- Migrate DØSAR monitoring tools to SG/runjob
- Enhance brokering capabilities
- Need enhanced brokering for seamless job creation to execution to data storage
- Will work with FNAL SG Team for smooth integration and implementation of D0Grid
- DØSAR demonstrates that “Grid” empowers
- 4th DØSAR Workshop at KSU in Sep., 2004.

## TALK OUTLINE

*                                                                                                                                                          *

**TALK OUTLINE**

**DØSAR Organization **
**Computing Resources**
**DØSAR Tools:**
**McFarm**
**Monitoring**
**Grid Enabling DØSAR**
**Overview of 3****rd ****DØSAR Workshop (May 7-9)**
**Production Delivered**
**Plans**
**Issues**
**Conclusion**

## Ganglia Resource Monitoring

## McFarmGraph Archive Report

## 3rd DØSAR Workshop, LTU, May 7-9

**General talks on grid development and data processing nationally and internationally**
**Discussion of HEP Analysis efforts within DØSAR**
**Deployment of SAMGrid/JMM (Job Manager McFarm) within DØSAR**
**Informational talks by Computer Science/IT collaborators**

## FNAL Submission Site

## Execution Site

- Submission Site

- Client Site