# Presentation: 134409

## Overview:Offline Luminosity Software

**Elizabeth Gallas**
**Fermilab Computing Division /**
**D0 Computing and Analysis Group**

- Luminosity meeting
- June 15, 2006

- ElizabethGallas

- June 15, 2006

## Outline

- Links to Documentation
- Luminosity Home page
- Offline Luminosity Software
- Luminosity Database
- Purpose
- Luminosity Database Status
- Luminosity Offline Software Status

- ElizabethGallas

- June 15, 2006

## Documentation

- Luminosity Group – Home page
- www-d0.fnal.gov/phys_id/luminosity/
- links to documentation on all related Online and Offline systems
- Luminosity Offline Software Documentation
- www-d0.fnal.gov/phys_id/luminosity/software/offline.html
- Loading online and offline Data
- Luminosity database description (below)
- clients and servers
- Luminosity Database Documentation (D0 note 4915)
- _[/d0dist/dist/packages/lm_db/devel/www/](http://www-d0.fnal.gov/d0dist/dist/packages/lm_db/devel/www/LumDB.html)__[ LumDB](http://www-d0.fnal.gov/d0dist/dist/packages/lm_db/devel/www/LumDB.html)__[.html](http://www-d0.fnal.gov/d0dist/dist/packages/lm_db/devel/www/LumDB.html)_
- the luminosity database schema
- database definition language in cvs
- descriptions of database tables and columns, relationships, data types
- and links to database access methods in production and development

- ElizabethGallas

- June 15, 2006

## Purpose – Luminosity Offline Software

**Calculate/Deliver a Luminosity Normalization**
**for any physics data set**
**Verify and certify data integrity**
**for normalization purposes**
**Improve error tracking and characterization**
**Produce Operations Reports and Graphs**
**Produce LBN Quality Reports**

- ElizabethGallas

- June 15, 2006

## Purpose – Luminosity Database

- The Luminosity Offline Software is centered on the Luminosity Database
- The Luminosity Database stores information from:
- Luminosity Monitor Detector
- Trigger Framework
- Level 3
- Fermilab Tevatron Accelerator
- Offline Data Processing (SAM)
- "Group" assigned quality quality flags
- "Consistency" determined quality
- Plays administrative role cross checking information from all online and some offline subsystems

- ElizabethGallas

- June 15, 2006

## The Luminosity Database “Schema”

_**The Luminosity Database “Schema”**_

- ElizabethGallas

- June 15, 2006

## The Luminosity Database “Schema”

_**The Luminosity Database “Schema”**_

- "Corrections"

- Streaming and
- Offline Processing

- Triggered
- Luminosity

- Delivered/Exposed
- Luminosity/Scalars

- LBN

- "Group" assigned
- Data Quality

- "Transitions"

- 9 STATUS_TO% tables
- "Consistency" assigned
- Data Quality

- ElizabethGallas

- June 15, 2006

## Luminosity Database Status

_**Luminosity Database Status**_

- Schema is stable
- Legacy Data is loaded
- Online Data is loaded automatically (lumGrabber)
- evolving with other short term work (next slide)
- Data Quality (DQ by LBN is waiting...)
- Test system online 30-March-2006
- waiting for feedback from DQ group

- ElizabethGallas

- June 15, 2006

## Luminosity Database Status

_**Luminosity Database Status**_

- Current work on the database:
- Luminosity Constant – many years of studies changing all luminosity measurements back to the beginning of Run 2A
- Other:
- Eliminating duplicate records, impose unique keys and constraints
- Understanding Special Values and Status Flags
- Fix Transition Times
- Get Begin/End LBN for every Store in the database
- loading of fuzzy or other times (transition records)

- ElizabethGallas

- June 15, 2006

## Luminosity Client/Server Status

_**Luminosity Client/Server Status**_

- Operations Reports
- Need to:
- understand operation and discrepancies
- address performance
- lmAccess

- ElizabethGallas

- June 15, 2006

## LumDB: Long Term Issues

_**LumDB: Long Term Issues**_

- Procedures for updating the database
- luminosity constant change
- discrepancies found
- establish on case by case basis
- Need program! check database vs online Scalar files
- at regular intervals and especially after updates (1.)
- Online data loading
- will require maintenance/supervision
- Thanks Vladimir for help so far !

- ElizabethGallas

- June 15, 2006

## Conclude with Recent Progress

- Lots of user input means we are successful
- complaints mean: have a product people need/use 
- size of the luminosity group == collaboration of testers
- More and better Data Loading (understanding content)
- new lmAccess features, documentation
- new Operations Reports
- March 2, 2006, more complete, 10 x faster (short Runs)
- Need to:
- understand operation and discrepancies
- address performance

- ElizabethGallas

- June 15, 2006