# Presentation: 565407

## CDF Computing

- Robert M. Harris
- CD Projects Briefing
- Feb 12, 2002

## Outline

- Latest Documented Plan is from Run 2 Review
- CDF 5914 “CDF Plan and Budget for Computing in Run 2”
- _[http://cdfsga.fnal.gov/~rharris/cdf5914_computing_plan.ps](http://cdfsga.fnal.gov/~rharris/cdf5914_computing_plan.ps)_
- Here I’ll update the plan for the latest FY03 budget.
- Overview of Computing Sub-Projects
- Central Analysis Farms (CAF)
- Data Handling
- Databases
- Reconstruction Farms
- Central & Desktop Systems

- Robert M. Harris, Fermilab CD/CDF

## CDF 5914: Required Computing

- Lum
- (fb-1)
- 4.1

- 03

- 04

- 05

- 0.3

- Batch
- CPU
- (THz)
- 4.7

- Farm
- CPU
- (THz)

- Static
- Disk
- (TB)
- 540

- Read
- Cache
- (TB)

- Write
- Cache
- (TB)

- Archive
- Volume
- (PB)
- 1.7

- Disk
- I/O
- (GB/s)
- 4.9

- Archive
- I/O
- (GB/s)

- 1.3

- 160

- 46

- 0.48

- 02

- Fiscal
- Year

- 0.9

- 1.3

- 1.6

- 0.5

- 1.0

- 1.4

- 1.8

- 0.37

- 0.33

- 0.54

- 82

- 98

- 160

- 200

**26**

- 28

- 46

- 60

- 0.8

- 0.9

- 1.4

- 1.8

- 0.3

- 0.4

- 0.4

- 0.6

- Robert M. Harris, Fermilab CD/CDF

## Equipment Budget: FY03 Updated

- FY02 spending was achieved by combination of Fermilab & Non-Fermilab sources.
- $2M FY02 base + FY01 carryovers of $0.4M +hardware return of $0.36M + non-Fermilab contribution of $0.48M.
- FY03 – FY05 spending is achieved by Fermilab equipment budget.
- Not included above is operating expenses for tapes & misc.

| FY | CAF
batch
CPU
($M) | Inter-
active
CPU
($M) | Farm
CPU

($M) | DB

($M) | Robot
&
Drives
($M) | Static
Disk

($M) | Cache
Disk

($M) | Net-
Work

($M) | Legacy
System

($M) | Total

($M) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 2002 | 0.59 | 0.07 | 0.22 | 0.02 | 0.77 | 0.47 | 0.16 | 0.25 | 0.69 | 3.24 |
| 2003 | 0.38 | 0.1 | 0.12 | 0.15 | 0.05 | 0.24 | 0.11 | 0.25 | - | 1.40 |
| 2004 | 0.48 | 0.20 | 0.13 | 0.10 | 0.35 | 0.35 | 0.11 | 0.25 | - | 1.97 |
| 2005 | 0.60 | 0.20 | 0.19 | 0.10 | 0.35 | 0.35 | 0.13 | 0.25 | - | 2.17 |

- Robert M. Harris, Fermilab CD/CDF

## CAF: See F. Wurthwein’s Talk

- People
- Head: F. Wurthwein (UCSD & CD/CDF)
- MIT: M. Neubauer, T. Kim.
- CD/CDF: R. Colombo, G. Cooper, R. Jetton,  A.Kreymer, L. Weems.
- Status & Plans
- Stage 1 was clear success with 60 1.3 GHz duals and 30 TB of disk.
- Stage 2 added another 200 1.7 GHz duals and 150 TB disk.
- We have used a subset of this disk and CPUs for winter conferences.
- Need to fix 3ware controller/ WD disk incompatibility or replace fileservers.
- Using all CPUs overwhelmed dCache.  Bringing dCache back slowly.
- Stage 3 purchase on hold until problems with disk & dCache resolved.
- We need help with the fileserver evaluation process for future purchases.
- FY03 Equipment Budget:
- $380K for CPU, $350K for disk.

- Robert M. Harris, Fermilab CD/CDF

## Data Handling: see J. Tseng’s Talk

- People
- Head: Jeff Tseng (MIT & CD/CDF).
- CD/CDF: R. Herber, R. Kennedy, A. Kreymer, D. Litvintsev, E. Wicklund.
- CD/CCF:  B. Alcorn, J. Bakken, D. Petravick, R. Wellner, Enstore-Admin.
- Universities: F. Ratnikov, R. St. Denis, S. Stonjek
- Many data access methods
- Disk Inventory Manager (DIM): in use on fcdfsgi2 only.
- dCache: DIM replacement in use on most central + trailer systems.
- Failed under load. Turned off for CAF during critical analysis period for conferences.
- rootd: server run on central systems for trailer + remote clients.
- SAM: the future CDF DH system now in beta use in trailers + remotely.
- Managing static datasets on CAF is an operational load.
- Used for ICHEP02 last summer and Winter conferences right now.  Needed fallback.
- More effort needed for ops, dCache support, SAM/dCache integration now!
- FY03 Equipment Budget: $50K for various.

- Robert M. Harris, Fermilab CD/CDF

## Databases: See D. Litvintsev’s talk

- People
- Head: Alan Sill (Texas Tech)
- Deputy Head: Dmitry Litvintsev (CD/CDF)
- CD/CDF: R. Herber, R. Jetton,  A. Kreymer, E. Wicklund.
- CD/CSS: A. Kumar, N. Stanfield.
- CD/CEPA: D. Box, Y. Gao, J. Kowalkowski, L. Lebedova, L. Sexton-Kennedy, J. Trumbo, M. Vittone.
- Universities: J. Cranshaw, R. Hughes, Larry Kirsch, D. Waters, Tom Wright.
- Projects & Plans
- Replication using Oracle Streams
- Freeware DBMS
- DB Monitoring and Metering
- Code & Schema Reviews
- SAM
- FY03 Equipment Budget: $150K for DB replicas.

- Robert M. Harris, Fermilab CD/CDF

## Reconstruction Farms

- People:
- Co-Heads: Steve Wolbers (CD/CDF) and Yen-Chu Chen (Taiwan)
- CD: Roman Lysak, G.P. Yeh, Steve Timm, Joseph Syu, Stan Namola
- Plans
- Operating well, continue to run, and CPU as necessary.
- FY03 Equipment Budget: $120K.

- Robert M. Harris, Fermilab CD/CDF

## Central & Desktop Systems

- People
- Co-Heads: F. Wurthwein (UCSD & CD/CDF) R. Harris (CD/CDF)
- MIT: M. Neubauer.
- CD/CDF: Rick Colombo, Glenn Cooper, Jason Harrington, Richard Jetton, Mark Schmitz, Lance Weems.
- Plans
- Interactive linux system (login pool) with shared disk.
- Decommission half of fcdfsgi2 when interactive system in wide use.
- FY03 Equipment Budget
- $250K for all CDF networking.
- $100K for interactive linux system

- Robert M. Harris, Fermilab CD/CDF

## Conclusions

- CDF computing is following the plan in CDF 5914.
- Only commodity systems can provide the required computing.
- Must succeed at commissioning reliable & scalable systems.
- Existing IDE fileservers must be made reliable or disks replaced.
- DH system must be engineered not to fail under increasing load.
- We need more help.

- Robert M. Harris, Fermilab CD/CDF