# Presentation: 858376

## fcdfdata016

- Disk/Cache

- Station
- central-analysis
- smaster

- Stager
- stagerng

- FSS
- central-analysis
- fss

- Stager
- stagerng

- Disk/Cache

- Disk/Cache

- Disk/Cache

- Stager
- stagerng

- Stager
- stagerng

- Stager
- stagerng

## Node1

- Cache

- Node2

- Cache

- Node3

- Cache

- Node4

- Cache

- Node5

- Cache

- Station
- smaster

- Stager
- stagerng

- Stager
- stagerng

- Stager
- stagerng

- Stager
- stagerng

- Stager
- stagerng

## fcdfdata016

- <fcdfdata016>

- Disks/Cache

## fcdfdata016

- <fcdfdata016>

- Station
- central-analysis
- smaster

- Disks/Cache

## fcdfdata016

- <fcdfdata016>

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

## sam dump station --disks

- <nglas08> sam dump station --disks
- *** BEGIN DUMP STATION chris version v3_2_2 running at nglas08 53 minutes 25 seconds, admins: jozwiak terekhov
- Known batch systems: lsf
- Default batch system: lsf
- No replica selection criteria
- There are 0 authorized transfer groups
- Minimum delivery is 1KB; external deliveries are unconstrained
- STATION DISKS:
- disk 7844 nglas08.fnal.gov:/sam/test9/jozwiak/dev/chris, 29947KB/20GB free
- disk 8064 nglas08.fnal.gov:/sam/test10/jozwiak/dev/chris, 93110KB/20GB free
- *** END OF STATION DUMP ***

## sam dump station --groups

- *** BEGIN DUMP STATION chris version v3_2_2 running at nglas08 57 minutes 3 seconds, admins: jozwiak terekhov
- Known batch systems: lsf
- Default batch system: lsf
- No replica selection criteria
- There are 0 authorized transfer groups
- Minimum delivery is 1KB; external deliveries are unconstrained
- AUTHORIZED GROUPS:
-  group test: admins: jozwiak , swap policy: LRU, fair share: 0, quotas (cur/max): projects = 0/150, disk: 13054803KB/40GB, locks:0B/0KB
-  group test1: admins: jozwiak , swap policy: LRU, fair share: 0, quotas (cur/max): projects = 0/40, disk: 1714466KB/30GB, locks:0B/0KB
-  group test2: admins: jozwiak , swap policy: LRU, fair share: 0, quotas (cur/max): projects = 0/50, disk: 7170234KB/40GB, locks:0B/0KB
- *** END OF STATION DUMP ***

## sam dump station --projects

- *** BEGIN DUMP STATION chris version v3_2_2 running at nglas08 1 hours 4 minutes 49 seconds, admins: jozwiak terekhov
- Known batch systems: lsf
- Default batch system: lsf
- No replica selection criteria
- There are 0 authorized transfer groups
- Minimum delivery is 1KB; external deliveries are unconstrained
- PROJECT MANAGER: fileReleaseTO = 1 days, max files given to project: Unlimited
- NO PROJECTS
- *** END OF STATION DUMP ***

## fcdfdata016

- <fcdfdata016>sam submit
- --script=userscript
- --group=groupname
- --cpu-per-event=
- --defname=

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

## fcdfdata016

- <fcdfdata016>
- >>>>>> Starting project with
- the Station Master
- Station Master contacted, result:
-  Started project 49008
- (49008_sam_) for group test
- Waiting for the project to
- initialize...

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

## fcdfdata016

- <fcdfdata016>
- Callback from server:
- 'OK|Project is ready'

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

## fcdfdata016

- <fcdfdata016>
- >>>>>> Submitting the job to
- the batch system.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user> PSUSP

## Sam dump station --projects

- *** BEGIN DUMP STATION chris version v3_2_2 running at nglas08 1 hours 12 minutes 44 seconds, admins: jozwiak terekhov
- Known batch systems: lsf
- Default batch system: lsf
- No replica selection criteria
- There are 0 authorized transfer groups
- Minimum delivery is 1KB; external deliveries are unconstrained
- PROJECT MANAGER: fileReleaseTO = 1 days, max files given to project: Unlimited
- STATION PROJECTS:
- project 49205_sam_(49205) user jozwiak.test started 01 Nov 14:08:45 UNIX pid 158400787 still wants/currently uses 5/0 files
- *** END OF STATION DUMP ***

## sam dump project –project=<project name>

- *** BEGIN GPM DUMP ***
- Input files: 1003853..1011900
-   1003853: sim.ztautau.1000evts.017-1442-c5.01, size=0K, unbuffered yet
-   1003854: sim.ztautau.1000evts.017-1442-c5.02, size=0K, unbuffered yet
-   1011651: sim.pmc02_01.pythia.ztautau_mb1.1av_200evts.267_1553, size=0K, unbuffered
-   1011900: sim.pmc02_01.pythia.ztautau_mb1.1av_200evts.276_1152, size=0K, unbuffered
- Cached (not buffered) files: (none)
- Buffered files: (none)
- External files with delivery problems: (none)
- Umer contexts (name, state, join time, nSeen): (no umers)
- Proc contexts (ID: name, state, join time [, current|last]): (no procs)
- Processes waiting for call back:(none)
- *** END GPM DUMP ***

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user> PSUSP

- Optimizer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user> PSUSP

- eworker

- eworker

- eworker

- eworker

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user> PSUSP

- eworker

- eworker

- eworker

- eworker

- encp

- encp

- encp

- encp

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user> PSUSP

- eworker

- eworker

- eworker

- eworker

- encp

- encp

- encp

- encp

- Enstore

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user> PSUSP

- eworker

- eworker

- eworker

- eworker

- encp

- encp

- encp

- encp

- Enstore

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user> PSUSP

- eworker

- eworker

- eworker

- eworker

- encp

- encp

- encp

- encp

- Enstore

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  PSUSP

- eworker

- eworker

- encp

- encp

- Enstore

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- eworker

- eworker

- encp

- encp

- Enstore

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- eworker

- eworker

- encp

- encp

- Enstore

- samscript.sh

- userscript

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- eworker

- eworker

- encp

- encp

- Enstore

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- eworker

- eworker

- encp

- encp

- Enstore

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- eworker

- eworker

- encp

- encp

- Enstore

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- eworker

- eworker

- encp

- encp

- Enstore

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- eworker

- eworker

- encp

- encp

- Enstore

- samscript.sh

- userscript

- consumer

## SAMManager:sam  Getting next input file...

- SAMManager:sam  Project master will call back.

## Sam dump project –project=49225_sam_

- *** BEGIN GPM DUMP ***
- Input files: 1099393..1099756
-   1099417: d0g.test_file_1G_a_dev.0001_001, size=0K, unbuffered yet
-   1099418: d0g.test_file_1G_a_dev.0002_001, size=0K, unbuffered yet
- Cached (not buffered) files: (none)
- Buffered files: (none)
- External files with delivery problems: (none)
- Umer contexts (name, state, join time, nSeen):
-   36422: jozwiak(test-harness:1), active, 05 Nov 13:59:09, 31
- Proc contexts (ID: name, state, join time [, current|last]):
-   144663: jozwiak(test-harness:1)@nglas08, wait, 05 Nov 13:59:10, 1099415
- Processes waiting for call back:
-   CID=36422: 144663@nglas08.fnal.gov:11872 (05 Nov 20:53:43)
- *** END GPM DUMP ***

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- eworker

- eworker

- encp

- encp

- Enstore

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- eworker

- eworker

- encp

- encp

- Enstore

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

- rm

- rm

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

- Optimizer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

- eworker

- eworker

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

- eworker

- eworker

- rcp

- rcp

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

- eworker

- eworker

- rcp

- rcp

- Other Cache

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

- eworker

- eworker

- rcp

- rcp

- Other Cache

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

- eworker

- eworker

- rcp

- rcp

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>
- Job <52554> is submitted to
- queue <sam_lo>.

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)
- 52554 <user>  RUN

- samscript.sh

- userscript

- consumer

## fcdfdata016

- <fcdfdata016>

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Project
- pmaster

- Batch (LSF)

## fcdfdata016

- <fcdfdata016>

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Batch (LSF)

## fcdfdata016

- <fcdfdata016>sam submit....
- <fcdfdata016>sam submit....
- <fcdfdata016>sam run project...

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Batch (LSF)

## fcdfdata016

- <fcdfdata016>

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Batch (LSF)
- 52668 <user1> RUN
- 52675 <user2> RUN
- 52756 <user3> PSUSP

- Project
- pmaster

- Project
- pmaster

- Project
- pmaster

- samscript.sh

- samscript.sh

- userscript

- userscript

- consumer

- consumer

- eworker

- eworker

- rcp

- encp

- Other Cache

- Enstore

## fcdfdata016

- <fcdfdata016>

- Station
- central-analysis
- smaster

- Disks/Cache

- Stager
- stagerng

- Batch (LSF)
- 52668 <user1> RUN
- 52675 <user2> RUN
- 52756 <user3> PSUSP

- Project
- pmaster

- Project
- pmaster

- Project
- pmaster

- samscript.sh

- samscript.sh

- userscript

- userscript

- consumer

- consumer

- eworker

- eworker

- rcp

- encp

- Other Cache

- Enstore

## fcdfdata016

- <fcdfdata016>

- Disks

- FSS
- Central-analysis
- fss

- Stager
- stagerng

## Sam dump fss

- FSS version v3_2_2 at station central-analysis running on fcdfdata016.fnal.gov 6 hours 57 minutes 34 seconds
- No routing (all transfers are direct)
- Configuration for operation retrial (count, interval/timeout)
- DBS contact: 3, 1 hours
- Opter contact: 1, 1 hours
- Authorization receipt:1, 1 hours
- Stager contact: 1, 1 hours
- Transfer (retrials upon timeout and upon failure): 3, 6 hours
- Relay (multi-stage routing only): 3, 1 hours
- File Storage Server Dump:
- Stagers are known at nodes: fcdfdata016.fnal.gov
- No requests ever submitted

## fcdfdata016

- <fcdfdata016>sam store
- descrip.py
- --source=<file loc>
- [--dest=/pnfs.....]

- Disks

- FSS
- Central-analysis
- fss

- Stager
- stagerng

## fcdfdata016

- <fcdfdata016>sam store
- descrip.py
- --source=<file loc>
- [--dest=/pnfs.....]

- Disks

- FSS
- Central-analysis
- fss

- Stager
- stagerng

- Descrip.py

- Metadata
- Info about file

- Sam checks info,
- checks location,

## fcdfdata016

- <fcdfdata016>sam store
- descrip.py
- --source=<file loc>
- [--dest=/pnfs.....]

- Disks

- FSS
- Central-analysis
- fss

- Stager
- stagerng

- eworker

- encp, rcp,
- bbftp

## Enstore

- Far Away

- Disk

- Fss
- From Really
- Far Away

- Stager

- fcdfdata016

- Fss
- central-analysis

- Stager

- Tmp Disk

## Enstore

- Far Away

- Disk

- Fss
- Routing:
- fcdfdata016

- Stager

- fcdfdata016

- Fss
- central-analysis

- Stager

- Tmp Disk

- sam store      enstore

## Enstore

- Far Away

- Disk

- Fss
- Routing:
- fcdfdata016

- Stager

- fcdfdata016

- Fss
- central-analysis

- Stager

- Tmp Disk

- eworker

- bbftp         fcdfdata016

## Enstore

- Far Away

- Disk

- Fss
- From really
- Far away

- Stager

- fcdfdata016

- Fss
- central-analysis

- Stager

- Tmp Disk

- eworker

- bbftp         fcdfdata016

## Enstore

- Far Away

- Disk

- Fss
- From really
- Far away

- Stager

- fcdfdata016

- Fss
- central-analysis

- Stager

- Tmp Disk

## Enstore

- Far Away

- Disk

- Fss
- From really
- Far away

- Stager

- fcdfdata016

- Fss
- central-analysis

- Stager

- Tmp Disk

- eworker

- encp

## Enstore

- Far Away

- Disk

- Fss
- From really
- Far away

- Stager

- fcdfdata016

- Fss
- central-analysis

- Stager

- Tmp Disk

- eworker

- encp

## Enstore

- Far Away

- Disk

- Fss
- From really
- Far away

- Stager

- fcdfdata016

- Fss
- central-analysis

- Stager

- Tmp Disk

- rm

## Enstore

- Far Away

- Disk

- Fss
- From really
- Far away

- Stager

- fcdfdata016

- Fss
- central-analysis

- Stager

- Tmp Disk