<!-- Title: Day shift. Tue Dec 20, 2005 -->
<!-- SciCo: Todd Huffman -->
<!-- DAQAce: Dean Hidas -->
<!-- MonAce: Conor Henderson -->
<!-- CO: D. Witson/S. Leone -->
<!-- OpManager: Guram Chlachidze -->
<!-- Notes: -->
<pre>Running  store 4556.</pre>


<!-- Date: Tue Dec 20 07:58:50.939 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-21821&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-21821  width='300' align='top'></a></td><td>Plot bottom middle is RED. Experts mailed.</td></tr></table>
<!-- Author: Aafke Kraan -->

<!-- Date: Tue Dec 20 08:00:05.278 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085">209085</a>
muons: <tt>YMon #34 CSP there seems to be an empty channel which was not present in the referece. Elog entry made and mail sent to experts (guram@fnal.gov).<br>
</tt>
<!-- Author: Consumer Operator(Aafke Kraan) -->


<!-- Date: Tue Dec 20 08:00:06.350 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085">209085</a>
trigger: <tt>1.3.5: L1_SumEt for Run 209085 right plot peaks at different place. Experts mailed and entry in Elog made.<br>
<br>
1.6.1: XTRPMon Summary: Error rate high (>1/10000) in bottom right plot, emailed experts and entry in Elog.<br>
<br>
2.2.2: L2_Tracklist: non zero entries in top left plot. Mail address of experts not present.</tt>
<!-- Author: Consumer Operator(Aafke Kraan) -->


<!-- Date: Tue Dec 20 08:00:07.809 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085">209085</a>
monitors: <tt>Eff_WvsBHperL left top plot not empty. Experts already mailed yesterday.<br>
Object Mon #97 MuonMonitor is RED. Experts mailed.</tt>
<!-- Author: Consumer Operator(Aafke Kraan) -->



<!-- Date: Tue Dec 20 08:00:07.289 2005 -->
D0 Pot is going in. Watch silicon rad. rates.
<!-- Author: Todd -->


<!-- Date: Tue Dec 20 08:03:04.698 2005 -->
L2 Decosion Timeout
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085' target=_top>209085</a>) -->
<!-- Comment: Tue Dec 20 08;05;22 comment by...Dean -->
Another
<!-- Comment: Tue Dec 20 08;09;34 comment by...Dean -->
Another
<!-- Comment: Tue Dec 20 08;14;25 comment by...Dean -->
Another
<!-- Comment: Tue Dec 20 08;26;35 comment by...Dean -->
Another
<!-- Comment: Tue Dec 20 08;32;40 comment by...Dean -->
Another
<!-- Comment: Tue Dec 20 08;34;35 comment by...Dean -->
On this last HRR the L2TO did not clear.  Another HRR fixed this.
<!-- Comment: Tue Dec 20 08;41;08 comment by...Dean -->
Another
<!-- Comment: Tue Dec 20 09;20;47 comment by...Dean -->
Another
<!-- Comment: Tue Dec 20 09;34;57 comment by...Dean -->
Another. "DecIsion Timeout" actually
<!-- Comment: Tue Dec 20 09;35;45 comment by...Dean -->
Another
<!-- Comment: Tue Dec 20 09;40;54 comment by...Dean -->
Another
<!-- Comment: Tue Dec 20 10;36;08 comment by...Dean -->
L2 DT have been continuing at the same rate.  This last Auto-HRR one didn't recover the L2TO.  A second HRR cleared it.
<!-- Date: Tue Dec 20 08:03:14.525 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-21822&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-21822' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-21823&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-21823' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-21824&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-21824' width='300'></a></center>
<!-- Author: Salvador -->
<!-- Comment: Tue Dec 20 08;03;36 comment by...Salvador -->
Current hourly ACNET plots



<!-- Date: Tue Dec 20 08:08:29.766 2005 -->
Consumer Error: CER_SVXMON_HALT_RECOVER_RUN_ERROR. 
stuck called S/B3/W7/L2/CS-9 
Auto HRR
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085' target=_top>209085</a>) -->




<!-- Date: Tue Dec 20 08:19:11.284 2005 -->
Busy Timeout
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085' target=_top>209085</a>) -->
<!-- Comment: Tue Dec 20 09;04;15 comment by...Dean -->
Another
<!-- Comment: Tue Dec 20 10;19;35 comment by...Dean -->
Another
<!-- Comment: Tue Dec 20 10;34;43 comment by...Dean -->
Another
<!-- Date: Tue Dec 20 08:37:16.202 2005 -->
Flying Wire
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085' target=_top>209085</a>) -->
<!-- Comment: Tue Dec 20 09;37;17 comment by...Dean -->
Again
<!-- Comment: Tue Dec 20 10;37;28 comment by...Dean -->
#3.
<!-- Comment: Tue Dec 20 11;36;57 comment by...Dean -->
#4
<!-- Date: Tue Dec 20 09:01:30.028 2005 -->
Done Timeout from pcal11.  HRR, but pcal11 was then stuck with target state Halted.  Shepherd it and we're back taking data.
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085' target=_top>209085</a>) -->



<!-- Date: Tue Dec 20 09:14:21.408 2005 -->
ICICLE PC has not been backed up since 1 Dec.
<!-- Author: Conor -->



<!-- Date: Tue Dec 20 09:22:15.569 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-21825&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-21825' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-21826&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-21826' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-21827&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-21827' width='300'></a></center>
<!-- Author: Conor -->
<!-- Comment: Tue Dec 20 09;22;43 comment by...Conor -->
Hourlies. Losses are very low.


<!-- Date: Tue Dec 20 09:28:18.887 2005 -->
<pre>Kaori is trying to be a "remote CO" from WH11 this morning for 
a short while.  Plan is to do a little longer CO shift from 
WH11 this afternoon between 2 - 4 pm. 
IP address for the polycom connection at WH11 is 131.225.56.161. 
The phone extention #s are: 4955 and 4964. </pre>
<!-- Author: kaori -->
<!-- Comment: Tue Dec 20 09;32;48 comment by...kaori -->
<pre>Todd and Kaori tested the video connection between B0 and WH11.
It worked fine.  We are set for an afternoon remote CO shift.</pre>



<!-- Comment: Tue Dec 20 09;35;55 comment by...Todd Huffman -->
<pre>Initial test was pretty smooth but here are some tips.

1). The PC's MUST be on AC power not running on the battery. The reason is that the power saving software will slow the processor down and this prevents the video connection from forming.

2). You must turn on the camera before starting the video program so that the program can upload to the camera.

3). If you have problems with the program you have to shut the camera off and turn it back on as well to clear the old download out of the camera.

4). Use the ethernet cable for the IP connection, do not use wireless as the bandwidth might be too slow.

5). try to keep the camera away from the laptop as the microphone is in the camera. This will help prevent feedback.

6). The system seems to only connect to IP addresses directly. this is likely because it hasn't been registered with the ad-hoc ESnet hub??? (But I do not know this for sure).</pre>




<!-- Date: Tue Dec 20 09:54:50.498 2005 -->
b0dap57 rebooted.  It didn't crash/freeze, it just randomly restarted/reset.  One second I was typing, the monitors flashed, and it was rebooting.  Restarted DQMon and everything is back now...
<!-- Author: Dean -->
<!-- Comment: Tue Dec 20 09;58;16 comment by...Dean -->
Ah, it appears it was just the x-server which crashed.
<!-- Date: Tue Dec 20 09:55:57.610 2005 -->
Done Timeout for cot06.  cleared by HRR.
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085' target=_top>209085</a>) -->






<!-- Date: Tue Dec 20 10:25:52.047 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-21828&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-21828' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-21829&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-21829' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-21830&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-21830' width='300'></a></center>
<!-- Author: Conor -->
<!-- Comment: Tue Dec 20 10;26;11 comment by...Conor -->
Hourlies

<!-- Date: Tue Dec 20 10:26:34.676 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085">209085</a>
monitors: <tt>Silimon L00 plot not empty. Posted in elog and experts mailed yesterday. <br>
CMX zstub also red.  Already in elog. </tt>
<!-- Author: Consumer Operator( Daniel Whiteson) -->






<!-- Date: Tue Dec 20 11:10:04.460 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-21831&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-21831  width='300' align='top'></a></td><td>Pinky: S_DVDD_B2W9L1</td></tr></table>
<!-- Author: Conor -->
<!-- Comment: Tue Dec 20 11;11;00 comment by...Conor -->
Turned green again after unmarking



<!-- Date: Tue Dec 20 11:38:35.264 2005 -->
<pre>I express my thanks to the monitoring Ace who power cycled the 
TDC diagnostic crate for me, after it repeatedly hung after 
being rebooted/reset.</pre>
<!-- Author: M Jones -->
<!-- Comment: Tue Dec 20 11;41;09 comment by...Conor -->
Happy to help


<!-- Date: Tue Dec 20 12:10:31.777 2005 -->
Inhibit from TOF HV.  PSM alarm sounded - EndWall.  recovered and back takig data.
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085' target=_top>209085</a>) -->

<!-- Date: Tue Dec 20 12:42:10.742 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085">209085</a>
 Terminated at 2005.12.20 12:41:28
<!-- Author: RunControl -->


<!-- Date: Tue Dec 20 12:42:41.015 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085">209085</a>
TERMINATE: Reset due to evb2b error state
<!-- Author: Dean x2080 -->


<!-- Date: Tue Dec 20 12:51:29.435 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209102">209102</a>
 Activated at 2005.12.20 12:49:32
<!-- Author: RunControl -->


<!-- Date: Tue Dec 20 12:51:30.282 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209102">209102</a>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_3_07 [2,725,597] 
<!-- Author: Dean x2080 -->



<!-- Date: Tue Dec 20 12:55:31.067 2005 -->
<pre>EVB problem in SCPU 14:  
we had a data transfer problem in SCPU 14 and EVB proxy got stuck while doing a HRR. We had to reset the run and also reset the SCPU. 
We are back running ...</pre>
<!-- Author: markus  -->


<!-- Date: Tue Dec 20 13:03:36.049 2005 -->
We first got messages from TevMon telling us that TevMon was failing to receive Acnet messages via the RTserver.  Then we got an error from procmon for the RTserver.  Check of the RTserver in procmon showed 1 FIN_WAIT which went away in a minute or so after which the RT server was fine, but TevMon was still not updating.  We restarted the Acnet monitor from procmon.  TevMon started updating again and we were back top taking data. 
(this was ~12:13)
<!-- Author: Dean & Conor :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085' target=_top>209085</a>) -->
<!-- Comment: Tue Dec 20 13;45;24 comment by...Dean -->
Clarification: with the RTserver/FIN_WAIT problems we were actually taking data the whole time.  Acnet plots were looking good.
<!-- Date: Tue Dec 20 13:09:16.494 2005 -->
At ~12:22 we had many Busy Timeouts, a TM2 Events Pending Timeout Error, and RXPT Errors LOOP. 
 
A bit after this we had another busy TO. evb2b didn't make the HRR transition from Halted to Recovered.  markus and conor were on hand to take care of the problems with evb.
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085' target=_top>209085</a>) -->


<!-- Date: Tue Dec 20 13:13:57.638 2005 -->
L2 Decision Timeout
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209102' target=_top>209102</a>) -->
<!-- Comment: Tue Dec 20 13;14;17 comment by...Dean -->
another


<!-- Date: Tue Dec 20 13:15:13.262 2005 -->
Also got done timeouts from SVT_TRACKING_02 and 03 at 12:49:36
<!-- Author: Dean -->

<!-- Date: Tue Dec 20 13:22:31.195 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209102">209102</a>
 Terminated at 2005.12.20 13:21:39
<!-- Author: RunControl -->


<!-- Date: Tue Dec 20 13:22:32.495 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209102">209102</a>
TERMINATE: MCR is moving the waist.  we'll start a new run when they are done.
<!-- Author: Dean x2080 -->


<!-- Date: Tue Dec 20 13:22:34.380 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209102">209102</a>
TERMINATE: MCR is moving the waist.  we''ll start a new run when they are done.
<!-- Author: Dean x2080 -->
<!-- Comment: Tue Dec 20 13;31;24 comment by...Dean -->
why is this here twice?
<!-- Comment: Tue Dec 20 13;47;06 comment by...Conor -->
why is this here twice?
<!-- Date: Tue Dec 20 13:28:33.358 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-21832&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-21833  width='300' align='top'></a></td><td>Same cell as before went pink again.</td></tr></table>
<!-- Author: Conor -->




<!-- Date: Tue Dec 20 13:46:54.215 2005 -->
<pre>The MCR have claimed to move our waist point a couple of cm to try to put the luminous region more centered in the detector. 
 
A new run is started in order to check the difference.</pre>
<!-- Author: Todd -->
<!-- Comment: Tue Dec 20 14;07;17 comment by...Willis -->
<p>For reference, the waist point prior to run 209106 has been        
   about z=+1.9cm or so (from the BeamMon COT track only Zvtx
   distribution), and about the same in the x and y planes.
</p>
<!-- Date: Tue Dec 20 13:49:50.887 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106">209106</a>
 Activated at 2005.12.20 13:49:38
<!-- Author: RunControl -->


<!-- Date: Tue Dec 20 13:49:51.247 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106">209106</a>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_3_07 [2,725,597] 
<!-- Author: Dean x2080 -->



<!-- Date: Tue Dec 20 13:51:19.151 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-21834&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-21834' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-21835&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-21835' width='300'></a></center>
<!-- Author: guram -->
<!-- Comment: Tue Dec 20 13;52;15 comment by...Guram -->
These are plots with beam position in run 209102, i.e. before
moving the beam
<!-- Comment: Tue Dec 20 13;59;43 comment by...Todd -->
<pre>Please put the 'after' plots in this same place. Not at the end of the shift log.</pre>
<!-- Comment: Tue Dec 20 14;19;58 comment by...guram -->
Probably we need to look at the file with more statistic for this
comparison.
<!-- Date: Tue Dec 20 13:51:26.463 2005 -->
At beginning of run with 1 L2A, 0 L3A got a done timeout: SVT_TRACKING_02
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106' target=_top>209106</a>) -->




<!-- Date: Tue Dec 20 14:00:25.741 2005 -->
Halted for TOF trip.  This seems to be the same issue we had yesterday.  We paged the expert.
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106' target=_top>209106</a>) -->
<!-- Comment: Tue Dec 20 14;18;24 comment by...Conor -->
Stefano gave me instructions on how to get TOF running again. He is going to look at the crate which is giving the problems



<!-- Date: Tue Dec 20 14:31:33.702 2005 -->
DQMon complained about bad CMP plot, but it cleared itself pretty fast.
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106' target=_top>209106</a>) -->


<!-- Date: Tue Dec 20 14:33:17.874 2005 -->
three L3 Reformatter error windowns.  We've continued, like the previous shift, to get reformatter errors throughout the day.  If it becomes more of a problem I'll note the increased rate.
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106' target=_top>209106</a>) -->


<!-- Date: Tue Dec 20 14:36:09.149 2005 -->
SVXMon missing error.  I restarted SVXMon while the CO was in transit to the (super secret?) remote CO location.
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106' target=_top>209106</a>) -->


<!-- Date: Tue Dec 20 14:37:16.093 2005 -->
Flying Wire!
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106' target=_top>209106</a>) -->


<!-- Date: Tue Dec 20 14:48:34.112 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-21836&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-21836  width='300' align='top'></a></td><td>COT z position</td></tr></table>
<!-- Author: Daniel Whiteson -->


<!-- Date: Tue Dec 20 14:50:31.404 2005 -->
L2 Decision Timeout
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106' target=_top>209106</a>) -->


<!-- Date: Tue Dec 20 14:53:30.795 2005 -->
Busy Timeout
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106' target=_top>209106</a>) -->

<!-- Date: Tue Dec 20 14:56:07.820 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106">209106</A>
 Terminated at 2005.12.20 14:55:40
<!-- Author: RunControl -->


<!-- Date: Tue Dec 20 14:56:48.217 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106">209106</A>
TERMINATE: reset due to evb2b error.  this looked the same as what we had earlier from the RC point of view
<!-- Author: Dean x2080 -->



<!-- Date: Tue Dec 20 15:01:23.510 2005 -->
Many Busy Timeouts in a row.  Several HRRs. On a second-in-a-row HRR evb2b again was stuck in Halted with target state Recovered.  We had to Reset the run.  Apparently it does not show up in the SCPUs check here right away, but b0evem14 couldn't be reached.
<!-- Author: Dean :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106' target=_top>209106</a>) -->
<!-- Comment: Tue Dec 20 15;02;37 comment by...Dean -->
The CPU check didn't show the problem until we reset and tried to partition again.  When it failed partitioning it showed up in the SCPU check.


<!-- Date: Tue Dec 20 15:08:36.598 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-21837&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-21837  width='300' align='top'></a></td><td>Dead channels in CCR</td></tr></table>
<!-- Author: Daniel Whiteson -->


<!-- Date: Tue Dec 20 15:38:29.410 2005 -->
<pre>While debugging the problem with SCPU 14 from earlier today we saw the problem again. It turns out that the SCPU was not able to access the VME anymore. We did a reset of the board and a power cycle of the crate which did not help after which the board failed to even reboot properly. We swapped the same SCPU to a second adapter card in the crate which seems to work fine. We will remove and inspect the adapter card at the next opportunity.  
 
All this was done within 20min but we fail to restart a run, first due to RC being stuck and right now because xtrp is not willing to configure.</pre>
<!-- Author: markus -->


<!-- Date: Tue Dec 20 15:46:24.108 2005 -->
<pre> Not loading Ram Pipe FPGA Algorithms....  
         doing even/odd pipes ???....  
 
 Loading even Pipe in all needed data boards....  
Configuring FPGA...sel - 55 in data board 0 
Configuring FPGA...sel - 55 in data board 1 
Configuring FPGA...sel - 55 in data board 2 
Configuring FPGA...sel - 55 in data board 3 
Configuring FPGA...sel - 55 in data board 4 
Configuring FPGA...sel - 55 in data board 5 
Configuring FPGA...sel - 55 in data board 6 
Configuring FPGA...sel - 55 in data board 7 
Configuring FPGA...sel - 55 in data board 8 
Configuring FPGA...sel - 55 in data board 9 
Configuring FPGA...sel - 55 in data board 10 
Configuring FPGA...sel - 55 in data board 11 
 
 Loading odd Pipe in all needed data boards....  
Configuring FPGA...sel - aa in data board 0 
Configuring FPGA...sel - aa in data board 1 
Configuring FPGA...sel - aa in data board 2 
Configuring FPGA...sel - aa in data board 3 
Configuring FPGA...sel - aa in data board 4 
Configuring FPGA...sel - aa in data board 5 
Configuring FPGA...sel - aa in data board 6 
Configuring FPGA...sel - aa in data board 7 
Configuring FPGA...sel - aa in data board 8 
Configuring FPGA...sel - aa in data board 9 
Configuring FPGA...sel - aa in data board 10 
Configuring FPGA...sel - aa in data board 11 
XtrpDataBoard loading BC, L1 delays and setting board/wedge ids  
 
 Turning clock on and doign few settings...  
Resetting default fractional prescale value of 2  
XTRP_setFractionalPrescale(add 0x9005c) (new 2,old 2 ) success; event 0 
</pre>
<!-- Author: W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209122' target=_top>209122</a>) -->


<!-- Date: Tue Dec 20 15:48:05.459 2005 -->
Remote CO experience: 
I was remote CO for 2 hours this afternoon.    90% of the C0 tasks were easy -- detector checklist, etc -- from the remote site. 10% were difficult or impossible: 
- check to see if the HV is ok [ had to ask SciCo to do it ] 
- look at histodisplay [ had to run remotely -- slow ] 
- (re)start consumers/displays  
- follow what's happening in CR -- needed help from SciCo. 
  
<!-- Author: Daniel -->
<!-- Comment: Tue Dec 20 18;39;40 comment by...Charles Plager -->
We aren't going to ask remote C.O.s to run HistoDisplay (it will be <b>way</b> too slow).  They ought to be able to do everything on the web.
<!-- Date: Tue Dec 20 15:48:52.394 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209122">209122</A>
TERMINATE: Never activated
<!-- Author: Dean x2080 -->


<!-- Date: Tue Dec 20 15:55:14.829 2005 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>Physics able</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L1Accepts</TH>
<TH>L2Accepts</TH>
<TH>L3Accepts</TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209085 target=_blank>209085</A> x330BD</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_3_07 [2,725,597]</FONT></TD>
<TD ALIGN=CENTER>01:50:03</TD>
<TD ALIGN=CENTER>12:41:28</TD>
<TD ALIGN=CENTER>09:35:00</TD>
<TD ALIGN=RIGHT>    826,258,602</TD>
<TD ALIGN=RIGHT>    11,085,228</TD>
<TD ALIGN=RIGHT>   2,947,571</TD>
<TD ALIGN=RIGHT> 1747.081</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209102 target=_blank>209102</A> x330CE</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_3_07 [2,725,597]</FONT></TD>
<TD ALIGN=CENTER>12:49:32</TD>
<TD ALIGN=CENTER>13:21:39</TD>
<TD ALIGN=CENTER>00:25:43</TD>
<TD ALIGN=RIGHT>     24,018,227</TD>
<TD ALIGN=RIGHT>       289,431</TD>
<TD ALIGN=RIGHT>      92,401</TD>
<TD ALIGN=RIGHT>   47.124</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209106 target=_blank>209106</A> x330D2</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_3_07 [2,725,597]</FONT></TD>
<TD ALIGN=CENTER>13:49:38</TD>
<TD ALIGN=CENTER>14:55:40</TD>
<TD ALIGN=CENTER>00:43:39</TD>
<TD ALIGN=RIGHT>     38,568,079</TD>
<TD ALIGN=RIGHT>       503,168</TD>
<TD ALIGN=RIGHT>     154,952</TD>
<TD ALIGN=RIGHT>   74.078</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>15:55:00</TD>
<TD ALIGN=CENTER>10:44:23</TD>
<TD ALIGN=RIGHT>     888,844,908</TD>
<TD ALIGN=RIGHT>     11,877,827</TD>
<TD ALIGN=RIGHT>     3,194,924</TD>
<TD ALIGN=RIGHT> 1868.282</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Dec 20 15:55:20.995 2005 -->
<pre>b0xtrp00-&gt; tt Messenger 
2e66c8 vxTaskEntry    +68 : FER_messenger () 
1ec69310 FER_messenger  +2c4: 1ec3d778 () 
1ec3d778 FER_smartInitMS+26c8: TipcSrvMsgProcess (1ecb1920) 
23163c TipcSrvMsgProcess+d8 : 22e914 (1ece9100, 1ecb1920) 
22ec38 TipcSrvSubjectCbCreate+8c0: TutCbListCall (1ecb1a00, 1ece9100, 1ed689c8) 
126574 TutCbListCall  +158: 1ec45c2c () 
1ec45cec FER_processReadoutListCallout+5538: 1ec41ae4 () 
1ec41ae4 FER_processReadoutListCallout+1330: FER_coldstart () 
1ec70d48 FER_coldstart  +a0 : 1ec6e470 () 
1ec6e470 FER_init       +4b0: 1ec77468 () 
1ec77468 TRIG_coldstart +67c: XTRP_coldstart () 
1ec95c28 XTRP_coldstart +20 : 1ec8f2c0 () 
1ec8f2c0 XTRP_init      +20d0: xtrp_mapInit () 
1eaeb340 xtrp_mapInit   +150: readPara () 
1eaed0ac readPara       +78 : fopen () 
2995f8 fopen          +4c : open () 
2a6c88 open           +14 : 2a6c98 () 
2a6dd4 open           +160: iosOpen () 
2a8624 iosOpen        +44 : 2751d8 () 
2755ac netDevCreate2  +b48: 27670c () 
276a8c netLsByName    +bf8: read () 
2a7208 read           +5c : iosRead () 
2a87f4 iosRead        +c8 : 2683c0 () 
268440 bsdRecv        +1c4: soreceive () 
261764 soreceive      +32c: sbwait () 
262ea0 sbwait         +d4 : ksleep () 
264118 ksleep         +68 : semTake () 
2dae78 semTake        +13c: semBTake () 
</pre>
<!-- Author: badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209123' target=_top>209123</a>) -->
<!-- Comment: Tue Dec 20 16;13;44 comment by...badgett -->
<pre>This was the last action I caught before the Messenger 
task exited.   My guess is that the XTRP code is 
trying to "fopen" a file that is not on one of the two 
NFS mounted disks (/cdf/onln/data or /cdf/onln/code)
This is always a touchy thing to do -- sometimes works, sometimes 
does not...      We need to comb thru the code.</pre>
<!-- Date: Tue Dec 20 16:10:21.414 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209123">209123</A>
 Activated at 2005.12.20 16:10:02
<!-- Author: RunControl -->


<!-- Date: Tue Dec 20 16:10:22.401 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=209123">209123</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_3_07 [2,725,597] 
<!-- Author: Sarah x2080 -->




<!-- Date: Tue Dec 20 16:17:26.391 2005 -->
<font color=red>Shift Summary: </font><pre>*** Day Shift 12/18/05 ***  
  
08:00 Taking Data  
      Store 4556  
  
13:40 MCR calls and requests to move the waist more to the center  
      of CDF. We agree. Silicon brought to standby. No indication   
      of significant additional losses in the protons while the   
      process was going on.  
  
13:50 New run started 209106  
  
14:05 TOF trip. Yesterday we were told by TOF expert to touch   
      touch nothing. Expert now paged.  
  
14:52 Remote CO shift is in progress. He has posted the final plot   
      showing some possible effect on the mean position of the   
      luminous region.  
  
      Before:   Number of events: 60289  
		Mean: 1.132 cm  
		RMS:  27.65 cm  
  
      After:	Number of events:  5287  
		Mean: -0.0077 cm  
		RMS:    27.18 cm  
  
15:50 Problems with the XTRP. Crate reset. Bill Badget helping with  
      run control and I don't know exactly why, so I'll rely on   
      filler from people at the 8am meeting.  
  
16:00 Remote CO shift commentary:  
      We started a full remote CO shift around 2:30pm. The connection   
      went well due to our previous set-up efforts (Todd and Kaori).  
      The CO was able to enter plots in the e-log. We checked several runs,   
      exchanged views on their relative merits as we would in a real shift.  
      The connection was muted most of the time.   
      The shift ran well but I can see some potential problems:  
      This shift was handled by an attentive CO because it was something   
      new and he had few distractions. In a real remote situation the CO   
      and the SciCo will need discipline in order to keep one another informed   
      when they have to go out of ear-shot over the video link.   
      Phone contact numbers will be a must.   
      In this vein it will be necessary to allow the control room phone to  
      call overseas. We will need to have available the cost-code so that   
      we can make such calls if required.   
  
      My final summary is that I think this can work. I think it will be   
      an excellent alternative to the 'live' CO shift if a modicum of   
      structure can be developed. The structure needs to be such that it   
      forces the SciCo and CO to pay attention and communicate, but it   
      should not be so onerous as to be burdensome.  
  
End of Day Shift summary   
  
Store 4555 colliding   
End of Shift Numbers:   
  
Run     = 209106   
B0PLOS  =   7 Hz   
B0APLOS =  60 Hz    
TevPR   = 5006e09   
TevPB   =  620e09   
B0ILUM  = 25.5e30   
B0PAGC  =  391 Hz   
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   209085,102,106
Delivered Luminosity   959.7  
Acquired Luminosity    661.7  
Efficiency             68.8
   
</td></tr></table></pre>
<!-- Author: Todd Huffman -->