<!-- Title: Day shift. Sat Aug 23, 2008 -->
<!-- SciCo: K. Hara -->
<!-- DAQAce: Andreas Schmidt -->
<!-- MonAce: Yoshikazu Nagai -->
<!-- CO: Toru Okusawa -->
<!-- OpManager: &nbsp; -->
<!-- Notes: -->
<pre>colliding beam (80E30, store 6377)</pre>


<!-- Date: Sat Aug 23 08:01:35.986 2008 -->
Attention!!! L2 Decision Timeout ERROR !!. 
Auto HRR.
<!-- Author: Yoshikazu /Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266490' target=_top>266490</a>) -->
<!-- Comment: Sat Aug 23 08;01;53 comment by...Yoshikazu / Andreas -->
Again

<!-- Comment: Sat Aug 23 08;02;27 comment by...Yoshikazu / Andreas -->
Again

<!-- Comment: Sat Aug 23 08;02;49 comment by...Yoshikazu / Andreas -->
Again

<!-- Comment: Sat Aug 23 08;04;26 comment by...Yoshikazu / Andreas -->
Again

<!-- Comment: Sat Aug 23 08;09;27 comment by...Yoshikazu / Andreas -->
again at 08:07:04

<!-- Comment: Sat Aug 23 08;09;48 comment by...Yoshikazu / Andreas -->
again at 08:08:06

<!-- Comment: Sat Aug 23 08;10;11 comment by...Yoshikazu / Andreas -->
again at 08:09:36

<!-- Comment: Sat Aug 23 08;10;59 comment by...Yoshikazu / Andreas -->
again at 08:10:37

<!-- Comment: Sat Aug 23 08;11;36 comment by...Yoshikazu / Andreas -->
again at 08:11:18


<!-- Comment: Sat Aug 23 08;16;05 comment by...Yoshikazu / Andreas -->
Again 08:14
<!-- Comment: Sat Aug 23 08;16;23 comment by...Yoshikazu / Andreas -->
Again 08:15:40
<!-- Comment: Sat Aug 23 08;19;14 comment by...Yoshikazu / Andreas -->
Again 08:18:12
<!-- Comment: Sat Aug 23 08;20;23 comment by...Yoshikazu / Andreas -->
Again 08:19:34
<!-- Comment: Sat Aug 23 08;22;21 comment by...Yoshikazu / Andreas -->
Again 08:21:28
<!-- Date: Sat Aug 23 08:13:10.069 2008 -->
Done TO b0cot16. HRR.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266490' target=_top>266490</a>) -->
<!-- Comment: Sat Aug 23 08;14;04 comment by...Yoshikazu / Andreas -->
ErrorLogger said <i>TDC in slot 18 not ready for readout</i>





<!-- Date: Sat Aug 23 08:16:55.077 2008 -->
ICICLE restart
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266490' target=_top>266490</a>) -->





<!-- Date: Sat Aug 23 08:25:41.646 2008 -->
CER_SVXMON_HALT_RECOVER_RUN_ERROR !!!  
two HRRs
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266490' target=_top>266490</a>) -->

<!-- Date: Sat Aug 23 08:26:02.508 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266490>266490</A>
 Terminated at 2008.08.23 08:25:56
<!-- Author: RunControl -->


<!-- Date: Sat Aug 23 08:26:21.363 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266490>266490</A>
TERMINATE: Investigating RECEES timeouts
<!-- Author: Yuchul/David -->


<!-- Date: Sat Aug 23 08:30:39.467 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266491>266491</A>
 Activated at 2008.08.23 08:29:59
<!-- Author: RunControl -->


<!-- Date: Sat Aug 23 08:30:40.454 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266491>266491</A>
ACTIVATE: RunSet: AAA_CURRENT_L1MET  Trigger: PHYSICS_5_01 [9,1119,725] Recees ignored
<!-- Author: Yoshikazu / Andreas -->



<!-- Date: Sat Aug 23 08:36:36.236 2008 -->
Attention !!!. FERML_SRC_FATALITY ERROR !!!  
SRC Fatality Error for b0svx02: Sl 6 Resonance Detected.  
HRR.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266491' target=_top>266491</a>) -->

<!-- Date: Sat Aug 23 08:43:23.240 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266490>266490</A>
general: <tt>All plots look OK. Note:the 2 known ladders from ISL0 side Z are still red (see attaced plot below)</tt>
<!-- Author: Consumer Operator( Toru OKUSAWA) -->



<!-- Date: Sat Aug 23 08:48:35.716 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4258&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4258  width='300' align='top'></a></td><td>The known 2 known ISL 0 Ladders on Z side are still red. I will keep watching.</td></tr></table>
<!-- Author: Toru OKUSAWA -->


<!-- Date: Sat Aug 23 08:56:17.839 2008 -->
Done TO b0ccal05 
We assume the same problem as before. 
 
<pre> 
(MLE) b0ccal05:Messenger:Aug 23, 2008 08:53:54 AM->SMXR Not Responding event 279988, slot 3, bunch ctr 21, L2buffer 0, header 0x3bfe315 
(MLE) b0ccal05:Messenger:Aug 23, 2008 08:53:54 AM->SMXR slot 3 Header: 0x03BFE315 0x00FF0011 0x00000004 0x02636363 0x00000026  
(MLE) b0ccal05:Messenger:Aug 23, 2008 08:53:55 AM->SMXR slot 4 Header: 0x03800415 0x00FF0011 0x00000004 0x02636363 0x00000026  
(MLE) b0ccal05:Messenger:Aug 23, 2008 08:53:55 AM->SMXR slot 5 Header: 0x03800515 0x00FF0011 0x00000004 0x02636363 0x00000026  
(MLE) b0ccal05:Messenger:Aug 23, 2008 08:53:55 AM->ADMEM slot 17 Header: 0x019A1115 
(MLE) b0ccal05:Messenger:Aug 23, 2008 08:53:55 AM->ADMEM slot 19 Header: 0x019C7315 
(MLE) b0ccal05:Messenger:Aug 23, 2008 08:53:55 AM->ADMEM slot 21 Header: 0x019C1515 
(MLE) b0ccal05:Messenger:Aug 23, 2008 08:53:55 AM->ADMEM slot 16 Header: 0x019E3015 
(MLE) b0ccal05:Messenger:Aug 23, 2008 08:53:55 AM->ADMEM slot 18 Header: 0x019AD215 
(MLE) b0ccal05:Messenger:Aug 23, 2008 08:53:55 AM->ADMEM slot 20 Header: 0x0184F415 
(MLE) b0control21.fnal.gov:Thread-26:Aug 23, 2008 08:53:58 AM->Done Timeout: CCAL_05 </pre>
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266491' target=_top>266491</a>) -->
<!-- Comment: Sat Aug 23 09;13;55 comment by...Yoshikazu / Andreas -->
Paged to SMX. Mike L suggested us to perform b0ccal05 power cycle. 
It was done.
<!-- Date: Sat Aug 23 08:57:45.370 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266491>266491</A>
 Terminated at 2008.08.23 08:56:51
<!-- Author: RunControl -->


<!-- Date: Sat Aug 23 08:57:46.154 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266491>266491</A>
TERMINATE: REECES ignored for this run.
<!-- Author: Yoshikazu / Andreas -->


<!-- Date: Sat Aug 23 09:06:54.026 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266492>266492</A>
TERMINATE: evb2b failed config, resetting for cleanup
<!-- Author: Yoshikazu / Andreas -->
<!-- Comment: Sat Aug 23 09;12;12 comment by...Yoshikazu / Andreas -->
Clean up evb2b.
<!-- Date: Sat Aug 23 09:09:46.558 2008 -->
asked Jim to power cycle ccal_05 and is done
<!-- Author: K. Hara :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266493' target=_top>266493</a>) -->

<!-- Date: Sat Aug 23 09:11:12.926 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266493>266493</A>
 Activated at 2008.08.23 09:10:03
<!-- Author: RunControl -->


<!-- Date: Sat Aug 23 09:11:13.717 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266493>266493</A>
ACTIVATE: RunSet: AAA_CURRENT_L1MET  Trigger: PHYSICS_5_01 [9,1119,725] 
<!-- Author: Yoshikazu / Andreas -->





<!-- Date: Sat Aug 23 09:14:05.261 2008 -->
We took a run with REECES ignored from run control to identify which ccal crate was causing frequent l2 done timeouts (run 266491). This eventually identified b0ccal05 as the culprit (~10 minutes after the second wave of dynamic prescales had activated). It has been power cycled and we've returned to normal data taking. I'll hang around until the prescales have activated to see if the problem comes back.
<!-- Author: David (L2 Pager) :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266493' target=_top>266493</a>) -->


<!-- Date: Sat Aug 23 09:17:09.161 2008 -->
Done TO b0cot07. HRR.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266493' target=_top>266493</a>) -->
<!-- Comment: Sat Aug 23 09;17;42 comment by...Yoshikazu / Andreas -->
<pre>(MLE) b0cot07:Messenger:Aug 23, 2008 09:15:58 AM->TDC Invalid SRAM Header evt 44453 slot 17: exp/fnd mod 423/423 l2b 2/0 D3800944
(MLE) b0cot07:Messenger:Aug 23, 2008 09:15:58 AM->TDC Header Mismatch evt 44453 slot 17: static/fifo 0xD3881821/0xD3800944 [0D4,0D0]
(MLE) b0cot07:Messenger:Aug 23, 2008 09:15:58 AM->TDC evt 44453 slot 17 static/fifo: ModID 423/423 L2B 2/0 Hits 24/9 BC 33/68
(MLE) b0cot07:Messenger:Aug 23, 2008 09:15:59 AM->TDC Header Mismatch evt 44454 slot 17: static/fifo 0xD3841870/0xD3801321 [0D8,0D4]
(MLE) b0cot07:Messenger:Aug 23, 2008 09:15:59 AM->TDC evt 44454 slot 17 static/fifo: ModID 423/423 L2B 1/0 Hits 24/19 BC 112/33
1 crate/s: b0cot07(55),  Done TO. [RXPT]</pre>


<!-- Date: Sat Aug 23 09:18:54.727 2008 -->
<table border=0><td><tr><td bgcolor=#e0e030>I am substiting for JJ as ops man between now and 1530 hours. 
I am in the trailers now and will be on the third floor of B0 from 945 onward. I am carrying my cell phone 630-207-2770. 
Please make a note of it. 
</td></tr></td></table>
<!-- Author: Farrukh Azfar -->
<!-- Comment: Sat Aug 23 09;55;25 comment by...jj -->
Note that I am available by cell phone 630-640-1518 and
checking in when I can.
<!-- Date: Sat Aug 23 09:19:46.334 2008 -->
L2 TO Error 
HRR
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266493' target=_top>266493</a>) -->

<!-- Date: Sat Aug 23 09:24:58.743 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266491>266491</A>
general: <tt>All plots seems OK</tt>
<!-- Author: Consumer Operator( Toru OKUSAWA) -->



<!-- Date: Sat Aug 23 09:26:38.833 2008 -->
From Run-Coord e-log: EOS is estimated at 16:00.
<!-- Author: K. Hara :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266493' target=_top>266493</a>) -->

<!-- Date: Sat Aug 23 09:36:40.356 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266493>266493</A>
 Terminated at 2008.08.23 09:36:17
<!-- Author: RunControl -->


<!-- Date: Sat Aug 23 09:37:34.104 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266493>266493</A>
TERMINATE: Restarting du to the SMX problems.
<!-- Author: Yoshikazu / Andreas -->


<!-- Date: Sat Aug 23 09:40:20.077 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494>266494</A>
 Activated at 2008.08.23 09:39:53
<!-- Author: RunControl -->


<!-- Date: Sat Aug 23 09:40:21.720 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494>266494</A>
ACTIVATE: RunSet: AAA_CURRENT_L1MET  Trigger: PHYSICS_5_01 [9,1119,725] 
<!-- Author: Yoshikazu / Andreas -->



<!-- Date: Sat Aug 23 09:44:32.129 2008 -->
After power cycling b0ccal05, L2 TO came back.  
DQMON reported dead channels in CES, CPR and CCR. It confirmed by CO. 
We pageed SMX again. Mike L suggested power cycle SW arch. 
 
We restart the new run after PC  
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->


<!-- Date: Sat Aug 23 09:45:14.697 2008 -->
L2 decision TO again.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->
<!-- Comment: Sat Aug 23 10;05;32 comment by...Yoshikazu / Andreas -->
Again
<!-- Comment: Sat Aug 23 10;49;03 comment by...Yoshikazu / Andreas -->
Again
<!-- Date: Sat Aug 23 09:53:22.680 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266493>266493</A>
general: <tt>All plots seems OK except CES,CPR and CCR with wedge 16 dead. ( see attached plots.)</tt>
<!-- Author: Consumer Operator( Toru OKUSAWA) -->




<!-- Date: Sat Aug 23 09:55:55.035 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4259&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4259  width='300' align='top'></a></td><td>CES west strip plot, phi wedge #16 dead</td></tr></table>
<!-- Author: Toru OKUSAWA -->



<!-- Date: Sat Aug 23 10:09:45.549 2008 -->
PTM PW10 current temp is 81.5. 
we keep eye on.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->
<!-- Comment: Sat Aug 23 10;56;25 comment by...Yoshikazu / Andreas -->
now 82.0
<!-- Date: Sat Aug 23 10:10:31.174 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266491>266491</A>
RUNSTATUS: <PRE>Marked Bad, explanation:
CSMX 
</PRE>
<!-- Author: cdfscico -->


<!-- Date: Sat Aug 23 10:11:51.961 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266491>266491</A>
RUNSTATUS: <PRE>Marked Bad, explanation:
PSMX 
SMX 
</PRE>
<!-- Author: cdfscico -->


<!-- Date: Sat Aug 23 10:14:10.652 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266493>266493</A>
RUNSTATUS: <PRE>Marked Bad, explanation:
CSMX 
</PRE>
<!-- Author: cdfscico -->



<!-- Date: Sat Aug 23 10:15:36.873 2008 -->
ProcMon reported ENCP to Tape Error.  
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->

<!-- Date: Sat Aug 23 10:28:54.079 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494>266494</A>
general: <tt>All plots seems OK, except TRIGMON slides are noy yet arrived. </tt>
<!-- Author: Consumer Operator( Toru OKUSAWA) -->



<!-- Date: Sat Aug 23 10:38:46.507 2008 -->
PTM PE09 is Yellow. temp is 79.1.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->
<!-- Comment: Sat Aug 23 12;30;03 comment by...Yoshikazu / Andreas -->
Red now, temp is 80.0.
<!-- Comment: Sat Aug 23 15;26;04 comment by...Yoshikazu / Andreas -->
now 80.1 with Red.
<!-- Date: Sat Aug 23 10:39:46.158 2008 -->
Done TO b0cot16.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->


<!-- Date: Sat Aug 23 10:45:24.166 2008 -->
PTM PW08 is Yellow. temp is 79.1. 
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->
<!-- Comment: Sat Aug 23 12;30;27 comment by...Yoshikazu / Andreas -->
Yellow, 79.7.
<!-- Date: Sat Aug 23 11:01:37.708 2008 -->
TOF HV trip. Automatically recovered.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->
<!-- Comment: Sat Aug 23 11;37;19 comment by...Yoshikazu / Andreas -->
TOF02 trip. auto recovered
<!-- Date: Sat Aug 23 11:21:22.557 2008 -->
WATER ALARM: Temperature of TE-81 is a little higher than 67F. Jim suspects that the humidity is high because doors are open: this can happen in summer. Currently alarm is silenced. Jim keeps eye on it. 
<!-- Author: K. Hara :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->


<!-- Date: Sat Aug 23 11:36:50.244 2008 -->
L2 decison TO. 
HRR is failed due to the errlog error. 
Shepherded errlog and then HRR success.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->
<!-- Comment: Sat Aug 23 11;48;45 comment by...Yoshikazu / Andreas -->
Errorlogger failed again during <i>Halt</i> transition, closed it again, opened a new one and shepherded it according to the instructions in the popup window.
<!-- Comment: Sat Aug 23 12;28;36 comment by...Yoshikazu / Andreas -->
ProcMon complains about RTSERVER, <i>reporting one potentially stuck port on b0control21</i>.
<!-- Comment: Sat Aug 23 12;39;55 comment by...Yoshikazu / Andreas -->
RTSERVER is green again in ProcMon.
<!-- Date: Sat Aug 23 11:37:04.492 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4261&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4261  width='300' align='top'></a></td><td>pinkie S_VBIAS B1W9L0. Turned green after a minute.</td></tr></table>
<!-- Author: K. Hara -->




<!-- Date: Sat Aug 23 12:05:21.401 2008 -->
COT is triped. SL8 S9 0V at 11:42. 
We  called to Eiko and she suggested to turn it on. 
Voltage came up, but tripped again now at same channel.  
<!-- Author: Yoshikzu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->


<!-- Date: Sat Aug 23 12:09:42.925 2008 -->
Page to DAQ because RunControl have problem in ErrorHandler. 
 
RTServer showed b0control21 had stucked.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->
<!-- Comment: Sat Aug 23 12;52;54 comment by...M. Datta -->
<pre>From the log file, the ErrorHandler problems seem to be from b0pcal07:

2008.08.23 11:35:07 ***In printMessage Message:com.smartsockets.TipcMsgImpl@187c55c
     From(sender):/_b0pcal07_28543696; to(Dest):/partition-0/monitor; mt(Type):MLencodedMessage; fields: 11
2008.08.23 11:35:07 Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 20969416


2008.08.23 11:43:10 ***In printMessage Message:com.smartsockets.TipcMsgImpl@1ff92f5
     From(sender):/_b0pcal07_28543696; to(Dest):/partition-0/monitor; mt(Type):MLencodedMessage; fields: 11
2008.08.23 11:43:10 Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 20976736

The ACE shepharded that crate</pre>
<!-- Date: Sat Aug 23 12:25:01.073 2008 -->
COT voltages started ramping, presumably to standby. Farrukh is going downstairs to see if someone is working on it.
<!-- Author: Andreas / Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->
<!-- Comment: Sat Aug 23 12;26;07 comment by...Andreas -->
Bob Wagner is downstairs replacing a module. I misunderstood that on the phone and didn't get it that he was already here.


<!-- Comment: Sat Aug 23 13;06;29 comment by...Bob and Eiko -->
COT SL8 S9 tripped twice on "OV", which means BiRa pod voltage regulation. It has done this twice before since June.  We replaced the pod with a spare.  
<!-- Comment: Sat Aug 23 13;51;55 comment by...Yoshikazu / Andreas -->
They called COT is fine now. 
<!-- Date: Sat Aug 23 12:27:21.972 2008 -->
b0pcal10 and bopcal04 failed, shepherded them.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->





<!-- Date: Sat Aug 23 12:34:36.506 2008 -->
<p>Jim Humbert called me earlier to notify me about the problem with 2nd floor 
humidity.  As far as I could tell over the phone, it looks like the HVAC system is 
struggling with keeping up with the outdoor humidity (last I looked 73%, dewpoint 
73%° F, only 10° below the temperature).  In fact, one consequence is that the ECW 
temperature has been raised almost 1° to keep the proper headroom above the 
dewpoint in the trigger room.</p> 
 
<p>But, that's only the preface to the real point.  I then tried to look at some 
variables in CDFONPROD, only to find that none of the ICICLE variables have been 
updated since before 0600 this morning.  I talked with Andreas, and he checked 
the network disk was working correctly, and that the log messages (including 
connecting to CDFONPROD) looked correct when restarting ICICLE.  But still I see 
no new data.  Andreas said he was having other odd problems, like not being 
able to shepard crates; I advised he  
contact the DAQ pager.  More when we know more.</p>
<!-- Author: Steve Hahn :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->
<!-- Comment: Sat Aug 23 12;36;09 comment by...Steve Hahn -->
Oops, the second 73 is 73°, not 73%°
<!-- Comment: Sun Aug 24 12;36;17 comment by...Steve Hahn -->
Note: apparently, the problem was
<a href=
'/cgi/elog/elog.pl?nb=2008&action=view&page=710&frame=2&anchor=12:34:53.740'>
not what I thought</a>. 

<!-- Date: Sat Aug 23 12:35:07.553 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494>266494</A>
general: <tt>All plots seems OK.</tt>
<!-- Author: Consumer Operator( Toru OKUSAWA) -->





<!-- Date: Sat Aug 23 12:40:24.651 2008 -->
ENCP TO TAPE is red again in ProcMon.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->



<!-- Date: Sat Aug 23 12:53:46.325 2008 -->
When trying to recover from the error logger problem, b0cmx01 gave a VME BUS ERROR for slot 4. 
<p>We shepherded it once, it didn't come up, failing to initialize slot 4.</p> 
<p>We shepherded it again, this time it came up. We were active for about five seconds with events coming through to the L3 display, followed by a Done TO for the same crate.</p>
<!-- Author: Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->
<!-- Comment: Sat Aug 23 13;01;59 comment by...Yoshikazu/Andreas -->
ErrorLogger info:
<pre>
(RC)   12:55:39 Run -> ACTIVE
(EH Info) b0cmx01:Messenger:Aug 23, 2008 12:45:37 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]b0cmx01:Messenger:Aug 23, 2008 12:45:53 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]b0cmx01:Messenger:Aug 23, 2008 12:46:10 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]b0cmx01:Messenger:Aug 23, 2008 12:49:57 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]1 crate/s: b0cmx01(87),  Done TO. [RXPT]
(MLE) b0control21.fnal.gov:Thread-26:Aug 23, 2008 12:55:42 PM->Done Timeout: CMX_01 
(EH Info) b0cmx01:Messenger:Aug 23, 2008 12:45:37 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]b0cmx01:Messenger:Aug 23, 2008 12:45:53 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]b0cmx01:Messenger:Aug 23, 2008 12:46:10 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]b0cmx01:Messenger:Aug 23, 2008 12:49:57 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]1 crate/s: b0cmx01(87),  Done TO. [RXPT]
(EH Info) b0cmx01:Messenger:Aug 23, 2008 12:45:37 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]b0cmx01:Messenger:Aug 23, 2008 12:45:53 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]b0cmx01:Messenger:Aug 23, 2008 12:46:10 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]b0cmx01:Messenger:Aug 23, 2008 12:49:57 PM->TDC_readyForReadoutNoWait: slot=4 VME bus error reading TDC status register [9]1 crate/s: b0cmx01(87),  Done TO. [RXPT]
(MLE) b0l2cntl00.fnal.gov:TEDCpp.exe:Aug 23, 2008 12:55:51 PM->{ 12:55:51, 8/23/2008 }: L2-Pulsar-Linux: Halted while  processing happily
(RC)   12:55:51 Halt -> HALTED
</pre>



<!-- Comment: Sat Aug 23 13;45;21 comment by...Andreas / Yoshikazu -->
Eric James called back and suggested to power cycle the crate and shepherd it afterwards. We did that, but it didn't come up after shepherding.
<!-- Comment: Sat Aug 23 13;47;10 comment by...Yoshikazu / Andreas -->
It seems to be slot 5 this time: FrontendConsole from failed shepherding attempt:
<pre>
TDC moduleId = 50 52 54 32 34 36 38 40 42 44 46 48 
FISION: S_errno_EIO (0x5): VME BERR received!
*** TDC in slot 5, ID PROM not found (blank check) ***
FISION: S_errno_EIO (0x5): VME BERR received!
FISION: S_errno_EIO (0x5): VME BERR received!
FISION: S_errno_EIO (0x5): VME BERR received!
FISION: S_errno_EIO (0x5): VME BERR received!
TDC in slot 5 Toggle of event mask failed : 0xffffffff
FISION: S_errno_EIO (0x5): VME BERR received!
FISION: S_errno_EIO (0x5): VME BERR received!
TDC in slot 5 Control Register after second toggle: 0xffffffff
FISION: S_errno_EIO (0x5): VME BERR received!
*** TDC in slot 5, found DspVer=255, expected 45 ***
FISION: S_errno_EIO (0x5): VME BERR received!
*** Wrong TDC boardType: found 15, expected 8 in slot 5 ***
Cannot configure readout - check readout list.
Readout process not started. Error status: 1
Resetting and Enabling TAXI to send data to VRB
*** Error Processing Readout List ! ***
Sent ack to Run Control: 0 ERROR ERROR 
Resetting card in slot 5 failed 
Resetting card in slot 5 failed 
Statechange failed 
</pre>
<!-- Comment: Sat Aug 23 13;49;01 comment by...Yoshikazu / Andreas -->
We tried to shepherd it once more, to the same effect.
<!-- Comment: Sat Aug 23 14;01;44 comment by...Yoshikazu / Andreas -->
Eric called back and suggested to power cycle it once again, as the problem has moved to a different card and sometimes they don't come up in the correct configuration. We might have to do it more often.
<!-- Comment: Sat Aug 23 14;06;02 comment by...Yoshikazu / Andreas -->
After power cycling and shepherding, we are in the very same state as above, again <i>TDC in slot 5, ID PROM not found (blank check)</i> and Resetting <i>card in slot 5 failed</i>.
<!-- Comment: Sat Aug 23 14;13;16 comment by...Yoshikazu / Andreas -->
Power cycled it once more, leaving the power off for about three minutes. Subsequent shepherding failed, console output stopped one line after <i>done executing startup script</i>. Shepherded again, same slot 5 problem as before. We are calling Eric again.
<!-- Comment: Sat Aug 23 14;39;10 comment by...Yoshikazu / Andreas -->
Eric will come in and try to remove and reinsert card 5 in that crate. In the meantime, we can continue power cycling it as it might come up all right.
<!-- Date: Sat Aug 23 13:02:00.611 2008 -->
<table border=0><td><tr><td bgcolor=#e0e030>Regarding b0cmx01: It seems that the TDC in slot 4 may have to be reseated. I spoke to Bill who recommended against power-cycling the crate. 
 
I have paged Eric James. </td></tr></td></table>
<!-- Author: Farrukh  (ops)  :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->



<!-- Date: Sat Aug 23 13:07:32.868 2008 -->
COT trips again at SL8. 
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494' target=_top>266494</a>) -->
<!-- Comment: Sat Aug 23 14;09;11 comment by...Aseet and Bob Wagner -->
SL8 S9 tripped on OV again, even with the new pod.  It may be that the DAC output is drifting with time, and the DAC is located on the BiRa module itself (not the pod).  The HV control program trips the superlayer if the difference between a DAC setting and the pod output become too large.  Aseet increased the allowed difference from 100V to 150V, and we will see if the S9 OV trips go away.  
<!-- Date: Sat Aug 23 13:08:31.401 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4264&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4264  width='300' align='top'></a></td><td>S-AVDD B3W6L2, I-VBIAS B1W4L3, I-VBIAS B5W0L1 are pinkie. Because the changes are small and DAQ is having trouble, no HRR is issued yet. We keep eye on them.</td></tr></table>
<!-- Author: K. Hara -->
<!-- Comment: Sat Aug 23 13;27;42 comment by...Satyajit -->
The jumps in bias currents are small. These would be fixed by
adjusting the upper limit. You can set them to ignore for the
time being.
<!-- Date: Sat Aug 23 13:21:45.257 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4265&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4265  width='300' align='top'></a></td><td>AVDD cell</td></tr></table>
<!-- Author: Yoshikazo / Andreas -->
<!-- Comment: Sat Aug 23 13;30;03 comment by...Satyajit -->
The jump in AVDD is small too. If it doesn't go away with a couple
of HRRs then mark it ignored. We will look at it at the next 
available opportunity.



<!-- Comment: Sat Aug 23 13;48;22 comment by...Yoshikazu / Andreas -->
Thank you!. We set them to <i>ignore</i>.
<!-- Date: Sat Aug 23 13:43:08.613 2008 -->
Per  Eric James request, Jim Humbert and I powercycled 
b0cmx01 on first floor.  We need to clarify whether this 
is shift crew responsibility or process system tech job.
<!-- Author: jj -->
<!-- Comment: Sat Aug 23 13;59;48 comment by...Yoshikazu / Andreas -->
Please also note the additional information in the comments above.





<!-- Comment: Sun Aug 24 11;16;08 comment by...jj -->
It appears that Eric eventually came in and hot-reseated
TDC in this crate.
<!-- Date: Sat Aug 23 14:22:44.726 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494>266494</A>
general: <tt>All plots seems OK.</tt>
<!-- Author: Consumer Operator( Toru OKUSAWA) -->


<!-- Date: Sat Aug 23 14:24:52.074 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266494>266494</A>
 Terminated at 2008.08.23 14:24:45
<!-- Author: RunControl -->
<!-- Comment: Sat Aug 23 14;29;29 comment by...Yoshikazu / Andreas -->
Ended this run to take some (bad) data without b0cmx01 in the meantime. We had to use <i>manually override state manager condition</i> to end it, and there was a window <i>Error updating the database</i> which disappeared two seconds later. 
<!-- Date: Sat Aug 23 14:29:08.970 2008 -->
Gas alarm: NWX gas flow reached the lower limit. Jim increased the flow.
<!-- Author: K. Hara :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266495' target=_top>266495</a>) -->


<!-- Date: Sat Aug 23 14:29:47.586 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266495>266495</A>
 Activated at 2008.08.23 14:29:37
<!-- Author: RunControl -->


<!-- Date: Sat Aug 23 14:29:48.860 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266495>266495</A>
ACTIVATE: RunSet: AAA_CURRENT_L1MET  Trigger: PHYSICS_5_01 [9,1119,725] 
<!-- Author: Yoshikazu / Andreas -->
<!-- Comment: Sat Aug 23 14;30;30 comment by...Yoshikazu / Andreas -->
b0cmx01 is excluded from this run, data will be bad.

<!-- Comment: Sat Aug 23 14;37;02 comment by...Yoshikazu / Andreas -->
PSM alarm because of power cycling for b0cmx01, so we masked the VME Power inhibit and continued to take (bad) data.




<!-- Date: Sat Aug 23 14:42:13.580 2008 -->
L2 Decision TO (<i>waiting for RECES</i> messages in log). HRR.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266495' target=_top>266495</a>) -->
<!-- Comment: Sat Aug 23 15;09;11 comment by...Yoshikazu / Andreas -->
again
<!-- Date: Sat Aug 23 14:43:41.868 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266495>266495</A>
 Terminated at 2008.08.23 14:43:07
<!-- Author: RunControl -->



<!-- Date: Sat Aug 23 14:43:41.255 2008 -->
TOF HV trigger inhibit, but no indication from iFIX. Cleared itself after some seconds.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266495' target=_top>266495</a>) -->

<!-- Date: Sat Aug 23 14:46:40.251 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266496>266496</A>
 Activated at 2008.08.23 14:46:30
<!-- Author: RunControl -->


<!-- Date: Sat Aug 23 14:46:41.619 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266496>266496</A>
ACTIVATE: RunSet: AAA_CURRENT_L1MET  Trigger: PHYSICS_5_01 [9,1119,725] 
<!-- Author: Yoshikazu / Andreas -->



<!-- Date: Sat Aug 23 14:58:09.457 2008 -->
CPR HV alarm from iFIX. Alarm details on CLC1 PC say that 49/50 channels for CPR west are at full voltage. We tried to turn it on, but it had no effect. The instructios say we should start a new run, mask the inhibit and contact the pager. 
<p>As we had just started a new run and only acquired about one minute of data, we continued with that run and just masked the inhibit.</p>
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266496' target=_top>266496</a>) -->
<!-- Comment: Sat Aug 23 15;03;49 comment by...Yoshikazu / Andreas -->
Called Mary by mistake, sorry. She suggested to page the CPR high voltage pager. Paged them.
<!-- Comment: Sat Aug 23 15;06;52 comment by...Yoshikazu / Andreas -->
Larry called back and told us to <i>consider him informed</i> and just keep running in that configuration.
<!-- Comment: Sat Aug 23 15;28;02 comment by...convery -->
No problem.  I think this affects 16 channels of CPR, so the CO should look for this.  I can't remember, but I think 16 dead channels is enough to mark CPR bad.  If the HV is just slightly lower than nominal, maybe Larry can tell if it's ok.  If it's bad, the HV module needs to be replaced.  I might be able to come in later to do this.
<!-- Comment: Sat Aug 23 15;46;32 comment by...Toru OKUSAWA -->
Right now CPR plot looks well. ( see the attached slide below)
<!-- Date: Sat Aug 23 15:00:42.968 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266495>266495</A>
general: <tt>All plots seems OK.</tt>
<!-- Author: Consumer Operator( Toru OKUSAWA) -->



<!-- Date: Sat Aug 23 15:01:33.472 2008 -->
We restart the sequencer. 
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266496' target=_top>266496</a>) -->





<!-- Date: Sat Aug 23 15:12:11.428 2008 -->
Done TO b0cot16. HRR.  
Slot 18 no ready for read out.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266496' target=_top>266496</a>) -->
<!-- Comment: Sat Aug 23 15;43;43 comment by...Yoshikazu / Andreas -->
Again. Bunch couter mismatch, slot 17.
<!-- Date: Sat Aug 23 15:20:28.185 2008 -->
from RunCo eLog: this store will be terminated at 16:30 and go to shot setup right after.
<!-- Author: K. Hara :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266496' target=_top>266496</a>) -->


<!-- Date: Sat Aug 23 15:24:54.273 2008 -->
TOF LV trigger inhibit, PSM red in iFIX. PSM details show <i>TOF_W</i> in red, details there showed channel 7 red. It went back to normal before we could make a screenshot.
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266496' target=_top>266496</a>) -->



<!-- Date: Sat Aug 23 15:32:52.492 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266495>266495</A>
RUNSTATUS: <PRE>Marked Bad, explanation:
CMX 
</PRE>
<!-- Author: cdfscico -->


<!-- Date: Sat Aug 23 15:34:08.632 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266496>266496</A>
general: <tt>All plots seems OK.</tt>
<!-- Author: Consumer Operator( Toru OKUSAWA) -->



<!-- Date: Sat Aug 23 15:35:54.278 2008 -->
Attention !!!. CER_SVXMON_HALT_RECOVER_RUN_ERROR !!!  
Stuck Cellid S/B2/W4/L4/C0-6 .  
 
two HRRs
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266496' target=_top>266496</a>) -->


<!-- Date: Sat Aug 23 15:37:59.844 2008 -->
L2 Decision TO (waiting for RECES messages in log). HRR
<!-- Author: Yoshikazu / Andreas :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266496' target=_top>266496</a>) -->
<!-- Comment: Sat Aug 23 15;53;35 comment by...Yoshikazu  -->
again
<!-- Date: Sat Aug 23 15:48:02.785 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4266&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4266  width='300' align='top'></a></td><td>CPR slide mensioned above.</td></tr></table>
<!-- Author: Toru OKUSAWA -->


<!-- Date: Sat Aug 23 15:55:20.069 2008 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=266490 target=_runSummary>266490</A> x410FA</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [9,1119,725]</FONT></TD>
<TD ALIGN=CENTER>05:34:41</TD>
<TD ALIGN=CENTER>08:25:56</TD>
<TD ALIGN=CENTER>02:11:49</TD>
<TD ALIGN=RIGHT>     965,793</TD>   <TD ALIGN=RIGHT>  1,280.37</TD>
<TD ALIGN=RIGHT>  1,022.35</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=266491 target=_runSummary>266491</A> x410FB</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [9,1119,725]</FONT></TD>
<TD ALIGN=CENTER>08:29:59</TD>
<TD ALIGN=CENTER>08:56:51</TD>
<TD ALIGN=CENTER>00:24:53</TD>
<TD ALIGN=RIGHT>     120,752</TD>   <TD ALIGN=RIGHT>    125.65</TD>
<TD ALIGN=RIGHT>    114.01</TD>
<TD ALIGN=CENTER>0</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=266493 target=_runSummary>266493</A> x410FD</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [9,1119,725]</FONT></TD>
<TD ALIGN=CENTER>09:10:03</TD>
<TD ALIGN=CENTER>09:36:17</TD>
<TD ALIGN=CENTER>00:17:22</TD>
<TD ALIGN=RIGHT>      77,127</TD>   <TD ALIGN=RIGHT>    116.09</TD>
<TD ALIGN=RIGHT>     76.82</TD>
<TD ALIGN=CENTER>0</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=266494 target=_runSummary>266494</A> x410FE</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [9,1119,725]</FONT></TD>
<TD ALIGN=CENTER>09:39:53</TD>
<TD ALIGN=CENTER>14:24:45</TD>
<TD ALIGN=CENTER>01:53:37</TD>
<TD ALIGN=RIGHT>     480,698</TD>   <TD ALIGN=RIGHT>  1,080.89</TD>
<TD ALIGN=RIGHT>    462.44</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=266495 target=_runSummary>266495</A> x410FF</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [9,1119,725]</FONT></TD>
<TD ALIGN=CENTER>14:29:37</TD>
<TD ALIGN=CENTER>14:43:07</TD>
<TD ALIGN=CENTER>00:12:06</TD>
<TD ALIGN=RIGHT>      29,094</TD>   <TD ALIGN=RIGHT>     46.54</TD>
<TD ALIGN=RIGHT>     39.94</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=266496 target=_runSummary>266496</A> x41100</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [9,1119,725]</FONT></TD>
<TD ALIGN=CENTER>14:46:30</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>00:56:53</TD>
<TD ALIGN=RIGHT>     251,174</TD>   <TD ALIGN=RIGHT>    218.37</TD>
<TD ALIGN=RIGHT>    182.94</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>15:55:01</TD>
<TD ALIGN=CENTER>05:56:44</TD>
<TD ALIGN=RIGHT>     1,924,638</TD> <TD ALIGN=RIGHT>  2,867.93</TD>
<TD ALIGN=RIGHT>  1,898.51</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Sat Aug 23 16:01:45.740 2008 -->
<font color=red>Shift Summary: </font><pre>shift started with colliding beam 80E30. 
Water Alarm is silenced for now, since the humidity is high and the 
temperature limit became close to the actual temperature. 
Ccal_05 and SW arch 400Hz power cycled that solved frequent L2 
Decision TO errors. 
Pcal_07 caused Error logger problem, solved by Mousumi. 
COT SL8 S9 HV tripped. Bob/Eiko/Asheet replaced pod regulation and 
adjusted software. 
CMX crate cmx01 power cycled several times but failed. Eric is coming. 
NWX gas flow reached the lower limit. Gas flow increased. 
CPR2 NW HV is 98% - Larry said to consider him informed. ignore it for 
now and mark this run good. 
Temperature limits for PTM are 85/83F for PE10/PW10. 
This store will be terminated at 16:30, following shot setup 
right after. 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   266490-266496
Delivered Luminosity   1835/nb  
Acquired Luminosity    980/nb  
Efficiency             53.4%
   
</td></tr></table></pre>
<!-- Author: K. Hara -->
<!-- Comment: Sun Aug 24 07;46;02 comment by...K. Hara -->
Eric had fixed the cmx01 crate problem.