<!-- Title: Owl shift. Sun Jun  3, 2001 -->
<!-- SciCo: Christoph Paus -->
<!-- DAQAce: Yanwen Liu -->
<!-- MonAce: Michael Riveline -->
<!-- CO: Andrei Solodsky -->
<!-- OpManager: Doug Benjamin -->
<!-- Notes: -->
<pre>Shift Plan 
========== 
 
a) watch silicon radiation monitors carefully (beam is in the 
   machine) 
 
b) exercise the detector with cosmic runs 
 
c) no calibrations needed 
</pre>


<!-- Date: Sun Jun 3 00:26:39 2001 -->
<pre>HV trip in PHA: crate Nr4, tagname: AWHA, AEHA. 
Crate was reset</pre>
<!-- Author: michael -->


<!-- Date: Sun Jun 3 00:32:50 2001 -->
End the previous Run(116615), put b0imu01 and L3-sumfarm 0~15 in. 
<!-- Author: Yanwen :: (run <a href='/cgi-bin/runSummaryRun.cgi?116615' target=_top>116615</a>) -->
<!-- Comment: Sun Jun  3 00;36;26 comment by...Yanwen -->
<pre>Restart the run: Crate CMX_00 is missing card TDC_CMX_09 in slot 15. (Run configuration error, but not fatal.) </pre>


<!-- Date: Sun Jun 3 00:41:35 2001 -->
<pre>Run 116616 started successfully. </pre>
<!-- Author: Yanwen :: (run <a href='/cgi-bin/runSummaryRun.cgi?116616' target=_top>116616</a>) -->
<!-- Comment: Sun Jun  3 00;53;20 comment by...Yanwen -->
<pre>(done timeout)
***Busy Condtion***
"Busy condition in VRB/EVB forwarded by crates: IMU_01.
Busy condtions are produced by the VRB and are forwarded by the front end create to the busy crosspoint.  Busy conditions do not represent a problem with the front end crate themselves, but with the EVB system."</pre>


<!-- Date: Sun Jun 3 00:55:05 2001 -->
<pre>java.lang.OutOfMemeoryError occured. restart RC. </pre>
<!-- Author: Yanwen :: (run <a href='/cgi-bin/runSummaryRun.cgi?116616' target=_top>116616</a>) -->
<!-- Comment: Sun Jun  3 01;00;50 comment by...Yanwen -->
<pre>restore the previous configuration, busy timeout, when partitioning.</pre>

<!-- Comment: Sun Jun  3 01;03;21 comment by...Yanwen -->
<pre>Take b0imu_01 out, restart. </pre>


<!-- Date: Sun Jun 3 01:14:25 2001 -->
<pre>Run 116617 started successfully.</pre>
<!-- Author: Yanwen :: (run <a href='/cgi-bin/runSummaryRun.cgi?116617' target=_top>116617</a>) -->


<!-- Date: Sun Jun 3 01:24:34 2001 -->
Something weird happened in ACNET: monitoring for SVRAD1 (W OUTER BLM) jumped from 0 to 3453... not understood yet. 
 
PS: E:SVRAD1 is the summed dose of the west outer BLM according to E20 and not west inner BLM as mentionned in the page: 
/mcs/radmon/ace.html
<!-- Author: michael -->


<!-- Date: Sun Jun 3 01:45:47 2001 -->
<pre>East PHA crate Nr 8 trips.</pre>
<!-- Author: michael -->


<!-- Date: Sun Jun 3 01:56:00 2001 -->
<pre>HV in PHA keep tripping (crate 6 in west plug, 11 and 12 in east  
plug).</pre>
<!-- Author: michael -->


<!-- Date: Sun Jun 3 02:21:16 2001 -->
Busy timeout, Busy Contion in VRB/EVB forwarded by creates 
CMX_00 
 
did a HRR. Continue run 116617
<!-- Author: Yanwen :: (run <a href='/cgi-bin/runSummaryRun.cgi?116617' target=_top>116617</a>) -->
<!-- Comment: Sun Jun  3 03;15;21 comment by...Yanwen -->
Done Timeout detected in crates CMX_01
continue data taking after a HRR. 


<!-- Comment: Sun Jun  3 03;25;28 comment by...Yanwen -->
<pre>"Busy Condtion in VRB/EVB forwarded by crates:&lt;nobody&gt;"

HRR</pre>
<!-- Date: Sun Jun 3 03:17:44 2001 -->
<pre>I just made another ups product version of ace control panel with the latest bug fixes. it is now running in control room under the release number v2_15</pre>
<!-- Author: Arkadiy -->



<!-- Date: Sun Jun 3 03:43:21 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1032&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1032  width='300' align='top'></td><td>Noticed  runtime error.  This is the Error Display. HRR did not help.  I will restart the run. </a></td></tr></table>
<!-- Author: Yanwen -->


<!-- Date: Sun Jun 3 03:53:48 2001 -->
End Run 116617, Start 116618 
"Strange (but not fatal) Run configuration selections: 
Crate CMX_00 is missing card TDC_CMX09 in slot 15.  
 
tried to take a look at the run configuration.  
Parameters->Edit or View Run Settings  
highlighted CMX_00, but Edit menu did not respond.  
 
Proceed. but the bunch counter mismatch appeared immediately again. 
<!-- Author: Yanwen :: (run <a href='/cgi-bin/runSummaryRun.cgi?116618' target=_top>116618</a>) -->


<!-- Date: Sun Jun 3 03:59:09 2001 -->
Take a look at the b0musc00 for the bunch counters disagree problem. Ending the previous run.
<!-- Author: Yanwen :: (run <a href='/cgi-bin/runSummaryRun.cgi?116618' target=_top>116618</a>) -->
<!-- Comment: Sun Jun  3 04;04;03 comment by...Yanwen -->
start a new run(116619), vxlogin b0musc00 to watch the error messages. 

Monitor: interval 8000, state ACTIVE for partition 0
Monitor: Evts sent/readout/triggered 2971/2971/2971
Monitor: Error state:    0, VRB_Busy:    0, TV count: 0
Monitor: readout/sent rate    102.6 Hz /    102.6 Hz, cur evt is 220 bytes
Runtime Error 3000, Event 3088: Bunch crossing mismatch, mismatch count = 1
Event 3089: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 3500, Event 3601: Bunch crossing mismatch, mismatch count = 1
Event 3602: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 4000, Event 4115: Bunch crossing mismatch, mismatch count = 1
Event 4116: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 4500, Event 4638: Bunch crossing mismatch, mismatch count = 1
Event 4639: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 5000, Event 5153: Bunch crossing mismatch, mismatch count = 1
Event 5154: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 5500, Event 5665: Bunch crossing mismatch, mismatch count = 1
Event 5666: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 6000, Event 6182: Bunch crossing mismatch, mismatch count = 1
Event 6183: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 6500, Event 6697: Bunch crossing mismatch, mismatch count = 1
Event 6698: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 7000, Event 7215: Bunch crossing mismatch, mismatch count = 1
Event 7216: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 7500, Event 7730: Bunch crossing mismatch, mismatch count = 1
Event 7731: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 8000, Event 8244: Bunch crossing mismatch, mismatch count = 1
Event 8245: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 8500, Event 8764: Bunch crossing mismatch, mismatch count = 1
Event 8765: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 9000, Event 9278: Bunch crossing mismatch, mismatch count = 1
Event 9279: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 9500, Event 9792: Bunch crossing mismatch, mismatch count = 1
Event 9793: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 10000, Event 10297: Bunch crossing mismatch, mismatch count = 1
Event 10298: Bunchcounters in slot 3 and 9 disagree (at least)                     

<!-- Comment: Sun Jun  3 04;04;28 comment by...Yanwen -->
<pre>start a new run(116619), vxlogin b0musc00 to watch the error messages. 

Monitor: interval 8000, state ACTIVE for partition 0
Monitor: Evts sent/readout/triggered 2971/2971/2971
Monitor: Error state:    0, VRB_Busy:    0, TV count: 0
Monitor: readout/sent rate    102.6 Hz /    102.6 Hz, cur evt is 220 bytes
Runtime Error 3000, Event 3088: Bunch crossing mismatch, mismatch count = 1
Event 3089: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 3500, Event 3601: Bunch crossing mismatch, mismatch count = 1
Event 3602: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 4000, Event 4115: Bunch crossing mismatch, mismatch count = 1
Event 4116: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 4500, Event 4638: Bunch crossing mismatch, mismatch count = 1
Event 4639: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 5000, Event 5153: Bunch crossing mismatch, mismatch count = 1
Event 5154: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 5500, Event 5665: Bunch crossing mismatch, mismatch count = 1
Event 5666: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 6000, Event 6182: Bunch crossing mismatch, mismatch count = 1
Event 6183: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 6500, Event 6697: Bunch crossing mismatch, mismatch count = 1
Event 6698: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 7000, Event 7215: Bunch crossing mismatch, mismatch count = 1
Event 7216: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 7500, Event 7730: Bunch crossing mismatch, mismatch count = 1
Event 7731: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 8000, Event 8244: Bunch crossing mismatch, mismatch count = 1
Event 8245: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 8500, Event 8764: Bunch crossing mismatch, mismatch count = 1
Event 8765: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 9000, Event 9278: Bunch crossing mismatch, mismatch count = 1
Event 9279: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 9500, Event 9792: Bunch crossing mismatch, mismatch count = 1
Event 9793: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 10000, Event 10297: Bunch crossing mismatch, mismatch count = 1
Event 10298: Bunchcounters in slot 3 and 9 disagree (at least)                     </pre>


<!-- Date: Sun Jun 3 04:10:55 2001 -->
<pre>Ending the previous run.  
did a 'reset_crate b0musc00' 
vxlogin it to watch messages, start a new run(116620). </pre>
<!-- Author: Yanwen :: (run <a href='/cgi-bin/runSummaryRun.cgi?116620' target=_top>116620</a>) -->
<!-- Comment: Sun Jun  3 04;14;04 comment by...Yanwen -->
b0musc00 failed cold start. 
try again.

<!-- Comment: Sun Jun  3 04;17;13 comment by...Yanwen -->
<pre>b0l3gate1.fnal.gov : Sender : 4.15.16 AM
 -&gt; L3 took too longtojoin the partition.

cold start failed. try again.</pre>

<!-- Comment: Sun Jun  3 04;23;12 comment by...Yanwen -->
<pre>failed in partitioning. reset. restart L3 proxy..</pre>

<!-- Comment: Sun Jun  3 04;35;05 comment by...Yanwen -->
<pre>Run 116622 started. but the problem of b0musc00 persisted. 

"Monitor: Evts sent/readout/triggered 2998/2998/2998
Monitor: Error state:    0, VRB_Busy:    0, TV count: 0
Monitor: readout/sent rate    108.0 Hz /    108.0 Hz, cur evt is 228 bytes
Runtime Error 3000, Event 3081: Bunch crossing mismatch, mismatch count = 1
Event 3082: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 3500, Event 3586: Bunch crossing mismatch, mismatch count = 1
Event 3587: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 4000, Event 4104: Bunch crossing mismatch, mismatch count = 1
Event 4105: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 4500, Event 4617: Bunch crossing mismatch, mismatch count = 1
Event 4618: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 5000, Event 5132: Bunch crossing mismatch, mismatch count = 1
Event 5133: Bunchcounters in slot 3 and 9 disagree (at least)
Runtime Error 5500, Event 5644: Bunch crossing mismatch, mismatch count = 1
Event 5645: Bunchcounters in slot 3 and 9 disagree (at least)                   
"</pre>

<!-- Comment: Sun Jun  3 04;41;54 comment by...Yanwen -->
<pre>leave it running along with complaint !</pre>


<!-- Date: Sun Jun 3 04:46:04 2001 -->
<pre>PHA crate 11 goes again over-voltage. Recovers after a few minutes</pre>
<!-- Author: michael -->


<!-- Date: Sun Jun 3 06:23:04 2001 -->
<pre>Beams were injected into the Tevatron starting around 5 o'clock.</pre>
<!-- Author: Christoph Paus -->


<!-- Date: Sun Jun 3 06:23:18 2001 -->
<pre>CMX_01 done timeout, did a HRR.</pre>
<!-- Author: Yanwen -->


<!-- Date: Sun Jun 3 06:44:44 2001 -->
<pre>Some beam in the machine. One of the radiation monitor is stepping up (SVRAD3) (from ~5600 to 7390)</pre>
<!-- Author: michael -->


<!-- Date: Sun Jun 3 06:47:21 2001 -->
<pre>Very heratic behavior of SVRAD3</pre>
<!-- Author: michael -->


<!-- Date: Sun Jun 3 07:45:40 2001 -->
<pre>Integrated radiation rates at the end of the shift 
 
SVRAD0  2127 
SVRAD1  3453 
SVRAD2  1087 
SVRAD3  6744</pre>
<!-- Author: michael -->


<!-- Date: Sun Jun 3 07:58:41 2001 -->
<font color=red>Shift Summary: </font><pre>Shift Summary 
============= 
 
 a) Beam in the machine until about 1am (very little) and later 
    starting from around 5am. 
 
 b) Verified list of crates in the readout and tried another time to 
    include IMU_01 which failed. 
 
 c) Taking lots of cosmics. 
 
 d) Error messages from b0musc00 which should be looked at by the 
    experts. 
 
 e) Again high radiation dose observed when beams where dumped. No 
    alarm audible or automatic beam dump. Are the monitors reliable?! 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   116615-116622
Delivered Luminosity   0  pb-1
Acquired Luminosity    0  pb-1
Efficiency             100 %
   
</td></tr></table></pre>
<!-- Author: Christoph Paus -->