<!-- Title: Eve shift. Mon Jul 14, 2008 -->
<!-- SciCo: Matthew Herndon -->
<!-- DAQAce: Jan Morlock -->
<!-- MonAce: &nbsp; -->
<!-- CO: David Clark -->
<!-- OpManager: Peter Dong -->
<!-- Notes: -->
<pre>Shot just went in. 
Plan is to take good data.</pre>


<!-- Date: Mon Jul 14 16:09:05.591 2008 -->
TeV: Done with scraping.  We are turning on our lumi counters
<!-- Author: herndon :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->
<!-- Comment: Mon Jul 14 16;13;19 comment by...herndon -->
Scraping complete at 16:10. Store # 6297
<!-- Date: Mon Jul 14 16:12:57.426 2008 -->
Luminosity 292e30
<!-- Author: herndon :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->


<!-- Date: Mon Jul 14 16:14:38.731 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744>264744</A>
 Activated at 2008.07.14 16:13:28
<!-- Author: RunControl -->


<!-- Date: Mon Jul 14 16:14:39.077 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744>264744</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_5_01 [7,1095,721] 
<!-- Author: Jan -->



<!-- Date: Mon Jul 14 16:18:51.287 2008 -->
TOF Trip in Channels 216 to 295 immediatelly after the start of the run. Brought HV Power back on
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->


<!-- Date: Mon Jul 14 16:20:52.607 2008 -->
Quick look at the triggers. 
Two triggers dominant: 
CMX single muon 3D: fine 
CMX + track 3D:     why is this not prescaled?
<!-- Author: herndon :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->
<!-- Comment: Tue Jul 15 08;32;41 comment by...phil -->
it will be in the next trigger table which we hope to test this week
<!-- Date: Mon Jul 14 16:25:38.705 2008 -->
L2 Decision TO. Auto HRR fixed it.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->
<!-- Comment: Mon Jul 14 16;32;44 comment by...Jan -->
Again


<!-- Comment: Mon Jul 14 16;36;02 comment by...Jan -->
Again
<!-- Comment: Mon Jul 14 16;48;33 comment by...Jan -->
Again
<!-- Comment: Mon Jul 14 16;52;07 comment by...Jan -->
Again
<!-- Comment: Mon Jul 14 16;53;37 comment by...Jan -->
Again
<!-- Comment: Mon Jul 14 17;21;06 comment by...Jan -->
Again
<!-- Date: Mon Jul 14 16:32:53.129 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-3587&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-3587  width='300' align='top'></a></td><td>SVRAD</td></tr></table>
<!-- Author: Jan -->


<!-- Date: Mon Jul 14 16:33:26.599 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-3588&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-3588  width='300' align='top'></a></td><td>Loss/AbGaps</td></tr></table>
<!-- Author: Jan -->





<!-- Date: Mon Jul 14 17:08:06.072 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744>264744</A>
general: <tt>CO checklist completed; so far so good.</tt>
<!-- Author: Consumer Operator(David Clark) -->




<!-- Date: Mon Jul 14 17:42:08.709 2008 -->
COT HV trip in SL2. I brought HV to Stand-By. I waited a few minutes but the bars remained red. Then I hit the On button. This brought HV back.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->


<!-- Date: Mon Jul 14 17:49:27.580 2008 -->
<pre>COT HV trip in SL2 tripped again. 
Called COT expert Morris Binkley. 
Morris is not familiar with this wire tripping. 
Morris will put the system to standby and call Bob Wagner</pre>
<!-- Author: herndon :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->
<!-- Comment: Mon Jul 14 18;11;17 comment by...herndon -->
Morris brought the system up and told us to resume datataking
<!-- Date: Mon Jul 14 18:04:09.409 2008 -->
CER_SVXMON_HALT_RECOVER_RUN_ERROR !!!  
Pipeline out of synch in 401 silicon readout chips. 
Auto HRR fixed it.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->



<!-- Date: Mon Jul 14 18:11:24.689 2008 -->
CER_SVXMON_HALT_RECOVER_RUN_ERROR !!! Pipeline out of synch in 154 silicon readout chips. Auto HRR fixed this. Afterwards Active became red and a L2 Decision TO followed. Another Auto HRR fixed this too.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->


<!-- Date: Mon Jul 14 18:11:48.445 2008 -->
<pre>COT HV trip in SL2 tripped again.  
Called COT expert Morris Binkley. </pre>
<!-- Author: herndon :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->
<!-- Comment: Mon Jul 14 18;45;22 comment by...herndon -->
<pre>COT experts, Bob Wagner and Morris Binkley will ramp down the COT to access which quadrent is the problem and make repairs.  Estimate 20-30 minutes downtime.</pre>
<!-- Date: Mon Jul 14 18:20:15.576 2008 -->
b0pcal05 became unresponsive in HALTED state. Shepherding was successful.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->


<!-- Date: Mon Jul 14 18:33:11.419 2008 -->
We got the error message "SVXMon not sending heart beat to ConsumerErrorReceiver (aka ConsumerMonitor) since 2008-07-14 18:09:24.0 ConsumerErrorReceiver forwards errors and HRR requests from SVXMon and these processes are very important to data taking! Restart SVXMon immediately!" We think that this is related to our current COT problem. So we will ignore this message until COT is recovered and we get back into active state.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->



<!-- Date: Mon Jul 14 19:51:44.583 2008 -->
We got a Plug HV trip in HALTED state. LED 11 (East Plug) was off on Plug HV Control. We followed the instructions on the plug HV ace help page: we killed the programs, reset the crate (the LED turned red) and restarted the programs again. This fixed the problem.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->


<!-- Date: Mon Jul 14 20:10:27.152 2008 -->
<pre>COT experts Bob Wagner and Morris Binkley still at work.  They have the voltage up at the moment so we are taking data. </pre>
<!-- Author: herndon :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->

<!-- Date: Mon Jul 14 20:18:53.802 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744>264744</A>
general: <tt>CO checklist completed; Status - OK.</tt>
<!-- Author: Consumer Operator(David Clark) -->



<!-- Date: Mon Jul 14 20:22:26.603 2008 -->
Plug HV trip. LED 1 (West Plug) was off on Plug HV Control. We followed the instructions on the plug HV ace help page: we killed the programs, reset the crate (the LED turned red) and restarted the programs again. This fixed the problem.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->


<!-- Date: Mon Jul 14 20:27:40.521 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-3589&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-3590  width='300' align='top'></a></td><td>ISL VBIAS B0W0L3 current pinky 
1uA jump.</td></tr></table>
<!-- Author: herndon -->


<!-- Date: Mon Jul 14 20:32:49.384 2008 -->
Done TO for b0pcal10. Shepherding fixed it.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->


<!-- Date: Mon Jul 14 21:36:39.210 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-3591&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-3592  width='300' align='top'></a></td><td>ISL Bias B0W0L3 current currnt</td></tr></table>
<!-- Author: herndon -->
<!-- Comment: Mon Jul 14 21;37;07 comment by...herndon -->
Current jump is small.  Ingnored


<!-- Date: Mon Jul 14 21:37:18.227 2008 -->
 
During recovery from HALTED state b0pcal02 got stuck. Shepherding fixed it.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->
<!-- Comment: Mon Jul 14 21;39;01 comment by...Jan -->
It was immediately followed by a FERML_TM2_HEVB2B_EVENTS_PENDING_TIMEOUT. Auto HRR fixed it.


<!-- Date: Mon Jul 14 21:44:02.896 2008 -->
Earlier this shift P12 in SL2 started tripping.  It behaved like a "glow" with a DC current of a few hundred microamps which would quickly cause a SOC trip.  It tripped three times in quick succession.  So we added an auxilliary supply to try to determine which quadrant was tripping.  This way we determined that it was quadrant A.  The auxillary supply is now connected to SL2, P12A and set 10 volts below nominal voltage.  The chamber ran for about 45 minutes in this new configuration before tripping.  After this last trip, we moved the transformer with auxillary capacitors from SL8, P12B to SL2, P12A in an attempt to get some spike triggers to determine which cell is causing the problem in SL2.  If there is another trip. the shift crew can try to reset it once; if there are subsequent trips they should call an expert.  Aseet has been informed of the situation.  
<!-- Author: Morris and Bob :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->
<!-- Comment: Mon Jul 14 21;53;04 comment by...herndon -->
COT lasted about 1 minute after they left.  Tripped again, but this time in SL8.

<!-- Comment: Mon Jul 14 22;03;50 comment by...herndon -->
Reset voltage.  Bob Wagner came back and is looking at the problem.


<!-- Comment: Mon Jul 14 22;31;16 comment by...herndon -->
Please note above that the 45 minutes waiting for a trip after connecting sector A to the auxillery power supply resulted in two downtimes with a data taking period inbetween.  The second downtime would have been short but the plug crate problem extended it.
<!-- Date: Mon Jul 14 22:16:06.420 2008 -->
Plug HV trip. LED 11 (West Plug) was off on Plug HV Control. We followed the instructions on the plug HV ace help page: we killed the programs and reset the crate. However the LED didn't turn red this time. So I switched the crate off and waited for five minutes. The LED didn't come back afterwards. So we tried another reset. This one worked. Finally we are taking data again now.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->

<!-- Date: Mon Jul 14 22:22:11.202 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744>264744</A>
general: <tt>CO checklist completed; status - OK.</tt>
<!-- Author: Consumer Operator(David Clark) -->




<!-- Date: Mon Jul 14 22:35:56.081 2008 -->
Done TO for b0pcal04. Shepherding fixed it.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->


<!-- Date: Mon Jul 14 22:52:59.636 2008 -->
CER_SVXMON_HALT_RECOVER_RUN_ERROR !!! Stuck Cellid S/B2/W4/L4/C7-13 
Auto HRR fixed it.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->

<!-- Date: Mon Jul 14 23:53:30.985 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744>264744</A>
general: <tt>CO checklist completed; status - OK.</tt>
<!-- Author: Consumer Operator(David Clark) -->



<!-- Date: Mon Jul 14 23:54:44.016 2008 -->
RXPT Error for b0pcal11. Auto HRR fixed it. It was immediately followed by a L2 decision TO. This was fixed by another Auto HRR. Afterwards ACTIVE became red. A manual HRR fixed this.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=264744' target=_top>264744</a>) -->

<!-- Date: Mon Jul 14 23:55:08.694 2008 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=264744 target=_runSummary>264744</A> x40A28</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [7,1095,721]</FONT></TD>
<TD ALIGN=CENTER>16:13:28</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>03:47:47</TD>
<TD ALIGN=RIGHT>   1,897,952</TD>   <TD ALIGN=RIGHT>  4,927.07</TD>
<TD ALIGN=RIGHT>  2,419.37</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>23:55:01</TD>
<TD ALIGN=CENTER>03:47:47</TD>
<TD ALIGN=RIGHT>     1,897,952</TD> <TD ALIGN=RIGHT>  4,927.07</TD>
<TD ALIGN=RIGHT>  2,419.37</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Jul 15 00:00:38.440 2008 -->
<font color=red>Shift Summary: </font><pre>Store 6297 done scraping right after shift started. 
 
Early running has 15% dead time dominated by: 
  CMX single muon 3D 
  CMX muon + track 3D(why is this trigger not prescaled?) 
 
COT trip on SL2 Sector A led to two large downtimes 
COT experts(Bob Wagner and Morris Binkley) isolated trip and connected monitoring euqipement 
Left instructions to call an expert in COT trips more than once. 
COT trip on SL8 recovered, call expert in another trip occurs. 
 
Several plug crates had to be rebooted.  11 twice, 1 once 
Second crate 11 trip required going to step 2 recovery. 5 minutes power cycle. 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   264744
Delivered Luminosity   5004.1  
Acquired Luminosity    2444.2  
Efficiency             48.8
   
</td></tr></table></pre>
<!-- Author: herndon -->
<!-- Comment: Tue Jul 15 00;02;43 comment by...herndon -->
One silicon pinky that occured twice and was ignored on the second time.  1uA jump