<!-- Title: Eve shift. Wed Aug 13, 2008 -->
<!-- SciCo: Marco Rescigno -->
<!-- DAQAce: Mohammad Hussein -->
<!-- MonAce: &nbsp; -->
<!-- CO: Mark Neubauer -->
<!-- OpManager: Massimo Casarsa -->
<!-- Notes: -->
<pre>Store 6357 collding  
B0Lum 194 E30 run 266048 ongoing</pre>


<!-- Date: Wed Aug 13 16:30:39.818 2008 -->
Some Level 3 subfarms are almost red - such as s04p03 to 22 and s11p02 to 21 and others- The busy total deadtime is zero and we are taking data smoothly. We are paging an expert just in case...
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266048' target=_top>266048</a>) -->
<!-- Comment: Wed Aug 13 17;36;21 comment by...Conor and Pasha -->
This run was started from IDLE. That's why some subfarms were not taking data and giving strange colors in the display. This problem is fixed by starting a new run, making sure to reset and partition again.
<!-- Date: Wed Aug 13 16:42:40.520 2008 -->
Busy Timeout. Auto HRR was issued.
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266048' target=_top>266048</a>) -->
<!-- Comment: Wed Aug 13 16;59;11 comment by...mohammad -->
again
<!-- Date: Wed Aug 13 16:55:26.398 2008 -->
Cryo alarm, FIMF. went away...
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266048' target=_top>266048</a>) -->
<!-- Comment: Wed Aug 13 17;00;34 comment by...mohammad -->
again


<!-- Comment: Wed Aug 13 19;20;47 comment by...mohammad -->
and again
<!-- Comment: Wed Aug 13 22;17;08 comment by...phil -->
this is the problem we tried to solve between stores and which seems to have gotten us at 1830h tripping the solenoid
<!-- Date: Wed Aug 13 17:13:10.613 2008 -->
pcal05 failed. shepherded it.
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266048' target=_top>266048</a>) -->

<!-- Date: Wed Aug 13 17:13:46.405 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266048>266048</A>
 Terminated at 2008.08.13 17:13:14
<!-- Author: RunControl -->


<!-- Date: Wed Aug 13 17:14:59.821 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266048>266048</A>
TERMINATE: a weird error pup up did shift the run to IDLE state .
<!-- Author: Mohammad -->


<!-- Date: Wed Aug 13 17:17:50.773 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049>266049</A>
 Activated at 2008.08.13 17:17:29
<!-- Author: RunControl -->


<!-- Date: Wed Aug 13 17:17:51.681 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049>266049</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_5_01 [9,1119,725] 
<!-- Author: Mohammad -->



<!-- Date: Wed Aug 13 17:25:31.202 2008 -->
I got this weird error message: 
(( Client errmon reports the error: b0csl20.fnal.gov:cls_mon_send:Aug13,2008 05:13:14pm Logger partition 0 cannot log this event, Run 266048 not accepted. Last run=266408. End of this run is STRONGLY recommended . The client h...)) 
The message wasnt completed to tell us what the client problem was. 
However,the run turned to the IDLE state by itself giving a red color to the evb2b crate. I reset the run and run again and every thing now seems ok. One good thing out of this weird error is that L3 display is working well now. Last point, this error came out few seconds after successfully shepherding pcal05. 
<!-- Author: Mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->
<!-- Comment: Wed Aug 13 18;45;46 comment by...Willis -->
The EVB/L3 probably sent the CSL badly formatted events that the
CSL rejected.  
<!-- Date: Wed Aug 13 17:58:16.401 2008 -->
Timeout in imu_01. Auto HRR was issued.
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->


<!-- Date: Wed Aug 13 18:24:30.633 2008 -->
Plug HV 04 Trip. Killing and reloading the Plug HV monitor program. 
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->


<!-- Date: Wed Aug 13 18:28:31.493 2008 -->
Solenoid problem. Field dropped to 12000 Gauss or lower,  
cryo tech working on it.
<!-- Author: Scico :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->


<!-- Date: Wed Aug 13 18:28:56.934 2008 -->
Solenoid alarm, There is a red circle beside the word TRIP . 
This alarm comes and goes at this moment. 
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->
<!-- Comment: Wed Aug 13 18;36;06 comment by...mohammad -->
Trigger inhibits from B field and TOF. COT is stand by now. Waiting a call from the Cryo when they fix it. The field right now is about 11000 gauss.


<!-- Comment: Wed Aug 13 18;52;14 comment by...Scico -->
Helium flow too low tripped the magnet. Flow has been restored and we are back to full field now (13702 Gauss).

<!-- Comment: Wed Aug 13 18;55;45 comment by...mohammad -->
We are running back now...


<!-- Date: Wed Aug 13 18:58:56.550 2008 -->
COT expert here to fix COT HVMon in control room which appears not to be working.
<!-- Author: Scico -->
<!-- Comment: Wed Aug 13 19;14;10 comment by...Scico -->
Program restarted, now OK, actual HV from downstair program OK.
<!-- Date: Wed Aug 13 19:04:16.261 2008 -->
pcal07 failed. shepherded it.
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->
<!-- Comment: Wed Aug 13 21;55;22 comment by...mohammad -->
again
<!-- Date: Wed Aug 13 19:18:41.076 2008 -->
Timeout in cot16. Auto HRR was issued.
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->
<!-- Comment: Wed Aug 13 20;01;08 comment by...mohammad -->
again
<!-- Comment: Wed Aug 13 20;47;30 comment by...mohammad -->
again
<!-- Comment: Wed Aug 13 21;01;10 comment by...mohammad -->
and again
<!-- Comment: Wed Aug 13 21;30;44 comment by...mohammad -->
again
<!-- Comment: Wed Aug 13 22;20;06 comment by...mohammad -->
again
<!-- Comment: Wed Aug 13 23;04;52 comment by...mohammad -->
again
<!-- Date: Wed Aug 13 19:49:08.284 2008 -->
SVX02 has been tripped. It did recover by itself. The active button turned red. HRR fixed it. 
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->



<!-- Date: Wed Aug 13 20:09:09.186 2008 -->
CER_SVXMON_HALT_RECOVER_RUN_ERROR; Stuck Cellid I/B3/W0/L0/C0-3. This was followed by L2 timeout. Auto HRR fixed the error.  
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->

<!-- Date: Wed Aug 13 20:13:36.394 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266048>266048</A>
<HTML>Run <A HREF=http://www-cdfonline.fnal.gov/java/cdfdb/servlet/RunSummary?RUN=266048 target=_runSummary>266048</A> has not yet been checked for goodrun status; please do so.</HTML>
<!-- Author: RunControl -->



<!-- Date: Wed Aug 13 20:40:15.866 2008 -->
pcal08 failed. shepherded it. CMP HV -bottom A3,D3- tripped. turn it on. 
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->
<!-- Comment: Wed Aug 13 20;42;35 comment by...mohammad -->
after few seconds, got the same trip. This time I pulled the bars up. 



<!-- Date: Wed Aug 13 20:53:27.012 2008 -->
Timeout in cot07. Auto HRR was issued.
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->




<!-- Date: Wed Aug 13 22:13:43.561 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049>266049</A>
cal: <tt>Hot WHA channel (-11 eta tower, phi wedge 5) not in reference</tt>
<!-- Author: Consumer Operator( Mark Neubauer) -->






<!-- Date: Wed Aug 13 23:28:19.740 2008 -->
timeout in pcal11. Auto HRR was issued.
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->


<!-- Date: Wed Aug 13 23:42:34.461 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4063&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4064  width='300' align='top'></a></td><td>Pinkie set to ignore</td></tr></table>
<!-- Author: Scico -->
<!-- Comment: Wed Aug 13 23;43;14 comment by...Scico -->
VBIAS1 ISL B3W2L0


<!-- Date: Wed Aug 13 23:46:07.374 2008 -->
Timeout in imu00. Auto HRR was issued.
<!-- Author: mohammad :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->

<!-- Date: Wed Aug 13 23:56:28.126 2008 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=266048 target=_runSummary>266048</A> x40F40</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [9,1119,725]</FONT></TD>
<TD ALIGN=CENTER>14:53:57</TD>
<TD ALIGN=CENTER>17:13:14</TD>
<TD ALIGN=CENTER>02:03:06</TD>
<TD ALIGN=RIGHT>   1,124,210</TD>   <TD ALIGN=RIGHT>  1,658.75</TD>
<TD ALIGN=RIGHT>  1,449.06</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=266049 target=_runSummary>266049</A> x40F41</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [9,1119,725]</FONT></TD>
<TD ALIGN=CENTER>17:17:29</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>05:34:49</TD>
<TD ALIGN=RIGHT>   2,606,612</TD>   <TD ALIGN=RIGHT>  3,052.16</TD>
<TD ALIGN=RIGHT>  2,527.69</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>23:55:01</TD>
<TD ALIGN=CENTER>07:37:56</TD>
<TD ALIGN=RIGHT>     3,730,822</TD> <TD ALIGN=RIGHT>  4,710.91</TD>
<TD ALIGN=RIGHT>  3,976.75</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Wed Aug 13 23:58:38.472 2008 -->
<font color=red>Shift Summary: </font><pre>Inherited store 6357 colliding at 195 E30 
 
Run 266048 had problem with L3 subfarm not receiving events because Run has not  
started from "Start" as yesterday night. Run terminated automatically on  
csl problem. Next Run 266049 started OK.  
Too low Helium flow tripped the solenoid, COT, TOF tripped too. 
Cryo restored Helium flow and full B field reached at around 18:50  
(20 min. lost). 
 
Some CMP trips (bottom A3,D3). 
 
Quiet evening 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   266048-266049
Delivered Luminosity   3911 nb-1  
Acquired Luminosity    3285 nb-1  
Efficiency             84.0 %
   
</td></tr></table></pre>
<!-- Author: Marco Rescigno  -->


<!-- Date: Wed Aug 13 23:59:25.046 2008 -->
b0pcal10 became unresponsive. Shepherded it.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->


<!-- Date: Thu Aug 14 00:01:14.618 2008 -->
b0cot14 became unresponsive during Recover transition. Shepherded it.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->


<!-- Date: Thu Aug 14 00:03:40.080 2008 -->
FERML_TM2_HEVB2B_EVENTS_PENDING_TIMEOUT !!! 
AUTO HRR fixed it.
<!-- Author: Jan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=266049' target=_top>266049</a>) -->