<!-- Title: Eve shift. Thu Dec 21, 2006 -->
<!-- SciCo: Roberto Carosi -->
<!-- DAQAce: Timo Aaltonen -->
<!-- MonAce: Till Hoffmann -->
<!-- CO: Ai Nagano -->
<!-- OpManager: Koji Sato -->
<!-- Notes: -->
<pre>Waiting for shot setup. According to the RC elog, it is expected 
at about 20:00.</pre>


<!-- Date: Thu Dec 21 16:10:28.768 2006 -->
Aces should be aware of the new instructions for Silicon trips, 
given in the previous elog at 14:14.
<!-- Author: Roberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230712' target=_top>230712</a>) -->


<!-- Date: Thu Dec 21 17:35:33.224 2006 -->
Done TO in COT17; event builder error right after HRR. We shepherded COT17. In error again. More to follow.
<!-- Author: Timo/Till :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230712' target=_top>230712</a>) -->
<!-- Comment: Thu Dec 21 17;55;31 comment by...Till -->
<br>After some more shepherdings, we paged Bill Badgett. He is currently hacking the COT crates (we have several corrupt heaps and other errors in all the COTXX crates).


<!-- Comment: Thu Dec 21 18;17;07 comment by...Timo/Till -->
We got to reset and  then reboot the muon camac branch driver crate (aka c0muca00) in the process. That was fun.
<!-- Comment: Thu Dec 21 18;47;30 comment by...Timo -->
After last comment everything has been fine.
<!-- Date: Thu Dec 21 17:58:40.009 2006 -->
<P> 
Talked to Eric James on the phone, and he suggested doing  
the things we were already doing;   one new thing he  
suggested is to end the run and clean up the Event Builder;   
this tends to get the EVB people mad, but perhaps is worth  
a try, and so I have cleaned it up. 
<P> 
Also, we haven't had an en-masse front-end crate reboot  
in a while, so i did that. 
<P> 
  
<!-- Author: badgett -->

<!-- Date: Thu Dec 21 18:07:01.341 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230754>230754</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] 
<!-- Author: Tatiana -->
<!-- Comment: Thu Dec 21 18;13;50 comment by...Timo -->
That was me...



<!-- Date: Thu Dec 21 18:18:05.125 2006 -->
Looks like one of the plug CAEN crates is giving problems. Timo is upstairs to investigate.
<!-- Author: Till :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230754' target=_top>230754</a>) -->
<!-- Comment: Thu Dec 21 18;20;18 comment by...Timo -->
Now it is fine. I didnt found any problems in upstairs.


<!-- Date: Thu Dec 21 19:16:18.544 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230754>230754</A>
TERMINATE: Preparing for shot setup.
<!-- Author: Timo -->


<!-- Date: Thu Dec 21 19:20:33.479 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230761>230761</A>
 Activated at 2006.12.21 19:19:52
<!-- Author: RunControl -->


<!-- Date: Thu Dec 21 19:20:34.037 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230761>230761</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,730,639] 
<!-- Author: Timo -->


<!-- Date: Thu Dec 21 19:23:11.348 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230761>230761</A>
 Terminated at 2006.12.21 19:21:50
<!-- Author: RunControl -->


<!-- Date: Thu Dec 21 19:23:12.638 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230761>230761</A>
TERMINATE: Three times in a row L2 timeout. Last time ending the run and starting the new one cleared the problem.
<!-- Author: Timo -->


<!-- Date: Thu Dec 21 19:29:45.543 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230762>230762</A>
 Activated at 2006.12.21 19:25:09
<!-- Author: RunControl -->


<!-- Date: Thu Dec 21 19:29:46.817 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230762>230762</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,730,639] 
<!-- Author: Timo -->



<!-- Date: Thu Dec 21 20:43:53.481 2006 -->
Our daily ICICLE heartbeat alarm. Restarted it.
<!-- Author: Timo :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230762' target=_top>230762</a>) -->


<!-- Date: Thu Dec 21 21:49:47.062 2006 -->
Our dear friend COT02 again giving errors. First auto HRR and now manual shepperding.
<!-- Author: Timo :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230762' target=_top>230762</a>) -->
<!-- Comment: Thu Dec 21 21;52;26 comment by...Timo -->
And again. We now change to shot setup. If problem continues we page the expert.
<!-- Date: Thu Dec 21 21:51:42.660 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230762>230762</A>
 Terminated at 2006.12.21 21:51:08
<!-- Author: RunControl -->


<!-- Date: Thu Dec 21 21:51:43.558 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230762>230762</A>
TERMINATE: To shot setup.
<!-- Author: Timo -->




<!-- Date: Thu Dec 21 21:53:30.850 2006 -->
Final protons loaded.
<!-- Author: Roberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230762' target=_top>230762</a>) -->

<!-- Date: Thu Dec 21 21:55:40.740 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230766>230766</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Timo -->


<!-- Date: Thu Dec 21 21:56:40.017 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230766>230766</A>
TERMINATE: L2, once again.
<!-- Author: Timo -->


<!-- Date: Thu Dec 21 22:02:45.023 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230768>230768</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_4_01 [2,852,663] <br>
Short test for L2puls00
<!-- Author: Till -->
<!-- Comment: Thu Dec 21 22;10;02 comment by...Till -->
<br>Had a couple of L2 decision TOs ("waiting for Clusterfinder data") that HRRed fine.

<!-- Comment: Thu Dec 21 22;21;22 comment by...Timo -->
2 more...


<!-- Comment: Thu Dec 21 22;32;34 comment by...Timo -->
2 more...
<!-- Comment: Thu Dec 21 22;35;56 comment by...Timo -->
Had those 4 more. Now changing the run configuration.
<!-- Date: Thu Dec 21 22:26:58.396 2006 -->
pbars loaded.
<!-- Author: Roberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230768' target=_top>230768</a>) -->


<!-- Date: Thu Dec 21 22:35:27.439 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230768>230768</A>
TERMINATE: Preparing for the data.
<!-- Author: Timo -->




<!-- Date: Thu Dec 21 22:53:08.356 2006 -->
Store # 5143, scraping complete.
<!-- Author: Roberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230769' target=_top>230769</a>) -->


<!-- Date: Thu Dec 21 22:54:23.662 2006 -->
<TABLE bgcolor=#add8e6> 
<TR><TH>Date</th><th>Time</th><th colspan=3>Quantity</th></tr> 
<tr><td>2006.12.21</td><td>22:49:09</td><td>C:B0ILUM</td><td>0.00</td><td>E30</td></tr> 
<tr><td>2006.12.21</td><td>22:49:09</td><td>C:B0LLUM</td><td>0.00</td><td>E30</td></tr> 
<tr><td>2006.12.21</td><td>22:49:09</td><td>C:B0PLOS</td><td>4538.11</td><td>Hz</td></tr> 
<tr><td>2006.12.21</td><td>22:49:09</td><td>C:B0ALOS</td><td>69.28</td><td>Hz</td></tr> 
<tr><td>2006.12.21</td><td>22:52:30</td><td>TEVpr</td><td>8586.12</td><td>E09</td></tr> 
<tr><td>2006.12.21</td><td>22:52:30</td><td>TEVpb</td><td>1807.74</td><td>E09</td></tr> 
</TABLE> 
<strong>Luminosity and losses</strong>
<!-- Author: Roberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230769' target=_top>230769</a>) -->


<!-- Date: Thu Dec 21 22:55:44.494 2006 -->
Initial luminosity  178.8 e30
<!-- Author: Roberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230769' target=_top>230769</a>) -->

<!-- Date: Thu Dec 21 22:59:07.503 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230769>230769</A>
 Activated at 2006.12.21 22:58:55
<!-- Author: RunControl -->


<!-- Date: Thu Dec 21 22:59:08.418 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230769>230769</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Timo -->



<!-- Date: Thu Dec 21 22:59:35.153 2006 -->
CMP lost the race this time. It tripped.
<!-- Author: Timo :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230769' target=_top>230769</a>) -->


<!-- Date: Thu Dec 21 23:10:48.632 2006 -->
<center><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-16561&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-16561' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-16562&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-16562' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-16563&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-16563' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-16564&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-16564' width='300'></a></center>
<!-- Author: Till: shot setup -->


<!-- Date: Thu Dec 21 23:13:20.832 2006 -->
At the beginning of the run b0l2pu01 was extremely slow. This caused long delays and eventually L2DTO. Took me a while to figure that out and then power cycled the crate. Things seem ok now, but I have no idea what the cause for this slow motion was. Oh well, not the first or the last thing I have no clue about...
<!-- Author: VR :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230769' target=_top>230769</a>) -->


<!-- Date: Thu Dec 21 23:13:30.365 2006 -->
<pre> 
*** Node b0pcal10 in Error *** 
Heap is Corrupt 
</pre> 
 
Manually shepperded.
<!-- Author: Timo :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230769' target=_top>230769</a>) -->
<!-- Comment: Thu Dec 21 23;16;24 comment by...Timo -->
Failed. Shepperding again.
<!-- Comment: Thu Dec 21 23;17;30 comment by...Timo -->
This time success.
<!-- Date: Thu Dec 21 23:14:54.451 2006 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2006&action=view&page=-16565&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2006&action=view&page=-16566  width='300' align='top'></a></td><td>Pink cell AVDD B1 W8 L4, current 1015.0</td></tr></table>
<!-- Author: Roberto -->




<!-- Date: Thu Dec 21 23:30:39.205 2006 -->
We set up b0l2pu00 with one pulsar loaded with one L2CAL mezz card and one merger for the incoming L2CAL tests. This crate is not in the configuration so this should not affect data taking.
<!-- Author: L2CAL crowd :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230769' target=_top>230769</a>) -->


<!-- Date: Thu Dec 21 23:50:42.187 2006 -->
Phys run 230769 starting 30 min after plot checked. OK.
<!-- Author: Ai :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230769' target=_top>230769</a>) -->


<!-- Date: Thu Dec 21 23:52:16.281 2006 -->
Our daily RTServer alarm. One minute and fine.
<!-- Author: Timo :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=230769' target=_top>230769</a>) -->

<!-- Date: Thu Dec 21 23:55:26.599 2006 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=230769 target=_runSummary>230769</A> x38571</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_01 [2,852,663]</FONT></TD>
<TD ALIGN=CENTER>22:58:55</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>00:40:01</TD>
<TD ALIGN=RIGHT>     294,225</TD>   <TD ALIGN=RIGHT>    440.47</TD>
<TD ALIGN=RIGHT>    373.40</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>23:55:01</TD>
<TD ALIGN=CENTER>00:40:01</TD>
<TD ALIGN=RIGHT>       294,225</TD> <TD ALIGN=RIGHT>    440.47</TD>
<TD ALIGN=RIGHT>    373.40</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Thu Dec 21 23:56:46.000 2006 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2006&action=view&page=-16567&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2006&action=view&page=-16568  width='300' align='top'></a></td><td>During readout of CEM: status bar sez <i>off</i>.</td></tr></table>
<!-- Author: Till -->
<!-- Comment: Fri Dec 22 09;16;13 comment by...m mattson -->
This is normal and likely not a problem.  Under the Monitoring Ace web page, check the
<a href="http://www-cdfonline.fnal.gov/ops/mcs/cencal/troubleshooting.html">iFix CEM/CHA/WHA troubleshooting link</a>,
about halfway down is "CEM, CHA, or WHA HV summary bars disappear (detector HV readout in progress)".
<!-- Date: Thu Dec 21 23:58:52.334 2006 -->
<font color=red>Shift Summary: </font><pre>16:00 Waiting for shot setup. According to the RC elog, it is       expected at about 20:00. 
 
17:35 Problems with COT crate 17, DAQ expert paged, then TDC. 
 
22:50 Store 5143 started with initial luminosity 179e30. 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   230769
Delivered Luminosity   526.3 nb-1  
Acquired Luminosity    397.9 nb-1  
Efficiency             75.6%
   
</td></tr></table></pre>
<!-- Author: Roberto -->