<!-- Title: Owl shift. Tue Jan 15, 2008 -->
<!-- SciCo: DongHee Kim -->
<!-- DAQAce: Si Xie -->
<!-- MonAce: &nbsp; -->
<!-- CO: Konstantinos Velidis -->
<!-- OpManager: &nbsp; -->
<!-- Notes: -->
<pre>Expect shot setup very soon 
</pre>

<!-- Date: Tue Jan 15 00:12:38.369 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256320>256320</A>
 Terminated at 2008.01.15 00:12:13
<!-- Author: RunControl -->


<!-- Date: Tue Jan 15 00:12:39.087 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256320>256320</A>
TERMINATE: let's try putting back subfarms 16,17,18.
<!-- Author: Si Xie -->


<!-- Date: Tue Jan 15 00:14:52.208 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256321>256321</A>
 Activated at 2008.01.15 00:14:38
<!-- Author: RunControl -->


<!-- Date: Tue Jan 15 00:14:53.458 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256321>256321</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706] 
<!-- Author: Si Xie -->



<!-- Date: Tue Jan 15 00:32:00.774 2008 -->
MCR called that the shot setup will be started very soon.
<!-- Author: scico :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256321' target=_top>256321</a>) -->


<!-- Date: Tue Jan 15 00:39:23.277 2008 -->
Conor called back and informed us that he has cleaned up the disks on subfarms 16,17, and 18. He also updated the cleanup scripts to remove anomalously large log files. Hopefully this fixes the problem with Level3 when we introduce new trigger tables.
<!-- Author: Si :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256321' target=_top>256321</a>) -->


<!-- Date: Tue Jan 15 00:50:43.847 2008 -->
00:45:26-   HEP shot setup. 
<!-- Author: scico :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256321' target=_top>256321</a>) -->


<!-- Date: Tue Jan 15 01:41:41.122 2008 -->
Done Timeout for b0musc00. (MUON_SCINT_00). This is a new one, I've never seen a Done Timeout from this one.
<!-- Author: Si :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256321' target=_top>256321</a>) -->

<!-- Date: Tue Jan 15 01:43:22.065 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256321>256321</A>
 Terminated at 2008.01.15 01:42:48
<!-- Author: RunControl -->


<!-- Date: Tue Jan 15 01:43:23.137 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256321>256321</A>
TERMINATE: stop to run shot setup mode.
<!-- Author: Si Xie -->


<!-- Date: Tue Jan 15 01:47:37.680 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256322>256322</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_5_01 [3,1016,713] 
<!-- Author: Si Xie -->


<!-- Date: Tue Jan 15 01:51:52.194 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256322>256322</A>
TERMINATE: csl logger queue is red. have to restart it.
<!-- Author: Si Xie -->



<!-- Date: Tue Jan 15 01:57:50.743 2008 -->
I restarted the CSL, because the logger queues were full and showing red. The restart script didn't work so I did the "manual cleanup". Sent an email to the csl group mail list. Also cleaned up L3 after the csl restart.
<!-- Author: Si -->

<!-- Date: Tue Jan 15 02:01:09.244 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256323>256323</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_5_01 [3,1016,713] 
<!-- Author: Si Xie -->



<!-- Date: Tue Jan 15 02:11:26.809 2008 -->
Final protons loaded, 10,326e9
<!-- Author: scico :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256323' target=_top>256323</a>) -->


<!-- Date: Tue Jan 15 02:13:38.297 2008 -->
page Silicon and ops manager
<!-- Author: scico :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256323' target=_top>256323</a>) -->


<!-- Date: Tue Jan 15 02:31:46.429 2008 -->
Silicon MPC in control room now
<!-- Author: scico :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256323' target=_top>256323</a>) -->


<!-- Date: Tue Jan 15 02:44:27.530 2008 -->
There was a heartbeat alarm for The muon detectors + CES. I went to Muon3, and there was a virus check program running on it. Nothing else was wrong. I closed the virus check program. The heartbeat came back after about 4min while I was trying to figure out what was wrong with it. Looks like the virus check was interfering with the heartbeats??
<!-- Author: Si :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256323' target=_top>256323</a>) -->


<!-- Date: Tue Jan 15 02:59:19.408 2008 -->
Pbar has been loaded : 2132e9
<!-- Author: scico :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256323' target=_top>256323</a>) -->

<!-- Date: Tue Jan 15 03:01:05.081 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256323>256323</A>
TERMINATE: go to physics table
<!-- Author: Si Xie -->



<!-- Date: Tue Jan 15 03:16:28.317 2008 -->
Scraping complete at 03:16. Store # 5846 
<!-- Author: scico :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256324' target=_top>256324</a>) -->


<!-- Date: Tue Jan 15 03:17:46.138 2008 -->
2008.01.15	03:16:26	TEVpr	8580.215	E09 
2008.01.15	03:16:26	TEVpb	2042.396	E09
<!-- Author: scico :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256324' target=_top>256324</a>) -->


<!-- Date: Tue Jan 15 03:21:21.994 2008 -->
Initial luminosity : 197.598	E30
<!-- Author: scico :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256324' target=_top>256324</a>) -->

<!-- Date: Tue Jan 15 03:22:50.077 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256324>256324</A>
 Activated at 2008.01.15 03:22:15
<!-- Author: RunControl -->


<!-- Date: Tue Jan 15 03:22:51.488 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256324>256324</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_5_01 [3,1016,713] 
<!-- Author: Si Xie -->



<!-- Date: Tue Jan 15 03:27:18.071 2008 -->
<center><a href='/cgi/elog/elog.pl?nb=2008&action=view&page=-402&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2008&action=view&page=-402' width='300'></a><a href='/cgi/elog/elog.pl?nb=2008&action=view&page=-403&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2008&action=view&page=-403' width='300'></a></center>
<!-- Author: Losses and SVRAD during scraping -->


<!-- Date: Tue Jan 15 03:43:03.252 2008 -->
L2 Decision TO - 03:42:30
<!-- Author: Si :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256324' target=_top>256324</a>) -->
<!-- Comment: Tue Jan 15 04;56;27 comment by...Si -->
L2 Decision TO - 04:56:01
<!-- Comment: Tue Jan 15 05;28;25 comment by...Si -->
L2 Decision TO - 05:27:55
<!-- Comment: Tue Jan 15 05;51;26 comment by...Si -->
L2 Decision TO - 05:51:08
<!-- Comment: Tue Jan 15 06;29;40 comment by...Si -->
L2 Decision TO - 06:29:04
<!-- Date: Tue Jan 15 03:57:26.248 2008 -->
There was a Silicon auto hockerization. We are powering them back up.
<!-- Author: Si :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256324' target=_top>256324</a>) -->


<!-- Date: Tue Jan 15 03:57:49.372 2008 -->
Meanwhile, pcal11 was unresponsive. I shepherded it.
<!-- Author: Si :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256324' target=_top>256324</a>) -->

<!-- Date: Tue Jan 15 04:08:13.146 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256324>256324</A>
 Terminated at 2008.01.15 04:07:06
<!-- Author: RunControl -->


<!-- Date: Tue Jan 15 04:08:14.542 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256324>256324</A>
TERMINATE: Silicon wants to do a config
<!-- Author: Si Xie -->


<!-- Date: Tue Jan 15 04:12:10.518 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256325>256325</A>
 Activated at 2008.01.15 04:10:48
<!-- Author: RunControl -->


<!-- Date: Tue Jan 15 04:12:11.539 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256325>256325</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_5_01 [3,1016,713] 
<!-- Author: Si Xie -->


<!-- Date: Tue Jan 15 04:16:21.638 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256325>256325</A>
 Terminated at 2008.01.15 04:13:15
<!-- Author: RunControl -->


<!-- Date: Tue Jan 15 04:16:22.318 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256325>256325</A>
TERMINATE: something wrong with L2
<!-- Author: Si Xie -->


<!-- Date: Tue Jan 15 04:18:30.291 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256326>256326</A>
 Activated at 2008.01.15 04:17:57
<!-- Author: RunControl -->


<!-- Date: Tue Jan 15 04:18:31.984 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256326>256326</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_5_01 [3,1016,713] 
<!-- Author: Si Xie -->


<!-- Date: Tue Jan 15 04:18:32.630 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256326>256326</A>
 Terminated at 2008.01.15 04:18:05
<!-- Author: RunControl -->


<!-- Date: Tue Jan 15 04:18:33.743 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256326>256326</A>
TERMINATE: L2 bad
<!-- Author: Si Xie -->



<!-- Date: Tue Jan 15 04:20:08.582 2008 -->
page L2 expert
<!-- Author: scico :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256326' target=_top>256326</a>) -->
<!-- Comment: Tue Jan 15 04;35;02 comment by...Si -->
The L2 expert is rebooting the machine.

<!-- Comment: Tue Jan 15 04;45;08 comment by...Andrew -->
The L2 executable has died. Did a software reboot of the L2 PC.
<!-- Comment: Tue Jan 15 04;45;47 comment by...Si -->
After we started the new run to do config for silicon, We got a L2 Decision TO. Then it did an auto HRR. During Halt and Recover, the l2ctrlb client was taking over 30seconds. After we went to active, we did not get any L2 accepts. I checked the L2node logs and it says "dying gracefully". We paged L2 at that point. Then I tried starting another run just to see if it works in the meantime. It doesn't. I tried to follow instructions from the L2 webpage, but it requires the root password, which used to be on that webpage, but presumably got taken out by JJ or somebody else's request, rendering those particular instructions completely useless unless somebody writes down the password somewhere in the control room and tells the aces about it!!!....The Level2 pager carrier called us back after 10min or so, and rebooted the control node for us. It's now working.
<!-- Comment: Tue Jan 15 08;54;12 comment by...Laura -->
The executable hasn't been restarted in the correct way yesterday after L2 tests: otherwise restarting a new run would be the solution.
The password will be written to the SciCo notebook, in any case, as written in the web page, page L2 expert was the correct thing to do. The instructions should help pager carrier/ACE in case pager carrier can't connect immediately to a terminal.


<!-- Date: Tue Jan 15 04:39:52.607 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256327>256327</A>
 Activated at 2008.01.15 04:39:47
<!-- Author: RunControl -->


<!-- Date: Tue Jan 15 04:40:56.109 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256327>256327</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_5_01 [3,1016,713] 
<!-- Author: Si Xie -->
<!-- Comment: Tue Jan 15 04;48;00 comment by...Si -->
Unfortunately lost 30min, and 0.5pb^-1...:( probably was avoidable. Should have taken more like 5min.
<!-- Date: Tue Jan 15 04:44:11.083 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-404&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-404  width='300' align='top'></a></td><td>Found warning for too many errors in COT SL6 TrigSim vs Data Discrepancy</td></tr></table>
<!-- Author: Costas -->








<!-- Date: Tue Jan 15 06:08:11.023 2008 -->
Plug HV crate 10 has died. The check passed LED light is off. I am resetting it.
<!-- Author: Si :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256327' target=_top>256327</a>) -->
<!-- Comment: Tue Jan 15 06;12;03 comment by...Si -->
I reset crate 10, and the check passed LED light came back after a min. Then I restart the plug monitoring program. It had to wait for a second readout cycle for everything to turn green again. We are taking data again.



<!-- Date: Tue Jan 15 07:02:54.705 2008 -->
Done TO - b0pcal10. It was unresponsive to Halt so I shepherd it.
<!-- Author: Si :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=256327' target=_top>256327</a>) -->

<!-- Date: Tue Jan 15 07:55:11.608 2008 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=256324 target=_runSummary>256324</A> x3E944</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [3,1016,713]</FONT></TD>
<TD ALIGN=CENTER>03:22:15</TD>
<TD ALIGN=CENTER>04:07:06</TD>
<TD ALIGN=CENTER>00:28:23</TD>
<TD ALIGN=RIGHT>     307,245</TD>   <TD ALIGN=RIGHT>    490.67</TD>
<TD ALIGN=RIGHT>    312.87</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=256325 target=_runSummary>256325</A> x3E945</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [3,1016,713]</FONT></TD>
<TD ALIGN=CENTER>04:10:48</TD>
<TD ALIGN=CENTER>04:13:15</TD>
<TD ALIGN=CENTER>00:00:00</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT>     25.58</TD>
<TD ALIGN=RIGHT>      0.00</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>0</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=256326 target=_runSummary>256326</A> x3E946</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [3,1016,713]</FONT></TD>
<TD ALIGN=CENTER>04:17:57</TD>
<TD ALIGN=CENTER>04:18:05</TD>
<TD ALIGN=CENTER>00:00:00</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT>      1.95</TD>
<TD ALIGN=RIGHT>      0.00</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>0</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=256327 target=_runSummary>256327</A> x3E947</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [3,1016,713]</FONT></TD>
<TD ALIGN=CENTER>04:39:47</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>02:55:25</TD>
<TD ALIGN=RIGHT>   1,652,967</TD>   <TD ALIGN=RIGHT>  1,482.50</TD>
<TD ALIGN=RIGHT>  1,329.43</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>07:55:01</TD>
<TD ALIGN=CENTER>03:23:48</TD>
<TD ALIGN=RIGHT>     1,960,212</TD> <TD ALIGN=RIGHT>  2,000.71</TD>
<TD ALIGN=RIGHT>  1,642.30</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Jan 15 08:00:36.070 2008 -->
<font color=red>Shift Summary: </font><pre>Scraping complete at 03:16. Store # 5846 with initial luminosity : 197.598 E30 
 
downtime for ~ 30 min due to L2 dead. --&gt; responsible for low efficiency(70%)  
 
continuous data taking after L2 problem. 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   256324, 256327
Delivered Luminosity   2355.1 nb-1  
Acquired Luminosity    1667.5 nb-1  
Efficiency             70.8
   
</td></tr></table></pre>
<!-- Author: DongHee Kim -->