<!-- Title: Eve shift. Wed Mar  5, 2003 -->
<!-- SciCo: John Yoh -->
<!-- DAQAce: Kristian Hahn -->
<!-- MonAce: Kristian Hahn -->
<!-- CO: John Yoh -->
<!-- OpManager: Andy Hocker -->
<!-- Notes: -->
<pre>Hier sitz' ich  zur Wacht, wahre den Hof, 
wehre die Halle dem Feind.</pre>


<!-- Date: Wed Mar 5 16:18:38 2003 -->
PSM alarm. 2RR30C_1 briefly showed "Return Values = 0" for channels 0,1,3,4.  Cleared. 
<!-- Author: Kristian -->


<!-- Date: Wed Mar 5 16:28:04 2003 -->
Doing some tests with the hadron timing crate for Ron Moore.
<!-- Author: Kristian -->

<!-- Date: Wed Mar 5 16:31:14 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159822">159822</A>
TERMINATE: try again
<!-- Author: chun 2080 -->
<!-- Comment: Wed Mar  5 16;37;28 comment by...Kristian -->
Chun means Kristian ...
<!-- Date: Wed Mar 5 16:34:00 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159823">159823</A>
 Activated at 2003.03.05 16:33:38
<!-- Author: RunControl -->


<!-- Date: Wed Mar 5 16:34:01 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159823">159823</A>
ACTIVATE: htdc test
<!-- Author: chun 2080 -->



<!-- Date: Wed Mar 5 16:40:08 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159823">159823</A>
 Terminated at 2003.03.05 16:40:44
<!-- Author: RunControl -->


<!-- Date: Wed Mar 5 16:48:44 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159823">159823</A>
TERMINATE: lots of HRR's ... Forgot to take out the cot crates.  We're preparing for a Plug Laser run.
<!-- Author: Kristian -->


<!-- Date: Wed Mar 5 16:48:45 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159825">159825</A>
ACTIVATE: <PRE>Have changed the JDK version when you :

    setup fer

on a Linux+2.4 (RedHat 7.3) machine.   Now it will point 
to v1_4_0-ibm (rather than v1_4_1-02-sun).   Another 
desperate attempt to prevent JVM crashing on RedHat 7.3
</PRE>

<!-- Author: badgett -->



<!-- Date: Wed Mar 5 16:53:05 2003 -->
Replaced the tracer in cot07 to try to fix event id errors.
<!-- Author: Jane Nachtman, Bill Badgett -->

<!-- Date: Wed Mar 5 16:54:00 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159826">159826</A>
ACTIVATE: Plug laser claibration (normal-mode) begin's for the hadron timing people.
<!-- Author: Kristian -->



<!-- Date: Wed Mar 5 16:58:55 2003 -->
Please use caution if you choose to put HTML into an entry.  Forgetting to use a close tag for each open tag will certainly cause problems.  
 
If you choose to use plain text, PLEASE USE CR's since this text window automatically wraps the text and gives the illusion of CR's.  (click to clear this message)  
<!-- Author: ronmoore -->
<!-- Comment: Wed Mar  5 17;00;31 comment by...ronmoore -->
Yes, that is wise.  Too bad I forgot to click.


<!-- Date: Wed Mar 5 17:06:55 2003 -->
With Dave Toback's and Jane Nachtman's blessing, I have installed 
TDC #800, a prototype Rev E Michigan TDC, into the EM timing slot 
3 of the hadron TDC crate.  It should behave like any other TDC 
in terms of DAQ operation.  But, we do want to exercise it for 
at least a few days to verify that.  Caveats: 1) This TDC has 
not been calibrated at Michigan.  Hit times may be off 8-15 ns 
from expected times.  In principle, this problem can accounted 
for using laser calibration data offline.  2)  Don't try reprogramming this TDC's flashram without my help.  3) VME reads 
of flashram may give corrupt data, if you know what to look for. 
The DAQ does not read flashram under normal circumstances, so there should be no problem.  However, TDC Test *does* read flashram to get channel id's, so don't be surprised if this TDC 
fails TDC Test.  Contact me about any observed problems with this TDC.
<!-- Author: ronmoore -->


<!-- Date: Wed Mar 5 17:07:18 2003 -->
<pre>Jeff Schmidt has apparently rebooted  
the www-cdfonline web server machine b0dap61. 
 
It had some problems after the server reboots  
this morning. 
 
E-log, etc., should be back up (as evidenced in  
this message) 
 
</pre>
<!-- Author: W.Badgett -->

<!-- Date: Wed Mar 5 17:11:30 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159828">159828</A>
 Activated at 2003.03.05 17:10:55
<!-- Author: RunControl -->


<!-- Date: Wed Mar 5 17:11:31 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159828">159828</A>
ACTIVATE: Cosmics run starts
<!-- Author: Ace x2080 -->


<!-- Date: Wed Mar 5 17:31:38 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159830">159830</A>
ACTIVATE: Testing runControl on b0dap74 with only one 
CPU up and running;  looks OK;  one processor (non-SMP kernel)
will be the next test for JVM RunControl crashes.

<!-- Author: BB x2080 -->


<!-- Date: Wed Mar 5 17:42:54 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159828">159828</A>
 Terminated at 2003.03.05 17:42:22
<!-- Author: RunControl -->


<!-- Date: Wed Mar 5 17:42:55 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159828">159828</A>
TERMINATE: ending this cosmics run for tourture
<!-- Author: Kristian -->


<!-- Date: Wed Mar 5 17:49:54 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159831">159831</A>
ACTIVATE: L2 torture begins for ~2hrs. in partition 5
<!-- Author: Kristian -->


<!-- Date: Wed Mar 5 18:00:44 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159830">159830</A>
TERMINATE: <PRE>Finished testing single CPU on b0dap74.

Will reboot b0dap74 now to put it back into 
double CPU (SMP) mode.

Will hold off doing this on b0dap73 until 
the ibm v1_4_0 JDK has been tested overnight.
</PRE>
<!-- Author: BB x2080 -->



<!-- Date: Wed Mar 5 18:09:08 2003 -->
<pre>Sergei installed the "expect" utility on  
the RedHat 7.3.1 machines, so now vxlogin  
and vxboot will work from b0dap72, 73, 74, etc. 
 
 
</pre>
<!-- Author: W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159831' target=_top>159831</a>) -->


<!-- Date: Wed Mar 5 18:12:03 2003 -->
<pre>To: cdf_aces@fnal.gov 
 
Dear Aces, 
 
While the Tevatron is down, please continue to try running 
RunControl on node b0dap73.     If you encounter a crash, 
please cut and paste at least the first few lines of the 
crash dump from the xterminal into the e-log.   If you encounter 
a freeze, please try: 
 
        killall -3 java 
 
and record the resulting trace dump, before doing a "killall -9 java" 
 
Thanks, 
Bill 
 
</pre>
<!-- Author: W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159831' target=_top>159831</a>) -->


<!-- Date: Wed Mar 5 18:13:44 2003 -->
PSM - svx-set-01 alarm ... cleared itself.
<!-- Author: Kristian -->
<!-- Comment: Wed Mar  5 19;39;32 comment by...Kristian -->
again ...
<!-- Date: Wed Mar 5 18:25:17 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-1721&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-1721' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-1722&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-1722' width='300'></a></center>
<!-- Author: slava77 -->
<!-- Comment: Wed Mar  5 18;26;29 comment by...slava77 -->
This was a leading edge time plot comparison between the new and the old TDC for two plug laser runs


<!-- Date: Wed Mar 5 19:36:04 2003 -->
Error from pcal09.  HRR OK ... <br><br> 
 
(MLE) b0pcal09:Messenger:7:32:32 PM->Runtime Error 1, Event 1846050: See nonsequential event number (old 1, new 7) in L2 message 
(MLE) b0pcal09:Messenger:7:32:32 PM->Event 1846050: Bunchcounters in slot 14 (BC=86) and slot 20 (BC=112) disagree (at least)<br> 
(MLE) b0pcal09:Messenger:7:32:32 PM->Event 1846050: Bunchcounters in slot 14 (BC=86) and slot 15 (BC=112) disagree (at least)<br> 
(MLE) b0pcal09:Messenger:7:32:32 PM->Event 1846050: Bunchcounters in slot 14 (BC=86) and slot 17 (BC=9) disagree (at least)<br> 
(MLE) b0pcal09:Messenger:7:32:32 PM->Event 1846050: Bunchcounters in slot 14 (BC=86) and slot 19 (BC=9) disagree (at least)<br> 
(MLE) b0pcal09:Messenger:7:32:32 PM->Event 1846050: Bunchcounters in slot 14 (BC=86) and slot 21 (BC=65) disagree (at least)<br> 
(MLE) b0pcal09:Messenger:7:32:32 PM->Runtime Error 2, Event 1846050: Bunch counter mismatch, mismatch count = 5<br>  
<!-- Author: Kristian :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159831' target=_top>159831</a>) -->
<!-- Comment: Wed Mar  5 21;32;19 comment by...Kristian -->
again ...
<!-- Date: Wed Mar 5 19:45:59 2003 -->
PSM - SVX_NEB_1 alarm.  cleared itself
<!-- Author: Kristian -->

<!-- Date: Wed Mar 5 19:48:09 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159831">159831</A>
TERMINATE: end L2 torture in partition 5
<!-- Author: Kristian -->


<!-- Date: Wed Mar 5 19:54:50 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159834">159834</A>
ACTIVATE: L2 torture in partition 6 begins ...
<!-- Author: Kristian -->




<!-- Date: Wed Mar 5 21:43:06 2003 -->
DTO from pcal09 <br><br> 
 
SCPU-P6-E-VrbReadFailed: Error reading VRB in slot 12 for event 1896199.  The VRB had no event.  
<!-- Author: Kristian -->

<!-- Date: Wed Mar 5 21:48:39 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159834">159834</A>
TERMINATE: ending this run so that we can run in another partition
<!-- Author: Kristian -->


<!-- Date: Wed Mar 5 21:53:18 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159835">159835</A>
ACTIVATE: L2 torture in partition 7
<!-- Author: Kristian -->



<!-- Date: Wed Mar 5 22:07:11 2003 -->
DTO from wcal03<br><br> 
 
(MLE) b0wcal03:Messenger:10:05:02 PM->Event 218766: Bunchcounters in slot 5 (BC=121) and slot 19 (BC=12) disagree (at least)<br> 
(MLE) b0wcal03:Messenger:10:05:02 PM->Runtime Error 1, Event 218766: Bunch counter mismatch, mismatch count = 1<br> 
CT: 3/5/2003, 22:5'4"   
<!-- Author: Kristian :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159835' target=_top>159835</a>) -->


<!-- Date: Wed Mar 5 22:39:47 2003 -->
DTO from wcal05 ( and clc00? )<br><br> 
 
(MLE) b0clc00:Messenger:1:06:40 PM->Event 225520: Bunchcounters in slot 16 (BC=128) and slot 4 (BC=60) disagree (at least)<br> 
(MLE) b0clc00:Messenger:1:06:40 PM->Runtime Error 1, Event 225520: Bunch counter mismatch, mismatch count = 1<br> 
(MLE) b0wcal05:Messenger:10:36:46 PM->Event 764288: Bunchcounters in slot 16 (BC=77) and slot 20 (BC=80) disagree (at least)<br> 
(MLE) b0wcal05:Messenger:10:36:46 PM->Runtime Error 1, Event 764288: Bunch counter mismatch, mismatch count = 1<br>  
<!-- Author: Kristian :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159835' target=_top>159835</a>) -->


<!-- Date: Wed Mar 5 22:40:12 2003 -->
heartbeat alarm from COT ... it's gone away
<!-- Author: Kristian -->
<!-- Comment: Wed Mar  5 23;25;33 comment by...Kristiasn -->
again ...
<!-- Date: Wed Mar 5 22:56:34 2003 -->
corrupted data ( bad tracer words ) errors from a bunch of crates.  These include XFT_XTRP_00, XFT_FINDER_00-05,  MUON_TRIGGER_00, LEVEL1_CAL_00-02, LEVEL1_GLOBAL_00, LEVEL2_CAL_00-01-03-05 
<!-- Author: Kristian :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159835' target=_top>159835</a>) -->


<!-- Date: Wed Mar 5 23:08:55 2003 -->
Whooping gas alarm.  John called the cryo guys and they confirmed that work is being done on the system and will be throughout the night.  They've silenced the alarm.
<!-- Author: Kristian -->


<!-- Date: Wed Mar 5 23:21:55 2003 -->
DTO ccal13.  HRR OK
<!-- Author: Kristian :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159835' target=_top>159835</a>) -->



<!-- Date: Wed Mar 5 23:30:51 2003 -->
PSM crying wolf ... 1RR18D_1
<!-- Author: Kristian -->

<!-- Date: Wed Mar 5 23:54:58 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>23:55:01</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->


<!-- Date: Wed Mar 5 23:57:30 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159835">159835</A>
TERMINATE: L2 torture on partition 7
<!-- Author: Kristian -->



<!-- Date: Wed Mar 5 23:57:43 2003 -->
<font color=red>Shift Summary: </font><pre>Hoiho --nothing important 
 
Gas alarm silenced--they will fix tommorrow--it's okay 
Solenoid at 3/4 level--so COT, TOF remain STBY/OFF 
Usual suspects crying wolf</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   
Delivered Luminosity   0  
Acquired Luminosity    0  
Efficiency             0
   
</td></tr></table></pre>
<!-- Author: John Yoh -->