<!-- Title: Eve shift. Sun Sep 22, 2002 -->
<!-- SciCo: Bill Foster -->
<!-- DAQAce: Karen Gibson -->
<!-- MonAce: Jason Nielsen -->
<!-- CO: Dan Pantea -->
<!-- OpManager: Phil Koehn -->
<!-- Notes: -->
<pre>DAQ DOA  L=15.3E30</pre>


<!-- Date: Sun Sep 22 16:21:49 2002 -->
Awaiting BSU expert who will reset CCU15, unreadable in iFix.
<!-- Author: Jason -->


<!-- Date: Sun Sep 22 16:31:12 2002 -->
CCU15 was unreadable - rebooted. Now is OK.
<!-- Author: Oleg Poukhov -->


<!-- Date: Sun Sep 22 16:31:25 2002 -->
CCU15 is reading OK now.  iFix is green again for BSU.
<!-- Author: Jason -->

<!-- Date: Sun Sep 22 16:33:55 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151906">151906</A>
 Activated at 2002.09.22 16:35:20
<!-- processed by 128.174.118.70 -->
<!-- Author: RunControl -->


<!-- Date: Sun Sep 22 16:34:36 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151906">151906</A>
ACTIVATE: Running again after L3/EVB troubles
<!-- processed by 131.225.236.229 -->
<!-- Author: Karen -->



<!-- Date: Sun Sep 22 16:37:49 2002 -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>There is a now familiar problem with b0dap51's window manager.  This is the machine the CO uses to start consumer processes and displays, and often for general netscape use. 
 
The symptom is that the mouse cursor will become trapped in the lower left hand corner of the bottom display.  The desktop may also blank.  If this happens, please make sure that the consumers are still running, from the consumer status web page.  If they are, leave the machine alone.  The consumers will still run.  If you need to start consumers, or displays, you can telnet into b0dap51 and do so just as if you were logged in at console. 
 
At a convenient time, for instance when there are no collisions, you can reboot the CPU (login to b0dap51 by telnet, and type "reboot" or failing that power cycling seems to do the trick), restart the consumers, and everything should be fine. 
 
The first priority is that the consumer processes are running, so that the CO's can monitor the data we're taking. 
 
Perhaps the DAQ ace will be kind enough to lend the CO a computer to use for netscape, etc. when b0dap51 freezes. 
 
Feel free to page the consumers/online monitor pager if you have questions.</pre></td></tr></td></table>
<!-- Author: Adam Gibson -->
<!-- Comment: Sun Sep 22 23;52;28 comment by...Karen -->
Earlier this evening we ran into this problem several times.  Arnd noted that if you switch to a text display then back, you can frequently regain control of the mouse. So a command sequence that might help is Ctrl-Alt-F4 then Ctrl-Alt-F5.   
<!-- Date: Sun Sep 22 16:44:30 2002 -->
<pre>   We had several EVB/L3 problems. 
1. The procedure of cleaning up EVB was not working 
properly. It appears to be due to a bug that was probably 
introduced last Thursday when we updated the GUI. We have 
switched to the older version of the EVB/L3 control GUI. 
2.  Processor node 082 has died. As a result, ColdStart 
failed.We stopped and cleaned up L3. 
3. Subfarm c06 has 9 nodes that failed coldstart in the next  
run (083-085,088-089, 093-096, 098 in run 151906). 
The same problem has been reported yesterday, I have sent email 
about it to Jeff Tseng. Suggstion for now is to ignore 
the problem, since it does not prevent from starting the run. 
4. Subfarm c08 does not process events even after cleaning up 
Level3. Probably there is a problen with the ATM interface 
on c08. We need to at least reboot it to recover subfarm. 
Probably we will do it between stores. For now it makes no 
difference whether it is included or not in the run 
configuration. 
   Finally now we are running. 
</pre>
<!-- Author: Ilya/Nuno -->


<!-- Date: Sun Sep 22 17:18:34 2002 -->
Dzero is moving Pots.
<!-- Author: gwfoster -->

<!-- Date: Sun Sep 22 17:20:21 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151906">151906</A>
 Terminated at 2002.09.22 17:21:55
<!-- processed by 131.225.151.21 -->
<!-- Author: RunControl -->


<!-- Date: Sun Sep 22 17:20:40 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151906">151906</A>
TERMINATE: Ending run due to L2 decision timeouts
<!-- processed by 131.225.236.229 -->
<!-- Author: Karen -->



<!-- Date: Sun Sep 22 17:23:01 2002 -->
<pre>L2 Decision Timeout loop, minicom error 
 
SvtMon: Error: no data from XTRP(3 words) or SVT(0) 
FaultmManager: Fatal error, sending L2 timeout directly 
Stop or Recover stateStop or Recover state 
 
Went to HALT and waited 60s.  Tried a couple more HRRs, but no luck. So I ended the run and went through ColdStart to hopefully fix the problem.</pre>
<!-- Author: Karen :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151906' target=_top>151906</a>) -->


<!-- Date: Sun Sep 22 17:24:10 2002 -->
<center><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8050&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8050' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8051&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8051' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8052&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8052' width='300'></a></center>
<!-- Author: Jason -->

<!-- Date: Sun Sep 22 17:27:17 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151907">151907</A>
 Activated at 2002.09.22 17:28:20
<!-- processed by 64.193.0.233 -->
<!-- Author: RunControl -->


<!-- Date: Sun Sep 22 17:27:17 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151907">151907</A>
ACTIVATE: Beginning new run after L2 decision timeout loop
<!-- processed by 64.193.0.233 -->
<!-- Author: Karen -->



<!-- Date: Sun Sep 22 17:46:00 2002 -->
Noticed that the error display wasn't really displaying most of the errors for the current and previous run.  Checked to see that the log files are actually being written and they are.  Killed error display; now trying to restart it from run control.  
<!-- Author: Karen :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151907' target=_top>151907</a>) -->


<!-- Date: Sun Sep 22 18:12:08 2002 -->
Smoke-like smell in the control room (similar to the first time heating is turned on in the winter).  Smell seemed strongest near center of room where air duct exhausts.  
Sniffed inside all racks in control room, trigger room, downstairs.  Checked other rooms on 1st, 2nd, 3rd floors.  Smell faded away after a few minutes.   No alarms anywhere except the air conditioner in L3 room was beeping "low humidity" alarm (humidity reading was 35%, alarm reset OK).  Cryo tech & ops manager were unfamiliar with the syndrome.   We will continue to sniff around for remainder of shift...
<!-- Author: GW Foster -->


<!-- Date: Sun Sep 22 18:14:08 2002 -->
<center><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8053&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8053' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8054&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8054' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8055&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8055' width='300'></a></center>
<!-- Author: Jason -->


<!-- Date: Sun Sep 22 18:31:05 2002 -->
<pre>Error handling has not come back up.  Arnd spent some time working on it, but it looks like we'll have to go thru partition again to be "sure" that the error log will come back. We've lost TrigMon, so we'll wait until it's (hopefully) successfully restarted and logged enough events to make a decision on the run before ending it.  </pre>
<!-- Author: Karen :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151907' target=_top>151907</a>) -->


<!-- Date: Sun Sep 22 19:15:46 2002 -->
MCR is having trouble with Accumulator transverse emittances, stacking rate has been averaging 3~4 mA/hr for the last hour.  So the original schedule for dumping the store for Dzero access at 21:00 when the stack reaches 120mA, then shooting from ~140mA at about midnite, is in question...
<!-- Author: GW Foster -->


<!-- Date: Sun Sep 22 19:33:02 2002 -->
<center><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8056&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8056' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8057&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8057' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8058&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8058' width='300'></a></center>
<!-- Author: Jason -->

<!-- Date: Sun Sep 22 19:47:19 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151907">151907</A>
 Terminated at 2002.09.22 19:48:31
<!-- processed by 131.225.127.7 -->
<!-- Author: RunControl -->


<!-- Date: Sun Sep 22 19:48:23 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151907">151907</A>
TERMINATE: Ending run to take Si D-Mode calib & MUON_TEST
<!-- processed by 64.193.48.213 -->
<!-- Author: Karen -->


<!-- Date: Sun Sep 22 19:57:11 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151908">151908</A>
ACTIVATE: DPS-on D-mode silicon calibration
<!-- processed by 12.248.25.58 -->
<!-- Author: Jason x2080 -->


<!-- Date: Sun Sep 22 20:05:00 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151909">151909</A>
ACTIVATE: DPS-off D-mode silicon calibration
<!-- processed by 12.248.25.58 -->
<!-- Author: Jason x2080 -->



<!-- Date: Sun Sep 22 20:06:43 2002 -->
In L1 Trigger X-sections and L3 Path X-sections: many parameters missing i.e. 'not in db', bits 30 and 41-43 (L1)  and 84-87 and 89-128 (L3). This was observed also in the previous shift for the run 151903. 
<!-- Author: Dan Pantea :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151907' target=_top>151907</a>) -->


<!-- Date: Sun Sep 22 20:08:45 2002 -->
Tried to run MUON_TEST in parallel with Silicon D-Mode calib (as per the run plan on the white board.)  Couldn't accomplish this b/c run control wouldn't pass partition without DAQ_VRB_00.  We can't find this crate anywhere in Edit/View Run Settings, so we'll wait until calib's done to take MUON_TEST[6,158,318].
<!-- Author: Karen -->
<!-- Comment: Sun Sep 22 20;22;09 comment by...Arnd -->
This is because the Silicon calibration run configuration includes
the muon scintillator crate (for control of the inhibit system).
The event builder crates (DAQ_VRB_00 is one of them) cannot be
split between partitions, which is why run control intervened:
the muon crates all send their data to the same EVB crate, so it's
all or nothing in terms of booking muon crates.

<!-- Date: Sun Sep 22 20:15:52 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151910">151910</A>
 Activated at 2002.09.22 20:17:18
<!-- processed by 65.58.40.83 -->
<!-- Author: RunControl -->


<!-- Date: Sun Sep 22 20:16:20 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151910">151910</A>
ACTIVATE: MUON_TEST[6,158,318] trigger table test
<!-- processed by 131.225.236.168 -->
<!-- Author: Karen -->



<!-- Date: Sun Sep 22 20:31:34 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151910">151910</A>
 Terminated at 2002.09.22 20:32:05
<!-- processed by 131.225.236.229 -->
<!-- Author: RunControl -->


<!-- Date: Sun Sep 22 20:31:34 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151910">151910</A>
TERMINATE: Ending muon trigger test
<!-- processed by 131.225.236.229 -->
<!-- Author: Karen -->


<!-- Date: Sun Sep 22 20:38:09 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151911">151911</A>
 Activated at 2002.09.22 20:39:42
<!-- processed by 24.126.117.178 -->
<!-- Author: RunControl -->


<!-- Date: Sun Sep 22 20:38:25 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151911">151911</A>
ACTIVATE: Beginning another physics run
<!-- processed by 131.225.235.153 -->
<!-- Author: Karen -->



<!-- Date: Sun Sep 22 20:43:29 2002 -->
<center><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8059&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8059' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8060&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8060' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8061&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8061' width='300'></a></center>
<!-- Author: Jason -->


<!-- Date: Sun Sep 22 20:57:43 2002 -->
MCR now plans to dump store at 130 mA (approx 11:00) for Dzero "45 minute" access.  Shot setup from ~140mA to follow.
<!-- Author: gw foster -->
<!-- Comment: Sun Sep 22 20;59;15 comment by...gwf -->
by 11:00 I meant 23:00.


<!-- Date: Sun Sep 22 21:22:37 2002 -->
<center><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8062&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8062' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8063&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8063' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8064&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8064' width='300'></a></center>
<!-- Author: Jason -->


<!-- Date: Sun Sep 22 21:34:31 2002 -->
CDF GAS alarm sounded & silenced by cryo tech.  Alarm was caused by Argon-Ethane pressure < 10 PSI.  Cause was stuck valve between gas tank #1 and output manifold, which prevented automatic switchover to tank #1 when tank #3 went empty. Valve was unstuck by manually cycling valves to tank #2 and back to tank #1.  Pressure at output never went below 10 PSI due to presence of buffer tank #4. The computer autodialer worked in the sense that the phone rang in the control room and demanded that I type in "*8" to "acknowledge", but the information content of the voice message was less than useful.
<!-- Author: GW Foster -->


<!-- Date: Sun Sep 22 22:04:52 2002 -->
<center><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8065&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8065' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8066&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8066' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8067&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8067' width='300'></a></center>
<!-- Author: Jason -->


<!-- Date: Sun Sep 22 23:09:40 2002 -->
<center><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8068&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8068' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8069&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8069' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8070&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8070' width='300'></a></center>
<!-- Author: Jason -->

<!-- Date: Sun Sep 22 23:18:00 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151911">151911</A>
 Terminated at 2002.09.22 23:19:34
<!-- processed by 131.225.127.7 -->
<!-- Author: RunControl -->


<!-- Date: Sun Sep 22 23:18:24 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151911">151911</A>
TERMINATE: Ending run b/c end of store soon
<!-- processed by 66.188.59.82 -->
<!-- Author: Karen -->



<!-- Date: Sun Sep 22 23:23:10 2002 -->
HV in standby
<!-- Author: gw foster :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151911' target=_top>151911</a>) -->


<!-- Date: Sun Sep 22 23:31:13 2002 -->
MCR kills store, after a several minute delay while Dzero got their act together... either that, or some kind of head fake.
<!-- Author: gw foster :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151911' target=_top>151911</a>) -->


<!-- Date: Sun Sep 22 23:45:40 2002 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2002&action=view&page=-8071&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2002&action=view&page=-8071  width='300' align='top'></td><td>Our shift luminosity</a></td></tr></table>
<!-- Author: Jason -->


<!-- Date: Sun Sep 22 23:53:44 2002 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151906>
151906</A> 
x25162</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_1_02 [3,136,317]</TD>                                       
<TD ALIGN=CENTER>16:35:20</TD>                                          
<TD ALIGN=CENTER>17:21:55</TD>                                          
<TD ALIGN=CENTER>00:43:19</TD>                                          
<TD ALIGN=RIGHT>     15,605,513</TD>                                    
<TD ALIGN=RIGHT>       404,154</TD>                                     
<TD ALIGN=RIGHT>      82,880</TD>                                       
<TD ALIGN=RIGHT>   38.378</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151907>
151907</A> 
x25163</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_1_02 [3,136,317]</TD>                                       
<TD ALIGN=CENTER>17:28:20</TD>                                          
<TD ALIGN=CENTER>19:48:31</TD>                                          
<TD ALIGN=CENTER>02:17:07</TD>                                          
<TD ALIGN=RIGHT>     44,994,741</TD>                                    
<TD ALIGN=RIGHT>     1,161,208</TD>                                     
<TD ALIGN=RIGHT>     243,326</TD>                                       
<TD ALIGN=RIGHT>  111.894</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151910>
151910</A> 
x25166</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>MUON_TEST [6,158,318]</TD>                                          
<TD ALIGN=CENTER>20:17:18</TD>                                          
<TD ALIGN=CENTER>20:32:05</TD>                                          
<TD ALIGN=CENTER>00:14:42</TD>                                          
<TD ALIGN=RIGHT>         37,004</TD>                                    
<TD ALIGN=RIGHT>        37,004</TD>                                     
<TD ALIGN=RIGHT>      36,929</TD>                                       
<TD ALIGN=RIGHT>   10.961</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151911>
151911</A> 
x25167</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_1_02 [3,136,317]</TD>                                       
<TD ALIGN=CENTER>20:39:42</TD>                                          
<TD ALIGN=CENTER>23:19:34</TD>                                          
<TD ALIGN=CENTER>02:39:27</TD>                                          
<TD ALIGN=RIGHT>     44,589,835</TD>                                    
<TD ALIGN=RIGHT>     1,149,097</TD>                                     
<TD ALIGN=RIGHT>     248,958</TD>                                       
<TD ALIGN=RIGHT>  112.566</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>23:55:01</TD>                                                       
<TD ALIGN=CENTER>05:54:36</TD>                                          
<TD ALIGN=RIGHT>     105,227,093</TD>                                   
<TD ALIGN=RIGHT>      2,751,463</TD>                                    
<TD ALIGN=RIGHT>       612,093</TD>                                     
<TD ALIGN=RIGHT>  273.798</TD>                                          
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- processed by 131.225.236.229 -->
<!-- Author: End of Shift Report -->



<!-- Date: Mon Sep 23 00:01:21 2002 -->
<font color=red>Shift Summary: </font><pre>16:00     DAQ DOA (Level3/EVB problems)  L=15.3E30 
 
16:35     Back on the Air (Run 151906) after Ilya restored old verion (last Thursday's) of EVB/L3 contol GUI. 
 
16:45     Wildcat Strike by nodes on Subfarm #6, Management Lockout on Subfarm #8. See shift notes. 
          No impact on dead time at present luminosity, but Ilya wants to reboot some PCs between runs. 
 
17:15     Dzero called to warn they are moving pots.  Nothing noticeable resulted. 
 
17:23     L2 Decision Timeouts abort Run 151906.  Buffers saved for SVX-SVT-L2 fingerpointing. 
 
17:30     Restarting the run apparently ended the Work Stoppage by nodes on Subfarm #6.   
          No improvement in labor relations on subfarm #8. 
 
17:46     TRIGMON crashes & Errlog window stops.  Trigmon eventually restarts, Errlog window does not. 
          HRR's are continuing a normal pace, so we decide to keep cruising. 
 
18:12     Smoke-like smell in the control room (similar to the first time heating is turned on in the winter).  
          Smell seemed strongest near center of room where air duct exhausts. 
          Sniffed inside all racks in control room, trigger room, downstairs.  
          Checked other rooms on 1st, 2nd, 3rd floors. Smell faded away after a few minutes.  
          No alarms anywhere except the air conditioner in L3 room was beeping "low humidity" alarm  
          (humidity reading was 35%, alarm reset OK).  
          Cryo tech & ops manager were unfamiliar with the syndrome.  
          We will continue to sniff around for remainder of shift... 
 
19:50     Stopped Run 151907 and repartitioned in R_C in hopes of getting the error logger window back.  
          Took this opportunity to start long-awaited Silicon D_ MODE calibrations and MUON_TEST run. 
I 
20:40     Back to Physics datataking, with R_C Error Window restored to life. 
 
22:00     XMON L1 Trigger X-sections and L3 Path X-sections: many parameters are missing,  
          marked: "not in db".  This was also noted by the previous shift for run 151903,  
          and looking at previous runs it appears to be SNAFU.  It is a nuisance to  
          the shift crew to have things that appear to be errors that do not get fixed, 
          and dilutes the attention paid to real errors.  If this is not a serious error,  
          at a minimum this should be indicated by the summary page and CO documentation. 
          And keep smiling....this is a damn well organized experiment. 
 
23:31     MCR kills store as scheduled.  Dzero pulls off a brillinat head fake by first requesting  
          that the store gets terminated early, then coninuing on for six minutes after CDF has 
          brought their HV down as scheduled. 
 
23:45     Level3 guys show up to deal with the continuing labor unrest on subfarm #8. 
 
The shift efficiency reported below counts both the SVX calibration and MUON_TEST run as wasted beam. 
(If this time was included, shift efficiency would be 79.39%.) 
 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   151906-151911
Delivered Luminosity   345.26  
Acquired Luminosity    263.13  
Efficiency             76.2
   
</td></tr></table></pre>
<!-- Author: Bill Foster -->

<!-- Date: Mon Sep 23 00:11:49 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151912">151912</A>
 Activated at 2002.09.23 00:13:19
<!-- processed by 131.225.236.229 -->
<!-- Author: RunControl -->


<!-- Date: Mon Sep 23 00:12:45 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=151912">151912</A>
ACTIVATE: Test for Level3
<!-- processed by 131.225.236.168 -->
<!-- Author: jian -->
<!-- Comment: Mon Sep 23 00;14;19 comment by...Ilya/Nuno -->
   We have rebooted subfarm c08, it stopped working 
ealier today. Rebooting converter solved the problem.
We also rebooted a processor node (082) that died
earlier today and included it back.