<!-- Title: Day shift. Fri Jan 10, 2003 -->
<!-- SciCo: C. Blocker, B. Foster -->
<!-- DAQAce: B. Stelzer, D. Clark -->
<!-- MonAce: L. Cerrito, T. Nelson -->
<!-- CO: Valentin Necula -->
<!-- OpManager: Eric James -->
<!-- Notes: -->
<pre>Still stacking.  Anticipate shot around 11am-noon.</pre>


<!-- Date: Fri Jan 10 08:28:01 2003 -->
This happened in the owl shift... 
 
<p> 
1) 
CLSMAIN appeared red in ProcMon, and we tried to restarted. But, actually there was not any problem in CSL (comunitation problem in ProcMon?). We stopped and started CSL, but run was in progress. So, finally evb was stuck, and it was needed to stop the run (just shop setup) and clean up evb. 
 
<p> 
2) b0dap58 was frozen, and we needed to reboot it. We already restarted ProcMon and TevMon processes
<!-- Author: Guillelmo/Lin -->

<!-- Date: Fri Jan 10 08:31:59 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156431">156431</A>
TERMINATE: End run - switch to cosmics
<!-- Author: Bernd -->


<!-- Date: Fri Jan 10 08:39:17 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156433">156433</A>
 Activated at 2003.01.10 08:38:15
<!-- Author: RunControl -->


<!-- Date: Fri Jan 10 08:39:17 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156433">156433</A>
ACTIVATE: Cosmic run to examine DAQ system
<!-- Author: Bernd/David -->



<!-- Date: Fri Jan 10 09:09:46 2003 -->
TOF alarm in iFix while TOF OFF, it turned red for 30 sec., and 
then back OK, I could not see anything wrong with it
<!-- Author: Lucio -->
<!-- Comment: Fri Jan 10 13;15;06 comment by...Lucio -->
then it goes yellow every now and then, but again I can't see
the reason. TOF is OFF
<!-- Date: Fri Jan 10 09:12:01 2003 -->
<pre>We get several erros in the error logger about CSL "receiving a bad event" (every 2-8min) -  
All CSL processes in ProcMon are green though. 
 
41'32" b0dau32.fnal.gov:csl_mon_send:8:41:32 AM->CSL received a "BAD EVENT" in partition 0.[MLW]</pre>
<!-- Author: Bernd :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156433' target=_top>156433</a>) -->


<!-- Date: Fri Jan 10 09:38:18 2003 -->
<pre>OK, here are the formal Terms of Offer for my attempt to bribe  
the MCR shift crew to deliver luminosity while I am CDF SiCo:  
(this is a renewal of my previous offer Nov 30 2002, which 
came very very close to working...) 
 
 1) Each member of the MCR shift crew (up to maximum of 6) gets  
twenty ($20) U.S. Dollars apiece for breaking the record for  
single-shift delivered luminosity on a shift where I am CDF SiCo  
(currently DAY Jan 10-18).  Note this offer does not depend   
on how much of the data CDF actually records.  
 
2) If the single-shift record is associated with a record  
instantaneous luminosity on a shot put in by the previous MCR  
shift, then that shift crew qualifies as well.  But the previous  
shift crew only qualifies if the shot stays in long enough to  
generate a record integrated luminosity on MY shift.  Got it?  
 
3) The offer is renewable up to maximum of (3) times during this  
period, providing that subsequent records represent an  
improvement of at least 2.5% over the previous record.  
 
(this part of the offer is kind of irrelevant this week since  
we are heading into shutdown.  Looks like the last, best chance 
is a really good shot early tomorrow AM.) 
 
4) Only CDF luminosity is considered in this bribe.  For example, 
optimizing the luminosity lifetime by reworking the Helix to  
bring the beams out of collision at D0 would be a perfectly 
acceptable means of qualifying for this Award. 
 
I believe that the current single-shift delivered luminosity is 
still 712 nb-1,  set 20 Oct. 2002 Owl shift.  Breaking this 
record will require approximately L > 32E30 at 8AM and keeping 
the store in all shift.</pre>
<!-- Author: Bill Foster -->

<!-- Date: Fri Jan 10 09:47:59 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156433">156433</A>
 Terminated at 2003.01.10 09:46:55
<!-- Author: RunControl -->


<!-- Date: Fri Jan 10 09:49:17 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156433">156433</A>
TERMINATE: end Cosmic run for CCAL Laser calibration.
<!-- Author: Bernd/David -->


<!-- Date: Fri Jan 10 09:52:02 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156438">156438</A>
TERMINATE: Silicon global Cold-start to pick up hardware DB changes to e483.
<!-- Author: nielsenj -->


<!-- Date: Fri Jan 10 10:26:11 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156442">156442</A>
 Activated at 2003.01.10 10:25:13
<!-- Author: RunControl -->


<!-- Date: Fri Jan 10 10:26:11 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156442">156442</A>
ACTIVATE: Cosmic run again
<!-- Author: Bernd/David -->



<!-- Date: Fri Jan 10 10:26:41 2003 -->
I made some changes in the <a href=http://www-cdfonline.fnal.gov/internal/usr/spezziga/elog.html>luminosity calculator script</a> (under "Luminosity summary"), trying to fix the problem which appeared <a href= 
'/cgi/elog/elog.pl?nb=2002&action=view&page=1079&frame=2&anchor=16:24:19'>a couple of weeks ago</a>, when ACNET was providing bad values to the database. It is not easy to reproduce the problem to debug it now that ACNET is working, so I am not sure 100% that it will react properly next time.
<!-- Author: Mario Spezziga -->


<!-- Date: Fri Jan 10 10:29:36 2003 -->
We are investigating the change in AVDD current on SB4W1L4. 
(This cell is RED/ORANGE/whatever in IMON.) 
  
<!-- Author: Jason Nielsen -->
<!-- Comment: Fri Jan 10 10;30;04 comment by...Jason -->
RED/ORANGE/PINK/MAGENTA


<!-- Date: Fri Jan 10 10:45:09 2003 -->
MCR still plans to shoot at 120mA -- currently at 112mA and 5~6mA/hr.   This would mean shot setup around noon & so shot might go in 1-2PM. 
<!-- Author: Bill Foster -->

<!-- Date: Fri Jan 10 11:00:30 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156442">156442</A>
 Terminated at 2003.01.10 10:59:10
<!-- Author: RunControl -->


<!-- Date: Fri Jan 10 11:11:15 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156442">156442</A>
TERMINATE: End run - Nikolai will be back to continue his laser runs
<!-- Author: Bernd/David -->



<!-- Date: Fri Jan 10 11:51:21 2003 -->
<pre>During Nikolai's Laser run, we got a Done timeout error - 
We issued a manual HRR, but Run Control got stuck in Recover state - Problem seems related to EVB/Trigger supervisor -  
Paged EVB experts</pre>
<!-- Author: Bernd/David/Tim -->

<!-- Date: Fri Jan 10 11:56:17 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156443">156443</A>
TERMINATE: Abort run - RC got stuck doing HRR
<!-- Author: Bernd/David -->



<!-- Date: Fri Jan 10 12:10:26 2003 -->
<pre>Trying to partition the same configuration doesn't work. 
EVB/L3 doesn't pass partition. 
 
Expert instructed us to reboot b0tsi00 and cleanup EVB. 
In the meanwhile he is coming in.</pre>
<!-- Author: Bernd/David/Tim -->
<!-- Comment: Fri Jan 10 12;21;01 comment by...Bernd -->
<pre>Here is the error from the elog:

44'21" 1 crate/s: b0htdc00(153),  busy.[RXPT]
(MLE) b0tsi02:Messenger:11:44:19 AM-&gt;BUSY timeout
(MLE) b0dap59.fnal.gov:AWT-EventQueue-0:11:44:19 AM-&gt;Busy Timeout: HADRON_TIMING_00 
(MLE) b0tsi02:Messenger:11:44:23 AM-&gt;BUSY timeout
(MLE) b0tsi02:Messenger:11:44:28 AM-&gt;BUSY timeout
(MLE) b0tsi02:Messenger:11:44:32 AM-&gt;BUSY timeout</pre>
<!-- Date: Fri Jan 10 12:19:00 2003 -->
<pre>We tried a new Central Laser run, but after a Busy timeout  
from trigger supervisor 2. 
b0tsi02:Messenger:12:14:00 PM-&gt;BUSY timeout 
After a manual HRR Run Control got stuck again</pre>
<!-- Author: Bernd/Nikolai/David/Tim -->



<!-- Date: Fri Jan 10 12:26:23 2003 -->
<pre>MCR now estimates shot setup starting 1PM ==&gt; collisions 2:30~3:00. 
Stack is at 123mA.</pre>
<!-- Author: Bill Foster -->


<!-- Date: Fri Jan 10 12:48:40 2003 -->
<pre>MCR called, their estimate for shot setup is now 1:30.</pre>
<!-- Author: Bill Foster -->


<!-- Date: Fri Jan 10 13:13:15 2003 -->
I got a pop-up window in iFix, complaining that the alarm queue 
'SUMMARY LIST' has overflowed, and at least one alarm may have 
been lost! . Since I don't understand what this means, I emailed  
yun@fnal.gov
<!-- Author: Lucio -->
<!-- Comment: Fri Jan 10 17;23;56 comment by...Andy H. -->
Don't worry, that happens from time to time and it isn't serious
(even though it looks like it is).
<!-- Date: Fri Jan 10 13:20:10 2003 -->
<pre>Level3 was paged because EVB would not partition  
 
The problem was in Scanner Manager crate b0eb10  
that had a suspended process tsmDisp. 
 
That one got suspended because a little ago EVB  
was used in 2 partition mode and the second  
user on partition 2 closed Run Control while 
 being in Idle State    
 
Clean up of the EVB did not help because on the  
partition transition after EVB clean up b0eb10 
 would get the same confusing message from RTserver  
 
So , what i had to do was: 
restart RTserver , switch to partition 0 and clean up EVB  
 
Now things seem to be working  </pre>
<!-- Author: Arkadiy -->


<!-- Date: Fri Jan 10 13:39:55 2003 -->
MCR calls with 5-minute warning on shot setup.
<!-- Author: Bill Foster -->


<!-- Date: Fri Jan 10 13:46:26 2003 -->
shot setup underway.
<!-- Author: Bill Foster -->

<!-- Date: Fri Jan 10 13:50:30 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156448">156448</A>
 Activated at 2003.01.10 13:49:44
<!-- Author: RunControl -->


<!-- Date: Fri Jan 10 13:51:59 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156448">156448</A>
ACTIVATE: running cosmic to ex. daq, removed clc00 and clc01 (used by other partition)
<!-- Author: Bernd/David -->


<!-- Date: Fri Jan 10 14:22:37 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156448">156448</A>
 Terminated at 2003.01.10 14:21:44
<!-- Author: RunControl -->


<!-- Date: Fri Jan 10 14:22:37 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156448">156448</A>
TERMINATE: End the run to switch to shot-setup
<!-- Author: Bernd/David -->


<!-- Date: Fri Jan 10 14:32:10 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156449">156449</A>
ACTIVATE: AAA_Shotsetup with current PHYSICS_1_04[3,224,354] table
<!-- Author: Bernd/David -->



<!-- Date: Fri Jan 10 14:49:12 2003 -->
Smells like final protons.
<!-- Author: Bill Foster -->


<!-- Date: Fri Jan 10 15:01:31 2003 -->
Checked Roman Pot trigger signals with scope by triggering on fake B0 signal, we found that one of 3 RP bits was not delivered  
properly to the PreFRED. Replaced the trigger panel with the  
spare, and then everything looked fine.
<!-- Author: M. Mulhearn, M. Gallinaro, K. Terashi -->


<!-- Date: Fri Jan 10 15:02:13 2003 -->
<TABLE bgcolor=#cdc9a5> 
<TR><TH>Date</th><th>Time</th><th>BLM</th><th colspan=2>Dose</th></tr> 
<tr><td>2003.01.10</td><td>14:57:47</td><td>W Inner BLM</td><td>0.70</td><td>RADS</td></tr> 
<tr><td>2003.01.10</td><td>14:57:47</td><td>W Outer BLM</td><td>0.23</td><td>RADS</td></tr> 
<tr><td>2003.01.10</td><td>14:57:47</td><td>E Inner BLM</td><td>1.47</td><td>RADS</td></tr> 
<tr><td>2003.01.10</td><td>14:57:47</td><td>E Outer BLM</td><td>2.00</td><td>RADS</td></tr> 
</TABLE> 
<strong>Integrated dosage</strong> 
  
<!-- Author: Lucio -->
<!-- Comment: Fri Jan 10 15;05;29 comment by...Lucio -->
protons load
<!-- Date: Fri Jan 10 15:04:47 2003 -->
Proton Load ~8400.  Injecting Final Pbars.
<!-- Author: Bill Foster -->



<!-- Date: Fri Jan 10 15:24:13 2003 -->
<pre>3:20:39 PM-&gt;  Level 2 Decision Timeout 
HRR recovered OK 
Error message in Alpha minicom: 
 
Error: Startload is still low. ModDone bits 0x400effff for event 14204           
TIMEOUT: Mod done not set for slot 19 (0x0006ffff, cnt 1)                        
                                                                                 
Error: Startload is still low. ModDone bits 0x4006ffff for event 14560           
TIMEOUT: Mod done not set for slot 19 (0x0006ffff, cnt 2)                        
                                                                                 
Error: Startload is still low. ModDone bits 0x400effff for event 50852           
TIMEOUT: Mod done not set for slot 19 (0x0006ffff, cnt 3)                        
Unknown saw 3 sequential errors at Jan 10 15:21:15 2003                          
FaultManager: Fatal error, sending L2 timeout (L2A 10436)                        
</pre>
<!-- Author: Bernd/David/Tim :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156449' target=_top>156449</a>) -->


<!-- Date: Fri Jan 10 15:36:52 2003 -->
<TABLE bgcolor=#cdc9a5> 
<TR><TH>Date</th><th>Time</th><th>BLM</th><th colspan=2>Dose</th></tr> 
<tr><td>2003.01.10</td><td>15:34:27</td><td>W Inner BLM</td><td>0.83</td><td>RADS</td></tr> 
<tr><td>2003.01.10</td><td>15:34:27</td><td>W Outer BLM</td><td>0.23</td><td>RADS</td></tr> 
<tr><td>2003.01.10</td><td>15:34:27</td><td>E Inner BLM</td><td>1.74</td><td>RADS</td></tr> 
<tr><td>2003.01.10</td><td>15:34:27</td><td>E Outer BLM</td><td>2.28</td><td>RADS</td></tr> 
</TABLE> 
<strong>Integrated dosage</strong> 
  
<!-- Author: Lucio -->
<!-- Comment: Fri Jan 10 15;37;13 comment by...Lucio -->
after pbars load


<!-- Date: Fri Jan 10 15:37:46 2003 -->
Ramping Pbars=800E9 Prot=6800
<!-- Author: bill foster -->

<!-- Date: Fri Jan 10 15:39:31 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156449">156449</A>
TERMINATE: End shot setup.
<!-- Author: Bernd/David -->



<!-- Date: Fri Jan 10 15:44:26 2003 -->
scraping...
<!-- Author: Bill Foster -->


<!-- Date: Fri Jan 10 15:44:47 2003 -->
<pre>Partition AAA_Current with PHYSICS_1_04[3,224,354]</pre>
<!-- Author: Bernd/David -->


<!-- Date: Fri Jan 10 15:54:37 2003 -->
<pre>scraping complete Lum=27.65</pre>
<!-- Author: Bill Foster -->

<!-- Date: Fri Jan 10 15:55:48 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:01</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Fri Jan 10 15:59:09 2003 -->
All HV are ON and ready to go, except Silicon, waiting for TeVMon
<!-- Author: Lucio -->


<!-- Date: Fri Jan 10 16:00:18 2003 -->
<font color=red>Shift Summary: </font><pre>Store 1107 went in uneventfully 5 mins before end of shift. 
Initial Lum 27.65.</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   156431-156449
Delivered Luminosity   6.5  
Acquired Luminosity    0  
Efficiency             0
   
</td></tr></table></pre>
<!-- Author: Bill Foster -->


<!-- Date: Fri Jan 10 16:00:47 2003 -->
TeVMon green, turning silicon ON
<!-- Author: Lucio -->

<!-- Date: Fri Jan 10 16:07:19 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156452">156452</A>
 Activated at 2003.01.10 16:06:35
<!-- Author: RunControl -->


<!-- Date: Fri Jan 10 16:07:48 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=156452">156452</A>
ACTIVATE: Starting PHYSICS run
<!-- Author: Alberto -->