<!-- Title: Day shift. Fri Apr  9, 2004 -->
<!-- SciCo: Rick Vidal -->
<!-- DAQAce: Martin Griffiths -->
<!-- MonAce: Olga Norniella -->
<!-- CO: John Smith -->
<!-- OpManager: JJ Schmidt -->
<!-- Notes: -->
store ending at 9:30; continuing data taking until then; possible 1 hr access after store dumped...


<!-- Date: Fri Apr 9 08:30:08.995 2004 -->
<center><a href='/cgi/elog/elog.pl?nb=2004&action=view&page=-4749&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2004&action=view&page=-4749' width='300'></a><a href='/cgi/elog/elog.pl?nb=2004&action=view&page=-4750&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2004&action=view&page=-4750' width='300'></a><a href='/cgi/elog/elog.pl?nb=2004&action=view&page=-4751&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2004&action=view&page=-4751' width='300'></a><a href='/cgi/elog/elog.pl?nb=2004&action=view&page=-4752&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2004&action=view&page=-4752' width='300'></a></center>
<!-- Author: Olga -->
<!-- Comment: Fri Apr  9 08;30;43 comment by...Olga -->
Hourly plots (7:00-8:00)


<!-- Date: Fri Apr 9 08:39:25.857 2004 -->
MCR calls and informs us this store will be terminated sometime before 9 AM...
<!-- Author: R. Vidal -->

<!-- Date: Fri Apr 9 08:48:25.534 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181420">181420</A>
 Terminated at 2004.04.09 08:47:30
<!-- Author: RunControl -->


<!-- Date: Fri Apr 9 08:48:26.074 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181420">181420</A>
TERMINATE: ending for Rainer to try to fix L2 without L1 errors
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 08:52:56.434 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181432">181432</A>
 Activated at 2004.04.09 08:52:47
<!-- Author: RunControl -->



<!-- Date: Fri Apr 9 08:53:31.377 2004 -->
store to be dumped; we lower HV...
<!-- Author: R. Vidal -->

<!-- Date: Fri Apr 9 08:53:42.744 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181432">181432</A>
ACTIVATE: definiteley useless - SRC in errro, try to make a snapshot for ace training
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 08:54:14.640 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181432">181432</A>
 Terminated at 2004.04.09 08:54:07
<!-- Author: RunControl -->


<!-- Date: Fri Apr 9 08:55:38.753 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181432">181432</A>
TERMINATE: definitely bad
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 09:01:59.492 2004 -->
All voltages to the state configuration before a store (before the store ends)
<!-- Author: Olga -->

<!-- Date: Fri Apr 9 09:09:44.806 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181433">181433</A>
ACTIVATE: Cal QIE calibration
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 09:10:46.757 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181434">181434</A>
ACTIVATE: Cal QIE calibration
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 09:11:40.731 2004 -->
<br> 
Our HV are down but there is still beam in machine. Abort gap losses are going very high. I called MCR (Kevin answered) and 
asked if they were doing EOS studies. He said yes they were 
(pbar BPM tests?). So beam will still in machine for a little 
while.<br><br> 
THERE WILL BE NO ACCESS FOR D0.
<!-- Author: JJ -->

<!-- Date: Fri Apr 9 09:12:26.051 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181434">181434</A>
TERMINATE: Calib QIE
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 09:13:16.711 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181435">181435</A>
ACTIVATE: CLC QIE
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 09:13:53.426 2004 -->
 
<br>From MCR eLog...<br> 
Tev quench at B0 low betas. Cool down has started at A4 and B1
<!-- Author: JJ -->

<!-- Date: Fri Apr 9 09:16:43.077 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181435">181435</A>
TERMINATE: CLC QIE
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 09:17:43.308 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181437">181437</A>
ACTIVATE: BSC QIE
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 09:18:23.599 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181437">181437</A>
TERMINATE: BSC QIE
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 09:19:18.379 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181438">181438</A>
ACTIVATE: Roman Pot SMQIE
<!-- Author: Martin x2080 -->
<!-- Comment: Fri Apr  9 09;20;52 comment by...convery -->
This won't work!

<!-- Comment: Fri Apr  9 09;25;14 comment by...Martin -->
It didn't! Why not?
<!-- Comment: Fri Apr  9 09;29;07 comment by...convery -->
We are having problems with the roman-pot readout electronics, so
the board is marked offline (SMXR in slot 4 of fcal00).  I put a note on the white board where calibrations are checked off, but I will put a note on the ace calibration web page as well. 
<!-- Comment: Fri Apr  9 10;29;12 comment by...Martin -->
Found the message on the whiteboard, sorry. Thanks.
<!-- Date: Fri Apr 9 09:24:47.830 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181439">181439</A>
ACTIVATE: TOF QIE
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 09:25:35.007 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181439">181439</A>
TERMINATE: TOF QIE
<!-- Author: Martin x2080 -->




<!-- Date: Fri Apr 9 09:30:55.948 2004 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2004&action=view&page=-4754&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2004&action=view&page=-4754  width='300' align='top'></a></td><td>Post-incident Check out</td></tr></table>
<!-- Author: Olga -->
<!-- Comment: Fri Apr  9 09;34;34 comment by...Olga -->
plots of the BLMs Summary 


<!-- Date: Fri Apr 9 09:34:37.968 2004 -->
Doing SMX QIE, got error: 
 
Heap Corrupt Fatal Error. FERML_MEMORY_EXHAUSTED_ERROR 
 
Followed instruction and successfully shepherded b0ccal13
<!-- Author: Martin -->


<!-- Date: Fri Apr 9 09:36:58.161 2004 -->
I negotiated with Crew Chief Duane to see if we could 
get a 45 minutes controlled access for silicon without 
delaying TeV startup. We decided not. 
<!-- Author: JJ -->


<!-- Date: Fri Apr 9 09:42:10.464 2004 -->
Following the problem with b0ccal13, tried to abort but several cal crates are bad and could not abort. Hit reset and tried to shepherd these but seems to be problem with RT server.
<!-- Author: Martin -->
<!-- Comment: Fri Apr  9 09;56;13 comment by...Martin -->
Spoke to Jane Nachtman. She says RT server looks OK now and perhaps there was a glitch. Retrying SMX QIE calib.
<!-- Date: Fri Apr 9 09:42:59.369 2004 -->
SciCO reports that Cal QIE calibration was unsuccessful. Cal expert is here, and wants to repeat calibration.
<!-- Author: Martin -->
<!-- Comment: Fri Apr  9 10;42;52 comment by...Martin -->
Meant CO not SciCO...
<!-- Date: Fri Apr 9 09:48:13.094 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181441">181441</A>
ACTIVATE: Cal QIE - retrying
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 09:50:37.635 2004 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2004&action=view&page=-4755&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2004&action=view&page=-4755  width='300' align='top'></a></td><td>this plot shows the abort gap losses shooting through the roof before the store was dropped, after we had our HV down. there was some rate in the BLMs - if we knew what the Abort gap loss rate was at the time of abort, we would have been able to calibrate the abort gap loss rates w.r.t. to rates in the BLMS - but from this plot it is hard to read off what the rate was...</td></tr></table>
<!-- Author: olga, rainer -->
<!-- Comment: Fri Apr  9 10;58;56 comment by...JJ -->
<a href=http://www-bd.fnal.gov/cgi-mach/machlog.pl?nb=tev04&action=view&page=119&anchor=093215&hilite=09:32:15- target=_top> Link to Tevatron studies that caused quench.</a>
<!-- Comment: Fri Apr  9 15;41;54 comment by...JJ -->
<a href=
'/cgi/elog/elog.pl?nb=2004&action=view&page=222&frame=2&anchor=15:40:30.699'>
See below for an expanded view. </a>
<!-- Date: Fri Apr 9 09:54:48.309 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181441">181441</A>
TERMINATE: Cal QIE retry
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 09:55:26.160 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181442">181442</A>
ACTIVATE: Retry SMX QIE calib
<!-- Author: Martin x2080 -->




<!-- Date: Fri Apr 9 09:58:23.807 2004 -->
Retried SMX QIE calib. This time got problems with b0ccal10, 11, 12, 14, 15. ie the ones which I did not shepherd before. Details say DELAY in FER_monitorIII.
<!-- Author: Martin -->
<!-- Comment: Fri Apr  9 10;04;28 comment by...Martin -->
Again, these crates will not abort when run is aborted.

<!-- Date: Fri Apr 9 10:11:33.425 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181443">181443</A>
ACTIVATE: SMX QIE - trying again after shepherding all the ccal crates
<!-- Author: Martin x2080 -->
<!-- Comment: Fri Apr  9 10;13;00 comment by...Martin -->
It worked this time.

<!-- Comment: Fri Apr  9 10;26;27 comment by...Martin -->
Frank killed merlin server as this may have been causing RT server problems. 
<!-- Date: Fri Apr 9 10:15:28.956 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181444">181444</A>
ACTIVATE: Another Cal QIE
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 10:19:33.594 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181445">181445</A>
ACTIVATE: Trying Cal QIE again after shepherding puls01
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 10:28:11.946 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181445">181445</A>
TERMINATE: Still seeing the same problems in DBANA, but messages did not appear in error logger this time.
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 10:33:09.845 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181447">181447</A>
ACTIVATE: CEM LED
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 10:33:10.782 2004 -->
All the CHA channels show up as bad in CAL QIE with wide RMS. Looks like the CAMAC controller which turns off the CHA laser for calibrations is not working properly. I'm going to talk to Steve Hahn about this. This doesn't affect data-taking and shows up as a problem only in calibration. 
<!-- Author: V Tiwari -->

<!-- Date: Fri Apr 9 10:34:32.389 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181447">181447</A>
TERMINATE: CEM LED
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 10:35:18.128 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181449">181449</A>
ACTIVATE: COT Calib
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 10:36:43.878 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181449">181449</A>
TERMINATE: COT Calib
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 10:37:18.526 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181451">181451</A>
ACTIVATE: Muon Calib

<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 10:37:44.136 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181451">181451</A>
TERMINATE: Muon Calib
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 10:38:50.317 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181453">181453</A>
ACTIVATE: TOF TAC Calib
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 10:40:58.340 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181453">181453</A>
TERMINATE: TOF TAC Calib
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 10:49:41.856 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181454">181454</A>
 Activated at 2004.04.09 10:49:30
<!-- Author: RunControl -->


<!-- Date: Fri Apr 9 10:50:18.818 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181454">181454</A>
ACTIVATE: Spike run
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 10:57:18.407 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181454">181454</A>
 Terminated at 2004.04.09 10:56:51
<!-- Author: RunControl -->


<!-- Date: Fri Apr 9 10:58:13.780 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181454">181454</A>
TERMINATE: Spike run
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 11:03:12.276 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181420">181420</A>
cal: <tt>Reference plots are out-of-date.</tt>
<!-- Author: Consumer Operator( John R. Smith) -->


<!-- Date: Fri Apr 9 11:03:13.621 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181420">181420</A>
muons: <tt>No Gaps, but CSP Occupancy for Part NE has a High Channel (no 15).</tt>
<!-- Author: Consumer Operator( John R. Smith) -->


<!-- Date: Fri Apr 9 11:11:35.969 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181455">181455</A>
ACTIVATE: L2 TORTURE
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 11:11:36.396 2004 -->
Tevatron is still in quench recovery, ramping to high energy three times...
<!-- Author: R. Vidal -->


<!-- Date: Fri Apr 9 11:20:35.492 2004 -->
Running L2 torture. Lots of errors in error logger like: 
 
(MLE) b0xft04:Messenger:11:18:07 AM->Runtime Error 14, Event 98696: Bunch counter mismatch, mismatch count = 1 
(MLE) b0xft02:Messenger:11:18:13 AM->Event 100020: Bunchcounters in slot 13 (BC=30) and slot 11 (BC=71) disagree (L2B=0)  
(MLE) b0xft02:Messenger:11:18:13 AM->Runtime Error 10, Event 100020: Bunch counter mismatch, mismatch count = 1 
(MLE) b0xft00:Messenger:11:18:33 AM->Event 104960: Bunchcounters in slot 13 (BC=59) and slot 6 (BC=56) disagree (L2B=0)  
 
This seems to be a common problem in the e-log. 
 
Also one node in L3 (203) is persistently magenta. This means it takes ~5 minutes for L3 to get into active state.
<!-- Author: Martin -->


<!-- Date: Fri Apr 9 11:38:28.493 2004 -->
<pre>L3 node 203 stayed magenta. Attempted to end run and restart to clear this up. At this point got an L3 Relay Error: 
 
Code: 0x1c110800000011  Mnemonic: L3_RELAY_FAILURE 
Node Name: b0l3pcom2.fnal.gov; Node Id: 131.225.236.189 
Process: main; PID: -1; Time: 11:34:41 AM 
Code Line: 153; Routine: merlin.MLencodedMessage.<init> 
Parameters: Error on L3 node b0l3pcom2.fnal.gov (partition 0) Fri Apr 9 11:34:41 2004 l3proxy  
  in End (L3ProxyPartition.cc:2870) 
  @L3_RELAY_FAILURE Level3 Relay failure detected! 
The following subfarms need to be removed from the next runs: 
      None. You can use all the same subfarms. 
The following Level3 converter nodes are marked bad for now: 
      None. 
The full list of Level3 nodes giving Relay trouble is printed below 
 
 b0l3203 
 
 ************************************************ 
 These Level3 nodes will be marked OFFLINE!!! 
 Abort/End/Reset and Partition again!!! 
 ************************************************ 
</pre>
<!-- Author: Martin -->
<!-- Comment: Fri Apr  9 11;44;01 comment by...Martin -->
Followed instructions to go through Abort/Reset/Partition. Now four nodes are grey - 134, 182, 203, 262.
<!-- Comment: Fri Apr  9 11;58;49 comment by...Martin -->
Paged L3, looking into it.
<!-- Comment: Fri Apr  9 13;00;31 comment by...L3 people -->
There were 3 offline the whole day. Then, 3+1 = 4
<!-- Date: Fri Apr 9 11:43:21.497 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181456">181456</A>
ACTIVATE: L2 TORTURE
<!-- Author: Martin x2080 -->





<!-- Date: Fri Apr 9 12:28:06.474 2004 -->
relevant comment from Run Coordinator's e-log: "There was lower lifetime to start yesterday's store, some  
tuning may be done today when the store starts. Shot setup will  
be extended about 20 minutes for Tevatron tune tracker studies."
<!-- Author: R. Vidal -->


<!-- Date: Fri Apr 9 12:33:01.544 2004 -->
<pre>Level3 was paged about a couple of nodes giving Relay trouble  
 
fixed both. Those are b0l3187 and b0l3203 
 
Subfarm 12 appeared weird color because by accident b0l3187 
is also a head l3 monitoring node 
 </pre>
<!-- Author: Arkadiy -->


<!-- Date: Fri Apr 9 12:36:41.016 2004 -->
Run 181457: L2 torture. L3 expert fixed problematic nodes 187 and 203. 134, 182 and 262 are out due to repair. 
<!-- Author: Martin -->

<!-- Date: Fri Apr 9 12:47:38.874 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181458">181458</A>
 Activated at 2004.04.09 12:47:01
<!-- Author: RunControl -->


<!-- Date: Fri Apr 9 12:48:10.979 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181458">181458</A>
ACTIVATE: Cosmics
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 13:05:36.589 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181458">181458</A>
 Terminated at 2004.04.09 13:05:06
<!-- Author: RunControl -->


<!-- Date: Fri Apr 9 13:06:24.031 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181458">181458</A>
TERMINATE: Trying slightly different code in COT crates; end run to reboot them.
<!-- Author: Martin x2080 -->
<!-- Comment: Fri Apr  9 13;12;45 comment by...W.Badgett -->
That was me.

<!-- Date: Fri Apr 9 13:26:01.810 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181459">181459</A>
 Activated at 2004.04.09 13:25:53
<!-- Author: RunControl -->


<!-- Date: Fri Apr 9 13:33:50.088 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181459">181459</A>
 Terminated at 2004.04.09 13:33:05
<!-- Author: RunControl -->


<!-- Date: Fri Apr 9 13:35:15.576 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181460">181460</A>
 Activated at 2004.04.09 13:34:53
<!-- Author: RunControl -->


<!-- Date: Fri Apr 9 13:36:08.251 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181460">181460</A>
 Terminated at 2004.04.09 13:35:52
<!-- Author: RunControl -->



<!-- Date: Fri Apr 9 13:36:08.626 2004 -->
Begin injecting final protons for Store #3366...
<!-- Author: R. Vidal -->


<!-- Date: Fri Apr 9 13:37:36.967 2004 -->
<pre>Date Time BLM Dose  
2004.04.09 13:33:03 W Inner BLM 0.14 RADS  
2004.04.09 13:33:03 W Outer BLM 0.09 RADS  
2004.04.09 13:33:03 E Inner BLM 0.48 RADS  
2004.04.09 13:33:03 E Outer BLM 0.59 RADS  
Integrated dosage </pre>
<!-- Author: Olga -->

<!-- Date: Fri Apr 9 13:44:27.819 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181461">181461</A>
ACTIVATE: AAA_SHOTSETUP
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 13:56:05.077 2004 -->
<table border=0><td><tr><td bgcolor=#e0e030><b> please page silicon SPL on final anti proton load </b> 
</td></tr></td></table>
<!-- Author: rainer -->


<!-- Date: Fri Apr 9 14:00:11.498 2004 -->
<pre>Have put in fer FrontEndReadout/RunControl package  
to v3_30, with some small changes: 
 
  . Remove a few debug prints to speed up booting  
    and configuring slightly; b0cmp00 has an even  
    faster booter kernel, too  
 
  . Add StaticRAM/FIFO comparison of number of words  
    to readout per TDC;  produce error if mismatch; also  
    add check for correct ECL/LVDS TDC version number (8 or 9) 
 
  . Add extra check for Universe DONE bit after DMA chain  
    readout (COT TDCs only)   This may or may not help  
    alleviate low rate of mismatch errors. 
 
  . Chun Lin's fixes to ScalerMonitor for dynamic  
    prescale change algorithm rate normalization; if you're  
    afraid, use "setup fer v3_29e" instead;  have left  
    the v3_29e version running in control room;  also the  
    60 second window will be used for dead time alarm 
 
  . Fix VME address images for Tracer when running with  
    an MVME 5500;  fix TASK_DESC memory allocation for  
    larger size in 5500;  no 5500's in the system yet, so  
    no effect for now 
 
Note to carefully restart ScalerMonitor if it crashes with  
the supposedly safer "setup fer v3_29e" 
 
</pre>
<!-- Author: W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181461' target=_top>181461</a>) -->


<!-- Date: Fri Apr 9 14:07:18.253 2004 -->
<pre>Looks like we still have the b0cot08, slot 3 errors  
after installing the new code.  So now we suspect  
a hardware problem.  Should replace TDC in b0cot08, slot 3 
at some convenient access time in the future.  Looking at  
run 181236 COT_08 errors, there is a summary of the errors  
listed below. Could be flakey bits in the TDC FIFO readout,  
since the StaticRAM headers look OK. 
 
Run 181236 had 18 errors in 5 hours 40 minutes of running  
time.   So presumably this is not often enough to request  
an access just for this problem.    Note that the event  
only goes to the error stream (D) out of Level 3, and so  
is effectively lost. 
 
 
Columns: 
   1: EventNumber 
   2: ModuleID      HDWDB/FIFO 
   3. ReadoutList   Tracer/FIFO 
   4. L2Buffer      Tracer/FIFO 
   5. HeaderWord    StaticRAM/FIFO 
   6. NWords/NHits  StaticRAM/FIFO     NWords=NHits + (NHits%2) 
 
 209394 429/429 rol 0/4 l2b 0/0  0xD681FA56/0xD6C0F956   1FA/0F9 
 363672 429/428 rol 0/4 l2b 0/0  0xD682BE06/0xD640BD06   2BE/0BD 
 659456 429/428 rol 0/0 l2b 2/0  0xD68A8A3E/0xD600893E   28A/089 
 780536 429/429 rol 0/0 l2b 1/0  0xD685D044/0xD680CF44   1D0/0CF 
 948738 429/429 rol 2/0 l2b 3/0  0xD6AED250/0xD680D050   3D2/0D0 
1148560 429/429 rol 0/4 l2b 2/0  0xD68A5A0C/0xD6C0580C   25A/058 
1420491 429/429 rol 0/4 l2b 0/0  0xD681C647/0xD6C0C547   1C6/0C5 
1420492 429/429 rol 0/0 l2b 2/0  0xD68A9A4A/0xD680984A   29A/098 
1635500 429/428 rol 0/4 l2b 0/0  0xD6822488/0xD6402288   224/022 
1742201 429/428 rol 0/0 l2b 0/0  0xD6826441/0xD6006341   264/063 
2258034 429/428 rol 0/4 l2b 2/0  0xD68A9418/0xD6409218   294/092 
2578306 429/429 rol 0/0 l2b 1/0  0xD686DA15/0xD680D915   2DA/0D9 
3269828 429/429 rol 0/0 l2b 3/0  0xD68DD88B/0xD680D78B   1D8/0D7 **** 
3759559 429/429 rol 0/4 l2b 3/0  0xD68DBC85/0xD6C0BB85   1BC/0BB 
4004278 429/429 rol 0/4 l2b 0/0  0xD681C64D/0xD6C0C54D   1C6/0C5 
4252406 429/429 rol 0/4 l2b 0/0  0xD681F850/0xD6C0F750   1F8/0F7 
4510056 429/429 rol 0/4 l2b 0/0  0xD681F406/0xD6C0F206   1F4/0F2 
4701480 429/429 rol 0/0 l2b 1/0  0xD686BE00/0xD680BD00   2BE/0BD 
 
 

</pre>
<!-- Author: W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181236' target=_top>181236</a>) -->


<!-- Date: Fri Apr 9 14:20:58.363 2004 -->
Ray accidentally turned off b0cmx00 - shepherded and did HRR.
<!-- Author: Martin -->


<!-- Date: Fri Apr 9 14:33:46.757 2004 -->
all anti-proton bunches have been loaded for Store #3366...
<!-- Author: R. Vidal -->

<!-- Date: Fri Apr 9 14:36:32.866 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181461">181461</A>
TERMINATE: reached flat top
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 14:53:24.454 2004 -->
b0pcal02 turned red (U) in VxWorks monitor. Shepherded.
<!-- Author: Martin -->


<!-- Date: Fri Apr 9 15:08:29.849 2004 -->
Store #3366 - scraping complete...
<!-- Author: R. Vidal -->


<!-- Date: Fri Apr 9 15:18:28.078 2004 -->
<TABLE bgcolor=#add8e6> 
<TR><TH>Date</th><th>Time</th><th colspan=3>Quantity</th></tr> 
<tr><td>2004.04.09</td><td>15:12:31</td><td>C:B0ILUM</td><td>44.37</td><td>E30</td></tr> 
<tr><td>2004.04.09</td><td>15:12:31</td><td>C:B0LLUM</td><td>0.00</td><td>E30</td></tr> 
<tr><td>2004.04.09</td><td>15:12:31</td><td>C:B0PLOS</td><td>4214.78</td><td>Hz</td></tr> 
<tr><td>2004.04.09</td><td>15:12:31</td><td>C:B0ALOS</td><td>1824.48</td><td>Hz</td></tr> 
<tr><td>2004.04.09</td><td>15:15:49</td><td>TEVpr</td><td>8479.36</td><td>1E09</td></tr> 
<tr><td>2004.04.09</td><td>15:15:49</td><td>TEVpb</td><td>926.90</td><td>1E09</td></tr> 
</TABLE> 
<strong>Luminosity and losses</strong> 
 
LOSTP and LOSTPB are acceptable but the abort gap losses are not, so MCR will try to reduce them before we continue...
<!-- Author: R. Vidal -->


<!-- Date: Fri Apr 9 15:19:53.090 2004 -->
PSM alarm: IRR18D2 (Muon TDC Crate)
<!-- Author: Olga -->


<!-- Date: Fri Apr 9 15:21:10.249 2004 -->
Cleared clock errors BC LOC and BC PH 742 and 1113.
<!-- Author: Martin -->

<!-- Date: Fri Apr 9 15:26:35.051 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181462">181462</A>
TERMINATE: Bad - Rainer said to abort.
<!-- Author: Martin x2080 -->


<!-- Date: Fri Apr 9 15:27:27.339 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181463">181463</A>
 Activated at 2004.04.09 15:27:09
<!-- Author: RunControl -->


<!-- Date: Fri Apr 9 15:27:28.456 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181463">181463</A>
ACTIVATE: AAA_CURRENT
<!-- Author: Martin x2080 -->



<!-- Date: Fri Apr 9 15:30:54.738 2004 -->
<TABLE bgcolor=#add8e6> 
<TR><TH>Date</th><th>Time</th><th colspan=3>Quantity</th></tr> 
<tr><td>2004.04.09</td><td>15:25:49</td><td>TEVpr</td><td>8464.43</td><td>1E09</td></tr> 
<tr><td>2004.04.09</td><td>15:25:49</td><td>TEVpb</td><td>919.55</td><td>1E09</td></tr> 
<tr><td>2004.04.09</td><td>15:27:33</td><td>C:B0ILUM</td><td>43.38</td><td>E30</td></tr> 
<tr><td>2004.04.09</td><td>15:27:33</td><td>C:B0LLUM</td><td>40.24</td><td>E30</td></tr> 
<tr><td>2004.04.09</td><td>15:27:33</td><td>C:B0PLOS</td><td>7332.56</td><td>Hz</td></tr> 
<tr><td>2004.04.09</td><td>15:27:33</td><td>C:B0ALOS</td><td>1581.99</td><td>Hz</td></tr> 
</TABLE> 
<strong>Luminosity and losses</strong><br> 
Lostp ~ 15K and Lostpb ~ 5k;  abort gap losses ok;  we take data...
<!-- Author: R. Vidal -->


<!-- Date: Fri Apr 9 15:33:03.480 2004 -->
<center><a href='/cgi/elog/elog.pl?nb=2004&action=view&page=-4757&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2004&action=view&page=-4757' width='300'></a><a href='/cgi/elog/elog.pl?nb=2004&action=view&page=-4758&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2004&action=view&page=-4758' width='300'></a></center>
<!-- Author: Olga -->
<!-- Comment: Fri Apr  9 15;34;30 comment by...Olga -->
Losses and radiation plots during the shot.


<!-- Date: Fri Apr 9 15:35:22.794 2004 -->
Still getting bunch counter mismatch errors in b0xft02 and b0xft04. past entry in e-log say this does not affect data-taking.
<!-- Author: Martin -->


<!-- Date: Fri Apr 9 15:40:30.699 2004 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2004&action=view&page=-4759&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2004&action=view&page=-4759  width='300' align='top'></a></td><td>Another view of messy abort of store 3363.</td></tr></table>
<!-- Author: JJ -->
<!-- Comment: Fri Apr  9 15;41;03 comment by...JJ -->
THIS IS FROM END OF THIS MORNING'S STORE. OUT OF ELOG TIME>



<!-- Date: Fri Apr 9 15:52:22.768 2004 -->
LOSTP becomes very spikey; Ops Manager will call MCR to try to improve this tune...
<!-- Author: R. Vidal -->


<!-- Date: Fri Apr 9 15:52:52.115 2004 -->
Starting beginning of this store,  we changed cdfsoftb0 version 
to the new current default version which is 5.3.1h. 
Everything except ObjectMon.  ObjectMon crashed in JpsiMonitor. 
Code writer was informed.  We set ObjectMon to run with previous 
version which is 5.3.1b.
<!-- Author: ryo and kaori :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181463' target=_top>181463</a>) -->

<!-- Date: Fri Apr 9 15:56:26.484 2004 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181420>
181420</A> 
x2C4AC</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_2_03 [2,456,449]</TD>                                       
<TD ALIGN=CENTER>02:00:11</TD>                                          
<TD ALIGN=CENTER>08:47:30</TD>                                          
<TD ALIGN=CENTER>29:08:30</TD>                                          
<TD ALIGN=RIGHT>  1,394,889,810</TD>                                    
<TD ALIGN=RIGHT>    20,478,458</TD>                                     
<TD ALIGN=RIGHT>   4,021,428</TD>                                       
<TD ALIGN=RIGHT> 2182.438</TD>                                          
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=181463>
181463</A> 
x2C4D7</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_2_03 [2,456,449]</TD>                                       
<TD ALIGN=CENTER>15:27:09</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>00:24:46</TD>                                          
<TD ALIGN=RIGHT>     25,609,486</TD>                                    
<TD ALIGN=RIGHT>       480,750</TD>                                     
<TD ALIGN=RIGHT>      85,036</TD>                                       
<TD ALIGN=RIGHT>   62.253</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:03</TD>                                                       
<TD ALIGN=CENTER>29:33:16</TD>                                          
<TD ALIGN=RIGHT>   1,420,499,296</TD>                                   
<TD ALIGN=RIGHT>     20,959,208</TD>                                    
<TD ALIGN=RIGHT>     4,106,464</TD>                                     
<TD ALIGN=RIGHT> 2244.691</TD>                                          
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Fri Apr 9 16:01:47.627 2004 -->
<font color=red>Shift Summary: </font><pre> store dumped at 9:00; 
 
 Store #3366 at 15:30; L ~ 43 </pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   181420-181463
Delivered Luminosity   152.5 nb-1  
Acquired Luminosity    99.8 nb-1  
Efficiency             65.4%
   
</td></tr></table></pre>
<!-- Author: R. Vidal -->