<!-- Title: Day shift. Fri Oct  4, 2002 -->
<!-- SciCo: carla/ simone -->
<!-- DAQAce: Karen Gibson -->
<!-- MonAce: Jason Nielson -->
<!-- CO: Woo-Hyun/W.Wester/ -->
<!-- OpManager: Matt Jones -->
<!-- Notes: -->
<pre>Colliding Beams L= 1.27 e31, stack 81E10 
 
Keep running, near end of store do trigger studies and SVX D-mode calibration. 
 
Page COT in case of trips.</pre>


<!-- Date: Fri Oct 4 08:44:58 2002 -->
Lack of downtime logger auto entries was because 
the ODDMOD accelerator program was in a bad state. 
This has been restarted, and the downtime logger 
should start recording entries. If it doesn't let 
me know.
<!-- Author: j. patrick -->


<!-- Date: Fri Oct 4 09:03:07 2002 -->
<pre>Trouble with dynamic prescales: even though the L1 rate was  
down to 4.5 kHz, the two-track triggers were still prescaled 
(5 for L1_TWO_TRK2_OPPQ_etc and 250 for L1_TWO_TRK2_DPHI90_etc) 
 
It seems to have affected all data from this store. 
 
Greg paged, looking into it now. 
We changed by hand L1_TWO_TRK2_OOPQ_etc to 1 but set it back to 5 
on Greg's request, and made a scaler log file called 021004.log</pre>
<!-- Author: Rolf Oldeman :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152464' target=_top>152464</a>) -->
<!-- Comment: Fri Oct  4 09;09;42 comment by...Rolf -->
With Greg's permission, changed both prescale to 1. L1 rate now
11kHz
<!-- Date: Fri Oct 4 09:07:29 2002 -->
<center><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8366&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8366' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8367&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8367' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8368&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8368' width='300'></a></center>
<!-- Author: Jason -->



<!-- Date: Fri Oct 4 09:27:05 2002 -->
<pre>With the changes Rolf made in the prescales, we are currently running with  
 
L1A:   11kHz 
Deadtime:  1.5%</pre>
<!-- Author: Karen :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152464' target=_top>152464</a>) -->


<!-- Date: Fri Oct 4 09:34:26 2002 -->
Notice bad HADTDC timing plots in ObjectMon. The reference book says to ignore red alarms, but to notify maxi@fnal.gov. We do this.
<!-- Author: William Wester :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152464' target=_top>152464</a>) -->


<!-- Date: Fri Oct 4 10:16:54 2002 -->
<pre>The plan: MCR will do beam studies for the last hour of this 
 store, starting around noon. 
We will do D-mode SVX calibration before the beam studies, 
 trigger table and diffractive timing during the last hour 
 of the store</pre>
<!-- Author: carla -->

<!-- Date: Fri Oct 4 10:21:42 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152464">152464</A>
 Terminated at 2002.10.04 10:20:24
<!-- processed by 131.225.232.165 -->
<!-- Author: RunControl -->


<!-- Date: Fri Oct 4 10:21:42 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152464">152464</A>
TERMINATE: Ending run for Steve Nahn to swap VRB cables.
<!-- processed by 131.225.232.165 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 10:22:42 2002 -->
LJN appears just as we were about to contact experts. New dead WHA PMT. eta 9 phi 1L. LJN says that this will be a tough access and it's likely this will be bad for some time.	
<!-- Author: William Wester :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152464' target=_top>152464</a>) -->
<!-- Comment: Fri Oct  4 16;13;20 comment by...M Mattson -->
<br>
I checked the electronics, which look fine.  My guess is that it is the PMT, like Larry suggested.
<!-- Date: Fri Oct 4 10:23:48 2002 -->
<pre>Lost the beam!</pre>
<!-- Author: carla -->


<!-- Date: Fri Oct 4 10:25:49 2002 -->
Quench at F4.
<!-- Author: carla -->

<!-- Date: Fri Oct 4 10:31:55 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152465">152465</A>
TERMINATE: Never made it past ColdStart
<!-- processed by 131.225.95.81 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 10:37:50 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152466">152466</A>
ACTIVATE: CAL QIE calib
<!-- processed by 131.225.232.116 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 10:37:50 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152466">152466</A>
ACTIVATE: CAL QIE calib
<!-- processed by 131.225.232.116 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 10:44:17 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152467">152467</A>
ACTIVATE: SMX QIE calib (w/CES, CCR, CPR HV off & no beam in machine.)
<!-- processed by 131.225.45.171 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 10:46:53 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152468">152468</A>
ACTIVATE: CLC QIE calib
<!-- processed by 131.225.235.163 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 10:49:09 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152469">152469</A>
ACTIVATE: BSC QIE calib
<!-- processed by 131.225.235.75 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 10:52:20 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152470">152470</A>
ACTIVATE: TOF QIE calib
<!-- processed by 131.225.235.150 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 10:52:20 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152470">152470</A>
ACTIVATE: TOF QIE calib
<!-- processed by 131.225.236.161 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 10:52:56 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152471">152471</A>
ACTIVATE: CEM LED calib
<!-- processed by 131.225.236.162 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 10:53:21 2002 -->
<table><tr><td><a href=/elog/notebooks/2002/Fri_Oct__4_2002_Day.105238.ps align=top><img src=/cgi/elog/elog.pl?nb=2002&action=view&page=-8372  align='top'></td><td>Jason (Monitoring ACE) alerted CO's for problems he noticed in SiliMon raw occ plot which shows ISL B0 W 14 and 15 look dead.  It seems almost impossible for non-expert  to notice this type of problem.  Jason paged Si expert and also expert on monitor. </a></td></tr></table>
<!-- Author: W. Chung -->
<!-- Comment: Fri Oct  4 11;12;01 comment by...Jason -->
This sort of thing also shows up as yellow cells on the Chip Status slide in SVXMon.
<!-- Date: Fri Oct 4 11:00:32 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152473">152473</A>
ACTIVATE: CEM XEF calib
<!-- processed by 131.225.236.26 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 11:00:32 2002 -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>We have upgraded the L2 alpha processor firmware. 
Only the following Trigger Tables (the key is the  
L2 Tagset) will work with the new firmware - 
------------------------------------------------- 
SUMET5[1,168,xxx] 
COSMICS[7,169.xxx] 
COSMICS_NOTRACKS[4,170,xxx] 
MINIMUM_BIAS_1[7,171,xxx] 
L2TORTURE[4,172,xxx] 
PHYSICS_1_02[6,165,...] 
-------------------------------------------------- 
Please test all these tables ASAP! 
 
--------------------------------------------------</pre></td></tr></td></table>
<!-- Author: Greg Feild and Peter Wittich -->

<!-- Date: Fri Oct 4 11:10:57 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152475">152475</A>
ACTIVATE: Plug laser calib, BOTHPLUGS config
<!-- processed by 131.225.236.26 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 11:19:02 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152477">152477</A>
ACTIVATE: Plug laser calib; BOTHPLUGS w/Myron mode ON.
<!-- processed by 131.225.127.7 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 11:20:59 2002 -->
<center><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8373&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8373' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8374&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8374' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8375&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8375' width='300'></a></center>
<!-- Author: Jason -->


<!-- Date: Fri Oct 4 11:29:36 2002 -->
The COT calibration was also taken (run 152478.)
<!-- Author: Karen -->

<!-- Date: Fri Oct 4 11:31:32 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152479">152479</A>
ACTIVATE: MUON calib
<!-- processed by 131.225.236.229 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 11:36:29 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152480">152480</A>
ACTIVATE: TOF TAC calib
<!-- processed by 131.225.233.93 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 11:53:05 2002 -->
<pre>Investigating why Dynamic Prescaling was not  
running in the last store.  Using crates: 
 
    LEVEL1_GLOBAL_00 
    TRIGGER_SCALERS_00 
 
</pre>
<!-- Author: badgett -->

<!-- Date: Fri Oct 4 12:10:39 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152481">152481</A>
 Activated at 2002.10.04 12:10:25
<!-- processed by 131.225.95.81 -->
<!-- Author: RunControl -->


<!-- Date: Fri Oct 4 12:10:51 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152481">152481</A>
ACTIVATE: PMT spike run
<!-- processed by 131.225.236.168 -->
<!-- Author: Karen -->
<!-- Comment: Fri Oct  4 12;15;29 comment by...Karen -->
<pre>Standard, no beam
Raw L1 rate  118 Hz</pre>
<!-- Date: Fri Oct 4 12:15:29 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152481">152481</A>
 Terminated at 2002.10.04 12:15:14
<!-- processed by 131.225.236.168 -->
<!-- Author: RunControl -->



<!-- Date: Fri Oct 4 12:31:40 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152483">152483</A>
 Activated at 2002.10.04 12:31:20
<!-- processed by 141.211.101.170 -->
<!-- Author: RunControl -->


<!-- Date: Fri Oct 4 12:32:56 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152483">152483</A>
ACTIVATE: Cosmics run, testing trigger table COSMICS[7,169,318]
<!-- processed by 131.225.236.168 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 12:51:07 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152483">152483</A>
 Terminated at 2002.10.04 12:50:15
<!-- processed by 131.225.235.75 -->
<!-- Author: RunControl -->


<!-- Date: Fri Oct 4 12:51:07 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152483">152483</A>
TERMINATE: Ending to try another trigger table. 
<!-- processed by 131.225.235.75 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 12:59:56 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152484">152484</A>
ACTIVATE: cosmics no tracks, w/table COSMICS_NOTRACKS[4,170,318].
<!-- processed by 131.225.233.51 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 13:16:19 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152484">152484</A>
TERMINATE: Ending run for more trigger tests.
<!-- processed by 131.225.232.108 -->
<!-- Author: Karen -->


<!-- Date: Fri Oct 4 13:26:49 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152485">152485</A>
 Activated at 2002.10.04 13:26:33
<!-- processed by 131.225.234.39 -->
<!-- Author: RunControl -->


<!-- Date: Fri Oct 4 13:29:32 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152485">152485</A>
ACTIVATE: Testing MINIMUM_BIAS[7,171,318]
<!-- processed by 131.225.236.229 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 13:30:15 2002 -->
<pre>shot setup in progress</pre>
<!-- Author: carla -->

<!-- Date: Fri Oct 4 13:32:21 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152485">152485</A>
 Terminated at 2002.10.04 13:31:04
<!-- processed by 131.225.236.229 -->
<!-- Author: RunControl -->



<!-- Date: Fri Oct 4 13:51:22 2002 -->
Asset has finished with COT HV work.
<!-- Author: Jason -->

<!-- Date: Fri Oct 4 13:56:01 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152486">152486</A>
ACTIVATE: AAA_SHOTSETUP w/table PHYSICS_1_02[6,165,321]
<!-- processed by 128.135.102.184 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 14:02:55 2002 -->
<pre>Bill Badgett found and fixed a bug related to the new 
"Look and Feel" of the DPS button on the Scaler GUI. 
DPS should be working again. 
</pre>
<!-- Author: Greg :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152486' target=_top>152486</a>) -->

<!-- Date: Fri Oct 4 14:11:41 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152487">152487</A>
ACTIVATE: New SHOT_SETUP run, no WCAL_04 crate
<!-- processed by 166.90.65.243 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 14:18:27 2002 -->
<pre>There was a bug in ScalerMonitor (scaler) that  
made it so that the first time you clicked the dynamic  
prescale button, the DynamicPrescaling was not  
enabled.   Subsequent presses of the button should  
have been successful.  I would be surprised if the shift  
crew did not try more than once, but who knows? 
 
Anyhow, this bug is fixed.   Also, the ScalerMonitor  
session on b0dap57 (cdfdaq account) will automatically  
enable dynamic prescaling at the start of a run. 
</pre>
<!-- Author: W.Badgett -->


<!-- Date: Fri Oct 4 14:29:49 2002 -->
Final proton bucnhes being loaded
<!-- Author: carla -->

<!-- Date: Fri Oct 4 14:34:01 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152487">152487</A>
TERMINATE: Ending SHOTSETUP run to retreive CMX_01 & WCAL_04 for "real" SHOTSETUP run.
<!-- processed by 131.225.127.7 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 14:37:19 2002 -->
<TABLE bgcolor=#cdc9a5> 
<TR><TH>Date</th><th>Time</th><th>BLM</th><th colspan=2>Dose</th></tr> 
<tr><td>2002.10.04</td><td>14:35:22</td><td>W Inner BLM</td><td>0.03</td><td>RADS</td></tr> 
<tr><td>2002.10.04</td><td>14:35:22</td><td>W Outer BLM</td><td>0.00</td><td>RADS</td></tr> 
<tr><td>2002.10.04</td><td>14:35:22</td><td>E Inner BLM</td><td>0.06</td><td>RADS</td></tr> 
<tr><td>2002.10.04</td><td>14:35:22</td><td>E Outer BLM</td><td>0.18</td><td>RADS</td></tr> 
</TABLE> 
<strong>Integrated dosage</strong>
<!-- Author: Jason -->


<!-- Date: Fri Oct 4 14:38:57 2002 -->
<pre>Looks like they were not the final bunches</pre>
<!-- Author: carla -->

<!-- Date: Fri Oct 4 14:42:50 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152491">152491</A>
ACTIVATE: Final protons are being loaded, so this is the "real" AAA_SHOTSETUP run.
<!-- processed by 131.225.236.162 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 14:52:49 2002 -->
<pre>Final protons are in. 
Loading pbars</pre>
<!-- Author: carla -->


<!-- Date: Fri Oct 4 15:16:01 2002 -->
<pre>TEV ramping</pre>
<!-- Author: carla -->

<!-- Date: Fri Oct 4 15:31:07 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152491">152491</A>
TERMINATE: into physics....
<!-- processed by 131.225.236.229 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 15:32:55 2002 -->
<pre>scraping complete.  
Store 1824 
L = 2.85E31</pre>
<!-- Author: carla -->
<!-- Comment: Fri Oct  4 15;35;48 comment by...carla -->
<pre>TevPR 6376 E09
TevPB 716 E09</pre>

<!-- Date: Fri Oct 4 15:40:25 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152492">152492</A>
 Activated at 2002.10.04 15:39:28
<!-- processed by 131.225.232.81 -->
<!-- Author: RunControl -->


<!-- Date: Fri Oct 4 15:41:24 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152492">152492</A>
ACTIVATE: NO_SILICON run w/new trigger table PHYSICS_1_02[6,165,321].
<!-- processed by 131.225.127.7 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 15:42:40 2002 -->
<center><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8376&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8376' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8377&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8377' width='300'></a><a href='/cgi/elog/elog.pl?nb=2002&action=view&page=-8378&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2002&action=view&page=-8378' width='300'></a></center>
<!-- Author: Jason -->

<!-- Date: Fri Oct 4 15:45:33 2002 -->
<pre>
Ena&!MT summary: 000000000000000000
</pre>
<!-- processed by 131.225.236.162 -->
<!-- Author: svt whodunnit script -->


<!-- Date: Fri Oct 4 15:46:54 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152492">152492</A>
 Terminated at 2002.10.04 15:46:37
<!-- processed by 141.211.101.170 -->
<!-- Author: RunControl -->



<!-- Date: Fri Oct 4 15:46:59 2002 -->
CMP (south wall A1) was in yellow even though its voltage and currents were 100% normal.  Then the alarm went away... 
<!-- Author: Jason -->
<!-- Comment: Fri Oct  4 16;00;17 comment by...Trevor -->
<pre>I was paged a couple of times about this... South wall A1 average current is slightly above 15 uA, and the limit for the average current is set at 15.0 uA.  The instantaneous current limit is
set at 20.0 uA, so I told the monitoring ACE not to worry about this too much.

It is interesting to note that the top of the north wall, and the top of the south wall both have average currents between 13 and 15.5 uA.  I'll have to check records to see if this is unusually high.</pre>
<!-- Date: Fri Oct 4 15:47:16 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152492">152492</A>
TERMINATE: Ending run b/c of L2 decision timeouts.
<!-- processed by 65.59.72.140 -->
<!-- Author: Karen -->
<!-- Comment: Fri Oct  4 15;52;42 comment by...Karen -->
New trigger table seems to have problems w/L1A > 12kHz.  Will go back to PHYSICS_1_02[5,151,319]


<!-- Comment: Fri Oct  4 16;14;20 comment by...Peter W -->
Problem was, from alpha minicom log:

<pre>
In HALT state after 0 events

Running Started

Read L2 prescales
Mod done mask read from crate controller: 0x000008c1
SvtMon: SVT buffno 0 != event buffno 2
XtrpMon: XTRP buffno 2 != event buffno 0
XtrpMon: XTRP buffno 0 != event buffno 1
XtrpMon: XTRP buffno 0 != event buffno 3
MonitorBase::doErrorAction: Monitor TrackListMonitor saw 3 sequential errors
SvtMon: SVT buffno 0 != event buffno 3
FaultManager: Fatal error, sending L2 timeout


In HALT state after 1305200 events

Running Started

Read L2 prescales
Mod done mask read from crate controller: 0x000008c1
XtrpMon: XTRP buffno 2 != event buffno 0
MonitorBase::doErrorAction: Monitor TrackListMonitor saw 4 sequential errors
FaultManager: Fatal error, sending L2 timeout


In HALT state after 1305201 events

Running Started

Read L2 prescales
Mod done mask read from crate controller: 0x000008c1
XtrpMon: XTRP buffno 1 != event buffno 0
MonitorBase::doErrorAction: Monitor TrackListMonitor saw 5 sequential errors
FaultManager: Fatal error, sending L2 timeout


In HALT state after 1305202 events

Running Started

Read L2 prescales
Mod done mask read from crate controller: 0x000008c1
IsolistMon: Error on pass 0, cluster 0: got 0, expected 1(eta: 2 phi: 14)
XtrpMon: XTRP buffno 0 != event buffno 1
SvtMon: SVT buffno 0 != event buffno 1
XtrpMon: XTRP buffno 0 != event buffno 2
SvtMon: SVT buffno 0 != event buffno 2
XtrpMon: XTRP buffno 1 != event buffno 3
MonitorBase::doErrorAction: Monitor TrackListMonitor saw 3 sequential errors
SvtMon: SVT buffno 0 != event buffno 3
MonitorBase::doErrorAction: Monitor SvtMonitor saw 3 sequential errors
FaultManager: Fatal error, sending L2 timeout


In HALT state after 1305206 events

Running Started

Read L2 prescales
Mod done mask read from crate controller: 0x000008c1
XtrpMon: XTRP buffno 3 != event buffno 0
MonitorBase::doErrorAction: Monitor TrackListMonitor saw 4 sequential errors
FaultManager: Fatal error, sending L2 timeout


In HALT state after 1305207 events
</pre>

We have reverted to the old PROM and are doing a post-mortem. Ugh.
<!-- Comment: Fri Oct  4 16;59;15 comment by...Greg & Peter -->
It is likely that this was a VME bus error problem in b0l2de00, which is independent of the PROM. We will re-request a test of the new firmware.
<!-- Date: Fri Oct 4 15:53:35 2002 -->
New cdfsoftb0 release 4.8.3b is built this morning and tested 
ok.  Decleared this version to be current default (around 14:00h) and running in the control room.  
<!-- Author: kaori -->

<!-- Date: Fri Oct 4 15:55:38 2002 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152464>
152464</A> 
x25390</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_1_02 [5,151,319]</TD>                                       
<TD ALIGN=CENTER>07:15:13</TD>                                          
<TD ALIGN=CENTER>10:20:24</TD>                                          
<TD ALIGN=CENTER>03:03:44</TD>                                          
<TD ALIGN=RIGHT>     77,124,636</TD>                                    
<TD ALIGN=RIGHT>     1,478,316</TD>                                     
<TD ALIGN=RIGHT>     321,793</TD>                                       
<TD ALIGN=RIGHT>  137.078</TD>                                          
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152492>
152492</A> 
x253AC</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_1_02 [6,165,321]</TD>                                       
<TD ALIGN=CENTER>15:39:28</TD>                                          
<TD ALIGN=CENTER>15:46:37</TD>                                          
<TD ALIGN=CENTER>00:01:42</TD>                                          
<TD ALIGN=RIGHT>      1,305,222</TD>                                    
<TD ALIGN=RIGHT>        29,072</TD>                                     
<TD ALIGN=RIGHT>       4,081</TD>                                       
<TD ALIGN=RIGHT>    2.758</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>0</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:01</TD>                                                       
<TD ALIGN=CENTER>03:05:27</TD>                                          
<TD ALIGN=RIGHT>      78,429,858</TD>                                   
<TD ALIGN=RIGHT>      1,507,388</TD>                                    
<TD ALIGN=RIGHT>       325,874</TD>                                     
<TD ALIGN=RIGHT>  139.836</TD>                                          
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- processed by 131.225.242.250 -->
<!-- Author: End of Shift Report -->


<!-- Date: Fri Oct 4 15:58:39 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152493">152493</A>
 Activated at 2002.10.04 15:58:09
<!-- processed by 131.225.45.171 -->
<!-- Author: RunControl -->


<!-- Date: Fri Oct 4 16:00:17 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152493">152493</A>
ACTIVATE: Another NOSILICON run w/table PHYSICS_1_02[5,151,319].
<!-- processed by 131.225.127.7 -->
<!-- Author: Karen -->



<!-- Date: Fri Oct 4 16:05:32 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152493">152493</A>
 Terminated at 2002.10.04 16:04:54
<!-- processed by 131.225.45.171 -->
<!-- Author: RunControl -->


<!-- Date: Fri Oct 4 16:05:39 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152493">152493</A>
TERMINATE: Ending to include silicon
<!-- processed by 146.139.52.113 -->
<!-- Author: Karen -->




<!-- Date: Fri Oct 4 16:15:35 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152494">152494</A>
 Activated at 2002.10.04 16:15:13
<!-- processed by 131.225.127.7 -->
<!-- Author: RunControl -->


<!-- Date: Fri Oct 4 16:16:25 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=152494">152494</A>
ACTIVATE: Start run with silicon.
<!-- processed by 131.225.236.136 -->
<!-- Author: Chris -->



<!-- Date: Fri Oct 4 16:18:01 2002 -->
<table border=0><td><tr><td bgcolor=#e0e030>The CMX pager carrier will be out of pager range some fraction of the weekend. He can be reached on his cell phone, however. 630-308-3517. 
 
Should laying on of hands be necessary, I am at x5037 or 264-0674.</td></tr></td></table><font color=red><cite>(entry outside this shift's time range )</cite></font>
<!-- Author: Phil -->


<!-- Date: Fri Oct 4 16:24:38 2002 -->
<P>  Arndt and I debugged the TOTRIB coldstart code.  We fixed a few problems with the way VMEopen is called on the processor, and then changed the hard coded values to use the values from the HWDB through the config message from run control.  After Bill fixed a bug in the HWDB accessors for the TOTRIB, this worked perfectly. </P> 
 
<P>We also further investigated a problem with reading back the configuration of values on the TOTRIBs JTAG control register.  Tests at the test stand have revealed that these problems only occur when there are 6 or more TDCs between the TOTRIB and crate processor! Yikes. </P><font color=red><cite>(entry outside this shift's time range )</cite></font>
<!-- Author: mulhearn -->


<!-- Date: Fri Oct 4 16:25:43 2002 -->
<font color=red>Shift Summary: </font><pre>Shift start with store in progress 
L =1.27E31, stack 81E10  
 
Found that dynamic prescale didn't lower  
the prescale when it was supposed to. 
Changed by hand.  Expert looking into it. 
 
Discussions on the plan for the end of the store- 
obsoleted by a quench. 
 
Steve Nahn swaps VRB cables to make them right. 
 
New dead PMT in WHA. Larry says it will take  
along access, need to move the plug. 
 
MCR will go in shot setup immediately after quench  
recovery. 
 
Start taking all calibrations. 
Test COSMICS[7,169,318] 
     COSMICS_NOTRACKS[4,170,318] 
     PHYSICS_1_02[6,165,321] 
 
CMX Pager: until Sunday morning call cell phone: 630-308-3517 
 
14:42 Final Proton bunches loaded 
 
15:13 Pbars loaded 
 
15:32 Scarping complete 
Inintial L = 2.85E31 
 
Start run without silicon. L2 decision timeouts, end run,  
change Alpha's prom and revert to old trigger table 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   152464, 152493
Delivered Luminosity   154.5  
Acquired Luminosity    132.1  
Efficiency             85.5%
   
</td></tr></table></pre>
<!-- Author: carla -->


<!-- Date: Fri Oct 4 16:26:20 2002 -->
<pre>Cleaned up Level 3 monitoring since the  
display was stuck in Magenta for a lot of  
the processors nodes.  & restarted L3 display 
 
(Ace was busy) 
</pre><font color=red><cite>(entry outside this shift's time range )</cite></font>
<!-- Author: badgett -->

<!-- Date: Fri Oct 4 16:27:09 2002 -->
<pre>
Ena&!MT summary: 000000000000000000
</pre>
<!-- processed by 131.225.236.162 -->
<!-- Author: svt whodunnit script -->