<!-- Title: Day shift. Tue Feb  4, 2003 -->
<!-- SciCo: Paul Karchin -->
<!-- DAQAce: Mark Mattson -->
<!-- MonAce: &nbsp; -->
<!-- CO: &nbsp; -->
<!-- OpManager: Matthew Jones -->
<!-- Notes: -->
<pre>access continues, VESDA system off</pre>


<!-- Date: Tue Feb 4 08:26:57 2003 -->
Mark called - will be working on fire alarm system - alarms may appear.
<!-- Author: Paul -->


<!-- Date: Tue Feb 4 08:32:50 2003 -->
I will be doing tests with the RTserver this morning.  I will be shutting the RTserver on b0dau30 down for a few minutes, and there may be other interruptions.  Work will be finished by 10:00.
<!-- Author: Jane Nachtman 2080 -->


<!-- Date: Tue Feb 4 08:52:50 2003 -->
ifix alarm for fcal - crate powered off due to drilling work in hall
<!-- Author: Paul -->


<!-- Date: Tue Feb 4 08:55:07 2003 -->
Cyro tech (Steve) requests to power off solenoid so engineer can work on control software.  Matt approves. Mark turns off TOF HV. 
Steve informed to proceed w/ solenoid power down.
<!-- Author: Paul -->


<!-- Date: Tue Feb 4 09:01:33 2003 -->
<br><b>East Halo Counters:</b> 
<br>Removed east halo counters from their frame for jib crane 
installation.  Found the bottom counter broken at the light 
guide.  Will attempt repair of the next few days. 
<br>
<!-- Author: R.J. Tesarek -->


<!-- Date: Tue Feb 4 09:03:21 2003 -->
Current status of the Global Alarms page:<p> 
COT is grey, pink, and occasionally black.  Work is being done, so this is probably normal.<p> 
PSM is red, with occasional voice alarm about node unreachable.  This is due to fcal01 being turned off.<p> 
Icicle has purple heartbeat.  This was true yesterday as well.<p> 
CEM, CHA, WHA have purple heartbeat.  This happened about 10 minutes ago.
<!-- Author: m mattson -->
<!-- Comment: Tue Feb  4 09;10;07 comment by...m mattson -->
<br>
People on the first floor are updating the system on 1RR06C.  Have been reassured that the monitoring is still running.  They should be done soon, after which the heartbeat should come back on the global alarm page for CEM, CHA, WHA.

<!-- Date: Tue Feb 4 09:28:36 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158035">158035</A>
 Terminated at 2003.02.04 09:27:00
<!-- Author: RunControl -->


<!-- Date: Tue Feb 4 09:28:37 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158035">158035</A>
TERMINATE: Because Greg F said so
<!-- Author: Alberto -->



<!-- Date: Tue Feb 4 09:30:17 2003 -->
Greg will start scaler firmware upgrade.
<!-- Author: Paul -->




<!-- Date: Tue Feb 4 09:42:53 2003 -->
As <a href= 
'/cgi/elog/elog.pl?nb=2003&action=view&page=104&frame=2&anchor=08:26:57'> 
promissed </a> error codes appear intermittently on process display panel.
<!-- Author: Paul -->


<!-- Date: Tue Feb 4 09:55:35 2003 -->
SVX, ISL, L00 are red.  "D" button does not help, as the page says that IFIX communication "NotOK".  Gino was here, dealt with the problem, display is green again.<p> 
CMU NE-top turned red (tripped).  Went to the bars page, turned the offender to "On", and CMU is happy again.
<!-- Author: m mattson -->

<!-- Date: Tue Feb 4 10:03:09 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158036">158036</A>
ACTIVATE: L2 torture w/o pcal crates, fcal01
<!-- Author: mattson -->



<!-- Date: Tue Feb 4 10:05:18 2003 -->
First attempt to partition failed.  All crates are a gold yellow.  Jane N works with RT server, fixes the situation.<p>During second try, errlog stays gold.  "Special Needs Client" button did not help, until Error Display was quit and started again.<p>Window popped up saying: 
<pre>L3CalibTag not found Error!!! 
Please page L3 Filter software expert immediately</pre> 
After a delay, L3 finished, so no pager was called.
<!-- Author: m mattson :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158036' target=_top>158036</a>) -->
<!-- Comment: Tue Feb  4 10;07;16 comment by...m mattson -->
<p>Run starts with L2TO.  Minicom window says slot 19 problem, which Greg F recognizes.  He will power cycle crate, then we will shepherd crate back into run.
<!-- Comment: Tue Feb  4 10;18;37 comment by...m mattson -->
<p>L2TO still.  One more HRR seemed to clean this up.<p>
Now we get DTO from ccal06, slot 3 SMXR.  After a few HRRs, ccal06 and ccal07 act up.  We will start a new run w/o ccal crates.<p>Karen B is found in the trigger room, and confesses to doing work on the ccal crates.
<!-- Date: Tue Feb 4 10:05:45 2003 -->
Access to clean CMU LV connectors.  Will cause PSM alarm for CMU and SMX. - Koji and Hyunsoo.
<!-- Author: Paul -->



<!-- Date: Tue Feb 4 10:10:38 2003 -->
Access to work on TSU amplifier grounding - Oleg and Akram.
<!-- Author: Paul -->

<!-- Date: Tue Feb 4 10:14:22 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158036">158036</A>
TERMINATE: ccal06 and ccal07 SMXR slots not responding
<!-- Author: mattson -->



<!-- Date: Tue Feb 4 10:26:12 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158041">158041</A>
TERMINATE: Experts cry "abort!"
<!-- Author: mattson -->
<!-- Comment: Tue Feb  4 10;27;53 comment by...m mattson -->
<br>Problem with new L2 torture trigger table.(??)
<!-- Date: Tue Feb 4 10:26:13 2003 -->
Access to work on HAD TDC - Sungwon and Fabio.
<!-- Author: Paul -->


<!-- Date: Tue Feb 4 10:32:10 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158043">158043</A>
ACTIVATE: Silicon test run
<!-- Author: nahn -->


<!-- Date: Tue Feb 4 10:32:11 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158042">158042</A>
ACTIVATE: L2 torture, no ccal/pcal/fcal01
<!-- Author: mattson -->
<!-- Comment: Tue Feb  4 10;44;07 comment by...m mattson -->
<br>Greg F and Jane N negotiate, decide now is the time to interrupt the run for more RT tests.  She stopped the RT server on dau30.

<!-- Comment: Tue Feb  4 10;46;52 comment by...m mattson -->
<br>Jane restarts dau30, system recovers, run continues...


<!-- Date: Tue Feb 4 10:50:59 2003 -->
COT HV to standby - Bob Wagner.
<!-- Author: Paul -->

<!-- Date: Tue Feb 4 10:55:50 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158042">158042</A>
TERMINATE: hadron timing crate DoneTimeOut problem (b0htdc00), also 
Greg wanted to make changes anyways
<!-- Author: mattson -->



<!-- Date: Tue Feb 4 10:57:48 2003 -->
SVX power supply trip - Gino and Steve here to look.
<!-- Author: Paul -->

<!-- Date: Tue Feb 4 11:08:41 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158047">158047</A>
ACTIVATE: More L2 torture
<!-- Author: mattson -->
<!-- Comment: Tue Feb  4 11;10;20 comment by...Greg F, Michael Schmidt -->
<pre>We have backed out the experimental scaler proms.
They did not behave as expected.
</pre>
<!-- Comment: Tue Feb  4 11;23;55 comment by...m mattson -->
<br>
Still having hadron_timing_00 DTO.  Trying the magic button (Reboot-Reset-Recover) for b0htdc00 to see if this helps.
<!-- Date: Tue Feb 4 11:09:16 2003 -->
stopping the rtserver on b0dau30 for a quick test.
<!-- Author: Jane -->



<!-- Date: Tue Feb 4 11:10:55 2003 -->
Consumers were pointing at partition 1.  Today we are on partition 2, so I have killed existing consumers and started new ones.
<!-- Author: m mattson -->


<!-- Date: Tue Feb 4 11:16:59 2003 -->
ISL PS trip - Gino & Steve to look.
<!-- Author: Paul -->


<!-- Date: Tue Feb 4 11:23:12 2003 -->
<pre>CMU access report: 
Cleaned up LV connectors for CMU preamp powerlines. Following 
wedges were cleaned up; 8W, 13W, 14W, 15W, 16W, 18W, 19W, 21W, 
22W, and 23W.</pre>
<!-- Author: hyunsoo & Koji Ebina -->
<!-- Comment: Tue Feb  4 11;34;39 comment by...hyunsoo -->
<pre>0W, 3W, 4W, 5W, and 6W need to be cleaned up. (and whole east
side).</pre>
<!-- Comment: Tue Feb  4 11;52;28 comment by...A. Fan -->
<pre>Hyunsoo rules!</pre>
<!-- Date: Tue Feb 4 11:27:12 2003 -->
Mark from fire safety called - the fire panel is back on-line.
<!-- Author: Paul -->


<!-- Date: Tue Feb 4 11:29:07 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030>Please, if somebody clean up either L3 or EVB, don't <br>  
forget to put a comment in the e-log telling was <br> 
going on, and why you thought it was needed to clean up it.<br> 
It's very useful for us your comments. Thanks</td></tr></td></table>
<!-- Author: Guillelmo -->


<!-- Date: Tue Feb 4 11:30:17 2003 -->
RTserver tests are finished.
<!-- Author: Jane Nachtman -->


<!-- Date: Tue Feb 4 11:31:32 2003 -->
Layer-00 PS trip. Waiting for rt-server to investigate.
<!-- Author: Paul -->



<!-- Date: Tue Feb 4 11:35:02 2003 -->
SVX, ISL, L00 PS alarms gone.
<!-- Author: Paul -->

<!-- Date: Tue Feb 4 11:39:21 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158047">158047</A>
TERMINATE: Taking out b0htdc00
<!-- Author: mattson -->
<!-- Comment: Tue Feb  4 11;40;42 comment by...m mattson -->
<br>Getting bunch counter mismatches in slot4 (BC=80) and slot3 (BC=210).  Trigger experts say upper limit for BC is 159.

<!-- Date: Tue Feb 4 11:45:07 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158048">158048</A>
ACTIVATE: CAL QIE calibration and FRAM download for all ccal crates.
<!-- Author: Vivek(x2080) -->
<!-- Comment: Tue Feb  4 11;49;17 comment by...Vivek -->
Yesterday, we worked on b0ccal06. Ch 14 in slot 20 of b0ccal06 had a little high mean and RMS before. The corresponding PMT CEM 20W, 7L was noticed hot on YMon. After yesterday's work, the RMS and pedestals have come down a little bit. Looking at the FRAM contents of this channel today, they were still calibrated to the old mean. Just refreshing the FRAMs with new constants.
<!-- Comment: Tue Feb  4 12;31;02 comment by...Vivek -->
We waited for a day to confirm that the channel is stable in its mean and rms and only then the FRAM was downloaded.
<!-- Date: Tue Feb 4 11:47:48 2003 -->
c11 converter node is gold.  Since I am waiting in "start" for other work, I have clicked "Clean up L3 mon" and "Clean up L3 farm".
<!-- Author: m mattson -->
<!-- Comment: Tue Feb  4 12;02;27 comment by...m mattson -->
<br>Steve N hit the reset button on one of the svx (vrb?) crates.  We have clicked the "Clean up EVB" bar.
<!-- Date: Tue Feb 4 11:52:40 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158048">158048</A>
TERMINATE: Done FRAM download for ccal crates.
<!-- Author: Vivek(x2080) -->
<!-- Comment: Tue Feb  4 11;57;54 comment by...Vivek -->
In particular, b0ccal06, slot 20, ch 14 FRAM is now matched to its current calibration.


<!-- Date: Tue Feb 4 11:59:58 2003 -->
Calorimeter crate update: 
<UL> 
<LI>Willis S has the plug cal crates for laser calibrations 
<LI>Karen B has the central cal crates to check SMXR 
<LI>Nikolay L has the wall cal crates to do sourcing 
</UL>
<!-- Author: m mattson -->


<!-- Date: Tue Feb 4 12:05:15 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158050">158050</A>
ACTIVATE: plug laser, normal mode, ler=1. Two PHA towers off: west w11t06, east w17t14
<!-- Author: willis -->


<!-- Date: Tue Feb 4 12:09:23 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158050">158050</A>
TERMINATE: good run
<!-- Author: willis -->



<!-- Date: Tue Feb 4 12:09:23 2003 -->
<pre>Willis warns that his work my set off plug HV alarm. 
 
</pre>
<!-- Author: Paul -->

<!-- Date: Tue Feb 4 12:13:07 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158051">158051</A>
ACTIVATE: L2 torture, no cal crates, no b0htdc00
<!-- Author: mattson -->
<!-- Comment: Tue Feb  4 12;16;06 comment by...m mattson -->
<br> and no fcal01, which is still yellow.  An initial "L3 rate at 0 Hz" message, but a manual HRR cleared that up.  


<!-- Comment: Tue Feb  4 15;00;57 comment by...Michael Schmidt -->
<pre>This run has the bunch gate scaler firmware upgraded
correctly.  This upgrade provides information, via two
additional (and so far unused) scaler channels, if
either bunch gate board (L1A per bunch or livetime per
bunch) sees a sync error for the 132 nsec CDF clock
(e.g. bunch counter counting beyond 158 ... starting over at 0 for each B0 marker).

There is no reason to expect that this change affects
anything in terms of online performance or monitors.

The end of run summary diagnostic confirms that the per
bunch information is good (the sum equals the OR).
</pre>
<!-- Date: Tue Feb 4 12:18:40 2003 -->
Mark Knapp + another person work on alarms and TOF display.
<!-- Author: Paul -->


<!-- Date: Tue Feb 4 12:29:48 2003 -->
Run failed to end gracefully, evb stuck.  Steve N points out that L3 proxy has died.  Following instructions, hit Abort-Reset-"Clean up EVB".
<!-- Author: m mattson -->
<!-- Comment: Tue Feb  4 13;01;14 comment by...Guillelmo -->
you mean EVB proxy (not L3 proxy), right?
<!-- Date: Tue Feb 4 12:41:22 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158054">158054</A>
ACTIVATE: L2 torture, w/o any cal crates, fcal01, and hadron_timing
<!-- Author: mattson -->
<!-- Comment: Tue Feb  4 12;43;19 comment by...m mattson -->
<p>Peter W instructed me on the trigger voodoo to do:
<UL>
<LI>L1 trigger 1, change prescale from 101 to 49
<LI>L2 trigger 6, change prescale from 10K to 151
</UL>
Torture run is going smoothly, L1A is 35.7 KHz, L2A is 238 Hz


<!-- Date: Tue Feb 4 12:43:51 2003 -->
Andy Hocker access to make visual cable inspection.
<!-- Author: Paul -->

<!-- Date: Tue Feb 4 12:51:59 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158054">158054</A>
TERMINATE: Putting ccal crates back in
<!-- Author: mattson -->


<!-- Date: Tue Feb 4 12:59:36 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158056">158056</A>
ACTIVATE: Karen B torture test for ccal crates
<!-- Author: mattson -->



<!-- Date: Tue Feb 4 13:10:10 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158056">158056</A>
TERMINATE: Testing SMXR
<!-- Author: mattson -->


<!-- Date: Tue Feb 4 13:14:41 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158060">158060</A>
ACTIVATE: More SMXR torture stuff
<!-- Author: mattson -->



<!-- Date: Tue Feb 4 13:19:40 2003 -->
Dave Toback access to work on plug had tdc w/ Sungwon and Fabio.
<!-- Author: Paul -->

<!-- Date: Tue Feb 4 13:21:08 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158060">158060</A>
TERMINATE: Shepherded ccal06 and 14 at the beginning of the run
<!-- Author: mattson -->


<!-- Date: Tue Feb 4 13:25:57 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158062">158062</A>
ACTIVATE: Another SMXR torture run
<!-- Author: mattson -->


<!-- Date: Tue Feb 4 13:32:17 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158061">158061</A>
TERMINATE: Si Test Run 
<!-- Author: nahn -->


<!-- Date: Tue Feb 4 13:36:45 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158062">158062</A>
TERMINATE: try another SMXR run
<!-- Author: mattson -->


<!-- Date: Tue Feb 4 13:41:54 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158063">158063</A>
ACTIVATE: SMXR torture run w/o ccal06, slot3
<!-- Author: mattson -->



<!-- Date: Tue Feb 4 13:41:59 2003 -->
Dan Cyr responded to a page about a TDC time out error that occurred in a cosmic run earlier today, run 158047.  He will come tonight to look at it.
<!-- Author: Paul -->
<!-- Comment: Tue Feb  4 14;43;13 comment by...m mattson -->
<p>Also look at the short spike run 158065, error log, for the htdc00 problem.
<!-- Date: Tue Feb 4 13:45:18 2003 -->
Nikolay will start WHA sourcing run.
<!-- Author: Paul -->

<!-- Date: Tue Feb 4 13:49:33 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158063">158063</A>
TERMINATE: data does not appear to be going to the look area
<!-- Author: mattson -->
<!-- Comment: Tue Feb  4 14;05;27 comment by...Michael Schmidt -->
<pre>It would be useful it at least some data could go to the look
area for these L2 torture and cosmic runs as we sweep through
the partitions so that I can look at some information offline.</pre>
<!-- Date: Tue Feb 4 13:51:57 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158064">158064</A>
ACTIVATE: Another test
<!-- Author: nahn -->


<!-- Date: Tue Feb 4 13:58:28 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158065">158065</A>
 Activated at 2003.02.04 13:56:33
<!-- Author: RunControl -->


<!-- Date: Tue Feb 4 13:58:29 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158065">158065</A>
 Terminated at 2003.02.04 13:57:08
<!-- Author: RunControl -->
<!-- Comment: Tue Feb  4 13;59;57 comment by...m mattson -->
<br>
forgot htdc00 was in the configuration.  It still has the bizarre bunchcounter DTO problem.
<!-- Date: Tue Feb 4 13:58:30 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158065">158065</A>
ACTIVATE: spike run
<!-- Author: mattson -->




<!-- Date: Tue Feb 4 14:06:13 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158066">158066</A>
 Activated at 2003.02.04 14:05:09
<!-- Author: RunControl -->


<!-- Date: Tue Feb 4 14:06:42 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158066">158066</A>
ACTIVATE: spike run w/o pcal, wcal, htdc00
<!-- Author: mattson -->


<!-- Date: Tue Feb 4 14:13:47 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158066">158066</A>
 Terminated at 2003.02.04 14:12:08
<!-- Author: RunControl -->


<!-- Date: Tue Feb 4 14:17:06 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158066">158066</A>
TERMINATE: Finished 30K for spike run
<!-- Author: mattson -->


<!-- Date: Tue Feb 4 14:22:11 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158064">158064</A>
TERMINATE: 30 kEvents no errors...
<!-- Author: nahn -->


<!-- Date: Tue Feb 4 14:24:53 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158068">158068</A>
 Activated at 2003.02.04 14:23:48
<!-- Author: RunControl -->


<!-- Date: Tue Feb 4 14:27:11 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158068">158068</A>
ACTIVATE: Cosmic run w/o pcal, wcal, fcal01, htdc00
<!-- Author: mattson -->



<!-- Date: Tue Feb 4 14:31:52 2003 -->
Turning on solenoid so Nikolay can do WHA sourcing.
<!-- Author: Paul -->


<!-- Date: Tue Feb 4 14:37:38 2003 -->
<pre>  In case of a need to page L3 farm pager please try the pager 
first and if it does not respond within 10min, call Ilya's cell 
630-430-4803. The pager is going to be out of range most likely 
starting from now (14:30) for 2 hours or so. After then all 
will be back to normal. 
</pre>
<!-- Author: Ilya -->


<!-- Date: Tue Feb 4 14:39:15 2003 -->
PHA HV channel swaps: west wedge 11 towers 6 and 7, 
                      east wedge 17 towers 14 and 15<br> 
1) During adjustments of the plug HV based on source data, the 
   check of the actual PMT gain shifts with plug laser runs 
   revealed HV cable swaps in two pairs 
   of towers in the PHA. We turned off the HV to one of 
   the towers in the pair swap and verifed this. The source runs 
   indicate no swaps on the PMT signal output end. (Data is ok -- 
   taken into account by LERs)<br> 
2) The cabling was not swapped; the HV map in the plug HV  
   control program's HV configuration file was swapped.<br>   
<!-- Author: Howard Budd, Willis -->


<!-- Date: Tue Feb 4 14:39:52 2003 -->
During this run we had all crates go into error at the same time. From the error log file: 
 
<pre> 
 
31'3" 27 crate/s: b0imu00(80), b0imu01(81), b0cmu01(82), b0cmu00(83), b0musc00(85), b0cmx00(86), b0xft05(102), b0svt00(120), b0svt07(122), b0svt02(123), b0svt06(124), b0svt03(125), b0svt05(126), b0svt04(127), b0l1cl00(128), b0l1cl02(130), b0l1cl03(131), b0l1cl04(132), b0l1cl05(133), b0tsi03(138), b0puls00(139), b0l2cl00(144), b0l2cl01(145), b0l2cl02(146), b0l2cl03(147), b0l2cl04(148), b0l2cl05(149),  in error.[RXPT] 
(MLE) b0dap59.fnal.gov:AWT-EventQueue-0:2:31:03 PM->FrontEnd Crate Error Condition from: 
CCAL_00 
CCAL_01 
CCAL_02 
CCAL_03 
CCAL_04 
CCAL_06 
CCAL_08 
CCAL_09 
CCAL_12 
CCAL_13 
CCAL_14 
CCAL_15 
COT_00 
COT_01 
COT_02 
COT_03 
COT_04 
COT_05 
COT_08 
COT_09 
COT_10 
COT_11 
COT_12 
COT_13 
COT_14 
COT_15 
IMU_00 
IMU_01 
CMU_01 
CMU_00 
CMP_00 
MUON_SCINT_00 
CMX_00 
XFT_LINKER_01 
XFT_LINKER_03 
XFT_LINKER_05 
SVT_TRACKING_00 
SVT_FANOUT_07 
SVT_TRACKING_02 
SVT_FITTER_06 
SVT_TRACKING_03 
SVT_TRACKING_05 
SVT_TRACKING_04 
LEVEL1_CAL_00 
LEVEL1_CAL_01 
LEVEL1_CAL_02 
LEVEL1_CAL_03 
LEVEL1_CAL_04 
LEVEL1_CAL_05 
LEVEL1_GLOBAL_00 
TRIGGER_SCALERS_00 
COT_PULSER_00 
LEVEL2_CAL_00 
LEVEL2_CAL_01 
LEVEL2_CAL_02 
LEVEL2_CAL_03 
LEVEL2_CAL_04 
LEVEL2_CAL_05 
</pre> 
HRR recovered.
<!-- Author: peter wittich :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158068' target=_top>158068</a>) -->


<!-- Date: Tue Feb 4 14:44:05 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158069">158069</A>
ACTIVATE: plug laser, normal mode, ler=1 (after PHA HV channel swaps)
<!-- Author: willis -->



<!-- Date: Tue Feb 4 14:44:12 2003 -->
<pre>TSU grounding work is fully completed. 
</pre>
<!-- Author: Akram Artikov, Oleg Poukhov -->

<!-- Date: Tue Feb 4 14:49:51 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158069">158069</A>
TERMINATE: good run (warm up 1)
<!-- Author: willis -->


<!-- Date: Tue Feb 4 14:53:19 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158070">158070</A>
ACTIVATE: plug laser, normal mode, ler=1
<!-- Author: willis -->


<!-- Date: Tue Feb 4 15:00:14 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158068">158068</A>
 Terminated at 2003.02.04 14:58:03
<!-- Author: RunControl -->


<!-- Date: Tue Feb 4 15:00:15 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158068">158068</A>
TERMINATE: switching from cosmic to torture run
<!-- Author: mattson -->


<!-- Date: Tue Feb 4 15:00:16 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158070">158070</A>
TERMINATE: good run (warm up #2)
<!-- Author: willis -->



<!-- Date: Tue Feb 4 15:02:04 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158071">158071</A>
ACTIVATE: plug laser, myron mode, ler=1
<!-- Author: willis -->


<!-- Date: Tue Feb 4 15:08:28 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158072">158072</A>
ACTIVATE: L2 Torture run, w/o pcal, wcal, fcal01, htdc00
<!-- Author: mattson -->
<!-- Comment: Tue Feb  4 15;09;28 comment by...m mattson -->
<br>
L1A at 43.1 KHz, L2A at 305 Hz
<!-- Comment: Tue Feb  4 15;16;10 comment by...m mattson -->
<p>Run grinds to a halt:
<pre>9'8" b0l3gate1.fnal.gov:main:3:09:08 PM->Host b0eb15.fnal.gov, task tRec_0
SCPU-P2-E-BadVrbByteCount: Event 35316 total byte count is lt 32,
 gt 65528, or not divisible by 8 for VRB in slot 10.
Count = 196851. -->  
 Additional Information: 

 Attention!!!. SCPU_BAD_VRB_BYTE_COUNT Error !!!. 
 Hardware EVB has detected a problem with data quality.
 SCPU %s reports problems with a VRB header.
 Datataking is paused: events are not being processed.
    - HRR should help.</pre>
Manual HRR has us running again.  Wonder what "%s" is supposed to be.
<!-- Date: Tue Feb 4 15:08:42 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158071">158071</A>
TERMINATE: good run, but apparently not Myron mode.
<!-- Author: willis -->



<!-- Date: Tue Feb 4 15:10:37 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158073">158073</A>
ACTIVATE: plug laser, myron mode, ler=1
<!-- Author: willis -->


<!-- Date: Tue Feb 4 15:14:56 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158073">158073</A>
TERMINATE: good run
<!-- Author: willis -->



<!-- Date: Tue Feb 4 15:15:34 2003 -->
<pre>Calibrated central SMXRs earlier (around 12:30pm) and 
then ran L2torture to try to understand high occupancy 
problem observed in owl shift for West phi=18.   This 
high occupancy was observed 2 nights ago for West phi=18,19,20.  
It looks like the Lookup tables were corrupt (i.e., the  
SMXRs needed calibrating).  There were calibrations over the weekend,  
so i'm not sure why the SMXR became uncalibrated.    
 
In the future, the easist way to see this is to look at the 
CESWireCanvas (or CESstripCanvas or CPRWireCanvas) and then 
to rescale the occupancy by left clicking on the mouses and 
setting this limit beyond 1.0 (2. or 1.5 ).  
Whenever the SMXR reads out 100% of the time with ADCs greater than 30000 cts,  
the lookup tables are garbage and we need to calibrate.   </pre>
<!-- Author: byrum -->

<!-- Date: Tue Feb 4 15:16:00 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158072">158072</A>
TERMINATE: moving right along...
<!-- Author: mattson -->




<!-- Date: Tue Feb 4 15:16:30 2003 -->
Slava, Dave Toback, Sungwon want to swap a plug em asd board. Willis wants to finish other plug work first.  Page Slava at 218-8916 when Willis is done.
<!-- Author: Paul -->
<!-- Comment: Tue Feb  4 15;45;08 comment by...Paul -->
access is granted
<!-- Date: Tue Feb 4 15:18:35 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-873&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-873  width='300' align='top'></td><td>This plots shows the uncalibrated SMXR in West phi=18</a></td></tr></table>
<!-- Author: byrum -->

<!-- Date: Tue Feb 4 15:29:58 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158075">158075</A>
ACTIVATE: Cosmic run w/o tracks, w/ readoutlists, also w/o pcal, wcal, fcal01, htdc00
<!-- Author: mattson -->



<!-- Date: Tue Feb 4 15:34:08 2003 -->
<pre>Current heartbeat alarm status: 
 
purple: COT, CEM, CHA, WHA, ICI 
 
grey: PEM, PHA, PSH 
 
black: TOF 
 
I do not understand why COT and TOF are under alarm.  Steve Hahn is notified. 
 
 
</pre>
<!-- Author: Paul -->

<!-- Date: Tue Feb 4 15:37:36 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158075">158075</A>
TERMINATE: XTRP is being swiped
<!-- Author: mattson -->



<!-- Date: Tue Feb 4 15:38:57 2003 -->
I've taken the XTRP crate to test loading the three track trigger board with our old 2301 MVME processor.
<!-- Author: Nathan -->
<!-- Comment: Tue Feb  4 15;45;35 comment by...m mattson -->
<br>
When they powered off the crate, it set off a PSM alarm for 1RR18F.


<!-- Date: Tue Feb 4 15:51:00 2003 -->
<br> LERs are set =1 for WHA crates to make WHA sourcing. 
I made several WHA source runs with Bon:158074,158076.
<!-- Author: Andrea & Nikolay  -->

<!-- Date: Tue Feb 4 15:57:25 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:02</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->


<!-- Date: Tue Feb 4 15:57:26 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158079">158079</A>
 Activated at 2003.02.04 15:55:21
<!-- Author: RunControl -->


<!-- Date: Tue Feb 4 15:57:27 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158079">158079</A>
ACTIVATE: Isolist run w/o pcal, wcal, xtrp
<!-- Author: mattson -->



<!-- Date: Tue Feb 4 15:59:14 2003 -->
<font color=red>Shift Summary: </font><pre>level 2 torture tests, scaler firmware upgrade - Greg 
 
cosmic trigger runs 
 
RT server tests - Jane N. 
 
drilling for crane infrastructure in hall 
   east halo counters removed for protection - Rick 
 
installation of control software for solenoid 
 
Access work: 
 
   clean CMU LV connectors - Koji and Hyunsoo 
 
   TSU amplifier grounding work fully completed - Oleg and Akram 
 
   HAD TDC - Dave Toback, Sungwon and Fabio 
 
   replace plug em asd board - Slava, Dave, Sungwon 
 
plug calorimeter laser calib - Willis 
 
SMX ccal crate tests - Karen - found lookup tables for SMXR were corrupted 
 
silicon crate tests - Steve N. 
 
WHA sourcing - Nikolay</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   tests only
Delivered Luminosity     
Acquired Luminosity      
Efficiency             
   
</td></tr></table></pre>
<!-- Author: Paul -->

<!-- Date: Tue Feb 4 16:15:53 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158079">158079</A>
 Terminated at 2003.02.04 16:14:46
<!-- Author: RunControl -->