<!-- Title: Day shift. Wed Feb 12, 2003 -->
<!-- SciCo: Kirsten Tollefson -->
<!-- DAQAce: Alberto Annovi -->
<!-- MonAce: Luis Castillo -->
<!-- CO: &nbsp; -->
<!-- OpManager: Phil Koehn -->
<!-- Notes: -->
<pre>In access until 11am.   
 
Work with Karen and Mike on SMXR crates.  L2 torture tests. 
L3 work. 
 
</pre>


<!-- Date: Wed Feb 12 08:34:21 2003 -->
DTO from FCAL00: Bunchcounters in slot 8 (BC=12) and slot 16 (BC=106) disagree.  
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158665' target=_top>158665</a>) -->
<!-- Comment: Wed Feb 12 08;55;16 comment by...Alberto -->
HRR fixed it.
<!-- Date: Wed Feb 12 08:48:58 2003 -->
During today's access I looked at SMD-SE 9 & 11 because of fans not running. I found that the AC-receptacle # 8 is faulty. So I used a different receptacle to power up fans for SMDSE 9 & 11. Fans are now working fine.
<!-- Author: Roberto Davila -->


<!-- Date: Wed Feb 12 08:49:20 2003 -->
DTO from CCAL01: AM->SMXR Not Responding event 599720, slot 4, bunch ctr 80, L2buffer 0, header 0x3bfe450
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158665' target=_top>158665</a>) -->
<!-- Comment: Wed Feb 12 08;54;41 comment by...Alberto -->
Auto HRR fixed it.



<!-- Comment: Wed Feb 12 09;02;08 comment by...Alberto -->
<pre>Got 2 more:
AM->SMXR Not Responding event 762211, slot 4, bunch ctr 71, L2buffer 0, header 0x3bfe447
AM->SMXR Not Responding event 769897, slot 4, bunch ctr 9, L2buffer 0, header 0x3bfe409
Auto HRR fixed them. 
L1 rate is 41 KHz.</pre>
<!-- Comment: Wed Feb 12 09;09;24 comment by...Alberto -->
<pre>one more:
AM->SMXR Not Responding event 933452, slot 4, bunch ctr 3, L2buffer 0, header 0x3bfe403</pre>
<!-- Comment: Wed Feb 12 09;11;07 comment by...Alberto -->
one more: AM->SMXR Not Responding event 978388, slot 4, bunch ctr 0, L2buffer 0, header 0x3bfe400. Auto HRR fixed it.
<!-- Comment: Wed Feb 12 09;14;06 comment by...Alberto -->
one more:  AM->SMXR Not Responding event 1028443, slot 4, bunchctr 86, L2buffer 0, header 0x3bfe456. Auto HRR fixed it.
<!-- Comment: Wed Feb 12 09;15;36 comment by...Alberto -->
one more: AM->SMXR Not Responding event 1054743, slot 4, bunch ctr 139, L2buffer 0, header 0x3bfe48b. Auto HRR did it.
<!-- Comment: Wed Feb 12 09;17;44 comment by...Alberto -->
one more: AM->SMXR Not Responding event 1054743, slot 4, bunch ctr 139, L2buffer 0, header 0x3bfe48.
<!-- Comment: Wed Feb 12 09;32;07 comment by...Luis -->
One more:
(MLE) b0ccal01:Messenger:9:26:34 AM->SMXR Not Responding event 1282993, slot 4, bunch ctr 62, L2buffer 0, header 0x3bfe43e

<!-- Comment: Wed Feb 12 09;38;46 comment by...Alberto -->
one more: AM->SMXR Not Responding event 1388031, slot 4, bunch ctr 56, L2buffer 2, header 0x3bfe438.
<!-- Date: Wed Feb 12 09:00:39 2003 -->
At 8:21 the event rate went to 0. 
Karen that was downstair niticed this and called us. 
HRR recovered. I suppose that Karen was faster then the "L2 rate goes to 0" alarm because we didn't get it.
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158665' target=_top>158665</a>) -->








<!-- Date: Wed Feb 12 09:30:05 2003 -->
<pre>There were 5 consecutive HEVB errors. Auto HRR recovered: 
 
 Hardware EVB has detected a problem with data quality in  
 SCPU b0eb13 (forwarded by FER crate COT_08).  
 Datataking is paused: events are not being processed.  
 - HRR should help.  
[MLE] 
(MLE) b0l3gate1.fnal.gov:main:9:21:38 AM->Host b0eb13.fnal.gov, task tRec_0 
SCPU-P0-E-VrbHeader: Dump of header words for event 1202095 from VRB in slot 10: 
0x00000000 0x000016d0 0x00000040 0x00f80120 0x013c0118 0x010000f8 0x01000724 0x07200100 
21'40" b0l3gate1.fnal.gov:main:9:21:38 AM->Host b0eb13.fnal.gov, task tRec_0 
SCPU-P0-E-TracerEventId: Event 1202096, crate 56, channel 7 has either bad Tracer ID or bad markers around Tracer word. 
 Tracer word event ID is 2, should be 0. 
Tracer word = 0x6e020038 (I think). 
Channel data = 0x000001c8 0x6e020038 0x434f5444 0x00140008 0x00000000 0x00000023 0x00000003 0x00000010 ... 
... 0x00000718 0x00000000 0x00065d4f 0x00000000 0xaaaaaaaa 0x55555555 0x6e020038 0x80000000 -->   
 Attention!!!. SCPU_TRACER_EVENT_ID Error !!!  
 Hardware EVB has detected a problem with data quality in  
 SCPU b0eb13 (forwarded by FER crate COT_08).  
 Datataking is paused: events are not being processed.  
 - HRR should help.  
</pre>
<!-- Author: Luis :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158665' target=_top>158665</a>) -->


<!-- Date: Wed Feb 12 09:38:12 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158665">158665</A>
TERMINATE: Ending L2 torture
<!-- Author: Tim -->



<!-- Date: Wed Feb 12 09:41:46 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158666">158666</A>
ACTIVATE: Starting CAL QIE calibration
<!-- Author: Tim -->


<!-- Date: Wed Feb 12 09:43:30 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158666">158666</A>
TERMINATE: Ending CAL QIE calibration
<!-- Author: Tim -->



<!-- Date: Wed Feb 12 09:44:15 2003 -->
People will be working on COT SL7. The HV monitoring will show some unps and downs for COT.
<!-- Author: Luis -->

<!-- Date: Wed Feb 12 09:46:22 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158667">158667</A>
ACTIVATE: Starting CLC QIE calibration
<!-- Author: Tim -->


<!-- Date: Wed Feb 12 09:55:27 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158672">158672</A>
ACTIVATE: Starting SMXQIE calibration
<!-- Author: Tim -->



<!-- Date: Wed Feb 12 09:55:29 2003 -->
<pre>Reboot b0clc01 crate to download online lumi program 
with new calibration constants.</pre>
<!-- Author: Ming -->


<!-- Date: Wed Feb 12 09:55:47 2003 -->
There was an alarm from the arches (04W). CANWT_1 showed a problem, but came back to normal.
<!-- Author: Luis :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158672' target=_top>158672</a>) -->

<!-- Date: Wed Feb 12 09:57:50 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158672">158672</A>
TERMINATE: Ending SMXQIE calibration
<!-- Author: Tim -->


<!-- Date: Wed Feb 12 10:01:31 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158673">158673</A>
ACTIVATE: prepping for daq deadtiem scans
<!-- Author: feild -->


<!-- Date: Wed Feb 12 10:13:17 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158674">158674</A>
ACTIVATE: Starting L2 torture
<!-- Author: Tim -->



<!-- Date: Wed Feb 12 10:15:37 2003 -->
Checked roman pots - there was a card stuck.  They rebooted  
the crate and now it works fine.
<!-- Author: Kirsten -->


<!-- Date: Wed Feb 12 10:19:43 2003 -->
DTO from PCAL09:<br> 
(MLE) b0l3gate1.fnal.gov:main:10:13:07 AM->Host b0eb16.fnal.gov, task tRec_0SCPU-P2-E-VrbReadFailed: Error reading VRB in slot 12 for event 29076.<br> 
The VRB had no event.<br> 
13'10" 1 crate/s: b0pcal09(43),  Done TO.[RXPT]<br> 
(MLE) b0tsi02:Messenger:10:13:08 AM->DONE timeout<br> 
(MLE) b0dap59.fnal.gov:AWT-EventQueue-0:10:13:08 AM->Done Timeout: PCAL_09 <br>  
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158674' target=_top>158674</a>) -->

<!-- Date: Wed Feb 12 10:27:29 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158674">158674</A>
TERMINATE: Ending to take CCAL06 out.
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 10:27:29 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158674">158674</A>
TERMINATE: Ending to take CCAL06 out.
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 10:30:02 2003 -->
Got 4 CCAL06 DTO: 
 
AM->SMXR Not Responding event 168374, slot 3, bunch ctr 21, L2buffer 0, header 0x3ffe315 
AM->SMXR Not Responding event 168375, slot 3, bunch ctr 30, L2buffer 0, header 0x3ffe31e 
AM->SMXR Not Responding event 168376, slot 3, bunch ctr 0, L2buffer 1, header 0x3bfe300 
AM->SMXR Not Responding event 168377, slot 3, bunch ctr 24, L2buffer 0, header 0x3ffe318
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158674' target=_top>158674</a>) -->

<!-- Date: Wed Feb 12 10:35:30 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158675">158675</A>
ACTIVATE: Starting L2 torture w/o CCAL06 
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 10:41:57 2003 -->
Martin Wolter came to look at the PSM problem. Voltman shows that two power supplies (SMDCW04 and CANWT1) went to zero and back almost at the same time. It seems it was a result of power cycling them (they are also close to each other).
<!-- Author: Luis -->

<!-- Date: Wed Feb 12 10:45:43 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158675">158675</A>
TERMINATE: Ending L2 torture
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 10:46:14 2003 -->
Aseet came back. They are done with SL7, and alarms should be paid attention to again. SL7 will remain low though.
<!-- Author: Luis -->

<!-- Date: Wed Feb 12 10:50:39 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158676">158676</A>
ACTIVATE: Starting L2 torture w/o CCAL06
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 10:51:03 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158677">158677</A>
ACTIVATE: Starting SMX QIE calib
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 10:51:29 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158677">158677</A>
TERMINATE: Ending SMX QIE calib (only CCAL 06)
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 10:55:06 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158676">158676</A>
TERMINATE: Ending to include CCAL06
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 10:55:39 2003 -->
PEM, PHA and PSH status is changing often. People are working on these systems.
<!-- Author: Luis -->
<!-- Comment: Wed Feb 12 10;56;24 comment by...Luis -->
They are back to being monitored.


<!-- Date: Wed Feb 12 10:59:31 2003 -->
Gas alarm. We called cryo (and they called us almost at the same time). They are doing a test.
<!-- Author: Luis -->

<!-- Date: Wed Feb 12 11:06:44 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158679">158679</A>
ACTIVATE: l2 torture with ps set to L1a 20KHz, L2A 330 Hz
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 11:12:04 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158679">158679</A>
TERMINATE: Ending L2 torture
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 11:15:55 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158682">158682</A>
ACTIVATE: Start L2 torture again
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 11:16:41 2003 -->
b0fcal00 was red in VxWorks. I reseted it. Now it's green.
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 11:30:32 2003 -->
<pre>Hw EVB errors: 
 
b0l3gate1.fnal.gov:main:11:23:16 AM->Host b0eb15.fnal.gov, task tRec_0 
SCPU-P2-E-VrbHeader: Dump of header words for event 173626 from VRB in slot 12:0x00000000 0x000021f8 0x00390039 0x04480000 0x049c0484 0x04580494 0x05400428 0x02100000 
23'17" b0l3gate1.fnal.gov:main:11:23:16 AM->Host b0eb15.fnal.gov, task tRec_0 SCPU-P2-E-BadVrbByteCount: Event 173626 total byte count is lt 32, gt 65528, or not divisible by 8 for VRB in slot 14. Count = 196659. 
 
b0l3gate1.fnal.gov:main:11:23:16 AM->Host b0eb15.fnal.gov, task tRec_0 SCPU-P2-E-VrbHeader: Dump of header words for event 173626 from VRB in slot 14: 0x00920031 0x00930033 0x00940034 0x00950033 0x00960032 0x00970030 0x00cc0034 0x00cd002f 
 
2 orange windows poped up.</pre>
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158682' target=_top>158682</a>) -->


<!-- Date: Wed Feb 12 11:38:27 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-919&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-919 align='top'></td><td>the universe (according to WMAP)</a></td></tr></table>
<!-- Author: R. Vidal -->


<!-- Date: Wed Feb 12 11:43:33 2003 -->
DTO from CCAL01: 
AM->Event 443543: Bunchcounters in slot 16 (BC=83) and slot 19 (BC=62) disagree (at least) 
AM->Runtime Error 1, Event 443543: Bunch counter mismatch, mismatch count = 1  
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158682' target=_top>158682</a>) -->


<!-- Date: Wed Feb 12 11:48:10 2003 -->
<pre>SMX Access report.  We solved one problem (ccal07), but probably not the other (ccal06).    
 
Ccal07 has been reporting errors of type  
 
PM->SMXR Not Responding event 799, slot 4, bunch ctr 71, L2buffer 0, header 0x3bfe447 
 
since the arch was power cycled at the end of the last access on Thursday 2/6.   
We power cycled both the SMXR and SMD crates to ccal07, slot4 to 
reset and reestablish communication. 
This crate was giving a hard immediate failure at the beginning  
of l2 torture runs which is not now occuring. 
 
 
We also noticed a stressed cable from the SMXR auxilary board 
to the SMD crate for ccal06, slot3. Since the error we are chasing  
involves communication loss between the SMD and SMXR 
crates, there was a long shot that this could be causing our 
errors.  We removed this stress and then ran L2 torture for 
almost 2 hours with no errors.  However, once we closed the 
muon wall, we immediatelly got consecutive events with errors of the type 
 
CCAL06 DTO: AM->SMXR Not Responding event 168374, slot 3, bunch ctr 21, L2buffer 0, header 0x3ffe315  
AM->SMXR Not Responding event 168375, slot 3, bunch ctr 30, L2buffer 0, header 0x3ffe31e  
 
 
AM->SMXR Not Responding event 168376, slot 3, bunch ctr 0, L2buffer 1, header 0x3bfe300  
AM->SMXR Not Responding event 168377, slot 3, bunch ctr 24, L2buffer 0, header 0x3ffe318  
 
We swapped the modified SMXR in slot 3 with an unmodified SMXR. 
If this doesn't work, we will next swap out the modified tracer.</pre>
<!-- Author: byrum,lindgren -->

<!-- Date: Wed Feb 12 11:59:34 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158684">158684</A>
ACTIVATE: Starting L2 torture again
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 12:03:31 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158684">158684</A>
TERMINATE: Ending L2 torture
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 12:04:52 2003 -->
<pre>DTO from PCAL09: 
(MLE) b0l3gate1.fnal.gov:main:11:59:42 AM->Host b0eb16.fnal.gov, task tRec_0 
SCPU-P2-E-VrbReadFailed: Error reading VRB in slot 12 for event 57938. 
The VRB had no event. 59'43" 1 crate/s: b0pcal09(43),  Done TO.[RXPT] 
</pre>
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158684' target=_top>158684</a>) -->

<!-- Date: Wed Feb 12 12:08:25 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158685">158685</A>
ACTIVATE: Calibration and downloading
<!-- Author: spezziga -->



<!-- Date: Wed Feb 12 12:10:16 2003 -->
Went on an access to investigate into "flaky" trigger output 4 in b0pcal11, slot 19. Found nothing wrong with the cable and it was plugged in fine. But still took it out, checked for broken/bent pins and put it back in. SUMET5 rates were fine after this.
<!-- Author: Vivek -->

<!-- Date: Wed Feb 12 12:15:53 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158685">158685</A>
TERMINATE: Calibration good, but CSL errors. I'll do it again using a different partition
<!-- Author: spezziga -->


<!-- Date: Wed Feb 12 12:15:54 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158686">158686</A>
ACTIVATE: Starting BSC QIE calibration
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 12:16:51 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158686">158686</A>
TERMINATE: Ending BSC QIE calib
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 12:18:24 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158687">158687</A>
ACTIVATE: New calibration
<!-- Author: spezziga -->


<!-- Date: Wed Feb 12 12:18:25 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158688">158688</A>
ACTIVATE: Starting BSC RP calib
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 12:20:31 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158688">158688</A>
TERMINATE: Ending BSC RP calibration
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 12:24:44 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158689">158689</A>
ACTIVATE: Starting CLC QIE calibration
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 12:25:40 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158689">158689</A>
TERMINATE: Ending CLC QIE calib
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 12:32:09 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158687">158687</A>
TERMINATE: Calibration performed and downloaded
<!-- Author: spezziga -->
<!-- Comment: Wed Feb 12 12;37;51 comment by...Mario Spezziga -->
I learnt that partition 14 must not be used to do a QIE calibration, or it will trigger a message saying that the CSL is not going to write data to disk. This happened yesterday and, though it may not be the cause of the trouble we were having since that calibration, i used a different partition for this calibration instead and everithing looked fine.
<!-- Date: Wed Feb 12 12:36:57 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158690">158690</A>
ACTIVATE: Starting TOF QIE calib
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 12:37:13 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158690">158690</A>
TERMINATE: Ending TOF QIE calib
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 12:44:50 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158691">158691</A>
ACTIVATE: Starting L2 torture
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 12:51:09 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158692">158692</A>
ACTIVATE: Starting L2 torture
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 12:53:49 2003 -->
<pre>DTO from PCAL09: 
(MLE) b0pcal09:Messenger:12:47:18 PM->Runtime Error 1, Event 5190: See nonsequen 
tial event number (old 5, new 8) in L2 message 
(MLE) b0pcal09:Messenger:12:47:18 PM->Event 5190: Bunchcounters in slot 14 (BC=127) and slot 20 (BC=77) disagree (at least) 
(MLE) b0pcal09:Messenger:12:47:19 PM->Runtime Error 2, Event 5190: Bunch counter mismatch, mismatch count = 5 
(MLE) b0l3gate1.fnal.gov:main:12:47:19 PM->Host b0eb16.fnal.gov, task tRec_0 
SCPU-P2-E-VrbHeader: Dump of header words for event 5190 from VRB in slot 12:0x00000000 0x000012e0 0x00050045 0x02ec031c 0x031802ec 0x03700338 0x00000000 0x0 
0000000 
</pre>
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158692' target=_top>158692</a>) -->


<!-- Date: Wed Feb 12 13:02:50 2003 -->
DTO's from CMP_00 multiple times. 
 
<pre> 
(MLE) b0dap59.fnal.gov:AWT-EventQueue-0:12:55:08 PM->Done Timeout: CMP_00  
(MLE) b0cmp00:Messenger:12:55:11 PM->Runtime Error 4, Event 126889: Timeout on global TDC Done 
(MLE) b0cmp00:Messenger:12:55:11 PM->VISIONread/write failed in slot 5 
(MLE) b0cmp00:Messenger:12:55:11 PM->Runtime Error 5, Event 126889: TDC in slot 5 not ready for readout 
(MLE) b0tsi02:Messenger:12:55:11 PM->DONE timeout 
</pre> 
Try "reboot, reset, recover" on this guy. then mutr00 gives problems. do same to it.  so far so good.
<!-- Author: alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158692' target=_top>158692</a>) -->

<!-- Date: Wed Feb 12 13:04:18 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158692">158692</A>
TERMINATE: Ending to reset EVB
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 13:13:59 2003 -->
<pre>PM->Busy Timeout: TRIGGER_SCALERS_00. 
1'13" 1 crate/s: b0tsi03(138),busy.[RXPT]b0l3gate1.fnal.gov:main:1:01:13 PM->Host b0eb10.fnal.gov, task tsmDisp 
SM-P2-E-ScpuTimeout: SCPU ack timeout for Recover operation.[MLE] 1'14" b0l3gate1.fnal.gov:main:1:01:13 PM->Host b0eb10.fnal.gov, task tsmDisp 
SM-P2-E-ScpuTimeout: SCPU ack timeout for Recover operation.[MLE] 
 
(MLE) b0tsi02:Messenger:1:01:47 PM->BUSY timeout 
1'51" 1 crate/s: b0tsi03(138),  busy.23 crate/s: b0svt00(120), b0svt01(121), b0svt07(122), b0svt02(123), b0svt06(124), b0svt03(125), b0svt05(126), b0svt04(127), b0l1cl00(128), b0l1cl01(129), b0l1cl02(130), b0l1cl03(131), b0l1cl04(132), b0l1cl05(133), b0l1gl00(134), b0tsi03(138), b0puls00(139), b0l2cl00(144), b0l2cl01(145), b0l2cl02(146), b0l2cl03(147), b0l2cl04(148), b0l2cl05(149),  in error.[RXPT] 
 
then many of the following: 
(EOR) b0ccal00: triggered 132215/readout 132215/sent 132215 events. 
then we have got a CSL error. 
 
Check the log file for more details. 
 
</pre>
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158692' target=_top>158692</a>) -->

<!-- Date: Wed Feb 12 13:14:48 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158693">158693</A>
ACTIVATE: Starting L2 torture again
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 13:26:44 2003 -->
<pre>(MLE) b0pcal09:Messenger:1:23:34 PM->Event 144197: Bunchcounters in slot 14 (BC=112) and slot 21 (BC=76) disagree (at least) 
(MLE) b0pcal09:Messenger:1:23:35 PM->Runtime Error 1, Event 144197: Bunch counter mismatch, mismatch count = 1 
</pre>
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158693' target=_top>158693</a>) -->

<!-- Date: Wed Feb 12 13:42:57 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158693">158693</A>
TERMINATE: Ending L2 torture
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 13:53:19 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158694">158694</A>
ACTIVATE: Starting L2 torture
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 13:55:39 2003 -->
By Sasha's request, turned the CLC HV on.
<!-- Author: Luis :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158694' target=_top>158694</a>) -->


<!-- Date: Wed Feb 12 14:19:52 2003 -->
DTO from PCAL09, bunchcounters mismatch.
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158694' target=_top>158694</a>) -->


<!-- Date: Wed Feb 12 14:26:39 2003 -->
<p>Have done CLC QIE expert calibration, downloaded new calib. constants into CLC ADMEM's FRAM 
 
<p>Done CLC LED gain calibration<p>
<!-- Author: Sasha -->


<!-- Date: Wed Feb 12 14:34:44 2003 -->
PSM alarm from 2nd floor power supplies. It went away once I brought up the corresponding window.
<!-- Author: Luis -->


<!-- Date: Wed Feb 12 14:42:14 2003 -->
Sasha is done. CLC HV back off.
<!-- Author: Luis -->


<!-- Date: Wed Feb 12 15:00:05 2003 -->
<p>Irina and I have started up the CEM CHA WHA PMT readout with the new, improved iFIX 3.0 version.  Please let one of us know if there are any problems.</p>
<!-- Author: Steve Hahn, Irina Schreiber -->

<!-- Date: Wed Feb 12 15:12:15 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158702">158702</A>
ACTIVATE: Starting L2 torture
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 15:20:56 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158702">158702</A>
TERMINATE: ending run to remove the cal crates for the laser guys
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 15:27:29 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158703">158703</A>
ACTIVATE: Starting L2 torture w/o CCALs and WCALs
<!-- Author: Alberto -->


<!-- Date: Wed Feb 12 15:48:47 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158705">158705</A>
ACTIVATE: Starting L2 torture
<!-- Author: Alberto -->



<!-- Date: Wed Feb 12 15:54:04 2003 -->
PCAL09 "event": 
 
(MLE) b0dap59.fnal.gov:AWT-EventQueue-0:3:46:01 PM->Done Timeout: PCAL_09 
SCPU-P2-E-TracerEventId: Event 2166, crate 44, channel 3 has either bad Tracer ID or bad markers around Tracer word.
<!-- Author: Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=158705' target=_top>158705</a>) -->

<!-- Date: Wed Feb 12 15:58:17 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:01</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Wed Feb 12 16:05:00 2003 -->
<font color=red>Shift Summary: </font><pre>During controlled access Karen and Mike worked on CCAL_06 and  
CCAL_07.  Hopefully the DTO's from the SMXR boards  
will be gone now.  Also Vivek reseated the cables to  
PCAL_11 to hopefully solve the problem seen last night with  
the calorimeter trigger tower.   
 
COT SL7's voltage has been lowered due to trips during the store 
last night. 
 
Greg, Bill and Peter W. have been running L2 torture tests and  
SVT timing studies all day. 
 
Bill Badgett and Mario S. redid the CAL QIE calibrations and  
made sure they made it to the database. 
 
Fabio and Simone are doing central and wall laser calibrations now. 
 
Beams plan to stack to 100 and then shot.  Don't expect beam  
until end of eve shift.</pre> 
<!-- Author: Kirsten -->


<!-- Date: Wed Feb 12 16:05:18 2003 -->
<pre>Changed /cdf/code-common/cdfonline/vxboot/ups/b0_cot.table  
file to point to the tdc "current" version, rather  
than development. 
 
Will take effect after reboot. 
</pre>
<!-- Author: Ron Moore, W.Badgett -->
<!-- Comment: Wed Feb 12 16;13;29 comment by...ronmoore -->
<pre>Ditto for the b0_muontdc.table file.</pre>