<!-- Title: Owl shift. Sun Jul 20, 2003 -->
<!-- SciCo:  Marjorie Shapiro -->
<!-- DAQAce:  Mitch Soderberg -->
<!-- MonAce: Chun Yang -->
<!-- CO:  Anadi Canepa -->
<!-- OpManager:  Masa Tanaka -->
<!-- Notes: -->
<pre>Waiting for store setup.  Taking cosmics</pre>


<!-- Date: Sun Jul 20 00:23:21.288 2003 -->
<center><a href='/elog/notebooks/2003/Sun_Jul_20_2003_Owl.002157.ps'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8318' ></a><a href='/elog/notebooks/2003/Sun_Jul_20_2003_Owl.002224.ps'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8320' ></a><a href='/elog/notebooks/2003/Sun_Jul_20_2003_Owl.002233.ps'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8322' ></a></center>
<!-- Author: Anadi & Stefano -->
<!-- Comment: Sun Jul 20 00;35;04 comment by...byrum -->
This calibration looks great,  there are no sections of consecutive channels.  There are several single channels with
all 8 ranges and 4 capids failing calibrations, and this is normal. 

<!-- Date: Sun Jul 20 00:42:18.376 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166401">166401</A>
 Terminated at 2003.07.20 00:40:35
<!-- Author: RunControl -->


<!-- Date: Sun Jul 20 00:42:19.358 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166401">166401</A>
TERMINATE: end cosmics run waiting for shot setup
<!-- Author: Chun x 2080 -->


<!-- Date: Sun Jul 20 00:53:41.661 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166402">166402</A>
ACTIVATE: start AAA_shotsetup
<!-- Author: Chun x 2080 -->



<!-- Date: Sun Jul 20 00:55:49.226 2003 -->
<pre>Proton injection in progress</pre>
<!-- Author: Marjorie Shapiro -->


<!-- Date: Sun Jul 20 00:57:21.645 2003 -->
<TABLE bgcolor=#cdc9a5> 
<TR><TH>Date</th><th>Time</th><th>BLM</th><th colspan=2>Dose</th></tr> 
<tr><td>2003.07.20</td><td>00:49:43</td><td>W Inner BLM</td><td>0.31</td><td>RADS</td></tr> 
<tr><td>2003.07.20</td><td>00:49:43</td><td>W Outer BLM</td><td>0.05</td><td>RADS</td></tr> 
<tr><td>2003.07.20</td><td>00:49:43</td><td>E Inner BLM</td><td>1.23</td><td>RADS</td></tr> 
<tr><td>2003.07.20</td><td>00:49:43</td><td>E Outer BLM</td><td>3.47</td><td>RADS</td></tr> 
</TABLE> 
<strong>Integrated dosage</strong>
<!-- Author: Mitch -->


<!-- Date: Sun Jul 20 01:21:12.598 2003 -->
<pre>Antiproton bunches loaded</pre>
<!-- Author: Marjorie Shapiro -->

<!-- Date: Sun Jul 20 01:24:00.367 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166402">166402</A>
TERMINATE: end AAA_shotsetup at Flattop
<!-- Author: Chun x 2080 -->



<!-- Date: Sun Jul 20 01:44:10.414 2003 -->
Store number 2803:  scraping complete 
TevPR: 8080e9, TevPB: 746e9 
L=31.9 e30 
  
<!-- Author: Marjorie Shapiro -->

<!-- Date: Sun Jul 20 01:45:01.723 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403">166403</A>
 Activated at 2003.07.20 01:43:17
<!-- Author: RunControl -->


<!-- Date: Sun Jul 20 01:45:02.487 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403">166403</A>
ACTIVATE: start AAA_Current
<!-- Author: Chun x 2080 -->



<!-- Date: Sun Jul 20 01:51:54.047 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8323&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8323' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8324&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8324' width='300'></a></center>
<!-- Author: Mitch -->
<!-- Comment: Sun Jul 20 01;53;16 comment by...Mitch -->
Shot-setup plots.  Had to turn off BMU, SW 84 due to trip (as previous shift-crew said we would have to).


<!-- Date: Sun Jul 20 01:54:00.993 2003 -->
<TABLE bgcolor=#add8e6> 
<TR><TH>Date</th><th>Time</th><th colspan=3>Quantity</th></tr> 
<tr><td>2003.07.20</td><td>01:45:12</td><td>TEVpr</td><td>8068.43</td><td>1E09</td></tr> 
<tr><td>2003.07.20</td><td>01:45:12</td><td>TEVpb</td><td>744.24</td><td>1E09</td></tr> 
<tr><td>2003.07.20</td><td>01:47:31</td><td>C:B0ILUM</td><td>31.73</td><td>E30</td></tr> 
<tr><td>2003.07.20</td><td>01:47:31</td><td>C:B0LLUM</td><td>30.74</td><td>E30</td></tr> 
<tr><td>2003.07.20</td><td>01:47:31</td><td>C:B0PLOS</td><td>2344.11</td><td>Hz</td></tr> 
<tr><td>2003.07.20</td><td>01:47:31</td><td>C:B0ALOS</td><td>138.57</td><td>Hz</td></tr> 
</TABLE> 
<strong>Luminosity and losses</strong>
<!-- Author: Mitch -->


<!-- Date: Sun Jul 20 01:59:34.150 2003 -->
<pre>Pinky: 
ISL DVDD B0W4L0 
unmarked.</pre>
<!-- Author: Mitch :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403' target=_top>166403</a>) -->


<!-- Date: Sun Jul 20 02:00:33.875 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>Bunchcounter mismatch collection 
 
(MLE) b0wcal05:Messenger:1:53:59 AM-&gt;Event 147595: Bunchcounters in slot 16 (BC=83) and slot 17 (BC=65) disagree (L2B=0) </pre></td></tr></td></table>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403' target=_top>166403</a>) -->
<!-- Comment: Sun Jul 20 02;06;37 comment by...Chun -->
<pre>Messenger:2:02:22 AM-&gt;Event 264279: Bunchcounters in slot 5 (BC=109) and slot 8 (BC=15) disagree (L2B=0) 
(MLE) b0cot19:Messenger:2:02:22 AM-&gt;Runtime Error 1, Event 264279: Bunch counter mismatch, mismatch count = 1</pre>
<!-- Comment: Sun Jul 20 02;20;21 comment by...Chun -->
<pre>(MLE) b0cot02:Messenger:2:15:23 AM-&gt;Event 442017: Bunchcounters in slot 2 (BC=68) and slot 13 (BC=65) disagree (L2B=3) </pre>
<!-- Comment: Sun Jul 20 02;26;25 comment by...Chun -->
<pre>(MLE) b0xft00:Messenger:2:18:00 AM-&gt;Event 474745: Bunchcounters in slot 13 (BC=0) and slot 7 (BC=0) disagree (L2B=0) 

(MLE) b0xft00:Messenger:2:19:19 AM-&gt;Event 493084: Bunchcounters in slot 13 (BC=0) and slot 10 (BC=0) disagree (L2B=0) 
</pre>
<!-- Date: Sun Jul 20 02:02:52.540 2003 -->
<pre>L3 node 166 filter 1 red</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403' target=_top>166403</a>) -->


<!-- Date: Sun Jul 20 02:05:00.377 2003 -->
<pre>(MLE) b0dap73.fnal.gov:Thread-22724:1:57:15 AM-&gt;SVXMon not connected since 2003-07-20 02:00:14.0</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403' target=_top>166403</a>) -->
<!-- Comment: Sun Jul 20 02;05;35 comment by...Chun -->
<pre>asked the CO to restart the SvxMon</pre>



<!-- Date: Sun Jul 20 02:12:13.884 2003 -->
<pre>SCPU_TRACER_EVENT_ID Error !!!  
Hardware EVB has detected a problem with data quality in  
SCPU b0eb12 (forwarded by FER crate LEVEL1_GLOBAL_00, ... etc).  
Datataking is paused: events are not being processed. </pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403' target=_top>166403</a>) -->



<!-- Date: Sun Jul 20 02:22:09.139 2003 -->
<pre>(MLE) b0l3gate2:main:2:09:30 AM-&gt;Error on L3 node b0l3026 (partition 0) Sun Jul 20 02:09:30 2003 l3_node 
in refoInt_reformatProc (l3_refevt.c:610) 
   </pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403' target=_top>166403</a>) -->



<!-- Date: Sun Jul 20 02:40:30.114 2003 -->
<pre>Looking at SVXMON, we see about 5 chips in L4 are giving chip ID errors.  We page SVX expert.</pre>
<!-- Author: Marjorie Shapiro  :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403' target=_top>166403</a>) -->


<!-- Date: Sun Jul 20 02:53:43.209 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-8326&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-8326  width='300' align='top'></td><td>SVX Cell ID and Map problem</a></td></tr></table>
<!-- Author: anadi -->


<!-- Date: Sun Jul 20 02:56:09.662 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8327&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8327' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8328&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8328' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8329&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8329' width='300'></a></center>
<!-- Author: Mitch -->
<!-- Comment: Sun Jul 20 02;56;31 comment by...Mitch -->
<pre>Hourly Plots.</pre>


<!-- Date: Sun Jul 20 03:13:03.206 2003 -->
<pre>get a big series of Error report like the following: 
 
(MLE) b0l3gate1.fnal.gov:main:3:02:12 AM-&gt;Host b0eb17.fnal.gov, task tRec_0SCPU-P0-E-VrbReadFailed: Error reading VRB in slot ** for event 1081474. 
The VRB had no event. 
</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403' target=_top>166403</a>) -->

<!-- Date: Sun Jul 20 03:22:13.793 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403">166403</A>
 Terminated at 2003.07.20 03:17:08
<!-- Author: RunControl -->


<!-- Date: Sun Jul 20 03:22:14.293 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403">166403</A>
TERMINATE: end the run for the SCPU Timeout Error and series L2 decision Timeout errors
<!-- Author: Chun x 2080 -->



<!-- Date: Sun Jul 20 03:25:39.674 2003 -->
<pre>58'40" 1 crate/s: b0svx02(112),  busy.[RXPT]b0l3gate1.fnal.gov:main:3:02:34 AM-&gt;Host b0eb10.fnal.gov, task tsmDisp 
SM-P0-E-ScpuTimeout: SCPU ack timeout for Recover operation. --&gt;   
 Additional Information:  
 
 Attention!!!. Scanner Manager SM_SCPU_TIMEOUT Error !!!.  
 We STRONGLY RECOMMEND the following steps:  
 - End the run, Reset  
 - Clean up EVB                              
 - Start run again.  
</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403' target=_top>166403</a>) -->
<!-- Comment: Sun Jul 20 03;32;55 comment by...Chun -->
<pre>We have to end the run because shortly after this error, there were a series of L2 decision timeout error. HRR didn't help. This was common recently and the L2 experts always asked asked us to end-&gt;reset-&gt;cold start. </pre>
<!-- Date: Sun Jul 20 03:32:55.506 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166404">166404</A>
TERMINATE: b0Svx01 halted in config. have to redo config
<!-- Author: Chun x 2080 -->



<!-- Date: Sun Jul 20 03:38:43.541 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166405">166405</A>
TERMINATE: bpccal10 halted this time during config. have to re-config
<!-- Author: Chun x 2080 -->
<!-- Comment: Sun Jul 20 03;45;23 comment by...Chun -->
<pre>shepherded this crate and successed.</pre>
<!-- Date: Sun Jul 20 03:41:47.269 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406">166406</A>
 Activated at 2003.07.20 03:40:26
<!-- Author: RunControl -->


<!-- Date: Sun Jul 20 03:41:48.350 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406">166406</A>
ACTIVATE: resume datataking
<!-- Author: Chun x 2080 -->



<!-- Date: Sun Jul 20 03:41:49.591 2003 -->
<pre>Have a ton of pink cells (SVX DVDD row 0 and 1), though the Silicon expert (who was already on the phone with the CO) says this is probably due to the fact that b0svx01 failed Config transition.  History plots show that all these cells spiked during this time, but came back down to normal values quickly.  Will wait for new run to confirm this.</pre>
<!-- Author: Mitch -->
<!-- Comment: Sun Jul 20 03;56;30 comment by...Mitch -->
<pre>whoops. I meant layer 0 and layer 1, not row.
</pre>
<!-- Comment: Sun Jul 20 04;16;26 comment by...Mitch -->
<pre>Talked to silicon expert again.  We're now fairly confident that the pinkies in layer 0 and layer 1 of SVX DVDD were caused by the spike in the proton abort gap (see hourly plots below), and had nothing to do with b0svx01 failing config.  </pre>
<!-- Date: Sun Jul 20 03:43:17.727 2003 -->
<pre>Jason: stuck cell ID for several layer 4 chips. 
chips are scattered. we'll keep an eye on the next run </pre>
<!-- Author: anadi  :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403' target=_top>166403</a>) -->



<!-- Date: Sun Jul 20 03:46:48.216 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-8330&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-8330  width='300' align='top'></td><td>This is an example of what the pinkies history plots looked like.</a></td></tr></table>
<!-- Author: Mitch -->



<!-- Date: Sun Jul 20 04:00:10.291 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8331&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8331' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8332&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8332' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8333&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8333' width='300'></a></center>
<!-- Author: Mitch -->
<!-- Comment: Sun Jul 20 04;04;37 comment by...Mitch -->
<pre>Hourly plots.  Note the huge spike in the proton abort gap plot (PBSM, yellow line in middle plot), which happened at right about the time we got all the pinkies I mentioned above.  Perhaps this was the cause of the pinkies, not b0svx01 failing transition?</pre>


<!-- Comment: Sun Jul 20 08;07;16 comment by...SCN -->
More likely it is the transition failure (or really the fact
that the failure of the transition holds off the all Fib crates
initialization for longer than usual.  This sort of thing happens
because you have initializaed the SRC but not the Fibs.  A spike 
in the losses would probably not affect ALL ladders.
<!-- Date: Sun Jul 20 04:13:47.535 2003 -->
<pre>manually issue HRR by the request of the CO</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406' target=_top>166406</a>) -->



<!-- Date: Sun Jul 20 04:21:56.003 2003 -->
<pre>(MLE) b0cot09:Messenger:4:19:46 AM-&gt;Event 488141: Bunchcounters in slot 2 (BC=74) and slot 6 (BC=86) disagree (L2B=2)  
(MLE) b0cot09:Messenger:4:19:46 AM-&gt;Runtime Error 1, Event 488141: Bunch counter mismatch, mismatch count = 1</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406' target=_top>166406</a>) -->


<!-- Date: Sun Jul 20 04:35:36.699 2003 -->
<table><tr><td><a href=/elog/notebooks/2003/Sun_Jul_20_2003_Owl.043533.ps align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-8347  align='top'></td><td>SVXMon problem: stuck cell ID  Jason suggested HRR. HRR done. Jason is storing info in the monitoring database for diagnostic purposes</a></td></tr></table>
<!-- Author: anadi -->


<!-- Date: Sun Jul 20 04:36:48.942 2003 -->
<table><tr><td><a href=/elog/notebooks/2003/Sun_Jul_20_2003_Owl.043645.ps align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-8349  align='top'></td><td>plot for Cell ID</a></td></tr></table>
<!-- Author: anadi  -->
<!-- Comment: Sun Jul 20 14;29;43 comment by...Jason Nielsen -->
Found 4 out of 5 chips with stuck cell ID were already known in the silicon problem DB.  I added the fifth (e364c8).  They are known problems and are masked in the auto-HRR generation.
<!-- Date: Sun Jul 20 04:51:23.457 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8350&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8350' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8351&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8351' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8352&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8352' width='300'></a></center>
<!-- Author: Mitch -->
<!-- Comment: Sun Jul 20 04;51;45 comment by...Mitch -->
<pre>Hourly plots.
</pre>


<!-- Date: Sun Jul 20 04:52:23.904 2003 -->
<pre>series done timeout. find lots of bunchcounter mismatch in crate b0pcal10. 
 
RXPT errors loop. have to shepherd the crate b0pcal10. things back to normal now.</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406' target=_top>166406</a>) -->


<!-- Date: Sun Jul 20 05:23:06.667 2003 -->
<pre>get a series of bunchcounter mismatch 
 
(MLE) b0xft04:Messenger:4:52:00 AM-&gt;Event 857511: Bunchcounters in slot 13 (BC=0) and slot 6 (BC=0) disagree (L2B=0)  
(MLE) b0xft04:Messenger:4:52:00 AM-&gt;Runtime Error 2, Event 857511: Bunch counter mismatch, mismatch count = 1 
(MLE) b0xft04:Messenger:4:52:29 AM-&gt;Event 864668: Bunchcounters in slot 13 (BC=0) and slot 9 (BC=0) disagree (L2B=0)  
(MLE) b0xft04:Messenger:4:52:29 AM-&gt;Runtime Error 3, Event 864668: Bunch counter mismatch, mismatch count = 1 
(MLE) b0xft00:Messenger:4:59:50 AM-&gt;Event 971712: Bunchcounters in slot 13 (BC=0) and slot 7 (BC=0) disagree (L2B=0)  
(MLE) b0xft00:Messenger:4:59:50 AM-&gt;Runtime Error 1, Event 971712: Bunch counter mismatch, mismatch count = 1 
(MLE) b0xft04:Messenger:5:03:40 AM-&gt;Event 1027761: Bunchcounters in slot 13 (BC=0) and slot 9 (BC=0) disagree (L2B=0)  
(MLE) b0xft04:Messenger:5:03:41 AM-&gt;Runtime Error 4, Event 1027761: Bunch counter mismatch, mismatch count = 1 
(MLE) b0xft00:Messenger:5:18:42 AM-&gt;Event 1243489: Bunchcounters in slot 13 (BC=0) and slot 7 (BC=0) disagree (L2B=0)  
(MLE) b0xft00:Messenger:5:18:42 AM-&gt;Runtime Error 2, Event 1243489: Bunch counter mismatch, mismatch count = 1 
(MLE) b0cot09:Messenger:5:19:02 AM-&gt;Event 1248222: Bunchcounters in slot 2 (BC=127) and slot 4 (BC=59) disagree (L2B=2)  
(MLE) b0cot09:Messenger:5:19:02 AM-&gt;Runtime Error 2, Event 1248222: Bunch counter mismatch, mismatch count = 1</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406' target=_top>166406</a>) -->
<!-- Comment: Sun Jul 20 05;48;17 comment by...Chun -->
<pre>(MLE) b0cot10:Messenger:5:45:59 AM-&gt;Event 1624599: Bunchcounters in slot 5 (BC=139) and slot 11 (BC=6) disagree (L2B=3) </pre>


<!-- Comment: Sun Jul 20 06;00;23 comment by...Chun -->
<pre>(MLE) b0ccal03:Messenger:5:57:33 AM-&gt;Event 1779862: Bunchcounters in slot 17 (BC=71) and slot 16 (BC=53) disagree (L2B=0) </pre>
<!-- Comment: Sun Jul 20 06;58;40 comment by...Chun -->
<pre>(MLE) b0cot15:Messenger:6:55:45 AM-&gt;Event 2552288: Bunchcounters in slot 3 (BC=65) and slot 5 (BC=127) disagree (L2B=1) </pre>
<!-- Date: Sun Jul 20 05:50:36.837 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8353&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8353' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8354&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8354' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8355&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8355' width='300'></a></center>
<!-- Author: Mitch -->
<!-- Comment: Sun Jul 20 05;50;58 comment by...Mitch -->
<pre>Hourly plots.
</pre>



<!-- Date: Sun Jul 20 06:55:32.383 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8356&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8356' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8357&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8357' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8358&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8358' width='300'></a></center>
<!-- Author: Mitch -->
<!-- Comment: Sun Jul 20 06;55;56 comment by...Mitch -->
<pre>Hourly Plots.
</pre>



<!-- Date: Sun Jul 20 07:13:30.448 2003 -->
<pre>L3 node 60 filter 1 red</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406' target=_top>166406</a>) -->


<!-- Date: Sun Jul 20 07:22:47.362 2003 -->
<pre>(MLE) b0l3gate2:main:7:14:46 AM-&gt;Error on L3 node b0l3234 (partition 0) Sun Jul 20 07:14:46 2003 l3_node  
in refoInt_reformatProc (l3_refevt.c:610) 
L3_REFORMAT_ERROR</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406' target=_top>166406</a>) -->


<!-- Date: Sun Jul 20 07:24:25.909 2003 -->
<pre>56'28" b0dau32.fnal.gov:csl_mon_send:7:00:22 AM-&gt;CSL received a "BAD EVENT" in partition 0.[MLW] 
(MLE) b0l3gate1.fnal.gov:main:7:14:46 AM-&gt;Host b0eb12.fnal.gov, task tRec_0 
SCPU-P0-E-VrbHeader: Dump of header words for event 2794100 from VRB in slot 14: 
0x00000000 0x00001a60 0x00120092 0x03e003e0 0x03e003e0 0x03e003e0 0x03000000 0x00000000 
(MLE) b0l3gate1.fnal.gov:main:7:14:46 AM-&gt;Host b0eb12.fnal.gov, task tRec_0 
SCPU-P0-E-VrbHeader: Dump of header words for event 2794101 from VRB in slot 12: 
0x55555555 0x54150081 0x80000000 0x00000000 0x0000008b 0x5c150082 0x54433144 0x000c0003</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406' target=_top>166406</a>) -->


<!-- Date: Sun Jul 20 07:38:56.003 2003 -->
<pre>30'53" b0dap57.fnal.gov:resmgr.ReplyMonitor 2:7:34:47 AM-&gt; Dead Time is High ~100%</pre>
<!-- Author: Chun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406' target=_top>166406</a>) -->
<!-- Comment: Sun Jul 20 07;41;16 comment by...Chun -->
<pre>This high deadtime is contributed nearly 100% by the L2. Issue HRR and recovered.</pre>


<!-- Date: Sun Jul 20 07:49:01.742 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8359&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8359' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8360&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8360' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-8361&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-8361' width='300'></a></center>
<!-- Author: Mitch -->
<!-- Comment: Sun Jul 20 07;49;31 comment by...Mitch -->
<pre>Hourly Plots.
</pre>


<!-- Date: Sun Jul 20 07:51:24.397 2003 -->
(MLE) b0wcal05:Messenger:7:49:11 AM->Runtime Error 1, Event 3214510: Bunch counter mismatch, mismatch count = 1
<!-- Author: Stan Forrester :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406' target=_top>166406</a>) -->


<!-- Date: Sun Jul 20 07:54:57.688 2003 -->
(MLE) b0cot06:Messenger:7:52:59 AM->Event 3258197: Bunchcounters in slot 6 (BC=133) and slot 7 (BC=12) disagree (L2B=3)  
(MLE) b0cot06:Messenger:7:52:59 AM->Runtime Error 1, Event 3258197: Bunch counter mismatch, mismatch count = 1
<!-- Author: Stan Forrester :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406' target=_top>166406</a>) -->

<!-- Date: Sun Jul 20 07:57:22.227 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166403>
166403</A> 
x28A03</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_1_05 [5,319,391]</TD>                                       
<TD ALIGN=CENTER>01:43:17</TD>                                          
<TD ALIGN=CENTER>03:17:08</TD>                                          
<TD ALIGN=CENTER>01:29:05</TD>                                          
<TD ALIGN=RIGHT>     74,085,817</TD>                                    
<TD ALIGN=RIGHT>     1,262,486</TD>                                     
<TD ALIGN=RIGHT>     282,899</TD>                                       
<TD ALIGN=RIGHT>  159.170</TD>                                          
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406>
166406</A> 
x28A06</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_1_05 [5,319,391]</TD>                                       
<TD ALIGN=CENTER>03:40:26</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>04:03:60</TD>                                          
<TD ALIGN=RIGHT>    181,114,076</TD>                                    
<TD ALIGN=RIGHT>     3,258,198</TD>                                     
<TD ALIGN=RIGHT>     703,030</TD>                                       
<TD ALIGN=RIGHT>  356.600</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>07:55:02</TD>                                                       
<TD ALIGN=CENTER>05:33:05</TD>                                          
<TD ALIGN=RIGHT>     255,199,893</TD>                                   
<TD ALIGN=RIGHT>      4,520,684</TD>                                    
<TD ALIGN=RIGHT>       985,929</TD>                                     
<TD ALIGN=RIGHT>  515.770</TD>                                          
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Sun Jul 20 07:57:47.077 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-8362&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-8362  width='300' align='top'></td><td>End of shift luminosity plot.</a></td></tr></table>
<!-- Author: d -->


<!-- Date: Sun Jul 20 07:58:17.486 2003 -->
<TABLE bgcolor=#cdc9a5> 
<TR><TH>Date</th><th>Time</th><th>BLM</th><th colspan=2>Dose</th></tr> 
<tr><td>2003.07.20</td><td>07:49:44</td><td>W Inner BLM</td><td>223.90</td><td>RADS</td></tr> 
<tr><td>2003.07.20</td><td>07:49:44</td><td>W Outer BLM</td><td>0.00</td><td>RADS</td></tr> 
<tr><td>2003.07.20</td><td>07:49:44</td><td>E Inner BLM</td><td>0.00</td><td>RADS</td></tr> 
<tr><td>2003.07.20</td><td>07:49:44</td><td>E Outer BLM</td><td>223.90</td><td>RADS</td></tr> 
</TABLE> 
<strong>Integrated dosage</strong>
<!-- Author: Mitch -->


<!-- Date: Sun Jul 20 07:58:43.528 2003 -->
<font color=red>Shift Summary: </font><pre>01:45 Run 166403 begins 
02:40 we see about 5 chips in L4 giving chip ID errors 
       SVX expert (Jaison) says bad chips scattered.  Keep going 
       and just watch 
03:22 End the run for the SCPU Timeout Error 
03:41 Start new run 166406 
04:50 bunchcounter mismatch errors in crate b0pcal10</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   166403,  166406
Delivered Luminosity   576.11  
Acquired Luminosity     509.88  
Efficiency             88.50
   
</td></tr></table></pre>
<!-- Author: Marjorie Shapiro -->
<!-- Comment: Sun Jul 20 14;27;48 comment by...Jason Nielsen -->
All of those scattered chips were known to have stuck cell ID.  They are masked in the stuck cell ID auto-HRR generation.  There must be a better way for us (silicon group) to let the CO know which errors are known and which are new.
<!-- Date: Sun Jul 20 08:00:13.631 2003 -->
(MLE) b0l3gate2:main:7:57:46 AM->Error on L3 node b0l3144 (partition 0) Sun Jul 20 07:57:44 2003 l3_node  
  in refoInt_reformatProc (l3_refevt.c:610) 
     ( L3_REFORMAT_ERROR: see Error Handler _reformatter.log file for full message) 
54'14" b0dap63.fnal.gov:ConsumerErrorRe:7:58:08 AM->Runtime Error 1, Event 4884, RunNum 166406: SvxMon Halt Recover Run: Pipeline out of synch in 77 silicon readout chips . -->   
 Additional Information:  
 
 Attention !!!. CER_SVXMON_HALT_RECOVER_RUN_ERROR !!!  
  
 Pipeline out of synch in 77 silicon readout chips .  
 AUTO HRR will be issued
<!-- Author: Stan Forrester :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=166406' target=_top>166406</a>) -->