<!-- Title: Eve shift. Wed Oct 19, 2005 -->
<!-- SciCo: Bill Ashmanskas -->
<!-- DAQAce: Yuji Takeuchi -->
<!-- MonAce: Peter Dong -->
<!-- CO: Anna Sfyrla -->
<!-- OpManager: Guram Chlachidze -->
<!-- Notes: -->
No colliding beams.  Recycler stash at 51E10, Accumulator stack at 56E10, stacking at 13E10/hr.  Tev studies in progress.  Shot expected later this shift.  

<!-- Date: Wed Oct 19 16:17:32.598 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205878">205878</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [16,729,599] 
<!-- Author: markus x2080 -->



<!-- Date: Wed Oct 19 16:19:06.875 2005 -->
<pre>Summary of L3/EVB work: 
- debugged missing XTCD bank.  
- debugged L3 reformatter.  
- replaced a VRB in EVB crate 12. 
Please use the EVB as much as possible and report high rate of Busy TO's or TM2 pending TOs.</pre>
<!-- Author: markus -->
<!-- Comment: Wed Oct 19 16;39;27 comment by...Bill -->
Frank Chlebana called to ask us (or Markus) to test the swapped VRB at high rates using L2 torture or similar, before declaring victory.

<!-- Date: Wed Oct 19 16:21:26.144 2005 -->
Got heartbeat alarm for PSM.  VOLTMAN PC had an uncaught exception  and crashed.  Rebooted the PC, started it going again, all is well.
<!-- Author: Peter Dong -->

<!-- Date: Wed Oct 19 16:30:33.648 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205878">205878</A>
TERMINATE: ending to start a cosmic run ...
<!-- Author: markus x2080 -->



<!-- Date: Wed Oct 19 16:36:27.678 2005 -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>Found that we are getting NFS mount timeout errors on the   
front-end crates when they reboot:  
 
*** Error nfsMount /cdf/code-common  
*** Error: 3080197 &lt;S_rpcLib_RPC_TIMEDOUT&gt;  
 
Note that /cdf/code-common is still on the old b0dau30   
file server.    FrontEnd crates can still access files   
on /cdf/code-common, but at a very, very slow rate.   This   
also make the booting process significantly slower.  
 
Note that this problem is preventing b0clc01 from operating!! 
</pre></td></tr></td></table>
<!-- Author: W.Badgett -->
<!-- Comment: Wed Oct 19 16;43;28 comment by...Bill -->
Sent short message to run2-sys-cdfonline-pager.


<!-- Comment: Wed Oct 19 16;48;11 comment by...Bill -->
Stephan says he's not aware of anything we can do to fix this, as he doesn't know what the problem is.  "You [the shift crew] have to debug it."
I guess I'll go get my laptop and network hub ....

<!-- Date: Wed Oct 19 16:45:36.794 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205879">205879</A>
TERMINATE: only 3 l1 acc., no l2 acc. 
<!-- Author: markus x2080 -->
<!-- Comment: Wed Oct 19 16;50;22 comment by...markus -->
<pre>we are running AAA_SHOTSETUP. The first attempt to start failed. It was sufficient to restart the run.</pre>


<!-- Date: Wed Oct 19 16:57:19.336 2005 -->
<pre>The nfs mounting problem occurs on the Linux PCs, too;   
however, they look like they are OK as long as you  
don't reboot them.     
 
To debug the problem, I rebooted b0control01 to see if  it  
would have trouble with /cdf/code-common, and it did. 
</pre>
<!-- Author: W.Badgett -->


<!-- Date: Wed Oct 19 17:10:59.960 2005 -->
<pre>On the VRB swap: 
- we are running with a spare VRB in EVB crate 12. 
- the VRB was tested with 1.000.000 events using the diagnostic board b0rvb01. 
- we took a L2torture run with ~650Hz L2 accept rate. 
- currently we are running AAA_SHOTSETUP and found the first corrupted event. In 25min one corrupted event was detected.</pre>
<!-- Author: markus -->

<!-- Date: Wed Oct 19 17:13:02.676 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205880">205880</A>
TERMINATE: include clc
<!-- Author: markus x2080 -->



<!-- Date: Wed Oct 19 17:13:26.230 2005 -->
Portmapper on the SGI found unresponsive and restarted.
<!-- Author: Jason & Stephan -->
<!-- Comment: Wed Oct 19 17;38;17 comment by...W.Badgett -->
This fixes the above noted nfsMount problems...
<!-- Date: Wed Oct 19 17:25:42.151 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205881">205881</A>
TERMINATE: CSL gave up ...
<!-- Author: markus x2080 -->



<!-- Date: Wed Oct 19 17:37:53.372 2005 -->
<TABLE WIDTH=75% BGCOLOR=#CFCFFF> 
<TR><TD> 
<FONT COLOR=#0F0FFF> 
The <I>fer</I> package for <U>F</U>ront<U>E</U>nd<U>R</U>eadout has been  
upped to <BR>version <B>v4_24</B> with the following changes: 
<UL> 
<LI>Fix stupid bug in XTC Recover function that disabled XTCD readout <BR> 
after HRR. 
<LI>Change EVB daqmon subject to new one (VxMonMaster.java) 
</UL> 
Restarted daqmon and rebooted frontend crates to pick up change. 
</FONT> 
</TR></TR> 
</TABLE> 
<P>  
<!-- Author: W.Badgett -->



<!-- Date: Wed Oct 19 17:41:20.076 2005 -->
Sebastian says that IB2W2L3 VBIAS1 is dead.  He has set the current limit very low (2 microamps) so that it will go pink if it does turn on (in case it's just a flaky connection).  If it turns pink, we should put it in the elog but don't need to page silicon.
<!-- Author: Peter Dong -->

<!-- Date: Wed Oct 19 17:47:48.677 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205883">205883</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [16,729,599] 
<!-- Author: markus x2080 -->
<!-- Comment: Wed Oct 19 18;00;40 comment by...markus -->
can you please change the personal client name in RC.
<!-- Date: Wed Oct 19 17:51:48.236 2005 -->
Have loaded the CDF VxWorks kernel version 7.0 into the upstairs  
MVME2301 CPUs.   The change is to nfsMount the new  
/cdf/onln/data disk.  We'll see how that goes before changing  
the other CPUs.
<!-- Author: W.Badgett -->


<!-- Date: Wed Oct 19 18:23:09.553 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205884">205884</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [16,729,599] 
<!-- Author: Yuji x2080 -->



<!-- Date: Wed Oct 19 18:35:28.342 2005 -->
Got TM2 Error. Auto HRR issued. 
In Error Display, there are continuous error messages in every few seconds: 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:25 PM->FER_E_SVT, GB 6.1 nw=15 (mod7=1) ee=60646d event=186650, more:  
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:25 PM->FER_E_SVT, nwordsMod7=0, EEword=1 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:30 PM->FER_E_SVT, GB 6.1 nw=15 (mod7=1) ee=68647f event=188228, more:  
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:30 PM->FER_E_SVT, nwordsMod7=0, EEword=1 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:38 PM->FER_E_SVT, GB 6.1 nw=15 (mod7=1) ee=606444 event=190317, more:  
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:38 PM->FER_E_SVT, nwordsMod7=0, EEword=1 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:38 PM->FER_E_SVT, GB 6.1 nw=15 (mod7=1) ee=606403 event=190501, more:  
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:38 PM->FER_E_SVT, nwordsMod7=0, EEword=1  
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205884' target=_top>205884</a>) -->
<!-- Comment: Wed Oct 19 18;36;10 comment by...Yuji -->
<pre>Every few seconds we got:
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:25 PM-&gt;FER_E_SVT, GB 6.1 nw=15 (mod7=1) ee=60646d event=186650, more: 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:25 PM-&gt;FER_E_SVT, nwordsMod7=0, EEword=1
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:30 PM-&gt;FER_E_SVT, GB 6.1 nw=15 (mod7=1) ee=68647f event=188228, more: 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:30 PM-&gt;FER_E_SVT, nwordsMod7=0, EEword=1
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:38 PM-&gt;FER_E_SVT, GB 6.1 nw=15 (mod7=1) ee=606444 event=190317, more: 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:38 PM-&gt;FER_E_SVT, nwordsMod7=0, EEword=1
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:38 PM-&gt;FER_E_SVT, GB 6.1 nw=15 (mod7=1) ee=606403 event=190501, more: 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:34:38 PM-&gt;FER_E_SVT, nwordsMod7=0, EEword=1
</pre>

<!-- Comment: Wed Oct 19 18;45;56 comment by...Yuji -->
<pre>After shepherding the crate, we still have the messages, though the rate seems to be reduced:
(RC)   18:40:42 Run -&gt; ACTIVE
(MLE) b0svt06:Messenger:Oct 19, 2005 6:40:55 PM-&gt;FER_E_SVT, GB 6.1 nw=29 (mod7=1) ee=686606 event=3662, more: 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:40:55 PM-&gt;FER_E_SVT, nwordsMod7=0, EEword=1
(MLE) b0svt06:Messenger:Oct 19, 2005 6:41:26 PM-&gt;FER_E_SVT, GB 6.1 nw=29 (mod7=1) ee=68661b event=12511, more: 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:41:26 PM-&gt;FER_E_SVT, nwordsMod7=0, EEword=1
(MLE) b0svt06:Messenger:Oct 19, 2005 6:41:37 PM-&gt;FER_E_SVT, GB 6.1 nw=29 (mod7=1) ee=606609 event=15588, more: 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:41:37 PM-&gt;FER_E_SVT, nwordsMod7=0, EEword=1
(MLE) b0svt06:Messenger:Oct 19, 2005 6:42:37 PM-&gt;FER_E_SVT, GB 6.1 nw=29 (mod7=1) ee=686653 event=32056, more: 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:42:37 PM-&gt;FER_E_SVT, nwordsMod7=0, EEword=1
(MLE) b0svt06:Messenger:Oct 19, 2005 6:43:58 PM-&gt;FER_E_SVT, GB 6.1 nw=29 (mod7=1) ee=68668b event=54604, more: 
(MLE) b0svt06:Messenger:Oct 19, 2005 6:43:58 PM-&gt;FER_E_SVT, nwordsMod7=0, EEword=1
</pre>


<!-- Comment: Thu Oct 20 00;52;43 comment by...Bill Ashmanskas -->
In the past, this has been an 'impossible' (according to the source code) condition, which went away when the svtvme package was recompiled on gobi (the Sun machine), presumably to avoid a compiler bug that shows up on other host platforms.  Bill Badgett bought me a beer at some point for suggesting this.

<!-- Date: Wed Oct 19 19:08:18.828 2005 -->
Got TM2 Events Pending TO.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205884' target=_top>205884</a>) -->

<!-- Date: Wed Oct 19 19:10:02.303 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205884">205884</A>
TERMINATE: Test cosmic.
<!-- Author: Yuji x2080 -->


<!-- Date: Wed Oct 19 19:12:52.176 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205885">205885</A>
 Activated at 2005.10.19 19:11:58
<!-- Author: RunControl -->


<!-- Date: Wed Oct 19 19:12:53.587 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205885">205885</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,730,598] 
<!-- Author: Yuji x2080 -->



<!-- Date: Wed Oct 19 19:16:54.933 2005 -->
Got Done TO for b0cot06. HRR worked.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205885' target=_top>205885</a>) -->
<!-- Comment: Wed Oct 19 19;19;03 comment by...Yuji -->
Again.

<!-- Comment: Wed Oct 19 19;19;42 comment by...Yuji -->
Again.

<!-- Comment: Wed Oct 19 19;23;21 comment by...Yuji -->
Again. Shephered the crate.


<!-- Comment: Wed Oct 19 19;42;34 comment by...Yuji -->
Again.
<!-- Date: Wed Oct 19 19:25:58.822 2005 -->
Got TM2 Events Pending TO. HRR solved the problem.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205885' target=_top>205885</a>) -->
<!-- Comment: Wed Oct 19 19;43;46 comment by...Yuji -->
Again. HRR
<!-- Comment: Wed Oct 19 19;53;34 comment by...Yuji -->
Again.
<!-- Comment: Wed Oct 19 20;10;36 comment by...Yuji -->
Again.
<!-- Date: Wed Oct 19 19:26:27.726 2005 -->
Busy TO for b0tsi03. HRR.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205885' target=_top>205885</a>) -->
<!-- Comment: Wed Oct 19 20;17;58 comment by...Yuji -->
Again. HRR.

<!-- Date: Wed Oct 19 20:26:45.024 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205885">205885</A>
 Terminated at 2005.10.19 20:26:35
<!-- Author: RunControl -->


<!-- Date: Wed Oct 19 20:29:15.234 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205885">205885</A>
TERMINATE: End cosmic

<!-- Author: Yuji x2080 -->


<!-- Date: Wed Oct 19 20:30:51.310 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205886">205886</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_3_07 [2,725,597] 
<!-- Author: Yuji x2080 -->



<!-- Date: Wed Oct 19 20:31:07.039 2005 -->
<TABLE bgcolor=#cdc9a5> 
<TR><TH>Date</th><th>Time</th><th>BLM</th><th colspan=2>Dose</th></tr> 
<tr><td>2005.10.19</td><td>20:28:45</td><td>W Inner BLM</td><td>0.02</td><td>RADS</td></tr> 
<tr><td>2005.10.19</td><td>20:28:45</td><td>W Outer BLM</td><td>0.00</td><td>RADS</td></tr> 
<tr><td>2005.10.19</td><td>20:28:45</td><td>E Inner BLM</td><td>0.07</td><td>RADS</td></tr> 
<tr><td>2005.10.19</td><td>20:28:45</td><td>E Outer BLM</td><td>0.16</td><td>RADS</td></tr> 
</TABLE> 
<strong>Integrated dosage</strong>
<!-- Author: Peter Dong -->


<!-- Date: Wed Oct 19 20:33:37.934 2005 -->
Busy TO for b0cmu00.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205886' target=_top>205886</a>) -->
<!-- Comment: Wed Oct 19 20;35;09 comment by...Yuji -->
Again.


<!-- Date: Wed Oct 19 20:35:11.464 2005 -->
Proton load nearly complete -- will they be 'final'?  
<!-- Author: Bill -->
<!-- Comment: Wed Oct 19 20;37;45 comment by...Bill -->
Looks like they are final; antiproton load beginning.

<!-- Date: Wed Oct 19 20:37:11.123 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205886">205886</A>
TERMINATE: Cleanup EVB
<!-- Author: Yuji x2080 -->




<!-- Date: Wed Oct 19 20:38:51.296 2005 -->
Cleanup EVB.
<!-- Author: Yuji -->

<!-- Date: Wed Oct 19 20:39:46.214 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205887">205887</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_3_07 [2,725,597] 
<!-- Author: Yuji x2080 -->



<!-- Date: Wed Oct 19 20:41:23.945 2005 -->
Busy TO for b0cot08, b0xft02 and b0xft04. HRR issued.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205887' target=_top>205887</a>) -->
<!-- Comment: Wed Oct 19 20;44;47 comment by...Yuji -->
Again.


<!-- Comment: Wed Oct 19 20;49;00 comment by...Yuji -->
Busy TO for b0cot08.
<!-- Comment: Wed Oct 19 21;04;14 comment by...Yuji -->
Busy To for b0l2pu01
<!-- Date: Wed Oct 19 20:45:08.935 2005 -->
First 4 antiproton bunches loaded.  (Do they call it a 'parcel'?)
<!-- Author: Bill -->



<!-- Date: Wed Oct 19 21:00:28.176 2005 -->
TM2 Events Pending TO.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205887' target=_top>205887</a>) -->



<!-- Date: Wed Oct 19 21:07:15.966 2005 -->
Antiproton load complete: C:FBIANG = 940E9.  
<!-- Author: Bill -->
<!-- Comment: Wed Oct 19 21;07;36 comment by...  -->
Silicon expert is watching from home, will come in only if needed.



<!-- Date: Wed Oct 19 21:09:35.732 2005 -->
An SVX trip required a crate to be Hockerized.  I don't know what that means, but we spoke with Sebastian about it on the phone just before the end of antiproton loading.  
<!-- Author: Bill -->
<!-- Comment: Wed Oct 19 21;11;15 comment by...Peter Dong -->
Sebastian said we don't need to page if we're sure it's a Hockerization (but we should page if there's any doubt or uncertainty).  Hockerized successfully and brought the silicon back to standby.
<!-- Comment: Wed Oct 19 21;16;44 comment by...Sebastian -->
Thanks. Hockerizing simply means rebooting the power supply crate mainfame (for Andy Hocker, who established the procedure).
<!-- Date: Wed Oct 19 21:10:01.052 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205887">205887</A>
TERMINATE: At Flattop
<!-- Author: Yuji x2080 -->





<!-- Date: Wed Oct 19 21:22:46.864 2005 -->
Yuji saw a cluster of pinkies in iMon.  We unmarked all and they went back.
<!-- Author: Peter Dong -->


<!-- Date: Wed Oct 19 21:23:22.880 2005 -->
MCR calls to say that scraping is complete.  HV ramping up.  
<!-- Author: Bill -->
<!-- Comment: Wed Oct 19 21;24;43 comment by...Bill -->
Let MCR know that CLC is up.  L=88.9E30, not bad from 110E10 antiprotons!



<!-- Comment: Wed Oct 19 22;50;10 comment by...Peter Dong -->
Let the record show that Peter Dong won the pot for initial luminosity by Price-Is-Right rules, with a bet of 80.  On the other hand, Bill's bet was much closer (90).
<!-- Date: Wed Oct 19 21:26:18.841 2005 -->
Losses look great so I turn on silicon.
<!-- Author: Peter Dong -->


<!-- Date: Wed Oct 19 21:28:41.102 2005 -->
Trip on TOF followed immediately by CMX trip.  Reset both and they held.
<!-- Author: Peter Dong -->

<!-- Date: Wed Oct 19 21:29:05.153 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205888">205888</A>
 Activated at 2005.10.19 21:28:13
<!-- Author: RunControl -->


<!-- Date: Wed Oct 19 21:29:06.855 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205888">205888</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_3_07 [2,725,597] 
<!-- Author: Yuji x2080 -->



<!-- Date: Wed Oct 19 21:29:07.667 2005 -->
High voltages are up.  Here we go!  Store 4460, run 205888.  
<!-- Author: Bill :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205888' target=_top>205888</a>) -->


<!-- Date: Wed Oct 19 21:30:03.509 2005 -->
L3 high reformatter error rate, error logger screen is scrolling like mad ....  
<!-- Author: Bill -->
<!-- Comment: Wed Oct 19 21;31;36 comment by...Bill -->
Paging L3 for help.


<!-- Date: Wed Oct 19 21:31:54.850 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205888">205888</A>
 Terminated at 2005.10.19 21:31:17
<!-- Author: RunControl -->


<!-- Date: Wed Oct 19 21:31:55.105 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205888">205888</A>
TERMINATE: Many L3 reformatter errors
<!-- Author: Yuji x2080 -->
<!-- Comment: Wed Oct 19 22;17;15 comment by...Yuji -->
Cleaned up EVB here, but it didn't help to solve L3 reformatter error.
<!-- Date: Wed Oct 19 21:37:51.111 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889">205889</A>
 Activated at 2005.10.19 21:36:58
<!-- Author: RunControl -->


<!-- Date: Wed Oct 19 21:37:52.819 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889">205889</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_3_07 [2,725,597] 
<!-- Author: Yuji x2080 -->



<!-- Date: Wed Oct 19 21:38:21.355 2005 -->
Offending banks seem to be TCMD and TC1D, according to reformatter log.  
<!-- Author: Bill -->


<!-- Date: Wed Oct 19 21:55:06.684 2005 -->
Got L3 error. 
L3_REF_ERROR_HIGH_RATE error. 
error rate is about 6.5%.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889' target=_top>205889</a>) -->


<!-- Date: Wed Oct 19 21:55:15.337 2005 -->
Markus says he knows what the problem is, that it's a feature/bug of the reformatter code, not a problem with the data.  He said that the fix requires recompiling the L3 code, but he can't get to a computer just now to do that.  He's going to try to reach someone who can do it.  <p> 
Meanwhile, we're throwing away 8% of the data.  
<!-- Author: Bill -->


<!-- Date: Wed Oct 19 21:56:09.409 2005 -->
Busy TO for b0clc00
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889' target=_top>205889</a>) -->


<!-- Date: Wed Oct 19 21:58:51.155 2005 -->
<pre>Error messges flooding in Error DISPLAY. 
(MLE) b0l3pcom2.fnal.gov:main:Oct 19, 2005 9:58:27 PM-&gt;Error on L3 node b0l3271 (partition 0) Wed Oct 19 21:58:27 2005 l3_node  
  in refoInt_reformatProc (l3_refevt.c:628) 
  
         L3_REFORMAT_ERROR (Parsed Info):  
         RAWREF Error - BNK-VRBWRD - with code 32 -- START 
         Error count: 7 of 7 
         Reject rate: 3.627 percent 
                   (see Error Handler log file for full message) 
(MLE) b0l3pcom2.fnal.gov:main:Oct 19, 2005 9:58:28 PM-&gt;Error on L3 node b0l3245 (partition 0) Wed Oct 19 21:58:27 2005 l3_node  
  in refoInt_reformatProc (l3_refevt.c:628) 
  
         L3_REFORMAT_ERROR (Parsed Info):  
         RAWREF Error - BNK-VRBWRD - with code 32 -- START 
         Error count: 8 of 8 
         Reject rate: 4.420 percent 
                   (see Error Handler log file for full message) 
(MLE) b0l3pcom2.fnal.gov:main:Oct 19, 2005 9:58:28 PM-&gt;Error on L3 node b0l3076 (partition 0) Wed Oct 19 21:58:28 2005 l3_node  
  in refoInt_reformatProc (l3_refevt.c:628) 
  
         L3_REFORMAT_ERROR (Parsed Info):  
         RAWREF Error - BNK-VRBWRD - with code 32 -- START 
         Error count: 6 of 6 
         Reject rate: 2.479 percent 
                   (see Error Handler log file for full message) 
(</pre>
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889' target=_top>205889</a>) -->


<!-- Date: Wed Oct 19 21:59:03.316 2005 -->
North top CMP is oscillating. Can't tell if it's the top of the north wall or the blue beam. The parts worked on yesterday are fixed.
<!-- Author: Phil Schlabach -->
<!-- Comment: Wed Oct 19 22;10;08 comment by...Phil -->
top of the north wall, stack 6 or 8 are implicated
<!-- Comment: Wed Oct 19 22;15;42 comment by...Phil -->
proponents emailed.
<!-- Date: Wed Oct 19 22:01:17.536 2005 -->
<pre>Messages from L3 Node Details windows (for b0l3050) 
 
ERROR at Wed Oct 19 22:00:04 2005 partition 0 
    in refoInt_reformatProc() [l3_refevt.c:628] 
    info: @L3_REFORMAT_ERROR 
 
RAWREF Error - BNK-VRBWRD - with code 32 -- START 
 Line -  334 in: src/library/rr_refevt.c 
 Buffer position: -1 
 Error count: 8 of 8 
 Reject rate: 2.899 percent 
 
 VRB word not consistent with the existing one. 
 Bank Name   Bank Type   Default     Faulty 
  0x44314354  0x00000003  0x00003c05  0x00000034 
 
 Error location code: 0x00060000 
 
 
 Crate Id?: 0x00000000 
 
 Error during reformatting! 
 Exact position not identifiable! 
 
 More diagnosis: 
 
 NOTE: Event rejected! 
 
RAWREF Error - BNK-VRBWRD - with code 32 -- FINISHED: L&lt;  550 
 
 
ERROR at Wed Oct 19 22:00:04 2005 partition 0 
    in refoInt_reformatProc() [l3_refevt.c:633] 
    info: Inconsistent data banks in event! Corrupt data? 
 
WARNING at Wed Oct 19 22:00:04 2005 partition 0 
    in l3_ana_reformat_analyze() [l3_ana_reformat.c:459] 
    info: Processor reformatter error:  event rejected 
</pre>
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889' target=_top>205889</a>) -->


<!-- Date: Wed Oct 19 22:04:33.977 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18818&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18818' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18819&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18819' width='300'></a></center>
<!-- Author: Peter Dong: shot setup plots -->


<!-- Date: Wed Oct 19 22:05:24.849 2005 -->
Conner Henderson says he is 10 minutes away and knows how do to the magical recompile.  He'd like to be able to get Markus on the phone to be certain that he knows which code versions to pick up.  
<!-- Author: Bill -->
<!-- Comment: Wed Oct 19 22;07;47 comment by...  -->
It's spelled <u>Conor</u> Henderson, sorry.

<!-- Comment: Wed Oct 19 22;11;12 comment by...Bill -->
Markus just called to say that he has spoken with Conor by phone and will be available to talk Conor through the procedure by phone, once Conor arrives.

<!-- Comment: Wed Oct 19 22;18;20 comment by...Bill -->
Conor is here; Markus is on the phone.
<!-- Date: Wed Oct 19 22:05:58.096 2005 -->
Looks as if something similar may have happened on July 22, day shift, and March 29, day shift.  
<!-- Author: Bill -->




<!-- Date: Wed Oct 19 22:10:47.543 2005 -->
Busy TO for b0l2pu01
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889' target=_top>205889</a>) -->



<!-- Date: Wed Oct 19 22:12:34.872 2005 -->
CMP trip.  
<!-- Author: Bill -->


<!-- Date: Wed Oct 19 22:13:00.851 2005 -->
Got SRC Ftality Error for b0svx02: Sl 6 Resonance Detected.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889' target=_top>205889</a>) -->


<!-- Date: Wed Oct 19 22:14:02.287 2005 -->
Got Trigger Inhibit from CMP Trip.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889' target=_top>205889</a>) -->



<!-- Date: Wed Oct 19 22:15:45.571 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-18820&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-18820  width='300' align='top'></a></td><td>  </td></tr></table>
<!-- Author: anna. -->
<!-- Comment: Wed Oct 19 22;26;34 comment by...Dale -->
CMP 2D occupancy plot for the experts: nearly 8 hit multiplicity for each of of the blue-beam channels that are oscilating.<br>
<a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18826&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18826' width='300'></a>
<!-- Comment: Wed Oct 19 22;31;26 comment by...Dale -->
See <a href=
'/cgi/elog/elog.pl?nb=2005&action=view&page=876&frame=2&anchor=21:59:03.316'>
Phil's entry above</a> - my money is on stacks 6 and 8 as well but 7 may be just as suspect.

<!-- Comment: Wed Oct 19 23;08;54 comment by...Xiaojian -->
Hi Dale, you have about 50% chance to win! Today's oscillation is exactly same as the one happened on Aug 28th, see <a href=
'/cgi/elog/elog.pl?nb=2005&action=view&page=722&frame=2&anchor=09:03:10.808'>
last oscillation in this region </a>. For the last oscillation, we diagonosed that stack 8 is the one that caused all oscillations and have tried to fix it by power-cycling the LV of stack 8. But it did not help. The problem went away by itself after an access (no fix to top CMP was done) when the south wall was moved, see <a href=
'http://www-cdfonline.fnal.gov/cgi/elog/elog.pl?nb=2005&action=view&page=734&frame=2&anchor=11:47:02.808'>
"last recovery of the top oscillation from 5-11" </a>. I wil try power-cycling tomorrow, but not sure how much it will help. 
<!-- Date: Wed Oct 19 22:15:46.679 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-18821&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-18821  width='300' align='top'></a></td><td>Silicon pinkie.  I unmarked it and will keep an eye on it.</td></tr></table>
<!-- Author: Peter Dong -->


<!-- Date: Wed Oct 19 22:16:31.758 2005 -->
CMP tripped on Bottom D4 sense voltage.  Ramped it up fine.
<!-- Author: Peter Dong :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889' target=_top>205889</a>) -->




<!-- Date: Wed Oct 19 22:19:00.609 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18822&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18822' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18823&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18823' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18824&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18824' width='300'></a></center>
<!-- Author: Peter Dong: hourly plots 2030-2130 -->
<!-- Comment: Wed Oct 19 22;20;54 comment by...Peter Dong -->
These are awfully late because we suddenly got awfully busy.
<!-- Date: Wed Oct 19 22:20:31.029 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-18825&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-18825  width='300' align='top'></a></td><td>Another pinkie in IB4W0L3 VBIAS1 line.  Doesn't go away.  Probably not important, but paged anyway.</td></tr></table>
<!-- Author: Peter Dong -->
<!-- Comment: Wed Oct 19 22;24;17 comment by...Peter Dong -->
Sebastian says not to worry.  If similar one shows up in a bias line (very stable, just recently went over the limit), then we should page anyway, but if it's at, say, 3:00 a.m., we can probably wait until morning.  Of course, when in doubt, page.
<!-- Date: Wed Oct 19 22:21:19.920 2005 -->
Busy TO for b0cot08 and b0cot09. HRR.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889' target=_top>205889</a>) -->
<!-- Comment: Wed Oct 19 22;23;10 comment by...Yuji -->
Busy TO for b0l2pu01. HRR


<!-- Date: Wed Oct 19 22:23:38.541 2005 -->
Collider flying wire scan.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889' target=_top>205889</a>) -->



<!-- Date: Wed Oct 19 22:25:23.058 2005 -->
CMP expert called back.  He looked at the graphs in the logbook.  He says CMP data are still good, despite the oscillating channels.  He will try power-cycling the low voltage at the first opportunity that arises tomorrow.
<!-- Author: Bill :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889' target=_top>205889</a>) -->

<!-- Date: Wed Oct 19 22:26:28.502 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889">205889</A>
 Terminated at 2005.10.19 22:25:23
<!-- Author: RunControl -->


<!-- Date: Wed Oct 19 22:26:29.994 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889">205889</A>
TERMINATE: Reformatter changed
<!-- Author: Yuji x2080 -->



<!-- Date: Wed Oct 19 22:29:33.788 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889">205889</A>
RUNSTATUS: High rate of reformatter errors (8%); many oscillating CMP stacks.  Both experts say OK anyway.
<!-- Author: cdfscico -->


<!-- Date: Wed Oct 19 22:29:34.388 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889">205889</A>
muons: <tt>YMon:Slides/SlideMuon --> Not dead,but noisy channels -- check picture that comes later.</tt>
<!-- Author: Consumer Operator(Anna Sfyrla) -->


<!-- Date: Wed Oct 19 22:29:35.803 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205890">205890</A>
 Activated at 2005.10.19 22:29:20
<!-- Author: RunControl -->


<!-- Date: Wed Oct 19 22:29:36.869 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889">205889</A>
trigger: <tt>XTRD-->error rate 2/880 in the first plot {(1,5), expept from (1,3)}, but too low statistics...<br>
<br>
Level 3 Trigger and Event Builder (l3) --> 8.2% &nbsp;-- TOO HIGH!!</tt>
<!-- Author: Consumer Operator(Anna Sfyrla) -->


<!-- Date: Wed Oct 19 22:29:37.387 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205890">205890</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_3_07 [2,725,597] 
<!-- Author: Yuji x2080 -->



<!-- Date: Wed Oct 19 22:31:13.488 2005 -->
TOF flashed yellow, briefly set trigger inhibit, went away right away.
<!-- Author: Peter Dong :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205890' target=_top>205890</a>) -->


<!-- Date: Wed Oct 19 22:31:16.831 2005 -->
Bummer, new run after recompile, and reformatter error rate still high.  
<!-- Author: Bill :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205890' target=_top>205890</a>) -->



<!-- Date: Wed Oct 19 22:32:28.000 2005 -->
Trigger Inhibit from TOF01 Trip, but it was quite transient. 
Run wasn't halted.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205890' target=_top>205890</a>) -->


<!-- Date: Wed Oct 19 22:33:30.366 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18827&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18827' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18828&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18828' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18829&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18829' width='300'></a></center>
<!-- Author: Peter Dong: hourly plots 2130-2230 -->


<!-- Date: Wed Oct 19 22:33:45.680 2005 -->
We still have high reformatter error rate (>5%)
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205890' target=_top>205890</a>) -->


<!-- Date: Wed Oct 19 22:34:52.038 2005 -->
Got Heap corrupt for b0pcal05. Shepherded it.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205890' target=_top>205890</a>) -->

<!-- Date: Wed Oct 19 22:40:27.374 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205890">205890</A>
 Terminated at 2005.10.19 22:40:18
<!-- Author: RunControl -->


<!-- Date: Wed Oct 19 22:41:04.585 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205890">205890</A>
TERMINATE: Change to new reformatter.
<!-- Author: Yuji x2080 -->


<!-- Date: Wed Oct 19 22:44:20.299 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205891">205891</A>
 Activated at 2005.10.19 22:43:32
<!-- Author: RunControl -->


<!-- Date: Wed Oct 19 22:44:21.403 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205891">205891</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_3_07 [2,725,597] 
<!-- Author: Yuji x2080 -->



<!-- Date: Wed Oct 19 22:45:44.109 2005 -->
Busy TO for b0svx06. Recovered by HRR.
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205891' target=_top>205891</a>) -->


<!-- Date: Wed Oct 19 22:48:50.569 2005 -->
Re-recompile is a success!  Initial recompile had been done on the wrong machine, so compiler output didn't go where L3 looks for it.  Now we have a happy reformatter.  Thanks, Conan!  I am told that Markus will appear at the 08:00 meeting tomorrow to be spanked.  
<!-- Author: Bill :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205891' target=_top>205891</a>) -->
<!-- Comment: Wed Oct 19 22;49;44 comment by...  -->
Oops, how barbaric.  I meant Conor.


<!-- Date: Wed Oct 19 22:49:53.426 2005 -->
Level 3 Reformatter errors have been fixed. The problem was not really in the data itself, but in a check which is applied to the data. We have reverted to the previous version of the reformatter code and recompiled the Level3 binaries.
<!-- Author: Conor Henderson -->


<!-- Date: Wed Oct 19 22:54:25.636 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205890">205890</A>
RUNSTATUS: Run too short to check adequately, but we can interpolate from the surrounding runs.  CMP oscillation, reformatter errors.  Experts both say OK.

<!-- Author: cdfscico -->



<!-- Date: Wed Oct 19 22:55:54.417 2005 -->
Got SRC Fatality error for b0svx02: Sl 6 Resonance Detected.  
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205891' target=_top>205891</a>) -->
<!-- Comment: Wed Oct 19 22;56;57 comment by...Yuji -->
<pre>(MLE) b0dap73.fnal.gov:Thread-26:Oct 19, 2005 10:54:47 PM-&gt;FrontEnd Error: VRB_SVX_02 
(MLE) b0svx05:Messenger:Oct 19, 2005 10:55:01 PM-&gt;Silicon Resonator: Sl 20 Ch 8 -&gt; e5b3: Bytes: 00110

(MLE) b0svx00:Messenger:Oct 19, 2005 10:55:01 PM-&gt;Silicon Resonator: Sl 16 Ch 7 -&gt; e072: Bytes: 00056

b0svx02:Messenger:Oct 19, 2005 10:55:02 PM-&gt;SRC Fatal Error:Sl 6 Resonance Detected </pre>


<!-- Comment: Wed Oct 19 23;10;07 comment by...Yuji -->
<pre>Again.

(MLE) b0dap73.fnal.gov:Thread-26:Oct 19, 2005 11:07:53 PM-&gt;FrontEnd Error: VRB_SVX_02 
(MLE) b0svx04:Messenger:Oct 19, 2005 11:08:05 PM-&gt;Silicon Resonator: Sl 20 Ch 4 -&gt; e4a4: Bytes: 00098

(MLE) b0svx02:Messenger:Oct 19, 2005 11:08:05 PM-&gt;Silicon Resonator: Sl 11 Ch 3 -&gt; e203: Bytes: 00154
e200

b0svx02:Messenger:Oct 19, 2005 11:08:06 PM-&gt;SRC Fatal Error:Sl 6 Resonance Detected 
</pre>

<!-- Comment: Wed Oct 19 23;30;32 comment by...Yuji -->
<pre>Again.


(MLE) b0dap73.fnal.gov:Thread-26:Oct 19, 2005 11:29:27 PM-&gt;FrontEnd Error: VRB_SVX_02 
(MLE) b0svx01:Messenger:Oct 19, 2005 11:29:40 PM-&gt;Silicon Resonator: Sl 10 Ch 9 -&gt; e134: Bytes: 00082

(MLE) b0svx03:Messenger:Oct 19, 2005 11:29:40 PM-&gt;Silicon Resonator: Sl 10 Ch 9 -&gt; e334: Bytes: 00070
e360 12:e340

(MLE) b0svx02:Messenger:Oct 19, 2005 11:29:40 PM-&gt;Silicon Resonator: Sl 13 Ch 9 -&gt; e254: Bytes: 00068
e200

b0svx02:Messenger:Oct 19, 2005 11:29:40 PM-&gt;SRC Fatal Error:Sl 6 Resonance Detected </pre>
<!-- Date: Wed Oct 19 23:20:33.307 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205891">205891</A>
muons: <tt>CMP-->High Occupancy (still...)</tt>
<!-- Author: Consumer Operator(Anna Sfyrla) -->



<!-- Date: Wed Oct 19 23:23:15.573 2005 -->
Flying wire scan
<!-- Author: Yuji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205891' target=_top>205891</a>) -->



<!-- Date: Wed Oct 19 23:30:49.991 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-18830&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-18830  width='300' align='top'></a></td><td>From last Recycler shot to Tevatron shot.</td></tr></table>
<!-- Author: Bill -->


<!-- Date: Wed Oct 19 23:32:58.946 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18831&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18831' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18832&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18832' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-18833&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-18833' width='300'></a></center>
<!-- Author: Peter Dong: hourly plots 2230-2330 -->
<!-- Comment: Wed Oct 19 23;34;25 comment by...Peter Dong -->
Just out of curiosity, why do the hourly plots contain the T:AGIGI2 variable twice (plots 2 and 3)?  Seems a bit redundant.  Seems a bit redundant.  Isn't there another variable of interest we could plot instead?

<!-- Comment: Wed Oct 19 23;49;51 comment by...Sebastian -->
yes, it is redundant.. but it will confuse us if suddendly it is no longer there... there is a long procedure to change something as vital as this plots, could take months, you know, ja.

<!-- Date: Wed Oct 19 23:55:26.627 2005 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>Physics able</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L1Accepts</TH>
<TH>L2Accepts</TH>
<TH>L3Accepts</TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205888 target=_blank>205888</A> x32440</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_3_07 [2,725,597]</FONT></TD>
<TD ALIGN=CENTER>21:28:13</TD>
<TD ALIGN=CENTER>21:31:17</TD>
<TD ALIGN=CENTER>00:01:52</TD>
<TD ALIGN=RIGHT>      2,060,329</TD>
<TD ALIGN=RIGHT>        22,616</TD>
<TD ALIGN=RIGHT>       6,146</TD>
<TD ALIGN=RIGHT>    9.392</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>0</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205889 target=_blank>205889</A> x32441</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_3_07 [2,725,597]</FONT></TD>
<TD ALIGN=CENTER>21:36:58</TD>
<TD ALIGN=CENTER>22:25:23</TD>
<TD ALIGN=CENTER>00:37:09</TD>
<TD ALIGN=RIGHT>     53,495,739</TD>
<TD ALIGN=RIGHT>       685,821</TD>
<TD ALIGN=RIGHT>     166,866</TD>
<TD ALIGN=RIGHT>  178.661</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205890 target=_blank>205890</A> x32442</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_3_07 [2,725,597]</FONT></TD>
<TD ALIGN=CENTER>22:29:20</TD>
<TD ALIGN=CENTER>22:40:18</TD>
<TD ALIGN=CENTER>00:08:47</TD>
<TD ALIGN=RIGHT>     11,176,098</TD>
<TD ALIGN=RIGHT>       100,552</TD>
<TD ALIGN=RIGHT>      28,128</TD>
<TD ALIGN=RIGHT>   37.839</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=205891 target=_blank>205891</A> x32443</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_3_07 [2,725,597]</FONT></TD>
<TD ALIGN=CENTER>22:43:32</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>01:06:05</TD>
<TD ALIGN=RIGHT>     97,656,053</TD>
<TD ALIGN=RIGHT>     1,139,019</TD>
<TD ALIGN=RIGHT>     319,434</TD>
<TD ALIGN=RIGHT>  258.527</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>23:55:01</TD>
<TD ALIGN=CENTER>01:53:53</TD>
<TD ALIGN=RIGHT>     164,388,219</TD>
<TD ALIGN=RIGHT>      1,948,008</TD>
<TD ALIGN=RIGHT>       520,574</TD>
<TD ALIGN=RIGHT>  484.419</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Wed Oct 19 23:57:51.012 2005 -->
<font color=red>Shift Summary: </font><pre>Shot 4460 started around 21:20, at 89E30, we're running.  Will write more below. 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   205889, 205890, 205891
Delivered Luminosity   643  
Acquired Luminosity    479  
Efficiency             74.5%
   
</td></tr></table></pre>
<!-- Author: Bill Ashmanskas -->


<!-- Date: Thu Oct 20 00:17:54.576 2005 -->
<pre>Evening shift began with Tev studies in progress, Recycler stash 51E10, Accumulator stack 56E10, stacking at 13E10/hr.   
 
Markus finished up EVB work around 17:00.  Frank had called in to remind us to test at high rate. 
 
Problem mounting /cdf/code-common appeared and was fixed by restarting SGI portmapper. 
 
Shot setup began fairly quickly after final round of transfers from Accumulator to Recycler (which ended at 19:00).  Antiproton load began at 20:37 and was complete at 21:07.  Loaded 94.0E10 out of starting stash of 110E10 antiprotons.  Scraping done at 21:23, initial luminosity 88.9E30 -- not bad!   
 
We were on the air quickly (running at 21:29), but we suffered until 22:48 with high (about 8%) reformatter event rejection rates.  Markus said reformatter software issue, data still good.  Conor Henderson saved our butts by coming in to recompile L3 code with an earlier version of reformatter software.   
 
Many new CMP stacks oscillating now; experts are on the case. 
 
Turned run 205891 over to owl shift. 
 
 
 
</pre> <font color=red><cite>(entry outside this shift's time range )</cite></font>
<!-- Author: Bill -->