<!-- Title: Eve shift. Tue Jan 18, 2005 -->
<!-- SciCo: Petar Maksimovic -->
<!-- DAQAce: Ilsung Cho -->
<!-- MonAce: Jonathan Efron -->
<!-- CO: Salvador Marti-Garcia -->
<!-- OpManager: Bob Wagner -->
<!-- Notes: -->
<pre>Store 3925, stack 163 in accumulator and 90 in recycler, 
lumi at 20e30.  
 
Plan to drop the store at 7, and then immediately go 
into another shot setup with (possibly) record luminosity. 
</pre>


<!-- Date: Tue Jan 18 16:12:34.572 2005 -->
<pre>I got sevaral L2 decesion time out error. HRR didn't help it. 
I rebotted alpha.</pre>
<!-- Author: Ilsung  :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192399' target=_top>192399</a>) -->


<!-- Date: Tue Jan 18 16:29:01.998 2005 -->
<pre>SVXMon not sending heart beat to ConsumerErrorReceiver (aka ConsumerMonitor) 
  since 2005-01-18 16:08:44.0 
ConsumerErrorReceiver forwards errors and HRR requests from SVXMon 
  and these processes are very important to data taking! 
Restart SVXMon immediately! 
 
 
</pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192399' target=_top>192399</a>) -->


<!-- Date: Tue Jan 18 16:31:28.035 2005 -->
<pre> Attention!!!. SCPU_BAD_VRB_BYTE_COUNT Error !!!  
 Hardware EVB has detected a problem with data in  
 SCPU b0eb22.  
 Datataking is paused: events are not being processed.  
  
 AUTO HRR will be issued. </pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192399' target=_top>192399</a>) -->


<!-- Date: Tue Jan 18 16:38:39.764 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-983&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-983' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-984&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-984' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-985&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-985' width='300'></a></center>
<!-- Author: Efron -->


<!-- Date: Tue Jan 18 16:53:28.188 2005 -->
<pre>I rebooted alpha due to L2 decision time out.</pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192399' target=_top>192399</a>) -->


<!-- Date: Tue Jan 18 16:56:08.356 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-986&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-986  width='300' align='top'></a></td><td>CO plots. L2 Pulsar errors -> Expert paged</td></tr></table>
<!-- Author: Salva -->
<!-- Comment: Tue Jan 18 17;06;57 comment by...salva -->
Expert phoned back and said it is a downstream problem. Problem known and some one working on it. Anyway the error rate is not so large (45 out of 7500 events)
<!-- Date: Tue Jan 18 16:59:44.767 2005 -->
<pre>reboot alpha due to L2 decision time out. 
</pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192399' target=_top>192399</a>) -->



<!-- Date: Tue Jan 18 17:16:44.006 2005 -->
<pre>I rebooted alpha several times when I got L2 decision time out. 
HRR didn't fix it. 
I'll keep an eye on it.</pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192399' target=_top>192399</a>) -->


<!-- Date: Tue Jan 18 17:29:26.169 2005 -->
<pre>L2 decisoin time out . rebotted alpha one more </pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192399' target=_top>192399</a>) -->


<!-- Date: Tue Jan 18 17:35:20.054 2005 -->
<pre>L2 Decision Timeout error came again. several times of HRR  fixed it. but this error appeared again a few secnods later. I rebotted alpha again. after that the following error came. 
 Done Timeout detected in crates: 
LEVEL2_DECISION_00. HRR fixed it. 
</pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192399' target=_top>192399</a>) -->


<!-- Date: Tue Jan 18 17:36:48.605 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-987&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-987' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-988&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-988' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-989&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-989' width='300'></a></center>
<!-- Author: Efron -->

<!-- Date: Tue Jan 18 17:49:45.737 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192399">192399</A>
 Terminated at 2005.01.18 17:49:25
<!-- Author: RunControl -->


<!-- Date: Tue Jan 18 17:50:55.941 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192399">192399</A>
TERMINATE: termibate due to so many red FE crates.
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 18:18:55.811 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192404">192404</A>
TERMINATE: terminate
<!-- Author: Ilsung (x2080) -->



<!-- Date: Tue Jan 18 18:33:20.541 2005 -->
<pre>*** Node b0musc00 in Error *** 
Last data more than 120s ago!  Node is not responsive 
 
after that, all FE crate went to be red. terminate run  
and page DAQ experts. expert suggested me to clean up the EVB.  
during clean up it, b0eb16 closed the rlogin connection.so, 
The EVB expert resetted b0eb16 and cleaned up EVB. 
but, All FE creates( except only  b0res00, b0res01 )are still red. The DAQ experts said it might be related with lan connection. she will make a phone call again after investigating.  
</pre>
<!-- Author: Ilisung -->

<!-- Date: Tue Jan 18 18:46:28.211 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192405">192405</A>
 Activated at 2005.01.18 18:46:21
<!-- Author: RunControl -->


<!-- Date: Tue Jan 18 18:46:30.753 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192405">192405</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_3_00 [2,570,510] 
<!-- Author: Ilsung (x2080) -->
<!-- Comment: Tue Jan 18 19;04;51 comment by...Tom Wright -->
Darn, a stupid bug snuck in there.  I will fix it and compile a new L2 tagset.  Other than the SVT Zin check it looks okay, though.

<!-- Date: Tue Jan 18 18:48:41.441 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192405">192405</A>
 Terminated at 2005.01.18 18:48:20
<!-- Author: RunControl -->



<!-- Date: Tue Jan 18 18:51:08.460 2005 -->
<TABLE bgcolor=#add8e6> 
<TR><TH>Date</th><th>Time</th><th colspan=3>Quantity</th></tr> 
<tr><td>2005.01.18</td><td>18:48:16</td><td>C:B0ILUM</td><td>18.66</td><td>E30</td></tr> 
<tr><td>2005.01.18</td><td>18:48:16</td><td>C:B0LLUM</td><td>0.00</td><td>E30</td></tr> 
<tr><td>2005.01.18</td><td>18:48:16</td><td>C:B0PLOS</td><td>1050.81</td><td>Hz</td></tr> 
<tr><td>2005.01.18</td><td>18:48:16</td><td>C:B0ALOS</td><td>230.95</td><td>Hz</td></tr> 
<tr><td>2005.01.18</td><td>18:49:26</td><td>TEVpr</td><td>6242.52</td><td>E09</td></tr> 
<tr><td>2005.01.18</td><td>18:49:26</td><td>TEVpb</td><td>716.58</td><td>E09</td></tr> 
</TABLE> 
<strong>Luminosity and losses</strong>
<!-- Author: jze -->


<!-- Date: Tue Jan 18 18:59:06.117 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-990&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-990  width='300' align='top'></a></td><td>missing et plot (phi vs eta)</td></tr></table>
<!-- Author: salva -->
<!-- Comment: Wed Jan 19 17;08;58 comment by...Willis -->
The prominent phi=0 feature in the jet Et for Met35 triggers
has been there since about 16Apr04 (from store 3402). This is
the phi=Pi spike in the Met distribution.

<!-- Comment: Wed Jan 19 18;23;31 comment by...Willis -->
After looking over more 2004 data in the ObjectMon phiMetCut35 plot, I find that the phi=Pi spike in the Met distribution is there in all runs I looked at, and that the spike is usuaully about 2 times higher than the rest of the bins in the plot. The corresponding plot from run 192424 is not that different.
<!-- Date: Tue Jan 18 19:12:01.598 2005 -->
<p>Tried to reduce voltage in 07E, 01R from 1361 V to 1255 V. 
Larry says he thinks the gain is high by 3X, and this is about 
the right voltage reduction.  Unfortunately, the DAQ was messed 
up and we got no events.  At Bob's request, I have now returned 
this CHA PMT's HV to 1361 V.  Will try again when luminosity  
comes down in next store.</p>
<!-- Author: Steve Hahn -->

<!-- Date: Tue Jan 18 19:45:59.734 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192409">192409</A>
ACTIVATE: RunSet: DAQTEST 
<!-- Author: BB x2080 -->


<!-- Date: Tue Jan 18 19:55:41.905 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192410">192410</A>
TERMINATE: cmx_00 error duing config transisiton
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 20:00:17.748 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192411">192411</A>
TERMINATE: terminate due to b0cmx00
<!-- Author: Ilsung (x2080) -->



<!-- Date: Tue Jan 18 20:02:24.346 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-991&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-991  width='300' align='top'></a></td><td>Roberto just called. He said they are going to change a board in the acquisition. When taking data resumes CO shifter must check as soon as posible the CLTD canvas. In case of troubles report to him immedately. I just save the most recent canvas for comparison (so this is ok and the next one must look like this) </td></tr></table>
<!-- Author: Salva -->

<!-- Date: Tue Jan 18 20:08:38.149 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192412">192412</A>
TERMINATE: terminate due to b0cmx00
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 20:10:18.108 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192413">192413</A>
TERMINATE: abort due to the same problem 
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 20:11:40.682 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192414">192414</A>
TERMINATE: abort due to b0cmx00
<!-- Author: Ilsung (x2080) -->



<!-- Date: Tue Jan 18 20:11:40.804 2005 -->
<pre>On Muon calibration, the b0cmx00 crate's Messenger  
task crashes during the config transition: 
 
b0cmx00-&gt; tt Messenger 
28249c vxTaskEntry    +60 : FER_messenger () 
d809f0 FER_messenger  +2cc: d56bc0 () 
d56bc0 FER_smartInitMS+24b8: 1f1d78 () 
1f1d78 TipcSrvMainLoop+510: TipcSrvMsgProcess (e28ae0) 
1f1848 TipcSrvMsgProcess+d8 : 1eeb20 (e57da8, e28ae0) 
1eee44 TipcSrvSubjectCbCreate+8c0: TutCbListCall (e278c8, e57da8, ec7a28) 
111370 TutCbListCall  +158: d5e6d4 () 
d5e794 FER_processReadoutListCallout+4fa4: d5aab8 () 
d5aab8 FER_processReadoutListCallout+12c8: FER_coldstart () 
d89f38 FER_coldstart  +a4 : d87728 () 
d87728 FER_init       +d08: MuonCal_init () 
d9efa8 MuonCal_init   +2e8: MuonCal_CalCard_deselect_all () 
da223c MuonCal_CalCard_deselect_all+5c : s16OutputChar () 
 
 
I tried several different versions of fer code:  v3_53,  
v3_51a, v3_49, but all had the same crash.   Requires  
further investigation. 
</pre>
<!-- Author: W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192414' target=_top>192414</a>) -->


<!-- Date: Tue Jan 18 20:12:32.756 2005 -->
<pre>Replaced the TDC board in slot 21 of b0clc00. 
The old board is #360.  The new board is #977. 
We want a newer Rev. F board in this crate so 
that we can implement it's fast-clear function 
to reduce crate readout time (in the near future). 
Ran the standard battery of tests and everything 
looks ok.  Please keep a close eye on the CLC  
data at the beginning of the next store. 
</pre>
<!-- Author: Eric James -->
<!-- Comment: Tue Jan 18 20;13;42 comment by...Eric -->
<pre>The old board was placed in an empty slot
in b0clc00 in case it's necessary to swap 
back to the original board.</pre>

<!-- Date: Tue Jan 18 20:19:34.415 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192415">192415</A>
ACTIVATE: RunSet: CALIB_QIE_FWD 
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 20:20:45.918 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192415">192415</A>
TERMINATE: done
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 20:22:33.256 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192416">192416</A>
ACTIVATE: RunSet: CALIB_RP_SMQIE 
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 20:24:43.963 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192416">192416</A>
TERMINATE: done
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 20:38:27.441 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192417">192417</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_TEST_HIGHLUM_3_00 [1,569,520] test trigger table
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 20:47:50.300 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192417">192417</A>
TERMINATE: end of test
<!-- Author: Ilsung (x2080) -->
<!-- Comment: Tue Jan 18 20;57;27 comment by...Veronica -->
<br>
this was a no beam test of a TEST high luminosity table, which is a copy of the current physics table except for the svt triggers which have been removed. 


<!-- Date: Tue Jan 18 21:20:52.035 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192418">192418</A>
ACTIVATE: RunSet: TOF_TAC_CALIB 
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 21:21:24.703 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192418">192418</A>
TERMINATE: error on CSL
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 21:23:14.904 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192419">192419</A>
ACTIVATE: RunSet: TOF_TAC_CALIB 
<!-- Author: Ilsung (x2080) -->



<!-- Date: Tue Jan 18 21:23:15.686 2005 -->
<pre>Had problems running crate b0cot08, b0ccal06, and  
b0ccal14 -- they gave errors when starting up the  
front-end code, failing on netClBlkGet() calls (unable  
to allocate a network cluster block).   There may have  
been indications (?) that the boot FlashRAMs were  
corrupted, but it's not clear;   anyhow, we have reloaded  
and older version of the kernel into FlashRAM and  
they are working again. 
</pre>
<!-- Author: W.Badgett, Eric James -->

<!-- Date: Tue Jan 18 21:31:42.690 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192419">192419</A>
TERMINATE: done
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 21:38:01.675 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192420">192420</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [16,561,513] 
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 21:39:12.214 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192420">192420</A>
TERMINATE: add svt crates
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 21:43:13.125 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192421">192421</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [16,561,513] 
<!-- Author: Ilsung (x2080) -->


<!-- Date: Tue Jan 18 21:49:27.623 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192421">192421</A>
TERMINATE: done 
<!-- Author: Ilsung (x2080) -->



<!-- Date: Tue Jan 18 21:49:27.289 2005 -->
We uploaded the new, latest and greatest firmware (ie Long Cluster removal) to all 12 SVT Track Fitters, and ran fakehits through the system. Output looks fine. The system will default to NO Long Cluster cuts (ie cuts OFF), so the SVT system should function as previously. 
 
We also updated the svtvme firmware to talk to the Track Fitters about the Long Cluster cuts. Again, the system operates OK in fakehits mode, and we expect no change.
<!-- Author: Jahred & Stefano T. -->
<!-- Comment: Tue Jan 18 23;35;54 comment by...Jahred -->
Despite all the current deadtime problems, SVT appears to be working OK with the new TF firmware.
<!-- Date: Tue Jan 18 21:58:10.316 2005 -->
At 21:40, six serious proton bunches were injected (~280), 
but the Tevatron aborted at the seventh. 
 
Now they are trying once again.
<!-- Author: Petar -->
<!-- Comment: Tue Jan 18 22;08;27 comment by...Petar -->
This time, they are doing much better, almost done with
all final protons.
<!-- Date: Tue Jan 18 22:00:04.805 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192422">192422</A>
ACTIVATE: RunSet: BOTHPLUGS_NORMAL  Trigger: COSMICS [14,503,442] 
<!-- Author: Ilsung (x2080) -->
<!-- Comment: Tue Jan 18 22;02;33 comment by...Ilsung -->
<pre>injecting final protons duing calibrations</pre>

<!-- Date: Tue Jan 18 22:06:45.539 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192422">192422</A>
TERMINATE: done
<!-- Author: Ilsung (x2080) -->




<!-- Date: Tue Jan 18 22:10:57.571 2005 -->
Final protons loaded.  Commencing the injections of antiprotons.
<!-- Author: Petar -->


<!-- Date: Tue Jan 18 22:11:33.082 2005 -->
<TABLE bgcolor=#cdc9a5> 
<TR><TH>Date</th><th>Time</th><th>BLM</th><th colspan=2>Dose</th></tr> 
<tr><td>2005.01.18</td><td>22:09:35</td><td>W Inner BLM</td><td>0.35</td><td>RADS</td></tr> 
<tr><td>2005.01.18</td><td>22:09:35</td><td>W Outer BLM</td><td>0.00</td><td>RADS</td></tr> 
<tr><td>2005.01.18</td><td>22:09:35</td><td>E Inner BLM</td><td>0.06</td><td>RADS</td></tr> 
<tr><td>2005.01.18</td><td>22:09:35</td><td>E Outer BLM</td><td>0.30</td><td>RADS</td></tr> 
</TABLE> 
<strong>Integrated dosage</strong>
<!-- Author: jze -->

<!-- Date: Tue Jan 18 22:13:55.185 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192423">192423</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_3_00 [2,566,510] 
<!-- Author: Ilsung (x2080) -->



<!-- Date: Tue Jan 18 22:23:28.875 2005 -->
Paged the Silicon pager carrier (Jen) and the SPL (Ryong).
<!-- Author: Petar -->


<!-- Date: Tue Jan 18 22:39:51.233 2005 -->
<pre>Store 3926: Final antiprotons have been loaded. 
 
Preparing to ramp.</pre>
<!-- Author: Petar -->

<!-- Date: Tue Jan 18 22:42:43.210 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192423">192423</A>
TERMINATE: flattop
<!-- Author: Ilsung (x2080) -->



<!-- Date: Tue Jan 18 22:58:50.458 2005 -->
Store 3926: scraping complete. 
CLC is up.  
<!-- Author: Petar -->
<!-- Comment: Tue Jan 18 23;00;23 comment by...Petar -->
Our luminosity is 115.


<!-- Date: Tue Jan 18 23:04:54.926 2005 -->
During Ramping up, CMX SE 16 and 17 HV tripped
<!-- Author: JZE -->

<!-- Date: Tue Jan 18 23:08:39.409 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424">192424</A>
 Activated at 2005.01.18 23:08:34
<!-- Author: RunControl -->


<!-- Date: Tue Jan 18 23:09:04.095 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424">192424</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_3_00 [2,566,510] 
<!-- Author: Ilsung (x2080) -->



<!-- Date: Tue Jan 18 23:10:45.284 2005 -->
<pre>I updated L2 trigger table as 566  in AAA_SHOTSETUP and AAA_CURRENT run configuration.</pre>
<!-- Author: Ilsung -->


<!-- Date: Tue Jan 18 23:11:49.851 2005 -->
CMP South Wall Wall A1  was marked yellow.  Temporarily cured its ills.  Problem reappears.
<!-- Author: JZE -->
<!-- Comment: Tue Jan 18 23;16;49 comment by...jze -->
Average current of that part of the detector is slightly high.  Number on top of bar graph, 35.0; on bottom, 35.5.
<!-- Comment: Tue Jan 18 23;32;05 comment by...jze -->
Problem went away around 11:25
<!-- Date: Tue Jan 18 23:11:52.305 2005 -->
<pre>Attention!!! L2 Decision Timeout ERROR !!. 
HRR fixed it. at now L2 dead time is very high. 
It's around 80%.  </pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->


<!-- Date: Tue Jan 18 23:11:56.341 2005 -->
The deadtime is 89%!!! 
 
All BUSY, but Level 3 is working hard, since L2A rate is 320Hz!  
<!-- Author: Petar -->


<!-- Date: Tue Jan 18 23:12:22.249 2005 -->
<pre> Attention!!!. FERML_HIGH_DEADTIME !!!  
 - Trigger/DAQ Deadtime is too high (at 84.63332 %).  
 - Look for source of hot triggers.  
 - Contact a trigger expert for further assistance. </pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->


<!-- Date: Tue Jan 18 23:13:51.697 2005 -->
<pre> Attention!!!. FERML_HIGH_DEADTIME !!!  
 - Trigger/DAQ Deadtime is too high (at 60.43789 %).  
 - Look for source of hot triggers.  
 - Contact a trigger expert for further assistance. </pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->



<!-- Date: Tue Jan 18 23:17:48.331 2005 -->
<pre>Attention!!!. FERML_HIGH_DEADTIME !!!  
 - Trigger/DAQ Deadtime is too high (at 61.05075 %).  
 - Look for source of hot triggers.  
 - Contact a trigger expert for further assistance.  
</pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->


<!-- Date: Tue Jan 18 23:20:29.527 2005 -->
<pre>Attention!!!. FERML_HIGH_DEADTIME !!!  
 - Trigger/DAQ Deadtime is too high (at 61.131313 %).  
 - Look for source of hot triggers.  
 - Contact a trigger expert for further assistance. </pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->



<!-- Date: Tue Jan 18 23:33:14.987 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-992&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-992' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-993&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-993' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-994&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-994' width='300'></a></center>
<!-- Author: Ilsung -->
<!-- Comment: Tue Jan 18 23;34;35 comment by...Ilsung -->
<pre>EVB Health plots. Total deadtime is around 60%</pre>



<!-- Date: Tue Jan 18 23:39:22.986 2005 -->
<pre> 
 Attention!!!. FERML_HIGH_DEADTIME !!!  
 - Trigger/DAQ Deadtime is too high (at 59.315323 %).  
 - Look for source of hot triggers.  
 - Contact a trigger expert for further assistance.  
 
There were several error messages about high dead time. 
but total dead time is going to be decreased gradually.</pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->


<!-- Date: Tue Jan 18 23:40:36.779 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-995&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-995' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-996&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-996' width='300'></a></center>
<!-- Author: efron -->
<!-- Comment: Tue Jan 18 23;41;16 comment by...efron -->
Loss/Abgaps and SVRAD Integration during the shot


<!-- Date: Tue Jan 18 23:43:09.928 2005 -->
The deadtime problem we've been seeing for the last few stores persists.  The L2A rate is now less than 240Hz while the deadtime remains around 61%.
<!-- Author: KPitts :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->


<!-- Date: Tue Jan 18 23:44:51.198 2005 -->
<pre>High dead time error occured continuously.</pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->


<!-- Date: Tue Jan 18 23:49:08.540 2005 -->
<pre>FrontEnd Crate Error Condition from:COT_12 
 
RXPT Error for crate/s: b0cot12    
 
HRR fixed it. 
</pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->

<!-- Date: Tue Jan 18 23:55:09.908 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192405">192405</A>
RUNSTATUS: <PRE>Marked Bad, explanation:
L00 is 1/3rd off
</PRE>
<!-- Author: cdfscico -->


<!-- Date: Tue Jan 18 23:55:27.714 2005 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192399>
192399</A> 
x2EF8F</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_3_00 [2,560,510]</TD>                                       
<TD ALIGN=CENTER>15:10:49</TD>                                          
<TD ALIGN=CENTER>17:49:25</TD>                                          
<TD ALIGN=CENTER>02:11:03</TD>                                          
<TD ALIGN=RIGHT>    104,584,560</TD>                                    
<TD ALIGN=RIGHT>     1,135,574</TD>                                     
<TD ALIGN=RIGHT>     332,839</TD>                                       
<TD ALIGN=RIGHT>  158.859</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192405>
192405</A> 
x2EF95</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_3_00 [2,570,510]</TD>                                       
<TD ALIGN=CENTER>18:46:21</TD>                                          
<TD ALIGN=CENTER>18:48:20</TD>                                          
<TD ALIGN=CENTER>00:00:00</TD>                                          
<TD ALIGN=RIGHT>          2,526</TD>                                    
<TD ALIGN=RIGHT>           313</TD>                                     
<TD ALIGN=RIGHT>         263</TD>                                       
<TD ALIGN=RIGHT>    0.010</TD>                                          
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>0</TD></TR>                                            
                                                                        
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424>
192424</A> 
x2EFA8</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_3_00 [2,566,510]</TD>                                       
<TD ALIGN=CENTER>23:08:34</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>00:16:58</TD>                                          
<TD ALIGN=RIGHT>     38,139,688</TD>                                    
<TD ALIGN=RIGHT>       664,304</TD>                                     
<TD ALIGN=RIGHT>     147,402</TD>                                       
<TD ALIGN=RIGHT>  108.513</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>23:55:05</TD>                                                       
<TD ALIGN=CENTER>02:28:02</TD>                                          
<TD ALIGN=RIGHT>     142,726,774</TD>                                   
<TD ALIGN=RIGHT>      1,800,191</TD>                                    
<TD ALIGN=RIGHT>       480,504</TD>                                     
<TD ALIGN=RIGHT>  267.383</TD>                                          
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Jan 18 23:55:53.275 2005 -->
<pre>The same RXPT error occured on COT 12. 
HRR fixed it. 
</pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->

<!-- Date: Tue Jan 18 23:58:16.469 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192370">192370</A>
RUNSTATUS: <PRE>Marked Bad, explanation:
L00 1/3rd off
</PRE>
<!-- Author: cdfscico -->



<!-- Date: Wed Jan 19 00:01:30.420 2005 -->
<pre>*** Node b0pcal10 in Error *** 
Last data more than 120s ago!  Node is not responsive 
 
Shepherding didn't work, I tried reboot and shepherding create.</pre>
<!-- Author: Ilsung :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->


<!-- Date: Wed Jan 19 00:09:55.641 2005 -->
<pre>Attention!!!. FERML_HIGH_DEADTIME !!!  
 - Trigger/DAQ Deadtime is too high (at 53.897102 %).  
 - Look for source of hot triggers.  
 - Contact a trigger expert for further assistance. </pre>
<!-- Author: ryo :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->


<!-- Date: Wed Jan 19 00:12:56.799 2005 -->
<pre>Attention!!!. FERML_HIGH_DEADTIME !!!  
 - Trigger/DAQ Deadtime is too high (at 53.09244 %).  
 - Look for source of hot triggers.  
 - Contact a trigger expert for further assistance.  
</pre>
<!-- Author: ryo :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192424' target=_top>192424</a>) -->


<!-- Date: Wed Jan 19 00:16:23.321 2005 -->
<font color=red>Shift Summary: </font><pre>Store 3925, ending, lumi at 20e30 at the beginning of the  
shift.  Smoothly colliding until ~ 18:30, when we wanted  
to terminate the run and try a couple of things.  However,  
all crates went to red, and stayed there until Bill Badgett  
and Eric James fixed them later.  (Crates b0cot08, b0ccal06,   
and b0ccal14.)  
  
Eric replaced a CLC TDC (slot 21 of b0clc00).  
  
Stre was dropped at 19:00.  The SVT folks are loading the  
new firmware to all 12 SVT Track Fitters and also the new   
library to the crates.  The new features include the Long   
Cluster removal,  however the default is to not use it, so  
the SVT should function exactly as before.  
  
Store 3926 comes in with B0 Lumi at 115.11 (scraping  
complete at 22:58).  Our initial dead time is 89%, at  
L2A = 320Hz.  Paged Jonathan, then Alberto (L3/EVB pager).  
However, the EVB monitoring plots show that the EVB is just  
waiting for data from b0cot12, 13 and, occasionally, from  
b0svx06 (ISL/L00).  Waiting for Jonathan to show up and  
take over the investigation.  
  
NB: our efficiency is so crappy since the luminosity is  
dominated by the new store, and the deadtime is > 60%.  
  
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   192399,192424
Delivered Luminosity    570.9  
Acquired Luminosity    223.0  
Efficiency             39.1
   
</td></tr></table></pre>
<!-- Author: Petar -->


<!-- Date: Wed Jan 19 14:29:53.986 2005 -->
<h3>Rough Data volume study</h3> 
 
<center> 
<a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-993&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-993' width='300'></a> 
<a href=/cgi/elog/elog.pl?nb=2004&action=view&page=-9022&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2004&action=view&page=-9022 width='300' align='top'></a> 
<a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-5860&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-5860 width='300' align='top'></a> 
</center> 
Data size in each SCPU crate today at about 100E30 (left) and 7 months ago at 50E30 (middle) before rebalancing and right now at 35E30. 
If I bin in major subsytem, and approximate sizes, I get 
<TABLE Border=
<!-- Author: SCN, Marcel -->
<!-- Comment: Wed Jan 19 14;32;20 comment by...SCN, Marcel -->
<TABLE Border="1">
<TR> <TH> System <th> SCPU <th> Data Size @50E30 6/18/04 <th> Data size @100E30 1/18/05 <th>  Data Size @35E30 1/19/05 </tr>
<tr> <td> DAQ  <td> 11-16 <td> 158 kB  <td> 196 kB <td> 135 kB</tr>
<tr> <td> SVXII   <td> 17-22 <td> 48 kB <td> 60 kB <td> 42 kB</tr>
<tr> <td> ISL/L00 <td> 23-25 <td>  65 kB<td> 62 kB <td> 55 kB </tr>
</tr>
</table>
Not very conclusive...data size is bigger at higher lumi (surprise!).  No red flags, but not sure how max L2A rate varies with SCPU sizes.