<!-- Title: Eve shift. Wed Oct 18, 2006 -->
<!-- SciCo: Greg Feild -->
<!-- DAQAce: Luca Introzzi -->
<!-- MonAce: Silvia Amerio -->
<!-- CO: Kevin Lannon -->
<!-- OpManager: Koji Sato -->
<!-- Notes: -->
<pre> 
We inherit a host of problems: 
 
L2 not working after the re-cabling. 
 
L3 manager disk quota problems. 
 
Continual debugging of the new CSL.</pre>

<!-- Date: Wed Oct 18 16:44:42.567 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225434>225434</A>
 Activated at 2006.10.18 16:44:38
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 16:45:06.769 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225434>225434</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,730,639] 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 16:48:25.291 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225434>225434</A>
 Terminated at 2006.10.18 16:46:41
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 16:48:26.287 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225434>225434</A>
TERMINATE: To take L2_torture
<!-- Author: DAQ Aces x2080 -->
<!-- Comment: Wed Oct 18 17;02;50 comment by...greg -->
<pre>L2 torture is not working after the recent
L3 Manager meltdown.  There is currently no
L3 Calib. tagset for L2Torture.  Frank C.
suggested Dave W. (Owl SciCo) might be able 
to fix it.

</pre>
<!-- Comment: Wed Oct 18 17;48;50 comment by...Chlebana -->
<pre>The problem is that it is selecting a corrupted version of
the calib tag set and we do not know how to force it to generate
a new calibration tag set.

</pre>
<!-- Date: Wed Oct 18 16:50:52.784 2006 -->
<p>Work done on CEM xenon flashers today over the course of the day, both upstairs 
and downstairs (thanks to my buddy TIll Hoffman from the day shift):</p> 
 
<ul> 
<li>02E - the current rises slowly but steadily in this wedge.  I've raised the current 
limit from 500 mA to 700 mA so it's less likely it trips if the ace takes a long time to do the CEMXEF run.</li> 
<li>10E - HV trips at about 1000 V.  Verified that problem follows xenon box and cabling on this wedge; not a CAEN problem.  Checked connections.  Tomorrow will check fuses and perhaps remove xenon box.</li> 
<li>13E - HV trips at about 500 V; this just started today after swapping 10E and 11E for test.  Raised trip timeout from 0 ms to 10 ms.  Now working OK.</li> 
<li>20E - no xenon signal.  Checked connections several times and fuses on transition card in b0ccal14; no problems found.  Problem probably in xenon box.   
Glad north wall is closed.</li> 
<li>22E - overvoltage condition (100-200 V when it should be 0) after HV ramps down; again just started today.  Found HV feedthru on xenon box was loose; could result in internal connection problems.  Alleviated condition, but when access is avaiable for north central should remove box and check and tighten connections.</li> 
</ul> 
<p>Odd that all the problems are on the east side, but probably just coincidence.</p>
<!-- Author: Steve Hahn :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225218' target=_top>225218</a>) -->

<!-- Date: Wed Oct 18 16:59:14.522 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225435>225435</A>
TERMINATE: Not the right type of trigger for CSL test.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 17:02:49.260 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225440>225440</A>
 Activated at 2006.10.18 17:02:16
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 17:02:50.219 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225440>225440</A>
ACTIVATE: RunSet: ACE_COSMIC_NOTRACKS  Trigger: COSMICS_NOTRACKS [9,731,639] 
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 17:09:09.665 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225440>225440</A>
 Terminated at 2006.10.18 17:08:26
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 17:09:10.686 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225440>225440</A>
TERMINATE: Test on CSL done.
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 17:13:23.187 2006 -->
Sarah and Xiaojian made an CMP access to fix problem in NW stack 32. The stack was very likely to start an oscillation whenever the north wall is moved. We replaced the preamp card for it(very hard!). We expect the new card should fix the problem. We checked the signal at TDC input, the replacement is successful. Ace please run a cosmic run whenever possible, we will check YMon plots.
<!-- Author: Xiaojian :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225440' target=_top>225440</a>) -->
<!-- Comment: Wed Oct 18 22;26;13 comment by...greg -->
<pre>Several nice cosmic runs this evening.
</pre>
<!-- Date: Wed Oct 18 17:17:41.716 2006 -->
ProcMon error.  RTSERVER: Found 237 rtserver connections (near >235 will degrade performance). Not to worry, possibly due to the high number of tests ongoing using Run Control.
<!-- Author: gianluca -->

<!-- Date: Wed Oct 18 17:24:54.116 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225445>225445</A>
ACTIVATE: RunSet: CALIB_CLC_QIE 
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 17:25:25.670 2006 -->
<pre>While ramping up Plug HV for calibrations, we got an alarm from PEM: HV bars were red. By the time I went upstairs to check on the PC, the alarm was cleared and all HV were fine.</pre>
<!-- Author: Silvia -->

<!-- Date: Wed Oct 18 17:26:10.251 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225445>225445</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 17:26:12.910 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225445>225445</A>
CALIBRATION: <U><B>clcqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#clcqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 17;35;00 comment by...K.Lannon -->
Looks OK.
<!-- Date: Wed Oct 18 17:30:17.888 2006 -->
<br><b>Halo Counters:</b> 
<br>Re-installed halo counter in the accelerator.  While there, 
the alcove region of the tunnel has about 1" of standing water 
and poly beads.  Since the connectors were soaking in the water, 
I will wait until tomorrow before biasing the PMTs.   
<br><br> 
<i>Observations: </i> One mouse in the tunnel (we expect the  
Tevatron mouse trap to be activated on Sunday).  Interlocks  
droppedin the A4-B1 sections. 
<br>
<!-- Author: Zeynep Gunay, R.J. Tesarek :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225445' target=_top>225445</a>) -->

<!-- Date: Wed Oct 18 17:31:59.554 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225446>225446</A>
ACTIVATE: RunSet: CALIB_QIE_FWD 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 17:32:23.479 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225446>225446</A>
CALIBRATION: <U><B>bscqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#bscqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 17;36;00 comment by...K.Lannon -->
Looks OK.
<!-- Date: Wed Oct 18 17:32:48.087 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225446>225446</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->





<!-- Date: Wed Oct 18 18:08:52.668 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225450>225450</A>
 Activated at 2006.10.18 18:08:13
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 18:08:53.239 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225450>225450</A>
ACTIVATE: RunSet: ACE_COSMIC_NOTRACKS  Trigger: COSMICS_NOTRACKS [9,731,639] 
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 18:10:45.284 2006 -->
<pre>Done TO. for crate/s:  
    b0imu00    
HRR done</pre>
<!-- Author: Silvia :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225450' target=_top>225450</a>) -->


<!-- Date: Wed Oct 18 18:17:58.590 2006 -->
<pre>another done timeout for crate IMU00. HRR done but it didn't fix the problem. We halted the run and sheperhded the crate. Now ok. </pre>
<!-- Author: Silvia :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225450' target=_top>225450</a>) -->
<!-- Comment: Wed Oct 18 18;27;11 comment by...greg -->
<pre>(MLE) b0imu00:Messenger:Oct 18, 2006 06:23:36 PM-&gt;TDC SRAM Invalid Header evt 1208559 slot 15: exp/fnd mod 8/8 l2b 0/3 0x040C027A
(MLE) b0imu00:Messenger:Oct 18, 2006 06:23:36 PM-&gt;Event 1208559: Bunchcounters in slot 11 (BC=36) and slot 15 (BC=122) disagree (L2B=0) </pre>
<!-- Date: Wed Oct 18 18:24:33.621 2006 -->
<pre>Done TO. for crate/s:  
    b0imu00    
HRR done.</pre>
<!-- Author: Silvia :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225450' target=_top>225450</a>) -->


<!-- Date: Wed Oct 18 18:27:05.467 2006 -->
Got HVAC alarm for collision hall fan, asked Steve at cryo to turn it back on (I had forgotten to ask him earlier). 
The alarm was low PF1 flow rate, and went away after fan came back on.
<!-- Author: Koji with Greg -->



<!-- Date: Wed Oct 18 18:32:15.924 2006 -->
Done Timeout detected in crates: IMU_00.  Auto HRR fixed it.
<!-- Author: gianluca :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225450' target=_top>225450</a>) -->

<!-- Date: Wed Oct 18 18:33:09.653 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225450>225450</A>
 Terminated at 2006.10.18 18:32:37
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 18:33:29.550 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225450>225450</A>
TERMINATE: To switch to L2 torture.
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 18:58:35.442 2006 -->
<pre>RTserver problem: Found 1 potentially stuck ports  
 
Proto Recv-Q Send-Q Local Address                     
tcp        0    240 b0server05.fnal.gov:5101  
 
Foreign Address             State       Address    Inode 
b0l2pu00.fnal.gov:1026      ESTABLISHED cdfdaq     236224503   
 
Experts are working on L2. Problem possibly do that.</pre>
<!-- Author: gianluca -->


<!-- Date: Wed Oct 18 19:00:49.863 2006 -->
<pre>PSM alarm for TOF_W. The following channels were red: 
Channel 0 -&gt; 9.63 (+9.5V) 
Channel 1 -&gt; 6.65  (+7.5A) 
but they turned green after 20 seconds.</pre>
<!-- Author: Silvia -->
<!-- Comment: Wed Oct 18 19;06;51 comment by...silvia -->
<pre>Now Channel 1 shows the value 6.72A. </pre>
<!-- Date: Wed Oct 18 19:02:39.921 2006 -->
Vadim called me over to the control room for something completely unrelated and we found SVT problems. In running fakehits, I can run fine without daq buffers (SVT readout) enabled, but the minute we turn on readout we get DTOs from b0svt02, b0svt03 and b0svt05. 
 
The crate is spitting out these type of messages: 
 
 
PULSAR_readOutFormat_stdd(): TRIG_alignedBuff too small, req 121931592 words, max 4096 words 
 
TRACER_enableDone: Front End Fatal Error (-1): Tracer done not set 
 
Internal buffer too small 
 
We had this problem Monday night and Tuesday and it turned out that Bill was playing with the readout code. I had not seen that error before (buffer too small) until this week, so perhaps someone is playing again with the code? Hopefully Bill can comment?
<!-- Author: jahred -->
<!-- Comment: Wed Oct 18 19;03;23 comment by...jahred -->
<pre>Here is the error, hopefully more readable:

PULSAR_readOutFormat_stdd(): TRIG_alignedBuff too small, req 121931592 words, max 4096 words

TRACER_enableDone: Front End Fatal Error (-1): Tracer done not set

Internal buffer too small</pre>


<!-- Date: Wed Oct 18 19:11:48.889 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225467>225467</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 19:15:22.955 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225467>225467</A>
TERMINATE: L3 was not included.  
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 19:23:27.628 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225468>225468</A>
TERMINATE: Problems with EVB. Turning to Cosmic to see it this work.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 19:32:47.875 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225469>225469</A>
 Activated at 2006.10.18 19:29:19
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 19:32:48.845 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225469>225469</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,730,639] 
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 19:54:14.237 2006 -->
L2 Decision Timeout ERROR.
<!-- Author: gianluca :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225469' target=_top>225469</a>) -->


<!-- Date: Wed Oct 18 19:54:23.217 2006 -->
<center><a href='/elog/notebooks/2006/Wed_Oct_18_2006_Eve.195331.ps'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-12978' ></a><a href='/elog/notebooks/2006/Wed_Oct_18_2006_Eve.195403.ps'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-12980' ></a></center>
<!-- Author: K.Lannon -->
<!-- Comment: Wed Oct 18 20;01;18 comment by...K.Lannon -->
<p>We're not really sure what to expect from the stereo system under these run conditions, but a couple stereo finders seem to be acting up a little.  Run conditions are:
<ul>
<li> Cosmic run with COT crates, XFT crates (and some others).
<li> COT HV is off, but muon and calorimeter are on.
</ul>
<p>Just to be on the safe side, we'll send e-mail to the stereo finder expert (Nils) to verify that this behavior doesn't concern him.


<!-- Comment: Wed Oct 18 23;17;56 comment by...Nils -->
Unfortunately that behavior is reason for grave concern.  On the bright side I believe they will be fixed as soon as I swap in some other boards.
<!-- Comment: Wed Oct 18 23;36;40 comment by...greg feild -->
<pre>
See what sort of useful information we can 
gather even from the most rag-tag of runs!
</pre>
<!-- Date: Wed Oct 18 20:01:59.388 2006 -->
<center><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-12981&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-12981' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-12982&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-12982' width='300'></a></center>
<!-- Author: greg feild -->
<!-- Comment: Wed Oct 18 20;03;37 comment by...greg -->
<pre>There seem to be some clustering issues 
following the L2 recabling effort.</pre>
<!-- Date: Wed Oct 18 20:03:08.471 2006 -->
L2 Decision Timeout ERROR. Again
<!-- Author: gianluca :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225469' target=_top>225469</a>) -->



<!-- Date: Wed Oct 18 20:05:10.575 2006 -->
<pre>Another PSM alarm for TOF_W. Three channels are red: 
Channel 0 -&gt; 9.72 (+9.5V) 
Channel 1 -&gt; 4.69 (+7.5A) 
Channel 3 -&gt; 6.20 (+7.5A) 
This time the alarm persists.  
</pre>
<!-- Author: Silvia :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225469' target=_top>225469</a>) -->
<!-- Comment: Wed Oct 18 20;16;29 comment by...Silvia -->
<pre>We turned TOF off.</pre>


<!-- Date: Wed Oct 18 20:17:46.990 2006 -->
CMX trip in NW Wedge 21.
<!-- Author: Silvia :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225469' target=_top>225469</a>) -->


<!-- Date: Wed Oct 18 20:19:07.385 2006 -->
L2 Decision Timeout ERROR. Third time. 
I wanted to page L2, but Scico decided to wait until tomorrow.
<!-- Author: gianluca :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225469' target=_top>225469</a>) -->

<!-- Date: Wed Oct 18 20:24:35.831 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225469>225469</A>
 Terminated at 2006.10.18 20:24:16
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 20:24:58.015 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225469>225469</A>
TERMINATE: To turn to L2 torture.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 20:28:28.715 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225470>225470</A>
TERMINATE: problem with L3
<!-- Author: DAQ Aces x2080 -->
<!-- Comment: Wed Oct 18 20;37;28 comment by...greg -->
<pre>No more L2 torture until the L3M problem is fixed!

</pre>
<!-- Date: Wed Oct 18 20:36:01.187 2006 -->
<h3>No Silicon for the overnight COSMICS run</h3> 
 
<p>Today the Silicon crew were working on the new Silicon VRB crate SBX09.  So current the Silicon DAQ is in a <em>funny</em> state.  So it would be prudent not to include Silicon in any runs as it is likely odd/strange errors may appear.</p>
<!-- Author: Ankush for the Silicon crew -->

<!-- Date: Wed Oct 18 20:36:57.921 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225471>225471</A>
TERMINATE: Could not go through Config: 
Error on L3 node b0eproxy02.fnal.gov (partition 0) Wed Oct 18 20:34:59 2006 l3proxy 
  in Config (L3ProxyPartition.cc:1493)L3_PACKAGE_FAIL - Failed to download package on a gateway. Checksum or size is incorrect
<!-- Author: DAQ Aces x2080 -->
<!-- Comment: Wed Oct 18 23;15;22 comment by...Conor -->
THis was due to the corrupt calib tag 16703
<!-- Date: Wed Oct 18 20:42:54.315 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225472>225472</A>
 Activated at 2006.10.18 20:42:36
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 20:42:55.842 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225472>225472</A>
ACTIVATE: RunSet: ACE_COSMIC_NOTRACKS  Trigger: COSMICS_NOTRACKS [9,731,639] 
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 20:43:19.065 2006 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2006&action=view&page=-12983&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2006&action=view&page=-12984  width='300' align='top'></a></td><td>Condition seen at the beginning of a L2 torture run.</td></tr></table>
<!-- Author: gianluca -->
<!-- Comment: Wed Oct 18 20;45;47 comment by...gianluca -->
Situation seen during transition. EVB and L3 did not pass CONFIG.

<!-- Comment: Wed Oct 18 20;52;42 comment by...Silvia -->
This is a know problem see 
 <a href= '/cgi/internal/elog/elog.pl?nb=2006&action=view&page=778&anchor=14:51:19.045'> this and the following entries </a>

<!-- Comment: Wed Oct 18 20;52;57 comment by...Geumbong -->
<pre>It was not the case of usual csl problem. This is known as "Fail to download l3... ". </pre>

<!-- Date: Wed Oct 18 20:59:35.577 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225472>225472</A>
 Terminated at 2006.10.18 20:59:21
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 20:59:57.531 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225472>225472</A>
TERMINATE: To do calibrations.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 21:03:47.425 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225473>225473</A>
ACTIVATE: RunSet: ACE_QIE 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 21:03:48.806 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225473>225473</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 21:03:49.768 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225473>225473</A>
CALIBRATION: <U><B>calqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#calqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 21;17;03 comment by...K.Lannon -->
No dead channels.  I'm asking the experts to double-check that the level of noisy channels is acceptable.
<!-- Date: Wed Oct 18 21:05:58.860 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225474>225474</A>
ACTIVATE: RunSet: CALIB_CLC_QIE 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 21:05:59.849 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225474>225474</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 21:06:00.984 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225474>225474</A>
CALIBRATION: <U><B>clcqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#clcqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->



<!-- Date: Wed Oct 18 21:12:32.771 2006 -->
<pre>&lt;b&gt; Dear Shift Crews,  
&lt;font color="FF3399"&gt;  
1. When taking cosmic, please check this before partitioning : 
 
 rc &gt; Parameters &gt; Edit/View &gt; CSL &gt; Lookarea-Nofiles, TapeOption-Nofiles.  
 
This will prevent older lookarea files disappearing. We are looking at the problems. &lt;/font&gt; 
&lt;font color="#003366"&gt; 
2. Please torture csl by changing run configuration as much as you can. CSL was upgraded in this afternoon. So I want to see if the csl crashing persists. &lt;/font&gt; &lt;b&gt;</pre>
<!-- Author: Geumbong -->
<!-- Comment: Wed Oct 18 21;14;01 comment by...gb -->
<pre>I wish I could make it colorful though. :-(</pre>
<!-- Comment: Thu Oct 19 07;20;33 comment by...Mautz -->
<b> Dear Shift Crews,  
<font color="FF3399"> 
<ol> 
<li> When taking cosmic, please check this before partitioning :  
 rc -> Parameters -> Edit/View -> CSL ->  Lookarea-Nofiles, TapeOption-Nofiles.  
 
This will prevent older lookarea files disappearing. We are looking at the problems. </font> 
<font color="#003366"> 
<li> Please torture csl by changing run configuration as much as you can. CSL was upgraded in this afternoon. So I want to see if the csl crashing persists. </font> </b>


<!-- Comment: Thu Oct 19 07;20;56 comment by...Mautz -->
</ol>
<!-- Date: Wed Oct 18 21:14:01.850 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225475>225475</A>
ACTIVATE: RunSet: CALIB_CLC_QIE 
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 21:15:43.124 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225475>225475</A>
CALIBRATION: <U><B>clcqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#clcqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 21;19;23 comment by...K.Lannon -->
Looks OK.
<!-- Date: Wed Oct 18 21:16:35.776 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225475>225475</A>
TERMINATE: Done. This calibration was taken again because b0clc00 was not working before.
<!-- Author: DAQ Aces x2080 -->




<!-- Date: Wed Oct 18 21:20:43.280 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225476>225476</A>
ACTIVATE: RunSet: CALIB_QIE_FWD 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 21:21:29.047 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225476>225476</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 21:21:30.521 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225476>225476</A>
CALIBRATION: <U><B>bscqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#bscqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 21;29;31 comment by...K.Lannon -->
Looks OK.
<!-- Date: Wed Oct 18 21:26:17.219 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225477>225477</A>
ACTIVATE: RunSet: BOTHPLUGS_NORMAL 
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 21:33:43.675 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225477>225477</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 21:39:57.455 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225478>225478</A>
ACTIVATE: RunSet: BOTHPLUGS_MM_C 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 21:39:58.308 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225478>225478</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 21:39:59.537 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225478>225478</A>
CALIBRATION: <U><B>pluglaser</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#pluglaser target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 21;42;19 comment by...K.Lannon -->
Looks OK.
<!-- Date: Wed Oct 18 21:40:00.440 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225479>225479</A>
ACTIVATE: RunSet: BOTHPLUGS_MM 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 21:41:36.866 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225479>225479</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->




<!-- Date: Wed Oct 18 21:48:03.086 2006 -->
<table border=0><td><tr><td bgcolor=#e0e030><pre> 
I've updated all the (useful looking) run configurations 
that rely on Level 2 to use the following Pulsar crates: 
 
LEVEL2_PULSAR_01 
LEVEL2_PULSAR_02 
TEST_L2PULSAR_TED 
</pre></td></tr></td></table>
<!-- Author: greg feild -->
<!-- Comment: Wed Oct 18 21;49;28 comment by...greg -->
<pre>Some of the run configurations are very old
and use the Alpha L2.  I did not update these.
Perhas they should be retired ....?</pre>

<!-- Date: Wed Oct 18 21:57:21.986 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225480>225480</A>
TERMINATE: L3 failed Config.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 22:05:17.514 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225481>225481</A>
TERMINATE: L3 failed Config again. I will try to clean-up.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 22:09:06.693 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225482>225482</A>
TERMINATE: Problem persists. b0eproxy02.fnal.gov:main:Oct 18, 2006 10:06:33 PM->Error on L3 node 
b0eproxy02.fnal.gov (partition 0) Wed Oct 18 22:06:33 2006 l3proxy in Config 
(L3ProxyPartition.cc:1493)
@L3_PACKAGE_FAIL - Failed to download package on a gateway. Checksum or size is incorrect

<!-- Author: DAQ Aces x2080 -->
<!-- Comment: Wed Oct 18 23;01;41 comment by...Conor -->
The calib tag 16703 that Level3 is asked to load is corrupt. This happened earlier this afternoon when the Level3Manager had problems. Hopefully when Dave Waters comes in on owl shift he can sort out this one problematic calib file.
<!-- Date: Wed Oct 18 22:13:53.121 2006 -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>Looks like all files are being sent to the look area... 
 
This is not what we want. 
 
When starting a run please select "no files to look area" 
to see if that stops writing to the look area... 
 
 
</pre></td></tr></td></table>
<!-- Author: Chlebana -->
<!-- Comment: Wed Oct 18 22;38;33 comment by...Chlebana -->
<pre>This only applies for non-calibration runs such as cosmics and l2torture.
</pre>
<!-- Date: Wed Oct 18 22:17:49.978 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225483>225483</A>
ACTIVATE: RunSet: ACE_TOF_QIE_NEW 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 22:20:44.110 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225483>225483</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 22:20:45.812 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225483>225483</A>
CALIBRATION: <U><B>tofqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#tofqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 22;30;31 comment by...K.Lannon -->
Looks OK.
<!-- Date: Wed Oct 18 22:22:35.784 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225484>225484</A>
ACTIVATE: RunSet: SMQIECALIB 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 22:23:17.578 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225484>225484</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 22:25:19.147 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225485>225485</A>
ACTIVATE: RunSet: ACE_LED_ALL 
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 22:26:35.546 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225485>225485</A>
TERMINATE: Done
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 22:27:43.782 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225485>225485</A>
CALIBRATION: <U><B>cemled</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cemled target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 22;31;31 comment by...K.Lannon -->
Looks OK
<!-- Date: Wed Oct 18 22:28:20.971 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225486>225486</A>
ACTIVATE: RunSet: COTCALIB_ACE 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 22:29:25.743 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225486>225486</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 22:31:20.307 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225486>225486</A>
CALIBRATION: <U><B>cot</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cot target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 22;35;13 comment by...K.Lannon -->
<pre>Too many bad channels in calibration.
Please send email to Eiko Yu (eikoyu@fnal.gov) 

Sending mail . . . .</pre>
<!-- Comment: Wed Oct 18 23;17;31 comment by...Eiko -->
<pre>  my guess is that (as usual) the bnc cable connection on the 
tracer or fanout module is flaky, therefore the calibration pulse 
is missing from time to time. We either need to replace the 
module or resolder the connector. I will find another person to 
go down to the pit with me tomorrow. 

We will need to access the TDC crate b0cot06 at the bottom south west 
side.
</pre>
<!-- Date: Wed Oct 18 22:33:41.712 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225487>225487</A>
ACTIVATE: RunSet: XEF_ALL 
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 22:35:13.905 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225487>225487</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 22:35:53.703 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225487>225487</A>
CALIBRATION: <U><B>calxef</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#calxef target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 22;43;22 comment by...K.Lannon -->
Looks OK.
<!-- Date: Wed Oct 18 22:38:05.582 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225484>225484</A>
CALIBRATION: <U><B>smx</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#smx target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 22;45;57 comment by...K.Lannon -->
Looks OK.
<!-- Date: Wed Oct 18 22:38:33.805 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225488>225488</A>
ACTIVATE: RunSet: CALIB_MUON_ALL1 
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 22:38:53.993 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225488>225488</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 22:41:51.520 2006 -->
HB alarm. ICICLE restarted.
<!-- Author: Silvia -->

<!-- Date: Wed Oct 18 22:42:30.338 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225489>225489</A>
ACTIVATE: RunSet: TOF_TAC_CALIB 
<!-- Author: DAQ Aces x2080 -->




<!-- Date: Wed Oct 18 22:47:20.737 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225489>225489</A>
TERMINATE: Done.
<!-- Author: DAQ Aces x2080 -->


<!-- Date: Wed Oct 18 22:48:07.312 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225489>225489</A>
CALIBRATION: <U><B>toftac</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#toftac target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Wed Oct 18 22;55;46 comment by...K.Lannon -->
Looks OK.
<!-- Date: Wed Oct 18 22:53:24.501 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225490>225490</A>
 Activated at 2006.10.18 22:53:13
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 22:53:25.168 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225490>225490</A>
ACTIVATE: RunSet: ACE_COSMIC_NOTRACKS  Trigger: COSMICS_NOTRACKS [9,731,639] 
<!-- Author: DAQ Aces x2080 -->




<!-- Date: Wed Oct 18 22:58:22.156 2006 -->
L2 Decision Timeout ERROR kepps coming back.  Four times in 5 min.
<!-- Author: gianluca :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225490' target=_top>225490</a>) -->

<!-- Date: Wed Oct 18 23:01:28.817 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225490>225490</A>
 Terminated at 2006.10.18 23:00:27
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 23:01:29.777 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225490>225490</A>
TERMINATE: L2 decision timeout reoccurring every minute.
<!-- Author: DAQ Aces x2080 -->



<!-- Date: Wed Oct 18 23:03:48.078 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225491>225491</A>
 Activated at 2006.10.18 23:03:40
<!-- Author: RunControl -->


<!-- Date: Wed Oct 18 23:03:49.265 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=225491>225491</A>
ACTIVATE: RunSet: ACE_COSMIC_NOTRACKS  Trigger: COSMICS_NOTRACKS [9,731,639] 
<!-- Author: DAQ Aces x2080 -->
<!-- Comment: Wed Oct 18 23;08;56 comment by...greg -->
<pre>With Auto L2 Accept</pre>




<!-- Comment: Wed Oct 18 23;26;48 comment by...greg -->
<pre>Using auto L2 accept causing a couple of extra hassles:

1) No TrigMon output to the display.

2) Data sync errors -
   DAQErrMon:DataSyncError: Error 36 Event 5669 Run 225491 
   TSID TL2D ReadoutList mismatch GlobalReadoutList: 0 L2 ROL: 7 </pre>



<!-- Date: Wed Oct 18 23:47:18.160 2006 -->
<font color=red>Shift Summary: </font><pre> 
We did all the calibrations.  All fine except  
for COT.  The CO mailed Eiko about the problem. 
Eiko will make an access tomorrow to fix it. 
 
We ran cosmics on and off with most of the HV on. 
(COT and Silicon are not to be powered until further notice.) 
 
Know Problems: 
 
L2 clustering mismatches in TrigMon (experts notified)  
This also seems to causing a lot of L2 decision timeouts. 
(We are running now with L2 auto accept.) 
 
The new CSL is writing all files to the look area.   
(Experts are aware.) The shift crew should try to disable the  
writing of files to the look area from runControl until this is fixed.)  
 
There are problems generating L3 calib. tagsets.   
Many run configurations may crash with "checksum errors". 
 
TOF is causing a PSM alarm.  TOF experts should be paged in the 
morning. 
 
The SVT readout is broken (experts notified). 
Do not try to include these crates in your runs for now. 
 
TrigMon showed some XFT errors (with the COT off!).   
Nils will have to replace some (unspecified) cards. 
</pre> 
<!-- Author: greg feild -->


<!-- Date: Wed Oct 18 23:48:29.030 2006 -->
<pre>Kevin Lannon (CO) is still here! 
 
</pre>
<!-- Author: proud scico -->

<!-- Date: Wed Oct 18 23:55:32.532 2006 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>23:55:01</TD>
<TD ALIGN=CENTER>::</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT></TD>
<TD ALIGN=RIGHT></TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->