<!-- Title: Eve shift. Thu Apr 12, 2007 -->
<!-- SciCo: Amit Lath -->
<!-- DAQAce: Micah Kreps/Shih-Chieh Hsu -->
<!-- MonAce: &nbsp; -->
<!-- CO: Alexei Semenov -->
<!-- OpManager: &nbsp; -->
<!-- Notes: -->
Inherited run from day shift.  Luminosity is really low and we are expecting them to dump the store soon and go into shot setup.

<!-- Date: Thu Apr 12 16:20:52.742 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=238991>238991</A>
ACTIVATE: L2 XFT test on b0l2pu02. Back to old fer code
<!-- Author: alister -->



<!-- Date: Thu Apr 12 16:23:08.219 2007 -->
I'm outa here. Thanks everyone.
<!-- Author: Rob :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=238989' target=_top>238989</a>) -->
<!-- Comment: Thu Apr 12 16;57;52 comment by...CDF -->
<table border=0><td><tr><td bgcolor=#e0e030>Parition 0:  "Congratulations!!!"</td></tr></td></table>
<!-- Date: Thu Apr 12 16:27:53.937 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=238989>238989</A>
 Terminated at 2007.04.12 16:27:45
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 16:29:20.691 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=238989>238989</A>
TERMINATE: End run for L2 test
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 16:34:45.954 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=238993>238993</A>
 Activated at 2007.04.12 16:34:32
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 16:34:47.005 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=238993>238993</A>
ACTIVATE: RunSet: AAA_NOSILICON  Trigger: PHYSICS_4_01 [5,866,678] Testin for L2CAL
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 16:38:19.852 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=238993>238993</A>
 Terminated at 2007.04.12 16:36:35
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 16:38:20.035 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=238993>238993</A>
TERMINATE: end test
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 16:44:08.191 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239001>239001</A>
ACTIVATE: XFTL2 next try at new fer code
<!-- Author: alister -->


<!-- Date: Thu Apr 12 16:45:01.822 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239000>239000</A>
 Activated at 2007.04.12 16:44:10
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 16:45:02.534 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239000>239000</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_4_02 [3,873,681] 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 16:50:50.632 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239005>239005</A>
ACTIVATE: and again...

<!-- Author: alister -->


<!-- Date: Thu Apr 12 16:55:26.326 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239008>239008</A>
ACTIVATE: back to original fer
<!-- Author: alister -->




<!-- Date: Thu Apr 12 17:01:01.747 2007 -->
<pre>Get SVXMon error 
"SVXMon not connected to ConsumerErrorReceiver (aka ConsumerMonitor) 
  since 2007-04-12 16:57:40.0 
ConsumerErrorReceiver forwards errors and HRR requests from SVXMon 
  and these processes are very important to data taking! 
Restart SVXMon immediately!" 
 
SVXMon timestamp and runnumber is correct. Keep watching if error messages are persistent.</pre>
<!-- Author: Shih-Chieh/Michal :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239000' target=_top>239000</a>) -->
<!-- Comment: Thu Apr 12 17;07;27 comment by...Shih-Chieh -->
again. Restart SVXMon
<!-- Date: Thu Apr 12 17:03:07.040 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239017>239017</A>
ACTIVATE: XFTL2 default fer
<!-- Author: alister -->



<!-- Date: Thu Apr 12 17:11:39.257 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239022>239022</A>
ACTIVATE: XFT L2 new fer code
<!-- Author: alister -->



<!-- Date: Thu Apr 12 17:15:01.966 2007 -->
MCR called, they are (finally) dropping this store.
<!-- Author: Amit :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239000' target=_top>239000</a>) -->

<!-- Date: Thu Apr 12 17:17:10.119 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239000>239000</A>
 Terminated at 2007.04.12 17:16:58
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 17:24:06.953 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239000>239000</A>
TERMINATE: End of Store. 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 17:33:05.485 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239032>239032</A>
ACTIVATE: RunSet: ACE_QIE 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 17:33:24.267 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239032>239032</A>
CALIBRATION: <U><B>calqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#calqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Thu Apr 12 18;08;41 comment by...Alexey Semenov -->
calqie calibration looks ok.
<!-- Date: Thu Apr 12 17:35:56.407 2007 -->
<P> 
Found immediate problems with data transfer between  
b0l2pu03 (LEVEL2_PULSAR_03) and the VRB_14 (b0vrb14, slot 10) 
with Tracer serial number 107.   This tracer had been  
removed from the system around or before 2006.07.03 (this  
is when the initial repair request was entered) with  
a comment "Suspect flakey problem driving CDF specific  
backplane signals".   The board was tested and returned  
with no problems detected and no repairs made. 
<P>
<!-- Author: badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239032' target=_top>239032</a>) -->
<!-- Comment: Thu Apr 12 17;37;32 comment by...bb -->
<pre>Starting test, will do 100000 passes
found not empty 0
found not empty 0
found not empty 0
found not empty 0
found not empty 0
found not empty 0
found not empty 0
found not empty 0
found not empty 0
Busy or fifo empty timeout on pass 73 status 200071a0
Resetting tracer...
</pre>
<!-- Comment: Thu Apr 12 17;40;23 comment by...badgett -->
<pre>Cancel the tracer suspicion, found same errors with another 
tracer, serial number 97:

Starting test, will do 5 passes
slot 10 got event 1, bytes is 2a8; total errors 0
slot 10 got event 2, bytes is 448; total errors 0
slot 10 got event 3, bytes is 328; total errors 0
incorrect count on event 3, expect: 338 saw: 328
Header: 00000000 00000328 00020002 00000000 00000000 00000304 00000000 00000000
Taxi violation counter at end 0
</pre>
<!-- Date: Thu Apr 12 17:36:57.707 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239033>239033</A>
ACTIVATE: RunSet: CALIB_CLC_QIE 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 17:36:58.651 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239034>239034</A>
ACTIVATE: XFT L2 new fer
<!-- Author: alister -->


<!-- Date: Thu Apr 12 17:37:27.086 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239033>239033</A>
CALIBRATION: <U><B>clcqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#clcqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Thu Apr 12 18;10;32 comment by...Alexey Semenov -->
clcqie calibration is ok.
<!-- Date: Thu Apr 12 17:40:27.544 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239035>239035</A>
ACTIVATE: RunSet: CALIB_QIE_FWD 
<!-- Author: Shih-Chieh/Michal -->



<!-- Date: Thu Apr 12 17:40:35.183 2007 -->
At Monica's request I replaced the DCAS in b0l2cl01 slot 20 (SNO 32) with one from the spares cabinet (SNO 46).  
<!-- Author: twright -->


<!-- Date: Thu Apr 12 17:41:19.804 2007 -->
We are using the Hardware EVB and b0l2pu03 to test data  
transfers between the two. 
  
<!-- Author: badgett, vrusu, sartori :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239035' target=_top>239035</a>) -->

<!-- Date: Thu Apr 12 17:42:06.605 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239035>239035</A>
CALIBRATION: <U><B>bscqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#bscqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Thu Apr 12 18;13;19 comment by...Alexey Semenov -->
bscqie calibration  looks good.
<!-- Date: Thu Apr 12 17:43:58.882 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239037>239037</A>
ACTIVATE: RunSet: ACE_TOF_QIE_NEW 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 17:43:59.971 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239037>239037</A>
CALIBRATION: <U><B>tofqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#tofqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Thu Apr 12 18;15;17 comment by...Alexey Semenov -->
tofqie calibration  is ok.
<!-- Date: Thu Apr 12 17:44:29.322 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239038>239038</A>
ACTIVATE: XFTL2 new fer version 3
<!-- Author: alister -->


<!-- Date: Thu Apr 12 17:46:47.128 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239039>239039</A>
ACTIVATE: RunSet: SMQIECALIB 
<!-- Author: Shih-Chieh/Michal -->



<!-- Date: Thu Apr 12 17:50:02.125 2007 -->
We're using b0wcal05 for Tracer/VRB tests.
<!-- Author: badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239039' target=_top>239039</a>) -->

<!-- Date: Thu Apr 12 17:51:18.991 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239040>239040</A>
ACTIVATE: RunSet: ACE_LED_ALL 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 17:51:41.524 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239039>239039</A>
CALIBRATION: <U><B>smx</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#smx target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Thu Apr 12 18;16;43 comment by...Alexey semenov -->
smx calibration  looks good.
<!-- Date: Thu Apr 12 17:53:12.350 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239040>239040</A>
CALIBRATION: <U><B>cemled</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cemled target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Thu Apr 12 18;17;41 comment by...Alexey Semenov -->
cemled calibration is ok.
<!-- Date: Thu Apr 12 17:55:09.893 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239041>239041</A>
ACTIVATE: XFTL2 version 3 again
<!-- Author: alister -->


<!-- Date: Thu Apr 12 17:55:10.601 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239042>239042</A>
ACTIVATE: RunSet: COTCALIB_ACE 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 17:58:53.986 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239000>239000</A>
trigger: <tt>Reformat errors is 2%</tt>
<!-- Author: Consumer Operator(Alexey Semenov) -->


<!-- Date: Thu Apr 12 17:58:54.728 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239000>239000</A>
general: <tt>General all monitors are good, except ReformatErrors (2% vs 1% as threshold)</tt>
<!-- Author: Consumer Operator(Alexey Semenov) -->


<!-- Date: Thu Apr 12 18:00:47.232 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239042>239042</A>
TERMINATE: abnormal long process.
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 18:01:23.135 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239043>239043</A>
ACTIVATE: RunSet: COTCALIB_ACE 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 18:07:43.608 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239042>239042</A>
CALIBRATION: <U><B>cot</B></U> calibration FAILED, please investigate
<!-- Author: CDFCALIB -->
<!-- Comment: Thu Apr 12 18;16;51 comment by...Eiko -->
<pre>I checked the log file /cdf/onln/data/cdfcalib/log/runCotCtt_0_2007-04-12_17:53:43.log and the results looks fine. 
See https://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cot

I will ask Bill Badget why there's an error 
message. </pre>
<!-- Comment: Thu Apr 12 18;20;52 comment by...Eiko -->
OK, my misunderstanding, the log file I checked was from Run 239043.
<!-- Comment: Thu Apr 12 18;59;16 comment by...Michal -->
First calibration run (239042 ) was weird as it took very long time  in which it got only couple of events. We decided to abort and do it once again. I looked to the results even if it failed to give link to e-log and was just about to write you email, but got other troubles which needed my attention first. I suppose you check all what you wanted to check and therefore I will not write email.
<!-- Date: Thu Apr 12 18:07:44.076 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239044>239044</A>
ACTIVATE: RunSet: XEF_ALL 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 18:07:45.061 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239044>239044</A>
CALIBRATION: <U><B>calxef</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#calxef target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Thu Apr 12 18;19;21 comment by...Alexey Semenov -->
calxef calibration  is ok.

<!-- Date: Thu Apr 12 18:20:35.151 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239045>239045</A>
ACTIVATE: RunSet: CALIB_MUON_ALL1 
<!-- Author: Shih-Chieh/Michal -->




<!-- Date: Thu Apr 12 18:31:56.788 2007 -->
<pre>confirmed a dead cafe card - WHA 12E ch.2 </pre>
<!-- Author: Kwangzoo -->

<!-- Date: Thu Apr 12 18:52:10.827 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239048>239048</A>
ACTIVATE: RunSet: TOF_TAC_CALIB 
<!-- Author: ace -->



<!-- Date: Thu Apr 12 18:56:25.237 2007 -->
Rack 1RR21E tripped. Peter Wilson was just around when we got PSM alarm for that rack and went down to check. He found out, that full rack was off. After it we had troubles with EVB which failed config. This was pinned down to b0evme14 and b0evme16 (both in 1RR21E) being unaccessible. We reset them but were still failing config. In next step we found that evbProxy was not running for partition 0. I managed to get in running again from ACE control panel to L3/EVB after which we could run again.
<!-- Author: Michal :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239047' target=_top>239047</a>) -->

<!-- Date: Thu Apr 12 18:56:46.735 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239048>239048</A>
CALIBRATION: <U><B>toftac</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#toftac target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Thu Apr 12 20;11;48 comment by...Alexey Semenov -->
toftac calibration is ok.
<!-- Date: Thu Apr 12 19:06:03.169 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239051>239051</A>
 Activated at 2007.04.12 19:04:46
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 19:06:04.665 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239051>239051</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,730,674] 
<!-- Author: ace -->


<!-- Date: Thu Apr 12 19:10:23.904 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239051>239051</A>
 Terminated at 2007.04.12 19:10:06
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 19:13:22.300 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239055>239055</A>
ACTIVATE: RunSet: COTCALIB_ACE 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 19:16:41.691 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239055>239055</A>
TERMINATE: Takes too long and we have to fix b0wcal06 things more urgently.
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 19:20:07.535 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239058>239058</A>
 Activated at 2007.04.12 19:18:56
<!-- Author: RunControl -->
<!-- Comment: Thu Apr 12 19;32;47 comment by...m mattson (ADMEM) -->
WCAL06 has the symptoms of its memory being scrambled in slot 18.  Looking in the error log, slot 18 BunchCounter number 255, which is not possible under normal operations.  When doing a map of the crate (from the QIETEST program), all the CAFE cards for that slot are reporting the same number.
<p>
I have reconfigured the slot 18 as a WHA ADMEM.  The board should be okay for use now.  At the beginning of a run, the error log will report that this slot is not configured, but that is because RunControl didn't do the configuring.
<!-- Comment: Thu Apr 12 20;06;00 comment by...Michal -->
Seems that problem is fixed.
<!-- Date: Thu Apr 12 19:20:08.768 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239058>239058</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,730,674] 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 19:21:01.482 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239058>239058</A>
 Terminated at 2007.04.12 19:20:21
<!-- Author: RunControl -->



<!-- Date: Thu Apr 12 19:39:08.317 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239061>239061</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_4_01 [5,866,678] 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 19:43:20.781 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239062>239062</A>
ACTIVATE: RunSet: COTCALIB_ACE 
<!-- Author: Michal -->


<!-- Date: Thu Apr 12 19:47:57.051 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239062>239062</A>
TERMINATE: I got Done timeout for cot10 during calibration twice. At the end we had 991 L2A and 1000 Calib events and calibration didn't made it to done state. Will try again.
<!-- Author: Michal -->


<!-- Date: Thu Apr 12 19:47:58.652 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239064>239064</A>
ACTIVATE: RunSet: COTCALIB_ACE 
<!-- Author: Michal -->


<!-- Date: Thu Apr 12 19:49:06.317 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239064>239064</A>
TERMINATE: Looks like this time it made it completely
<!-- Author: Michal -->


<!-- Date: Thu Apr 12 19:51:52.995 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239062>239062</A>
CALIBRATION: <U><B>cot</B></U> calibration FAILED, please investigate
<!-- Author: CDFCALIB -->



<!-- Date: Thu Apr 12 20:03:00.730 2007 -->
MCR called, they are having power supply problems.  We have quiet time, at least an hour, maybe two.
<!-- Author: Amit -->



<!-- Date: Thu Apr 12 20:17:18.536 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239000>239000</A>
<HTML>Run <A HREF=http://www-cdfonline.fnal.gov/java/cdfdb/servlet/RunSummary?RUN=239000 target=_runSummary>239000</A> has not yet been checked for goodrun status; please do so.</HTML>
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 20:35:23.031 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239068>239068</A>
 Activated at 2007.04.12 20:35:18
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 20:35:57.745 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239068>239068</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,730,674] 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 20:40:19.123 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239068>239068</A>
 Terminated at 2007.04.12 20:39:14
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 20:51:29.114 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239073>239073</A>
 Activated at 2007.04.12 20:50:54
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 20:51:30.680 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239073>239073</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,730,674] 
<!-- Author: Shih-Chieh/Michal -->



<!-- Date: Thu Apr 12 20:52:42.621 2007 -->
<pre>Fix of done timeout from b0cot10 in COT calibration:  
   
  I failed to reset and shepherd b0cot10 within run control. In  
the end, I did a "reboot" within vxcom and seemed to have solved  
the problem. I reran COT calibration twice and didnt get complaint  
from b0cot10. About the fact that some log files didnt seem to show up: I saw all the log files with successful COT calibrations, but  
not all the ones which failed. If the calibration is not finished  
properly, the log file will not be written. </pre>
<!-- Author: Eiko -->


<!-- Date: Thu Apr 12 20:55:10.102 2007 -->
<P> 
We found that the VRB_14, slot 10 VRB, channel 5 data input  
was not working properly.    Either the TART or VRB  
itself may be at fault.   Therefore, I  
have moved the b0l2pu03 VRB connection to VRB_15, slot 10, channel 0  for now.      Now b0l2pu03 readouts out properly with  
the hardware event builder. 
<P> 
JDL will want to fix up the fibre cabling for this crate,  
as I moved the cables at the back of the rack. 
<P> 
  
<!-- Author: badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239073' target=_top>239073</a>) -->


<!-- Date: Thu Apr 12 21:49:34.726 2007 -->
<pre>Spent a lot of time working on l2cal issues. Problems with l2pu03 when included with the run configuration were addressed by Bill. Once that was cleared up- ran successfully with l2pu03 & l2pu04 + l2quad02 in shot setup. These tests were done parasitically, received data from the new cluster path ( one full crate ) and the for current paths. The parasitic l2 processors were terminated after the testing and l2pu03 and 04 are not in any run configurations. 
 
</pre>
<!-- Author: Anadi,Dan,Gene, Laura, Vadim -->
<!-- Comment: Thu Apr 12 21;51;00 comment by...Gene -->
<pre>just to be clear: the problems mentioned above do not exist at this time ( see comment by bill above )</pre>


<!-- Date: Thu Apr 12 22:04:53.689 2007 -->
Loading final protons, we have switched to shot setup.
<!-- Author: Amit -->

<!-- Date: Thu Apr 12 22:05:52.058 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239073>239073</A>
 Terminated at 2007.04.12 22:03:21
<!-- Author: RunControl -->



<!-- Date: Thu Apr 12 22:11:32.506 2007 -->
<pre>Failed partition while including "L2PULSAR_TED" crate, error messages: 
Invalid Run Settings 
L2Enable 12 selects L2Spigot 3 but this 
 L2Processor is not in the run: 
hdwdb.L2Pulsar in crate LEVEL2_PULSAR_02 slot 18 
 
Exclude it and continue AAA_SHOTSETUP run.</pre>
<!-- Author: Shih-Chieh/Michal :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239074' target=_top>239074</a>) -->
<!-- Comment: Thu Apr 12 22;39;09 comment by...Andrew -->
<pre>I see no problem on the L2 PC side. The failure might be related to the fact that  there are two ./runTEDCpp.sh processes running on the control node. One left after L2CAL tests. :(</pre>
<!-- Date: Thu Apr 12 22:13:42.678 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239074>239074</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_4_02 [3,873,681] 
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 22:16:55.407 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239074>239074</A>
TERMINATE: DAQErrMon:DataMissingError: 
 Error 12 Event 321 Run 239074 Bank COTD_StorableBank missing from event record, nErrors 12 

Follow suggestion to start new run
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 22:20:19.144 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239075>239075</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_4_02 [3,873,681] 
<!-- Author: Shih-Chieh/Michal -->
<!-- Comment: Thu Apr 12 22;21;08 comment by...Shih-Chieh -->
SVT_TRACKING_03 done time out. HRR


<!-- Comment: Thu Apr 12 22;34;01 comment by...Shih-Chieh -->
CMU_01 done timeout, HRR
<!-- Date: Thu Apr 12 22:28:53.383 2007 -->
DAQErrMon:DataMissingError shows up again. We decide to restart DAQErrMon and the errors are gone.
<!-- Author: Shih-Chieh/Michal :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239075' target=_top>239075</a>) -->




<!-- Date: Thu Apr 12 22:47:13.485 2007 -->
PSM alarm: 1RR18C_1 turns red and recovers in 1 min
<!-- Author: Shih-Chieh :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239075' target=_top>239075</a>) -->


<!-- Date: Thu Apr 12 22:54:07.054 2007 -->
icile hear beat. restart icicle
<!-- Author: Shih-Chieh :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239075' target=_top>239075</a>) -->


<!-- Date: Thu Apr 12 23:14:06.580 2007 -->
Pbars loaded.
<!-- Author: Amit -->

<!-- Date: Thu Apr 12 23:18:20.679 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239075>239075</A>
TERMINATE: Prepare for HEP

<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 23:33:58.360 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239076>239076</A>
 Activated at 2007.04.12 23:33:48
<!-- Author: RunControl -->


<!-- Date: Thu Apr 12 23:33:59.162 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239076>239076</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_4_02 [3,873,681] 
<!-- Author: Shih-Chieh/Michal -->



<!-- Date: Thu Apr 12 23:39:50.768 2007 -->
Attention !!!. CER_SVXMON_HALT_RECOVER_RUN_ERROR !!!   
 Pipeline out of synch in 75 silicon readout chips .  
 AUTO HRR is issued  
<!-- Author: Shih-Chieh :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239076' target=_top>239076</a>) -->


<!-- Date: Thu Apr 12 23:43:23.902 2007 -->
Lostp and abortgap showed spikes.  MCR says it's not something they did, and anyway things are calm again.  Silicon pager carrier says to keep running, but keep an eye on beam conditions.
<!-- Author: Amit :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239076' target=_top>239076</a>) -->


<!-- Date: Thu Apr 12 23:47:07.970 2007 -->
<br><b>Done TO.</b> for crate/s: b0pcal07 
<br> shepherding ok.   
<!-- Author: Koji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239076' target=_top>239076</a>) -->


<!-- Date: Thu Apr 12 23:50:04.074 2007 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-3551&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-3551  width='300' align='top'></a></td><td>a</td></tr></table>
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 23:50:05.543 2007 -->
<br><b>Trigger Inhibit</b> is set from the components: TOF HV 
<br> it went away by itself.
<!-- Author: Koji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=239076' target=_top>239076</a>) -->


<!-- Date: Thu Apr 12 23:52:04.415 2007 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-3552&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-3552  width='300' align='top'></a></td><td>Loss/AbGaps</td></tr></table>
<!-- Author: Shih-Chieh/Michal -->


<!-- Date: Thu Apr 12 23:54:00.576 2007 -->
<font color=red>Shift Summary: </font><pre>Started collisions, initial luminosity 182.135</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   239076
Delivered Luminosity   117.8  
Acquired Luminosity    82.6  
Efficiency             70.1
   
</td></tr></table></pre>
<!-- Author: Amit -->

<!-- Date: Thu Apr 12 23:55:24.918 2007 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=238989 target=_runSummary>238989</A> x3A58D</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_02 [3,873,681]</FONT></TD>
<TD ALIGN=CENTER>15:59:43</TD>
<TD ALIGN=CENTER>16:27:45</TD>
<TD ALIGN=CENTER>00:22:46</TD>
<TD ALIGN=RIGHT>     135,404</TD>   <TD ALIGN=RIGHT>     44.61</TD>
<TD ALIGN=RIGHT>     35.70</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=239000 target=_runSummary>239000</A> x3A598</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_02 [3,873,681]</FONT></TD>
<TD ALIGN=CENTER>16:44:10</TD>
<TD ALIGN=CENTER>17:16:58</TD>
<TD ALIGN=CENTER>00:31:50</TD>
<TD ALIGN=RIGHT>     189,608</TD>   <TD ALIGN=RIGHT>     50.77</TD>
<TD ALIGN=RIGHT>     48.44</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=239076 target=_runSummary>239076</A> x3A5E4</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_02 [3,873,681]</FONT></TD>
<TD ALIGN=CENTER>23:33:48</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>00:18:28</TD>
<TD ALIGN=RIGHT>     112,319</TD>   <TD ALIGN=RIGHT>    211.41</TD>
<TD ALIGN=RIGHT>    181.87</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>23:55:01</TD>
<TD ALIGN=CENTER>01:13:05</TD>
<TD ALIGN=RIGHT>       437,331</TD> <TD ALIGN=RIGHT>    306.80</TD>
<TD ALIGN=RIGHT>    266.00</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Fri Apr 13 00:01:27.664 2007 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-3555&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-3556  width='300' align='top'></a></td><td>OLD ACE FREEDOM DAY is here and we are free from Control Room. We would like to wish new access good luck.</td></tr></table>
<!-- Author: Michal for all ACEs -->