<!-- Title: Day shift. Fri Jun 29, 2001 -->
<!-- SciCo: Niccola Bachetta -->
<!-- DAQAce: Michael Riveline -->
<!-- MonAce: Koji Ikado -->
<!-- CO: Jim Russ -->
<!-- OpManager: Steve Hahn -->
<!-- Notes: -->
<pre>Inherit nice run. Plan- drop beam at 9. Shot setup follows.</pre>


<!-- Date: Fri Jun 29 08:14:54 2001 -->
<pre>COT SL4 trips. Not beam related. Recover ok</pre>
<!-- Author: michael :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119029' target=_top>119029</a>) -->


<!-- Date: Fri Jun 29 08:42:00 2001 -->
<pre>Set COT HV to Hi STBY and set CMP HV to STBY for  
flying wires at 8:039.  
After that, turn them on.</pre>
<!-- Author: Koji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119029' target=_top>119029</a>) -->


<!-- Date: Fri Jun 29 08:49:52 2001 -->
<pre>1 done timeout -&gt; VRB_SVX02: 
 
(MLE) b0l3gate1.fnal.gov:main:8:47:07 AM-&gt;Host b0eb19.fnal.gov, task tRec_0 
SCPU-P0-E-VrbReadFailed: Error reading VRB in slot 12 for event 405481. 
VRB_BUS_ERROR: Alignment or VME bus error. 
Transferred 8 bytes before the error. 
(MLE) b0l3gate2.fnal.gov:main:8:47:07 AM-&gt;Error on L3 node b0l3079 (partition 0) Fri Jun 29 07:47:06 2001 l3_node 
  in refoInt_reformatProc (l3_refevt.c:610) 
  @L3_REFORMAT_ERROR 
  
RAWREF Error - VRB-CLEANP - with code 20 -- START 
 Line -  949 in: src/library/rr_rawevt.c 
 Buffer position: 43656 
 Error count: 1 of 2 
 Reject rate: 0.110 percent 
  
 VRB(non-SVX) has zero lenght data, VRB problem. 
 Probabaly EVB tries to clear VRB pipeline in HRR. 
 Length 
  0x00000000 
  
 Error location code: 0x01009090 
  
  
 Crate Id?: 0x00000010 
  
 Error during scanning MINI structure! 
 Last Unit prob. worked on (all counts from 0): 
  SCPU: 9 
  VRB : 0 
  LINK: 9 
  MINI: 0 
  
 Buffer (43636 until posi+2=43658) 
 0x0ca31414  0x27045012  0x02000000  0x2a2a2a2a  0x61745320  0x6f207472 
 0x63532066  0x656e6e61  0x50432072  0x76652055  0x20746e65  0x67617266 
 0x746e656d  0x2a2a2a20  0x0000002a  0x01000000  0x00000000  0x00000000 
 0x00000000  0x00000000  0x00000000  0x00000000  0x00000000 
  
  
 NOTE: Event rejected! 
  
RAWREF Error - VRB-CLEANP - with code 20 -- FINISHED: L&lt;  897 
  
  
CT: 6/29/2001, 8:47'9" 
47'9" 1 crate/s: b0svx02(112),  busy.[RXPT] 
(MLE) b0tsi02:Messenger:8:47:07 AM-&gt;BUSY timeout                                        </pre>
<!-- Author: michael :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119029' target=_top>119029</a>) -->


<!-- Date: Fri Jun 29 09:07:23 2001 -->
<pre>COT SL8 trips -&gt; recover ok.</pre>
<!-- Author: michael :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119029' target=_top>119029</a>) -->


<!-- Date: Fri Jun 29 09:11:09 2001 -->
<pre>Monitoring dead on sub-farm 05.</pre>
<!-- Author: michael :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119029' target=_top>119029</a>) -->


<!-- Date: Fri Jun 29 09:47:43 2001 -->
<pre>Another done timeout from VRB_SVX_02: 
 
(MLE) b0l3gate1.fnal.gov:main:9:44:22 AM-&gt;Host b0eb18.fnal.gov, task tRec_0 
SCPU-P0-E-VrbReadFailed: Error reading VRB in slot 8 for event 597952. 
The VRB had no event.                                                                    
 
Trips a couple of times -&gt; end run to clean EVB</pre>
<!-- Author: michael :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119029' target=_top>119029</a>) -->


<!-- Date: Fri Jun 29 09:59:26 2001 -->
Beam ON until 11:00am (D0 requested further time).
<!-- Author: Nicola -->


<!-- Date: Fri Jun 29 09:59:41 2001 -->
<pre>Restarting the run after clean up of EVB. YK and Farrukh come and ask me to integrate the new trigger table before starting the new run -&gt; have to restart RC.</pre>
<!-- Author: michael -->


<!-- Date: Fri Jun 29 10:01:15 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1365&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1365  width='300' align='top'></td><td>Luminosity plots from the begining of store.</a></td></tr></table>
<!-- Author: Koji -->


<!-- Date: Fri Jun 29 10:09:06 2001 -->
Just after partitionning (with new trigger table PHYSICS_0_00_00[6,154], silicon comes and requires to be dropped from run for studies. So drop SI and restart run.
<!-- Author: michael -->
<!-- Comment: Fri Jun 29 14;48;33 comment by...michael -->
<pre>Errata: it is [6,155].</pre>
<!-- Date: Fri Jun 29 10:13:30 2001 -->
<pre>Start new run with new trigger table and no silicon.</pre>
<!-- Author: michael :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119031' target=_top>119031</a>) -->


<!-- Date: Fri Jun 29 10:22:15 2001 -->
<pre>SVT06 crate is bad -&gt; SPYMON died. Have to reset it when run ends.</pre>
<!-- Author: michael :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119031' target=_top>119031</a>) -->
<!-- Comment: Fri Jun 29 10;51;10 comment by...marco -->
This seems to be related to running SVT with no Silicon. Protection against this will be patched to the code.
<!-- Date: Fri Jun 29 10:24:23 2001 -->
<pre>CMX01 done timeout -&gt; Bunch counter mismatch: 
 
(MLE) b0cmx01:Messenger:10:23:03 AM-&gt;Event 43014: Bunchcounters in slot 3 and slot 13 disagree (at least) 
(MLE) b0cmx01:Messenger:10:23:03 AM-&gt;Runtime Error 1, Event 43014: Bunch counter mismatch, 
mismatch count = 1 
23'7" 1 crate/s: b0cmx01(87),  Done TO.[RXPT]      </pre>
<!-- Author: michael :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119031' target=_top>119031</a>) -->


<!-- Date: Fri Jun 29 10:44:27 2001 -->
<pre>Set COT HV to Hi STBY and set CMP HV to STBY for  
flying wires at 10:39.  
After that, turn them on.</pre>
<!-- Author: Koji :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119031' target=_top>119031</a>) -->



<!-- Date: Fri Jun 29 10:59:11 2001 -->
MCR called. They are dropping the store in 5 minutes. 
Silicon to be brought OFF. Silicon is all OFF (AukiPeter). 
Run to end soon
<!-- Author: Nicola :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119031' target=_top>119031</a>) -->
<!-- Comment: Fri Jun 29 11;00;11 comment by...Nicola -->
HV brought to standby.


<!-- Date: Fri Jun 29 11:10:31 2001 -->
<pre>The store dropped. 
Set COT, MUON, CES, CPR and CCR HVs to standy. 
</pre>
<!-- Author: Koji -->


<!-- Date: Fri Jun 29 11:12:03 2001 -->
<pre>Solenoid field is going down. 
COT HV trips, turn it off.</pre>
<!-- Author: Koji -->


<!-- Date: Fri Jun 29 11:38:53 2001 -->
<pre>Beam is dumped at 11am -&gt; no beam for a while so doing calibrations: 
 
ACE_QJE        119038 
CALIB_CLC_QJE  119039    
SMQJECALIB     119040 
CAL_LED        119040 
FLASHPED_ALL   119041 -&gt; beam injected, have to abort before we start 
MUON           119046 
COT            119051 -&gt; b0cot08 hangs during setup; login to it and reset: 
 
Cannot configure readout - check readout list. 
Readout process not started. Error status: 1 
Sent ack to Run Control: 5 ERROR ERROR 
No software event builder 
Messenger: processStatechange Abort [0] 
Sent ack to Run Control: 5 IDLE SUCCESS 
Messenger: processStatechange Reset [0] 
Statechange failed                                  
</pre>
<!-- Author: michael -->
<!-- Comment: Fri Jun 29 12;03;33 comment by...vaia -->
<pre>run 119038 finished without the error reports we were getting
a couple of days ago. The Front end code fixes were succesful.
This is very good.</pre>
<!-- Date: Fri Jun 29 11:43:02 2001 -->
Reflowed some bits on CLIST to fix eta phi problems.  I _only_ reflowed these bits - did not add additional solder.  See L2 log book for specific bits.  If there are any problems with CLIST please page L2 pager.
<!-- Author: hray -->


<!-- Date: Fri Jun 29 11:44:02 2001 -->
<pre>Redo COT calibration (in partition 5); this time b0cot17 hangs... 
OK, 3rd attempt -&gt; now b0cot01 hangs... Pageing the experts</pre>
<!-- Author: michael -->


<!-- Date: Fri Jun 29 11:49:16 2001 -->
<pre>Take TOF calibration.</pre>
<!-- Author: michael :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119057' target=_top>119057</a>) -->


<!-- Date: Fri Jun 29 12:00:52 2001 -->
<table><tr><td><a href=/elog/notebooks/2001/Fri_Jun_29_2001_Day.120043.ps align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1377  align='top'></td><td>ACE_QIE run 119038</a></td></tr></table>
<!-- Author: Zhaoou -->


<!-- Date: Fri Jun 29 12:01:27 2001 -->
<table><tr><td><a href=/elog/notebooks/2001/Fri_Jun_29_2001_Day.120121.ps align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1379  align='top'></td><td>2</a></td></tr></table>
<!-- Author: Zhaoou -->


<!-- Date: Fri Jun 29 12:02:05 2001 -->
<table><tr><td><a href=/elog/notebooks/2001/Fri_Jun_29_2001_Day.120200.ps align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1381  align='top'></td><td>3</a></td></tr></table>
<!-- Author: zhaoou -->


<!-- Date: Fri Jun 29 12:02:53 2001 -->
<table><tr><td><a href=/elog/notebooks/2001/Fri_Jun_29_2001_Day.120248.ps align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1383  align='top'></td><td>4</a></td></tr></table>
<!-- Author: Zhaoou -->


<!-- Date: Fri Jun 29 12:03:26 2001 -->
<table><tr><td><a href=/elog/notebooks/2001/Fri_Jun_29_2001_Day.120321.ps align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1385  align='top'></td><td>5</a></td></tr></table>
<!-- Author: Zhaoou -->



<!-- Date: Fri Jun 29 12:04:42 2001 -->
<table><tr><td><a href=/elog/notebooks/2001/Fri_Jun_29_2001_Day.120437.ps align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1387  align='top'></td><td>showermax 119039</a></td></tr></table>
<!-- Author: Zhaoou -->


<!-- Date: Fri Jun 29 12:05:42 2001 -->
<table><tr><td><a href=/elog/notebooks/2001/Fri_Jun_29_2001_Day.120537.ps align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1389  align='top'></td><td>2</a></td></tr></table>
<!-- Author: Zhaoou -->


<!-- Date: Fri Jun 29 12:06:37 2001 -->
<table><tr><td><a href=/elog/notebooks/2001/Fri_Jun_29_2001_Day.120632.ps align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1391  align='top'></td><td>3</a></td></tr></table>
<!-- Author: Zhaoou -->


<!-- Date: Fri Jun 29 12:13:40 2001 -->
Rebooted b0l2de00 to pick up new monitoring code.  
<!-- Author: Arnd -->


<!-- Date: Fri Jun 29 12:14:02 2001 -->
<pre> Having trouble with the setup transition of the COT calibration.  The problem is that one of the crates always seems to not acknowledge the setup transition, but also doesn't seem to time out.  The crate just waits for the response from the softEVB.  This problem does not always happen in the same crate but seems to jump around.  (cot10,cot11,cot17,cot18,cot19)  Logging into the crate, there are no error messages, but I also noticed that the watchdog process has not been starting in the crate.  When reset is clicked, it looks like all of the "backed up" smartsockets messages are acted upon.  so you end up with a bunch of errors like: 
 
 
b0cot18-> 
b0cot18-> error in read socket 
0x1000e823 0x3 0x1e 0x20 
0x21 0x3d 0x0 0x1000e823 
Connection is closed file = 14 
connection failed: S_errno_ECONNREFUSED 
connection failed: S_errno_ECONNREFUSED 
connection failed: S_errno_ECONNREFUSED 
connection failed: S_errno_ECONNREFUSED 
FER_initEVB: Failed connection 
Processing a COT configuration message 
iteration = 0 
flag20 
flag21 
DTH requested = 225 < 350 !! 
Processing a COT configuration message 
iteration = -1 
flag20 
flag21 
DTH requested = 225 < 350 !! 
Cannot configure readout - check readout list. 
Readout process not started. Error status: 1 
Sent ack to Run Control: 3 ERROR ERROR 
No software event builder 
Messenger: processStatechange Reset [0] 
Messenger: processStatechange Reset [0] 
Messenger: processPartition 3 
Sent ack to Run Control: 3 IDLE SUCCESS 
Statechange failed 
  
The crate then goes back to acting normally.  Not sure if this is a problem with the softEvb not allowing enough connections, or a problem in the FER_initEvb function.  A definite problem is that the error does not seem to timeout, but just stagnates. 
 
Have fun figuring this out.  Please email me if you have more questions. 
 
</pre> 
  
<!-- Author: Kirby :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119051' target=_top>119051</a>) -->


<!-- Date: Fri Jun 29 12:16:09 2001 -->
Bill B. emailed me about sporadic CLIST VME errors.  I pressed reset on the board after reinstalling it, but it's quite possible it needed to be power cycled.  So, I powercycled the L2DE00 crate. 
<!-- Author: hray -->
<!-- Comment: Fri Jun 29 13;40;18 comment by...hray -->
took a short run to check for any VME BERR errors from CLIST.  run 119071 with SEVB, Integration_SumET2[2,150], Ignore Inhibit on.
<!-- Date: Fri Jun 29 12:16:24 2001 -->
<pre>Got WATER alarm. The box "Steam Disabled" is red and shows 0.00%. 
People are working on that.</pre>
<!-- Author: Koji -->


<!-- Date: Fri Jun 29 12:17:46 2001 -->
<pre>First TOF calibration didn't go to the data base, so we take another one.</pre>
<!-- Author: michael :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119065' target=_top>119065</a>) -->


<!-- Date: Fri Jun 29 12:31:05 2001 -->
<table><tr><td><a href=/elog/notebooks/2001/Fri_Jun_29_2001_Day.123048.ps align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1393  align='top'></td><td>TOF calib run 119065</a></td></tr></table>
<!-- Author: Jim Russ -->


<!-- Date: Fri Jun 29 12:43:25 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1394&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1394  width='300' align='top'></td><td>Luminosity plot from the beginning of store until now.</a></td></tr></table>
<!-- Author: Koji -->


<!-- Date: Fri Jun 29 12:56:51 2001 -->
<pre>I did some work on the nodes of L3 farm which got additional memory. 
From now on subfarms 0-3 will have 256Mb of memory  
i marked all the nodes online then distributed the version v2_3_6  
of level3 and v1_2 of relay over the farm I also removed version v2_3_3 of level3 code. 
 
I did the test run. It went Ok 
Subfarm c02 and node 001 will remain offline untill we fix them  </pre>
<!-- Author: Arkadiy -->


<!-- Date: Fri Jun 29 12:59:39 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1395&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1395  width='300' align='top'></td><td>beam losses during last store</a></td></tr></table>
<!-- Author: nicola -->


<!-- Date: Fri Jun 29 13:16:10 2001 -->
<pre>Take a DAQ run with CMX to check noise level.</pre>
<!-- Author: michael :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=119076' target=_top>119076</a>) -->


<!-- Date: Fri Jun 29 13:36:07 2001 -->
<pre>I testeda new version of evb proxy it worked  
returning level3 to the aces  
Boris might come later to work on converter02</pre>
<!-- Author: Arkadiy -->



<!-- Date: Fri Jun 29 13:49:11 2001 -->
It is very warm and humid on the west end of the 2nd floor--that is, in the meeting rooms.  The Disch air temperature readout in the Johnson Controls system is not working; the theory is that with reliable readback, the HV system shuts down.  Craig Olson has called this into FESS, and they have used software override to open up the chilled water heat exchanger.  It seems to be improving rapidly.  A technician is coming out to look at the temp readout.
<!-- Author: Steve Hahn -->


<!-- Date: Fri Jun 29 14:02:18 2001 -->
<pre>Run Control code has been modified to write the Level 2  
scaler information to the database at the end of run and  
periodically during the run.  (every 60 seconds) 
 
Ace will have to restart Run Control to match new  
L2 Decision front end code.</pre>
<!-- Author: W.Badgett -->


<!-- Date: Fri Jun 29 14:10:53 2001 -->
<pre>End CMX run -&gt; noise problems seem to have been cleared. 
Bob Wagner phoned -&gt; gas box of COT will be yellow for a while. 
Start taking a test run to exercise the system (both beams in the machine) -&gt; L3 is hanging.</pre>
<!-- Author: michael -->
<!-- Comment: Fri Jun 29 14;26;55 comment by...nicola -->
CMX noise disappears when the HV is lowered for the miniskirts. So was done. Claim is that we should still see signals.
<!-- Date: Fri Jun 29 14:13:37 2001 -->
<pre>L3 was taken... they also want 1 crate -&gt; took CCAL00.</pre>
<!-- Author: michael -->


<!-- Date: Fri Jun 29 14:22:40 2001 -->
<pre>We used the quiet time to correlate the CMX noise problems with the high voltage sent to the miniskirt wedges.  While the CAEN pods check out okay, we did confirm the correlation when the voltages on the anodes are high enough.  So we set the values low enough to avoid generating noise while still obtaining clean signals.  In a similar way we adjusted voltages for 10W and 5W. Details will be recorded in the CMX e-log.  We verified, with help from the shift crew, that the noise is gone, by accumulating over 500 events in YMON and observing the 2d occupancy plot.</pre>
<!-- Author: Michael Schmitt, Abraham Gallas & Hyunsoo Kim -->



<!-- Date: Fri Jun 29 14:34:02 2001 -->
TOF TAC calibration finished.  
<!-- Author: Koji Sato -->


<!-- Date: Fri Jun 29 14:39:22 2001 -->
The alcohol fraction of the COT drift gas was just increased, and we changed the flow to fast flush.  The fast flush will end on Monday morning.  Del silenced the flow alarms.
<!-- Author: R. Wagner -->



<!-- Date: Fri Jun 29 15:08:37 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1396&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1396  width='300' align='top'></td><td>svx losses during shot setup</a></td></tr></table>
<!-- Author: nicola -->


<!-- Date: Fri Jun 29 15:40:52 2001 -->
<pre>Updated PALS on CMX East TDC Transition Modules. 
 
Ran entire Muon System.  Looks Good. 
 
Return system to shift crew.</pre>
<!-- Author: Eric James -->


<!-- Date: Fri Jun 29 16:02:51 2001 -->
<font color=red>Shift Summary: </font><pre>summary: 
1. store from June 28 8:00am ended during our shift. 
	2.2E30 peak luminosity 
2. CMX noise was fixed by lowering the HV on the miniskirt wedges. 
3. set of calibration taken but no quiet time at our disposal. 
4. L3 problems (a couple of farms are dead).</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   119029-119076
Delivered Luminosity   136.5  
Acquired Luminosity    82.2  
Efficiency             60%
   
</td></tr></table></pre>
<!-- Author: Nicola -->