<!-- Title: Eve shift. Mon Sep 10, 2001 -->
<!-- SciCo: Hans Jensen -->
<!-- DAQAce: Carsten Rott -->
<!-- MonAce: MooHyun Ahn -->
<!-- CO: Reisaburo Tanaka -->
<!-- OpManager: Kevin Burkett -->
<!-- Notes: -->
<pre>Supervised access in progress. Both plugs are now open. 
The silicon Power supply GUI is now again available. 
 
 
</pre>


<!-- Date: Mon Sep 10 16:16:35 2001 -->
<pre>Recompiled RC from scratch to pick up some bug fixes... 
 
Bill B.. will instruct the shift crew to restart run control.</pre>
<!-- Author: Frank Chlebana -->


<!-- Date: Mon Sep 10 16:24:47 2001 -->
<pre>Run Control changes:   Fix lower level memory leaks of  
similar type to the one found 2.75 weeks ago, regarding the  
handling of stdout & stderr when spawning subprocesses from  
the Java virtual machine. 
 
Aces should now test out new version.</pre>
<!-- Author: W.Badgett -->


<!-- Date: Mon Sep 10 16:36:39 2001 -->
<pre>New version of Trigger Supervisor (TS) code has been  
declared current.   New version has Level 2 timeouts  
enabled (timeout is 8.8 seconds) 
 
We will now test it out. 
</pre>
<!-- Author: W.Badgett -->
<!-- Comment: Mon Sep 10 17;16;40 comment by...W.Badgett -->
<pre>Andew Martin changed the code at my request.</pre>
<!-- Comment: Tue Sep 11 14;19;19 comment by...W.Badgett -->
<pre>This was undone (for now) on Tuesday.</pre>
<!-- Date: Mon Sep 10 16:40:39 2001 -->
<pre>Finished all TOF work for today.  All channels of the front-end 
electronics are now working.</pre>
<!-- Author: M Jones, G Gomez -->


<!-- Date: Mon Sep 10 16:49:39 2001 -->
<pre>Run 126185 taken with standard physics table and  
central calorimeter + muons crates.  Trigger passing  
is the zero bias crossing trigger. 
 
To first order, no problems with turning on the Level 2  
timeouts at the TS. 
 
</pre>
<!-- Author: W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=126185' target=_top>126185</a>) -->
<!-- Comment: Mon Sep 10 16;56;10 comment by...W.Badgett -->
<pre>Part of that was a lie:   no cal crates at all;
try again.
</pre>


<!-- Date: Mon Sep 10 16:59:42 2001 -->
<pre>   We have returned HEVB hardware to the default configuration: 
Scanner CPUs b0eb17 and b0eb20 went to their original crates. 
The network settings, etc were restored on those CPUs. 
  The swapping was done last Friday within the plan of  
investigating SVX-reformatter errors. The errors stayed with 
the VRB crate, not with SCPU card. 
</pre>
<!-- Author: Ilya/Boris -->


<!-- Date: Mon Sep 10 17:02:39 2001 -->
BMU HV ramped up by itself and a bit later BMU alarm.  
<!-- Author: MooHyun -->
<!-- Comment: Mon Sep 10 17;07;49 comment by...MooHyun -->
someone worked on it.


<!-- Date: Mon Sep 10 17:10:17 2001 -->
WHA HAD ASD noise tests were performed on crate wcal07 (wedges <br> 12-17 SE) using ferrite clamps and a transformer board. We <br>found that the transformer reduces the noise by factor of 100 
<br> and we left it in place for some further tests.<br> 
 Notice that by inserting the transformer board the back plane of <br> the crate is not well close for cooling purposes. In any <br> it is a temporary test.
<!-- Author: Min Jeong Kim and Fotis -->
<!-- Comment: Mon Sep 10 19;52;55 comment by...fotis -->
Correction: the crate we worked on is wcal06
<!-- Date: Mon Sep 10 17:10:24 2001 -->
Ran with most of ccal & the phototube spark trigger. 
No errors.
<!-- Author: W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=126191' target=_top>126191</a>) -->


<!-- Date: Mon Sep 10 17:15:50 2001 -->
<pre>work done on cem xef: 
cable swap 1e&lt;-&gt;2e and 7w&lt;-&gt;8w detected and fixed. 
19w (no flash) had the cable unplugged. 
 
Requested a xef run to test changes. 
</pre>
<!-- Author: Andrew K. & Steve H. -->



<!-- Date: Mon Sep 10 17:17:35 2001 -->
<pre>Jeff Schmidt has replaced the Silicon Power Supply Control GUI  
PC (b0dap40) with a new PC (b0dap42). Note that the new machine 
is in a "more secure" online network subnet than the old machine. 
 
To the best of Jeff's knowledge, the Silicon crew can try  
restarting the GUI.</pre>
<!-- Author: JJ Schmidt -->


<!-- Date: Mon Sep 10 17:21:56 2001 -->
giving CLC to Ming
<!-- Author: Carsten -->


<!-- Date: Mon Sep 10 17:24:52 2001 -->
Andrew informed me that XEF calibration is not working because of problem with CSL. paged csl ... 
we should perform one XEF calibration once the csl problem is fixed.
<!-- Author: Carsten -->
<!-- Comment: Mon Sep 10 18;12;12 comment by...Hiro Matsunaga -->
The calibration CSL was not running. Restarted the calibration CSL on b0dap60.
<!-- Date: Mon Sep 10 18:07:32 2001 -->
<pre>A little while ago, Bob Kephart brought Rick Tesarek into the 
Control Room. Rick was bleeding at the right elbow and displayed 
a bruise on his right cheek. He was on a ladder in the Collision 
Hall, but fell when the ladder slipped. 
Kevin Burkett calls the paramedics, who arrive with bandages etc. 
After being patched up, Rick is taken to the hospital (Delnor?) 
by Jeff Spalding. 
</pre>
<!-- Author: Jensen -->
<!-- Comment: Mon Sep 10 20;06;17 comment by...Jensen -->
<pre>Note: Kevin Burkett locked away the ladder</pre>
<!-- Date: Mon Sep 10 18:12:53 2001 -->
<pre>Done/BusyTimeouts are now automatically filled with  
appropriate default values when selecting SoftEvb or  
HardEvb.  User has option to override defaults;  if defaults  
are not chosen, a non-fatal warning is issued. 
</pre>
<!-- Author: W.Badgett -->


<!-- Date: Mon Sep 10 19:24:02 2001 -->
trying to do QIE Calibration, 
WCAL05+07 and sevb04 fail activation. Error display show out of memory errors for wcal05+07. vxlogin shows no suspended jobs. rebooting wcal05+07 and trying calibration again
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=126200' target=_top>126200</a>) -->
<!-- Comment: Mon Sep 10 19;32;46 comment by...Carsten -->
this time calibration worked but sevb04 and errlog never turned green.


<!-- Date: Mon Sep 10 19:40:07 2001 -->
trying to do LED calibration. when activating b0tsi00 went into error state.
<!-- Author: Carsten :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=126201' target=_top>126201</a>) -->
<!-- Comment: Mon Sep 10 19;52;43 comment by...aces -->
vxlogin shows no suspended jobs. rebooting and trying calibration again. b0tsi00 fails again. paging L3



<!-- Comment: Mon Sep 10 20;19;55 comment by...aces -->
paging L1: Bill Badgett suggests to use a different partion, this didn't work. Error log showed error in b0ccal10+12 (RXPT), doing a sysreset on b0ccal10+12+13
<!-- Comment: Mon Sep 10 20;24;22 comment by...aces -->
b0tsi00 failed again ... but b0ccal10 gave still error message ... rebooting b0ccal10
<!-- Comment: Mon Sep 10 20;30;39 comment by...aces -->
<pre>still cannot run calibration. RC Error display shows now:
(RC)   20:28:26 Reset -&gt; IDLE
(RC)   20:28:45 Setup -&gt; READY
2 crate/s: b0ccal10(10), b0ccal13(13),  in error.[RXPT]
(MLE) b0tsi00:Messenger:8:28:53 PM-&gt;TS failed to Recover (State 2)
(RC)   20:28:52 Activate -&gt; ERROR</pre>
<!-- Comment: Tue Sep 11 10;09;31 comment by...Andrew Martin -->
<table border=0><td><tr><td bgcolor=#e0e030>Aces should note that if ANY crate is in error when the TS attempts to start a run, it will fail in exactly this way.  Fixing the other crates in error will fix the problem.</td></tr></td></table>
<!-- Date: Mon Sep 10 20:06:05 2001 -->
<b>Silicon Access Today</b> 
<ul> 
<li>Inserted eight L00 Power Supplies: LB0W1, LB0W2, LB0W3, LB0W4, LB1W0, LB1W1, LB1W4, LB1W5.  The two destined for the SE corner will have to wait until tomorrow AM when the Muon Arches come out. 
<li>Pulled the two SVX power supplies that were in LB0W0 and LB0W5. 
<li>Inserted an ISL Power Supply in IB1W3. 
</ul> 
Decided not to leave the load boxes attached overnight.  We will put them to use first thing tomorrow morning instead.
<!-- Author: Napora and Del Gamba -->
<!-- Comment: Mon Sep 10 20;07;54 comment by...Napora and Del Gamba -->
<p>We also updated the CAEN.map file accordingly.  The ISL/L00 power crates in the SE corner are still off.
<!-- Date: Mon Sep 10 20:06:22 2001 -->
<pre> 
     Today we removed the electronics of the miniskirts that 
     are inside the collision hall. Bench work has to be done  
     in order to fix the noise that those wedges were having. 
     At the beginning of the morning we turned off the HV for 
     the CMX. We unplugged the HV cables for the MS, and we  
     and we insulated them with kapton tape.  
     Tomorrow we continue our work in wedge 0 West side, is 
     still noise. </pre>
<!-- Author: Abraham Gallas, Muge Karagoz -->






<!-- Date: Mon Sep 10 20:50:03 2001 -->
trying to do XEF calibration, similar to LED calibration problem b0cal12 is in error state.
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=126209' target=_top>126209</a>) -->


<!-- Date: Mon Sep 10 20:59:17 2001 -->
LED and XEF calibration failed because of b0ccal10,12,13 problems. Called Robin, she said something might have been left off and we should try again tomorrow.
<!-- Author: aces -->


<!-- Date: Mon Sep 10 21:08:55 2001 -->
trying to start a run using calorimeter ... botsi00 failed again in activate state. Heather did a manual reset of the botsi00 and will start run with her rc.
<!-- Author: aces -->


<!-- Date: Mon Sep 10 21:40:28 2001 -->
<ul> 
We're having problems getting a run started.  When in ACTIVATE, the following error occurs in TSI00: 
 
<li>TM_wrap: call tm_start_flow 2 
Sent ack to Run Control: 2 ERROR ERROR  
TS failed to Recover (State 2) 
 
<li>We've (myself, Bill B, the aces previous to me taking the system) tried several things: 
 
<li>Pressing Reset on TSI00 crate 
<li>vxboot of TSI00 crate 
<li>We then found evb15 had suspended processes.  At the prompting of L3 we manually reset the crate, everything appeared fine, cleaned up EVB. 
<li>Bill reverted back to an older (circa this morning) version of TSI code 
<li>We then tried running with SEVB, to see if the problem was internal to TSI00 or if it was in the trigger manager - NOPE!  TSI00 still gives an error in Activate 
<li>Bill consults with Frank - we're still trying to figure this one out.  meantime, I check SCPU's again - all is good in EVB land 
</ul>
<!-- Author: hray, et al -->
<!-- Comment: Mon Sep 10 21;42;41 comment by...hray -->
as noted above when I took over I started a new run in my own RC, with a different partition number, and a different physics table.  This didn't help; TSI00 still in error.


<!-- Date: Mon Sep 10 21:55:04 2001 -->
<pre>SMXR cards across the calorimeter are causing lots of problems: 
Bunch Counter mismatch /  error line asserted 
 
Have masked the error line on these crates:  (argh!) 
 
  ccal10,12,13 
  wcal05,06 
  pcal08,10 
 
so that the AdMems could run.</pre>
<!-- Author: W.Badgett -->
<!-- Comment: Tue Sep 11 14;03;58 comment by...W.Badgett -->
<pre>Turns out the errors from all but ccal12 were red 
herrings.    Only ccal12 was in error, due to the SMXR cards.</pre>
<!-- Date: Mon Sep 10 22:10:15 2001 -->
So, we removed crates: 
ccal 9,10,11,12,13 
pcal 8,9,10 
wcal 5,6 
After this, we were able to start a run.  However, I was using L2_Torture[3] table which Stephen added some changes to this afternoon (in terms of alpha).  At the start of the run the deadtime was at 99%, all from L2, and we got a DTO.  I ended the run and switched to L2_Torture[1], and we were able to start a run, no problem.  I'll email Stephen about the possible problems with the trigger table; meanwhile aces should not use these crates in the run, and we'll let the smx people know about these errors
<!-- Author: hray, billb  :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=126221' target=_top>126221</a>) -->


<!-- Date: Mon Sep 10 22:48:55 2001 -->
test run with physics trigger worked (but dead time of 99%) ended run and start new run 126224 
with Cosmics_notrack[3,165] (cot off).
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=126224' target=_top>126224</a>) -->
<!-- Comment: Mon Sep 10 22;55;47 comment by...Carsten -->
cosmics_notrack[3,165] is running fine ... small dead time (<1%).

<!-- Comment: Mon Sep 10 23;42;46 comment by...aces -->
run stopped after 12570 events restarted new run 126225 this also stopped after 12570 events !


<!-- Date: Mon Sep 10 23:43:32 2001 -->
<pre>Run summary: 
 
1. In supervised access. Major activities include ISL cooling 
   investigation and COT work (which continues throughout shift) 
2. New versions of runcontrol and TS code 
3. Rick Tesarek fell in Collision Hall and was taken to the  
   hospital for stitches and x-rays 
4. Did calorimeter qie calibration, but LED and Xenon 
   calibrations did not work. Try these again tomorrow. 
5. Had difficulty getting a run with the calorimeter crates 
   started. SMXR cards causing lots of problems according to 
   Bill Badgett. 
6. Finally did get a Cosmics_notrack run started, but not with  
   all crates included.</pre>
<!-- Author: Jensen -->


<!-- Date: Tue Sep 11 00:01:19 2001 -->
<font color=red>Shift Summary: </font><pre>see above</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   126185-126226
Delivered Luminosity   0  
Acquired Luminosity    0  
Efficiency             ---
   
</td></tr></table></pre>
<!-- Author: Jensen -->