<!-- Title: Eve shift. Mon May 28, 2001 -->
<!-- SciCo: Jimmy Proudfoot -->
<!-- DAQAce: Anyes Taffard -->
<!-- MonAce: Vladimir Nagaslav -->
<!-- CO: &nbsp; -->
<!-- OpManager: Doug Benjamin -->
<!-- Notes: -->
<pre>Jane has everything - so we will relax like yesterday. </pre>


<!-- Date: Mon May 28 16:22:18 2001 -->
Turn on the WHA HV.  <br> 
Some work was dine on the fibers of 13-W. <br>
<!-- Author: fotis -->


<!-- Date: Mon May 28 16:47:22 2001 -->
<pre>B0dap58 got frozen after opening a netscape session. 
Tried to ssh to it from another machine but it didn't let us in. 
However we could ping it. 
Also tried Ctrl-Alt-Backspace to logout and Ctrl-Alt-F4 without success.  
Paged Jim Patrick which advice to power cycle the PC.  
Did this but got the following message: 
Press F1 to retry boot, F2 for setup utility. 
We have now switched off the machine.</pre>
<!-- Author: Anyes -->


<!-- Date: Mon May 28 18:04:45 2001 -->
<pre>Simon Washke & Steve Nahn are scheduled for SVX work starting at 4am tomorrow morning. After discussing this with Doug Benjamin we agreed that the keys issued to those two individuals will be left in the cabinet this evening. All other keys in the cabinet will be picked up. One should note that the SVX crew is working throughout the night and those with keys on their person will of course still have them. </pre>
<!-- Author: Jimmy P. -->


<!-- Date: Mon May 28 18:19:36 2001 -->
<table border=0><td><tr><td bgcolor=#e0e030>While noting the situation regarding keys in the cabinet,  we could not find the key assigned to Soushi Tsuno. There is no home number listed for him in the CDF database. He was on shift yesterday evening teamed with Lester Miller who confirmed that he left the collision hall at 11pm. Since Soushi is on shift at 8pm he will either have his key on him or will have a problem !</td></tr></td></table>
<!-- Author: Jimmy Proudfoot -->


<!-- Date: Mon May 28 20:08:53 2001 -->
<pre>Stating cosmic run [3,126] without L2decision00 and SVT crates 
which are still used by Jane.</pre>
<!-- Author: Anyes :: (run <a href='/cgi-bin/runSummaryRun.cgi?116119' target=_top>116119</a>) -->


<!-- Date: Mon May 28 20:19:20 2001 -->
Summary of the work today on the Level 2 Decision crate: we  
tried to make the L1, SVT, and CLIST board work together, and we 
did not succeed.  Each combination of two will work together,  
but the three boards don't work together since the new L1  
firmware which was changed on Friday.  It seems that the SVT  
board becomes confused by the L1 board asserting BOSS signals,  
but it is not clear what is happening.  
<!-- Author: Jane, Heather, David, Matt -->


<!-- Date: Mon May 28 20:28:47 2001 -->
<pre>PHA crate 9 just gave a power supply error. It managed to recover by itself</pre>
<!-- Author: Anyes :: (run <a href='/cgi-bin/runSummaryRun.cgi?116119' target=_top>116119</a>) -->


<!-- Date: Mon May 28 20:45:17 2001 -->
<pre>PHA crate 3 also gave a power suplly error. It also recover by 
itself.</pre>
<!-- Author: Anyes :: (run <a href='/cgi-bin/runSummaryRun.cgi?116119' target=_top>116119</a>) -->


<!-- Date: Mon May 28 20:59:34 2001 -->
<pre>Ended run 116119 with 228k events to take ShowerMax calibration. Jim noticed that the ShowerMax calibration taken during the last 
owl shift shows a tower to be active when it was not at the 
previous calibration. </pre>
<!-- Author: Anyes :: (run <a href='/cgi-bin/runSummaryRun.cgi?116119' target=_top>116119</a>) -->


<!-- Date: Mon May 28 21:02:03 2001 -->
<pre>PEM crate 4 gave a power supply error. It also sorted himself out.</pre>
<!-- Author: Anyes -->


<!-- Date: Mon May 28 21:15:23 2001 -->
<pre>ShowerMax calibration taken run 116131. </pre>
<!-- Author: Anyes :: (run <a href='/cgi-bin/runSummaryRun.cgi?116131' target=_top>116131</a>) -->


<!-- Date: Mon May 28 21:25:48 2001 -->
<pre>We just got back L2 and SVT crates.</pre>
<!-- Author: Anyes -->


<!-- Date: Mon May 28 22:24:15 2001 -->
<pre>Taking cosmic run[3,126] for Jim with CCAL, plug, L1 and L2 
autoaccept and L3 farms 1, 5 9, 13. 
Taking 3 runs of 20 k each: 116135, 116136, 116137</pre>
<!-- Author: Anyes :: (run <a href='/cgi-bin/runSummaryRun.cgi?116135' target=_top>116135</a>) -->


<!-- Date: Mon May 28 22:27:29 2001 -->
<pre>L3 farm 11 is giving us some troubles. Since bodap58 is required to run L3 ACE control panel, we paged a L3 expert to log us in. 
Cleaned evb and L3 farms.</pre>
<!-- Author: Anyes -->


<!-- Date: Mon May 28 22:32:11 2001 -->
<pre>Took another 20k event for Jim, run 116138.</pre>
<!-- Author: Anyes :: (run <a href='/cgi-bin/runSummaryRun.cgi?116138' target=_top>116138</a>) -->


<!-- Date: Mon May 28 22:55:14 2001 -->
<pre>Trying to take a cosmic run [3,126] with May28 configuration. 
Run 116140.  
We had to remove SVT Tracking 01 which gave the following error: 
Partition:1 Run number: 116139 (0x1c5ab) 
(MLE) b0puls00:Messenger:10:35:45 PM->Wrong card type in slot 10 
(MLE) b0svt01:Messenger:10:36:17 PM->Setup failed with error code 1 
(MLE) b0svt01:Messenger:10:36:17 PM->Statechange failed 
(RC)   22:36:15 Config -> ERROR 
(RC)   22:38:29 Reset -> START 
38'36" b0dau32.fnal.gov:csl_mon_send:10:38:36 PM->Data file for partition 1, run 
 116139 was closed with zero events. 
 
 
L2dec00 times out after 5k. Halt the run and took L2dec00 via 
single crate procedure. 
</pre>
<!-- Author: Anyes :: (run <a href='/cgi-bin/runSummaryRun.cgi?116140' target=_top>116140</a>) -->


<!-- Date: Mon May 28 22:56:33 2001 -->
<pre>Run 116140, Timeout error from CMX00. Halt run and took CMX00 
via single crate procedure. 
Run recoved sucessfully.</pre>
<!-- Author: Anyes :: (run <a href='/cgi-bin/runSummaryRun.cgi?116140' target=_top>116140</a>) -->


<!-- Date: Mon May 28 23:11:47 2001 -->
<pre>SVX trip. Apparently temp on PCW but when we looked immediately after the trip the temperatures all looked normal. Cryo didn't see a problem.l While we were investigating it tripped again and one of the SVX people inadvertently hit the crash button instead of the the alarm silence switch (fortunately not the one that drops the AC supplies).</pre>
<!-- Author: Jimmy P. -->


<!-- Date: Mon May 28 23:19:08 2001 -->
<pre>PHA crate 4 and later crate 10 had a power alarm. They sorted 
themselft out.</pre>
<!-- Author: Anyes -->


<!-- Date: Mon May 28 23:24:16 2001 -->
<pre>Jim wanted a run with setting [3,129] but I cannot find any file 
either under ACE or cosmics saved with that setting. 
Therefore I started a run with setting [3,126] with only CCAL, 
L1_CAL, L2_CAL, L2_autoaccept, PCAL and WCAL. Since [3,126] 
write less events to file than [3,129] we need to take minimum 
150K events.</pre>
<!-- Author: Anyes :: (run <a href='/cgi-bin/runSummaryRun.cgi?116141' target=_top>116141</a>) -->


<!-- Date: Mon May 28 23:27:34 2001 -->
<pre>Get following error message from L3 crate: 
Partition:1 Run number: 116141 (0x1c5ad) 
(RC)   23:18:10 Config -> READY 
(RC)   23:18:39 Activate -> ACTIVE 
(MLE) b0l3gate2.fnal.gov:main:11:20:08 PM->Error on L3 node b0l3c14 (partition 1 
) Mon May 28 23:20:07 2001 l3_node  
  in chain_loop (l3_chain.c:599) 
  @L3_INPUT_FAILURE:  chain 0 code Success (2334 good, 1 bad)</pre>
<!-- Author: Anyes :: (run <a href='/cgi-bin/runSummaryRun.cgi?116141' target=_top>116141</a>) -->


<!-- Date: Mon May 28 23:28:49 2001 -->
Another SVX cooling trip. Dave Stuart is of the opinion that it is real and coming from a wedge that has only just now been powered up. 
<!-- Author: Jimmy P. -->


<!-- Date: Mon May 28 23:40:05 2001 -->
<font color=red>Shift Summary: </font><pre>While things are relatively calm I can enter a summary for the shift: 
 
1) Level 2 work by Jane for more than half of the evening. They have not resolved the problems in the L2 decision crate 
 
2) b0dap58 crashed, couldn't be revived and has been switched off 
 
3) PSM on iFix is still flagging rack power supply problems - we think they are fake and it would be nice if an expert could look at this in the morning 
 
4) The PHA CAEN errors - the birds - have returned and clear themselves within 1 or 2 minutes 
 
5) The shower maximum readout in wedge W8 has recovered spontaneously from problems seen two nights ago. We tried to repeat the special cosmic runs (aka "Jimmy Runs") but couldn't find tagset 129 so the disk files were too small 
 
6) There were problems with the Level 3 farm which needed cleanup of the farm and even builder. Sinfe b0dap58 was inoperative we needed an expert to help us with this task 
 
7) we had problems re-including thbe level2 decision crate in the partition once the L2 folks had left. Eventually we dropped SVT01 and the run would go 
 
8) We had some excitement (!) with silicon cooling trips. During the second trip, the SVX 5v Enable crash button was hit rather than the silence switch. We recovered from this after contacting the experts and now Dave Stuart and the rest of the Si crew are studying the trip which is thought to be real and coming from a wedge that they have only started powering recently. 

9) I collected all the keys in the cabinet</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   
Delivered Luminosity     pb-1
Acquired Luminosity      pb-1
Efficiency             1000.00
   
</td></tr></table></pre>
<!-- Author: Jimmy P. -->


<!-- Date: Mon May 28 23:48:01 2001 -->
<pre>Starting cosmic run [3,129] with ACE_MAY28. I yet again found 
that the cards for SVT-TRACKIN00 and 01 where in the 
"to be chosen area" and not in the "chosen" area. I rectified  
this and resaved the file.</pre>
<!-- Author: Anyes -->


<!-- Date: Mon May 28 23:59:08 2001 -->
<pre>Same problem as previously with SVT_TRACKING01.  
(MLE) b0puls00:Messenger:11:48:19 PM-&gt;Wrong card type in slot 10 
(MLE) b0svt01:Messenger:11:48:51 PM-&gt;Setup failed with error code 1 
(MLE) b0svt01:Messenger:11:48:51 PM-&gt;Statechange failed 
(RC)   23:48:49 Config -&gt; ERROR 
(RC)   23:50:24 Reset -&gt; START 
 
This time I am rebooting the crate.</pre>
<!-- Author: Anyes -->
<!-- Comment: Mon May 28 23;59;46 comment by...Anyes -->
<pre>Run 116142</pre>


<!-- Date: Tue May 29 00:05:24 2001 -->
<pre>Nature of the SVX cooling trips: 
When PS on B2W8 is on, the temperature on TE_PCW1A_2.F_C 
starts rapidly growing and soon hits the trip limit. 
We had it 3 times. I printed out the plot from Ifix and 
Steve Gordon promised put the picture here a bit later. 
 
   </pre><font color=red><cite>(entry outside this shift's time range )</cite></font>
<!-- Author: Vladimir -->


<!-- Date: Tue May 29 00:42:15 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1010&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1011  width='300' align='top'></td><td>See the note above.</a></td></tr></table><font color=red><cite>(entry outside this shift's time range )</cite></font>
<!-- Author: Vladimir  -->