<!-- Title: Owl shift. Mon Aug 13, 2001 -->
<!-- SciCo: M. Chertok -->
<!-- DAQAce: Goldschmidt/Ray -->
<!-- MonAce: Fernandez/Sedov -->
<!-- CO: Flanagan -->
<!-- OpManager: Jay Dittman -->
<!-- Notes: -->
<pre>Inherited store.  Will try to run all night, but  
were told that if the solenoid pressure rises to 7 mbar 
we will have to end run so they can pump down.</pre>


<!-- Date: Mon Aug 13 00:34:07 2001 -->
<pre>Had Heartbeat alarm at 12:08 (probably CLC || BSC || RPS) 
COT SL8 S9a HV tripped. Turned it on (again). 
 
</pre>
<!-- Author: Alexei and JP -->


<!-- Date: Mon Aug 13 01:26:17 2001 -->
End run 123618 ended with ~500K due to OOM errors.  Peaceful run, a few BTO's reported by SVX02...
<!-- Author: guv guv :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123618' target=_top>123618</a>) -->


<!-- Date: Mon Aug 13 01:39:04 2001 -->
Started new run. Total time to end run control and begin new run: 14 minutes. 
New roon looks good so far.
<!-- Author: nate :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123619' target=_top>123619</a>) -->


<!-- Date: Mon Aug 13 01:45:24 2001 -->
L3 node b0l3021 turned red with no accompanying error message from the node. Reseting the node had no effect.  
<p> 
Did HRR. errorlog didn't recover. Flying wires began. Aborting run.
<!-- Author: Nate :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123619' target=_top>123619</a>) -->


<!-- Date: Mon Aug 13 02:04:44 2001 -->
Scanner manager error, ending run. doing EVB cleanup.
<!-- Author: nate :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123621' target=_top>123621</a>) -->


<!-- Date: Mon Aug 13 02:15:42 2001 -->
Started new run. Hopefully things will go smoothly till flying wires...
<!-- Author: nate :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123662' target=_top>123622</a>) -->


<!-- Date: Mon Aug 13 02:28:55 2001 -->
<pre>COT coooling alarm (Pc storage diff. pressure below limits : 0.5  
PSID) 
cryo informed about it 
figures back in normal shape (within allowed limits)</pre>
<!-- Author: Alexei and JP :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123622' target=_top>123622</a>) -->


<!-- Date: Mon Aug 13 02:30:49 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1876&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1876  width='300' align='top'></td><td>new to me error - no TO's from RC - just this error in Error Display </a></td></tr></table>
<!-- Author: guv guv guv  -->
<!-- Comment: Mon Aug 13 02;31;10 comment by...g-money -->
this was from run 123622...


<!-- Comment: Mon Aug 13 10;26;45 comment by...Arnd -->
For some systems that give bunch counter errors frequently there
is no DONE timeout (masked in front-end code).

<!-- Date: Mon Aug 13 04:03:42 2001 -->
L3 monitoring died. Ending run, cleaning up L3 farm. 
<!-- Author: N-diddy :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123622' target=_top>123622</a>) -->


<!-- Date: Mon Aug 13 04:05:15 2001 -->
3 ISL trips in row.
<!-- Author: Alex & JP -->
<!-- Comment: Mon Aug 13 04;19;16 comment by...Alexei and JP -->
<pre>It was connected with an spontaneous turn on/off of an
ISL layer (detector = 2, ps_n = 27, layer_n = 3)</pre>
<!-- Date: Mon Aug 13 04:08:33 2001 -->
Run control was growing out of hand, so we quit and restarted rc before starting a new run.
<!-- Author: n -->



<!-- Date: Mon Aug 13 04:22:21 2001 -->
Started a new run. All seems well.
<!-- Author: N :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123623' target=_top>123623</a>) -->


<!-- Date: Mon Aug 13 04:47:56 2001 -->
<pre>SL8 Sb11 tripped 
Restart ... ing ... ed 
(saw a spike in loss by the time SL8 Sb11 tripped; 
do not know if connected though)</pre>
<!-- Author: Alexei and JP -->


<!-- Date: Mon Aug 13 06:44:50 2001 -->
<pre>TOF alarm. Inmediately recovered.</pre>
<!-- Author: Alexei and JP -->


<!-- Date: Mon Aug 13 06:58:33 2001 -->
<table border=0><td><tr><td bgcolor=#e0e030>Look for interesting two-track event somewhere in the neighborhood of event #569,000!</td></tr></td></table>
<!-- Author: Nate :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123623' target=_top>123623</a>) -->
<!-- Comment: Mon Aug 13 07;30;52 comment by...Nate -->
Also, look for single track event w/ Et ~ 30 GeV (later in the run).
<!-- Date: Mon Aug 13 07:19:53 2001 -->
Ended run; run control out of memory. Started new run with new instance of run control. Process took 10 minutes. 
<!-- Author: Nate :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123624' target=_top>123624</a>) -->


<!-- Date: Mon Aug 13 07:22:56 2001 -->
<pre>A couple of the same spontaneous turned on/off of the  
same layer (detector=2, ps=27, l=3). Back in normal state 
after a few seconds. 
</pre>
<!-- Author: Alexei and JP -->


<!-- Date: Mon Aug 13 07:24:55 2001 -->
ISL problems; all events in run 123624 were rejected by the reformatter. All subfarms under converter node 13 are orange. Starting new run.
<!-- Author: N :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123626' target=_top>123626</a>) -->



<!-- Date: Mon Aug 13 07:32:51 2001 -->
All subfarms under converter node 10 just turned orange. (In addition to those under convertet node 10.) Presently, run is paused due to ISL problems.
<!-- Author: N :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=123626' target=_top>123626</a>) -->


<!-- Date: Mon Aug 13 07:35:28 2001 -->
L3 is hosed. Ending run and reseting L3.
<!-- Author: N -->


<!-- Date: Mon Aug 13 07:35:57 2001 -->
<pre>ISL alarm again. Doug paged . He is awared of it.</pre>
<!-- Author: Alexei and JP -->


<!-- Date: Mon Aug 13 07:38:41 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1877&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1877  width='300' align='top'></td><td>steady losses almost all the time</a></td></tr></table>
<!-- Author: Alexei and JP -->


<!-- Date: Mon Aug 13 07:44:16 2001 -->
L3 wouldn't pass parition transition. Cleaning up L3.
<!-- Author: N -->


<!-- Date: Mon Aug 13 07:54:33 2001 -->
L3 still won't partition. Cleaning up EVB AND L3 now...
<!-- Author: N -->


<!-- Date: Mon Aug 13 07:57:34 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1878&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1878  width='300' align='top'></td><td>lumi plot</a></td></tr></table>
<!-- Author: Alexei and JP -->


<!-- Date: Mon Aug 13 08:02:50 2001 -->
<pre>ISL alarm again. In hands on Silicon experts (Jean, 
Andrew, ...)</pre>
<!-- Author: Alexei and JP -->


<!-- Date: Mon Aug 13 08:03:58 2001 -->
<font color=red>Shift Summary: </font><pre>Good smooth data taking, but store was low-luminosity. 
 
various, strange ISL trips (with automatic recover) and 
alarms -- things powered up that shouldn't be.  Experts 
investigating. 
 
some OOM, scanner mgr. errors.  L3 monitoring deaths.</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   123618 - 123626
Delivered Luminosity   39.7  
Acquired Luminosity    25.6  
Efficiency             0.64
   
</td></tr></table></pre>
<!-- Author: Chertok -->