<!-- Title: Eve shift. Thu Aug 23, 2001 -->
<!-- SciCo: Paul Shepard -->
<!-- DAQAce: Boris Iyutin -->
<!-- MonAce: Vladimir Rekovic -->
<!-- CO: Albert Ruiz -->
<!-- OpManager: Kevin Burkett -->
<!-- Notes: -->
<pre>Shot setup underway at 15:45</pre>


<!-- Date: Thu Aug 23 16:37:55 2001 -->
We ran for about 15 minutes with XTRP sending internally 
generated data to SVT, with calib_continuous trigger.  Saw 
no synch errors.  What is different from last time we did 
this (and saw errors) is that some XTRP data boards have 
been swapped and we were using a more random trigger last 
time. 
<p> 
Nathan expects that synch errors from XTRP to 2nd floor will 
now occur at a much lower rate, after moving data boards.  So 
SVT is now programmed to catch synch errors with CDF_ERROR. 
If this happens often enough to be a signficant source of 
downtime, the on-call SVT expert (currently Marco) can turn 
off CDF_ERROR assertion.  It is interesting initially to see 
how long we can go between errors. 
<p>
<!-- Author: Ashmanskas, Eddy, Pitts -->


<!-- Date: Thu Aug 23 16:43:11 2001 -->
<pre>Try to put everything together. 
 
Had to reboot fib07 and svt03.  
Restarted RC to pick up XTRP  changes from Data Base.   
 
Running with 1.7Hz from Level1. </pre>
<!-- Author: Boris. -->
<!-- Comment: Thu Aug 23 17;25;12 comment by...SCN -->
Why did you reboot b0fib07?
<!-- Comment: Thu Aug 23 17;32;25 comment by...Boris.  -->
<pre>Suspended processes. Both of them. </pre>
<!-- Comment: Fri Aug 24 11;19;13 comment by...W.Badgett -->
<pre>Why did you have to restart Run Control?  What was changed?</pre>
<!-- Date: Thu Aug 23 16:50:53 2001 -->
Waiting for the beam.  
 
Playing basketball. 
<!-- Author: Shift crew. -->


<!-- Date: Thu Aug 23 17:04:21 2001 -->
<pre>Ended run to do special scaler test run 
</pre>
<!-- Author: Boris -->


<!-- Date: Thu Aug 23 17:09:19 2001 -->
<pre>Trying to start new run. b0clc01 did not not respond to 
coldStart message and front-end timed out waiting for r/o 
list.  Bill B looking. 
 
</pre>
<!-- Author: Boris :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=124574' target=_top>124574</a>) -->
<!-- Comment: Thu Aug 23 17;24;47 comment by...Greg -->
<pre>For this run we were trying to use L2_TORTURE_v2.
The run failed beacuase the rc could not fetch the 
FRED prescales from the database.  The BC prescale
was recently changed for this table ...

</pre>



<!-- Comment: Fri Aug 24 11;20;20 comment by...W.Badgett -->
<pre>The clc01 error was a read herring.    The errant trigger table 
caused the Run Control messenger task to crash, so it 
stopped sending readout lists to subsequent crates.
</pre>
<!-- Date: Thu Aug 23 17:30:12 2001 -->
<pre>Marking L2_TORTURE_v1 as DAQ valid.  Will change BC 
prescale by hand. 
 
</pre>
<!-- Author: Bill, Greg -->
<!-- Comment: Thu Aug 23 17;38;33 comment by...Greg -->
<pre>NOt changing BC prescale by hand.  The prescale is
correct but the trigger is on wire 21 and not 23.
</pre>


<!-- Date: Thu Aug 23 17:44:59 2001 -->
<pre>Run number 124576.  Running with L2_TORTURE_v2. 
</pre>
<!-- Author: Greg :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=124576' target=_top>124576</a>) -->
<!-- Comment: Thu Aug 23 17;46;25 comment by...Greg -->
<pre>End after 47000 events.
</pre>


<!-- Comment: Thu Aug 23 17;47;47 comment by...W.Badgett -->
<pre>No, Greg, it was L2_TORTURE_v1</pre>
<!-- Date: Thu Aug 23 17:47:04 2001 -->
<pre>Marked trigger table L2_TORTURE_v1 back online. 
 
L2_TORTURE_v2 does not work -- crashes Run Control.</pre>
<!-- Author: W.Badgett -->



<!-- Date: Thu Aug 23 17:49:21 2001 -->
<pre>Testing new trigger table Physics_I_0_01[7,175]. 
 
</pre>
<!-- Author: Boris :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=124576' target=_top>124576</a>) -->


<!-- Date: Thu Aug 23 18:53:31 2001 -->
<pre>c13 died so did l3_node on 5 nodes in the subfarm. 
099, 100, 102, 103, 104 - both chains died.  
105 ended the run.   
 
Note: Data flow was realy slow in this run (~1.5Hz from Level1)</pre>
<!-- Author: Boris.  :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=124577' target=_top>124577</a>) -->


<!-- Date: Thu Aug 23 19:07:34 2001 -->
<pre>MLE) b0tsi02:Messenger:7:05:32 PM-&gt;BUSY timeout 
(MLE) b0l3gate1.fnal.gov:main:7:05:32 PM-&gt;Host b0eb17.fnal.gov, task tRec_0 
SCPU-P0-E-VrbReadFailed: Error reading VRB in slot 20 for event 6983. 
The VRB had no event. 
 
Try coldstart </pre>
<!-- Author: Boris -->


<!-- Date: Thu Aug 23 19:11:06 2001 -->
(RC)   19:9:26 Config -> ERROR 
(MLE) b0fib02:Messenger:7:09:28 PM->Error Initializing HDI Slot 9 Chan 8: SVX B0W7 
(MLE) b0fib02:Messenger:7:09:28 PM->Statechange failed 
 
End Run. Use it to Clean up Level3.   
<!-- Author: Boris -->


<!-- Date: Thu Aug 23 20:06:38 2001 -->
<pre>Reset Luminocity in RC. </pre>
<!-- Author: Boris -->


<!-- Date: Thu Aug 23 20:14:53 2001 -->
<pre>cot16 failed Activate.  Can not login to it with vxlogin.  
Reset via minicom. </pre>
<!-- Author: Boris.  -->


<!-- Date: Thu Aug 23 20:52:58 2001 -->
<pre>Just as we were getting ready to take data we got 
Alarm from PSM -&gt; End Wall -&gt;COESB_1. 
Using video camera, saw that the power suply tripped. 
We excluded the COESB_1  from PSM, and will run w/0 it. 
 
</pre>
<!-- Author: Vladimir  -->


<!-- Date: Thu Aug 23 21:05:13 2001 -->
<pre>BSC alarm while we are having flying wire 
 
</pre>
<!-- Author: Vladimir  -->


<!-- Date: Thu Aug 23 21:10:41 2001 -->
<pre>Stefano Zucchelli fixed the problem with PEM, PHA, PSM. 
Caen crate 10 was completely off.  He turned it back on, and  
everything was OK afterwards. 
This event (COT crate tripping and plug crated tripping simultaneously) was observed back in November during comissioning run.</pre>
<!-- Author: Vladimir -->


<!-- Date: Thu Aug 23 21:12:35 2001 -->
This run has several problems.  One quadrant of COT missing do to 
tripped supply in collision hall.  Also some voltages on BSC are 
low.   Expert is coming to reset them.
<!-- Author: Shepard :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=124581' target=_top>124581</a>) -->


<!-- Date: Thu Aug 23 21:51:37 2001 -->
<pre>DTO from multiple COT crates. ColdStart.</pre>
<!-- Author: Boris :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=124585' target=_top>124585</a>) -->
<!-- Comment: Thu Aug 23 23;05;38 comment by...patrick -->
<pre>This was really the error line from b0svt07:

48'42" 1 crate/s: b0svt07(122),  in error.[RXPT]

Hard to find in all the other messages I admit.
It is a mystery why all the TDC errors happen when
the error line gets set.</pre>
<!-- Date: Thu Aug 23 21:58:58 2001 -->
<pre>One BSC HV channel tripped due to flying wire. Tripped channel is 
BSC-1 (counter 3) on the east side. So, the pbar losses (LOSTPB 
and B0ALOS) became lower during the period of trip. Turned on  
the voltage at 9:40pm.</pre>
<!-- Author: K. Terashi -->


<!-- Date: Thu Aug 23 22:23:44 2001 -->
<pre>RC)   22:21:59 Config -&gt; ERROR 
(MLE) b0fib02:Messenger:10:22:00 PM-&gt;Error Initializing HDI Slot 9 Chan 7: SVX B0W7 
(MLE) b0fib02:Messenger:10:22:00 PM-&gt;Statechange failed 
(RC)   22:23:14 Abort -&gt; IDLE</pre>
<!-- Author: Boris -->


<!-- Date: Thu Aug 23 22:25:55 2001 -->
AVDD3 tripped on SB2W7.  Reset and coldstart.  At same time we 
have put L2 back, and rebooted b0cot01
<!-- Author: Shepard -->
<!-- Comment: Thu Aug 23 22;29;38 comment by...Boris.   -->
<pre>We reset Alpha board before putting level2 back. </pre>
<!-- Date: Thu Aug 23 22:26:27 2001 -->
<pre> 
(RC)   22:25:24 Config -&gt; ERROR 
(MLE) b0fib03:Messenger:10:25:23 PM-&gt;Error Initializing HDI Slot 10 Chan 4: ISL B0W4 
(MLE) b0fib03:Messenger:10:25:23 PM-&gt;Statechange failed</pre>
<!-- Author: Boris -->


<!-- Date: Thu Aug 23 22:28:11 2001 -->
AVDD3 B2W7 tripped again.   Paged silicon.  Expert says it is 
really a DVDD current trip.  Anyway we have reset and powered 
back on.  Doing a cold start.  Different fib fails.  See previous 
entry in log book.  Cold start again.
<!-- Author: Shepard -->



<!-- Date: Thu Aug 23 22:40:25 2001 -->
<pre>SVT07 error -&gt; HRR 
</pre>
<!-- Author: Boris :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=124588' target=_top>124588</a>) -->



<!-- Date: Thu Aug 23 23:07:56 2001 -->
<pre>We've got a lot of errors from EVB on Partition transition.  
I was expecting that it will not let us to run, but we are finally running. 
 
(MLE) b0l3gate1.fnal.gov:main:10:47:07 PM-&gt;Host b0eb10.fnal.gov, task tsmReg 
SM-P0-E-ScpuConnectFailure: SCPU b0eb23 could not connect to Builder ID 31 on b0l3c10a. 
(MLE) b0l3gate1.fnal.gov:main:10:47:07 PM-&gt;Host b0eb10.fnal.gov, task tsmReg 
SM-P0-E-ScpuConnectFailure: SCPU b0eb23 could not connect to Builder ID 30 on b0l3c10a. 
(MLE) b0l3gate1.fnal.gov:main:10:47:07 PM-&gt;Host b0eb10.fnal.gov, task tsmReg 
SM-P0-E-ScpuConnectFailure: SCPU b0eb19 could not connect to Builder ID 31 on b0l3c10a. 
(MLE) b0l3gate1.fnal.gov:main:10:47:07 PM-&gt;Host b0eb10.fnal.gov, task tsmReg 
SM-P0-E-ScpuConnectFailure: SCPU b0eb19 could not connect to Builder ID 30 on b0l3c10a. 
(RC)   22:48:0 Reset -&gt; IDLE</pre>
<!-- Author: Boris.  :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=124589' target=_top>124589</a>) -->


<!-- Date: Thu Aug 23 23:09:56 2001 -->
<pre>error from SVT07  
HRR 
Multiple DTO from COT and CMX 
Coldstart.  
Running. </pre>
<!-- Author: Boris.  :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=124590' target=_top>124590</a>) -->
<!-- Comment: Thu Aug 23 23;10;38 comment by...Boris.  -->
<pre>One more error of the same kind. 
This time HRR helps. </pre>


<!-- Date: Thu Aug 23 23:15:57 2001 -->
<pre> 
1 crate/s: b0svt07(122),  in error.[RXPT] 
 
Error condition on XPT from crates:  
SVT-FANOUT_07 
</pre>
<!-- Author: Boris.  :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=112050' target=_top>112050</a>) -->


<!-- Date: Thu Aug 23 23:25:04 2001 -->
Trip due to SB0W1 DVDD0.  Stop run and coldstart.  Also problem 
with SVT (see other entry above).
<!-- Author: Shepard :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=124590' target=_top>124590</a>) -->


<!-- Date: Thu Aug 23 23:27:03 2001 -->
Tired of doing HRR every 1-2 minutes.  
Call SVT expert.  
 
Expert called back and told us that he will change  
some config files from home and call us back. 
<!-- Author: Boris.  -->


<!-- Date: Thu Aug 23 23:58:32 2001 -->
<font color=red>Shift Summary: </font><pre>16:00  Shot setup has just started.   We are trying to make sure DAQ will work 
correctly. 
20:00  Shot in and the wheels appear to be coming off the detector. 
(1)  Lose b0cot16 due to power supply trip in collision hall.  Need access to 
reset.  Will run without this cot crate and power supply. 
(2) PEM, PHA, PSM alarm due CAEN crate 10 trip.  Expert called and resets 
supply. 
(3)  BSC alarms.  One voltage is low and will have to be manually reset by 
expert. 
(4)  Numerious problems with DAQ 
 
23:00  Taken very little data.  We are running again and hopefully we can 
continue to the end of the shift. 
23:30  No luck--problems with SVT and another DVDD0 trip this time on  
SB0W1 layer 0.  Cold start.  Hope the midnight shift does better than us.</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   124572-124592
Delivered Luminosity   85nb  
Acquired Luminosity    9nb  
Efficiency             10%
   
</td></tr></table></pre>
<!-- Author: Shepard -->


<!-- Date: Fri Aug 24 00:02:18 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1991&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1991  width='300' align='top'></td><td>During Shot Set Up</a></td></tr></table>
<!-- Author: Vladimir -->


<!-- Date: Fri Aug 24 00:03:04 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1992&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1992  width='300' align='top'></td><td>Luminosities</a></td></tr></table>
<!-- Author: Vladimir  -->


<!-- Date: Fri Aug 24 00:04:08 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1993&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1993  width='300' align='top'></td><td>Radiation to SVX</a></td></tr></table>
<!-- Author: Vladimir -->


<!-- Date: Fri Aug 24 00:37:29 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1994&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1994  width='300' align='top'></td><td>losses for shift</a></td></tr></table><font color=red><cite>(entry outside this shift's time range )</cite></font>
<!-- Author: mon ace -->