<!-- Title: Owl shift. Tue Jan 23, 2007 -->
<!-- SciCo: Carmine Pagliarone -->
<!-- DAQAce: Naoki Kimura -->
<!-- MonAce: &nbsp; -->
<!-- CO: Peter Bussey -->
<!-- OpManager: Tom Wright -->
<!-- Notes: -->
<pre>
   From previous shift (EVE):
   ==========================
     There were numerous problems:
       - B0spool was rebooted due to sluggishness;
       - SOLENOID2 seems to have a real hardware problem and 
         occasionally crashes.
 
   OWL Shift:
   ==========
     Shift started waiting for Shot Setup;
       - Pbar stack is 54.5 E10; 
       - Recycler stash is 235.8 E10;
     MCR saied Tevatron is ready to go;
     We are running Cosmics.

</pre>
<!-- Author: Carmine Pagliarone -->


<!-- Date: Tue Jan 23 00:58:46.694 2007 -->
Hert beat missing in ICI : restart icicle problam.
<!-- Author: Naoki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232696' target=_top>232696</a>) -->


<!-- Date: Tue Jan 23 01:19:09.170 2007 -->
<pre>
   00:29 Tevatron started dry squeeze; 
   00:43 Beginning shots to Recycler; 
   Injecting Protons in 10 minutes from now.  
</pre>
<!-- Author: Carmine Pagliarone -->


<!-- Date: Tue Jan 23 01:32:15.349 2007 -->
<pre>
   Beginning the Shot Setup.
</pre>
<!-- Author: Carmine Pagliarone -->


<!-- Date: Tue Jan 23 01:35:59.085 2007 -->
<P> 
Per Operation's request, the RSF_STATUS default value  
is now <I>good</I>.    Old runs have been retroactively set.  
<P>  
<!-- Author: badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232696' target=_top>232696</a>) -->


<!-- Date: Tue Jan 23 02:01:00.030 2007 -->
L3 Trigger rate has dropped to 0Hz. ScalerMon all green.  : It is fixed by HRR. 
<!-- Author: Naoki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232696' target=_top>232696</a>) -->


<!-- Date: Tue Jan 23 02:24:35.104 2007 -->
<br>ICICLE PC(2RR06B) becames a standby or sleep mode(black screen) and ProcMon ICICLE error came up.<br> 
I checked the configuration but "Screen Saver" and "Pwoer Schemes" wrer off state.<br>
<!-- Author: Naoki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232696' target=_top>232696</a>) -->

<!-- Date: Tue Jan 23 02:42:48.313 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232696>232696</A>
 Terminated at 2007.01.23 02:42:17
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 02:42:49.204 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232696>232696</A>
TERMINATE: To change to Short SETUP
<!-- Author: Greg, Barbara, Rob -->



<!-- Date: Tue Jan 23 02:40:34.682 2007 -->
<pre>
   Final Proton bunches have been fully loaded ( 11210 E09 protons loaded).
   The OPS Manager have been called. 
   All Comsumer Monitors and Displays have been stopped and 
   set to PHYSICS MODE.
</pre>
<!-- Author: Carmine Pagliarone -->


<!-- Date: Tue Jan 23 02:42:05.205 2007 -->
<pre>
   Loading Pbars.
</pre>
<!-- Author: Carmine Pagliarone -->


<!-- Date: Tue Jan 23 03:03:48.782 2007 -->
Restart the monitors and displays.  Apparently all 10 are running 
correctly.  However there are continuous messages on the consumer operator screen saying "Waiting for all the monitor starts. 8/11 have already started."  We don't understand these messages.
<!-- Author: Peter -->

<!-- Date: Tue Jan 23 03:17:41.010 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232697>232697</A>
TERMINATE: To change AAA_CURRENT
<!-- Author: Naoki -->



<!-- Date: Tue Jan 23 03:16:41.901 2007 -->
<pre>
   AntiProton bunches have been fully loaded (2421 E09 PBars loaded).  
   Silicon Exp have been paged. 
</pre>  
<!-- Author: Carmine Pagliarone -->

<!-- Date: Tue Jan 23 03:17:01.901 2007 -->
<pre>
   Ramping.
</pre>  
<!-- Author: Carmine Pagliarone -->

<!-- Date: Tue Jan 23 03:18:45.585 2007 -->
<pre>
   COT HV have been ramped up from off to standby.
</pre>
<!-- Author: Carmine Pagliarone -->


<!-- Date: Tue Jan 23 03:20:21.091 2007 -->
<pre>
  Squeezing. 
</pre>
<!-- Author: Carmine Pagliarone -->


<!-- Date: Tue Jan 23 03:21:59.371 2007 -->
<pre>
   Initiating collisions.
</pre>
<!-- Author: Carmine Pagliarone -->

<!-- Date: Tue Jan 23 03:22:36.371 2007 -->
<pre>
   Start beam Scraping.
</pre>
<!-- Author: Carmine Pagliarone -->


<!-- Date: Tue Jan 23 03:30:48.207 2007 -->
In AAA_CURRENT "partition"  pcal10 is in Error, shepherd it. 
<!-- Author: Naoki -->


<!-- Date: Tue Jan 23 03:33:57.090 2007 -->
<pre>
   Scraping is finished; 
   Store # 5193 is now colliding.   
   Initial B0 Luminosity is 231.31 E30  
   Proton Current is 8626.6 E09  
   Antiproton Current is 2303.8 E09   
</pre>
<!-- Author: Carmine Pagliarone -->


<!-- Date: Tue Jan 23 03:35:23.982 2007 -->
<pre>
   Called the MCR as the proton loss is too high.
   COT HV have been ramped down.
</pre>
<!-- Author: Carmine Pagliarone -->
<!-- Comment: Wed Jan 24 09;12;54 comment by...convery -->
The high losses were reported to be due to a non-standard orbit smooth which was corrected the following store.
<!-- Date: Tue Jan 23 03:38:28.433 2007 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-1430&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-1430  width='300' align='top'></a></td><td>fast plot</td></tr></table>
<!-- Author: Naoki -->
<!-- Comment: Tue Jan 23 03;42;21 comment by...Naoki -->
Lost P to hish.
<!-- Date: Tue Jan 23 03:41:57.940 2007 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-1431&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-1431  width='300' align='top'></a></td><td>fast</td></tr></table>
<!-- Author: Naoki -->
<!-- Comment: Tue Jan 23 03;43;46 comment by...naoki -->
lost p is down so COT HV on


<!-- Date: Tue Jan 23 03:45:07.773 2007 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-1432&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-1432  width='300' align='top'></a></td><td>Fast time plot</td></tr></table>
<!-- Author: Naokoi -->
<!-- Comment: Tue Jan 23 03;46;13 comment by...naoki -->
misstake plot

<!-- Date: Tue Jan 23 03:47:16.158 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232698>232698</A>
 Activated at 2007.01.23 03:46:29
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 03:47:17.307 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232698>232698</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Naoki -->


<!-- Date: Tue Jan 23 03:48:07.721 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232698>232698</A>
 Terminated at 2007.01.23 03:48:02
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 03:48:43.145 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232698>232698</A>
TERMINATE: restarst
<!-- Author: Naoki -->



<!-- Date: Tue Jan 23 03:48:43.984 2007 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-1433&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-1433  width='300' align='top'></a></td><td>a</td></tr></table>
<!-- Author: Naoki -->
<!-- Comment: Tue Jan 23 03;50;37 comment by...Naoki -->
TevMon looks good fast time plot look good( lost p little high, short setup requirement is <5kHz.) SIlicon HV ON 
<!-- Date: Tue Jan 23 03:48:45.892 2007 -->
<pre> 
   Started to take data  
   Run 232697 
   B0 Luminosity= 210.9 E30 (03:47 a.m.)  
</pre
<!-- Author: Carmine Pagliarone -->


<!-- Date: Tue Jan 23 03:53:47.238 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232699>232699</A>
 Activated at 2007.01.23 03:53:23
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 03:55:14.207 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232699>232699</A>
 Terminated at 2007.01.23 03:55:01
<!-- Author: RunControl -->



<!-- Date: Tue Jan 23 03:55:14.158 2007 -->
Now we can't take data. 
<!-- Author: Naooki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232699' target=_top>232699</a>) -->
<!-- Comment: Tue Jan 23 03;56;35 comment by...Naoki -->
L3 rate to be0Hz!! : HRR is not working.
<!-- Date: Tue Jan 23 03:55:50.873 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232699>232699</A>
TERMINATE: to resatart
<!-- Author: Naoki -->




<!-- Date: Tue Jan 23 03:59:54.844 2007 -->
ICICLE PC freze with blue screan : try to reboot PC
<!-- Author: Naoki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232699' target=_top>232699</a>) -->
<!-- Comment: Tue Jan 23 04;16;11 comment by...Naoki -->
It was success.
<!-- Date: Tue Jan 23 04:02:03.126 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232700>232700</A>
 Activated at 2007.01.23 04:01:56
<!-- Author: RunControl -->



<!-- Date: Tue Jan 23 04:04:05.314 2007 -->
We can't take data yet.<br> 
Now scaler mon running by v5_32ff.<br>
<!-- Author: Naoki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232700' target=_top>232700</a>) -->
<!-- Comment: Tue Jan 23 04;06;10 comment by...Naoki -->
Error message : L2 & L3 trigger late 0Hz. 
<!-- Comment: Tue Jan 23 04;07;17 comment by...Naoki -->
I try to chage scalerMon version 32f
<!-- Comment: Tue Jan 23 06;08;13 comment by...Donatella T. -->
for the records, the version running since 04:25 is the 'test' version, which so far is doing just fine ( in runs without silicon), ie. it is enable-ing the LUMI triggers and changing the DPS prescales as it should. 
<!-- Date: Tue Jan 23 04:05:07.372 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232700>232700</A>
 Terminated at 2007.01.23 04:04:32
<!-- Author: RunControl -->

<!-- Date: Tue Jan 23 04:04:22.388 2007 -->
<pre>
   We got several problems: 
     * We cannot take the data:
     * SOLENOID2 PC crashed:
  
   Paged the Operations Manager and the DAQ expert.
</pre>
<!-- Author: Carmine Pagliarone :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232700' target=_top>232700</a>) -->


<!-- Date: Tue Jan 23 04:05:08.422 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232700>232700</A>
TERMINATE: to restart
<!-- Author: Naoki -->




<!-- Date: Tue Jan 23 04:10:29.878 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232700>232700</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Naoki -->



<!-- Date: Tue Jan 23 04:17:19.707 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232701>232701</A>
 Activated at 2007.01.23 04:17:15
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 04:17:24.958 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232701>232701</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Naoki -->



<!-- Date: Tue Jan 23 04:17:24.207 2007 -->
<pre>
   We got a bunch of SILICON PINKIES:
      * VBIAS SVX B0W8L2
      * VBIAS SVX B2W5L2
      * VBIAS SVX B3W3L4
      * VBIAS SVX B4W5L4
      * VBIAS SVX B5W6L4

   Paged the expert.
</pre>
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-1434&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-1434  width='300' align='top'></a></td><td>B0W8L2</td></tr></table>



<!-- Date: Tue Jan 23 04:17:52.291 2007 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-1435&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-1435  width='300' align='top'></a></td><td>B2W5L2</td></tr></table>


<!-- Date: Tue Jan 23 04:18:17.564 2007 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-1436&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-1436  width='300' align='top'></a></td><td>B3W3L4</td></tr></table>

<!-- Date: Tue Jan 23 04:18:36.939 2007 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-1437&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-1437  width='300' align='top'></a></td><td>B4W5L4</td></tr></table>

<!-- Date: Tue Jan 23 04:19:09.173 2007 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2007&action=view&page=-1438&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2007&action=view&page=-1438  width='300' align='top'></a></td><td>B5W6L4</td></tr></table>
<!-- Author: Carmine Pagliarone -->
<!-- Comment: Tue Jan 23 07;09;52 comment by...Ulrich -->
This RC-discharge behavior is expected for SVX layers 2 and 4 after the Silicon has not been biased for a while. Not a real problem.
<!-- Date: Tue Jan 23 04:37:43.329 2007 -->
COT 2 layer trip : reset trip
<!-- Author: Naoki -->

<!-- Date: Tue Jan 23 04:39:36.606 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232702>232702</A>
 Activated at 2007.01.23 04:39:02
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 04:39:37.052 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232702>232702</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Naoki -->


<!-- Date: Tue Jan 23 04:49:31.605 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232702>232702</A>
 Terminated at 2007.01.23 04:49:01
<!-- Author: RunControl -->



<!-- Date: Tue Jan 23 04:49:31.818 2007 -->
We can't take DATA.<br>  
<!-- Author: Naoki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232702' target=_top>232702</a>) -->

<!-- Date: Tue Jan 23 04:50:06.129 2007 -->
<pre> 
   Paged L3 Expert. 
</pre>
<!-- Author: Carmine Pagliarone -->

<!-- Date: Tue Jan 23 04:51:44.371 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232702>232702</A>
TERMINATE: Now getting BUSY timeouts
<!-- Author: Naoki -->


<!-- Date: Tue Jan 23 04:53:16.352 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232703>232703</A>
 Activated at 2007.01.23 04:52:41
<!-- Author: RunControl -->



<!-- Date: Tue Jan 23 04:54:03.051 2007 -->
<pre>Here's what I observed and did so far: 
- triggers are being held off, no data 
- it appears at the begining of every run there is Busy TO 
  but when the Ace tries to diagnose it, there is no error. 
- HRR does not result in more BTO, but just triggers held off 
- this sounds enough like last Thursday's night problem that 
  I recommend powercycling tsi00 and l2cl00 
- problem persists, but now the error sems to be consistently 
  L2TO (run 232702) 
- recommend talking to L2 pager 
- if still no solution, try L1/Greg Field and page me back</pre>
<!-- Author: Ray Culbertson :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232702' target=_top>232702</a>) -->
<!-- Comment: Tue Jan 23 04;57;51 comment by...Ray Culbertson -->
no backplane errors on tsi00, which was part of Thursday's problem
<!-- Date: Tue Jan 23 04:57:51.571 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232703>232703</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Naoki -->

<!-- Date: Tue Jan 23 04:50:06.129 2007 -->
<pre> 
   Paged L2 Expert. 
</pre>
<!-- Author: Carmine Pagliarone -->

<!-- Date: Tue Jan 23 04:58:29.501 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232703>232703</A>
 Terminated at 2007.01.23 04:58:04
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 04:58:30.702 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232703>232703</A>
TERMINATE: more BUSY timeouts, even 11 L2A
<!-- Author: Naoki -->


<!-- Date: Tue Jan 23 04:58:31.904 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232703>232703</A>
TERMINATE: more BUSY timeouts, every 11 L2A
<!-- Author: Naoki -->


<!-- Date: Tue Jan 23 05:02:41.458 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232704>232704</A>
 Activated at 2007.01.23 05:02:34
<!-- Author: RunControl -->





<!-- Date: Tue Jan 23 05:14:05.677 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232704>232704</A>
 Terminated at 2007.01.23 05:14:00
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 05:14:11.032 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232704>232704</A>
TERMINATE: restart
<!-- Author: Naoki -->


<!-- Date: Tue Jan 23 05:15:13.556 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232704>232704</A>
TERMINATE: restart
<!-- Author: Naoki -->


<!-- Date: Tue Jan 23 05:15:14.346 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232704>232704</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Naoki -->


<!-- Date: Tue Jan 23 05:18:30.699 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232705>232705</A>
 Activated at 2007.01.23 05:17:56
<!-- Author: RunControl -->



<!-- Date: Tue Jan 23 05:19:54.113 2007 -->
Now running in no silicon run
<!-- Author: Naoki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232705' target=_top>232705</a>) -->

<!-- Date: Tue Jan 23 05:22:00.992 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232705>232705</A>
ACTIVATE: RunSet: AAA_NOSILICON  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Naoki -->
<!-- Comment: Tue Jan 23 05;29;52 comment by...Naoki -->
<pre>In silicon run, all crate was green but in "Return Crosspoints  Moniter?" show SUSY SVX_06 and we can't take data by busy timeout. In nosilicon run, "REturn Crosspoints Moniter" show BUSY (N=0) and running. </pre>

<!-- Comment: Tue Jan 23 05;53;55 comment by...Tom -->
We talked to Bill Badgett and Conor Henderson, they were not sure what the problem could be.
<!-- Date: Tue Jan 23 05:31:45.566 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232705>232705</A>
 Terminated at 2007.01.23 05:31:34
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 05:31:51.911 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232705>232705</A>
TERMINATE: Try again with silicon
<!-- Author: Naoki -->



<!-- Date: Tue Jan 23 05:34:53.362 2007 -->
ICICLE PC freaze, we reboot it.  it is 3rd times.
<!-- Author: Naoki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232706' target=_top>232706</a>) -->

<!-- Date: Tue Jan 23 05:35:46.455 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232706>232706</A>
 Activated at 2007.01.23 05:35:04
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 05:36:22.306 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232706>232706</A>
 Terminated at 2007.01.23 05:36:10
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 05:39:11.795 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232706>232706</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Naoki -->
<!-- Comment: Tue Jan 23 05;51;52 comment by...Tom -->
Still getting BUSY timeouts, however this time we got an error on partition that we hadn't seen before

b0fib06:Messenger:Jan 23, 2007 05:34:01 AM->Fib Slot 8 Corrupt MSRAM: (Calc minus Expect) =  0xffffff80

We paged silicon, the pager carrier will try to figure out what it means
<!-- Comment: Tue Jan 23 06;18;38 comment by...Conor -->
<pre>I also see the following in the error logs that I dont remember seeing normally:
b0svx07:Messenger:Jan 23, 2007 05:36:21 AM->Silicon Timeout:BUSY- Slots:  13:fa20 16:fa00
Maybe worth resetting the VRBs in these two slots?</pre>
<!-- Comment: Tue Jan 23 06;35;10 comment by...Ulrich -->
Checking the error logs for a few of the runs, the busy TO from those slots seems to be present in all of them. So Conors suggestion seems reasonable. We have worked on b0svx07 yesterday, but not on the VRBs in these slots. We checked the system out with cosmics afterwards, and it was fine. The "Corrupt MSRAM" is something completely different: the system checks the RAM for the chip commands on the FIBs. If the checksum fails, the RAM gets overwritten. That does not sound like the problem we are having.
<!-- Date: Tue Jan 23 05:40:16.848 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232707>232707</A>
 Activated at 2007.01.23 05:40:11
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 05:40:17.022 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232707>232707</A>
ACTIVATE: RunSet: AAA_NOSILICON  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Naoki -->
<!-- Comment: Tue Jan 23 05;52;36 comment by...Tom -->
Back to no-silicon running while experts mull things over


<!-- Comment: Tue Jan 23 05;55;22 comment by...Tom -->
Also put silicon to standby since we're not using it


<!-- Comment: Tue Jan 23 06;07;42 comment by...Tom -->
Jose is coming in to look into the problem
<!-- Date: Tue Jan 23 05:57:36.463 2007 -->
Done TO in clc00 : HRR
<!-- Author: Naoki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232707' target=_top>232707</a>) -->



<!-- Date: Tue Jan 23 06:16:08.682 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232707>232707</A>
general: <tt>The silicon system is off.  Some plots have low statistics.  Non silicon items seem to be OK</tt>
<!-- Author: Consumer Operator( Peter Bussey) -->




<!-- Date: Tue Jan 23 06:21:43.716 2007 -->
ICICLE PC is not working again. reboot it
<!-- Author: Naoki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232707' target=_top>232707</a>) -->
<!-- Comment: Tue Jan 23 07;44;39 comment by...Naoki -->
again
<!-- Date: Tue Jan 23 06:38:18.209 2007 -->
2RR29C-1 Model 1 Alacrity power supply is dead and will have to be replaced ASAP. I have a spare one ready to go in this location. I will be on standby to get the OK to go ahead and replace it. Roberto Davila
<!-- Author: Roberto Davila :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232707' target=_top>232707</a>) -->

<!-- Date: Tue Jan 23 06:55:09.732 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232707>232707</A>
 Terminated at 2007.01.23 06:55:00
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 06:55:31.986 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232707>232707</A>
TERMINATE: to change silicon run
<!-- Author: Naoki -->


<!-- Date: Tue Jan 23 06:59:45.631 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232710>232710</A>
 Activated at 2007.01.23 06:59:01
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 06:59:46.339 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232710>232710</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_4_01 [2,852,663] 
<!-- Author: Naoki -->



<!-- Date: Tue Jan 23 07:28:57.663 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232710>232710</A>
 Terminated at 2007.01.23 07:28:46
<!-- Author: RunControl -->


<!-- Date: Tue Jan 23 07:29:00.220 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232710>232710</A>
TERMINATE: to restart.
<!-- Author: Naoki -->


<!-- Date: Tue Jan 23 07:35:21.691 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232711>232711</A>
 Activated at 2007.01.23 07:35:17
<!-- Author: RunControl -->



<!-- Date: Tue Jan 23 07:53:04.899 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232710>232710</A>
clc: <tt></tt>
<!-- Author: Consumer Operator( Peter Bussey) -->


<!-- Date: Tue Jan 23 07:53:05.032 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232710>232710</A>
si: <tt>L0 to L4 were not on the page from the checklist page. Continuous version OK probably.</tt>
<!-- Author: Consumer Operator( Peter Bussey) -->


<!-- Date: Tue Jan 23 07:53:06.174 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=232710>232710</A>
general: <tt>The plots seem to be OK</tt>
<!-- Author: Consumer Operator( Peter Bussey) -->


<!-- Date: Tue Jan 23 07:55:06.014 2007 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=232698 target=_runSummary>232698</A> x38CFA</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_01 [2,852,663]</FONT></TD>
<TD ALIGN=CENTER>03:46:29</TD>
<TD ALIGN=CENTER>03:48:02</TD>
<TD ALIGN=CENTER>00:00:00</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT>     22.38</TD>
<TD ALIGN=RIGHT>      0.02</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>0</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=232699 target=_runSummary>232699</A> x38CFB</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_01 [2,852,663]</FONT></TD>
<TD ALIGN=CENTER>03:53:23</TD>
<TD ALIGN=CENTER>03:55:01</TD>
<TD ALIGN=CENTER>00:00:00</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT>     24.15</TD>
<TD ALIGN=RIGHT>      0.00</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>0</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=232700 target=_runSummary>232700</A> x38CFC</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_01 [2,852,663]</FONT></TD>
<TD ALIGN=CENTER>04:01:56</TD>
<TD ALIGN=CENTER>04:04:32</TD>
<TD ALIGN=CENTER>00:00:00</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT>     37.17</TD>
<TD ALIGN=RIGHT>      0.03</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>0</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=232701 target=_runSummary>232701</A> x38CFD</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_01 [2,852,663]</FONT></TD>
<TD ALIGN=CENTER>04:17:15</TD>
<TD ALIGN=CENTER>04:21:33</TD>
<TD ALIGN=CENTER>00:00:00</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT>     52.62</TD>
<TD ALIGN=RIGHT>      0.02</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>0</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=232705 target=_runSummary>232705</A> x38D01</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_01 [2,852,663]</FONT></TD>
<TD ALIGN=CENTER>05:17:56</TD>
<TD ALIGN=CENTER>05:31:34</TD>
<TD ALIGN=CENTER>00:12:57</TD>
<TD ALIGN=RIGHT>      72,658</TD>   <TD ALIGN=RIGHT>    132.64</TD>
<TD ALIGN=RIGHT>    121.28</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=232707 target=_runSummary>232707</A> x38D03</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_01 [2,852,663]</FONT></TD>
<TD ALIGN=CENTER>05:40:11</TD>
<TD ALIGN=CENTER>06:55:00</TD>
<TD ALIGN=CENTER>01:09:30</TD>
<TD ALIGN=RIGHT>     432,902</TD>   <TD ALIGN=RIGHT>    627.66</TD>
<TD ALIGN=RIGHT>    579.82</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=232710 target=_runSummary>232710</A> x38D06</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_01 [2,852,663]</FONT></TD>
<TD ALIGN=CENTER>06:59:01</TD>
<TD ALIGN=CENTER>07:28:46</TD>
<TD ALIGN=CENTER>00:26:46</TD>
<TD ALIGN=RIGHT>     181,163</TD>   <TD ALIGN=RIGHT>    226.40</TD>
<TD ALIGN=RIGHT>    199.83</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>0</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=232711 target=_runSummary>232711</A> x38D07</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_01 [2,852,663]</FONT></TD>
<TD ALIGN=CENTER>07:35:17</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>00:17:04</TD>
<TD ALIGN=RIGHT>      93,294</TD>   <TD ALIGN=RIGHT>    130.93</TD>
<TD ALIGN=RIGHT>    119.56</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>07:55:01</TD>
<TD ALIGN=CENTER>02:06:18</TD>
<TD ALIGN=RIGHT>       780,017</TD> <TD ALIGN=RIGHT>  1,253.95</TD>
<TD ALIGN=RIGHT>  1,020.56</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Jan 23 08:00:28.582 2007 -->
<font color=red>Shift Summary: </font><pre>   From previous shift (EVE): 
   ========================== 
     There were numerous problems: 
       - B0spool was rebooted due to sluggishness; 
       - SOLENOID2 seems to have a real hardware problem and  
         occasionally crashes. 
 
   OWL Shift Summary    
   ================= 
 
  00:00 Shift started waiting for Shot Setup; 
  00:29 Tevatron is in dry squeeze; 
  00:43 Beginning shots to Recycler; 
* 01:29 Beginnig the Shot setup; 
  02:40 Final Proton bunches have been fully  
        loaded (2421 E09 protons loaded). 
  02:42 Loading Pbars.  
  03:16 AntiProton bunches have been fully loaded (1363 E09  
        PBars loaded). Silicon Exp have been paged. 
 
  03:16 Ramping;  
  03:19 Squeezing;   
  03:21 Initiating collisions; 
  03:22 Start beam Scraping. 
 
* 03:33 Scraping is finished;  
        Store # 5193 is now colliding.    
        Initial B0 Luminosity is 231.31 E30   
        Proton Current is 8626.6 E09   
        Antiproton Current is 2303.8 E09    
 
  03:45 Started the Run 232698 
        B0 Luminosity= 210.9 E30 (03:47 a.m.)  
        We have been not able to take data. 
 
* 05:19 Start to take data without silicon (Run 232707). 
 
* 06:59 Start to take data with silicon detectors (Run 232710). 
 
 
   Special Notes: 
   ============== 
 
      * We experienced several SOLENOID2 PC crashes (as in the 
        evening shift); 
      * We had a bunch of Silicon PINKIES on 5 VBIAS SVX produced  
        from current values just above the thresholds; 
      * We have not been able to take data for most of the shift  
        because Run Control had a wrong DB configuration produced 
        by the fact that one slot was changed the day before and  
        DB wasn't refreshed. 
 
        B0 Luminosity= 150.2 E30 (07:59 a.m.)  
        Delivered luminosity:	 2358.0 nb-1   
        Acquired luminosity:	 1052.5 nb-1      
        Efficiency:	           44.6 %</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   232696 -> 232710
Delivered Luminosity   2358  
Acquired Luminosity    1052.5  
Efficiency             44.6
   
</td></tr></table></pre>
<!-- Author: Carmine Pagliarone -->