<!-- Title: Owl shift. Wed Nov 13, 2002 -->
<!-- SciCo: Jeff Spalding -->
<!-- DAQAce: Stan Lai -->
<!-- MonAce: Joao Costa -->
<!-- CO: Vladimir Glagolev -->
<!-- OpManager: Matt Jones -->
<!-- Notes: -->

Booster vacuum repairs completed (just). Startup expected soon with shot setup to follow. 
<br>
<br> 
stack =161 mA, stack rate =0 (Booster off)


<!-- Date: Wed Nov 13 00:25:18 2002 -->
All four boxes (CLC, BSC, RPS, MNP) went grey in IFIX global alarms.<br> The CLC1 HV PC on the 3rd floor was frozen. So I rebooted it. <br>After log in, there was a message: 
<!-- Author: Oliver -->
<!-- Comment: Wed Nov 13 00;28;34 comment by...Oliver -->
" At least one driver failed during system startup."<br> Using the Event viewer to examine event log it seems that driver sjy did not start.<br> There was also an error Number after starting the hvServer.exe and hv.exe stating: "Error Number -2147212765 unauthorized access attempted".<br> IFIX seems to be able to comunicate again(all green) and BSC and RPS show 100% in the HV Status&Control window, while CLC and MNP are at 0% (HV off).



<!-- Comment: Wed Nov 13 00;50;04 comment by...Oliver -->
I sent Andrea an email about this.
<!-- Date: Wed Nov 13 00:47:35 2002 -->
MCR calls: about to put protons into the Tev
<!-- Author: Jeff -->



<!-- Date: Wed Nov 13 01:49:08 2002 -->
Present status:<br> 
pbars: reverse-proton tuneup complete <br>
protons: aborting on losses at D1 on proton injection - "consulting expert"
<!-- Author: Jeff -->


<!-- Date: Wed Nov 13 02:26:04 2002 -->
Lost HV monitoring on CLC, BSC, RPS and MNP (all grey). 
We checked the PC and it was OK. The problem fixed itself after a couple of minutes. This was probably the Virus Scanner software.   
<!-- Author: Joao -->


<!-- Date: Wed Nov 13 03:03:33 2002 -->
Another CLC HV monitoring alarm: 
<br> 
CLC1_BSC_STAT.F_CV: Connection NOT established with node. 
(...several similar messages relative to CLC,MNP,BSC and RPS...) 
<br> 
However, CLC, BSC, RPS and MNP Global Alarm remained green. 
<br> 
Closed error windows. No further action was taken.
<!-- Author: Joao -->
<!-- Comment: Wed Nov 13 03;10;54 comment by...Joao -->
The CLC HV monitoring errors are back. This time CLC, BSC, RPS and MNP turned gray in the Global Alarm window.
<br>
Checked PC and it seems to be running fine. There was the following info window open:
11/13/2002 2:22 AM: Script "clc1 dvd" (NCDF27): MICRON (D:), Execution completed successfully.
<br>
The time stamp is earlier than these errors but it seems that there are some processes slowing down the CLC HV Monitoring PC.
We have not seen this error rate before. Can someone clarify what is going on here?

<!-- Comment: Wed Nov 13 03;37;04 comment by...Joao -->
It happen again a few minutes ago. We have emailed Koji Terashi and Andrea Bocci.


<!-- Date: Wed Nov 13 04:15:15 2002 -->
SVX, ISL and L00 HV global alarm (red) but these are OFF! 
Heartbeat is purple on High Voltage Summary table but no heartbeat alarm was heard.
<!-- Author: Joao -->
<!-- Comment: Wed Nov 13 04;16;23 comment by...Joao -->
I meant "window" not "table". 

<!-- Date: Wed Nov 13 06:06:03 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154109">154109</A>
 Terminated at 2002.11.13 06:04:25
<!-- processed by 131.225.236.229 -->
<!-- Author: RunControl -->


<!-- Date: Wed Nov 13 06:06:03 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154109">154109</A>
TERMINATE: ending cosmic run
<!-- processed by 131.225.236.229 -->
<!-- Author: Stan -->


<!-- Date: Wed Nov 13 06:15:04 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154110">154110</A>
ACTIVATE: running AAA_SHOTSETUP
<!-- processed by 131.225.127.7 -->
<!-- Author: Stan -->



<!-- Date: Wed Nov 13 06:15:31 2002 -->
<strong>Final protons loaded: 
<br> 
Integrated dosage</strong> 
<TABLE bgcolor=#cdc9a5> 
<TR><TH>Date</th><th>Time</th><th>BLM</th><th colspan=2>Dose</th></tr> 
<tr><td>2002.11.13</td><td>06:09:09</td><td>W Inner BLM</td><td>2.99</td><td>RADS</td></tr> 
<tr><td>2002.11.13</td><td>06:09:09</td><td>W Outer BLM</td><td>1.65</td><td>RADS</td></tr> 
<tr><td>2002.11.13</td><td>06:09:09</td><td>E Inner BLM</td><td>7.57</td><td>RADS</td></tr> 
<tr><td>2002.11.13</td><td>06:09:09</td><td>E Outer BLM</td><td>9.16</td><td>RADS</td></tr> 
</TABLE>  
<!-- Author: Joao -->


<!-- Date: Wed Nov 13 06:37:21 2002 -->
Large beam losses after proton injection while tevatron at 150 GeV. LOSTP seems to have saturated at 100kHz. B0PLOS flactuates above that. 
<br> 
SVRAD variables below 15.
<!-- Author: Joao -->

<!-- Date: Wed Nov 13 06:43:03 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154110">154110</A>
TERMINATE: ending shot setup run
<!-- processed by 64.233.196.88 -->
<!-- Author: Stan -->


<!-- Date: Wed Nov 13 07:12:42 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154111">154111</A>
 Activated at 2002.11.13 07:11:05
<!-- processed by 131.225.236.168 -->
<!-- Author: RunControl -->


<!-- Date: Wed Nov 13 07:12:42 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154111">154111</A>
ACTIVATE: running without silicon
<!-- processed by 131.225.236.168 -->
<!-- Author: Stan -->



<!-- Date: Wed Nov 13 07:13:52 2002 -->
<pre>Trigger rates before manually adjusting prescales are: 
 
L1/L2/L3 7.1k/166/27</pre>
<!-- Author: Stan -->
<!-- Comment: Wed Nov 13 07;14;49 comment by...Stan -->
After dynamic prescale readjusted,
8k/167/29
(Disregard previous entry)





<!-- Comment: Wed Nov 13 07;22;01 comment by...Stan -->
<pre>After prescale adjustments:
8.7k/187/26.4
Actually, adjustments only changed bit 27.
But for the record this is what was manually set

Bit20:L2_CEM12_ISO_RL10HZ (was at 1 anyway)
Bit27:L2_RL20HZ_L1_CMUP6_PT4 (was at 2  - set to 1)
Bit80:L2_CEM8_PT8_CES2_RL6HZ (was at 1 anyway)</pre>
<!-- Comment: Wed Nov 13 07;29;41 comment by...Stan -->
Actually, Bit 27 started at prescale 2, and then switched to 1 quickly, and so when I set it to 1, it didn't really change anything.
<!-- Date: Wed Nov 13 07:18:47 2002 -->
<pre>Store 1961 
 
1st p in		05:52 
all p in                06:10   8992e9 
                                8500e9 by the time pbar injection starts 
1st pbar 4 bunches in   06:22 
all pbar in             06:40   1149e9, 159 mA -> 13 mA 
Scraping started        06:48 
Scraping done           07:02   Store 1961, TeVPR=5760,PB=910 
CLC & Plug at full      07:02   34e30 (CDF) 
All HV at full          07:08   (no silicon) 
Activate & Data taking  07:12   (with plug warm up) 
----------------------------- 
Scraping done -> data logging = 10 min, i.e. Plug warmup since no Si.</pre>
<!-- Author: Jeff -->



<!-- Date: Wed Nov 13 07:23:00 2002 -->
<pre>L2 rate dropped to zero. 
Did a manual HRR to recover. 
 
Note: Automatic HRR's are not by default enabled. 
Now they are enabled.</pre>
<!-- Author: Stan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154111' target=_top>154111</a>) -->


<!-- Date: Wed Nov 13 07:25:36 2002 -->
starting about 40 minutes ago all of the TV monitors show some intermittent interference
<!-- Author: Jeff -->


<!-- Date: Wed Nov 13 07:27:37 2002 -->
<TABLE bgcolor=#add8e6> 
<TR><TH>Date</th><th>Time</th><th colspan=3>Quantity</th></tr> 
<tr><td>2002.11.13</td><td>07:22:29</td><td>TEVpr</td><td>5766.91</td><td>1E09</td></tr> 
<tr><td>2002.11.13</td><td>07:22:29</td><td>TEVpb</td><td>912.80</td><td>1E09</td></tr> 
<tr><td>2002.11.13</td><td>07:23:18</td><td>C:B0ILUM</td><td>32.33</td><td>E30</td></tr> 
<tr><td>2002.11.13</td><td>07:23:18</td><td>C:B0LLUM</td><td>31.42</td><td>E30</td></tr> 
<tr><td>2002.11.13</td><td>07:23:18</td><td>C:B0PLOS</td><td>9861.43</td><td>Hz</td></tr> 
<tr><td>2002.11.13</td><td>07:23:18</td><td>C:B0ALOS</td><td>1362.59</td><td>Hz</td></tr> 
</TABLE> 
<strong>Luminosity and losses</strong> 
  
<!-- Author: Joao :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154111' target=_top>154111</a>) -->



<!-- Date: Wed Nov 13 07:30:10 2002 -->
LOSTP increased since end of shot. 
LOSTP is now about 37 kHz. We called MCR and they are trying to reduce losses.
<!-- Author: Joao :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154111' target=_top>154111</a>) -->


<!-- Date: Wed Nov 13 07:33:10 2002 -->
LostP rises to ~35K. Probably just following the usual shape, but we call MCR to see if they can improve things.
<!-- Author: Jeff -->


<!-- Date: Wed Nov 13 07:40:19 2002 -->
about 5min ago there was a BSU+TSU trip. Joao is still trying to reset it. We did NOT interupt the run, as agreed at 8:00 meeting yesterday.
<!-- Author: Jeff -->


<!-- Date: Wed Nov 13 07:44:57 2002 -->
BSU/TSU HV Global Alarm (red). 
Both show that CCU05 has tripped however if we click on it we  
get the following message: 
<br> 
"CCU05 is unreadable. Mail expert. He will reset CCU." 
<br> 
Is this a real HV trip or just a communication problem? 
<br> 
We have emailed Oleg.
<!-- Author: Joao :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154111' target=_top>154111</a>) -->
<!-- Comment: Wed Nov 13 07;47;05 comment by...Joao -->
We tried to recover from the PC downstairs but got the same message.

<!-- Date: Wed Nov 13 07:56:27 2002 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154111>
154111</A> 
x259FF</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_1_03 [2,194,329]</TD>                                       
<TD ALIGN=CENTER>07:11:05</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>00:40:53</TD>                                          
<TD ALIGN=RIGHT>     24,038,388</TD>                                    
<TD ALIGN=RIGHT>       504,018</TD>                                     
<TD ALIGN=RIGHT>      81,130</TD>                                       
<TD ALIGN=RIGHT>   79.851</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>07:55:01</TD>                                                       
<TD ALIGN=CENTER>00:40:53</TD>                                          
<TD ALIGN=RIGHT>      24,038,388</TD>                                   
<TD ALIGN=RIGHT>        504,018</TD>                                    
<TD ALIGN=RIGHT>        81,130</TD>                                     
<TD ALIGN=RIGHT>   79.851</TD>                                          
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- processed by 131.225.236.229 -->
<!-- Author: End of Shift Report -->



<!-- Date: Wed Nov 13 07:56:28 2002 -->
<font color=red>Shift Summary: </font><pre>00:00 start shift: Booster vacuum repairs just completed, stack =161 
 
00:00 overlap from eve shift: CLC1 PC frozen.  
      Rebooted (error messages but IFIX is happy) 
01:50 pbar tuned up with reverse protons, but Tev aborts on proton injection 
      Tev expert called in 
 
03:37 IFIX updates from CLC1 PC grey for a minute or two. PC looks OK. 
      emailed Koji Terashi and Andrea Bocci 
 
04:30 first successful injection of proton bunch into Tev 
 
Store 1961 
 
1st p in		05:52 
all p in                06:10   8992e9 
                                8500e9 by the time pbar injection starts 
1st pbar 4 bunches in   06:22 
all pbar in             06:40   1149e9, 159 mA -&gt; 13 mA 
Scraping started        06:48 
Scraping done           07:02   Store 1961, TeVPR=5760,PB=910 
CLC & Plug at full      07:02   34E30 (CDF) 
All HV at full          07:08   (no silicon) 
Activate & Data taking  07:12   (with plug warm up) 
----------------------------- 
Scraping done -&gt; data logging = 10 min, i.e. Plug warmup since no Si. 
 
06:22 paged ops mgr Matt at start of pbar load  
 
06:40 TV monitors start to have intermittent interference 
 
07:14 Matt removing rate limits on three triggers (see evening shift summary) 
 
07:35 BSU/TSU trip. "CCU05 unreadable" "email expert" &lt;-- done. It remains in this state. 
 
08:00 lum=30E30 
 
For next shift: 
o BSU/TSU is still in alarm (see above) 
o Note rate limit removal from 3 triggers. 
o Aseet has modified the COT HV monitoring:  
  Red = HV.OR.LV alarm and Yellow = LV warning (there is no HV warning state) 
o still waiting to catch a scope trace for Morris 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   154111
Delivered Luminosity   98  
Acquired Luminosity    78  
Efficiency             80%
   
</td></tr></table></pre>
<!-- Author: Jeff -->


<!-- Date: Wed Nov 13 08:05:43 2002 -->
Auto HRR: Done Timeout for PCAL_02
<!-- Author: Stan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154111' target=_top>154111</a>) -->


<!-- Date: Wed Nov 13 08:07:35 2002 -->
Auto HRR: Done Timeout PCAL_08
<!-- Author: Stan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154111' target=_top>154111</a>) -->


<!-- Date: Wed Nov 13 08:10:00 2002 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2002&action=view&page=-10277&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2002&action=view&page=-10277  width='300' align='top'></td><td>Losses from shot setup</a></td></tr></table>
<!-- Author: Joao -->


<!-- Date: Wed Nov 13 08:11:02 2002 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2002&action=view&page=-10278&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2002&action=view&page=-10278  width='300' align='top'></td><td>BLM integrated dose rates (SVRAD)</a></td></tr></table>
<!-- Author: Joao -->