<!-- Title: Eve shift. Sun Jan 16, 2005 -->
<!-- SciCo: Petar Maksimovic -->
<!-- DAQAce: Veronique Boisvert -->
<!-- MonAce: Paul Dituro -->
<!-- CO: Salvador Marti-Garcia -->
<!-- OpManager: Steve Hahn -->
<!-- Notes: -->
<pre>Store 3924 continues at 28e30.  Stack at 76. 
Hoping for another blissfully boring shift. 
</pre>


<!-- Date: Sun Jan 16 16:44:11.781 2005 -->
About 10 min ago I got an error message saying that TevMon might not be updating. The TevMon monitor has the correct time stamp and the web page as well and the numbers seems to be changing and non 0, so hopefully all is fine.
<!-- Author: Veronique -->


<!-- Date: Sun Jan 16 17:04:35.813 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-835&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-835' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-836&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-836' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-837&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-837' width='300'></a></center>
<!-- Author: Paul - Hourly Plots (15:45-16:45) -->


<!-- Date: Sun Jan 16 17:07:46.233 2005 -->
Got TOF inhibit for a few seconds, and the usual complaint of high dead time shortly after.
<!-- Author: Veronique -->


<!-- Date: Sun Jan 16 17:37:18.605 2005 -->
Got a bunch of L3 Reformat error in the error log and then a Busy TO from svx06 (EVB). Auto HRR took care of this. (this happened before the trip)
<!-- Author: Veronique -->
<!-- Comment: Sun Jan 16 17;41;18 comment by...Veronique -->
Tally so far of Reformatter rejected is 78
<!-- Date: Sun Jan 16 17:39:10.971 2005 -->
Received a CMX trip from South East Miniskirt 30.  There was no spike in conjunction with this trip, as is normally the case.  I reset the HV and we are now back to normal
<!-- Author: Paul -->



<!-- Date: Sun Jan 16 18:03:55.169 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-838&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-838' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-839&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-839' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-840&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-840' width='300'></a></center>
<!-- Author: Paul - Hourly Plots (16:45-17:45) -->


<!-- Date: Sun Jan 16 18:30:23.436 2005 -->
SCPU Bad Channel Counts error, b0eb24. Auto HRR took care of it.
<!-- Author: Veronique -->


<!-- Date: Sun Jan 16 19:03:25.289 2005 -->
SCPU Bad VRB Byte Count error, b0eb25. Auto HRR took care of it.
<!-- Author: Veronique -->


<!-- Date: Sun Jan 16 19:23:39.633 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-841&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-841' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-842&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-842' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-843&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-843' width='300'></a></center>
<!-- Author: Paul - Hourly Plots (17:45-18:45) -->


<!-- Date: Sun Jan 16 19:29:10.778 2005 -->
We had a heating smell in the control room, which we think is coming from the vent on the ceiling above L3 display. Probably the heater kicked in. Now the smell has mostly dissipated. Outside temperature: 8F (-13C). Vesda is all happy btw.
<!-- Author: Veronique -->


<!-- Date: Sun Jan 16 19:31:53.258 2005 -->
SCPU Bad Channel Counts Error. boeb24. Auto HRR took care of it. 
<!-- Author: Veronique -->


<!-- Date: Sun Jan 16 19:41:50.943 2005 -->
Another CMX trip in South East Miniskirt 30.  Reseting and back to normal
<!-- Author: Paul -->
<!-- Comment: Sun Jan 16 19;46;41 comment by...Paul -->
Two minutes after last trip, I receieved another CMX trip from the same SE Miniskirt 30.  Resetting again.


<!-- Comment: Sun Jan 16 20;53;04 comment by...Dale -->
Looks like its tripping at just less than 1 per hour.  We can live with this for now - just keep on resetting.  If you catch it Paul can you tell me if its tripping (what's flashing red) on the "Sense" [this is the top row if you are on the CMX SE bars page] or the "Field" [the bottom row]?  If it's on the sense it might go away with less frequency as the night passes.  If it's the field things could get worse.
<!-- Date: Sun Jan 16 19:54:33.118 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-844&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-844' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-845&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-845' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-846&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-846' width='300'></a></center>
<!-- Author: Paul - Hourly Plots (18:45-19:45) -->


<!-- Date: Sun Jan 16 19:58:56.232 2005 -->
Got Busy TO from SVX06 (EVB). Auto HRR fixed it but for a few seconds we got the "RC non responsive" state where everything was grey, but it came back...
<!-- Author: Veronique -->
<!-- Comment: Mon Jan 17 01;35;50 comment by...W.Badgett -->
In this case, b0svx07 took an unusually 
long time to respond to the HALT transition, 
about 44 seconds  (normally less than a second).
Please watch the "Replies and Acknowledgements" window 
to see which client is not responding.
<!-- Date: Sun Jan 16 20:24:28.734 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-847&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-847' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-848&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-848' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-849&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-849' width='300'></a></center>
<!-- Author: Salva -->
<!-- Comment: Sun Jan 16 20;26;02 comment by...salva -->
CO shift. Some histograms look different w.r.t. reference. Labelled as good as they satisfy the criteria. Need an update ?


<!-- Comment: Sun Jan 16 21;55;00 comment by...carla -->
<pre>Are you really looking at run 179055 (plots on the left) from a year ago?
I'll check the other one in the morning. </pre>
<!-- Comment: Mon Jan 17 08;27;16 comment by...Peter Dong -->
To clarify: the plot on the left is the reference plot.  On the right is what we see now.  The plot on the bottom is a known error which has already been entered into the fix list.
<!-- Date: Sun Jan 16 20:38:59.120 2005 -->
busy TO and SCPU Tracer Event ID  (fe: wcal_00) error in boeb15. Auto HRR took care of it.
<!-- Author: Veronique -->


<!-- Date: Sun Jan 16 20:49:37.825 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-850&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-850' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-851&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-851' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-852&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-852' width='300'></a></center>
<!-- Author: Paul - Hourly Plots (19:45-20:45) -->



<!-- Date: Sun Jan 16 21:10:54.880 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-853&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-853  width='300' align='top'></a></td><td>A huge spike in losses</td></tr></table>
<!-- Author: Paul -->
<!-- Comment: Sun Jan 16 21;11;23 comment by...Paul -->
I've turned Silicon to STANDBY

<!-- Comment: Sun Jan 16 21;23;17 comment by...Veronique -->
Also got TevMon error 
<!-- Date: Sun Jan 16 21:12:38.730 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192351">192351</A>
 Terminated at 2005.01.16 21:12:31
<!-- Author: RunControl -->



<!-- Date: Sun Jan 16 21:13:23.069 2005 -->
I am moving HV to End Of Store until further notice
<!-- Author: Paul -->

<!-- Date: Sun Jan 16 21:14:17.766 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192351">192351</A>
TERMINATE: Ending the run because losses too high (vertical separator trip)
<!-- Author: Veronique (x2080) -->




<!-- Date: Sun Jan 16 21:25:28.019 2005 -->
From MCR logbook: 
"21:11:37-   The A49 vertical separator just tripped due to a load resistor overtemp." 
 
The MCR called and asked us to take the high voltages down, so that 
they can attempt to bring A49 back up.  We are in standby, but 
the losses are still high and we're waiting to see what 
happens.
<!-- Author: Petar -->


<!-- Date: Sun Jan 16 21:26:12.233 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-854&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-854' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-855&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-855' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-856&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-856' width='300'></a></center>
<!-- Author: YIKES !!! -->

<!-- Date: Sun Jan 16 21:36:10.682 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192353">192353</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [16,561,513] 
<!-- Author: Veronique (x2080) -->



<!-- Date: Sun Jan 16 21:53:04.884 2005 -->
Thanks to this monster Spike, SVX SE TOP TOP had to be hockerized ...  
<!-- Author: Marcel -->



<!-- Date: Sun Jan 16 22:15:35.307 2005 -->
Done TO b0clc00, auto HRR took care of it.
<!-- Author: Veronique -->


<!-- Date: Sun Jan 16 22:22:26.169 2005 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2005&action=view&page=-857&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-857  width='300' align='top'></a></td><td>A huge jump in lost protons.  All HV systems were in End of Store mode when it happened</td></tr></table>
<!-- Author: Paul -->

<!-- Date: Sun Jan 16 22:23:31.739 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192353">192353</A>
TERMINATE: Ending. A  whole lot of SVT messages in error log. 
<!-- Author: Veronique (x2080) -->



<!-- Date: Sun Jan 16 22:27:46.750 2005 -->
The CLC expert called and asked that we not run until he comes into the Control Room to investigate the spike
<!-- Author: Paul -->
<!-- Comment: Sun Jan 16 22;31;08 comment by...Petar -->
Still occasional spikes in lost protons.  We are waiting to
make sure the losses are really stable.

<!-- Comment: Sun Jan 16 22;36;46 comment by...Paul -->
Roberto is here to work on CLC, and has asked that we not turn on the CLC HV until he has completed his task.  He estimated 15 minutes.


<!-- Date: Sun Jan 16 22:51:01.909 2005 -->
CLC is taken care of, so we'll resume the run.  The beam 
conditions are stable enough.
<!-- Author: Petar -->


<!-- Date: Sun Jan 16 22:53:01.652 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-858&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-858' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-859&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-859' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-861&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-861' width='300'></a></center>
<!-- Author: Paul - Hourly Plots (20:45-22:45) -->
<!-- Comment: Sun Jan 16 22;53;46 comment by...Paul -->
Special edition- 2 hour plot to show that we have come down from the spike and the beam seems to be under control


<!-- Date: Sun Jan 16 22:56:43.689 2005 -->
<pre>Refilled west CLC vessel with isobutane. Now pressure is 22.52psi. 
</pre>
<!-- Author: roberto rossin -->


<!-- Date: Sun Jan 16 22:56:55.327 2005 -->
In Ready State: CPR, CCR:PC was yellow so unmasked it.
<!-- Author: Veronique -->


<!-- Date: Sun Jan 16 23:00:47.037 2005 -->
All losses are back to a reasonable level, so I am returning all HV systems back to ON.  I have the lovely and talented Marcel here to permit to turn the Silicon systems ON.
<!-- Author: Paul -->

<!-- Date: Sun Jan 16 23:01:27.376 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192354">192354</A>
 Activated at 2005.01.16 23:01:10
<!-- Author: RunControl -->


<!-- Date: Sun Jan 16 23:01:28.927 2005 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192354">192354</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_3_00 [2,560,510] 
<!-- Author: Veronique (x2080) -->



<!-- Date: Sun Jan 16 23:12:33.150 2005 -->
MCR calls and says that they'll drop the store at 8 am, and 
<b>immediately</b> go into the next shot setup.  
<!-- Author: Petar -->


<!-- Date: Sun Jan 16 23:29:20.174 2005 -->
SCPU Bad VRB Byte Count error for b0eb24 (fe: wcal_00) and busy TO from svx06 (EVB). Auto HRR took care of this.
<!-- Author: Veronique -->
<!-- Comment: Mon Jan 17 01;39;02 comment by...W.Badgett -->
b0eb24 is a silicon scanner CPU;  presumably the 
wcal_00 was a misinterpretation due to data corruption.
<!-- Date: Sun Jan 16 23:42:58.487 2005 -->
Again an SCPU Bar VRB Byte COunt error from b0eb24. Auto HRR took care of it.
<!-- Author: Veronique -->

<!-- Date: Sun Jan 16 23:55:28.091 2005 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192351>
192351</A> 
x2EF5F</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_3_00 [2,560,510]</TD>                                       
<TD ALIGN=CENTER>12:49:37</TD>                                          
<TD ALIGN=CENTER>21:12:31</TD>                                          
<TD ALIGN=CENTER>07:56:48</TD>                                          
<TD ALIGN=RIGHT>    560,875,682</TD>                                    
<TD ALIGN=RIGHT>     5,959,742</TD>                                     
<TD ALIGN=RIGHT>   1,625,884</TD>                                       
<TD ALIGN=RIGHT>  772.954</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=192354>
192354</A> 
x2EF62</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_3_00 [2,560,510]</TD>                                       
<TD ALIGN=CENTER>23:01:10</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>00:51:54</TD>                                          
<TD ALIGN=RIGHT>     35,251,047</TD>                                    
<TD ALIGN=RIGHT>       378,759</TD>                                     
<TD ALIGN=RIGHT>     112,257</TD>                                       
<TD ALIGN=RIGHT>   52.958</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>23:55:03</TD>                                                       
<TD ALIGN=CENTER>08:48:43</TD>                                          
<TD ALIGN=RIGHT>     596,126,729</TD>                                   
<TD ALIGN=RIGHT>      6,338,501</TD>                                    
<TD ALIGN=RIGHT>     1,738,141</TD>                                     
<TD ALIGN=RIGHT>  825.911</TD>                                          
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Mon Jan 17 00:01:03.068 2005 -->
<font color=red>Shift Summary: </font><pre>Started with store 3924 at 28e30.  Stack at 76. 
                                                                                  
Beautifully boring shift until 21:11, when the A49 vertical separator tripped.  Went to stand-by, and waited for the problem to be fixed, which happened around 22:20-30.  ISL power supply 
tripped and Marcel came in to Hockerize it.  The beam was  
still unstable, so we waited for the spikes in LOSTP to go away. 
                                                                                 
The CLC expert used that time to refill the west CLC vessel  
with isobutane, and we started turning back on around 22:50. 
                                                                                  
From the MCR plan: 
"We are going to keep this store until 0800, when it will be terminated. Shot setup for the next store will begin at that time. (There is no plan for any quiet time between stores.)" 
                                                                                 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   192351, 192354 
Delivered Luminosity    525.9  
Acquired Luminosity     497.3  
Efficiency              94.6
   
</td></tr></table></pre>
<!-- Author: Petar -->