<!-- Title: Day shift. Sun Feb 27, 2005 -->
<!-- SciCo: Anna Maria Zanetti -->
<!-- DAQAce: Yoshiaki Kusakabe 	 -->
<!-- MonAce: Nils Krumnack -->
<!-- CO: Ilya Kravchenko -->
<!-- OpManager: Steve Hahn -->
<!-- Notes: -->
<pre>Store 4006 in progress.</pre>


<!-- Date: Sun Feb 27 08:28:24.236 2005 -->
Rceived a couple of alarms from DQMon for CLC in 10 minutes. 
They are cleared in a few second by itself.
<!-- Author: yoshiaki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=194539' target=_top>194539</a>) -->


<!-- Date: Sun Feb 27 08:36:53.735 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3341&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3341' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3342&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3342' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3343&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3343' width='300'></a></center>
<!-- Author: Nils -->
<!-- Comment: Sun Feb 27 08;37;22 comment by...Nils -->
hourly plots from 7.30 to 8.30.


<!-- Date: Sun Feb 27 09:14:31.846 2005 -->
L2 decision Timeout, HRR cleared it
<!-- Author: yoshiaki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=194539' target=_top>194539</a>) -->
<!-- Comment: Sun Feb 27 09;27;43 comment by...yoshiaki -->
again
<!-- Comment: Sun Feb 27 10;40;04 comment by...yoshiaki -->
again
<!-- Comment: Sun Feb 27 10;47;28 comment by...yoshiaki -->
again
<!-- Date: Sun Feb 27 09:23:08.798 2005 -->
Done timeout on b0pcal11, HRR stuck in the transition to Halt. 
Halt from LocalClientController also didn't work. 
Shepherded it. First time, it didn't work, and tried again. 
It works, and things look fine.
<!-- Author: yoshiaki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=194539' target=_top>194539</a>) -->



<!-- Date: Sun Feb 27 09:31:59.393 2005 -->
IMON: X_DVDD_B2W2L4 turned pink, recovered by unmarking.
<!-- Author: Nils -->


<!-- Date: Sun Feb 27 09:34:30.274 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3344&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3344' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3345&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3345' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3346&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3346' width='300'></a></center>
<!-- Author: Nils -->
<!-- Comment: Sun Feb 27 09;34;56 comment by...Nils -->
hourly plots from 8.30 to 9.30.


<!-- Date: Sun Feb 27 09:59:13.800 2005 -->
<pre> Attention!!!. Scanner Manager SM_SCPU_TIMEOUT Error !!!. 
and  
 
1 crate/s: b0svx06(16),  busy. [RXPT] 
MLE) b0svx08:Messenger:9:54:13 AM->Silicon Timeout:BUSY- Slots:  08:f000 
 
(MLE) b0svx05:Messenger:9:54:12 AM->Silicon Resonator: Sl 08 Ch 3 -> e503: Bytes: 00064 
e500 18:e580 16:e560 
 
 
Auto-HRR fixed them</pre>
<!-- Author: yoshiaki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=194539' target=_top>194539</a>) -->


<!-- Date: Sun Feb 27 09:59:43.417 2005 -->
<pre>I observe errors in SVXmon that come every several 10s of events: 
 
%ERLOG-e Bad ADC Value: Hardware error flag set  SIXDMon  
         Silicon/I/B5/W0/L0/C11/S102() 27-Feb-2005 09:52:42 CST          run = 194539 event = 3048736 
 
Meanwhile, the update for CO checklist can't find root files 
and display on b0dap56 is somewhat unresponsive. Investigating. 
</pre>
<!-- Author: Ilya :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=194539' target=_top>194539</a>) -->
<!-- Comment: Sun Feb 27 10;03;15 comment by...yoshiaki -->
CO check list of SVXMon slides are not implimented yet. sorry for incovenience.
Could you check the SVXMon slides on b0dap56?

<!-- Comment: Sun Feb 27 10;05;26 comment by...yoshiaki -->
SVXMon was not updated from 09:16, asked Ilya to restart SVXMon right now.

<!-- Comment: Sun Feb 27 10;28;14 comment by...Ilya -->
b0dap56 was terribly slow (took several min to open ssh connection). It became responsive again after we restarted 
SVXMon

<!-- Comment: Sun Feb 27 10;30;46 comment by...Ilya -->
After restartnig SVXMon the Bad ADC errors are still there.
In addition, there are messages about pipline out of sync
and stuck bits. SVXMon plots look generally ok except for a 
few new yellow ladders: may be because we have just restarted
SVXMon and there is not enough statistics. I am marking
SVX status in CO checklist as "Not Yet".


<!-- Comment: Sun Feb 27 10;44;09 comment by...Ilya -->
  Florencia has just responded to SVX errors problem. She
said she will try to understand it remotely, if needed she
will come to the Control Room.


<!-- Comment: Sun Feb 27 15;55;48 comment by...Anna Maria -->
Conclusion is that these errors are 'standard' and we should not care about them
<!-- Date: Sun Feb 27 10:44:43.095 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3347&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3347' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3348&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3348' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3349&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3349' width='300'></a></center>
<!-- Author: Nils -->
<!-- Comment: Sun Feb 27 11;06;51 comment by...Nils -->
hourly plots from 9.30 to 10.30.
<!-- Date: Sun Feb 27 10:49:12.584 2005 -->
IMON: S_AVDD_B2W4L4 turned pink, recovered by unmarking
<!-- Author: Nils -->


<!-- Date: Sun Feb 27 11:01:16.144 2005 -->
<table><tr><td><a href=/elog/notebooks/2005/Sun_Feb_27_2005_Day.110111.ps align=top><img src=/cgi/elog/elog.pl?nb=2005&action=view&page=-3354  align='top'></a></td><td>New structure in CMP monitoring plot (see bottom-rght plot). 
Paging CMP expert. TO SEE THE PROBLEM CLICK ON THE PLOT. 
The part with the problem is off the limits in this little 
thumb. 
</td></tr></table>
<!-- Author: Ilya -->
<!-- Comment: Sun Feb 27 11;17;06 comment by...Ilya -->
<pre>  Muon expert responded to the page. I tried my best to
describe how the plots look. Without seeing them, he says:
 - similar problems were seen over the last two months
 - generally this is not a serious problem, data are ok
 - if order of 10 or more stacks are as high as 0.8 or worse,
       page him again
 - he will come probably around 1pm today to the Control Room
       to investigate further
</pre>


<!-- Comment: Sun Feb 27 11;36;40 comment by...Dale -->
The south CMP wall has "oscillations" in ~12 stacks (not all together).  Simular to <a href=
'/cgi/elog/elog.pl?nb=2005&action=view&page=29&frame=2&anchor=08:44:12.524'>
before</a>.
<p>
We should track down when the problem started.
</p>
Note that making a gif file (not a ps) will make the image look "good" (full image shown; easier to look at via popup window).



<!-- Comment: Sun Feb 27 15;17;36 comment by...Dale -->
No hot stacks in run 194536.  Looks like it starts in run 194538 (maybe only durning the last ~30 min of the run).
<!-- Date: Sun Feb 27 11:36:59.387 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3357&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3357' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3360&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3360' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3361&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3361' width='300'></a></center>
<!-- Author: Nils -->
<!-- Comment: Sun Feb 27 11;37;20 comment by...Nils -->
hourly plots from 10.30 to 11.30.


<!-- Date: Sun Feb 27 12:36:37.301 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3362&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3362' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3363&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3363' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3364&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3364' width='300'></a></center>
<!-- Author: Nils -->
<!-- Comment: Sun Feb 27 12;37;04 comment by...Nils -->
hourly plots from 11.30 to 12.30.


<!-- Date: Sun Feb 27 12:49:25.223 2005 -->
Busy TO for crate b0svx06, Auto-HRR solved.
<!-- Author: yoshiaki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=194539' target=_top>194539</a>) -->


<!-- Date: Sun Feb 27 12:57:44.410 2005 -->
From Run coordinator page: TENTATIVE END OF STORE TIME is 20:30 
<!-- Author: Anna Maria -->


<!-- Date: Sun Feb 27 13:23:08.625 2005 -->
Done TO for crate b0cot01, HRR fixed it.
<!-- Author: yoshiaki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=194539' target=_top>194539</a>) -->


<!-- Date: Sun Feb 27 13:32:55.883 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3365&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3365' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3366&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3366' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3367&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3367' width='300'></a></center>
<!-- Author: Nils -->
<!-- Comment: Sun Feb 27 13;33;25 comment by...Nils -->
hourly plots from 12.30 to 13.30.


<!-- Date: Sun Feb 27 13:55:41.621 2005 -->
SCPU_BAD_VRB_COUNT 
affected SCPU is b0eb25. Auto-HRR fixed
<!-- Author: yoshiaki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=194539' target=_top>194539</a>) -->


<!-- Date: Sun Feb 27 14:22:59.588 2005 -->
iFIX: PSM: communication error with 1RR12C_4, recovered by itself.
<!-- Author: Nils -->


<!-- Date: Sun Feb 27 14:46:55.954 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3368&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3368' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3369&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3369' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3370&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3370' width='300'></a></center>
<!-- Author: Nils -->
<!-- Comment: Sun Feb 27 14;47;28 comment by...Nils -->
hourly plots from 13.30 to 14.30.



<!-- Date: Sun Feb 27 15:27:38.079 2005 -->
The CMP problem seen this afternoon is not a new one. It has happened two times since January. It is caused by the South stack 53 being oscillating. It spreads, thus causing 55 stack oscillating in all layers, and another stack having 3 layers on oscillation. This is not a big problem. No action is needed unless we have more than 4 FULL oscillating stacks.  
 
  I will turn off the low voltage of stack 53 on Monday when it is possible. The runs taken during this time period should be still marked good.  
 
 
<!-- Author: Xiaojian -->


<!-- Date: Sun Feb 27 15:34:24.248 2005 -->
G. Pauletta fixed the problem with the Laser for plug calibrations. 
The Laser was actually working and the problem was in between laser 
and MCR. If the problem should appear again, calibration can be done from downstairs.
<!-- Author: Anna Maria -->


<!-- Date: Sun Feb 27 15:36:27.455 2005 -->
<pre> Attention!!!. Scanner Manager SM_SCPU_TIMEOUT Error !!!. 
 We STRONGLY RECOMMEND the following steps: 
 - Try Halt-Recover-Run. 
 - If it fails, do End (Abort) -> Reset -> Cleanup EVB. 
 - Start run again. 
 
and  
 
Busy TO for crate b0svx06 
 
1st HRR didn't solve them, and 2nd HRR cleared them</pre>
<!-- Author: yoshiaki :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=194539' target=_top>194539</a>) -->


<!-- Date: Sun Feb 27 15:45:18.357 2005 -->
<center><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3371&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3371' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3372&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3372' width='300'></a><a href='/cgi/elog/elog.pl?nb=2005&action=view&page=-3373&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2005&action=view&page=-3373' width='300'></a></center>
<!-- Author: Nils -->
<!-- Comment: Sun Feb 27 15;45;40 comment by...Nils -->
hourly plots from 14.30 to 15.30

<!-- Date: Sun Feb 27 15:55:39.297 2005 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=194539>
194539</A> 
x2F7EB</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_3_00 [3,601,550]</TD>                                       
<TD ALIGN=CENTER>06:08:41</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>09:30:48</TD>                                          
<TD ALIGN=RIGHT>    642,628,990</TD>                                    
<TD ALIGN=RIGHT>     7,299,417</TD>                                     
<TD ALIGN=RIGHT>   2,008,920</TD>                                       
<TD ALIGN=RIGHT>  875.457</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:05</TD>                                                       
<TD ALIGN=CENTER>09:30:48</TD>                                          
<TD ALIGN=RIGHT>     642,628,990</TD>                                   
<TD ALIGN=RIGHT>      7,299,417</TD>                                    
<TD ALIGN=RIGHT>     2,008,920</TD>                                     
<TD ALIGN=RIGHT>  875.457</TD>                                          
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->




<!-- Date: Sun Feb 27 16:00:07.739 2005 -->
<font color=red>Shift Summary: </font><pre> - Smooth data taking. Inherit run 194539 from owl shift
   and still underway. 
 - CMP hot stacks in part S. Experts are aware. It is identified 
   as a known problem which sometimes shows up. Runs has to be 
   marked good. 
 - Problem with laser for plug calibrations fixed by G. Pauletta. 
 - Veronica (X2145) should begin a test of the trigger table  
   around 4pm (Sebastian will be here for checking things on the 
   Silicon side). 
 - Last Estimate for end of store: 20:00 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   
Delivered Luminosity   705  
Acquired Luminosity     687  
Efficiency              97
   
</td></tr></table></pre>
<!-- Author: Anna Maria -->


<!-- Date: Sun Feb 27 16:03:57.234 2005 -->
Done timeout for crat b0cot00
<!-- Author: efron :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=194539' target=_top>194539</a>) -->