<!-- Title: Eve shift. Mon Jul 24, 2006 -->
<!-- SciCo: Monica Tecchio -->
<!-- DAQAce: Emily Nurse -->
<!-- MonAce: Michael Weinberger -->
<!-- CO: Andrey Elagin -->
<!-- OpManager: Greg Feild -->
<!-- Notes: -->
<pre>Inherited store 4851 at 28.7e30.</pre>


<!-- Date: Mon Jul 24 16:12:12.886 2006 -->
Eric James has just changed the read-out mode of b0imu00 to spy-mode. After refreshing from the Hardware database and shepherding the crate we are running smoothly. If I get problems with the crate I will change the mode back and contact Eric.
<!-- Author: Emily :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->


<!-- Date: Mon Jul 24 16:20:26.984 2006 -->
WHA DQMon alarm, the annoying low stats issue.
<!-- Author: Emily :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->
<!-- Comment: Mon Jul 24 16;26;50 comment by...Emily -->
gone


<!-- Comment: Mon Jul 24 16;55;39 comment by...Larry N -->
There really is a more or less dead guy
<!-- Date: Mon Jul 24 16:37:47.986 2006 -->
<center><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7330&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7330' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7331&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7331' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7332&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7332' width='300'></a></center>
<!-- Author: Mike hourly Silicon plots -->
<!-- Comment: Mon Jul 24 16;40;25 comment by...Mike -->
I am not sure what the flat spots in the first plots are.  I did not notice any interuption in the fast time plotters where these gaps are.



<!-- Date: Mon Jul 24 17:20:21.926 2006 -->
<pre>XFT contact numbvers for SLAM test: 
  
Kevin Lannon 
home: 630-513-2406 
cell: 630-803-1256 
 
Jonathan Efron 
cell: 847-334-7754</pre>
<!-- Author: Greg and Koji -->


<!-- Date: Mon Jul 24 17:36:40.379 2006 -->
Phantom TOF ifix inhibit, which, as always, clears before it can be looked at.
<!-- Author: Mike :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->


<!-- Date: Mon Jul 24 17:44:20.417 2006 -->
<center><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7333&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7333' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7334&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7334' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7335&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7335' width='300'></a></center>
<!-- Author: Mike hourly Silicon plots -->


<!-- Date: Mon Jul 24 18:09:37.163 2006 -->
Done TO for crate b0svt09, fixed by HRR
<!-- Author: Emily :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->


<!-- Date: Mon Jul 24 18:11:14.788 2006 -->
<pre> 
 Attention!!!. FERML_HIGH_DEADTIME !!!  
 - Trigger/DAQ Deadtime is too high (at 24.011568 %).  
 - Look for source of hot triggers.  
 - Contact a trigger expert for further assistance.  
</pre> 
Cleared Instantaneously
<!-- Author: Daryl :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->


<!-- Date: Mon Jul 24 18:28:08.966 2006 -->
<pre>A spy cable has been added to the back of the L1 cal trigger  
crate to look at the data coming from the HAD tower  
phi=18, eta=6. 
 
Additional breakout cables have been added to the scaler 
crate to look at the various cal triggers.</pre>
<!-- Author: peter, ankush, greg -->


<!-- Date: Mon Jul 24 18:38:30.748 2006 -->
Gas alarm went off, Spoke to Cryo, they silenced the alarm, and had set some limits to tight.
<!-- Author: Mike :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->


<!-- Date: Mon Jul 24 18:45:12.610 2006 -->
<center><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7336&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7336' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7337&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7337' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7339&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7339' width='300'></a></center>
<!-- Author: Mike hourly Silicon plots -->


<!-- Date: Mon Jul 24 18:48:42.521 2006 -->
<table border=0><td><tr><td bgcolor=#e0e030>From MCR e-log: "Terminate the store at 0100, let Dzero into their hall for a 1.5 hour access." 
<P> 
Experts slotted to do tests between stores, please call x2080 to let the crew know whether you will be coming in or not....I will start calling in ~1h if I don't hear from you.</td></tr></td></table>
<!-- Author: monica :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->
<!-- Comment: Mon Jul 24 21;49;54 comment by...monica -->
ADMEM expert has confirmed he is coming at 1 a.m. to do the calQIE tests.
He needs the whole calorimeter for ~45'
<!-- Date: Mon Jul 24 18:58:05.063 2006 -->
<table><tr><td><a href=/elog/notebooks/2006/Mon_Jul_24_2006_Eve.185743.ps align=top><img src=/cgi/elog/elog.pl?nb=2006&action=view&page=-7341  align='top'></a></td><td>again hi rates in pulsar, was seen in previous shifts</td></tr></table>
<!-- Author: Andrey -->
<!-- Comment: Mon Jul 24 19;01;36 comment by...Emily -->
Issued an HRR


<!-- Comment: Mon Jul 24 19;16;34 comment by...Andrey -->
we are asked by expert to look on XTRP plot (upper left), it's fine as long there is a space between red spots.
<!-- Comment: Mon Jul 24 19;36;59 comment by...monica -->
For the future, if the XTRPMonitor shows an empty box in between the vertical row of boxes with high rates AND the L2 trigger rates are OK, just send an email to the expert (nils@fnal.gov). 
<!-- Date: Mon Jul 24 19:14:54.382 2006 -->
Silicon resonance error box explosion. 
Halted the run, Ankush and Greg looked at some stuff, then I recovered and ran. I'll let them fill in the details. 
 
<pre> 
1 crate/s: b0svx02(112),  in error. [RXPT] 
(MLE) b0control21.fnal.gov:Thread-26:Jul 24, 2006 07:07:03 PM->FrontEnd Error: VRB_SVX_02  
L1 Done Timeout.[RXPT] 
1 crate/s: b0svx02(112),  in error. [RXPT] 
L1 Done Timeout.[RXPT] 
1 crate/s: b0svx02(112),  in error. [RXPT] 
(MLE) b0svx08:Messenger:Jul 24, 2006 07:07:23 PM->Silicon Resonator: Sl 16 Ch 3 -> f843: Bytes: 00780 
 
(MLE) b0svx07:Messenger:Jul 24, 2006 07:07:23 PM->Silicon Resonator: Sl 13 Ch 3 -> fa23: Bytes: 00780 
 
b0svx02:Messenger:Jul 24, 2006 07:07:24 PM->SRC Fatal Error:Sl 6 Resonance Detected  
 -->   
 Additional Information:  
 
 Attention !!!. FERML_SRC_FATALITY ERROR !!!  
  
 SRC Fatal Error from b0svx02: Sl 6 Resonance Detected  
  
 - HALT the run                    
 - record any relevant information in e-log      
 - RECOVER - RUN      
[MLE] 
1 crate/s: b0svx02(112),  in error. [RXPT] 
(MLE) b0felix.fnal.gov:TEDCpp:Jul 24, 2006 07:07:26 PM->{ 19:7:26, 7/24/2006 }: L2-Pulsar-Linux: Halted while  waiting for SVT data 
(RC)   19:07:27 Halt -> HALTED 
(RC)   19:11:41 Recover -> RECOVERED 
(RC)   19:11:45 Run -> ACTIVE 
</pre>
<!-- Author: Emily :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->
<!-- Comment: Mon Jul 24 19;24;23 comment by...Daryl -->
Silicon resonance error occured again.  Halted run.  Ankush and Greg requested a recover and halt again.  Then recovered and ran.


<!-- Date: Mon Jul 24 19:25:20.170 2006 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2006&action=view&page=-7342&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2006&action=view&page=-7342  width='300' align='top'></a></td><td> 
jet10 rate for this run</td></tr></table>
<!-- Author: greg, ankush -->
<!-- Comment: Mon Jul 24 19;31;15 comment by...greg, ankush, peter -->
<pre>So, for the last two resonances, the Aces left the run in 
the Halt state and we dumped the four level 2 buffers from
the FRED card.  For each Halt we saw three of the four
events in the buffers were triggered by Jet10 ONLY.

As a control, we halted the run at a random time and 
saw a healthy mix of triggers in each of the four level 2
buffers,</pre>



<!-- Date: Mon Jul 24 19:48:51.039 2006 -->
<center><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7343&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7343' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7344&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7344' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7345&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7345' width='300'></a></center>
<!-- Author: Mike -->


<!-- Date: Mon Jul 24 20:00:38.339 2006 -->
We got another silicon resonance error box burst. I halted the run, Greg showed me how to read the Level 2 Buffers. For all 4 buffers we saw: 
<pre> 
Data Word 5 = 0 
Data Word 6 = 8 
</pre> 
The 8 here means the jet10 trigger. 
If I get any more of these errors I will do the same. 
<br> 
Note to the next shift crew: DO NOT push the WRITE button on the Fred Status Page GUI. If you do this accidently you should stop the run and start a new one.
<!-- Author: Emily :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->


<!-- Date: Mon Jul 24 20:36:10.893 2006 -->
<center><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7346&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7346' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7347&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7347' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7348&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7348' width='300'></a></center>
<!-- Author: Mike hourly Silicon plots -->


<!-- Date: Mon Jul 24 20:50:21.122 2006 -->
<pre>Recieved another SRC error 
Buffer 0 word 5 0 word 6 40008 
Buffer 1 word 5 0 word 6 8 
Buffer 2 word 5 2 word 6 0 
Buffer 3 word 5 0 word 6 8</pre>
<!-- Author: Mike :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->


<!-- Date: Mon Jul 24 20:50:45.529 2006 -->
Error on CLC & Forward Detector HV Server on the clc1 HV PC: 
<pre> 
Error  (Thread:2328 ClientID:xxx Node:xxx) ExecCaenRequest) A303-Read Error 
</pre> 
Pop up window,  DWHWIZARD.EXE application error:
<pre> 
The instruction at "0x514acef6" referenced memory at "0x514acef6". The memory could not be "read" 
</pre>
<!-- Author: Emily :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->
<!-- Comment: Mon Jul 24 21;03;57 comment by...monica -->
Paged CLC expert about this error message.

<!-- Comment: Mon Jul 24 21;21;36 comment by...Yuri -->
Went downstairs, clickes "ok" on error message. Monitoring programm was running fine.

<!-- Date: Mon Jul 24 21:41:31.529 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272>220272</A>
trigger: <tt>error rate is increasing in Pulsar Monitor</tt>
<!-- Author: Consumer Operator( Andrey Elagin) -->



<!-- Date: Mon Jul 24 21:45:50.389 2006 -->
<center><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7349&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7349' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7350&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7350' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7351&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7351' width='300'></a></center>
<!-- Author: Mike hourly Silicon plots -->



<!-- Date: Mon Jul 24 22:33:50.370 2006 -->
<center><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7353&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7353' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7354&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7354' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7355&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7355' width='300'></a></center>
<!-- Author: Daryl Hourly Silicon Plots -->


<!-- Date: Mon Jul 24 22:43:18.839 2006 -->
L3 node s07p10, thread 2 has crashed.
<!-- Author: Emily :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->


<!-- Date: Mon Jul 24 23:03:40.927 2006 -->
Greg calls. He suggests to mask HAD trigger tower (eta,phi)=(6,18) for the next run using the "traceDirac" application. This is the WHA tower which is believed responsible for the Si resonance condition. I will pass this info to the next Scico.
<!-- Author: monica :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->


<!-- Date: Mon Jul 24 23:05:39.970 2006 -->
Also, the trigger experts (Ted and Jonathan) agree on reverting to trigger table PHYSICS_4_00[4,816,640] as the default table until the problem with the huge TrigMon errorlog is understood.
<!-- Author: monica :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->


<!-- Date: Mon Jul 24 23:36:55.604 2006 -->
<pre>
Recieved another SRC error for b0svx02
Buffer 0: word 5 1000000 word 6 200  
Buffer 1: word 5 2       word 6 0  
Buffer 2: word 5 0       word 6 8  
Buffer 3: word 5 0       word 6 8
</pre>
<!-- Author: Emily :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->
<!-- Comment: Mon Jul 24 23;42;15 comment by...Emily -->
<pre>Incidently this wasn't an explosion. We got two error boxes:

 RXPT Error for crate/s: 
    b0svx02   

followed by:

Attention !!!. FERML_SRC_FATALITY ERROR !!! 
 
 SRC Fatality Error for b0svx02: Sl 6 Resonance Detected 
 
 - HALT the run     
 - record any relevant information in e-log     
 - RECOVER - RUN     </pre>
<!-- Date: Mon Jul 24 23:41:09.694 2006 -->
<center><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7356&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7356' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7357&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7357' width='300'></a><a href='/cgi/elog/elog.pl?nb=2006&action=view&page=-7358&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2006&action=view&page=-7358' width='300'></a></center>
<!-- Author: Daryl Hourly Silicon Plots -->



<!-- Date: Mon Jul 24 23:52:36.892 2006 -->
There seem to be lots of Bunch counter mismatch errors this run...
<!-- Author: Emily :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=220272' target=_top>220272</a>) -->

<!-- Date: Mon Jul 24 23:55:03.274 2006 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=220272 target=_runSummary>220272</A> x35C70</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_4_00 [4,816,640]</FONT></TD>
<TD ALIGN=CENTER>14:58:44</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>08:24:52</TD>
<TD ALIGN=RIGHT>   2,182,798</TD>   <TD ALIGN=RIGHT>    829.03</TD>
<TD ALIGN=RIGHT>    780.00</TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER></TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>23:55:00</TD>
<TD ALIGN=CENTER>08:24:52</TD>
<TD ALIGN=RIGHT>     2,182,798</TD> <TD ALIGN=RIGHT>    829.03</TD>
<TD ALIGN=RIGHT>    780.00</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Jul 25 00:17:14.162 2006 -->
<font color=red>Shift Summary: </font><pre>		July 24, 2006 Evening Shift  
  
16:00   Inherited store 4851 at 28.7e30  
16:12   Eric James changes the read-out mode of b0imu00 to spy-mode.   
18:28   A spy cable has been added to the back of the L1 cal trigger    
        crate to look at the data coming from the HAD tower phi=18, eta=6.  
19:36   Pulsar error rates starts complaining due to XTRP errors.   
        No action to be taken until it starts affecting the L2 trigger rates.  
20:50   Error on CLC & Forward Detector HV Server on the clc1 HV PC. Expert  
        checks it and can't find anything obviously wrong.   
        He decides to investigate it further tomorrow.  
23:04   Greg calls. He suggests to mask HAD trigger tower (eta,phi)=(6,18)   
        for the next run using the  
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   220272
Delivered Luminosity   727.7 nb-1  
Acquired Luminosity    685.5 nb-1  
Efficiency             94.2%
   
</td></tr></table></pre>
<!-- Author: monica -->