<!-- Title: Eve shift. Mon Sep 22, 2008 -->
<!-- SciCo: Peter Wittich -->
<!-- DAQAce: Yoshikazu Nagai -->
<!-- MonAce: &nbsp; -->
<!-- CO: TANG, Jian -->
<!-- OpManager: Ankush Mitra -->
<!-- Notes: -->
<pre>taking data.  L=126E30, TPR=7895, TPB=2247 
 
take data all shift.</pre>


<!-- Date: Mon Sep 22 16:29:08.240 2008 -->
iFix reported PEM HV yellow status. It immediately returned to green.
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->
<!-- Comment: Mon Sep 22 21;25;34 comment by...Yoshikazu -->
Again.
<!-- Date: Mon Sep 22 16:41:16.005 2008 -->
we suddenly get a large number of pinkies. page the Si. Expert (whose name I failed to get) is investigating remotely.
<!-- Author: peter :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->
<!-- Comment: Mon Sep 22 17;21;54 comment by...Miguel M (Silicon) -->
It is a known issue related to a temperature change (see <a href=
'/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=424&frame=2&anchor=17:17:29'>
silicon e-log</a>). Now, it is back to normal condition.
<!-- Date: Mon Sep 22 16:51:49.606 2008 -->
L2 Decision TO. Auto HRR.
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->
<!-- Comment: Mon Sep 22 22;02;05 comment by...Yoshikazu -->
again.
<!-- Date: Mon Sep 22 16:57:42.194 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4928&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4928  width='300' align='top'></a></td><td>Electron Lens.</td></tr></table>
<!-- Author: Yoshikazu -->
<!-- Comment: Mon Sep 22 16;59;14 comment by...Yoshikazu -->
Electron lens current dropped to 0 and recovered immediately. At the same time, TevMon warning were set and released soon. 


<!-- Date: Mon Sep 22 17:12:17.588 2008 -->
I was paged because some links (L1Accepts Hz, L1Accepts...) in the run summary page are really slow. I forced ProcMon to check and TOMCAT failed: 
 
2008.09.22 17:08:24 Status: CHECKING 
2008.09.22 17:10:26 Status: CHECK FAILED  
23634: Connection closed by 131.225.236.1  
<!-- Author: Enrique P. :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->
<!-- Comment: Mon Sep 22 17;42;29 comment by...Enrique P. -->
TOMCAT is OK now but some online pages are still slow.

<!-- Comment: Mon Sep 22 17;53;01 comment by...Enrique P. -->
Not clear to me what is causing the slowness. Since neither data taking nor any other critical process is affected (only some pages take a long time to load, ~5 min), I'll leave it as is. Page me again in case this get worse.


<!-- Date: Mon Sep 22 18:04:43.478 2008 -->
- Timeout on global TDC Done  for crate b0cot07. 
 Auto HRR recovered it.
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->


<!-- Date: Mon Sep 22 18:10:08.048 2008 -->
another burst of pinkies; we page miguel again
<!-- Author: peter :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->


<!-- Date: Mon Sep 22 18:18:00.835 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4929&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4930  width='300' align='top'></a></td><td>too many errors</td></tr></table>
<!-- Author: Jian Tang -->


<!-- Date: Mon Sep 22 18:22:58.915 2008 -->
previous problem:  error 1.5%, which is lower than 3%. So ignore it.
<!-- Author: Jian Tang :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->


<!-- Date: Mon Sep 22 18:28:29.308 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4933&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4934  width='300' align='top'></a></td><td>nine pinkies. Ignored as per Miguel's suggestion when we paged him.</td></tr></table>
<!-- Author: wittich -->


<!-- Date: Mon Sep 22 18:31:01.679 2008 -->
<center><a href='/cgi/elog/elog.pl?nb=2008&action=view&page=-4931&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2008&action=view&page=-4932' ></a><a href='/cgi/elog/elog.pl?nb=2008&action=view&page=-4933&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2008&action=view&page=-4934' ></a><a href='/cgi/elog/elog.pl?nb=2008&action=view&page=-4935&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2008&action=view&page=-4935' width='300'></a><a href='/cgi/elog/elog.pl?nb=2008&action=view&page=-4936&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2008&action=view&page=-4937' ></a><a href='/cgi/elog/elog.pl?nb=2008&action=view&page=-4938&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2008&action=view&page=-4939' ></a><a href='/cgi/elog/elog.pl?nb=2008&action=view&page=-4940&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2008&action=view&page=-4941' ></a></center>
<!-- Author: wittich -->
<!-- Comment: Mon Sep 22 18;32;52 comment by...wittich -->
full list. They are all bias.
<ul>
<li>B1W9L1
<li>B0W2L2
<li>B1W10L1
<li>B2W1L4
<li>B2W5L1
<li>B3W3L2
<li>B3W4L1
<li>B5W0L1
<li>B2W0L3
</ul>
We've set all these to 'ignore.'

<!-- Comment: Mon Sep 22 19;30;36 comment by...Miguel M (Silicon) -->
Thank you.
<!-- Date: Mon Sep 22 18:43:39.419 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294>267294</A>
general: <tt>JetMonitor of ObjectMon: "Multiplicity" turns red. Not found on known Problem list</tt>
<!-- Author: Consumer Operator( Jian Tang) -->



<!-- Date: Mon Sep 22 18:45:23.750 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4946&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4947  width='300' align='top'></a></td><td>JetMonitor of ObjectMon: "Multiplicity" turns red. Not found on known Problem list, But can be found from earlier shifts: see following site: 
http://www-cdfonline.fnal.gov/cgi/elog/elog.pl</td></tr></table>
<!-- Author: Jian -->


<!-- Date: Mon Sep 22 18:49:29.837 2008 -->
At the ACTIVE state, evb2b turned red. Performed manual HRR. During the HRR, L2 Decision TO Error happened. HRR recovered it.
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->


<!-- Date: Mon Sep 22 18:53:19.831 2008 -->
TOF 01 HV trip. Recovered it and continue data taking.
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->



<!-- Date: Mon Sep 22 20:28:05.768 2008 -->
TOF HV trigger inhibit was set. It released soon.
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->


<!-- Date: Mon Sep 22 20:30:27.187 2008 -->
Hourly plot on scrapbook are not updated. Restart the sequencer.
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->

<!-- Date: Mon Sep 22 20:55:44.210 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294>267294</A>
general: <tt>the same problem as before: JetMonitor has red "Multiplicity" plots</tt>
<!-- Author: Consumer Operator( Jian Tang) -->



<!-- Date: Mon Sep 22 21:24:40.656 2008 -->
Done TO: b0pcal02. Auto HRR failed. Shepherded it and HRR.
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->


<!-- Date: Mon Sep 22 21:24:51.646 2008 -->
<table border=0><td><tr><td bgcolor=#e0e030>Miguel (Si pager carrier) asks to be paged near end of proton loading for the next store.</td></tr></td></table>
<!-- Author: wittich -->



<!-- Date: Mon Sep 22 21:34:45.810 2008 -->
b0fib01 got error at the ACTIVE state. Try to shepherd it and success. Then two HRRS required to recover.
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->


<!-- Date: Mon Sep 22 21:48:31.392 2008 -->
<pre>from the runco elog: 
*  Terminate Store 6434 once we have 380-390E10 Pbars in the Recycler. ( est. 0000-0030hrs.) 
* Go to shot setup when ready."</pre>
<!-- Author: phil -->
<!-- Comment: Mon Sep 22 21;52;18 comment by...Phil -->
4.9917 /fb Young Kee


<!-- Date: Mon Sep 22 21:56:55.984 2008 -->
<pre>Attention !!!. CER_SVXMON_HALT_RECOVER_RUN_ERROR !!!  
Stuck Cellid S/B3/W7/L2/C5-9 .</pre>  
Auto HRR recovered it.
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->
<!-- Comment: Mon Sep 22 21;58;56 comment by...Yoshikazu -->
again.

<!-- Comment: Mon Sep 22 22;01;49 comment by...Yoshikazu -->
again. Ask CO to restart the SVXMon.



<!-- Date: Mon Sep 22 22:41:16.460 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4948&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4949  width='300' align='top'></a></td><td>new pinkie: VBIAS SVX B5W6L1. The jump is about 20 uA.</td></tr></table>
<!-- Author: wittich -->


<!-- Date: Mon Sep 22 22:49:59.677 2008 -->
Done TO: b0pcal10. During auto HRR, b0pcal10 got error. Shepherded it and then HRR.
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->


<!-- Date: Mon Sep 22 23:15:43.913 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-4950&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-4951  width='300' align='top'></a></td><td>updated plot at Miguel's request</td></tr></table>
<!-- Author: wittich -->
<!-- Comment: Mon Sep 22 23;19;28 comment by...wittich -->
according to miguel it is not so serious, and therefore I set the 'ignore' button on this pinkie.
<!-- Comment: Mon Sep 22 23;45;50 comment by...Miguel M (Silicon) -->
Thank you.
<!-- Date: Mon Sep 22 23:18:33.889 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294>267294</A>
general: <tt>running ok</tt>
<!-- Author: Consumer Operator( Jian Tang) -->




<!-- Date: Mon Sep 22 23:30:56.377 2008 -->
<pre>Attention !!!. CER_SVXMON_HALT_RECOVER_RUN_ERROR !!!  
Stuck Cellid I/B3/W0/L0/C0-3. </pre> 
Auto HRR. 
<!-- Author: Yoshikazu :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->
<!-- Comment: Mon Sep 22 23;36;26 comment by...Yoshikazu -->
Anotehr SVXMON Error. 
<pre>Attention !!!. CER_SVXMON_HALT_RECOVER_RUN_ERROR !!!
Pipeline out of synch in 162 silicon readout chips .</pre> 
Auto HRR.
<!-- Date: Mon Sep 22 23:36:05.852 2008 -->
MCR calls, 15 minutes to store termination.
<!-- Author: peter w :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294' target=_top>267294</a>) -->


<!-- Date: Mon Sep 22 23:43:27.586 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294>267294</A>
 Terminated at 2008.09.22 23:43:04
<!-- Author: RunControl -->


<!-- Date: Mon Sep 22 23:43:28.082 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=267294>267294</A>
TERMINATE: End of Store
<!-- Author: Yoshikazu -->




<!-- Date: Mon Sep 22 23:53:36.566 2008 -->
trouble turning down svx to standby; si pager is on the job.
<!-- Author: wittich -->

<!-- Date: Mon Sep 22 23:55:43.506 2008 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=267294 target=_runSummary>267294</A> x4141E</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [9,1129,725]</FONT></TD>
<TD ALIGN=CENTER>09:16:26</TD>
<TD ALIGN=CENTER>23:43:04</TD>
<TD ALIGN=CENTER>13:18:12</TD>
<TD ALIGN=RIGHT>   6,250,284</TD>   <TD ALIGN=RIGHT>  7,233.02</TD>
<TD ALIGN=RIGHT>  6,519.40</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>23:55:00</TD>
<TD ALIGN=CENTER>13:18:12</TD>
<TD ALIGN=RIGHT>     6,250,284</TD> <TD ALIGN=RIGHT>  7,233.02</TD>
<TD ALIGN=RIGHT>  6,519.40</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Sep 23 00:02:15.192 2008 -->
<font color=red>Shift Summary: </font><pre>- inherit smooth shift from Rob. 
- pinkie burst early in shift. Miquel comes in on page and explains 
  that it is due to a known problem where the temp in the collision hall 
  goes up suddenly. 
- problem with online machines: many things like L1 trigger rate display 
  history from run summary and elog are slow. Enrique takes a look. 
- another pinkie burst later, which we ignore after consultation with Miguel 
  (si pager carrier) 
 
- smooth sailing otherwise.  
  
 when we go to end the shift we have problems bringing SVX into standby. 
  Thus endeth the shift (while Yoshikazu is still valiantly trying to bring down the SVX) 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   267294 x
Delivered Luminosity   2746.0 nb-1  
Acquired Luminosity    2746.0 nb-1  
Efficiency             94.6
   
</td></tr></table></pre>
<!-- Author: wittich -->