<!-- Title: Eve shift. Thu Jun  1, 2006 -->
<!-- SciCo: R. Vidal -->
<!-- DAQAce: Ed Rogers -->
<!-- MonAce: &nbsp; -->
<!-- CO: &nbsp; -->
<!-- OpManager: Greg Feild -->
<!-- Notes: -->
<pre>Tevatron is attempting to inject beam...</pre>

<!-- Date: Thu Jun 1 16:21:45.748 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217260>217260</A>
TERMINATE: with Ed away, I have commandeered the system.   stop run to take XTRP. -KPitts (with Greg's permission)
<!-- Author: ed the ace -->


<!-- Date: Thu Jun 1 16:36:11.858 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217278>217278</A>
ACTIVATE: RunSet: DAQTEST_XTRP_PHYS  Trigger: PHYSICS_4_00 [3,798,626] 
<!-- Author: kpitts -->


<!-- Date: Thu Jun 1 16:36:12.634 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217278>217278</A>
TERMINATE: testing XTRP stereo mapping code with table 400_v3.
<!-- Author: kpitts -->


<!-- Date: Thu Jun 1 16:45:35.371 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217279>217279</A>
ACTIVATE: RunSet: DAQTEST_XTRP_PHYS  Trigger: COSMICS_3D [2,799,630] 
<!-- Author: kpitts -->


<!-- Date: Thu Jun 1 16:45:36.837 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217279>217279</A>
TERMINATE: testing xtrp stereo mapping code with cosmics_3d_v2.
<!-- Author: kpitts -->


<!-- Date: Thu Jun 1 16:45:38.979 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217277>217277</A>
TERMINATE: running to exercise the system (or the bits we have at least ...)
<!-- Author: ed the ace -->


<!-- Date: Thu Jun 1 16:45:39.341 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217281>217281</A>
ACTIVATE: RunSet: DAQTEST_XTRP_PHYS  Trigger: COSMICS_3D [3,800,630] 
<!-- Author: kpitts -->


<!-- Date: Thu Jun 1 16:45:40.248 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217281>217281</A>
TERMINATE: testing XTRP stereo mapping code with cosmics_3d_v3.
<!-- Author: kpitts -->


<!-- Date: Thu Jun 1 16:59:39.509 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217283>217283</A>
TERMINATE: ending.  possible CSL issue.	
<!-- Author: ed the ace -->
<!-- Comment: Thu Jun  1 17;10;29 comment by...Ed -->
<pre>Restarted CSL to fix L3 output problem.</pre>

<!-- Date: Thu Jun 1 17:12:24.935 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217286>217286</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,599] 
<!-- Author: ed the ace -->



<!-- Date: Thu Jun 1 17:13:04.439 2006 -->
<pre>L3 paged for b/c L3 could not output/connect to CSL.  Restarting CSL took care of it.  </pre>
<!-- Author: khaldoun -->


<!-- Date: Thu Jun 1 17:16:41.317 2006 -->
<pre>b0htdc00 is unresponsive to rc commands. 
Looks like the FER packages (readout, messenger) 
aren't loaded: 
 
  NAME        ENTRY       TID    PRI   STATUS      PC       SP     ERRNO  DELAY 
---------- ------------ -------- --- ---------- -------- -------- ------- ----- 
tExcTask   excTask        efe708   0 PEND         295da4   efe630       0     0 
tNetTask   netTask        ef6f28   1 PEND         279f9c   ef6e78       0     0 
tPortmapd  portmapd       ef2198   1 PEND         279f9c   ef2028      16     0 
tRlogOutTasrlogOutTask    e8ace8   2 PEND         279f9c   e8ab60       0     0 
tRlogInTaskrlogInTask     ec69e8   2 PEND         279f9c   ec67c0       0     0 
tShell     shell          e94c60   5 READY        27d960   e93c28   30065     0 
tRlogind   rlogind        ef3728  15 PEND         279f9c   ef3368       0     0 
t1         VISIONserver   edca38 100 PEND         279f9c   edc908       0     0 
t2         ROBINserver    ed74d8 100 PEND         279f9c   ed7398       0     0 
rtlm_main  rtlm_main      ed24b0 220 PEND         279f9c   ed2370       0     0 
tLogTask   logTask        efbd90 250 PEND         295da4   efbcc8       0     0 
value = 0 = 0x0 
 
Rebooting fixed the problem. 
 
</pre>
<!-- Author: greg :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217286' target=_top>217286</a>) -->


<!-- Date: Thu Jun 1 17:19:59.449 2006 -->
<pre>Icicicle died earlier today ... I restarted it. 
</pre>
<!-- Author: greg :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217286' target=_top>217286</a>) -->

<!-- Date: Thu Jun 1 17:22:07.139 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217286>217286</A>
TERMINATE: end to put in b0htdc00 

<!-- Author: ed the ace -->



<!-- Date: Thu Jun 1 17:28:37.420 2006 -->
<pre> 
L3 errors on partition for run 217287: 
 
(MLE) b0eproxy02.fnal.gov:main:Jun 1, 2006 05:23:46 PM->Error on L3 node b0l3s15p04 (partition 0) Thu Jun 1 17:23:36 2006 l3_node  
  in main (l3_node.c:1637) 
  @L3_OUT_INIT_FAIL:  Error initializing output 
 
(MLE) b0eproxy02.fnal.gov:main:Jun 1, 2006 05:23:46 PM->Error on L3 node b0l3s15p06 (partition 0) Thu Jun 1 17:23:36 2006 l3_node  
  in main (l3_node.c:1637) 
  @L3_OUT_INIT_FAIL:  Error initializing output 
 
(MLE) b0eproxy02.fnal.gov:main:Jun 1, 2006 05:23:46 PM->Error on L3 node b0l3s15p15 (partition 0) Thu Jun 1 17:23:36 2006 l3_node  
  in main (l3_node.c:1637) 
  @L3_OUT_INIT_FAIL:  Error initializing output 
 
(MLW) b0eproxy02.fnal.gov:main:Jun 1, 2006 05:23:46 PM->Error on L3 node b0eproxy02.fnal.gov (partition 0) Thu Jun 1 17:23:40 2006 l3proxy  
  in Config (L3ProxyPartition.cc:1707) 
  @L3_TRANS_INCOMPLETE - incomplete start:   b0l3u01 b0l3u01 b0l3u02 b0l3u02 b0l3u03 b0l3u03 b0l3u04 b0l3u04 b0l3u05 b0l3u06 b0l3u06 b0l3u07 b0l3u07 b0l3u08 b0l3u08 b0l3u09 b0l3u09    b0l3s01p01 b0l3s01p</pre>
<!-- Author: greg :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217287' target=_top>217287</a>) -->
<!-- Comment: Thu Jun  1 17;29;52 comment by...greg -->
<pre>sorry - we are stuck in config ...
</pre>


<!-- Date: Thu Jun 1 17:31:00.703 2006 -->
I am finished with the XTRP crate.   The new stereo mapping code seems to be working properly, so I am leaving it in.  I have verified that we fully replicate the maps with the offline emulation.  The stereo upgrade is backward compatible, so it works with all existing tables.     
<!-- Author: KPitts -->

<!-- Date: Thu Jun 1 17:46:29.859 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217292>217292</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,599] 
<!-- Author: ed the ace -->


<!-- Date: Thu Jun 1 17:46:39.474 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217292>217292</A>
TERMINATE: Ending to include XTRP 
<!-- Author: ed the ace -->



<!-- Date: Thu Jun 1 17:55:40.483 2006 -->
<pre>Lummon cannot connect to the database: 
 
Error 12535 : ORA-12535: TNS:operation timed out 
%ERLOG-e connection_failed:  failed to connect to database   
         filecatalog_writeuser/write@cdfofprd  error:   
         ORA-12535: TNS:operation timed out  DBObjects::dbOTL  
         01-Jun-2006 17:50:01 CDT run = 217292 event = 316023 
NOT CONNECTED TO ORACLE 
sql: select 1 from dual 
 more_info: NOT CONNECTED TO ORACLE 
Error 12535 : ORA-12535: TNS:operation timed out 
%ERLOG-e connection_failed:  failed to connect to database   
         filecatalog_writeuser/write@cdfofprd  error:  
</pre>
<!-- Author: greg feild :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217295' target=_top>217295</a>) -->
<!-- Comment: Thu Jun  1 18;06;39 comment by...greg -->
<pre>We restarted the Lummon program and the database 
errors are gone.

</pre>

<!-- Date: Thu Jun 1 18:14:59.849 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217301>217301</A>
ACTIVATE: RunSet: DAQTEST 
<!-- Author: andrew -->



<!-- Date: Thu Jun 1 18:21:02.832 2006 -->
<pre>Event Display keeps crashing. 
 
</pre>
<!-- Author: greg :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217295' target=_top>217295</a>) -->
<!-- Comment: Thu Jun  1 18;25;31 comment by...greg -->
<pre>Event display is working now ...
</pre>
<!-- Date: Thu Jun 1 18:23:12.116 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217302>217302</A>
ACTIVATE: RunSet: DAQTEST 
<!-- Author: andrew -->



<!-- Date: Thu Jun 1 18:30:14.513 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217303>217303</A>
ACTIVATE: RunSet: DAQTEST special patterns for SL7
<!-- Author: nils -->


<!-- Date: Thu Jun 1 18:34:41.563 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217295>217295</A>
TERMINATE: end to include xft/cot!

<!-- Author: ed the ace -->


<!-- Date: Thu Jun 1 18:37:29.283 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217304>217304</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,599] 
running with all the "L2 toture" crates!

<!-- Author: ed the ace -->



<!-- Date: Thu Jun 1 18:38:18.670 2006 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2006&action=view&page=-3328&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2006&action=view&page=-3328  width='300' align='top'></a></td><td>iFix shortly after heartbeat loss</td></tr></table>
<!-- Author: Ed -->
<!-- Comment: Thu Jun  1 18;45;06 comment by...Ed -->
<pre>We lost heartbeat on five elements of the iFix system, each associated with the CLC HV PC.  The instructions for rebooting the responsible PC on the first floor were found.  (See diagram and link below.)  After restarting.  Everything worked.

Note: The pager numbers listed on the webpage below do not work.</pre>
<!-- Comment: Thu Jun  1 19;06;42 comment by...Ed -->
<br />
<a href=/cgi/elog/elog.pl?nb=2006&action=view&page=-3329&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2006&action=view&page=-3329  width='300' align='top'></a><br />
<pre>How to find the CLC Recovery Page</pre><br />
<!-- Comment: Thu Jun  1 19;08;29 comment by...Ed -->
The page is available at : <a href="http://www-cdfonline.fnal.gov/ops/mcs/clc/clc_recover.html">http://www-cdfonline.fnal.gov/ops/mcs/clc/clc_recover.html</a>
<!-- Comment: Thu Jun  1 19;17;30 comment by...Ed -->
<pre>It would be very nice to see this recovery page updated.  Perhaps some graphics (from screen captures) of what to be clicking on.  At the least, if the names of the programs to be running could be brought up to date.
Outdated names on this page include:
"Start -> Programs -> iFix -> Startup" : This has changed to "Start -> Programs -> Proficy HMI SCADA - iFIX 4.0 -> iFix Startup Profile Manager"
"hv_CPR2" : has changed to "hv_clctoll_test"
"Main Menu" : has changed to "CLC & Forward Detectors Main Panel"

Lastly, we should have the password for this machine be available somewhere.  Logging in after restart required contacting an expert.</pre>
<!-- Comment: Thu Jun  1 19;55;48 comment by...Willis -->
Steve Hahn told me that the SciCo should have the passwords to
all the iFIX detector control machines.
<!-- Comment: Thu Jun  1 20;07;05 comment by...convery -->
A printout of the instructions are always left by the pc and have the password written on them.  They must have been misplaced.
I will rename the test version of the executable to the one listed in the instructions.
<!-- Date: Thu Jun 1 18:44:36.440 2006 -->
Summary of XFT work today:  We took test pattern runs including the L2 pulsars for the XFT upgrade to test the connection Finder -> L2 and we took special test pattern runs to test the segment finding in the stereo finders.  Now we have to analyze that data.
<!-- Author: Nils, Andrew -->
<!-- Comment: Thu Jun  1 18;45;05 comment by...Nils -->
PS: we returned the crates to the ace.



<!-- Date: Thu Jun 1 19:03:09.704 2006 -->
Tevatron is trying to inject protons again...
<!-- Author: R. Vidal -->




<!-- Date: Thu Jun 1 19:10:54.668 2006 -->
Randy Herber called earlier to suggest that their might be a problem with the online Oracle DB.  Indeed, LUMMON had lost connection to the DB, but when Greg restarted LUMMON it connected 
correctly.  Run Control is not complaining, the DB e-log 
contained no messages from the OEM, and if I click on the 
"run" links in the e-log, I retrieve the customary data -- so we think the DB recovered and should be okay now...
<!-- Author: R. Vidal -->




<!-- Date: Thu Jun 1 23:04:23.801 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217304>217304</A>
TERMINATE: Restarting run to check consumer output
<!-- Author: ed the ace -->



<!-- Date: Thu Jun 1 23:36:16.720 2006 -->
Ray Davis, 2002 Nobel Prize winner for discovering the solar neutrino deficit, dies at 91
<!-- Author: R. Vidal -->

<!-- Date: Thu Jun 1 23:36:32.108 2006 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217306>217306</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,599] 
<!-- Author: ed the ace -->



<!-- Date: Thu Jun 1 23:39:20.070 2006 -->
<pre>L3 paged.  L3 could not partition.  It seems the proxy did not pick up a relay failure during last run.  Cleaning up Level 3 started a new l3proxy and took care of it.</pre>
<!-- Author: khaldoun :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=217306' target=_top>217306</a>) -->


<!-- Date: Thu Jun 1 23:49:55.152 2006 -->
<font color=red>Shift Summary: </font><pre>we managed to get the readout working; leave it running over night...</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   --
Delivered Luminosity   --  
Acquired Luminosity    --  
Efficiency             --
   
</td></tr></table></pre>
<!-- Author: R. Vidal -->

<!-- Date: Thu Jun 1 23:56:13.300 2006 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>07:55:01</TD>
<TD ALIGN=CENTER>::</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT></TD>
<TD ALIGN=RIGHT></TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->