<!-- Title: Eve shift. Mon Sep 13, 2004 -->
<!-- SciCo: Brian Winer -->
<!-- DAQAce: Markus Klute -->
<!-- MonAce: None -->
<!-- CO: None -->
<!-- OpManager: Steve Hahn -->
<!-- Notes: -->
<pre> 
  Still Recovering from power outage this morning.</pre>


<!-- Date: Mon Sep 13 16:30:31.844 2004 -->
We have redownloaded the configuration memory in ADMEM in slot 17, b0ccal15 which was giving problems <a href= 
'/cgi/elog/elog.pl?nb=2004&action=view&page=668&frame=2&anchor=15:54:52.279'> before </a> . Things appear to be back to normal.
<!-- Author: K Chung, V Tiwari -->


<!-- Date: Mon Sep 13 16:45:59.177 2004 -->
<pre>Have marked offline the TDC in slot 15 of crate  
b0cot09 COT_09 for now, until the TDC experts  
can have a look.   Sent mail to James, Cyr, and Kirby  
telling them about the problem. 
 
Also, the crate is now in "non-spy-mode-readout"  
due to the missing TDC. 
</pre>
<!-- Author: W.Badgett -->
<!-- Comment: Mon Sep 13 17;56;26 comment by...Eric James -->
<pre>Recovered this board with hot extraction/insertion.
Bill marked this board back online and changed the 
crate readout mode back to normal in hardware DB.</pre>
<!-- Date: Mon Sep 13 16:59:11.161 2004 -->
Marcel and I acknowledged an SVX low flow alarm (~4pm)
<!-- Author: Markus -->


<!-- Date: Mon Sep 13 17:09:21.977 2004 -->
<pre>I have gotten all but one Control Room monitor back up and  
working. So far have only replaced one of the six monitors that 
appeared dead earlier today. Some of the existing working  
monitors are fuzzy but better than nothing at the moment. 
I will continue investigating this problem Tuesday.</pre>
<!-- Author: JJ -->


<!-- Date: Mon Sep 13 17:40:56.253 2004 -->
<pre> After power outage, SVTSPYMON has trouble. 
logfile says that 
 
&gt;xmlrpc_data.c:778: assertion failed 
&gt;SVTMON_USE_XMLRPC=1 svtmon_use_xmlrpc=1 
&gt;SVTMON-ACNET interface initialized - XML-RPC Fault: (null) (0) 
&gt;SVTMON_UPDATE_BEAMPAGE=0 svtmon_update_webpage=0 
 
&gt;ACNET interface - XML-RPC Fault: HTTP error #-1 occurred 
&gt;Fatal Error: connect operation failed (Connection refused) (-504) 
 
  Looks like XML-RPC connection error, but not sure for me 
 more than this.  
 So, I send email to Marco Rescigno and Subir who are real  
 expert for this. 
 
</pre>
<!-- Author: Taka Maruyama (SVT pager) -->


<!-- Date: Mon Sep 13 17:51:10.526 2004 -->
<h2>The State of the iFIX Address</h2> 
 
<p>Well, let's take a look at VNODE1; what do we see? 
COT is in red.  Clicking on "D" shows that this is due to the 
LV being on in all but one quadrant.  Not sure if this is due 
to the west endwall being off; will talk to Morris.</p> 
 
<p>SVX and ISL are both yellow.  The both are showing alarms 
on chiller inlet pressure and coolant conductivity.  I believe 
this is fairly normal after a shutdown.</p> 
 
<p>PSM is red, but understandably so: again all 400 Hz is off  
for the west plug, endwalls, and central arches. Also, all power 
is off to the 1st floor until the electricians are done wiring 
in more power for additional L3 and EVB computers.</p> 
 
<p>CEM CHA and WHA are yellow.  This is because there are many 
channels off from 2 to >20 V.  This is fairly typical since the 
Gamma HV supplies have been off for a few days.  I&prime;m in no rush 
to set them correctly; often they settle back to the previous 
output after a day or two.  If you have need of accurate  
cosmics, let me know and I might change my mind.</p>
<!-- Author: Steve Hahn -->

<!-- Date: Mon Sep 13 17:53:16.922 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=187139">187139</A>
TERMINATE: aborting to include l3 for a test
<!-- Author: Markus Klute x2080 -->




<!-- Date: Mon Sep 13 18:09:30.034 2004 -->
The event builder crates in the 1st floor have no power till ~noon tomorrow. No run with L3/Evb is possible until the power is back. L3 should be ready to go. We will use the software event builder in the meantime.
<!-- Author: Markus -->


<!-- Date: Mon Sep 13 20:44:20.181 2004 -->
TOF heartbeat alarm. Had to restart smacs. 
<!-- Author: Markus -->

<!-- Date: Mon Sep 13 21:41:50.039 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=187142">187142</A>
TERMINATE: ending to start a test with ccal 10.
<!-- Author: Markus Klute x2080 -->


<!-- Date: Mon Sep 13 21:47:46.863 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=187143">187143</A>
ACTIVATE: RunSet: ACE_CPRTEST  Trigger: COSMICS_NOTRACKS [9,467,441] 
<!-- Author: Markus Klute x2080 -->


<!-- Date: Mon Sep 13 21:53:21.935 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=187143">187143</A>
TERMINATE: ending 
<!-- Author: Markus Klute x2080 -->
<!-- Comment: Mon Sep 13 21;54;18 comment by...Markus -->
ending to write all files to the look area in the next run.

<!-- Date: Mon Sep 13 21:56:24.987 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=187144">187144</A>
ACTIVATE: RunSet: ACE_CPRTEST  Trigger: COSMICS_NOTRACKS [9,467,441] 
<!-- Author: Markus Klute x2080 -->


<!-- Date: Mon Sep 13 23:46:20.047 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=187144">187144</A>
TERMINATE: ending to start cosmic notrack run with sevb
<!-- Author: Markus Klute x2080 -->


<!-- Date: Mon Sep 13 23:55:49.208 2004 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>23:55:02</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Mon Sep 13 23:55:49.035 2004 -->
<pre>IFix crashed! I was able to stop the processes running on vnode1, but I can not restart IFix.</pre>
<!-- Author: Markus -->


<!-- Date: Tue Sep 14 00:07:10.881 2004 -->
<pre>We had an ISL cooling alarm and paged the expert who is looking at it right now.  
 
The IFix docu says that I should reboot vnode1 and call the IFix expert to ask for a username and password. We will leave that for the next shift.</pre>
<!-- Author: Markus -->


<!-- Date: Tue Sep 14 00:12:02.465 2004 -->
<font color=red>Shift Summary: </font><pre> Recovering from Power Outage. 
 
    =&gt; Problem with ADMEM in b0ccal15 identified 
       during day shift has been fixed by experts. 
 
    =&gt; JJ is still investigating the trouble with 
       the monitors.  The monitor VxMon, PingMon is 
       still dead. One of the others was replaced. 
 
 
    =&gt; ISL Cooling in ALARM. It looks like the cooling 
       supply values are at 0%. Called expert and they 
       are attempting to reset (This occurred at the end 
       of shift). 
 
    =&gt; IFIX seem to crash on terminal in control room. 
       Cannot seem to restart it. Experts should look at 
       it in the morning. 
</pre> 
<!-- Author: Brian Winer -->

<!-- Date: Tue Sep 14 00:21:19.006 2004 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=187145">187145</A>
ACTIVATE: RunSet: ACE_COSMIC_NOTRACKS  Trigger: COSMICS_NOTRACKS [9,467,441] 
<!-- Author: Markus Klute x2080 -->


<!-- Date: Tue Sep 14 07:55:46.917 2004 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>07:55:01</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->