<!-- Title: Eve shift. Tue Nov 12, 2002 -->
<!-- SciCo: Yoshi Seiya -->
<!-- DAQAce: Lucio Cerrito -->
<!-- MonAce: Oliver Stelzer-Chilton -->
<!-- CO: Pawel de Barbaro -->
<!-- OpManager: Matthew Jones -->
<!-- Notes: -->
<pre>Si and COT HV works in progress.</pre>


<!-- Date: Tue Nov 12 16:18:22 2002 -->
<pre>Silicon access report: 
 
Investigation concludews that L00 HV problem was due to crowbar 
fuse and not damage to detector.  Unfortunately no spares are  
available (they were already used up after the incident).  We 
will recover this channel when spares are available.</pre>
<!-- Author: Chris Hill -->
<!-- Comment: Tue Nov 12 16;51;36 comment by...Yoshi -->
Silicon will not be integrated in the next store.
<!-- Date: Tue Nov 12 16:18:44 2002 -->
<pre>The Ace can now restart the TOMCAT process  
on b0dap61 if it turns red on ProcMon, via: 
 
       ssh b0dap61 -l cdf_cat 
       kitty 
 
...then wait a couple minutes for the server  
to reestablish. 
 
TomCat is the Web server's Java interface. 
</pre>
<!-- Author: W.Badgett -->


<!-- Date: Tue Nov 12 16:19:10 2002 -->
Silicon quiet time work is complete.
<!-- Author: Chris Hill -->


<!-- Date: Tue Nov 12 16:38:28 2002 -->
Bruce (Cryo) called. Solenoid is coming up.
<!-- Author: Yoshi -->


<!-- Date: Tue Nov 12 16:45:47 2002 -->
Aseet is here working on the COT part of IFIX.
<!-- Author: Oliver -->
<!-- Comment: Tue Nov 12 17;25;11 comment by...Oliver -->
After entering the wrong ACE password 3 times we are unable to log into IFIX. Steve Hahn sais we have to wait 30 minutes and then can try again. He said also he will come by then.
<!-- Comment: Tue Nov 12 17;37;17 comment by...Oliver -->
Steve Hahn is here. 
<!-- Date: Tue Nov 12 17:12:57 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154050">154050</A>
RUNSTATUS: BSU/TSU tripped during the run. The run was not paused. IMU was marked as good.
<!-- processed by 131.225.236.229 -->
<!-- Author: cdfscico -->
<!-- Comment: Tue Nov 12 17;25;11 comment by...Yoshi -->
Hum. I tried to add this run comment from the goodrun GUI for
this run taken on 11/10. Goodrun hung. Killed java manually.
Now goodrun crashes on restart. Bill B. is looking at it.



<!-- Comment: Tue Nov 12 17;40;09 comment by...Yoshi -->
Goodrun restored.
<!-- Date: Tue Nov 12 17:33:25 2002 -->
<pre>Attempted to upgrade the JDK (Java) version  
from v1_3-ibm-sr13 to v1_3_1-ibm-sr1, since  
the newest PCs seem to require this to run  
Java in a stable manner. 
 
However, this new version of Java does not  
work with the old Linux on machines with  
dual monitors (b0dap59,58,etc), so I had  
to back out the changes -- back to v1_3-ibm-sr13 
</pre>
<!-- Author: W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154104' target=_top>154104</a>) -->


<!-- Date: Tue Nov 12 17:38:49 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154104">154104</A>
 Activated at 2002.11.12 17:37:48
<!-- processed by 131.225.236.229 -->
<!-- Author: RunControl -->


<!-- Date: Tue Nov 12 17:39:58 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154104">154104</A>
ACTIVATE: Cosmics Run
<!-- processed by 131.225.236.229 -->
<!-- Author: Ace x2080 -->




<!-- Date: Tue Nov 12 17:54:21 2002 -->
<table border=0><td><tr><td bgcolor=#e0e030>The machine b0dap74 is ready for  
monitoring use and is located at the far  
right of the Run Control bank of computers (rack 2RR10C) 
 
Please maintain PingMon and VxMon on the upper  
display of b0dap74.  Note that the "setup fer"  
is special on this machine, and is done for  
you upon login.  Do not reissue any "setup" commands  
on b0dap74. 
 
Please don't run multiple copies of PingMon  
or VxMon, as they are resource intensive. 
</td></tr></td></table>
<!-- Author: W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154104' target=_top>154104</a>) -->


<!-- Date: Tue Nov 12 18:03:19 2002 -->
<p>Kaori called me up because no one could log into VNODE1.  I came in and found the same; no matter what login was used it always claimed "User was not in security zone" or some such.  I checked on VNODE2 which worked fine, so it was not a system-wide problem.  I then proceeded to reboot VNODE1.</p> 
 
<p>It would not allow me to shutdown iFIX without a login, so that worked correctly.  However, I could not kill the iFIX Background Server or Intellution Dynamics windows, either, which is not normal if I remember correctly.  In the end, I had to "End Task" on these two processes and the iFIX Startup process via the Task Manager.  I then tried to logout of the account, but the screen just went grey, very odd.  At this point, I hit the restart button on the computer.</p> 
 
<p>VNODE1 rebooted, iFIX started up automagically correctly, and all the correct processes came up.  Now logins are working correctly.  I will talk with experts tomorrow.</p>  
<!-- Author: Steve Hahn -->
<!-- Comment: Tue Nov 12 18;24;40 comment by...Oliver -->
All Global Alarms are green and HB's are back.
<!-- Comment: Tue Nov 12 20;26;51 comment by...Yoshi -->
At this point, Aseet had been done with the COT HV works and
took off already.

<!-- Date: Tue Nov 12 18:23:12 2002 -->
COT HV was off after the IFIX reboot. <br> 
Aseet told us, we can put it to standby.
<!-- Author: Oliver -->



<!-- Date: Tue Nov 12 18:51:49 2002 -->
SMX access report - 
We recycled ccal01 to reseat the SMXR in slot 4.  Also removed 
and replaced the front cables.  This SMXR has been giving errors (recovered by HRR) since the Oct 23 access at a low level.  
If this doesn't fix these errors, we will replace the board in 
some future access.  Calibrations looked OK.  
<!-- Author: byrum,lindgren -->


<!-- Date: Tue Nov 12 19:12:19 2002 -->
Got an SVX,ISL and L00 alarm on IFIX. Looking at the detail<br> 
the box with the  message: "GUI -iFix communication" reads <br> 
"not ok" underneath. Also on the HV Summary the HB went purple.<br> 
-> The alarm cleared by itself after 2 minutes.<br><br> 
Silicon is actually off and will not be included in the coming store.
<!-- Author: Oliver -->
<!-- Comment: Tue Nov 12 19;50;21 comment by...Oliver -->
another one. 

<!-- Comment: Tue Nov 12 19;52;15 comment by...Oliver -->
all green again.


<!-- Date: Tue Nov 12 19:54:33 2002 -->
MCR called to update us. Still looking at the B0 QPM/HFU problem. 
No estimate for shot at this point. After restoring the QPM/HFU,  
they will resume the TeV turn-on procedure which will take  
about 45 min. or so, then go into a shot-setup.
<!-- Author: Yoshi -->
<!-- Comment: Tue Nov 12 20;20;26 comment by...Yoshi -->
The problem solved. TeV turn-on resumed.
<!-- Comment: Tue Nov 12 20;32;49 comment by...Yoshi -->
Shot-setup EST 1.25 hrs.
<!-- Date: Tue Nov 12 20:17:06 2002 -->
IFix on VNODE2 just died. The error message is:<br> 
Exception access violation(0xc0000005), Adress: 0x6d55ee12  
<!-- Author: Oliver -->
<!-- Comment: Tue Nov 12 20;43;26 comment by...Oliver -->
Paged the expert and he talked us through restarting the <br>
Intellution Dynamic Workspace.
<!-- Comment: Tue Nov 12 20;55;19 comment by...Yoshi -->
JC replied.
<!-- Date: Tue Nov 12 20:38:45 2002 -->
TeV turn-on got stuck again due to B0 low beta problem.
<!-- Author: Yoshi -->
<!-- Comment: Tue Nov 12 21;15;01 comment by...Yoshi -->
TeV turn-on back on the air.


<!-- Comment: Tue Nov 12 22;18;29 comment by...Yoshi -->
Now they are working on the booster vacuume problem that
happened at 20:40. They started accessing the booster.
<!-- Date: Tue Nov 12 21:36:32 2002 -->
<pre>Had an IFIX alarm in Process System Alarms: GAS acompanied with a sirene. <br>The Top Supply Flow rate was 4.1 (high limit 4.1). 
The cryo people are taking care of this and silenced the alarm. 
</pre>
<!-- Author: Oliver -->
<!-- Comment: Tue Nov 12 21;47;37 comment by...Yoshi -->
Was being leveled. Now back to normal.



<!-- Date: Tue Nov 12 22:23:50 2002 -->
I'm going to sleep for a while.  Please arrange for the 
next Scico to page me (314-4862) when final anti-protons 
eventually start to load.  
<!-- Author: M Jones -->


<!-- Date: Tue Nov 12 22:30:01 2002 -->
Aseet is back to check that the COT alarm is working. 
<!-- Author: Oliver -->


<!-- Date: Tue Nov 12 22:57:11 2002 -->
Sent CO home.
<!-- Author: Yoshi -->


<!-- Date: Tue Nov 12 23:18:02 2002 -->
<pre>Modified COT monitoring to have the COT box in the global alarm turn red for a severe low voltage alarm or any high voltage alarm; yellow for any warning low voltage alarm (there are no warning HV alarms).  Modified the voice schedule to respond to the same variable that the box color does, so they should remain in synch.  Modified COT-specific display (the "bulls-eye") to avoid black (=&gt;undefined) rings for channels which are off.</pre>
<!-- Author: Aseet Mukherjee -->

<!-- Date: Tue Nov 12 23:43:44 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154104">154104</A>
 Terminated at 2002.11.12 23:42:30
<!-- processed by 131.225.235.17 -->
<!-- Author: RunControl -->


<!-- Date: Tue Nov 12 23:45:13 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154104">154104</A>
TERMINATE: End Calibration run
<!-- processed by 131.225.235.100 -->
<!-- Author: Lucio -->


<!-- Date: Tue Nov 12 23:50:38 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154109">154109</A>
 Activated at 2002.11.12 23:48:13
<!-- processed by 131.225.236.229 -->
<!-- Author: RunControl -->


<!-- Date: Tue Nov 12 23:50:38 2002 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=154109">154109</A>
ACTIVATE: Cosmics Run
<!-- processed by 131.225.236.229 -->
<!-- Author: Lucio -->


<!-- Date: Tue Nov 12 23:56:17 2002 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>23:55:01</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- processed by 131.225.236.229 -->
<!-- Author: End of Shift Report -->



<!-- Date: Wed Nov 13 00:05:18 2002 -->
<font color=red>Shift Summary: </font><pre>Evening 
 
Si quiet time work and COT HV work in progress. 
- Still waiting for COT LV trips captured on the scope 
- On BSU/TSU trips -&gt; keep running. (IMU should be marked as bad??) 
 
 
A follow up of some works during the day shift: 
- Si quiet time work done. L00 HV problem was due to crowbar fuse,  
  not damage to the detector, but no spare right now. As to the Si 
  integration, the Ops decided not to include Si in the next store. 
 
- CCAL01 SMXR slot 4 reseated, the front cable removed and replaced. 
  Calibration OK. If the error persists, the board will be replaced  
  in future access. 
 
 
16:38    Solenoid turned on. 
 
18:23    COT put on stanby. 
 
19:12    Si alarm on IFIX, while Si off, cleared on its own in 2 min. 
         Happened 7 times. 
 
20:20    The TeV QPM/HFU problem since 16:18 was solved. TeV turn-on resumed. 
20:40    TeV B0 low beta problem. Solved at 21:09 
20:42    Booster vacuum problem. Fixed at 23:45. 
 
23:45    CLC HV PC restarted but not cleanly. 
 
23:47    Aseet finished with the COT HV monitoring. The COT in the global  
         alarm now turns to red in response to LV problem as well as HV,  
         yellow for LV warning (there are no HV warnings). The COT-specific  
         display was also modified so that the channels which are off  
         don't come up in black color (undefined state). 
 
 
 
Special instructions for dap74 (PingMon and VxMon) 
        - Don't issue any "setup" command after login. 
        - Don't run multiple copies of PingMon and VxMon. 
 
For the next store, Jonathan wants to remove rate limits of 
 
         L2_CEM12_ISO_RL10HZ_v-1 Bit: [20] 
         L2_RL20HZ_L1_CMUP6_PT4_v-1 Bit: [80] 
         L2_CEM8_PT8_CES2_RL6HZ_v-2 Bit: [27] 
 
Waiting for a shot. 
 
Please page Ops when final pbars loading starts. 
</pre> 
<!-- Author: Yoshi -->