<!-- Title: Eve shift. Thu Apr 17, 2008 -->
<!-- SciCo: David Stuart -->
<!-- DAQAce: William -->
<!-- MonAce: &nbsp; -->
<!-- CO: Reid Mumford -->
<!-- OpManager: Massimo -->
<!-- Notes: -->
<pre>Waiting for tev work</pre>


<!-- Date: Thu Apr 17 16:15:39.830 2008 -->
Signing off! The CDF detector can heave a sigh of relief!
<!-- Author: Elisa -->
<!-- Comment: Thu Apr 17 16;43;18 comment by...jj -->
  :-(

<!-- Date: Thu Apr 17 17:07:10.760 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261055>261055</A>
 Activated at 2008.04.17 17:07:04
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 17:07:34.126 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261055>261055</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706] L2 test with both decision nodes.
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 17:29:05.966 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261055>261055</A>
 Terminated at 2008.04.17 17:28:54
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 17:29:06.485 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261055>261055</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 17:32:37.353 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261057>261057</A>
TERMINATE: L2 test

<!-- Author: pmf -->



<!-- Date: Thu Apr 17 17:40:33.860 2008 -->
<pre>From  	William Badgett &lt;badgett@fnal.gov&gt;  
Sent  	Thursday, April 17, 2008 5:15 pm 
To  	Eric James &lt;jameseb@fnal.gov&gt;  
Cc  	Sebastian Grinstein &lt;gris@fnal.gov&gt; , jdl@fnal.gov , Phil Schlabach &lt;schlabach@fnal.gov&gt;  
Subject  	event horizon 
 
 
Hi Eric, 
 
The change to recheck the Tracer start-scan register 
for the Event ID has been in place for about a month. 
However, it was only doing a re-read of the register 
once.   I've now upped that to 10 times (max). 
 
Also, if the second check also failed, it would send 
an error, but it would not indicate that the recheck 
had been done.    I have updated the code to send 
a message for every recheck. 
 
In the past, if the recheck were successful, then 
the code would print out a message indicating 
that the 2nd time worked.    Since installed, this 
has happened only three times, and all in CCAL crates. 
So the mechanism was working in general, but 
did not apparently help the COT18 crate at all.   But 
now we will have a little more info when it does happen. 
 
Cheers, 
Bill 
</pre>
<!-- Author: badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261059' target=_top>261059</a>) -->
<!-- Comment: Thu Apr 17 17;41;37 comment by...badgett -->
<P>
The aforementioned changes take place with <i>fer</i> 
package version <i>v6_03</I> just declared current.   Crates 
have gotten <I>das reboot</I>.
<P>


<!-- Date: Thu Apr 17 17:51:45.881 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261061>261061</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [19,1021,705] 
<!-- Author: badgett -->



<!-- Date: Thu Apr 17 17:57:20.323 2008 -->
<P> 
Just tried a L2TORTURE run with COT_18 b0cot18 back in  
the normal "spy-mode" readout.   Not surprisingly, we can  
some readout errors.    Also, we now have information  
from one event where the event number was not sequential: 
<PRE> 
(MLE) b0cot18:Messenger:Apr 17, 2008 05:53:23 PM->Nonsequential event number, prev evt: 2, 1 try: 14, 2 try: 14 
(MLE) b0cot18:Messenger:Apr 17, 2008 05:53:23 PM->Nonsequential event number, prev evt: 2, 2 try: 14, 3 try: 14 
(MLE) b0cot18:Messenger:Apr 17, 2008 05:53:24 PM->Nonsequential event number, prev evt: 2, 3 try: 14, 4 try: 14 
(MLE) b0cot18:Messenger:Apr 17, 2008 05:53:24 PM->Nonsequential event number, prev evt: 2, 4 try: 14, 5 try: 14 
(MLE) b0cot18:Messenger:Apr 17, 2008 05:53:24 PM->Nonsequential event number, prev evt: 2, 5 try: 14, 6 try: 14 
(MLE) b0cot18:Messenger:Apr 17, 2008 05:53:24 PM->Nonsequential event number, prev evt: 2, 6 try: 14, 7 try: 14 
(MLE) b0cot18:Messenger:Apr 17, 2008 05:53:24 PM->Nonsequential event number, prev evt: 2, 7 try: 14, 8 try: 14 
(MLE) b0cot18:Messenger:Apr 17, 2008 05:53:24 PM->Nonsequential event number, prev evt: 2, 8 try: 14, 9 try: 14 
(MLE) b0cot18:Messenger:Apr 17, 2008 05:53:24 PM->Nonsequential event number, prev evt: 2, 9 try: 14, 10 try: 14 
b0cot18:Messenger:Apr 17, 2008 05:53:24 PM->Runtime Error 36, Event 3: Timeout on global TDC Done -->   
</PRE> 
When the non-sequential event ID is found, we try to  
read out the Tracer StartScan register ten times. The  
errors indicate the same problematic event ID (14) every  
time.    This could imply a Tracer fiber problem &minus;  
or with the Trigger XPT fiber output. 
<P> 
  
<!-- Author: badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261062' target=_top>261062</a>) -->
<!-- Comment: Thu Apr 17 17;58;19 comment by...badgett -->
<P>
Also, I had to disable the crate ERROR signal sent over 
the CDF/VME backplane to the tracer and on to the Return 
crosspoing, from crate b0cot18 COT_18 in order to get things 
to readout.
<P>

<!-- Comment: Sat Apr 19 13;47;02 comment by...bb -->
"crosspoint"

<!-- Date: Thu Apr 17 18:02:45.534 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261063>261063</A>
 Activated at 2008.04.17 18:02:35
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 18:04:46.245 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261063>261063</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706] 
L2 test with Laura's b0l2pu07 included.
<!-- Author: pmf -->



<!-- Date: Thu Apr 17 18:05:57.631 2008 -->
<P> 
Have swapped Trigger crosspoint output fibers 2 and 3  
in slot 10 of the TXPT b0tsi01 crate.    The original  
crates served by these spigots were b0cot18 and b0cot19,  
and of course they are now swapped.   The hardware database  
configuration has been updated. 
<P>   
<!-- Author: badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261063' target=_top>261063</a>) -->


<!-- Date: Thu Apr 17 18:11:18.636 2008 -->
<pre>FrontEnd Crate Error Condition from: COT_19 
Issuing HRR helped.</pre>
<!-- Author: Pedro (x2164) -->

<!-- Date: Thu Apr 17 18:13:26.093 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261063>261063</A>
 Terminated at 2008.04.17 18:12:47
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 18:13:27.427 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261063>261063</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 18:17:09.232 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261064>261064</A>
TERMINATE: L2 test

<!-- Author: pmf -->


<!-- Date: Thu Apr 17 18:20:36.987 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261065>261065</A>
 Activated at 2008.04.17 18:20:31
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 18:21:23.475 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261065>261065</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706] L2 test with b0l2pu07
<!-- Author: pmf -->



<!-- Date: Thu Apr 17 18:21:29.525 2008 -->
<P> 
After the switch of the b0cot18 and b0cot19 TXPT outputs,  
the crate error problem moved to crate b0cot19.   Hmm.  So  
I suspect TXPT slot 10, channel 2 as perhaps being bad.   Note  
that the channel 1, immediately above it, is also known to have  
problems, since quite some time ago. 
<P> 
Have moved b0cot19 TXPT output back to channel 3, as it  
was originally.     Have put b0cot18 TXPT output to channel 4  
to see what will happen.  
<P> 
  
<!-- Author: badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261065' target=_top>261065</a>) -->
<!-- Comment: Thu Apr 17 18;23;22 comment by...badgett -->
Also, I have unmasked the crate error line on b0cot18.
Note that b0cot18 is still in the normal "spy-mode" readout.


<!-- Date: Thu Apr 17 18:26:38.434 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261065>261065</A>
 Terminated at 2008.04.17 18:26:21
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 18:26:39.584 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261065>261065</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 18:29:04.099 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261066>261066</A>
 Activated at 2008.04.17 18:28:41
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 18:31:11.588 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261066>261066</A>
 Terminated at 2008.04.17 18:29:04
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 18:31:12.006 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261066>261066</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 18:32:22.396 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261067>261067</A>
 Activated at 2008.04.17 18:32:15
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 18:33:39.207 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261067>261067</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706] L2 test with b0l2pu07.
<!-- Author: pmf -->



<!-- Date: Thu Apr 17 18:49:43.938 2008 -->
Because of the lack of running, the CO is heading home.  In case, Reid can be reached at: 630.879.2676
<!-- Author: reid -->

<!-- Date: Thu Apr 17 19:11:32.655 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261067>261067</A>
 Terminated at 2008.04.17 19:10:41
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 19:11:33.591 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261067>261067</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 19:17:09.270 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261069>261069</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 19:21:25.034 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261070>261070</A>
 Activated at 2008.04.17 19:21:00
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 19:21:26.594 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261070>261070</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706] L2 test with both decision nodes
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 19:24:56.402 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261070>261070</A>
 Terminated at 2008.04.17 19:24:21
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 19:24:57.175 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261070>261070</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 19:35:59.368 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261071>261071</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 19:47:48.086 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261072>261072</A>
 Activated at 2008.04.17 19:40:06
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 19:47:49.196 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261072>261072</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706] L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 19:47:50.350 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261072>261072</A>
 Terminated at 2008.04.17 19:41:33
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 19:47:51.786 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261072>261072</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 19:47:52.767 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261073>261073</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 19:47:53.521 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261074>261074</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 19:52:06.766 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261075>261075</A>
 Activated at 2008.04.17 19:51:15
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 19:52:07.147 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261075>261075</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706] L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 19:53:45.548 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261075>261075</A>
 Terminated at 2008.04.17 19:53:19
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 19:53:46.089 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261075>261075</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 20:09:46.552 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261076>261076</A>
TERMINATE: L2 test
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 20:12:17.358 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261077>261077</A>
 Activated at 2008.04.17 20:12:00
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 20:14:20.704 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261077>261077</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706] L2 test with two nodes and b0l2pu07.
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 20:16:26.674 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261077>261077</A>
 Terminated at 2008.04.17 20:15:42
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 20:16:27.006 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261077>261077</A>
TERMINATE: End of L2 test for today.
<!-- Author: pmf -->


<!-- Date: Thu Apr 17 20:28:33.019 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261078>261078</A>
 Activated at 2008.04.17 20:27:15
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 20:28:34.202 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261078>261078</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706]
<!-- Author: Will -->


<!-- Date: Thu Apr 17 20:32:59.731 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261078>261078</A>
 Terminated at 2008.04.17 20:32:46
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 20:33:00.061 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261078>261078</A>
TERMINATE: end of test
<!-- Author: Will -->


<!-- Date: Thu Apr 17 20:43:33.104 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261079>261079</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [19,1021,705] 
<!-- Author: Will -->



<!-- Date: Thu Apr 17 20:55:43.249 2008 -->
<pre>The iFix program on vnode1 still has a number of grey icons.  The TOF/CLC/PEM/PHA/PSH/CSP/CSW/CSX/MSK/BSU/PSM/TSU icons are all greyed out, there HV controls are similarly greyed out. 
 
It was mentioned that this was due to retarting the iFix program so S^3 could be installed, and that they should have un-greyed a few hours ago, however this is not happening.</pre>
<!-- Author: Will :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261079' target=_top>261079</a>) -->
<!-- Comment: Thu Apr 17 21;46;38 comment by...jj -->
And thanks to Mark Knapp (and Kurt Biery and Steve), you
can check this yourself from Screen Snapshot Service at
<a href="http://www-cdfonline.fnal.gov/java/snapshot/ShowImageList.jsp">http://www-cdfonline.fnal.gov/java/snapshot/ShowImageList.jsp</a>
 .<br>

<!-- Comment: Thu Apr 17 23;05;21 comment by...Will -->
The screen shot caapture service was stopped, did not fix porblem
<!-- Date: Thu Apr 17 21:36:26.776 2008 -->
b0pcal11 in error, 
Last data more than 120s ago!  Node is not responsive 
 
A HRR caused b0pcal07 to turn red as well, 
Sheperded both machines succesfully
<!-- Author: Will :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261079' target=_top>261079</a>) -->
<!-- Comment: Thu Apr 17 22;05;39 comment by...Will -->
<pre>Again, sheparding was succesful</pre>
<!-- Comment: Thu Apr 17 22;34;21 comment by...Will -->
it was only b0pcal11 the second time
<!-- Date: Thu Apr 17 21:38:36.855 2008 -->
The RTSERVER error caused by 1 potentially stuck port from svxinter.fnal.gov:1037 seems to be happening about every 20 minutes or so.  Will continue to ignore
<!-- Author: Will :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261079' target=_top>261079</a>) -->
<!-- Comment: Fri Apr 18 00;06;04 comment by...Susan -->
This problem is still present.
<!-- Date: Thu Apr 17 21:57:59.093 2008 -->
I find the tevatron situation a bit murky but agree with the runco elog that a store tonight is not out of the question.
<!-- Author: phil -->
<!-- Comment: Thu Apr 17 22;09;00 comment by...phil -->
the magic next store orb is neither green nor red, how's that

<!-- Comment: Thu Apr 17 22;23;52 comment by...sergo (silicon) -->
<pre>Could you please copy/paste from the runco elog, I cannot view it from outside the lab. </pre>


<!-- Comment: Thu Apr 17 23;34;51 comment by...david stuart -->
From runco: Cryo experts accessed at A4 and checked Kautzky control lines for evidence of leakage to single phase on the low beta quads. Nothing was found bad on the triplets. Our Kautzky leak is thus likely to be somewhere else and not near the Q3 coils. So for now a 12 hour down period is not warranted to look any further at this time at the rest of the house since Cryo experts do not think this would cause B0Q3 quenches. Cryo experts lowered the operating set point for A4 to be 8 pounds to give us additional cooling margin. This along with an earlier turn on of lead flows in the Sequencer will hope fully help us get through to low beta and stay there. Tevatron experts are again conducting aperture scans at 150 GeV at B0 to look for problems. After this, they may proceed with some power testing of B0Q3 to see if we are close to quenching. If all goes well, I imagine we could go into shot setup some time on the late evening or early owl shift. Mechanical support also to the access opportunity to check the C33 turbo and replace the roughing pump. D0 made an access as well. - S.Chaurize

Then: 
 Tevatron experts will parse through the squeeze after the aperture scans and then conduct some power testing of the B0Q3 circuit. They will finalize the details for the test a little later. If all goes well we would then perform a dry and wet squeeze followed by shot setup. Tevatron experts will provide instructions for the MCR as needed. Fro shot setup we will shoot with the current Recycler Pbars as long as we stay above 230E10. We are currently at 243E10. We are pushing our stack size to have Pbars on reserve. The Stack is currently at 176mA as we interleave event for stacking and NuMI. - S.Chaurize  


<!-- Date: Thu Apr 17 22:43:15.734 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261079>261079</A>
TERMINATE: done
<!-- Author: Will -->


<!-- Date: Thu Apr 17 22:48:10.484 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261080>261080</A>
 Activated at 2008.04.17 22:47:16
<!-- Author: RunControl -->


<!-- Date: Thu Apr 17 22:48:34.780 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261080>261080</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706] 
<!-- Author: Will -->





<!-- Date: Thu Apr 17 23:41:40.350 2008 -->
<pre>Here is my last entry as ACE. I have learnt a lot about CDF and I really had fun during this 3 months! Thank you all for this great experience! I hav left some useful instructions for new generations of aces...they are on the wall! If you want you can add them in the ace help page!:) Good luck and have fun!  
Pierluigi</pre>
<!-- Author: Pierluigi :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261080' target=_top>261080</a>) -->


<!-- Date: Thu Apr 17 23:49:16.780 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-1899&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-1899  width='300' align='top'></a></td><td><p>Been trying to figure out what's wrong with VNODE1, many 
grey global alarm boxes.  No real clues on VNODE1 itself or 
on the PCs in question, but when closing the iFIX Workspace 
got the error you see here.  Clearly, iFIX was in a bad 
state on VNODE1.  Not sure if this is associated with the 
SSS or not, will try restarting after rebooting VNODE1.</p></td></tr></table>
<!-- Author: Steve Hahn -->

<!-- Date: Thu Apr 17 23:55:17.054 2008 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>23:55:00</TD>
<TD ALIGN=CENTER>::</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT></TD>
<TD ALIGN=RIGHT></TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Fri Apr 18 00:04:58.098 2008 -->
<p>So, after rebooting VNODE1 and waiting till systems refresh 
in the Global Alarms picture, it looks exactly like before: 
TOF, CLC, PEM PHA PSH (all in CDFEPHV), CSP CSW CSX MSK BSU TSU  
(all in CDF51683), and PSM are all grey.  I think I will try 
rebooting the remote PCs and see if that makes any difference.</p>
<!-- Author: Steve Hahn :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261080' target=_top>261080</a>) -->



<!-- Date: Fri Apr 18 00:06:50.883 2008 -->
<font color=red>Shift Summary: </font><pre>b0scico00.fnal.gov&gt; cat &gt; evesummary.txt 
 
Waiting for beam 
 
Pedro did L2 studies for about 4 hours 
 
Ran L2 torture and cosmics 
 
Steve worked on ifix HV page 
b0scico00.fnal.gov&gt;  
 
</pre> 
<!-- Author: David Stuart -->


<!-- Date: Fri Apr 18 00:13:19.261 2008 -->
<p>Killed and restarted the HV.exe client and HVServer.exe  
server on CDFEPHV; this did bring back the global alarms for  
PEM PHA PSH.  Noted something odd while killing the client and 
server: got a message about the MON tag for CDFEPHV being  
unreadable.  Used the special /dynamics/PIC/CDF/Misc/Recover.grf 
picture to force the MON tag to true for all components.  Now 
everything is back except some heartbeats; I'll give it a little 
more time, expecting everything to come back.  Have not seen this 
problem with the MON tags in a long long time.</p>
<!-- Author: Steve Hahn :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=261080' target=_top>261080</a>) -->
<!-- Comment: Fri Apr 18 00;27;43 comment by...Steve Hahn -->
Now all heartbeats are OK, also.