<!-- Title: Owl shift. Tue Jun  3, 2008 -->
<!-- SciCo: Mark Kruse -->
<!-- DAQAce: Susan Burke -->
<!-- MonAce: &nbsp; -->
<!-- CO: Bruce Barnett -->
<!-- OpManager: Steve Hahn -->
<!-- Notes: -->
<pre>Begin shift after a few problems resulting in solenoid trip. 
Back to full power now, and ready to start new run, though 
still looking into rack warnings first.</pre>

<!-- Date: Tue Jun 3 00:07:44.844 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262988>262988</A>
 Activated at 2008.06.03 00:07:18
<!-- Author: RunControl -->


<!-- Date: Tue Jun 3 00:07:45.090 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262988>262988</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_5_01 [7,1088,721] 
<!-- Author: Chang-Seong -->



<!-- Date: Tue Jun 3 00:15:06.492 2008 -->
You have several bands of missing PPR, better contact SMX pager
<!-- Author: Larry N :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262988' target=_top>262988</a>) -->
<!-- Comment: Tue Jun  3 00;19;12 comment by...Mark Kruse -->
Larry, what are you looking at ? We just recovered (almost!) from a solenoid trip. But don't see the bands you are talking about. Which
plots are you viewing. Thanks


<!-- Date: Tue Jun 3 00:20:29.100 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-2696&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-2696  width='300' align='top'></a></td><td>PES looks fine but PPR has problems</td></tr></table>
<!-- Author: Larry N -->
<!-- Comment: Tue Jun  3 00;21;37 comment by...kruse -->
Thanks. SMX paged....

<!-- Comment: Tue Jun  3 00;23;43 comment by...Larry N -->
pcal01 and pcal05 


<!-- Comment: Tue Jun  3 00;35;03 comment by...kruse -->
Steve Hahn talking to Britney now to try and sort it out, and
Steve will talk with Cryo to try to reconstruct the sequence of events leading to the solenoid trip.
<!-- Comment: Tue Jun  3 00;41;57 comment by...Britney Rutherford -->
Strange...looks like maybe an electronics problem.  I called Mike- he's looking into it.
<!-- Date: Tue Jun 3 00:26:27.272 2008 -->
Done TO b0cot16. Auto HRR.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262988' target=_top>262988</a>) -->
<!-- Comment: Tue Jun  3 00;51;03 comment by...Susan -->
Again.


<!-- Date: Tue Jun 3 00:56:59.189 2008 -->
b0pcal08 became unresponsive. Shepherded it. This also happened earlier when I was talking to Britney.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262988' target=_top>262988</a>) -->


<!-- Date: Tue Jun 3 01:00:00.717 2008 -->
The sequencer had stopped running during the evening shift so the scrapbook hourly plots were not being updated. I restarted the sequencer and  it looks okay. 
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262988' target=_top>262988</a>) -->

<!-- Date: Tue Jun 3 01:04:10.390 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262988>262988</A>
 Terminated at 2008.06.03 01:03:56
<!-- Author: RunControl -->


<!-- Date: Tue Jun 3 01:05:08.604 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262988>262988</A>
TERMINATE: Stop to do shower max plug calibration.
<!-- Author: Chang-Seong -->


<!-- Date: Tue Jun 3 01:05:09.462 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262988>262988</A>
RUNSTATUS: <PRE>Marked Bad, explanation:
PPR 
</PRE>
<!-- Author: cdfscico -->


<!-- Date: Tue Jun 3 01:16:01.071 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262989>262989</A>
ACTIVATE: RunSet: SMQIECALIB 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 01:17:44.062 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262989>262989</A>
TERMINATE: b0pcall11 is stuck.
<!-- Author: Susan -->
<!-- Comment: Tue Jun  3 01;23;07 comment by...Susan -->
Shepherded.
<!-- Date: Tue Jun 3 01:19:21.222 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262990>262990</A>
ACTIVATE: RunSet: SMQIECALIB 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 01:21:29.634 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262989>262989</A>
CALIBRATION: <U><B>smx</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#smx target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Tue Jun  3 01;23;30 comment by...Britney Rutherford -->
calibration looks fine.
<!-- Date: Tue Jun 3 01:23:02.519 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262990>262990</A>
TERMINATE: Same problem.
<!-- Author: Susan -->




<!-- Date: Tue Jun 3 01:24:28.753 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262991>262991</A>
ACTIVATE: RunSet: SMQIECALIB 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 01:25:40.168 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262991>262991</A>
TERMINATE: Done.
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 01:27:31.518 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262991>262991</A>
CALIBRATION: <U><B>smx</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#smx target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Tue Jun  3 01;28;30 comment by...Britney Rutherford -->
again, looks great.

<!-- Date: Tue Jun 3 01:32:17.666 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992>262992</A>
 Activated at 2008.06.03 01:32:02
<!-- Author: RunControl -->


<!-- Date: Tue Jun 3 01:32:18.326 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992>262992</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_5_01 [7,1088,721] 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 01:32:19.769 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992>262992</A>
 Activated at 2008.06.03 01:32:02
<!-- Author: RunControl -->


<!-- Date: Tue Jun 3 01:32:20.005 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992>262992</A>
ACTIVATE: RunSet: AAA_CURRENT  Trigger: PHYSICS_5_01 [7,1088,721] 
<!-- Author: Susan -->



<!-- Date: Tue Jun 3 01:44:07.830 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-2698&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-2698  width='300' align='top'></a></td><td>Updated PPR plot from YMON.</td></tr></table>
<!-- Author: Susan -->
<!-- Comment: Tue Jun  3 01;52;35 comment by...Britney Rutherford -->
Marvelous.  Good-night, everyone.

<!-- Comment: Tue Jun  3 01;53;40 comment by...Britney Rutherford -->
For anyone who is unfamiliar, the dead channels in this plot are a known existing problem that we're working on.

<!-- Comment: Tue Jun  3 02;00;27 comment by...kruse -->
Great thanks. We just paged you to ask about these, so you can
ignore!


<!-- Date: Tue Jun 3 02:12:32.947 2008 -->
Trigger inhibit was set for PES Low Voltage trip. PSM was red in iFix. Pulling up details reveals that in the west plug SMD01W and SMD08-12W are red and SMD02-07W are purple. Steve Hahn is here and suggested I disable the PES LV inhibit so we can continue to run while we try to restart the monitoring PC and do other tests. We are running.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->
<!-- Comment: Tue Jun  3 02;54;50 comment by...Susan -->
After Steve restarted voltman and the PSM errors disappeared I re-enabled the PES LV inhibit.
<!-- Date: Tue Jun 3 02:28:18.073 2008 -->
HBM button is red in iFix. I acknowledged the error message that poppped up when I clicked on the iFix background server.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->
<!-- Comment: Tue Jun  3 02;53;48 comment by...Susan -->
This turned green again a few minutes after I acknowledged the pop-up.
<!-- Date: Tue Jun 3 02:36:43.475 2008 -->
<h3>Trying to reconstruct what happened end of evening shift</h3> 
 
<p>Here's what I learned talking to Michael before he left, Jim 
Loskot who is still here as process system tech, and the current 
shift crew.  Apparently, this started with PSM going bad for the 
entire west endplug.  According to Jim, it was only the SMD crates 
(<u>not</u> the VME crates) and the top half (SMDPW_2-SMDPW_7) were 
purple, indicating communications problems, while the lower 
half (SMDPW_1 and SMDW08-SMDW12) were red.  He checked one of the red crates 
and found the -15 V and -7.5 V channels were reading out -25 V, 
which also indicates a communications problem.  At the same time, 
runControl received a PES LV inhibit.</p> 
 
<p>The SciCo called Jim and asked if there was anything he  
could do.  He replied he could power cycle the 400 Hz for the 
west plug, which was done twice.  When this didn't work, he 
also tried power cycling the 60 Hz, which unfortunately tripped 
the solenoid due to the crash button (or is this right?  I  
thought the crash button was on the east side.)  He did catch 
it right away ramping down, and the shift crew put the TOF and 
COT quickly to standby.  So, it did not take long to ramp back 
up to full field, and attempt to take data again.  However, 
now we have this problem with several of the wedges in PPR  
looking bad.  We have currently done a beam on SMX calibration, 
and that looks OK.  Now to see if the problem in data has gone 
away.</p> 
 
<p>A few observations about the above: the original PSM problem 
sounds very much like the symptoms we see when there are  
grounding problems for the endplugs.  However, since the daisy 
chain goes through one side of the VME crates, then the SMD 
crates, and then the other side, we usually see some portion of 
the VME crate bad, also.  Here, this was not the case.  Another 
possibility that comes to mind is that the VOLTMAN program just 
lost its mind and restarting it solved all the problems.</p> 
 
<p>In the process of writing this nonsense, PSM again had the 
same error.  We had already started taking data after the  
SMXQIE calibration seemed to solve the new problems in the 
PPR (the two bad half-wedges, which are an old problem, remain 
a problem).  Now that we knew it was a false alarm, we masked 
the PES LV and continued to take data.  I then tried only  
power cycling the PSM power supply, which did not solve the 
problem.  I then tried the Dervin prescription: killing the 
VOLT.EXE program, then power cycling the PSM power supply, 
and restarting VOLT.EXE.  This worked, everything came back 
green!</p>
<!-- Author: Steve Hahn :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->
<!-- Comment: Tue Jun  3 02;39;35 comment by...Steve Hahn -->
<table border=0><td><tr><td bgcolor=#e0e030><p>I suspect we have a real intermittent problem with the
cabling or grounding on the west plug.  If this is the case,
these PSM symptoms could recur anytime.  For the remainder of
the owl shift, if they do return, just mask the PES LV inhibit
and continue running.  We will formulate a plan in the morning.</p></td></tr></td></table>


<!-- Comment: Tue Jun  3 06;07;08 comment by...lindgren -->
<pre>There may be a ground problem on the west plug PSM serial
line, which I think is tied to ground through a resistor.
I do not think that power cycling the 400 hz to the detector
is the place to start if we lose PSM communications.  I would
have power cycled the PSM ps first a couple of times, then
done as Steve did in shutting down the Voltman pc and ps
and starting fresh.  We never used to have to do this, and
I suspect that it is also possible that we have a B&B module
somewhere that could be the cause of the problem.  We have
had times in the distant past where one of them losing its
address caused loss of communication through the rest of
the line.  Does not seem to be an exact fit to this situation
though.  Do we know which was the first module in the serial
line that we could not communicate with?  If there were
modules where we never lost communication we might be able
to get a fix on a problem area by starting the search near
them.  I have the cabling plan somewhere and will look at
it when I get in and talk to Steve and Dervin. </pre>
<!-- Comment: Tue Jun  3 07;52;46 comment by...Dervin -->
There is a Crash Button on both sides
<!-- Date: Tue Jun 3 02:41:54.557 2008 -->
<p>I also note that almost all iFIX PCs are running an 
administrator virus scan started at 0200.  I don't think this 
is causing a problem on VOLTMAN, but it certainly seems to be 
related to heartbeat alarms from MUON3.  For the moment, I've 
requested these run to completion if possible.</p>
<!-- Author: Steve Hahn :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->
<!-- Comment: Tue Jun  3 02;59;12 comment by...Susan -->
We are seeing heartbeat alarms on CES, CMU, CMP, CMX, and BMU presumably from the virus scan on MUON3. Waiting them out...
<!-- Comment: Tue Jun  3 04;07;25 comment by...Susan -->
No heartbeat alarms for awhile.
<!-- Date: Tue Jun 3 02:42:41.930 2008 -->
Done TO for b0imu00. Auto HRR.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->





<!-- Date: Tue Jun 3 03:04:04.078 2008 -->
b0pcal04 unresponsive. Shepherded it.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->


<!-- Date: Tue Jun 3 03:17:36.166 2008 -->
RXPT error for b0svt03 followed by L2TO. Auto HRR + 2 manual HRRs fixed it.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->


<!-- Date: Tue Jun 3 03:22:56.439 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-2703&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-2703  width='300' align='top'></a></td><td>Two pinkies. VBias1 ISL B5W0L2 just happened, but it also 
looks like an old one wasn't previously recorded:  
VBIAS ISL B3W0L1. Both have been put on ignore. 
BTW, the current pinkie alarm is hardly noticeable.</td></tr></table>
<!-- Author: kruse -->


<!-- Date: Tue Jun 3 03:23:48.052 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-2704&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-2704  width='300' align='top'></a></td><td>This was one missed previously.</td></tr></table>
<!-- Author: kruse -->


<!-- Date: Tue Jun 3 03:43:27.666 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-2705&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-2705  width='300' align='top'></a></td><td>pinkie on VBIAS ISL B4W1L1. Put on ignore.</td></tr></table>
<!-- Author: kruse -->


<!-- Date: Tue Jun 3 03:50:50.920 2008 -->
Done TO for b0cot16. Auto HRR.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->
<!-- Comment: Tue Jun  3 05;57;32 comment by...Susan -->
Again.
<!-- Date: Tue Jun 3 03:59:02.855 2008 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2008&action=view&page=-2706&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2008&action=view&page=-2706  width='300' align='top'></a></td><td>Yet another pinkie....frequency seems to be increasing. 
This time its VBIAS SVX B5W7L2. On ignore.</td></tr></table>
<!-- Author: kruse -->



<!-- Date: Tue Jun 3 04:27:11.189 2008 -->
ENCP To Tape is red in ProcMon. If this error does not disappear within 4 hours, we will need to email the data handling group.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->
<!-- Comment: Tue Jun  3 05;45;27 comment by...Susan -->
Green again.
<!-- Comment: Tue Jun  3 06;32;51 comment by...Susan -->
Red again.
<!-- Date: Tue Jun 3 04:33:36.882 2008 -->
CMX NE Wedge 20 trip. Successfully powered it back on.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->


<!-- Date: Tue Jun 3 04:39:27.312 2008 -->
Autohockerization of PS #7 causing ISL and LOO inhibits. SAR recovered the trip. (Nice messages at the run control terminal!!)
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->


<!-- Date: Tue Jun 3 05:04:18.501 2008 -->
We had hearbeat alarms for CPR and CLC.  I checked the CLC PC and saw the usual pop-up box about a memory error. I closed the monitoring program and restarted it. This sent inhibits for CLC and CPR. When the monitor came back on, the voltages for CLC and CPR all read 0 and there were no monitoring cycles in the terminal. I checked the displays on the CLC and CPR CAEN on the first floor. Both were responsive. When I tried to kill and restart  the monitor again (after some time in which the PC appeared to be frozen), the CLC voltage was at 100%, but I had to turn CPR on. This took a long time, but now we are running again.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->
<!-- Comment: Tue Jun  3 09;42;10 comment by...convery -->
Looks like the usual problem except that the monitoring didn't start correctly on the first try for some reason.  thanks for the details
<!-- Date: Tue Jun 3 05:38:33.120 2008 -->
b0pcal02 became unresponsive. Shepherded it.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->



<!-- Date: Tue Jun 3 05:47:47.630 2008 -->
TOF HV trip. Cleared itself immediately.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->




<!-- Date: Tue Jun 3 06:20:02.067 2008 -->
Water Alarm. The temperature of chiller TE66 was at 44.7 F and the upper limit is 43. Mark called the Cryo Tech. He explained that an expert was working on the chillers but hadn't notified him. In the meantime, the temperature has gone back to a normal value.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->



<!-- Date: Tue Jun 3 06:45:49.065 2008 -->
MCR called saying they'll end the store in 15 minutes.  
<!-- Author: kruse -->


<!-- Date: Tue Jun 3 06:47:28.043 2008 -->
CMX SW Wedge 15 trip. Tried to power it back on unsuccessfully and we are about to go into end of store.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992' target=_top>262992</a>) -->
<!-- Comment: Tue Jun  3 07;54;24 comment by...Phil -->
Cathode tripped a couple of times (4) for Susan. I turned it on just now; it was fine for a ocupole of minutes at least. It's now back down. Even the miniskirt won't take proton injection.
<!-- Comment: Tue Jun  3 11;58;16 comment by...phil -->
also been fine from the beginning of store 6188
<!-- Date: Tue Jun 3 06:47:56.708 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992>262992</A>
 Terminated at 2008.06.03 06:47:38
<!-- Author: RunControl -->


<!-- Date: Tue Jun 3 06:47:57.027 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262992>262992</A>
TERMINATE: End of store.
<!-- Author: Susan -->



<!-- Date: Tue Jun 3 06:53:50.167 2008 -->
Notified MCR we're ready for the store to be dropped. 
We won't have any quiet time, and will go straight into 
shot setup.
<!-- Author: kruse -->

<!-- Date: Tue Jun 3 07:00:19.037 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262993>262993</A>
ACTIVATE: RunSet: ACE_QIE 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:00:20.638 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262993>262993</A>
TERMINATE: Done.
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:01:16.666 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262993>262993</A>
CALIBRATION: <U><B>calqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#calqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Tue Jun  3 07;14;06 comment by...Barnett -->
Checked OK
<!-- Date: Tue Jun 3 07:01:17.776 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262994>262994</A>
ACTIVATE: RunSet: CALIB_CLC_QIE 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:02:17.563 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262994>262994</A>
TERMINATE: Done.
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:02:18.661 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262994>262994</A>
CALIBRATION: <U><B>clcqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#clcqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Tue Jun  3 07;16;25 comment by...Barnett -->
Checked OK
<!-- Date: Tue Jun 3 07:02:18.864 2008 -->
When it is time to restart ScalerMon, please start again the test version. To do so, open a xterm window and type:<pre> 
>setup fer test 
>scaler</pre> 
You should see "Version (fer package) test" in the lower section of ScalerMon Gui. 
Thank you.
<!-- Author: Donatella -->

<!-- Date: Tue Jun 3 07:06:28.364 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262995>262995</A>
TERMINATE: Stuck in partition.
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:07:59.413 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262996>262996</A>
ACTIVATE: RunSet: CALIB_QIE_FWD 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:08:00.368 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262996>262996</A>
TERMINATE: Done.
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:08:01.671 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262995>262995</A>
CALIBRATION: <U><B>bscqie</B></U> calibration FAILED, please investigate
<!-- Author: CDFCALIB -->


<!-- Date: Tue Jun 3 07:10:08.285 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262997>262997</A>
ACTIVATE: RunSet: ACE_TOF_QIE_NEW 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:10:09.578 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262997>262997</A>
CALIBRATION: <U><B>tofqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#tofqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Tue Jun  3 07;19;15 comment by...Barnett -->
Checked OK
<!-- Date: Tue Jun 3 07:10:10.884 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262997>262997</A>
TERMINATE: Done.
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:12:19.058 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262998>262998</A>
ACTIVATE: RunSet: SMQIECALIB 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:13:33.843 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262998>262998</A>
TERMINATE: Done.
<!-- Author: Susan -->



<!-- Date: Tue Jun 3 07:16:03.891 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262999>262999</A>
ACTIVATE: RunSet: ACE_LED_ALL 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:16:25.997 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262999>262999</A>
TERMINATE: Done.
<!-- Author: Susan -->



<!-- Date: Tue Jun 3 07:16:44.301 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262999>262999</A>
CALIBRATION: <U><B>cemled</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cemled target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Tue Jun  3 07;21;44 comment by...Barnett -->
Checked OK
<!-- Date: Tue Jun 3 07:16:45.768 2008 -->
Shot setup underway.
<!-- Author: kruse -->

<!-- Date: Tue Jun 3 07:18:00.271 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263000>263000</A>
ACTIVATE: RunSet: COTCALIB_ACE 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:18:01.474 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263000>263000</A>
TERMINATE: Done.
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:18:52.957 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=262998>262998</A>
CALIBRATION: <U><B>smx</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#smx target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->



<!-- Date: Tue Jun 3 07:20:10.222 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263001>263001</A>
ACTIVATE: RunSet: CALIB_MUON_ALL1 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:20:11.372 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263001>263001</A>
TERMINATE: Done.
<!-- Author: Susan -->



<!-- Date: Tue Jun 3 07:22:27.039 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263000>263000</A>
CALIBRATION: <U><B>cot</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cot target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Tue Jun  3 08;02;54 comment by...Barnett -->
Checkec OK
<!-- Date: Tue Jun 3 07:23:53.435 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263002>263002</A>
ACTIVATE: RunSet: XEF_ALL 
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:24:35.826 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263002>263002</A>
TERMINATE: Done.
<!-- Author: Susan -->


<!-- Date: Tue Jun 3 07:24:36.877 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263002>263002</A>
CALIBRATION: <U><B>calxef</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#calxef target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Tue Jun  3 08;01;05 comment by...Barnett -->
Checked OK
<!-- Date: Tue Jun 3 07:31:47.481 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263003>263003</A>
 Activated at 2008.06.03 07:31:33
<!-- Author: RunControl -->



<!-- Date: Tue Jun 3 07:32:06.423 2008 -->
L2 Decision TO. Auto HRR.
<!-- Author: Susan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263003' target=_top>263003</a>) -->

<!-- Date: Tue Jun 3 07:32:13.486 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263003>263003</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,1019,706] 
<!-- Author: Susan -->




<!-- Date: Tue Jun 3 07:56:30.382 2008 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=262988 target=_runSummary>262988</A> x4034C</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [7,1088,721]</FONT></TD>
<TD ALIGN=CENTER>00:07:18</TD>
<TD ALIGN=CENTER>01:03:56</TD>
<TD ALIGN=CENTER>00:50:25</TD>
<TD ALIGN=RIGHT>     306,296</TD>   <TD ALIGN=RIGHT>    337.48</TD>
<TD ALIGN=RIGHT>    297.20</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN=262992 target=_runSummary>262992</A> x40350</TD>
<TD>BEAM</TD>
<TD><FONT SIZE=-1>PHYSICS_5_01 [7,1088,721]</FONT></TD>
<TD ALIGN=CENTER>01:32:02</TD>
<TD ALIGN=CENTER>06:47:38</TD>
<TD ALIGN=CENTER>04:31:32</TD>
<TD ALIGN=RIGHT>   1,674,969</TD>   <TD ALIGN=RIGHT>  1,488.43</TD>
<TD ALIGN=RIGHT>  1,277.20</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD>
<TD ALIGN=CENTER>1</TD></TR>

<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>07:55:00</TD>
<TD ALIGN=CENTER>05:21:57</TD>
<TD ALIGN=RIGHT>     1,981,265</TD> <TD ALIGN=RIGHT>  1,825.91</TD>
<TD ALIGN=RIGHT>  1,574.40</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Jun 3 07:58:50.416 2008 -->
<font color=red>Shift Summary: </font><pre>Shift began with the solenoid having just tripped and several alarms sounding (not what you want to walk into at midnight!). See elog for details and possible scenarios for what caused it. Appears to be a problem with the monitoring crates -- experts will look into it further today (documented in elog entry from 02:36). 
 
Also some problems with the PSM. Elog has details from Steve Hahn on how to recover from them, but needs to be further investigated also. 
 
Just before store ended CMX wedge tripped that couldn't be brought up again. Phil S. will take a look before we start the next data run. 
 
End shift during shot setup. Though final protons estimated to still be about 40 minutes away. 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   262988 262992
Delivered Luminosity   2014.4 nb-1  
Acquired Luminosity    1574.4 nb-1  
Efficiency             78.2
   
</td></tr></table></pre>
<!-- Author: Mark Kruse -->




<!-- Date: Tue Jun 3 08:03:41.819 2008 -->
Final protons are being loaded
<!-- Author: Louise :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263003' target=_top>263003</a>) -->

<!-- Date: Tue Jun 3 08:04:09.089 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263003>263003</A>
 Terminated at 2008.06.03 08:03:45
<!-- Author: RunControl -->


<!-- Date: Tue Jun 3 08:08:12.388 2008 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263004>263004</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_5_01 [7,1088,721] 
<!-- Author: Susan -->



<!-- Date: Tue Jun 3 08:08:36.345 2008 -->
cmu00 done TO auto HRR fixed it
<!-- Author: Louise :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=263004' target=_top>263004</a>) -->