<!-- Title: Day shift. Fri Oct 19, 2007 -->
<!-- SciCo: Manfred Paulini -->
<!-- DAQAce: Glenn Strycker -->
<!-- MonAce: &nbsp; -->
<!-- CO: &nbsp; -->
<!-- OpManager: Steve Hahn -->
<!-- Notes: -->
<pre>Back in the control room: Plan still the same: Run Cosmics, L2 torture, do calibrations, let experts debug system (L2, XFT, ...)</pre>


<!-- Date: Fri Oct 19 08:15:41.419 2007 -->
What out for 2-3 hours of QT to do special calibrations (see white board)
<!-- Author: Manfred :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252127' target=_top>252127</a>) -->
<!-- Comment: Fri Oct 19 08;25;43 comment by...Manfred -->
This should read: Watch out for 2-3 hours ... Oh boy, what do I do without Advanced Edit????


<!-- Date: Fri Oct 19 08:28:16.381 2007 -->
Solenoid ramping to 2000 A as request (and done) by Cryo
<!-- Author: Manfred :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252127' target=_top>252127</a>) -->


<!-- Date: Fri Oct 19 08:35:47.036 2007 -->
<pre>super-quick beginning of shift summary (sqboss) 
------------------------------------------------ 
 
- everything is green (!) on vxworks, global alarms, process system alarms, HV, etc.  Even PSM is green now!  Treat ALL warnings as REAL now. 
 
- there are missing parts to the process system alarms... Steve is trying to get the blocks that are usually below the PSM button to come back. 
 
- YMon is running on the computer to the right of the concon computer.  Concon will show YMon as red (not running), but it is.  If it DOES crash on the other computer, however, we are to email Jiyeon and go ahead and restart it on the concon computer. 
 
- If "ignoreReces" is not set we get a lot of L2TOs, even when all of the crates are included.  This is known, and Laura said yesterday (see elog) that she will investigate today. 
 
- Noise in the muon tracking (see owl shift elog).  Phil is aware and will investigate. 
 
- Request for quiet-time calibrations to be done today... we have to wait until we get the "all-clear" from the MCR.</pre>
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 08:37:41.184 2007 -->
There are some problems with the usual code running on vnode1 (process systems alarms, etc)... Steve was investigating the missing parts of process system alarms when the whole program crashed.  He is currently debugging it.
<!-- Author: Glenn Strycker -->
<!-- Comment: Fri Oct 19 08;51;10 comment by...G.S. -->
It's fixed.

<!-- Date: Fri Oct 19 09:19:56.296 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252127>252127</A>
 Terminated at 2007.10.19 09:19:07
<!-- Author: RunControl -->


<!-- Date: Fri Oct 19 09:19:57.423 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252127>252127</A>
TERMINATE: Running smoothly... so let's run L2_TORTURE and see if there are any problems we can find.
<!-- Author: Glenn Strycker -->
<!-- Comment: Fri Oct 19 09;39;54 comment by...Laura -->
Please, include RECES. If L2 TO happens, put the system in halt and call me ( 3464 ).
<!-- Comment: Fri Oct 19 09;54;48 comment by...Manfred -->
Having problems to get beyond EVB in partitioning. Page L3 to see how to clean up EVB. 
<!-- Date: Fri Oct 19 09:27:06.772 2007 -->
I am working on the tomcat web server. You may get sporadic Procmon warnings ... (I am at x3986)
<!-- Author: Donatella T. -->



<!-- Date: Fri Oct 19 09:49:46.297 2007 -->
<pre>I tried to run L2 torture and couldn't get past the partition step.  The evb2b and csl crates were yellow and all others are white (sometimes l2ctrlb is yellow), so I think L3 is stuck.  I looked at the DAQ monitor and saw that the EVB Proxy is red, so that confirmed my hunch. 
 
I looked at the help web page and followed the steps for "EVB Proxy is red in DAQMON", "EVB2b fails PARTITION or CONFIG transition", and " Level 3 fails at PARTITION transition"... that is, I clicked "check EVB proxy" and "check SCPUs" in the Ace Control program and saw no errors.  I reset RTServer.  I tried to reset and repartition, but got the same stuck state.  I cleaned up the L3 farm as suggested under "Level 3 fails at PARTITION transition" on the web page.  Anyway, THAT didn't work either.  I think we need to page L3. 
 
This problem might be L2, since that is upstream from L3, the l2crtlb (TEST_L2PULSAR_TED) is yellow, and I know Laura wants to work on L2 problems anyhow.  Manfred and I will try a few more things here and then page L3 and/or L2 when we have a better idea of the issue.  I already sent an email to L3 so that they are aware of our work and possible tests.</pre>
<!-- Author: Glenn Strycker -->
<!-- Comment: Fri Oct 19 10;05;21 comment by...Glenn Strycker -->
<pre>Si came in and helped us.  It turns out that even though "check EVB Proxy" SAID the proxy was running, it in fact wasn't.  That is, the red status box is NOT a spurious warning, but really means the proxy is down.  A simple "clean-up EVB" brought it back to green right away, and I was able to partition normally.  The L3 web page should be updated to reflect this so that the Ace is not afraid to "clean-up EVB".</pre>
<!-- Date: Fri Oct 19 10:05:06.347 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252128>252128</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [19,979,705] -- Normal settings, RECES included.  We got a Done TO right away (crate b0svt09), so we will page Laura as requested.
<!-- Author: Glenn Strycker -->
<!-- Comment: Fri Oct 19 10;12;27 comment by...Laura -->
Page only in case of L2 decision TO. I want to be sure  that RECES problem is due to showermax data not coming. 

<!-- Comment: Fri Oct 19 10;14;09 comment by...G.S. -->
Laura said to go ahead and reset.  It worked for a while, and now we have a DECISION time out, which is what Laura wanted to see, so we put the state into HALT and gave her a call.

<!-- Comment: Fri Oct 19 10;20;58 comment by...G.S. -->
Laura worked on it from her office.  She called back just now and gave us the go-ahead to Recover and Run.

<!-- Comment: Fri Oct 19 10;28;58 comment by...G.S. -->
Another L2 Decision TO -- we called Laura.

<!-- Comment: Fri Oct 19 10;30;11 comment by...Laura -->
I've done. Ignore RECES if you want to avoid the L2 Decision TO

<!-- Comment: Fri Oct 19 10;30;18 comment by...G.S. -->
We recovered and run.  Laura said we don't have to keep calling her anymore, so we'll go ahead and do HRRs as before.  I'll put things back to autoHRR.


<!-- Date: Fri Oct 19 10:38:22.064 2007 -->
Alison and Laura came to do some XFT/L2 work - we step aside to let the power women take over ...
<!-- Author: Manfred :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252128' target=_top>252128</a>) -->

<!-- Date: Fri Oct 19 10:48:47.204 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252129>252129</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [19,979,705] testing masking on XTC fibers send to L2 Control Node... don't see any messages anywhere...
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 10:59:13.208 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252130>252130</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [19,979,705] 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 11:03:01.728 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252131>252131</A>
 Activated at 2007.10.19 11:02:54
<!-- Author: RunControl -->


<!-- Date: Fri Oct 19 11:05:24.514 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252131>252131</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,978,706] 
<!-- Author: Glenn Strycker -->



<!-- Date: Fri Oct 19 11:12:15.621 2007 -->
Rumor has it that DHCP server is down.  So people connecting 
with laptops without a fixed IP will have problems.  DataComm 
is aware.
<!-- Author: jj -->


<!-- Date: Fri Oct 19 11:20:51.143 2007 -->
I looked a bit at the noise in CMX. The oscillation on the south went away when I ramped down wedges 7/8. This is what I expected to happen. The wedge 4 stuff did not when I ramped down 4/5. That is now what I expected. I left the 4 wedges off. I was just too lazy to ramp them back up.
<!-- Author: Phil -->


<!-- Date: Fri Oct 19 11:51:17.711 2007 -->
GAM went red in global alarms -- everything was in the "@@@@@" state, which means a communications error.  I went downstairs to see if the computer was off and couldn't find anything wrong.  I came back upstairs and the problem had "fixed itself".  Nice.
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 11:57:17.507 2007 -->
Checked in with MCR about no beam in the Tev. They think there might be no beam for another 1/2 to 1 h. MCR will call when they inject beam again. We will use this time to do QT calibrations.
<!-- Author: Manfred :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252131' target=_top>252131</a>) -->


<!-- Date: Fri Oct 19 11:57:50.747 2007 -->
Alison is done with her tests, COSMICS run is going smoothly, and we called MCR and found that there will be at least 30 minutes of quiet time in the Tevatron.  Time to do Quiet Time Calibrations!
<!-- Author: Glenn Strycker -->

<!-- Date: Fri Oct 19 11:59:04.368 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252131>252131</A>
 Terminated at 2007.10.19 11:58:02
<!-- Author: RunControl -->


<!-- Date: Fri Oct 19 11:59:05.035 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252131>252131</A>
TERMINATE: good run, but time for calibrations.
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 11:59:58.218 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252132>252132</A>
ACTIVATE: RunSet: ACE_QIE 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 12:03:17.406 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252132>252132</A>
CALIBRATION: <U><B>calqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#calqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct 19 13;45;55 comment by...Glenn Strycker -->
BAD -- WHA channel 10 19W has 0 mean and -1 sigma.  It is also listed in the bad slope list.  I will email the experts anyway since this is the first quiet-time calibration done in the last few days.
<!-- Date: Fri Oct 19 12:03:18.769 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252133>252133</A>
ACTIVATE: RunSet: CALIB_CLC_QIE 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 12:03:19.125 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252133>252133</A>
CALIBRATION: <U><B>clcqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#clcqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct 19 13;49;54 comment by...Glenn Strycker -->
Good.
<!-- Date: Fri Oct 19 12:06:27.712 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252134>252134</A>
ACTIVATE: RunSet: CALIB_QIE_FWD 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 12:06:28.928 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252134>252134</A>
CALIBRATION: <U><B>bscqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#bscqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct 19 13;54;18 comment by...Glenn Strycker -->
ok, I think.  A few plots are green instead of blue as in the reference plots.  I emailed the experts.
<!-- Comment: Fri Oct 19 14;20;42 comment by...Glenn Strycker -->
Mary Convery informs me that this can be marked as good and the calibration page may be updated at a later time if the plots stay this color.
<!-- Date: Fri Oct 19 12:12:30.940 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252135>252135</A>
ACTIVATE: RunSet: BOTHPLUGS_NORMAL 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 12:20:35.880 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252136>252136</A>
ACTIVATE: RunSet: BOTHPLUGS_MM_C 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 12:22:45.886 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252136>252136</A>
CALIBRATION: <U><B>pluglaser</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#pluglaser target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct 19 13;06;08 comment by...Glenn Strycker -->
BAD -- TDC mean for E-PHA is 541.9, which is low.
<!-- Date: Fri Oct 19 12:24:01.655 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252137>252137</A>
ACTIVATE: RunSet: BOTHPLUGS_MM 
<!-- Author: Glenn Strycker -->



<!-- Date: Fri Oct 19 12:31:20.607 2007 -->
First the ICICLE heartbeat went off, then ICICLE completely crashed -- there was an error message on Solenoid2.  I closed the error and the program closed.  I re-opened ICICLE.  It appears to be working and the ProcMon box went back to green.  The heartbeat is still missing, but I'll give that 10 minutes for the update to take effect.
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 12:32:40.217 2007 -->
Matt Jones called from Purdue and is using the WCAL crates, so I'm putting off the PMT Spike Run Calibration.  He said he'd be done in < 20 mins, so I'll just leave the system in the Start state.
<!-- Author: Glenn Strycker -->

<!-- Date: Fri Oct 19 12:34:49.062 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252138>252138</A>
ACTIVATE: RunSet: TOF_TAC_CALIB Testing new TAC calibration consumer built in /cdf/onln/home/cdfdaq/consumers/code/TofTacCalib/TofTac_6.1.4_Fall2007
<!-- Author: M Jones 765-496-2464 -->


<!-- Date: Fri Oct 19 12:39:05.804 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252138>252138</A>
TERMINATE: Ooops.
<!-- Author: M Jones 765-496-2464 -->


<!-- Date: Fri Oct 19 12:47:49.000 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252139>252139</A>
ACTIVATE: RunSet: TOF_TAC_CALIB Trying a second time...
<!-- Author: M Jones 765-496-2464 -->


<!-- Date: Fri Oct 19 12:49:47.827 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252139>252139</A>
TERMINATE: Nope... it didn't seem to run the consumer script.
<!-- Author: M Jones 765-496-2464 -->



<!-- Date: Fri Oct 19 12:52:43.543 2007 -->
<pre>I built a new TOF TAC calibration consumer in /cdf/onln/home/cdfdaq/consumers/code/TofTacCalib/TofTac_6.1.4_Fall2007/ 
which should fix the problem of supposedly bad channels (which 
aren't really bad) not ending up in the right database table 
which will also fix the white boxes seen in DBAna. 
Unfortunately, I couldn't get run control to invoke the startup script... 
Maybe a clever ACE can figure it out!</pre>
<!-- Author: M Jones -->


<!-- Date: Fri Oct 19 12:55:09.413 2007 -->
<pre>From the Tev elog: 
12:26:05-  
Current Status 
 
# PAK3 has problems that probably require replacing components in the tank. 
# We have given D0 an hour of time where we will not run beam while the kicker guys run PAK3 at high voltage. 
# If the kicker tank work is needed, it will take 4 to 6 hours. During that time we would run only 150 GeV beam with the other 4 Proton abort kickers turned up by 20%. 
# If the kicker work requires a long session of conditioning, we would probably have to run no beam during that time. - annala  </pre>
<!-- Author: Phil -->

<!-- Date: Fri Oct 19 13:04:00.999 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252140>252140</A>
 Activated at 2007.10.19 13:03:40
<!-- Author: RunControl -->


<!-- Date: Fri Oct 19 13:04:01.612 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252140>252140</A>
ACTIVATE: RunSet: ACE_CALORIMETER_MINIMAL  Trigger: SUMET5 [7,983,706] 
<!-- Author: Glenn Strycker -->



<!-- Date: Fri Oct 19 13:11:55.431 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252140>252140</A>
 Terminated at 2007.10.19 13:11:12
<!-- Author: RunControl -->
<!-- Comment: Fri Oct 19 13;17;27 comment by...Glenn Strycker -->
L1A = 66.8 Hz.  Ok (between 40-100Hz)
<!-- Date: Fri Oct 19 13:13:46.332 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252141>252141</A>
ACTIVATE: RunSet: ACE_TOF_QIE_NEW 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 13:14:30.472 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252141>252141</A>
CALIBRATION: <U><B>tofqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#tofqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct 19 13;55;01 comment by...Glenn Strycker -->
Good.
<!-- Date: Fri Oct 19 13:15:55.956 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252142>252142</A>
ACTIVATE: RunSet: SMQIECALIB 
<!-- Author: Glenn Strycker -->



<!-- Date: Fri Oct 19 13:18:50.632 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252142>252142</A>
CALIBRATION: <U><B>smx</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#smx target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct 19 13;55;14 comment by...Glenn Strycker -->
Good.
<!-- Date: Fri Oct 19 13:19:38.775 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252143>252143</A>
ACTIVATE: RunSet: ACE_LED_ALL 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 13:21:06.605 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252143>252143</A>
CALIBRATION: <U><B>cemled</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cemled target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct 19 13;55;36 comment by...Glenn Strycker -->
Good.
<!-- Date: Fri Oct 19 13:23:04.327 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252144>252144</A>
CALIBRATION: <U><B>cot</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cot target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct 19 13;57;06 comment by...Glenn Strycker -->
Good.
<!-- Date: Fri Oct 19 13:24:19.563 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252144>252144</A>
ACTIVATE: RunSet: COTCALIB_ACE 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 13:29:37.855 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252145>252145</A>
ACTIVATE: RunSet: XEF_ALL 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 13:31:17.610 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252145>252145</A>
CALIBRATION: <U><B>calxef</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#calxef target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct 19 13;57;23 comment by...Glenn Strycker -->
Good.
<!-- Date: Fri Oct 19 13:41:13.613 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252146>252146</A>
ACTIVATE: RunSet: CALIB_MUON_ALL1 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 13:42:03.885 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252146>252146</A>
TERMINATE: Wow, um, that was quick.  WAY less than 1 minute 30 seconds.
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 13:43:39.992 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252147>252147</A>
ACTIVATE: RunSet: TOF_TAC_CALIB 
<!-- Author: Glenn Strycker -->
<!-- Comment: Fri Oct 19 14;05;45 comment by...Glenn Strycker -->
no results posted -- I hope the old delay error isn't back.  I may re-run if I have time, but L2 women are here and using the entire system.

<!-- Comment: Fri Oct 19 14;07;23 comment by...Glenn Strycker -->
Manfred reminds me that Matt Jones was working on this system and it probably isn't back to full working order yet.  It may be ok to not worry about this calibration for now.

<!-- Date: Fri Oct 19 14:11:28.316 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252148>252148</A>
 Activated at 2007.10.19 14:11:24
<!-- Author: RunControl -->


<!-- Date: Fri Oct 19 14:12:38.685 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252148>252148</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,978,706] 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 14:12:39.673 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252148>252148</A>
 Terminated at 2007.10.19 14:12:02
<!-- Author: RunControl -->



<!-- Date: Fri Oct 19 14:17:46.805 2007 -->
The proton abort kicker mentioned earlier in Phil's entry needs 
to be repaired.  We are currently negotiating with Salah over 
running studies during conditioning of the kicker.
<!-- Author: jj -->



<!-- Date: Fri Oct 19 14:20:46.661 2007 -->
running with b0clifford(spare control node, instead of b0felix, (main control node) to test it.
<!-- Author: Laura -->

<!-- Date: Fri Oct 19 14:30:08.067 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252149>252149</A>
ACTIVATE: RunSet: L2_TORTURE_HEATHER  Trigger: L2_TORTURE_HEATHER [3,980,706] 
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 14:51:30.908 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252152>252152</A>
ACTIVATE: RunSet: L2_TORTURE_HEATHER  Trigger: L2_TORTURE_HEATHER [3,980,706] testing new firmware.  ignoreAbort set 1.
<!-- Author: Glenn Strycker -->



<!-- Date: Fri Oct 19 14:53:49.426 2007 -->
<pre>ACNET plot "SA" is not working on the Monitoring Ace's computer, but it is working on other terminals (or so I thought, but there are problems... see below).  JJ suggested restarting the program.  I closed it, but couldn't figure out how to reopen it, so I rebooted the computer.  The programs reloaded automatically upon reboot and are working correctly -- BUT PLOTS STILL AREN'T WORKING.  We are getting a message saying "Timeout of FTPMAN timing info reply after 3 tries, Node=TEVA" in two of the plot windows.  The RF sum plot is working.  I rechecked my work on a different terminal and found out that the plots weren't working there either.  It must be related to Tevatron work and the fact that we have no beam.</pre>
<!-- Author: Glenn Strycker -->
<!-- Comment: Fri Oct 19 14;59;13 comment by...Glenn Strycker -->
<pre>Steve says this problem may occur when too many people are using ACNET at once.  There are many people looking at plots right now as an important Tevatron decision is in process, so this is a reasonable idea.  We'll ignore for a while and try the plots later.

MCR confirms that they aren't able to see the plots either.</pre>
<!-- Comment: Fri Oct 19 15;10;47 comment by...Glenn Strycker -->
MCR called back -- we checked the plots, and they are back.  Problem fixed.
<!-- Date: Fri Oct 19 14:55:27.129 2007 -->
<pre>Early Shift Summary: 
 
- Mario M. will cover from 3-4 pm 
- the combined brain power of CDF operations is currently contemplating  
  over running TeV studies during conditioning of the PAK3 kicker 
- ran cosmics in beginning of shift, then L2 torture and did QT plus  
  other calibrations but did not get to do other calibs that require 
  3-4 h of QT 
- at other times system used for L2/XFT studies (currently ongoing) 
- YMON crashed which is currently being investigated 
- M. Jones tried to get TOF TAC calibrations going (unsuccessful) 
- otherwise no major issues 
</pre>
<!-- Author: Manfred :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252152' target=_top>252152</a>) -->

<!-- Date: Fri Oct 19 14:57:32.522 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252153>252153</A>
ACTIVATE: RunSet: L2_TORTURE_HEATHER  Trigger: L2_TORTURE_HEATHER [3,980,706] 
<!-- Author: Glenn Strycker -->



<!-- Date: Fri Oct 19 14:58:16.406 2007 -->
ignoreAbort set 1.
<!-- Author: heather :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252153' target=_top>252153</a>) -->


<!-- Date: Fri Oct 19 14:59:12.870 2007 -->
ignored l2stereo
<!-- Author: heather :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252153' target=_top>252153</a>) -->


<!-- Date: Fri Oct 19 15:04:21.691 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252154>252154</A>
ACTIVATE: RunSet: L2_TORTURE_HEATHER  Trigger: L2_TORTURE_HEATHER [3,980,706] ignoreAbort 0 in 00, 01.  ignoreAbort 1 in 02.  ignore l2 stereo -hkg
<!-- Author: Glenn Strycker -->


<!-- Date: Fri Oct 19 15:09:45.159 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252155>252155</A>
ACTIVATE: RunSet: L2_TORTURE_HEATHER  Trigger: L2_TORTURE_HEATHER [3,980,706] ignoreAbort set to 0 in all 3 xft pulsars. ignorel2stereo -hkg
<!-- Author: Glenn Strycker -->




<!-- Date: Fri Oct 19 15:17:46.457 2007 -->
We put in new control firmware in the xft pulsars (version 0xc710190).  When L2Abort is set to 0x1 (xft pulsars ignore abort bit coming from the tracklist board), bit 2 of the slink trailer word error flag is set to 0x1, otherwise this bit is 0x0.  We tested this and it seems to be work properly.  Alison needs to update the L2 code to account for this possibility.  This firmware is remaining in the pulsars. 
 
<p> Until the new code is ready, ignoreL2Stereo needs to be checked. </p>
<!-- Author: Heather and Alison -->

<!-- Date: Fri Oct 19 15:22:16.603 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252156>252156</A>
 Activated at 2007.10.19 15:19:52
<!-- Author: RunControl -->


<!-- Date: Fri Oct 19 15:22:17.195 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252156>252156</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,984,706] test new L2 tag (984) 
<!-- Author: Glenn x2080 -->


<!-- Date: Fri Oct 19 15:22:18.695 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252156>252156</A>
 Terminated at 2007.10.19 15:20:26
<!-- Author: RunControl -->


<!-- Date: Fri Oct 19 15:22:19.922 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252156>252156</A>
TERMINATE: test Ok but we stop for rebooting crates
<!-- Author: Glenn x2080 -->


<!-- Date: Fri Oct 19 15:25:19.591 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252157>252157</A>
 Activated at 2007.10.19 15:23:36
<!-- Author: RunControl -->


<!-- Date: Fri Oct 19 15:25:20.456 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252157>252157</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,984,706] 
<!-- Author: Glenn x2080 -->


<!-- Date: Fri Oct 19 15:25:21.485 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252157>252157</A>
 Terminated at 2007.10.19 15:24:54
<!-- Author: RunControl -->


<!-- Date: Fri Oct 19 15:28:56.509 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252158>252158</A>
 Activated at 2007.10.19 15:27:50
<!-- Author: RunControl -->


<!-- Date: Fri Oct 19 15:28:58.858 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252158>252158</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,984,706] 
<!-- Author: Glenn x2080 -->


<!-- Date: Fri Oct 19 15:28:59.934 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252158>252158</A>
 Terminated at 2007.10.19 15:28:53
<!-- Author: RunControl -->



<!-- Date: Fri Oct 19 15:30:10.459 2007 -->
<P> 
Glenn found that b0control15 session had partially  
hung up &minus; no mouse focus possible.   
<P> 
Tried killing mozilla, acroread and java, but still  
no response.  Give it "das reboot" 
<P>  
<!-- Author: badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252158' target=_top>252158</a>) -->


<!-- Date: Fri Oct 19 15:32:06.543 2007 -->
<P> 
Have updated <I>fer</I> package to version <i>v5_60</I> to  
placate the L2 monster.   This add hdwdb control over the  
SvtFilterSetting setting parameter (hdwdb version v2_1d). 
<P> 
Have restarted RunControl and rebooted all the L2 Pulsar  
crates b0l2pu00...05 
<P> 
Heather G. sez it works. 
<P>
<!-- Author: badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252158' target=_top>252158</a>) -->
<!-- Comment: Fri Oct 19 15;38;42 comment by...Glenn Strycker -->
After reboot, Bill Badgett helped me reload the programs usually on B0Control15, namely vxmon and dqmon.
<!-- Date: Fri Oct 19 15:34:12.920 2007 -->
<pre>YMon got the crashing around 2pm and the reason was 
 that YMon lost the connection after run. 
Now, I started YMon in Consumer Controller (standard one) without CES plots. 
At the same time, I started the new YMon in the local area 
 separatly to check if the ymon with changes has the crashing. 
</pre>
<!-- Author: Jiyeon Han :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252158' target=_top>252158</a>) -->
<!-- Comment: Fri Oct 19 15;46;46 comment by...Glenn Strycker -->
Note to the next Aces: Jiyeon told me that the program is now running through concon, but there is a text output window open on b0control13 that she would like kept open.  So don't kill any terminal windows on the plot display monitors.
<!-- Date: Fri Oct 19 15:35:50.012 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252159>252159</A>
 Activated at 2007.10.19 15:35:16
<!-- Author: RunControl -->


<!-- Date: Fri Oct 19 15:35:51.594 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=252159>252159</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,984,706] testing L2 tagset 984 with pulsar in ROL=0

<!-- Author: Glenn x2080 -->





<!-- Date: Fri Oct 19 15:50:27.304 2007 -->
PSM went red -- a crate on the 2nd floor went into alarm.  It turned out that L2/trigger people were working on it, so it's ok.  They said it might go off again while they work, so the next ace should be aware of this.
<!-- Author: Glenn Strycker -->

<!-- Date: Fri Oct 19 15:56:46.276 2007 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>15:55:01</TD>
<TD ALIGN=CENTER>::</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT></TD>
<TD ALIGN=RIGHT></TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Fri Oct 19 15:58:11.567 2007 -->
<font color=red>Shift Summary: </font><pre>No data.   
 
   Ongoing L2 torture studies. Problems with ACNET and  
YMON now resolved. </pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   00
Delivered Luminosity   0  
Acquired Luminosity    0  
Efficiency             -
   
</td></tr></table></pre>
<!-- Author: Mario Martinez -->