<!-- Title: Day shift. Fri Oct  5, 2007 -->
<!-- SciCo: Manfred Paulini -->
<!-- DAQAce: Joachim Heuser -->
<!-- MonAce: &nbsp; -->
<!-- CO: &nbsp; -->
<!-- OpManager: Steve Hahn -->
<!-- Notes: -->
Steve subbing for Manfred until he arrives.  


<!-- Date: Fri Oct 5 08:36:41.765 2007 -->
<pre>Still problems with: 
 
Filesystem: 
x Procmon is red because chech script timed out after 2.5 min. 
x Sounds like is it connected to the network problems at the 
  moment, but in theory we should not be affected by online 
  problems. 
 
L2 control: 
x Procmon check says: 
   ..CHECKING 
   ..CHECK FAILED 
   ..Connection closed by UNKNOWN 
x cannot login to b0felix 
x should in theory also not be affected by online problems 
 
 
I suspect that both are connected to the netowrk problems since the failed Procmon checks occured both at the same time around ~7:30. At the moment we are running cosmics without L2 so that 
neither Filesystem nor L2 are urgent. 
Will page both if network problems are solved but problem still persists.</pre>
<!-- Author: Joachim -->
<!-- Comment: Fri Oct  5 08;55;24 comment by...Joachim -->
both up again, so is the netowrk i presume
<!-- Date: Fri Oct 5 08:37:41.262 2007 -->
<p>Nelly Stanfield just called asking if we were having network 
problems which might explain her Oracle access problems.  We 
answered in the affirmative.  She was relieved it was not some 
other problem.</p>
<!-- Author: Steve Hahn -->


<!-- Date: Fri Oct 5 08:41:42.178 2007 -->
<pre>beginning of shift status:    
 
- currently running COSMICS  
  - L1A rate: 27.5 Hz  
  - L2  rate: 27.5 Hz     
  - deadtime: 0.02%   
 
- crates:   
   - CCAL05 runs again with SMXR 15 disabled  
 
- HV:    
  - WRN:      SVX/ISL 
  - WRN/NOT:  CEM/CHA/WHA/GAM 
  - STD:      PEM/PHA/PSH 
  - ON but really off: MNP/BSC 
  - OFF:      everything else 
 
Global Alarm status:   
  - CEM/CHA/WHA/GAM yellow (ok) 
  - PSM still red  
 
- Process System Alarms:   
  - yellow: CRYO, GAS, COT, PSM, RACKS  
  - green: HVAC, WATER, SILICON, SOLENOID  
 
- Miscellaenous:  
  - Procmon RED for "Filesystem" and "L2 Control" 
 
</pre>
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 08:43:29.314 2007 -->
<p>Trying to note any network-related problems since it appears 
we have no access outside the online subnet, so this is our 
oppurtunity to test we can continue running under such  
circumstances.  Earlier, I could not login to my account on 
b0scico01 at the ops manager's desk.  Second time after waiting 
for an extremely long time, it succeeded.  Joachim said he saw 
the same when trying to login to b0felix.  Maybe a problem with 
our local Kerberos ticket server?</p>
<!-- Author: Steve Hahn -->


<!-- Date: Fri Oct 5 08:45:39.441 2007 -->
Upgrades to offline switches in trailers and the core router 
in FCC failed this morning and brought down our offline network. 
Trailer switches should be back online but core router is still 
being repaired.  Should not be too much longer.
<!-- Author: jj -->


<!-- Date: Fri Oct 5 08:47:08.560 2007 -->
SciCo arrived (thanks Steve) noting the wonderful large new screen at the SciCo desk ...
<!-- Author: Manfred -->

<!-- Date: Fri Oct 5 08:52:21.326 2007 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>07:55:02</TD>
<TD ALIGN=CENTER>::</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT></TD>
<TD ALIGN=RIGHT></TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Fri Oct 5 08:54:56.160 2007 -->
Procmon is happy again!
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 09:18:05.824 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250886>250886</A>
 Terminated at 2007.10.05 09:16:42
<!-- Author: RunControl -->


<!-- Date: Fri Oct 5 09:21:57.676 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250887>250887</A>
ACTIVATE: RunSet: ACE_QIE 
<!-- Author: Claudia -->


<!-- Date: Fri Oct 5 09:22:50.118 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250887>250887</A>
TERMINATE: done
<!-- Author: Claudia -->



<!-- Date: Fri Oct 5 09:22:50.588 2007 -->
JJ called to let us know that network is not yet fixed; there are still problems with a central network router - more updates later
<!-- Author: Manfred -->

<!-- Date: Fri Oct 5 09:24:37.699 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250887>250887</A>
CALIBRATION: <U><B>calqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#calqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct  5 09;37;13 comment by...Joachim -->
BAD - see,  <a href=
'/cgi/elog/elog.pl?nb=2001&action=view&page=27&frame=2&anchor=09:11:33'> here </a>
<!-- Date: Fri Oct 5 09:24:56.423 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250888>250888</A>
CALIBRATION: <U><B>clcqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#clcqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct  5 09;39;14 comment by...Joachim -->
GOOD - from what i can tell it looks better than the reference...
<!-- Date: Fri Oct 5 09:26:28.525 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250888>250888</A>
ACTIVATE: RunSet: CALIB_CLC_QIE 
<!-- Author: Claudia -->



<!-- Date: Fri Oct 5 09:26:28.746 2007 -->
while powering up HV for the plug iFIX complained about PEM wedge 6, controlled by CAEN crate 2 ... 
 
... it went away after 1 minute
<!-- Author: Joachim -->

<!-- Date: Fri Oct 5 09:27:31.754 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250888>250888</A>
TERMINATE: done
<!-- Author: Claudia -->


<!-- Date: Fri Oct 5 09:29:38.693 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250889>250889</A>
ACTIVATE: RunSet: CALIB_QIE_FWD 
<!-- Author: Claudia -->


<!-- Date: Fri Oct 5 09:29:50.958 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250889>250889</A>
CALIBRATION: <U><B>bscqie</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#bscqie target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct  5 09;40;28 comment by...Joachim -->
GOOD
<!-- Date: Fri Oct 5 09:30:27.390 2007 -->
Massimo is taking SVT crates - ok with us ...
<!-- Author: Manfred -->

<!-- Date: Fri Oct 5 09:32:36.816 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250890>250890</A>
ACTIVATE: RunSet: BOTHPLUGS_NORMAL 
<!-- Author: Joachim -->



<!-- Date: Fri Oct 5 09:38:43.839 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250890>250890</A>
TERMINATE: done
<!-- Author: Joachim -->



<!-- Date: Fri Oct 5 09:40:21.050 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250891>250891</A>
ACTIVATE: RunSet: BOTHPLUGS_MM_C 
<!-- Author: Joachim -->
<!-- Comment: Fri Oct  5 11;27;06 comment by...Joachim -->
GOOD - checked with DBANA
<!-- Date: Fri Oct 5 09:42:20.787 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250891>250891</A>
TERMINATE: done
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 09:43:26.557 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250892>250892</A>
ACTIVATE: RunSet: BOTHPLUGS_MM 
<!-- Author: Joachim -->



<!-- Date: Fri Oct 5 09:43:55.764 2007 -->
Steve H. calls to let us know that they are working on power supply monitoring => expect unexpected errors ...
<!-- Author: Manfred -->

<!-- Date: Fri Oct 5 09:48:29.293 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250893>250893</A>
 Activated at 2007.10.05 09:47:25
<!-- Author: RunControl -->


<!-- Date: Fri Oct 5 09:55:16.357 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250893>250893</A>
 Terminated at 2007.10.05 09:54:18
<!-- Author: RunControl -->
<!-- Comment: Fri Oct  5 09;56;05 comment by...Joachim -->
L1A rate was 75.3 Hz

<!-- Date: Fri Oct 5 09:57:19.565 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250894>250894</A>
ACTIVATE: RunSet: ACE_TOF_QIE_NEW 
<!-- Author: Joachim -->
<!-- Comment: Fri Oct  5 11;28;50 comment by...Joachim -->
GOOD - checked over Calibrations->Web page
<!-- Date: Fri Oct 5 09:58:11.970 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250894>250894</A>
TERMINATE: done
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 10:00:00.531 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250896>250896</A>
ACTIVATE: RunSet: SMQIECALIB 
<!-- Author: Joachim -->
<!-- Comment: Fri Oct  5 11;29;31 comment by...Joachim -->
GOOD - checked over Calibrations->Web page
<!-- Date: Fri Oct 5 10:01:43.718 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250897>250897</A>
ACTIVATE: RunSet: ACE_LED_ALL 
<!-- Author: Joachim -->
<!-- Comment: Fri Oct  5 11;30;25 comment by...Joachim -->
BAD - W wedges 9-11 empty, checked over Calibrations->Web page
<!-- Date: Fri Oct 5 10:03:16.356 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250897>250897</A>
TERMINATE: done
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 10:04:33.992 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250898>250898</A>
ACTIVATE: RunSet: COTCALIB_ACE 
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 10:05:00.365 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250898>250898</A>
CALIBRATION: <U><B>cot</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cot target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Fri Oct  5 10;06;11 comment by...Joachim -->
GOOD
<!-- Date: Fri Oct 5 10:05:05.874 2007 -->
The offline network switches are back. DataComm (David Tang) 
reports he still sees a problem with primary nameserver 
so we are not yet at 100%. (The secondary nameserver is 
responding.)
<!-- Author: jj -->


<!-- Date: Fri Oct 5 10:07:06.468 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250899>250899</A>
ACTIVATE: RunSet: XEF_ALL 
<!-- Author: Joachim -->
<!-- Comment: Fri Oct  5 11;31;20 comment by...Joachim -->
BAD - some empty wedges, checked over Calibrations->Web page
<!-- Date: Fri Oct 5 10:08:20.575 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250899>250899</A>
TERMINATE: done
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 10:10:48.368 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250900>250900</A>
ACTIVATE: RunSet: CALIB_MUON_ALL1 
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 10:13:07.723 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250901>250901</A>
ACTIVATE: RunSet: TOF_TAC_CALIB 
<!-- Author: Joachim -->
<!-- Comment: Fri Oct  5 11;34;16 comment by...Joachim -->
BAD - 5 cards on freshly replaced ADMEM card empty, <b>would appeciate expert opinion </B>, checked over Calibrations->Web page

<!-- Date: Fri Oct 5 10:19:30.497 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250901>250901</A>
TERMINATE: done
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 10:20:45.928 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250902>250902</A>
 Activated at 2007.10.05 10:19:52
<!-- Author: RunControl -->
<!-- Comment: Fri Oct  5 10;21;21 comment by...Joachim -->
running cosmics without SVT in L2-auto-accept
<!-- Date: Fri Oct 5 10:21:20.213 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250902>250902</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,954,639] 
<!-- Author: Joachim -->




<!-- Date: Fri Oct 5 10:22:40.450 2007 -->
<pre>The calibration runs are finished. The results however take their time, i assume this is connected with the network which is still not at 100%. 
</pre>
<!-- Author: Joachim -->

<!-- Date: Fri Oct 5 11:01:10.831 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250902>250902</A>
 Terminated at 2007.10.05 11:00:17
<!-- Author: RunControl -->


<!-- Date: Fri Oct 5 11:01:33.689 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250902>250902</A>
TERMINATE: can have the svt crates back.. will use this to test L2 status
<!-- Author: Joachim -->



<!-- Date: Fri Oct 5 11:02:34.646 2007 -->
Jim V. says east side alignment work will be done by noon.
<!-- Author: Phil Schlabach -->

<!-- Date: Fri Oct 5 11:04:26.196 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250907>250907</A>
 Activated at 2007.10.05 11:03:49
<!-- Author: RunControl -->


<!-- Date: Fri Oct 5 11:04:27.741 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250907>250907</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,954,639] 
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 11:05:36.819 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250907>250907</A>
 Terminated at 2007.10.05 11:04:50
<!-- Author: RunControl -->


<!-- Date: Fri Oct 5 11:05:37.320 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250907>250907</A>
TERMINATE: L2TO, will try ignoreReces
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 11:08:09.810 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250908>250908</A>
 Activated at 2007.10.05 11:07:42
<!-- Author: RunControl -->


<!-- Date: Fri Oct 5 11:08:10.442 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250908>250908</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,954,639] 
<!-- Author: Joachim -->
<!-- Comment: Fri Oct  5 11;08;43 comment by...Joachim -->
ignoring reces seems to work


<!-- Date: Fri Oct 5 11:08:59.864 2007 -->
We loaded and tested SL4 libraries on SVT crates. Since we had no errors during the test, we decided to leave the new libraries in during the week-end.  
<!-- Author: Massimo and Benedetto -->


<!-- Date: Fri Oct 5 11:21:43.898 2007 -->
DataComm believes network should be back to normal. Primary 
nameserver is responding again.
<!-- Author: jj -->








<!-- Date: Fri Oct 5 11:37:26.168 2007 -->
the calibration result links have not found their way to the e-log, checked them manually over the calibration web-page
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 11:49:27.404 2007 -->
s-cdf-cslogger (one of CSL switches) is no longer uplinked 
to main CDF router.  David Tang will come out and attempt to 
re-enable the link so we don't have to reboot 
the switch.
<!-- Author: jj :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250908' target=_top>250908</a>) -->
<!-- Comment: Fri Oct  5 12;31;40 comment by...Willis -->
<p>According to David Tang, the problem is outside of B0, and is
   due to configuration updates to their data switches. These
   updates were incompatible with the one in s-cdf-cslogger and 
   caused this switch to shut itself off. The s-cdf-cslogger
   configuration has been updated and the s-cdf-cslogger switch
   is online. 
</p>
<!-- Date: Fri Oct 5 12:18:02.120 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250908>250908</A>
 Terminated at 2007.10.05 12:17:45
<!-- Author: RunControl -->


<!-- Date: Fri Oct 5 12:18:14.562 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250908>250908</A>
TERMINATE: end, see what L2_torture will spew...
<!-- Author: Joachim -->



<!-- Date: Fri Oct 5 12:25:36.905 2007 -->
CLC expert (Yuri) calls requesting CLC to be put to "HV on" for the rest of the day. Trying to ramp up CLC ...
<!-- Author: Manfred -->

<!-- Date: Fri Oct 5 12:27:02.160 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250909>250909</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [19,952,633] 
<!-- Author: Joachim -->
<!-- Comment: Fri Oct  5 12;28;20 comment by...Joachim -->
ignoreReces active, default otherwise
<!-- Comment: Fri Oct  5 12;31;42 comment by...Joachim -->
ShowerMax Card in Slot 3 is complaining again for CCAL_05 -- automatic HRR fixed it for the moment, counting.. 1
<!-- Comment: Fri Oct  5 12;32;07 comment by...Joachim -->
2 minutes later again .... 2
<!-- Comment: Fri Oct  5 12;32;31 comment by...Joachim -->
and again ... 3   --> will take card out
<!-- Date: Fri Oct 5 12:27:27.322 2007 -->
CLC experts asked to ramp the CLC HV up. Done.
<!-- Author: Joachim -->






<!-- Date: Fri Oct 5 12:33:45.397 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250909>250909</A>
TERMINATE: take our SMX-card
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 12:38:21.416 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250911>250911</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [19,952,633] 
<!-- Author: Joachim -->
<!-- Comment: Fri Oct  5 12;38;49 comment by...Joachim -->
ignoreReces active, CCAL05 with SMX15, default otherwise 


<!-- Date: Fri Oct 5 12:43:04.586 2007 -->
Replace a broken HV cable on CHA 5W-7R.
<!-- Author: Paolo and Fotis -->

<!-- Date: Fri Oct 5 12:58:47.399 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250912>250912</A>
ACTIVATE: RunSet: WHA_MANUAL_SOURCING - No source moving. Checking the PMT currents
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 13:08:12.268 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250913>250913</A>
 Activated at 2007.10.05 13:07:32
<!-- Author: RunControl -->


<!-- Date: Fri Oct 5 13:08:13.288 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250913>250913</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,954,639] 
<!-- Author: gene -->
<!-- Comment: Fri Oct  5 13;27;38 comment by...gene -->
<pre>running 192.168.0.11 with 3 filars. The configuration is the same as that used on 192.168.0.10. </pre>
<!-- Date: Fri Oct 5 13:12:27.952 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250912>250912</A>
TERMINATE: Finish WHA current run
<!-- Author: Joachim -->




<!-- Date: Fri Oct 5 13:33:32.533 2007 -->
L2 (Gene) and L3 (Si) tests going on ...
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 14:04:14.822 2007 -->
L3 (Si) is done for the moment, will be back later
<!-- Author: Joachim -->

<!-- Date: Fri Oct 5 14:11:19.346 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250913>250913</A>
 Terminated at 2007.10.05 14:11:07
<!-- Author: RunControl -->


<!-- Date: Fri Oct 5 14:14:09.161 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250914>250914</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [19,952,633] 
<!-- Author: gene -->


<!-- Date: Fri Oct 5 14:20:26.853 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250915>250915</A>
TERMINATE: ccal05 is causing problems
<!-- Author: gene -->



<!-- Date: Fri Oct 5 14:51:05.801 2007 -->
Koji called and asked us to restart Trigmon ..done.
<!-- Author: Joachim -->

<!-- Date: Fri Oct 5 14:52:43.603 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250919>250919</A>
ACTIVATE: RunSet: LINK2XTRP  Trigger: PHYSICS_5_01 [1,965,702] 
<!-- Author: Joachim -->



<!-- Date: Fri Oct 5 14:55:51.080 2007 -->
Handing shift over to Frank who will continue with cosmics, L2 torture, calibrations and eventually L2/L3 and other work.
<!-- Author: Manfred :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250919' target=_top>250919</a>) -->


<!-- Date: Fri Oct 5 14:58:50.805 2007 -->
<font color=red>Shift Summary: </font><pre>End of Shift 
</pre> 
<!-- Author: Chlebana -->


<!-- Date: Fri Oct 5 15:01:49.852 2007 -->
Olga and I are running fake tracks through the XTRP to get rid of any input errors.
<!-- Author: KPitts -->

<!-- Date: Fri Oct 5 15:06:49.511 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250921>250921</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_5_01 [1,949,703] 
<!-- Author: Joachim -->



<!-- Date: Fri Oct 5 15:10:14.580 2007 -->
Rack alarm: Votis was here and told us they do some work, we should not worry about gamma red, now it is silcenced and racks are yellow again
<!-- Author: Claudia -->

<!-- Date: Fri Oct 5 15:11:27.531 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250922>250922</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_5_01 [1,949,703] 
<!-- Author: Joachim -->



<!-- Date: Fri Oct 5 15:14:46.295 2007 -->
<pre>beginning of shift status:     
 
- currently 
  expert work, Olga and KPitts 
 
- crates:    
   - CCAL05 runs with SMXR 15 disabled   
 
- HV:     
  - WRN:      CEM/WHA  
  - NOT:      GAM  
  - STD:      PEM/PHA/PSH 
  - ON:       CHA/CLC  
  - ON but really off: MNP/BSC  
  - OFF:      everything else  
 
Global Alarm status:    
  - CEM/WHA/GAM yellow (ok)  
  - PSM still red   
 
- Process System Alarms:    
  - yellow: CRYO, GAS, HVAC, COT, PSM, RACKS   
  - green: WATER, SILICON, SOLENOID  </pre>
<!-- Author: Claudia -->

<!-- Date: Fri Oct 5 15:15:04.241 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250923>250923</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_5_01 [1,949,703] 
<!-- Author: Joachim -->



<!-- Date: Fri Oct 5 15:18:04.475 2007 -->
<pre>level-2 is back to running 192.168.0.10. 
 
If lots of time outs occur try excluding ccal05 and/or select ignore reces in the expert options.</pre>
<!-- Author: gene -->

<!-- Date: Fri Oct 5 15:21:13.682 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250923>250923</A>
TERMINATE: end to remove ccal05
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 15:23:54.291 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250924>250924</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_5_01 [1,949,703] 
<!-- Author: Joachim -->



<!-- Date: Fri Oct 5 15:26:10.339 2007 -->
<pre>I am unable to ssh to my desktop from the scrico terminal and get 
the following error: 
 
b0scico00.fnal.gov&gt; ssh -X ncdf76.fnal.gov 
Permission denied (external-keyx,gssapi-with-mic,gssapi,keyboard-interactive). 
 
Works ok from my laptop...</pre>
<!-- Author: Chlebana -->

<!-- Date: Fri Oct 5 15:39:08.758 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250925>250925</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_5_01 [1,949,703] 
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 15:46:51.479 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250926>250926</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_5_01 [1,949,703] 
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 15:55:23.608 2007 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>15:55:01</TD>
<TD ALIGN=CENTER>::</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT></TD>
<TD ALIGN=RIGHT></TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->


<!-- Date: Fri Oct 5 16:01:05.950 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250926>250926</A>
TERMINATE: end because CSL logger queue is full
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 16:03:46.072 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250927>250927</A>
TERMINATE: didn't work, we reset
<!-- Author: Joachim -->


<!-- Date: Fri Oct 5 16:08:50.145 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=250928>250928</A>
ACTIVATE: RunSet: AAA_SHOTSETUP  Trigger: PHYSICS_5_01 [1,949,703] 
<!-- Author: Joachim -->



<!-- Date: Fri Oct 5 16:12:20.217 2007 -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>error: CSL logger queue full, got stuck 
 
WHY: always go through partition before you start the run again 
 
WHAT to do if it happens (CSL logger queue full): 
-&gt; restart CSL 
- ssh -l cslace b0csl20 
- setup csl 
- restartCSL 
(as it is documented in the ACE help page)</pre></td></tr></td></table>
<!-- Author: Claudia -->
<!-- Comment: Fri Oct  5 16;16;37 comment by...Claudia -->
dont use procmon to restart CSL because it would set it to the default CSL version but currently another version is used!