<!-- Title: Eve shift. Sat Sep  1, 2007 -->
<!-- SciCo: Kevin Lannon -->
<!-- DAQAce: Daniel Beecher -->
<!-- MonAce: Carolina Deluca -->
<!-- CO: &nbsp; -->
<!-- OpManager: &nbsp; -->
<!-- Notes: -->
<p>Water dripping from the ceiling due to a third floor AC problem.  Steve Hahn and Peter Wilson have investigated and conclude that "there is an excess of water."  Otherwise, things seem normal. 
 
<p>Silicon access is done for the day.  Hope for a quiet shift of DAQ idling and hopefully no drowning.

<!-- Date: Sat Sep 1 16:12:50.718 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248724>248724</A>
 Activated at 2007.09.01 16:12:01
<!-- Author: RunControl -->


<!-- Date: Sat Sep 1 16:12:51.576 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248724>248724</A>
ACTIVATE: RunSet: ACE_CALORIMETER_MINIMAL  Trigger: SUMET5 [7,957,639] No beam
<!-- Author: Carol & Dan -->



<!-- Date: Sat Sep 1 16:17:48.298 2007 -->
<B> ISL Cooling Repair Summary </B>  This morning we performed a leak test on the east portcard rings following the repair of the leak found on the rear of the return manifold on Friday.   The overall leak rate was the same, however, the rear ring held 30in of water for 30minutes.   Yesterday the pressure dropped from 30 to 0 in about 15sec.   After a series of isolation tests we concluded that the only remaining leak was on the front tubes of the return manifold.   We deposited epoxy around the left front tube.  We will do a pressure test on Sunday to see if we have sealed the last leak.
<!-- Author: Peter for the ISL repair crew -->

<!-- Date: Sat Sep 1 16:23:28.080 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248724>248724</A>
 Terminated at 2007.09.01 16:22:08
<!-- Author: RunControl -->


<!-- Date: Sat Sep 1 16:23:29.086 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248724>248724</A>
TERMINATE: L1 Accept Rate is 48.1Hz, OK.
<!-- Author: Carol & Dan -->


<!-- Date: Sat Sep 1 16:27:16.648 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248725>248725</A>
ACTIVATE: RunSet: SMQIECALIB 
<!-- Author: Carol & Dan -->


<!-- Date: Sat Sep 1 16:29:57.758 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248725>248725</A>
CALIBRATION: <U><B>smx</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#smx target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Sat Sep  1 16;41;28 comment by...carolina -->
Ok. Again PEM, PHA, PSH HV were not on standby, but they were OFF.
<!-- Date: Sat Sep 1 16:29:58.585 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248726>248726</A>
ACTIVATE: RunSet: ACE_LED_ALL 
<!-- Author: Carol & Dan -->


<!-- Date: Sat Sep 1 16:32:32.282 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248726>248726</A>
CALIBRATION: <U><B>cemled</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cemled target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Sat Sep  1 16;47;53 comment by...carolina -->
OK
<!-- Date: Sat Sep 1 16:34:38.196 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248727>248727</A>
CALIBRATION: <U><B>cot</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cot target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Sat Sep  1 16;50;07 comment by...carolina -->
BAD: Too many bad or missing channels in calibration.

<!-- Date: Sat Sep 1 16:40:07.874 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248728>248728</A>
ACTIVATE: RunSet: XEF_ALL 
east xenon didn't rump up as yesterday. West OK.
<!-- Author: Carol & Dan -->


<!-- Date: Sat Sep 1 16:40:41.260 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248728>248728</A>
CALIBRATION: <U><B>calxef</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#calxef target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Sat Sep  1 16;55;59 comment by...carolina -->
BAD. There were bad channels that don't appear in the reference:
Wedge 16 East Channels.
<!-- Date: Sat Sep 1 16:47:17.323 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248729>248729</A>
ACTIVATE: RunSet: CALIB_MUON_ALL1 
Muon HV Off, again DAQErrMon complained we were running on the wrong mode (cosmics)
<!-- Author: Carol & Dan -->



<!-- Date: Sat Sep 1 16:49:23.990 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248730>248730</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [19,952,633] 
<!-- Author: Carol & Dan -->




<!-- Date: Sat Sep 1 16:50:47.821 2007 -->
Update on the AC:  Steve is in touch with someone who's trying to find locate a person to come in and have a look at the malfunctioning unit.  We're waiting for a call back.  In the meantime, the temp on the third floor seems stable, so no emergency so far.
<!-- Author: K.Lannon -->


<!-- Date: Sat Sep 1 16:52:07.971 2007 -->
I forgot to add that we paged Kevin Burkett around 4pm for the COT LV problem.  Steve was unable to convince him to let us try to fix the problem, so Kevin will come in to fix it himself.
<!-- Author: K.Lannon -->
<!-- Comment: Sat Sep  1 17;23;26 comment by...Kevin, not the sci-co -->
Kevin came in because someone told him  that really none of the
red LEDs were lit up.  Unfortunately, they were.  But now 
they're not.

<!-- Date: Sat Sep 1 17:02:02.421 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248730>248730</A>
TERMINATE: For doing CSL tests
<!-- Author: Carol & Dan -->


<!-- Date: Sat Sep 1 17:10:28.634 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248731>248731</A>
 Activated at 2007.09.01 17:09:47
<!-- Author: RunControl -->


<!-- Date: Sat Sep 1 17:10:29.575 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248731>248731</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,954,639] CSL test
<!-- Author: Carol & Dan -->
<!-- Comment: Sat Sep  1 17;30;10 comment by...Willis -->
<p>The new CSL version seems to be running okay, so I will leave
   it in for testing over the Labor day weekend. If there any
   problems, please restart with the default CSL using the 
   instructions on the ACE help page for the CSL. The CSL
   code changes have been to streamline output to the CSL
   log files to make it easier to debug problems, like occasional
   bursts of events with no data format (neither ROOT nor TRYBOS).
</p>


<!-- Date: Sat Sep 1 17:31:16.078 2007 -->
Kevin Burkett has come in and fixed the COT LV problem.
<!-- Author: K.Lannon -->

<!-- Date: Sat Sep 1 17:45:00.437 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248731>248731</A>
 Terminated at 2007.09.01 17:44:38
<!-- Author: RunControl -->


<!-- Date: Sat Sep 1 17:45:12.852 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248731>248731</A>
TERMINATE: Stopped to test COT calibration.
<!-- Author: Carol & Dan -->


<!-- Date: Sat Sep 1 17:47:56.479 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248732>248732</A>
ACTIVATE: RunSet: COTCALIB_ACE Test it again now that the COT LV problem has been solved
<!-- Author: Carol & Dan -->


<!-- Date: Sat Sep 1 17:50:47.810 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248732>248732</A>
CALIBRATION: <U><B>cot</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cot target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->
<!-- Comment: Sat Sep  1 17;51;40 comment by...carolina -->
This calibration is o.k.

<!-- Date: Sat Sep 1 17:54:35.974 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248733>248733</A>
 Activated at 2007.09.01 17:54:04
<!-- Author: RunControl -->


<!-- Date: Sat Sep 1 17:55:55.163 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248733>248733</A>
ACTIVATE: RunSet: ACE_COSMICS_ALL  Trigger: COSMICS [15,954,639] Started again to continue checking CSL
<!-- Author: Carol & Dan -->



<!-- Date: Sat Sep 1 18:23:32.970 2007 -->
<p>FESS tech came in and took apart the 3rd floor Liebert.  He 
found that output fitting on the water filter for the  
humidification unit was squirting out water.  After a trip to 
get the right compression fitting, it is now fixed.  I used a  
wet-dry vac to try and pick up some water.  We had to turn off 
the Liebert for a few minutes more than once but the Liebert 
reported the temperature never getting higher than 73 F. 
Hopefully, we can remove the buckets in the control room soon.</p>
<!-- Author: Steve Hahn :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248733' target=_top>248733</a>) -->
<!-- Comment: Sat Sep  1 19;10;18 comment by...K.Lannon -->
Third floor temp continues to decrease steadily since AC was restored.


<!-- Date: Sat Sep 1 20:50:27.376 2007 -->
PROCMON ERROR: cdfqad is getting over quota: 
 
<pre>Error: cdfdaq is over 95% of its quota: 
Disk quotas for user cdfdaq (uid 5430):  
     Filesystem  blocks   quota   limit   grace   files   quota   limit   grace 
      /dev/sda9       4       0 20000000               1       0  100000         
b0home:/vol/home 
                7145628  12582912 15728640           37627  4294967295 4294967295         
b0spool:/vol/data 
                121383260  125829120 138412032          430171  4294967295 4294967295         
b0spool:/vol/spool 
                10453376  26214400 26214400             970  4294967295 4294967295         
Percent of home quota: 56 
Percent of data quota: 96</pre> 
 
We are trying to see if there is some obvious files to delete to recover space 
<!-- Author: carolina and dan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248733' target=_top>248733</a>) -->
<!-- Comment: Sat Sep  1 21;08;14 comment by...carolina and dan -->
<pre>Found CORE files in TrigMon and YMon consumers area: 
/cdf/onln/data/cdfdaq/consumer/runarea/TrigMon
/cdf/onln/data/cdfdaq/consumer/runarea/YMon

They are failing many times these two last days.
We removed them and checked Filesystem status again. Now it is OK.</pre>
<!-- Comment: Sat Sep  1 21;21;42 comment by...K.Lannon -->
<p>Looking into the failures in a little more detail, I find:

<p><b>TrigMon:</b>  All log files in the consumer/runarea/TrigMon area (since Aug. 30 21:10) show abnormal terminations with the following peculiar message:
<pre>
%ERLOG-e BANKS-Data Read Out-of-Bounds: offset =  0, index =  770, data_size =
         770, Bank ( T2FD ,  1)  GlobalLibraryLogger
         StorableBank::get_I4_element() 01-Sep-2007 21:07:44 CDT
         run = 248733 event = 365344
%ERLOG-e BANKS-Data Read Out-of-Bounds: offset =  0, index =  5589
        , data_size =  5589, Bank ( XSFD ,  1)  GlobalLibraryLogger
         StorableBank::get_I4_element() 01-Sep-2007 21:07:44 CDT
         run = 248733 event = 365344
%ERLOG-s Abnormal termination: caused by signal:  11 Framework abortJob() DisplayServer: Got an unexpected string from the consumer. Expected: 'CONSUMER SEND'. Received: '---'.
DisplayServer::loop(): ERROR: poll consumer returned with: -5
DisplayServer::loop(): Protocol between consumer and display server
was not obeyed! Display Sever will exit!
</pre>

<p><b>YMon:</b> All log files in the consumer/runarea/YMon area (since Aug. 29 17:21) show crashes with the following error message:
<pre>
%ERLOG-s Abnormal termination: caused by signal:  8 Framework abortJob()
         01-Sep-2007 20:36:58 CDT run = 248733 event = 309805
sendString = YMon|634@b0server06.fnal.gov$Framework$abortJob$Abnormal termination$11$248733/309805$run = 248733 event = 309805$run = 24873
3 event = 309805$caused by signal:  $8$
$END
Calling abortJob for DummyInput...
Calling abortJob for FileInput...
sendString = YMon|634@b0server06.fnal.gov$ConsumerInput$APPConsumerInputModule::terminateIOSystem$disconnect fails -- $5$248733/309805$run
 = 248733 event = 309805$run = 248733 event = 309805$
$END
Calling abortJob for OldDHInput...
sendString = YMon|634@b0server06.fnal.gov$ConsumerInput$APPConsumerInputModule::terminateIOSystem$disconnect fails -- $5$248733/309805$run
 = 248733 event = 309805$run = 248733 event = 309805$
$END
Calling abortJob for DHInput...
sendString = YMon|634@b0server06.fnal.gov$ConsumerInput$APPConsumerInputModule::terminateIOSystem$disconnect fails -- $5$248733/309805$run
 = 248733 event = 309805$run = 248733 event = 309805$
$END
Calling abortJob for ConsumerInput...
sendString = YMon|634@b0server06.fnal.gov$ConsumerInput$APPConsumerInputModule::terminateIOSystem$disconnect fails -- $5$248733/309805$run
 = 248733 event = 309805$run = 248733 event = 309805$
$END
sendString = YMon|634@b0server06.fnal.gov$ConsumerInput$APPConsumerInputModule::terminateIOSystem$disconnect fails -- $5$248733/309805$run
 = 248733 event = 309805$run = 248733 event = 309805$
$END
Calling abortJob for ErrorLoggerManager...
sendString = YMon|634@b0server06.fnal.gov$ConsumerInput$APPConsumerInputModule::terminateIOSystem$disconnect fails -- $5$248733/309805$run
 = 248733 event = 309805$run = 248733 event = 309805$
$END
sendString = YMon|634@b0server06.fnal.gov$ConsumerInput$APPConsumerInputModule::terminateIOSystem$disconnect fails -- $5$248733/309805$run
 = 248733 event = 309805$run = 248733 event = 309805$
$END
Calling abortJob for CalibrationManager...
sendString = YMon|634@b0server06.fnal.gov$ConsumerInput$APPConsumerInputModule::terminateIOSystem$disconnect fails -- $5$248733/309805$run
 = 248733 event = 309805$run = 248733 event = 309805$
$END
Calling abortJob for GeometryManager...
sendString = YMon|634@b0server06.fnal.gov$ConsumerInput$APPConsumerInputModule::terminateIOSystem$disconnect fails -- $5$248733/309805$run
 = 248733 event = 309805$run = 248733 event = 309805$
$END
Calling abortJob for SignalManager...
sendString = YMon|634@b0server06.fnal.gov$ConsumerInput$APPConsumerInputModule::terminateIOSystem$disconnect fails -- $5$248733/309805$run
 = 248733 event = 309805$run = 248733 event = 309805$
$END
Calling abortJob for CotqModule...
Calling abortJob for SvxqModule...
Calling abortJob for ConsumerErrorModule...
Calling abortJob for YMonModule...
%ERLOG-e ROOT/TFile:
         file /cdf/onln/data/cdfdaq/consumer/results/YMon/YMon248733aa.root already exists
          Framework TFile::TFile() 01-Sep-2007 20:36:59 CDT
         run = 248733 event = 309805
sendString = YMon|634@b0server06.fnal.gov$Framework$TFile::TFile$ROOT/TFile$7$248733/309805$run = 248733 event = 309805$run = 248733 event
 = 309805$file /cdf/onln/data/cdfdaq/consumer/results/YMon/YMon248733aa.root already exists $
$END
%ERLOG-e ROOT/TFile:
         file /cdf/onln/data/cdfdaq/consumer/results/YMon/YMon248733ab.root already exists
          Framework TFile::TFile() 01-Sep-2007 20:36:59 CDT
         run = 248733 event = 309805
sendString = YMon|634@b0server06.fnal.gov$Framework$TFile::TFile$ROOT/TFile$7$248733/309805$run = 248733 event = 309805$run = 248733 event
 = 309805$file /cdf/onln/data/cdfdaq/consumer/results/YMon/YMon248733ab.root already exists $
$END
%ERLOG-s Div() Histogram Routine:
         DivideByHist has different number of events, cannot divide!!!
         Histogram will no longer make any sense!, when averaging::
         CESEWireEnergy100  01-Sep-2007 20:37:00 CDT run = 248733 event = 309805
sendString = YMon|634@b0server06.fnal.gov$$$Div() Histogram Rout$11$248733/309805$run = 248733 event = 309805$run = 248733 event = 309805$
DivideByHist has different number of events, cannot divide!!! $Histogram will no longer make any sense!, when averaging::  $CESEWireEnergy
100 $
$END
YMonModule: Root file /cdf/onln/data/cdfdaq/consumer/results/YMon/YMon248733ac.root saved.
YMonModule: summary file /cdf/onln/data/cdfdaq/consumer/results/YMon/YMon248733.sum written.
ConsumerSummaryDB::insertRunSummary(): Comment string of Run Summary had to be
truncated to 200 characters. Larger comments cannot be stored in the data base.
ConsumerSummaryDB::initialize(): INFO: Sep  1 20:37:01 2007:
                   Opening connection to database 'cdfonprd.fnal.gov'.
sendString = YMon|634@b0server06.fnal.gov$$ConsumerSummaryDB::initialize$OCI unique constrain$6$248733/309805$run = 248733 event = 309805$
run = 248733 event = 309805$The Consumer run summary table has a UNIQUE constraint  $with respect to consumer and run number. $This means
ONE and only ONE entry per consumer  $(YMon, TrigMon, ObjectMon etc.) per run is allowed.
 $The current consumer process tried to violate this constraint! $Therefore, the online data base server rejected the issued  $INSERT comm
and. This situation can e.g. happen if the  $consumer  $process was killed or crashed during a run and was restarted. $In such a case the
first (crashed) process writes the DB  $entry because in the ConsumerFramework 'abortJob' calls the  $the regular 'endRun' method, which c
alls the DB access  $methods.
 $The failed DB access did however NOT cause a crash. $
$END
%ERLOG?? YMon Summary: ::Evaluation:  2 ::evtProcessed:  100599::Comment:
         CCRD:still in developmentCEM:still in developmentCESD:still in developmentCHA:still in developmentCMP:still in developmentCMU:sti
ll in developmentCMX:still in developmentCOTD:still in developmentCP2D:still in developmentCSPD:still in developmentCSXD:still in developm
entEMTD:still in developmentFDAD:still in developmentFDLD:still in developmentHAT:still in developmentIMUMonitor evaluation: BMU GOOD RUN,
 ISU GOOD RUN;MPAD:still in developmentPEM:still in developmentPESD:still in developmentPHA:still in developmentPPRD:still in developmentM
akeSlides:still in developmentTOFD:still in developmentTrig:still in developmentWHA:still in development
          YMonModule YMonModule() 01-Sep-2007 20:37:01 CDT
         run = 248733 event = 309805
sendString = YMon|634@b0server06.fnal.gov$YMonModule$YMonModule$YMon Summary$10$248733/309805$run = 248733 event = 309805$run = 248733 eve
nt = 309805$::Evaluation:  $2 $::evtProcessed:  $100599$::Comment: $CCRD:still in developmentCEM:still in developmentCESD:still in develop
mentCHA:still in developmentCMP:still in developmentCMU:still in developmentCMX:still in developmentCOTD:still in developmentCP2D:still in
 developmentCSPD:still in developmentCSXD:still in developmentEMTD:still in developmentFDAD:still in developmentFDLD:still in developmentH
AT:still in developmentIMUMonitor evaluation: BMU GOOD RUN, ISU GOOD RUN;MPAD:still in developmentPEM:still in developmentPESD:still in de
velopmentPHA:still in developmentPPRD:still in developmentMakeSlides:still in developmentTOFD:still in developmentTrig:still in developmen
tWHA:still in development $
$END
Calling abortJob for DummyOutput...
Calling abortJob for OldDHOutput...
Calling abortJob for FileOutput...
DisplayServer::pollConsumer(): INFO: YMon sent message: END CONNECTION
                             ==> Going to terminate connection to YMon running on
                             b0server06.fnal.gov
</pre>

<p>Could this be related to the CSL tests Willis is doing?  I will send e-mail to the experts.<br>
<!-- Comment: Sat Sep  1 21;52;13 comment by...Willis -->
<p>YMon has a history of dying on cosmic ray runs and is
   not related to the CSL tests if the event display and
   other consumers do not have any problems.
</p>
<p>Please send email to the YMon maintainer, Jiyeon Han
   (jyhan@fnal.gov) and include a link to this elog entry.
</p>
<!-- Date: Sat Sep 1 20:50:55.713 2007 -->
<table border=0><td><tr><td bgcolor=#e0e030>COT LV failure: 
   
  We have seen failure of COT low voltage from Lower South East  
(LSE) quadrant several times in the last week. Bob Wagner and Morris  
Binkley will work on this next week after the labor day weekend.  
The COT experts have decided to leave the quadrant LV off during the  
weekend if this quadrant has a LV failure again.  
</td></tr></td></table>
<!-- Author: Shin-Shan Yu (Eiko) -->
<!-- Comment: Sat Sep  1 22;30;48 comment by...Shin-Shan Yu (Eiko) -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>My mistake!! Because I saw the same quadrant LSE tripped off on 
Friday so I thought these were the channels Bob and Morris wanted to   
 fix next week. It looks like the ISL work might have tripped off 
LSE both on Friday and today. 

The channel which we want to keep it off and fix next week is 
actually only SL8B USE.

If you see LSE LV failure, please still page COT experts (either 
Eiko or Kevin Burkett).</pre></td></tr></td></table>
<!-- Date: Sat Sep 1 21:08:59.960 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248733>248733</A>
 Terminated at 2007.09.01 21:08:33
<!-- Author: RunControl -->


<!-- Date: Sat Sep 1 21:09:00.882 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248733>248733</A>
TERMINATE: Switch to L2_TORTURE
<!-- Author: Carol & Dan -->


<!-- Date: Sat Sep 1 21:15:20.184 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=248734>248734</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [19,952,633] 
<!-- Author: Carol & Dan -->





<!-- Date: Sat Sep 1 22:06:01.141 2007 -->
<font color=red>Shift Summary: </font><pre>15:00 Start shift with AC problem on third floor. 
 
16:00 Page Kevin Burkett for COT problem. 
 
17:00 Willis arrives for CSL test. 
 
17:30 Kevin Burkett fixes COT LV 
 
17:35 Willis finishes CSL test and asks us to keep running with new version. 
 
17:50 Repair person arrives for third floor AC.  Diagnoses problem. 
      All fixed by 18:15. 
 
20:40 Eiko calls to say that if the COT LV trips off again, we don't 
      need to reset (see entry above). 
 
21:03 Managed to located and delete core files to solve ProcMon errors 
      without paging anyone! 
 
22:00 End of Shift.  Leave L2Torture running.  JDL takes the  
      next two shifts.</pre> 
<!-- Author: K.Lannon -->
<!-- Comment: Sat Sep  1 22;35;18 comment by...Eiko -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>My mistake!! The COT LV channel which we want to keep it off and fix next week is actually only SL8B USE. 

If you see LV failure from any other channels, please still page COT 
experts (either Eiko or Kevin Burkett).</pre></td></tr></td></table>

<!-- Date: Sat Sep 1 23:55:45.889 2007 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>23:55:01</TD>
<TD ALIGN=CENTER>::</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT></TD>
<TD ALIGN=RIGHT></TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->


<!-- Date: Sun Sep 2 07:55:29.871 2007 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>07:55:00</TD>
<TD ALIGN=CENTER>::</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT></TD>
<TD ALIGN=RIGHT></TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Sun Sep 2 07:59:48.357 2007 -->
<font color=red>Shift Summary: </font><pre>End of Evening &(Owl) shifts.</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   n/a
Delivered Luminosity   n/a  
Acquired Luminosity    n/a  
Efficiency             n/a
   
</td></tr></table></pre>
<!-- Author: Itsuo -->