<!-- Title: Day shift. Wed Sep 17, 2003 -->
<!-- SciCo: Greg Feild -->
<!-- DAQAce: Luca Scodellaro -->
<!-- MonAce: &nbsp; -->
<!-- CO: &nbsp; -->
<!-- OpManager: &nbsp; -->
<!-- Notes: -->
<pre></pre>

<!-- Date: Wed Sep 17 08:23:44.828 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169407">169407</a>
TERMINATE: cot11 failed to shepard - no VISINdemo!
<!-- Author: Luca x2080 -->
<!-- Comment: Wed Sep 17 08;27;05 comment by...Luca -->
<pre>12'53" b0cot11:Messenger:8:14:10 AM->Runtime Error 1, Event 88593: Timeout on global TDC Done -->  
 Additional Information: 

 Attention!!!. FERML_TDC_NOT_READY_GLOBAL !!! 
 - Timeout on global TDC Done     
 
 - please SHEPHERD the offending TDC crate  
[MLE]
(MLE) b0cot11:Messenger:8:14:10 AM->Runtime Error 1, Event 88593: TDC in slot 5 not ready for readout
12'54" b0cot11:Messenger:8:14:10 AM->Runtime Error 2, Event 88593: Timeout on global TDC Done --></pre>


<!-- Date: Wed Sep 17 08:29:04.400 2003 -->
After recovering, ccal creates from 00 to 07, cot 11, pcal from 00 to 05, wcal from 00 to 03
<!-- Author: Luca :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169407' target=_top>169407</a>) -->
<!-- Comment: Wed Sep 17 08;29;41 comment by...Luca -->
they seem to be not powered.

<!-- Comment: Wed Sep 17 08;34;10 comment by...Luca -->
I mean, offending calorimetric create seem to be not powered. Cot11
is responding.

<!-- Date: Wed Sep 17 08:36:18.245 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169409">169409</a>
ACTIVATE: new L2TORTURE w/o offendin calorimeter create.
<!-- Author: Luca x2080 -->


<!-- Date: Wed Sep 17 08:38:41.287 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169409">169409</a>
TERMINATE: end due to problem with cot11 create.
<!-- Author: Luca x2080 -->
<!-- Comment: Wed Sep 17 08;39;31 comment by...Luca -->
MLE) b0cot11:Messenger:8:34:39 AM->An undefined error occured
(RC)   8:33:23 Activate -> ACTIVE
(MLE) b0tsi02:Messenger:8:34:43 AM->DONE timeout
(MLE) b0dap73.fnal.gov:Thread-735:8:33:27 AM->Done Timeout: COT_11 

<!-- Date: Wed Sep 17 08:40:16.427 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169410">169410</a>
ACTIVATE: new L2TORTURE w/o cot11.
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 08:46:18.675 2003 -->
High dead time (>99%). I set the prescale for MB and JET05 triggers 
to 0.
<!-- Author: Luca :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169410' target=_top>169410</a>) -->

<!-- Date: Wed Sep 17 08:53:21.462 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169410">169410</a>
TERMINATE: end run 
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 08:53:22.627 2003 -->
<pre>We are going to start a new run to see if SiliMon will 
tie up the db and prvent runControl from getting a run  
number</pre>
<!-- Author: Greg -->
<!-- Comment: Wed Sep 17 08;55;56 comment by...Greg -->
<pre>We were able to start a new run.  We will wait 
10 minurtes and try again.
</pre>
<!-- Date: Wed Sep 17 08:54:18.325 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169411">169411</a>
ACTIVATE: new L2TORTURE run
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 09:02:14.013 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169411">169411</a>
TERMINATE: end run
<!-- Author: Luca x2080 -->


<!-- Date: Wed Sep 17 09:03:50.245 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169412">169412</a>
ACTIVATE: new run number test (L2TORTURE used).
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 09:07:44.753 2003 -->
<pre>Dee Hahn disabled the VESDA.</pre>
<!-- Author: Greg -->

<!-- Date: Wed Sep 17 09:26:02.238 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169412">169412</a>
TERMINATE: end run again
<!-- Author: Luca x2080 -->


<!-- Date: Wed Sep 17 09:27:52.581 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169413">169413</a>
ACTIVATE: new test
<!-- Author: Luca x2080 -->


<!-- Date: Wed Sep 17 09:40:30.380 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169414">169414</a>
ACTIVATE: burning up run numbers
<!-- Author: greg 2080  -->



<!-- Date: Wed Sep 17 09:42:43.176 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>New tracers with a VME buffer DTACK filtering circuit  
will be cycled into the system slowly over the next  
few weeks, primarily in the COT crates.  These tracers  
are identified with a small pink label that  
says "DTACK MOD".  This modification makes the tracers  
somewhat more fragile, so please take extra care  
when handling them.</pre></td></tr></td></table>
<!-- Author: W.Badgett, Leland Scott -->


<!-- Date: Wed Sep 17 10:08:09.124 2003 -->
<pre>Alon working on plug PMT boxes 
</pre>
<!-- Author: Greg -->


<!-- Date: Wed Sep 17 10:09:02.686 2003 -->
<pre>Jane and Steve N. begin RTserver/Silicon monitoring studies. 
</pre>
<!-- Author: Greg  -->

<!-- Date: Wed Sep 17 10:18:32.906 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169413">169413</a>
TERMINATE: end run for an other run number test
<!-- Author: Luca x2080 -->


<!-- Date: Wed Sep 17 10:19:34.001 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169418">169418</a>
ACTIVATE: new run number test
<!-- Author: Luca x2080 -->


<!-- Date: Wed Sep 17 10:21:00.169 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169418">169418</a>
TERMINATE: end run to release two cot creates for Donatella.
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 10:23:16.748 2003 -->
cot03 and cot04 removed.
<!-- Author: Luca -->

<!-- Date: Wed Sep 17 11:04:22.118 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169421">169421</a>
ACTIVATE: start a new test
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 11:08:18.703 2003 -->
<pre>Steve K arrives to do Isolation studies.  We  
will integrate him seamlessly into the RTserver 
study. 
</pre>
<!-- Author: Greg -->


<!-- Date: Wed Sep 17 11:08:21.961 2003 -->
<pre>MLE) b0dap73.fnal.gov:Thread-55:11:00:52 AM->  Silicon Level 1 Done Timeout Error from SVX, ISL or L00 
 
0'55" 2 crate/s: b0cot14(62), b0svx02(112),  Done TO.[RXPT] 
(MLE) b0tsi02:Messenger:11:02:11 AM->DONE timeout 
(MLE) b0dap73.fnal.gov:Thread-55:11:00:54 AM->Done Timeout: COT_14 VRB_SVX_02  
0'56" L1 Done Timeout.[RXPT] 
0'58" 2 crate/s: b0cot14(62), b0svx02(112),  Done TO.[RXPT] 
(MLE) b0tsi02:Messenger:11:02:15 AM->DONE timeout 
(RC)   11:1:0 Halt -> HALTED 
1'0" AUTOMATIC HRRs enabled from EH Options Menu.[EH Info] 
(RC)   11:1:2 Recover -> RECOVERED 
(MLE) b0cot10:Messenger:11:02:21 AM->An undefined error occured 
(RC)   11:1:5 Run -> ACTIVE 
1'5" b0cot14:Messenger:11:02:22 AM->Runtime Error 1, Event 2: Timeout on global TDC Done -->   
 Additional Information:  
 
 Attention!!!. FERML_TDC_NOT_READY_GLOBAL !!!  
 - Timeout on global TDC Done      
  
 - please SHEPHERD the offending TDC crate  </pre>
<!-- Author: Luca :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169421' target=_top>169421</a>) -->
<!-- Comment: Wed Sep 17 11;09;11 comment by...Luca -->
I can not sheperded: setup cdfdb failed!

<!-- Date: Wed Sep 17 11:10:22.781 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169421">169421</a>
TERMINATE: end run
<!-- Author: Luca x2080 -->


<!-- Date: Wed Sep 17 11:13:30.527 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169422">169422</a>
ACTIVATE: new test w/o offending creates.
<!-- Author: Luca x2080 -->
<!-- Comment: Wed Sep 17 11;15;53 comment by...Greg -->
<pre>L1 DONE timeouts.  Perhaps Lester, Sal and Co. have 
put in an experimental prom?

</pre>
<!-- Date: Wed Sep 17 11:15:02.298 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169422">169422</a>
TERMINATE: end run due to new problems with silicon creates.
<!-- Author: Luca x2080 -->
<!-- Comment: Wed Sep 17 11;19;28 comment by...Luca -->
<pre>Many errors like this:

(MLE) b0dap73.fnal.gov:Thread-55:11:11:56 AM->  Silicon Level 1 Done Timeout Error from SVX, ISL or L00

</pre>
<!-- Date: Wed Sep 17 11:17:53.385 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169423">169423</a>
ACTIVATE: new test w/o silicon creates.
<!-- Author: Luca x2080 -->




<!-- Date: Wed Sep 17 11:39:55.780 2003 -->
Inserted a D=1.0 optical filter on cowtail n. 134 of 
EM COW n.3, East Plug, Wedge 22-21 
For Shower max signal attenuation.
<!-- Author: diego cauz -->


<!-- Date: Wed Sep 17 12:04:46.874 2003 -->
IFIX is giving a TOF alarm.
<!-- Author: Luca -->

<!-- Date: Wed Sep 17 13:01:51.545 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169424">169424</a>
ACTIVATE: start  L2TORTURE
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 13:13:13.682 2003 -->
<pre>Test entry</pre>
<!-- Author: Greg Feild -->

<!-- Date: Wed Sep 17 13:14:38.186 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169424">169424</a>
TERMINATE: abort run 
<!-- Author: Luca x2080 -->
<!-- Comment: Wed Sep 17 13;16;11 comment by...Luca -->
rc went through an HRR transition but it seems frozen.
<!-- Date: Wed Sep 17 13:16:11.573 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169425">169425</a>
ACTIVATE: try a new run
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 13:54:15.519 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169426">169426</a>
TERMINATE: abort run. same problem as before. rc is frozen in Halt transition.
<!-- Author: Luca x2080 -->


<!-- Date: Wed Sep 17 14:35:59.686 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169428">169428</a>
ACTIVATE: L3 test run. Config. L2_TORTURE[13,282,370]. Only ccal13 create in.
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 14:40:07.013 2003 -->
<pre>Level3 has recovered from online network problems  
and is fully usable right now</pre>
<!-- Author: Arkadiy -->


<!-- Date: Wed Sep 17 14:40:48.839 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030>During preparations for the cdf online switch firmware upgrade 
that was scheduled for Thursday morning the cdf online switch  
crashed.   
 
This prevented any communication between the online computers. 
 
During the recovery the security patch that was scheduled for 
tomorrow morning was installed. 
 
The work that was scheduled for Thursday morning has been 
completed. 
</td></tr></td></table>
<!-- Author: Frank Chlebana -->

<!-- Date: Wed Sep 17 14:42:15.425 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169428">169428</a>
TERMINATE: end l3 test
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 14:48:40.423 2003 -->
<pre>Inserted new firmware to investigate the eta errors from 
the Isolation trigger.  Now eta is taken from a different 
path,  except for the last step when it is sent to the 
processor. Nothing changed in the data, which eliminated 
most of the path as the culprit.   Will be back to  
look at scope pics.  </pre>
<!-- Author: Steve Kuhlmann -->


<!-- Date: Wed Sep 17 14:54:45.080 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>The following products have been upgraded to conform to latter  
day Java/JDK standards, and have been compiled  
under jdk v1_4_2 and declared current : 
 
    fer           v3_00 
    hdwdb         v1_9 
    rundb         v2_1 
    cdfdb         v1_5 
    resmgr        v1_3 
    proxy         v1_4 
    CalibDB       v1_3 
    cdfvme_common v3_0 
    cdfvme_vme    v2_0 
    fred          v2_0 
    pfred         v2_0 
    tracer        v2_1 
 
</pre></td></tr></td></table>
<!-- Author: W.Badgett, Carla, Greg -->


<!-- Date: Wed Sep 17 14:55:25.950 2003 -->
L3 problems ending run 169428. I checked L3 proxy. Answer 
is:"b0l3gate2 is DEAD".
<!-- Author: Luca :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169428' target=_top>169428</a>) -->


<!-- Date: Wed Sep 17 15:09:20.548 2003 -->
<pre>Level3 is down for 2 days.  
Steve Tether is upgrading the gateways  
to a new Linux version.  
 
And yes, they will connect to the right RT server.  
We changed the hosts file.  
</pre>
<!-- Author: Boris.  -->

<!-- Date: Wed Sep 17 15:28:24.912 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169429">169429</a>
ACTIVATE: start L2_TORTURE[13,282,370] w/o readout since experts are working on CLC.
<!-- Author: Luca x2080 -->


<!-- Date: Wed Sep 17 15:29:35.212 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169429">169429</a>
TERMINATE: end run to remove offending card from ccal13.
<!-- Author: Luca x2080 -->
<!-- Comment: Wed Sep 17 15;31;55 comment by...Luca -->
 
<a href=
'/cgi/elog/elog.pl?nb=2003&action=view&page=778&frame=2&anchor=08:02:00.828'>
see here </a>


<!-- Date: Wed Sep 17 15:33:34.317 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169430">169430</a>
ACTIVATE: start new run w/ card removed.
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 15:36:54.808 2003 -->
another offending card in ccal13 create: <br> 
(MLE) b0ccal13:Messenger:3:30:25 PM->SMXR Not Responding event 7, slot 5, bunch ctr 124, L2buffer 1, header 0x3dfc57c
<!-- Author: Luca :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169430' target=_top>169430</a>) -->

<!-- Date: Wed Sep 17 15:38:11.887 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169430">169430</a>
TERMINATE: end run to remove the offending card.
<!-- Author: Luca x2080 -->


<!-- Date: Wed Sep 17 15:40:38.414 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169433">169433</a>
ACTIVATE: try again...
<!-- Author: Luca x2080 -->


<!-- Date: Wed Sep 17 15:50:50.334 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169433">169433</a>
TERMINATE: end run to restart eun control
<!-- Author: Luca x2080 -->



<!-- Date: Wed Sep 17 15:50:51.103 2003 -->
The RTserver on b0dau30 has been stopped.  All processes are now connecting to the RTserver on b0dap78.  If rtserver problems come up, please page daq.
<!-- Author: Jane Nachtman -->


<!-- Date: Wed Sep 17 15:51:04.208 2003 -->
Switched off XFT part of TrigMon since it is writing large log-files - cause is lack of Low Voltage in COT/TDC.				
<!-- Author: Evelyn  -->


<!-- Date: Wed Sep 17 15:54:21.551 2003 -->
<font color=red>Shift Summary: </font><pre>All good!</pre> 
<!-- Author: Greg Feild -->

<!-- Date: Wed Sep 17 15:56:34.526 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</th>
<TH>Data Type</th>
<TH>Physics Table</th>
<TH>Begin Time</th>
<TH>End Time</th>
<TH>Live Time</th>
<TH>L1 Accepts</th>
<TH>L2 Accepts</th>
<TH>L3 Accepts</th>
<TH>Live Lumi, nb-1</th>
<TH>GR</th>
<TH>SC</th>
<TH>RC</th></tr>

<TR><TD>Totals</td>                                                     
<TD> </td>                                                              
<TD> </td>                                                              
<TD> </td>                                                              
<TD>15:55:02</td>                                                       
<TD ALIGN=CENTER>::</td>                                                
<TD ALIGN=RIGHT></td>                                                   
<TD ALIGN=RIGHT></td>                                                   
<TD ALIGN=RIGHT></td>                                                   
<TD ALIGN=RIGHT></td>                                                   
<TD> </td>                                                              
<TD> </td>                                                              
<TD> </td></tr>                                                         
                                                                        
</table>
<!-- Author: End of Shift Report -->


<!-- Date: Wed Sep 17 16:08:07.989 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169437">169437</a>
ACTIVATE: L2_TORTURE without ccal from 00 to 07, pcal from 00 to 05, wcal from 00 to 03, cmx01, svt_tracking 3 (yellow on the VxWorks System Monitor), and without COT crate. Besides ccal13 has been put inside without SMXREADOUT_39 and 41.   
<!-- Author: Monica x2080 -->


<!-- Date: Wed Sep 17 16:08:08.989 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169437">169437</a>
TERMINATE: end run because of problem on b0imu00 (RTserver stopped) 
<!-- Author: Monica x2080 -->



<!-- Date: Thu Sep 18 07:55:17.669 2003 -->
Plug Laser:   
 
A new filte ( 1 db nominal attenuation) has been inserted int 
one of the shower max connectors on the East plug. 
 
The connector corresponds to cowtail #134 , fiber cable #299 on EM cow #3 which feeds PMT box 12. 
 
This filter was requested by Alon Attal. 
 
Two Myron Mode laser runs were subsequently taken: 
Runs 169464 and 169466 
Both may be found in the look area. 
 
We were unable to include crate b0pcal02 in the run config. 
<!-- Author: Giovanni Pauletta -->