<!-- Title: Day shift. Fri Oct 31, 2003 -->
<!-- SciCo: Brig/Doug -->
<!-- DAQAce: Monica/Massimo/Eli -->
<!-- MonAce: &nbsp; -->
<!-- CO: &nbsp; -->
<!-- OpManager: Hahn -->
<!-- Notes: -->
<pre>Today's plan: 
 
  - roser/chlebana moving some crates around;  will affect 
   	> RT-server (will incur short downtimes; will have 
	  to move DAQ partition) 
	> consumers 
	> L3 build crate 
    should be done by ~1100 
 
  - xtrp and L3 work until 1100	    [krause,mit] 
 
  - COT tests (tdc and crate work)  [chlebana,phillips] 
    (standalone) 
 
  - silicon tests (checkout)        [svx-gang] 
    (standalone) 
 
  - silicon D-Mode calibrations 
    (needs L1/2/3 and HEVB) 
 
  - Evening: cosmics w/ cot/svx</pre>

<!-- Date: Fri Oct 31 08:59:26.054 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172657">172657</A>
 Activated at 2003.10.31 08:59:00
<!-- Author: RunControl -->


<!-- Date: Fri Oct 31 09:00:38.193 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172657">172657</A>
 Terminated at 2003.10.31 08:59:32
<!-- Author: RunControl -->


<!-- Date: Fri Oct 31 09:03:34.370 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172659">172659</A>
 Activated at 2003.10.31 09:02:21
<!-- Author: RunControl -->


<!-- Date: Fri Oct 31 09:03:35.653 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172659">172659</A>
 Terminated at 2003.10.31 09:03:19
<!-- Author: RunControl -->


<!-- Date: Fri Oct 31 09:11:33.128 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172660">172660</A>
 Activated at 2003.10.31 09:10:32
<!-- Author: RunControl -->


<!-- Date: Fri Oct 31 09:11:34.319 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172660">172660</A>
ACTIVATE: trigger L3 test
<!-- Author: Monica  -->


<!-- Date: Fri Oct 31 09:12:37.985 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172660">172660</A>
 Terminated at 2003.10.31 09:11:54
<!-- Author: RunControl -->



<!-- Date: Fri Oct 31 09:16:22.029 2003 -->
<pre> 
jane nachman and frank chlebana tell us that in preparation 
for the rack work mentioned above, they are going to move the 
rt-server to b0dap33;  all the crates will need to be rebooted. 
they are co-ordinating w/ the xtrp, L3 and silicon tests  
presently ongoing. 
</pre>
<!-- Author: Doug -->

<!-- Date: Fri Oct 31 09:20:28.038 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172663">172663</A>
 Activated at 2003.10.31 09:20:10
<!-- Author: RunControl -->


<!-- Date: Fri Oct 31 09:21:21.472 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172663">172663</A>
 Terminated at 2003.10.31 09:21:06
<!-- Author: RunControl -->


<!-- Date: Fri Oct 31 09:21:22.457 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172663">172663</A>
 Terminated at 2003.10.31 09:21:06
<!-- Author: RunControl -->



<!-- Date: Fri Oct 31 09:24:51.178 2003 -->
<pre>Water Process Systems Alarm TE66 temp. was 0.3 deg-F high; 
silenced; cryo guys looking at it.</pre>
<!-- Author: Doug -->
<!-- Comment: Fri Oct 31 09;47;20 comment by...Doug -->
<pre>Back to normal now.  TE66 well below limit (reads 35 deg-F, limit
is 45 deg-F).  Alarms unsilenced.</pre>
<!-- Date: Fri Oct 31 09:26:07.041 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172664">172664</A>
ACTIVATE: Test run with 3TT in the XTRP, PreFred B0Offset = 25 (default).
<!-- Author: jakraus x2346 -->



<!-- Date: Fri Oct 31 09:26:07.830 2003 -->
<pre>RTserver has been started on b0dap33. All crates will be rebooted, all processes will be restarted to use the new rtserver.  The rtserver on b0dap78 will continue to run until everything is switched over to dap33.</pre>
<!-- Author: Jane Nachtman -->


<!-- Date: Fri Oct 31 09:32:14.903 2003 -->
<pre>Mary Convery is upgrading the PC which monitors/controls the HV  
for the  CLC/BSC/MNP/RPS.  This may take awhile (days).  In the 
meantime, the Global Alarms page will show these as RED and the 
"H"eartbeat is grey. 
 
Steve suggests we page the CLC fellas b/c he thought the global 
alarms should be grey - perhaps red indicates a problem.</pre>
<!-- Author: Doug -->
<!-- Comment: Fri Oct 31 09;45;02 comment by...Doug -->
<pre>Song Ming Wang and Sasha respond to our page.  They did not
know of this work.  They will check to ensure all is well w/ the
CLC stuff.  They complained that this will hamper their plan to
replace some CLC PMTs.</pre>
<!-- Date: Fri Oct 31 09:34:24.260 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172665">172665</A>
ACTIVATE: Test run with 3TT in XTRP, PreFred B0Offset = 25 (default).
<!-- Author: jakraus x2346 -->





<!-- Date: Fri Oct 31 09:56:19.181 2003 -->
<pre>CMX update on access work: 
 
SW miniskirt has been safely inserted.  Some initial prep work is needed to get the gas lines hooked up.  The plan is to have N2 hooked up and purging throughout the weekend. 
 
Workers around the SW should allow spare for CMX and CSX work for today and the weekend.</pre>
<!-- Author: Dale Stentz, Ingyin Zaw, John Strologas -->


<!-- Date: Fri Oct 31 10:06:15.448 2003 -->
<pre>CMX people warn that they are going to try and force some 
trips of some chambers.  These ought show-up in the Global 
Alarms page.  They'll let us know when they're finished.</pre>
<!-- Author: Doug -->


<!-- Date: Fri Oct 31 10:19:30.036 2003 -->
<pre>We are moving the rtserver from dap78 to dap33. This is needed 
to allow source calibration runs. 
 
We also will move the consumers that are running on dap33 to  
dap78. 
 
We updated the consumer_script/startMon.sh file to start 
the consumers on dap78 
 
We modified the consumer_script/killMon.sh to kill processes 
on the same nodes that were used in the startMon script. 
 
</pre>
<!-- Author: Frank Chlebana -->


<!-- Date: Fri Oct 31 10:25:53.973 2003 -->
We are turning HV off on CMX keystone wedge 6.  We will  
turn it back on in a while.
<!-- Author: Ingyin Zaw, John Strologas, Dale Stentz  -->


<!-- Date: Fri Oct 31 10:42:05.983 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>Have declared a new version of fer RunControl  
product: v3_03 
 
This version deals with a subtle bug in the rtserver  
encountered when dealing with the new inhibit crate. 
 
If crates in your partition are rebooted YOU WILL  
HAVE to restart runControl and pick up v3_03 
</pre></td></tr></td></table>
<!-- Author: W.Badgett -->


<!-- Date: Fri Oct 31 10:45:11.158 2003 -->
I have made a few tests with the L3 and EVB (Redhat7.3.1 upgrade). System has been back to the aces with the old system working
<!-- Author: Guillelmo -->


<!-- Date: Fri Oct 31 10:46:15.652 2003 -->
<pre>rtserver on b0dap33 disappeared unexpectedly; 
i restarted it by hand 
</pre>
<!-- Author: W.Badgett -->


<!-- Date: Fri Oct 31 10:51:17.628 2003 -->
Error Handler (EH) has been updated to v1_10_c to fix a problem with multiple pop-up windows. When possible, please restart EH to pick up the new version (as usual, please remember to bring EH up-to-date with the rest of the DAQ system or it won't get any messages).  
<!-- Author: Donatella T. -->


<!-- Date: Fri Oct 31 10:56:59.651 2003 -->
The TOF Global alarm went red.  Expert is being paged.
<!-- Author: Helen -->
<!-- Comment: Fri Oct 31 11;04;38 comment by...Doug -->
<pre>Heartbeat indicates that PC in inaccessible.  Paged TOF.
Gerry Bauer responds.  He's coming-in to take a look.</pre>
<!-- Comment: Fri Oct 31 11;09;37 comment by...Helen -->
Never fails.... write the elog and the problem fixes itself!
<!-- Comment: Fri Oct 31 11;12;22 comment by...Helen -->
Ahh wrong! i meant this comment for the PSM alarm!, the TOF is still red
<!-- Comment: Fri Oct 31 11;21;39 comment by...Doug -->
<pre>The good Dr. Bauer stops-by to say that he's re-started the
TOF PC.  Global Alarms still grey, but should fix itself.  He'll
check again in a bit (after a meeting).</pre>
<!-- Comment: Fri Oct 31 12;22;32 comment by...Doug -->
<pre>TOF now ok on Global Alarms page.</pre>
<!-- Date: Fri Oct 31 10:58:23.540 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030><pre>b0dap33 has unexpectedly been rebooted.   
Therefore rtserver is not available. 
</pre></td></tr></td></table>
<!-- Author: Jane N., BB -->



<!-- Date: Fri Oct 31 11:06:45.734 2003 -->
The PSM alarm has gone red.  Appears to be COSWB_2 in the west endwall.
<!-- Author: Helen -->
<!-- Comment: Fri Oct 31 11;12;45 comment by...Helen -->
This has fixed itself
<!-- Date: Fri Oct 31 11:10:03.470 2003 -->
<pre> 
Dan Cyr called to say that he's left the TDC pager in the  
control room.  He'll fetch it on Monday.  In the meantime, 
if necessary, call him on his cell phone: 
 
     630/715.3704 
 
I've left the pager along w/ a note on the SciCo desk.</pre>
<!-- Author: Doug -->




<!-- Date: Fri Oct 31 11:18:55.086 2003 -->
I changed the processor adapter card in b0cot07 to add the capacitor to the DTACK line.
<!-- Author: Tom Phillips -->


<!-- Date: Fri Oct 31 11:19:25.348 2003 -->
<pre> 
Tom Phillips stops-by to ask that tonight, during cosmic runs 
and/or L2 torture tests, an effort be made to keep in as many of 
the COT crates as possible.  If there are problems (in particular 
w/ crates 3,5,11) PLEASE NOTE THE PROBLEMS IN THE LOGBOOK prior 
to removing them from the run.  They're trying to debug these  
crates.  Also, DON'T AUTOMATICALLY TAKE-OUT THESE CRATES EN  
MASSE (rather, just remove the problem crate).</pre>
<!-- Author: Doug -->

<!-- Date: Fri Oct 31 11:21:06.054 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172677">172677</A>
ACTIVATE: Test with 3TT in XTRP, PreFred B0Offset = 26 (default + 1), tr_x v_e9, L2 Torture table.
<!-- Author: jakraus -->



<!-- Date: Fri Oct 31 11:30:52.613 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172680">172680</A>
ACTIVATE: Test with 3TT in XTRP, PreFred B0Offset = 24 (default - 1), tr_x v_e9, L2 Torture table.
<!-- Author: jakraus -->


<!-- Date: Fri Oct 31 11:40:21.461 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172684">172684</A>
ACTIVATE: Test with 3TT in XTRP, PreFred B0Offset = 25 (default), tr_x v_ea, L2 Torture table.

<!-- Author: jakraus -->



<!-- Date: Fri Oct 31 11:47:26.976 2003 -->
Turning the rest of SWX off (CMX SW)
<!-- Author: Phil Schlabach -->

<!-- Date: Fri Oct 31 11:49:21.326 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172686">172686</A>
ACTIVATE: Test with 3TT in XTRP, PreFred B0Offset = 25 (default), tr_x v_e9, L2 Torture table.

<!-- Author: jakraus -->


<!-- Date: Fri Oct 31 12:18:06.122 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172690">172690</A>
ACTIVATE: XTRP Three Track test run for tr fgpa versions -- RECONFIG ALL FPGAS TOGETHER
<!-- Author: cmarino -->


<!-- Date: Fri Oct 31 12:19:03.221 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172692">172692</A>
ACTIVATE: XTRP TEst with b0offset set to 26
<!-- Author: cmarino -->



<!-- Date: Fri Oct 31 12:19:03.250 2003 -->
I tripped ne CMX wedges 0&1 as I was trying to lock out SW.
<!-- Author: Phil Schlabach -->


<!-- Date: Fri Oct 31 12:37:11.240 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172695">172695</A>
TERMINATE: stop because of rtserver working on
<!-- Author: Monica/Massimo -->



<!-- Date: Fri Oct 31 12:46:40.746 2003 -->
<pre>RTserver move to b0dap33 is complete, and RTserver on b0dap78 has been shut down.</pre>
<!-- Author: Jane -->

<!-- Date: Fri Oct 31 12:47:07.970 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172698">172698</A>
ACTIVATE: XTRP 3TT test run with PreFred B0Offset = 26.
<!-- Author: cmarino -->



<!-- Date: Fri Oct 31 13:04:07.735 2003 -->
Trying to make some tests on cot crates, we have realized that the first subfarm of L3 is not getting any event.  
  
<!-- Author: Monica -->


<!-- Date: Fri Oct 31 13:15:18.965 2003 -->
<pre>Brief gas alarm for SWXSUP and NWXSUP as Dell starts gas 
to miniskirts.  He takes care of it.  Should check later to 
ensure he unsilences these channels in the GAS Process System 
Alarms.</pre>
<!-- Author: Doug -->
<!-- Comment: Fri Oct 31 14;01;52 comment by...Doug -->
<pre>Phil explains that this was to start the N2 purge of
the SW mini-skirt (in preparation for Ar-Ethane). The
rest of the mini-skirt is left as it was.</pre>
<!-- Date: Fri Oct 31 13:18:35.981 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172700">172700</A>
ACTIVATE: XTRP L1global trigger word passing check
<!-- Author: cmarino -->


<!-- Date: Fri Oct 31 13:42:53.280 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172710">172710</A>
ACTIVATE: XTRP test with 3TT, PreFred
<!-- Author: cmarino -->



<!-- Date: Fri Oct 31 13:42:59.473 2003 -->
SW CMX (wedges 6-17) HV is locked out for N2 flush followed by argon ethane.
<!-- Author: Phil Schlabach -->



<!-- Date: Fri Oct 31 14:09:06.252 2003 -->
<pre>Fixed several Level3 nodes  
Will come back later to try to run with them </pre>
<!-- Author: Arkadiy -->

<!-- Date: Fri Oct 31 14:31:03.123 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172724">172724</A>
ACTIVATE: XTRP test with 3TT, PreFred in Myron Mode.
<!-- Author: cmarino -->



<!-- Date: Fri Oct 31 14:31:24.337 2003 -->
Experts still using hardEVB to test cot crates. Previously we found some problems on a certain number of subfarms, partially solved by Cleaning up the EVB. Possibly there were some interfernece with work done on level3 node.  
 
If we will still have this problemes when cot are done, we'll contact L3.  
<!-- Author: Monica -->


<!-- Date: Fri Oct 31 14:31:54.522 2003 -->
<pre>RACKS Process Systems Alarm goes red.  GAM CSP North/South 
and CHA SE are remotely silenced.  Apparently someone is  
working on them.</pre>
<!-- Author: Doug -->

<!-- Date: Fri Oct 31 15:11:36.099 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172728">172728</A>
ACTIVATE: XTRP test with 3TT, tr_ea.mcs, to check for trigger word problems. 
<!-- Author: cmarino -->



<!-- Date: Fri Oct 31 15:21:58.837 2003 -->
<p>After talking to first Michele Gallinaro and Mary Convery,  
and just now to Alexandre Pronko and Alexander Sukhanov who are 
installing new CLC PMTs on the east side, Mark Knapp has  
reinstalled the old CLC PC after we just installed the new 
PC this morning.  I've started up the HV monitoring and it 
seems to be working (though I have not ramped any HVs up).<p> 
 
<p><font size="+2" color="yellow">Thanks, Mark!</font></p>
<!-- Author: Steve Hahn -->

<!-- Date: Fri Oct 31 15:37:18.268 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172730">172730</A>
ACTIVATE: XTRP test run with 3TT, tr_e9.mcs
<!-- Author: cmarino -->



<!-- Date: Fri Oct 31 15:38:23.927 2003 -->
PSM alarm: on Muon/SVX panel indicates a trip on fcale_1 in collision hall. (someone working on it???) 
<pre> 
channel 0  OK 
channel 1  -12.3 (reference -15V)  
channel 2  +5.46 (reference +15V)   
channel 3  0 
channel 4  0 
</pre>
<!-- Author: Monica  -->
<!-- Comment: Fri Oct 31 15;55;51 comment by...Doug -->
<pre>Paged BSC folks. Koji responds and is taking a look.</pre>
<!-- Comment: Fri Oct 31 16;13;48 comment by...K. Terashi -->
The FCALE shows red alarm with above voltages, while the FCALW says "communication error: no response from PS" and it is turned pink. Somthing strange is going on the PS of both FCAL crates. Roberto swapped the PS in FCALW yesterday and in FCALE today, so Dervin was paged.
<!-- Date: Fri Oct 31 15:48:05.921 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172731">172731</A>
ACTIVATE: Try again with trigger system, 3TT in XTRP, tr_e9.mcs
<!-- Author: cmarino -->


<!-- Date: Fri Oct 31 15:55:28.861 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:02</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->


<!-- Date: Fri Oct 31 15:55:49.317 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172733">172733</A>
ACTIVATE: Test with only L1 Global and XTRP
<!-- Author: cmarino -->




<!-- Date: Fri Oct 31 15:57:03.976 2003 -->
<font color=red>Shift Summary: </font><pre>Solenoid is ON and should remain ON over the weekend. 
 
RTserver moved to b0dap33.  The previous server, b0dap78 has been   
turned-off.  Jane/Frank rebooted everything, so all crates ought to 
be correctly configured at this point. 
 
"Guillelmo" finished did L3/EVB upgrades. 
 
Silicon now at Standby. 
 
If you need to page TDCs, call Dan Cyr's cell phone, 630/715.3704. 
 
TO DO: 
  - let kraus finish XTRP tests 
  - silicon D-Mode calibrations 
  - cosmics w/ COT&Silicon 
 
</pre> 
<!-- Author: Doug -->
<!-- Comment: Fri Oct 31 21;14;52 comment by...Rainer -->
<b> ad Silicon plan </b>: we have a blown fuse in a CAEN crate which we need to fix so that throws a wrench in all planning. leave the silicon on standby for now. try to reset single ladder or single wedge trips once, if persist, call expert. don't attempt dmod or cosmics until further notice.
<!-- Date: Fri Oct 31 16:04:30.024 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=172734">172734</A>
ACTIVATE: XTRP 3TT trigger test with L1 Global in Calib Continuous mode.
<!-- Author: jakraus -->