<!-- Title: Day shift. Sat May 31, 2003 -->
<!-- SciCo: A. Foland -->
<!-- DAQAce: S. Vejcik -->
<!-- MonAce: T. Walter -->
<!-- CO: K. Bloom -->
<!-- OpManager: M. Tanaka -->
<!-- Notes: -->
<pre>Looking for cooling leak! </pre>


<!-- Date: Sat May 31 08:27:24.211 2003 -->
Paged Lou Morris to move the walls
<!-- Author: ADF -->

<!-- Date: Sat May 31 08:28:56.626 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163850">163850</A>
TERMINATE: BC and non-sequential event errors.
<!-- Author: Steve x2080 -->



<!-- Date: Sat May 31 08:39:36.785 2003 -->
<pre>b0dap73 is acting in a peculiar fashion: 
1. Cannot book any crates (not obviously related to dap73) 
2. Cannot look at e-log, crashes and cores. 
3. Can look at elog on b0dap52. 
</pre>
<!-- Author: steve -->
<!-- Comment: Sat May 31 08;41;08 comment by...steve -->
Booking of crates appears okay on b0dap52 too.

<!-- Comment: Sat May 31 08;43;21 comment by...steve -->
And ts crates are off now anyway.


<!-- Date: Sat May 31 08:52:14.662 2003 -->
Paged Keith in Accel. Ops about access
<!-- Author: ADF -->


<!-- Date: Sat May 31 09:11:22.333 2003 -->
Freed DAQ ace--Steve will be at (630)880-9585 
(Incidentally Farrukh is at x5019) 
Steve will check in at noon
<!-- Author: ADF -->


<!-- Date: Sat May 31 09:12:35.108 2003 -->
Dean, Lou, Kaori, Ken, and Steve H. are going to make a controlled access to look for water.
<!-- Author: ADF -->
<!-- Comment: Sat May 31 10;26;19 comment by...Ken Bloom -->
This was fun -- I don't think they usually let the CO's go in on access!
<!-- Date: Sat May 31 09:14:02.688 2003 -->
No crates will be turned on until we find the leak
<!-- Author: ADF -->
<!-- Comment: Sat May 31 09;18;24 comment by...ADF -->
COT racks are staying on to keep the endplates warm


<!-- Date: Sat May 31 10:03:49.936 2003 -->
Kaori just called.  They found the leak.  They are still opening the wall, but the water is coming from an upper rack in the NW corner, inside the wall.
<!-- Author: ADF -->


<!-- Date: Sat May 31 10:19:33.337 2003 -->
It is in fact coming from the lower CONWB.  There is an overflow bucket into which the CONWB dranpipe goes, which of course by now has overflowed. The water is flowing down the wall under the detector.  There is probably a drain down there, but paging Phil about the chambers.
<!-- Author: ADF -->



<!-- Date: Sat May 31 10:49:02.008 2003 -->
<p>There was some question as to whether we had to worry about the CDF Spill Procedure for this large ECW water loss (at least in my mind).  The answer is no: ECW is deionized, distilled water with some fungicides and bactericides in it, but no propylene glycol (like the silicon cooling) or ethylene glycol (like the building cooling).  Phew!</p>
<!-- Author: Steve Hahn -->


<!-- Date: Sat May 31 11:05:26.224 2003 -->
Water level in the reserve tank seems to be leveling off; waiting for cryo to give their OK to the ECW.  Dean and Lou have returned to the hall to install a fan to help dry things out.
<!-- Author: ADF -->
<!-- Comment: Sat May 31 11;07;51 comment by...ADF -->
It's not Dean, it's Steve Hahn who's with Lou


<!-- Date: Sat May 31 11:15:43.492 2003 -->
<p>The water from the leak would most likely have gone down the inner edge of the north wall a foot or so back from the west edge of the CMP chambers where the HV fanout and preamp are located. From there it drained to the center of the floor. Dean and Lou said the floor was damp at the point where it went down the wall and below the grate at the NW end of the detector, but that there was no buildup. Unless the water built up to a depth of several inches, there is unlikely to be any damage. This would have soaked the bottom chamber on the north wall first, then the wing chambers on the north side of the bottom which sit on wooden dollies a few inches high. Another possible mode for damage would be if water got onto the extrusion of these wing chambers and somehow flowed west to the end. This I think unlikely.</p> 
<p>CSP phototube HV would be closer to the source of the leak, but underneath the chambers.</p> 
<p>We will have to dry out the subfloor region for a while. Fans are being installed to blow air in. HV will not be restored to the chambers on the bottom or the bottom of the walls for a "while", say this evening at the earliest.</p> 
<p>Davit says the phototubes turned on OK.</p>
<!-- Author: Phil Schlabach, Hyunsoo Kim, Davit Chokheli -->


<!-- Date: Sat May 31 11:33:42.744 2003 -->
Fill CLC West with Isobutane. 
----------------------------- 
Yesterday afternoon we tried to fill CLC west with Isobutane 
before the power shutdown. When we were at the last stage 
of filling the O2 analysis results showed that the O2 content 
was too high. We decided to stop the filling process and try 
to contact Del Allspach on Saturday. On Saturday morning 
after talking to Del, we concluded that the problem with 
high O2 content was because the valve to the O2 analyser was 
not opened. We then repeat this O2 analysis process (with 
the valve opened) and this time the O2 content measured was 
below the threshold. Now both CLC west and east are filled with Isobutane at 22.5 psia.
<!-- Author: Ming / Sasha -->


<!-- Date: Sat May 31 11:43:42.303 2003 -->
No additional leaks found downstairs by Steve & Lou during second inspection.
<!-- Author: ADF -->
<!-- Comment: Sat May 31 11;44;32 comment by...ADF -->
The reserve tank level is still dropping, but more slowly.  We believe that this is simply water replacing air but we're still dumping water into the system...


<!-- Date: Sat May 31 11:48:28.296 2003 -->
Steve Gordon complained that node CDFMCSPC in the cyro area did  
not see the network. I eventually found what appears to be a  
failed port on an offline hub on the third floor. CDFMCSPC is  
now connected to port 16 of CentreCom FH824U hub (switch?). 
Port 15 has either failed or (if FH824U is smart switch) been 
shutdown for network errors.<br> 
This information will be sent to Mark Knapp and David Tang.
<!-- Author: JJ -->

<!-- Date: Sat May 31 11:56:01.850 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163851">163851</A>
ACTIVATE: trigger checkout after power outag
<!-- Author: ace 2080 -->



<!-- Date: Sat May 31 12:00:29.601 2003 -->
<p>Clock is no on in free run mode.  I see no indication ACnet is even working, so I assume we have no TeV RF signals.</p>  
<!-- Author: Steve Hahn -->


<!-- Date: Sat May 31 12:05:40.255 2003 -->
B0CLC00 and B0CLC01 crates are now turned on.
<!-- Author: Ming -->


<!-- Date: Sat May 31 12:06:03.297 2003 -->
<pre>Turned power on to b0svt00.  No blinky lights. 
Masa is contacting experts.</pre>
<!-- Author: Greg F. -->

<!-- Date: Sat May 31 12:06:21.019 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163853">163853</A>
ACTIVATE: trigger test
<!-- Author: ace 2080 -->



<!-- Date: Sat May 31 12:08:25.962 2003 -->
<pre>L2 Torture with L1cal, L2cal, GL1, GL2, XTRP, SVT06, SVT07, 
scalers, SEVB.  All these crates check out OK in this simple configuration, 
 
</pre>
<!-- Author: GREG FEILD :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163853' target=_top>163853</a>) -->


<!-- Date: Sat May 31 12:13:21.944 2003 -->
<pre>Plan 
 
1. Turn on 1st floor racks 
2. Test out 2nd floor trigger room 
3. Bring back L3 EVB 
4. Bring back clock 
5. Power on hall racks 
6. Call Mark Mattson before taking a calorimeter  
calibration run 
7. Page Eric James & Bill Badgett when HW EVB works  
in order to reseat & check COT TDC 
8. Do calibrations (may need to page CSL if files not  
appearing in look area) 
 
Accesses: 
We also still need to make an access for the COT / TDC;  
also remove the blower</pre>
<!-- Author: ADF -->
<!-- Comment: Sat May 31 13;45;19 comment by...ADF -->
<pre>1. Check!
2. Check! (SVT and Muon experts checking out a few crates)
3. Check!
4. Clock now free-running (no TeV RF)
5. Check! (except silicon)
6. Check!
7. Controlled access at 1500
8. L2 torture test now underway; calibrations to begin soon</pre>
<!-- Date: Sat May 31 12:17:28.636 2003 -->
<pre>Added SVT and XFT crates.  SVT03 won't pass cold start. 
======================================================= 
Here is some printoput from the svt cpu 
========================================================= 
TRACER: done enabled 
&gt;&gt;&gt; Setting TBus nibble to 0 
&gt;&gt;&gt; TBus readback    3FFFF 
stdout: TRIG_svt_coldstart 
stderr: TRIG_svt_coldstart 
 hwsetcrc/mapsetCRC 2626054224 3900388082 
 scdata1.hwsetCrc/mapsetCrc 2626054224 3900388082  
sc0(slot3,spy_w06w07): hwSet=stephen4 
hf(slot4, hf_w06_b0b1): mapSet=_cached_ hwSet=_cached_ wedge=6 
loading mapset offline_100030_20030519110159.mapset, CRC 3900388082, mapsetCrc 3900388082 
hf(slot4, hf_w06_b0b1): channelMask=0x0 channelKill=0x0 streamMask=0x0 streamKill=0x3ff 
hf(slot5, hf_w06_b2b3): mapSet=_cached_ hwSet=_cached_ wedge=6 
hf(slot5, hf_w06_b2b3): channelMask=0x0 channelKill=0x0 streamMask=0x0 streamKill=0x3ff 
hf(slot6, hf_w06_b4b5): mapSet=_cached_ hwSet=_cached_ wedge=6 
hf(slot6, hf_w06_b4b5): channelMask=0x0 channelKill=0x0 streamMask=0x0 streamKill=0x3ff 
Merger input mask 1 
mrg(slot7,mrg_w06): hwSet=_cached_ 
mrg(slot7,mrg_w06): inputMask=1 
ams(slot8,ams_w06): mapSet=_cached_ hwSet=_cached_ wedge=6 
amb(slot9,amb_w06_0): mapSet=_cached_ hwSet=_cached_ w=6 b=0 
amb(slot10,amb_w06_1): mapSet=_cached_ hwSet=_cached_ w=6 b=1 
hb(slot11,hb_w06): mapSet=_cached_ hwSet=_cached_ 
tf(slot12,tf_w06): mk=tf_w06, tf=0x746d9f0 
checkMemoryFragment: nerr=150 
FER_E_SVT, writeMap(tf_w06/TF0cf1): checkMemoryFragment mismatch (nerr=150) 
 
FER_E_SVT, tf(slot12,tf_w06): Coeff F0 C1 map write failed 
 
  svtvme_tf_coldstart returns -200 
Client id: 18 
FER_initEVB: Connection established. Node b0dap62 Port = 6500 
Cannot configure readout - check readout list. 
Readout process not started. Error status: 1 
Error Processing Readout List ! 
Sent ack to Run Control: 0 ERROR ERROR  
%FER-E-SVT, writeMap(tf_w06/TF0cf1): checkMemoryFragment mismatch  
%FER-E-SVT, (nerr=150) 
 
%FER-E-SVT, tf(slot12,tf_w06): Coeff F0 C1 map write failed 
 
0x7b7f908 (Messenger): memPartFree: invalid block 0x74c1e70 in partition 0x2ded34. 
 
</pre>
<!-- Author: GregF. :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163856' target=_top>163856</a>) -->
<!-- Comment: Sat May 31 14;26;09 comment by...Stefano -->
<table border=0><td><tr><td bgcolor=#e0e030>
<a href="http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=svt&action=copyentry&page=7&time=09:31:56">Here's</a>
how to fix it </td></tr></td></table>
<!-- Date: Sat May 31 12:18:16.375 2003 -->
<pre>XFT02 won't pass coldStart</pre>
<!-- Author: Greg F :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163856' target=_top>163856</a>) -->
<!-- Comment: Sat May 31 12;47;48 comment by...Cheng-Ju -->
<pre>Some of the XFT FlashRAMs got corrupted from the power
outage.  I am restored the design files.  XFT should
be ready to go now.</pre>
<!-- Date: Sat May 31 12:23:48.620 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163859">163859</A>
ACTIVATE: released xft crates for expert
<!-- Author: ace 2080 -->
<!-- Comment: Sat May 31 12;48;17 comment by...Cheng-Ju -->
<pre>XFT checked out okay.  Returing the crates back to ACES.</pre>
<!-- Date: Sat May 31 12:23:53.589 2003 -->
None of the pictures beneath the main HVMON++ display on the muon pc were present. There was a missing directory on the S: drive. We think we found the right directory and copied it. Success has yet to be confirmed.
<!-- Author: Phil Schlabach, Steve Hahn -->
<!-- Comment: Sat May 31 12;30;49 comment by...ps -->
s:\dynamics\pic\cdfmcs\muon -> s:\dynamics\pic\
<!-- Comment: Sat May 31 12;31;56 comment by...ps -->
Had to do the same god damn thing on the local (E:) drive.
<!-- Comment: Sat May 31 12;33;45 comment by...ps -->
oops, that was because we had told it to look locally... Switched it back, now ok.
<!-- Date: Sat May 31 12:23:53.589 2003 -->
<pre>Power back to svt00 but it won't pass cold atart. 
Here is some printout: 
================================================= 
b0svt00-&gt; Messenger: processStatechange Config [0] 
Slot  2: 0125 001 TRACER__V2.1A           
Slot  3: 0001 038 SpyControlV2            
Slot  7: 0003 039 XTF-C  v2.0 Jan2000     
Slot  8: 0216 032SVT AM Sequencer Feb2000 
Slot  9: 0003 031 Amboard V2.0            
Slot 10: 0005 031 Amboard V2.0            
Slot 11: 0014 033 Hit Buffer v2.1 Apr2000 
Slot 12: 0015 036Track Fitter V1          
Slot 13:      035 SVT HitFinder v20000000 
Slot 16: 0019 034 Merger v2.0 Jan2000     
Slot 17: 0203 032SVT AM Sequencer Feb2000 
Slot 18: 0009 031 Amboard V2.0            
Slot 19: 0011 031 Amboard V2.0            
Slot 20: 0017 033 Hit Buffer v2.1 Apr2000 
Slot 21: 0001 036Track Fitter V1          
Messenger: processReadoutlist 
Set FER_GLOB_Delay to 0 
SEVB node / port b0dap62 / 6500 
Crate Id         121 
Output-&gt;EVB/VRB  1/0 
Trigger mode     2 
Verbosity:       Minimal 
Mode             7  (RE 0) 
 
TRACER: VISIONopen Name=geo32:/slot=2 
TRACER: done enabled 
&gt;&gt;&gt; Setting TBus nibble to 0 
&gt;&gt;&gt; TBus readback    3FFFF 
stdout: TRIG_svt_coldstart 
stderr: TRIG_svt_coldstart 
 hwsetcrc/mapsetCRC 2626054224 3900388082 
 scdata1.hwsetCrc/mapsetCrc 2626054224 3900388082  
sc0(slot3,spy_w00w01): hwSet=stephen4 
loading mapset offline_100030_20030519110159.mapset, CRC 3900388082, mapsetCrc 3900388082 
hf(slot4, hf_w00_b0b1): channelMask=0x0 channelKill=0x0 streamMask=0x0 streamKill=0x3ff 
FER_E_SVT, hf(slot4, hf_w00_b0b1): HF_HOLD_DISABLE reads 0, expect 2 
 
  svtvme_hf_coldstart returns -200 
Client id: 16 
FER_initEVB: Connection established. Node b0dap62 Port = 6500 
Cannot configure readout - check readout list. 
Readout process not started. Error status: 1 
Error Processing Readout List ! 
Sent ack to Run Control: 0 ERROR ERROR  
%FER-E-SVT, hf(slot4, hf_w00_b0b1): HF_HOLD_DISABLE reads 0,  
%FER-E-SVT, expect 2 
 
Setup failed with error code 1 
Statechange failed  
Messenger: processStatechange Abort [0] 
Sent ack to Run Control: 0 IDLE SUCCESS  
 
</pre>
<!-- Author: Greg -->

<!-- Date: Sat May 31 12:29:45.664 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163859">163859</A>
TERMINATE: test ended
<!-- Author: ace 2080 -->




<!-- Date: Sat May 31 12:32:46.014 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163860">163860</A>
ACTIVATE: including ccal crates
<!-- Author: ace 2080 -->



<!-- Date: Sat May 31 12:35:44.655 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163860">163860</A>
TERMINATE: continous DTO from ccal07
<!-- Author: ace 2080 -->
<!-- Comment: Sat May 31 13;20;12 comment by...Frank Chlebana -->
<pre>MLE) b0ccal07:Messenger:12:32:19 PM-&gt;SMXR Not Responding event 8, slot 4, bunch ctr 62, L2buffer 2, header 0x3bfe43e
</pre>
<!-- Comment: Sat May 31 13;20;24 comment by...Frank Chlebana -->
<pre>&lt;pre&gt;MLE) b0ccal07:Messenger:12:32:19 PM-&gt;SMXR Not Responding event 8, slot 4, bunch ctr 62, L2buffer 2, header 0x3bfe43e
&lt;/pre&gt;</pre>
<!-- Date: Sat May 31 12:38:23.651 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163861">163861</A>
ACTIVATE: SMX calibration
<!-- Author: ace 2080 -->


<!-- Date: Sat May 31 12:39:23.297 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163861">163861</A>
TERMINATE: ended SMX calib
<!-- Author: ace 2080 -->
<!-- Comment: Sat May 31 12;54;12 comment by...Ken Bloom -->
Checked with DBANA, looks OK.
<!-- Date: Sat May 31 12:39:23.094 2003 -->
<pre>Level3 c12 has hardware failure.  
Tokk it out. </pre>
<!-- Author: Boris. -->
<!-- Comment: Sat May 31 12;52;39 comment by...Boris  -->
<pre>Also removed 050 and 246</pre>
<!-- Date: Sat May 31 12:41:02.950 2003 -->
<a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=156&frame=2&anchor=08:44:31'>Necessary</a> but perhaps not sufficient conditions for turning the Si back on. 
We'll wait until other things have settled down a bit, check later tonight etc.   
<!-- Author: Silicon Crew -->



<!-- Date: Sat May 31 12:48:02.686 2003 -->
<p>BMU and CMX, CCR, CES, and CPR have been at full voltage for 30 minutes. I have turned them back off. They are released to the control of the shift crew. They should be brought to standby at some convenient time.</p> 
<p><b><font color="#FF0000">CMP HV control is for experts only.</font></b></p> 
<p><b><font color="#FF0000">CMP HV control has been hardware disabled using the switch on the front of the CAEN.</font></b></p>  
<!-- Author: Phil Schlabach -->


<!-- Date: Sat May 31 12:49:01.985 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163863">163863</A>
TERMINATE: muon crates and muon rigger crate fail to pass coldSart
<!-- Author: gregf 2080 -->




<!-- Date: Sat May 31 13:00:42.484 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163867">163867</A>
ACTIVATE: run with cot crates but cot13
<!-- Author: gregf 2080 -->


<!-- Date: Sat May 31 13:05:12.302 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163867">163867</A>
TERMINATE: test ended
<!-- Author: gregf 2080 -->



<!-- Date: Sat May 31 13:08:00.707 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-5687&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-5687  width='300' align='top'></td><td>Water tank level histry</a></td></tr></table>
<!-- Author: Masa -->


<!-- Date: Sat May 31 13:09:08.852 2003 -->
CMP low voltage to the preamps is OK.
<!-- Author: Phil Schlabach -->

<!-- Date: Sat May 31 13:09:32.743 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163869">163869</A>
ACTIVATE: QIE CAl Calib
<!-- Author: ace 2080 -->


<!-- Date: Sat May 31 13:09:56.232 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163869">163869</A>
TERMINATE: cal calib done
<!-- Author: ace 2080 -->


<!-- Date: Sat May 31 13:12:22.695 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163868">163868</A>
ACTIVATE: including cot13 and evb/l3
<!-- Author: gregf 2080 -->



<!-- Date: Sat May 31 13:13:04.299 2003 -->
Steve in cryo is bringing up the solenoid soon.  No COT/ToF HV while ramping.  
<!-- Author: ADF -->
<!-- Comment: Sat May 31 13;21;36 comment by...kaori -->
Bob W. is informed about the status.  He will come in sometime
to check out COT HV.  We also asked him to bring up the COT HV monitor in the control room (right top terminal).
<!-- Date: Sat May 31 13:13:13.766 2003 -->
<b>Calorimeter Crate Checkout</b> 
<br> 
All the ADMEMs in the ccal, wcal and pcal crates are good. There are few PIN diode channels in PHA which are very noisy after the power outage. These should be ignored becuase they are not used for DAQ and are only used for diagnostics. 
<!-- Author: Vivek -->


<!-- Date: Sat May 31 13:13:44.312 2003 -->
Boris says HEVB and L3 are now working!
<!-- Author: ADF -->


<!-- Date: Sat May 31 13:13:52.272 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-5688&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-5688  width='300' align='top'></td><td>"Bad" channels from calorimeter calibration</a></td></tr></table>
<!-- Author: Ken Bloom -->
<!-- Comment: Sat May 31 13;17;14 comment by...Vivek -->
All the bad channels in PHA are PIN diodes not used for data-taking. CHA and CEM bad channels show a little shift in poedestal mean from the reference value but these value pretty good. So no problems.

<!-- Date: Sat May 31 13:18:14.921 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163868">163868</A>
TERMINATE: test ended
<!-- Author: gregf 2080 -->



<!-- Date: Sat May 31 13:18:46.312 2003 -->
Steve V. needs to call Doug Benjamin  232-4241  
<!-- Author: ADF -->



<!-- Date: Sat May 31 13:20:16.463 2003 -->
<pre>Reset the CPUs in all the muon TDC crates and in 
muon trigger crate.  This recovered all crates except 
CMX00, CMX01, MUSC.  Here is prinout from CMX00: 
========================================================  
 
TRACER: VISIONopen Name=geo32:/slot=2 
TRACER: done enabled 
&gt;&gt;&gt; Setting TBus nibble to 0 
&gt;&gt;&gt; TBus readback    3FFFF 
TDC slot = 3, boardType = 8, onlineFlag = 1 
TDC slot = 4, boardType = 8, onlineFlag = 1 
TDC slot = 5, boardType = 8, onlineFlag = 1 
TDC slot = 7, boardType = 8, onlineFlag = 1 
TDC slot = 8, boardType = 8, onlineFlag = 1 
TDC slot = 9, boardType = 8, onlineFlag = 1 
TDC slot = 11, boardType = 8, onlineFlag = 1 
TDC slot = 12, boardType = 8, onlineFlag = 1 
TDC slot = 13, boardType = 8, onlineFlag = 1 
TDC slot = 15, boardType = 8, onlineFlag = 1 
TDC slot = 16, boardType = 8, onlineFlag = 1 
TDC moduleId = 18 20 22 0 2 4 6 8 10 12 14  
TDC: VISIONopen Name=geo32:/slot=3 
transferProtocol auto, transferType best, syncMode sync, dataSize 4, autoThreshold 64, addrSize 4  
TDC 0 clearing FIFO and resetting DSP (before): CR old was 0x80000000 
TDC 0 clearing FIFO and resetting DSP (after): CR old was 0x84001800 
TDC: VISIONopen Name=geo32:/slot=4 
transferProtocol auto, transferType best, syncMode sync, dataSize 4, autoThreshold 64, addrSize 4  
TDC 1 clearing FIFO and resetting DSP (before): CR old was 0x8000c100 
TDC 1 clearing FIFO and resetting DSP (after): CR old was 0x84002000 
TDC: VISIONopen Name=geo32:/slot=5 
transferProtocol auto, transferType best, syncMode sync, dataSize 4, autoThreshold 64, addrSize 4  
TDC 2 clearing FIFO and resetting DSP (before): CR old was 0x8000c100 
TDC 2 clearing FIFO and resetting DSP (after): CR old was 0x84002800 
TDC: VISIONopen Name=geo32:/slot=7 
transferProtocol auto, transferType best, syncMode sync, dataSize 4, autoThreshold 64, addrSize 4  
FISION: S_errno_EIO (0x5): VME BERR received! 
TDC: Cannot access TDC (3) 0xff 
TDC: VISIONopen Name=geo32:/slot=8 
transferProtocol auto, transferType best, syncMode sync, dataSize 4, autoThreshold 64, addrSize 4  
TDC 4 clearing FIFO and resetting DSP (before): CR old was 0x8000fffc 
TDC 4 clearing FIFO and resetting DSP (after): CR old was 0x84004000 
TDC: VISIONopen Name=geo32:/slot=9 
transferProtocol auto, transferType best, syncMode sync, dataSize 4, autoThreshold 64, addrSize 4  
TDC 5 clearing FIFO and resetting DSP (before): CR old was 0x80000000 
TDC 5 clearing FIFO and resetting DSP (after): CR old was 0x84004800 
TDC: VISIONopen Name=geo32:/slot=11 
transferProtocol auto, transferType best, syncMode sync, dataSize 4, autoThreshold 64, addrSize 4  
TDC 6 clearing FIFO and resetting DSP (before): CR old was 0x8000c100 
TDC 6 clearing FIFO and resetting DSP (after): CR old was 0x84005800 
TDC: VISIONopen Name=geo32:/slot=12 
transferProtocol auto, transferType best, syncMode sync, dataSize 4, autoThreshold 64, addrSize 4  
TDC 7 clearing FIFO and resetting DSP (before): CR old was 0x800067fd 
TDC 7 clearing FIFO and resetting DSP (after): CR old was 0x84006000 
TDC: VISIONopen Name=geo32:/slot=13 
transferProtocol auto, transferType best, syncMode sync, dataSize 4, autoThreshold 64, addrSize 4  
TDC 8 clearing FIFO and resetting DSP (before): CR old was 0x8000c100 
TDC 8 clearing FIFO and resetting DSP (after): CR old was 0x84006800 
TDC: VISIONopen Name=geo32:/slot=15 
transferProtocol auto, transferType best, syncMode sync, dataSize 4, autoThreshold 64, addrSize 4  
TDC 9 clearing FIFO and resetting DSP (before): CR old was 0x80007f00 
TDC 9 clearing FIFO and resetting DSP (after): CR old was 0x84007800 
TDC: VISIONopen Name=geo32:/slot=16 
transferProtocol auto, transferType best, syncMode sync, dataSize 4, autoThreshold 64, addrSize 4  
TDC 10 clearing FIFO and resetting DSP (before): CR old was 0x80000000 
TDC 10 clearing FIFO and resetting DSP (after): CR old was 0x84008000 
TDC 0 Control Register new: 0x8000fffb 
TDC 1 Control Register new: 0x80000104 
TDC 2 Control Register new: 0x80007f10 
FISION: S_errno_EIO (0x5): VME BERR received! 
FISION: S_errno_EIO (0x5): VME BERR received! 
FISION: S_errno_EIO (0x5): VME BERR received! 
FISION: S_errno_EIO (0x5): VME BERR received! 
TDC 3 Toggle of event mask failed : 0xffffffff 
FISION: S_errno_EIO (0x5): VME BERR received! 
FISION: S_errno_EIO (0x5): VME BERR received! 
TDC 3 Control Register after second toggle: 0xffffffff 
TDC 3 Control Register new: 0xffffffff 
TDC 4 Control Register new: 0x80007f10 
TDC 5 Control Register new: 0x8000ff12 
TDC 6 Control Register new: 0x8000fffb 
TDC 7 Control Register new: 0x80007f10 
TDC 8 Control Register new: 0x8000ff10 
TDC 9 Control Register new: 0x8000ffe6 
TDC 10 Control Register new: 0x80007f10 
Cannot configure readout - check readout list. 
Readout process not started. Error status: 1 
Error Processing Readout List ! 
Sent ack to Run Control: 2 ERROR ERROR  
Resetting card in slot 7 failed  
Statechange failed  
 
b0cmx00-&gt;  
</pre>
<!-- Author: Greg Feild -->




<!-- Date: Sat May 31 13:27:42.142 2003 -->
Masa power cycles cmx00, cmx01, musc. 
They still won't pass coldStart. 
Paging experts.
<!-- Author: Greg Feild -->

<!-- Date: Sat May 31 13:28:35.426 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163870">163870</A>
ACTIVATE: including cal crates
<!-- Author: gregf 2080 -->


<!-- Date: Sat May 31 13:39:22.052 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163870">163870</A>
TERMINATE: test ended
<!-- Author: gregf 2080 -->




<!-- Date: Sat May 31 13:50:03.447 2003 -->
<pre>Access plan: 
 
1. 1500 for Bill Badgett and Eric James will go in 
2. Another access will be required to close walls  
and remove blower.  Keith Gollwitzer will call around  
1600 to check our progress.</pre>
<!-- Author: ADF -->

<!-- Date: Sat May 31 13:54:16.188 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163871">163871</A>
ACTIVATE: L2 Torture without svt-crates
<!-- Author: gregf 2080 -->



<!-- Date: Sat May 31 14:02:33.137 2003 -->
The HV of the central calorimeter is adjusted to nominal values.
<!-- Author: fotis -->

<!-- Date: Sat May 31 14:23:18.818 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163871">163871</A>
TERMINATE: run ended
<!-- Author: gregf 2080 -->



<!-- Date: Sat May 31 14:28:17.900 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163872">163872</A>
ACTIVATE: Cal QIE calibration
<!-- Author: gregf 2080 -->


<!-- Date: Sat May 31 14:28:34.509 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163872">163872</A>
TERMINATE: Cal QIE calib done
<!-- Author: Thorsten 2080 -->


<!-- Date: Sat May 31 14:33:01.352 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163873">163873</A>
ACTIVATE: CLC QIE calib.
<!-- Author: Thorsten 2080 -->
<!-- Comment: Sat May 31 14;46;59 comment by...Ken Bloom -->
Looks OK.
<!-- Date: Sat May 31 14:33:01.705 2003 -->
I have put a comment on entry about bo0svt03 above. 
 
For b0svt00 I observer that non of the 6 HF boards 
are listed in the crate dump. I can't belive 
all of 6 borke at the same time. Is one voltage 
missing by any chance ? Maybe the opt.link. receivers 
in the back have problems and confuse the 6 HF ?
<!-- Author: Stefano -->
<!-- Comment: Sat May 31 15;54;43 comment by...SCN -->
The HF will not see any data (i.e. light) from the Fibs until
the Fib racks are turned on (which can happen any time, as far
as I am concerned).
<!-- Date: Sat May 31 14:34:40.984 2003 -->
<pre>Magnetic field trigger inhibit is enabled coming out 
of iFix. This signal does not go throught the "software" 
inhibit either and needs attention at the cryo-end of 
the signal. Ops Mgr trying to get a hold of Steve Hahn 
(Roser on vaction) and Cryo is trying to find a relevant 
expert for their end.</pre>
<!-- Author: steve -->
<!-- Comment: Sat May 31 14;46;17 comment by...jj -->
Roser recently made some changes to solenoid inhibit. <a href=
'/cgi/elog/elog.pl?nb=2003&action=view&page=446&frame=2&anchor=13:37:58.371'>
See this elog entry. </a> There is not a lot of information but
worth noting. 
<!-- Date: Sat May 31 14:36:06.036 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163873">163873</A>
TERMINATE: CLC calib done
<!-- Author: Thorsten 2080 -->


<!-- Date: Sat May 31 14:43:09.923 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163875">163875</A>
ACTIVATE: BSC QIE Calib
<!-- Author: Thorsten 2080 -->


<!-- Date: Sat May 31 14:44:28.690 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163875">163875</A>
TERMINATE: BSC calib ended
<!-- Author: Thorsten 2080 -->
<!-- Comment: Sat May 31 15;13;25 comment by...Ken Bloom -->
Looks OK.
<!-- Date: Sat May 31 14:45:18.777 2003 -->
<br><b>Beam Halo Monitors:</b> 
<br>Turn on HV to beam halo counters after power outage.  Rates 
for all the halo monitors look reasonable. 
<br>
<!-- Author: R.J. Tesarek -->



<!-- Date: Sat May 31 14:48:23.162 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163877">163877</A>
ACTIVATE: Roman Pot calib
<!-- Author: Thorsten 2080 -->


<!-- Date: Sat May 31 14:48:24.463 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163877">163877</A>
TERMINATE: Roman pot calib done
<!-- Author: Thorsten 2080 -->
<!-- Comment: Sat May 31 15;18;14 comment by...Ken Bloom -->
Looks OK.
<!-- Date: Sat May 31 14:54:26.942 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163879">163879</A>
ACTIVATE: TOF QIE calib
<!-- Author: Thorsten 2080 -->


<!-- Date: Sat May 31 14:55:17.061 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163879">163879</A>
TERMINATE: TOF QIE calib done
<!-- Author: Thorsten 2080 -->



<!-- Date: Sat May 31 14:58:08.365 2003 -->
<p>I've started a job on b0l3gate2 which will copy the backup /home and /cdf made at 5 AM last Friday to b0l3gate3 (the eventual replacement for our current gate1). The job is running at high niceness (NI 10) and should yield the CPUs to ordinary interactive and Level 3 jobs. If need be the L3 expert can monitor the jobs with top: look for rsync and ssh. 
<p>
<!-- Author: Steve Tether -->

<!-- Date: Sat May 31 15:04:05.727 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163880">163880</A>
IDLE: <PRE>
The problem with COT18 in spy-mode readout 
persists at high rate.
Will now run Tracer->VRB tests at high statistics
</PRE>

<!-- Author: ace 2080 -->



<!-- Date: Sat May 31 15:05:14.401 2003 -->
Reserve tank water level has stabilized.
<!-- Author: ADF -->


<!-- Date: Sat May 31 15:06:27.834 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-5689&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-5689  width='300' align='top'></td><td>New "bad" channels from calorimeter calibration run 163872. The QIE calibrations gave no bad channels.</a></td></tr></table>
<!-- Author: Ken Bloom -->
<!-- Comment: Sat May 31 15;09;30 comment by...Ken BLoom -->
Rather, these channels came out of the pedestal check.  The QIE
slope check gave no bad channels.


<!-- Comment: Sat May 31 15;36;24 comment by...Vivek -->
Some PIN diodes in PHA showing up as bad channels have stabilized now. Other bad PIN diodes showing up as bad channels in this calibration are much better than before. Just to repeat my comment which I made before: PIN diodes in PHA are not used for data-taking. CEM and CHA bad channels are alos good because they only show a small shift from refernce pedestal values.
<!-- Date: Sat May 31 15:15:11.959 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163881">163881</A>
ACTIVATE: Central laser run, B on default timing, (after power outage week)
<!-- Author: Thorsten 2080 -->



<!-- Date: Sat May 31 15:16:12.024 2003 -->
<pre>Trying to get various HV/LV/etc. up and going. 
Current Rack alarms: 
PSM- 
    o Large sector of non-responding Central.  
      Fixed by appropriate twiddle of monitor cable 
      on 1st floor. 
    o 3 SMD crates : 04W 02W, 01W for which 
      Fan packs are said to be operating at 20%. 
      Experts (Willis) claim this is not "real" 
      but Karen Byrum being contacted. 
    o SVX Fib crates: Power is off by design. 
</pre>
<!-- Author: steve -->
<!-- Comment: Sat May 31 15;17;05 comment by...steve -->
Willis says that Karen B. says it (fan error) is likely
a readout issue. She'll check on it when an appropriate
access can be made-assume its okay for now.
<!-- Comment: Sat May 31 15;27;23 comment by...ADF -->
A similar thing happened Feb. 8, right after an access; eventually the PSM fixed itself.  Karen recommends masking off in the PSM.

<!-- Comment: Sat May 31 15;33;45 comment by...Masa -->
<pre>Alarm from these 3 wedges are masked off for now.
Karen wants to be paged if the next access oppotunity
comes earelier tonoight or tomorrow. </pre>
<!-- Date: Sat May 31 15:16:17.456 2003 -->
Take central laser run with B field on and default timimng.   
<!-- Author: fotis :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163881' target=_top>163881</a>) -->




<!-- Date: Sat May 31 15:22:00.264 2003 -->
The COT is at 100% high voltage and is back under the control of the shift crew.
<!-- Author: Bob Wagner -->


<!-- Date: Sat May 31 15:22:22.789 2003 -->
Bill Badgett and Eric James entering on Controlled Access to check COT TDC's.
<!-- Author: ADF -->




<!-- Date: Sat May 31 15:34:07.476 2003 -->
SVT errors in "config" which Greg Field pointed out ( 
<a href= 
'/cgi/elog/elog.pl?nb=2003&action=view&page=452&frame=2&anchor=12:17:28.636'> error1 </a>   
and <a href= 
'/cgi/elog/elog.pl?nb=2003&action=view&page=452&frame=2&anchor=12:23:53.589'> error2 </a>  ) 
was fixed. <p> 
 
"error1" comes from Track Fitter board (slot12) of b0svt03. 
This was fixed using hot reseat  
just like a previous error ( 
<a href= 
'/cgi/elog/det-system-elog.pl?nb=svt&action=view&page=6&frame=2&anchor=17:12:35'> SVT log </a> ). 
We are not sure what cause this problem, but rarely happen after power outage. <p> 
 
"error2" was mysterious. But after power off and on,  
 we have successful "config" (once called "coldstart"). 
Error log written by Greg looks like Hit Finder borads had errors 
and really tripped in hardware.<br> 
We are continuously looking this with care. <p> 
   
Anyway, fakehits test in SVT alone is now fine. 
We will have no problem. 
  
<!-- Author: Taka Maruyama -->


<!-- Date: Sat May 31 15:40:34.610 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163883">163883</A>
Config transition state: <PRE>
Running DAQ tests on cot18 in spy mode after reseating 
Tracer and its fibres.
</PRE>

<!-- Author: ace 2080 -->


<!-- Date: Sat May 31 15:43:29.271 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163883">163883</A>
TERMINATE: <PRE>
Unfortunately, we still see the same Tracer byte swapping 
errors.  Now we suspect the new Rev E TDC in slot 19 and 20.
</PRE>

<!-- Author: ace 2080 -->



<!-- Date: Sat May 31 15:53:46.937 2003 -->
at the request of SciCo, I turned HV on. Bottom A1/D1 
tripped half way through the ramping up. This is the  
north side where the spill occured. I am going down to check if the floor is still wet.
<!-- Author: hyunsoo -->
<!-- Comment: Sat May 31 16;24;11 comment by...hyunsoo and Andy -->
We went to check the floor under the grating in the north west side. saw some water (spotty but it is there). We will keep the fan on and the bottom A1/D1 section off till the morning. The CMP HV control is for the expert only.
<!-- Date: Sat May 31 15:55:54.190 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:02</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Sat May 31 15:57:05.730 2003 -->
<h2>Day Shift Summary</h2> 
 
<ol> 
<li> Started shift with mystery leak.  Cryo techs dumped water (20-60 
gallons a pop) into reserve tank 28 times over the course of the 
night.  All systems off except COT racks (to keep endplate warm). 
 
<li> Controlled access found leak in CONWB crate inside the muon wall. 
Outlet valve closed and leak contained.  Water went under detector, 
where there is a drain.  Fan placed there to help speed drying. 
All racks now on except silicon.  Water level stabilized by end of shift. 
<b> Walls out at end of shift</B>. 
 
<li> CMP may have been dripped on; LV is on, but <b><font color="#FF0000">  
CMP HV is now an expert operation</b></font>. 
 
<li> A few diagnostic PIN diodes in PHA very noisy now 
 
<li> Had serious troubles bringing up crates SVT00, SVT03, CMX00, CMX01,  
and MUSC00. SVT expert fixes SVT.  Eric James now looking at muon tdcs. 
 
<li> Took CAL QIE, CLC QIE, SMX, ToF QIE, BSC, Roman Pots, Central Laser, calibrations. 
 
<li> Solenoid is now inhibiting trigger, solenoid interlock expert on the 
way in. 
 
<li> SMD PSM (fans) alarming and masked off. Page Karen (SMX LRP) if  
there is an access at a reasonable hour. 
 
<li> Controlled access to reseat COT TDC's.  Problems remain after reseating 
and they will swap. 
 
<li> We need to take a Rick's Run after the final access to be sure that 
all cables are still connected. 
 
<li> CMP HV tripped while bringing up.  May go in to check out. 
 
</ol>
<!-- Author: ADF -->

<!-- Date: Sat May 31 16:04:22.658 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163884">163884</A>
Config transition state: Replaced slots 19 and 20 with Rev D TDCs; Eric has reprogrammed them.
Taking test run.

<!-- Author: ace 2080 -->


<!-- Date: Sat May 31 16:06:31.928 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163884">163884</A>
TERMINATE: <PRE>EVB does not respond at ACTIVATE, so we 
must now clean it up AGAIN!</PRE>

<!-- Author: ace 2080 -->


<!-- Date: Sat May 31 16:12:24.601 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163885">163885</A>
ACTIVATE: Try again after EVB clean up
<!-- Author: W.Badgett 2080 -->


<!-- Date: Sat May 31 16:12:25.440 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=163885">163885</A>
TERMINATE: EVB Failed to activate yet AGAIN.

<!-- Author: W.Badgett 2080 -->




<!-- Date: Sat May 31 16:26:42.762 2003 -->
<pre>CSL Failed to ACTIVATE; restarted CSL. 
</pre><font color=red><cite>(entry outside this shift's time range )</cite></font>
<!-- Author: W.Badgett -->