<!-- Title: 12:02:21  Thu May  5 2005 -->
<!-- Crewchief: Willis -->
<!-- Op1: &nbsp; -->
<!-- Op2: &nbsp; -->
<!-- Op3: &nbsp; -->
<!-- Op4: &nbsp; -->
<!-- Op5: &nbsp; -->
<!-- Op6: &nbsp; -->
<!-- Notes: -->
<pre>May 2005 
</pre>


<!-- Date: Thu May 5 12:10:00 2005 -->
<p>Plug HV access work</p> 
<ul> 
<li>CAEN Crate 6 slot 3 (ch 10: set 1165v, readback 1098v) and 
    crate 10 slot 9 (ch 3: set 1193v, readback 1196v) 
    replaced.</li> 
<li>CAEN crate 10 EEPROM was reformated via the RS232C 
    terminal input ("Format EEPROM" command). Prior to this 
    reformatting, the group configurations could not be 
    downloaded. Several shower max slots and the pin diode 
    group could not be set, and the readback of the configuration 
    had junk. After the EEPROM reformatting, all groups 
    downloaded properly.</li> 
</ul>  
<!-- Author: Willis, Howard, Steve  -->


<!-- Date: Mon May 9 18:11:27 2005 -->
<p>More channel problems:</p> 
<ul> 
<li>Crate 10 slot 9 chan 11: the V1 configuration parameter 
    (stamdby) seems to get screwed up on power cycles and had 
     to be downloaded. May have to replace this HV module 
     again...</li> 
<li>Crate 10 slot 4 chan 09: reads back ~200V above set for both 
    the standby and operating HV. Could not fix it by power 
    cycling crate 10. This needs to be replaced on an access.</li> 
</ul>
<!-- Author: Willis -->
<!-- Comment: Thu May 12 11;57;38 comment by...Willis -->
The slot 4 and 9 HV modules were replaced during the 
12May05 access.


<!-- Date: Wed Jun 15 08:41:42 2005 -->
<pre>CAEN crates 7 and 9 went into "fan failures" early in the 
morning of 13Jun2005. Crate 7 was replaced on 13Jun05, and 
crate 9 on 14Jun05. </pre>
<!-- Author: Willis -->


<!-- Date: Thu Jul 7 08:20:37 2005 -->
New HV configuration file: hv070705.txt ( MAPMT #19 in East Box 11) 
updated.
<!-- Author: Willis -->


<!-- Date: Thu Sep 1 11:38:40 2005 -->
Plug HV access work report: 31 Aug 2005 
<ul> <li>CAEN crate 7 replaced. The "Fan Failure" LED was going on and off, along with the crate beeping. We guessed this meant the crate was close to failing. Also, the HV module in slot 8 was replaced (chan 4 bad). The replacement crate refused to cooperate for about half an hour, but finally decided to behave properly.</li> <li>CAEN crate 8 slot 3 HV module replaced (chan 12 bad)</li> <li>CAEN crate 9 slot 7 HV module replaced because its checksum was bad. This prevents loading group parameters for 
channels in this HV module. 
</li> </ul>
<!-- Author: Willis -->
<!-- Comment: Fri Sep  2 16;58;13 comment by...Willis -->
CAEN crate 9 also had its HV inhibit bits srambled at the same
time that the slot 7 HV module died.


<!-- Date: Fri Jan 20 13:52:12 2006 -->
<p>Plug HV work done in collision hall access on 18 January 2006: 
  We replaced the following HV modules in the following plug 
  CAEN crates. 
<ul> 
<li>Crate07, Slot00: Chan07 (PHA 22W-13.1) Vset=1125v, 
    Vread=1071v </li> 
<li>Crate07, Slot02: Most channels Vread 0.2% high</li> <li>Crate12, Slot02: Chan08 (PEM 20E-14.0) Vset=853v, Vread=814v         
    </li> 
</ul> 
These seem to be internal calibration problems. Also plug CAEN 
crate 09 also shut itself off again on 19Jan06, probably 
because the ambient air temperature up at the top of the 
detector was a bit too hot from the HVAC air recirculation 
fans being off.  
</p>
<!-- Author: Howard Budd, Jiyeon Han, Willis -->


<!-- Date: Wed Feb 22 14:10:09 2006 -->
<p>Plug HV work on 22 February 2006 access: 
<ul> 
<li>Crate 01,Slot07: Replaced, as the HV module could not be 
    accessed. The RS232C front panel program indicated a "checksum 
    error". 
</ul> 
The hv.exe monitor reported a "Group configuration" error, similar 
to the Crate 10 problem of <a href= 
'/cgi/elog/det-system-elog.pl?nb=hvplug&action=view&page=2&frame=2&anchor=12:10:00'> 
5May05.</a>   The group configurations could not be downloaded 
for channels in this slot, and doing so made the problem worse: 
Reformatting the Crate 01 EEPROM did not work.  
If hv.exe reports  "Group configuration" errors, it now appears that downloading the group configuration 
without first reformating the CAEN crate EEPROM is BAD. 
</p>
<!-- Author: Steve Hahn, Willis -->
<!-- Comment: Wed Feb 22 17;38;41 comment by...Willis -->
<p>More configuration memory problems with Crate01. The
   alarm level bits, 0vc/Ovv/Unv, are also corrupt and causing
   DAQ trigger inhibits. They should be off/off/off but are
   on/off/off.
</p>


<!-- Date: Thu Mar 30 15:12:58 2006 -->
<p>Shutdown plug HV work: 30 March 2006 summary</p> 
<p>The top 4 plug CAEN crates [2.3,8,9] came back from PREP and 
   were reinstalled. The maintenance work: All fans replaced, and 
   all A932AN HV modules recalibrated. 
<ul> 
<li>Crate 2: Group configuration downloading failed. Clearing the 
    SY527 EEPROM via the RS232 control program did not work. In 
    addition, the SY527 reports "Caen Error 1" during hv.exe 
    startup, and a crate status just hangs (0xff00 error). This 
    was replaced with the last SY527 spare in B0. </li>  
<li>Crate 3: No problems -- came up and downloaded properly.</li> 
<li>Crate 8: No problems -- came up and downloaded properly.</li> 
<li>Crate 9: Original crate shuts down when the hall is warm 
             (during access) and all HV modules are on. This 
             crate is being shipped back to CAEN for repair. 
             The replacment crate downloaded properly and runs 
             without problems.</li> 
</ul> 
All the crates now okay: All came up to very close to their 
set point voltages. 
</p>
<!-- Author: Willis -->


<!-- Date: Fri Apr 28 14:16:23 2006 -->
<p>Shutdown plug HV work: 28 April 2006</p> 
<p>The bottom 8 plug CAEN SY527 crates are back from PREP. All 
   cooling fans have been replaced, and all A932AN modules have 
   been recalibrated. 
<ul> 
<li>One SY527 encountered problems during the fan replacement: 
    A power short blew out a relay and fuses. They were replaced. 
    The Group00 (non-programmable) configuration memory got 
    wiped out. A Format from the RS232 controls fixed it. This 
    crate came back with a bad fan, so it has to be fixed. 
    This is our only spare at the moment.</li> 
<li>The other 8 crates checked out without too much trouble. 
    Crate 5, before it was installed, checked out okay. After 
    it was installed, some HV modules failed to respond to a 
    crate map, and some of the group configurations programmed 
    in earlier appeared to have been corrupted. After a RS232 
    Format, and reprogramming, it now appears to be working 
    properly. Only time will tell if this crate really has a 
    problem.</li> 
</ul> 
</p>
<!-- Author: Willis -->


<!-- Date: Wed May 10 14:57:51 2006 -->
<p>Shutdown plug HV work: 09,10 May 2006 
<ul> 
<li>CAEN crate 10: Slots 0 and 1 upper HV cables were swapped 
    during the reinstallation at the end of Apr06. They were 
    moved back to their correct positions.</li> 
<li>CAEN crate 05: Slots 1 and 3 A932AN modules were replaced. 
    (Slot 1: ch 13 had Vset=848v, but Vmon was 1.7% high. 
     Slot 3: ch 5 had Vset=1051v, but Vmon was 1.6% high; 
             ch 13 hav Vset=1017v, but Vmon was 1.9% high.)</li> 
<li>CAEN crate 02 also has about half its HV modules reading 
    back 0.25% too high.</li> 
</ul> 
</p>
<!-- Author: Willis -->


<!-- Date: Thu May 25 10:46:01 2006 -->
<p>Plug HV Work: 24, 25 May 2006 
<ul> 
<li>SY527 crate 2 replaced on 24May06: Many A932AN modules  
    within it had a large fraction of channels reading back 
    (Vmon) 0.2% too low. This problem was fixed with the 
    replacement SY527 (which was previously crate 10).</li> 
<li>Crate 2 slot 6 A932AN replaced: Vset=1106v but Vmon=1070v 
    and slowly dropping. Module: Bologna ID: 8686.</li> 
<li>Crate 2 slot 5 A932AN replaced: About 90% of channels 
    Vmon was 0.2% low for Vset of about 700v. Bologna ID: 
    8687.</li> 
</ul> 
The hvMonitor (hv.exe) warnings for channels whose Vmon to 
Vset difference is above (0.1% I think) is down to about 10 
channels. 
</p>
<!-- Author: Willis -->


<!-- Date: Wed Jun 21 12:43:44 2006 -->
<p>Plug HV work: 21 June 2006 access 
<ul> 
<li>Crate 12 slot 0 A932AN (Fnal ID 575190) replaced. Channel 
    17 HV was unstable: For Vset=1100v, Vmon wandered from  
    -20% to +20%. According to YMon plots, the acutal HV 
    was very low -- so low that the tower was effectively dead.</li> 
</ul> 
</p>
<!-- Author: Willis -->


<!-- Date: Tue Jul 25 15:34:36 2006 -->
<p>Plug HV work, 25 July 2006 access: The A932AN in crate 5 slot 
   5 (FNAL ID 575336) had firmware corruption -- checksum error -- 
   at the time of the Feeder 48 fault and power outage. It was 
   replaced with a spare. 
</p>
<!-- Author: Willis -->


<!-- Date: Sat Nov 18 21:19:42 2006 -->
<p>Plug HV work: 18 Nov 2006 access 
<ul> 
<li>CAEN SY527 crate 07 (FNAL ID 555278, SN:E283) replaced. 
    The crate shuts down after 5-10 minutes of operation at 
    full load. At the standby voltage level, the crate does 
    not trip off. It is not a "Fan Failure" problem, but  
    a power supply loading problem. There was no failure 
    indication on the front panel. The SY527 logo was on the 
    LCD, but its menu did not work. 
</ul> 
</p>
<!-- Author: Willis -->