<!-- Title: 10:21:32  Fri Mar 30 2001 -->
<!-- Crewchief: K.Byrum -->
<!-- Op1: &nbsp; -->
<!-- Op2: &nbsp; -->
<!-- Op3: &nbsp; -->
<!-- Op4: &nbsp; -->
<!-- Op5: &nbsp; -->
<!-- Op6: &nbsp; -->
<!-- Notes: -->
<pre>SMX Elog for recording all SMX related tasks/problems/solutions.</pre>


<!-- Date: Thu May 3 15:54:57 2001 -->
<pre>We swapped the proms on the SMXRs in ccal07. 
this is the SMC prom - new prom id = S30. 
 
the smxr's are: 
slot 3, id 564566 
slot 4,    564553 
slot 5,    564544 
</pre>
<!-- Author: byrum,lindgre -->


<!-- Date: Fri May 4 15:21:36 2001 -->
<pre>&lt;html&gt; 
&lt;h1 Align-center&gt; &lt;font color="#ff0000"&gt; 
SMX Crates to include in Run Configuration as of May 04, 2001&lt;/font&gt;&lt;/h1&gt; 
&lt;hr&gt; 
&lt;br&gt; 
&lt;ul&gt; &lt;font color=green&gt;&lt;li&gt; Plug ShowerMax Crates: &lt;/font&gt; 
 
     &lt;ul&gt; &lt;li&gt; West Plug Crates: 
          &lt;ul&gt; Pcal01,Pcal02,Pcal04,Pcal05 (slots 4,5,6) 
	  &lt;/ul&gt; 
     &lt;/ul&gt; 
     &lt;ul&gt; &lt;li&gt; East Plug Crates: 
          &lt;ul&gt; Pcal07,Pcal08,Pcal10,Pcal11 (slots 4,5,6) 
	  &lt;/ul&gt; 
     &lt;/ul&gt; 
&lt;/ul&gt; 
 
&lt;ul&gt; &lt;font color=green&gt;&lt;li&gt; Central ShowerMax Crates&lt;/font&gt; 
  
    &lt;ul&gt; &lt;li&gt; East Central Crates: 
          &lt;ul&gt; Ccal08- slot3(phi0),slot4(phi1),slot5(phi2) 
	  &lt;/ul&gt; 
          &lt;ul&gt; Ccal09 -slot3(phi3),slot4(phi4),slot5(phi5) 
	  &lt;/ul&gt; 
          &lt;ul&gt; Ccal10- slot3(phi6),slot4(phi7),slot5(phi8) 
	  &lt;/ul&gt; 
          &lt;ul&gt; Ccal11 -slot3(phi9),slot4(phi10),slot5(phi11) 
	  &lt;/ul&gt; 
          &lt;ul&gt; Ccal12- slot3(phi12),slot4(phi13),slot5(phi14) 
	  &lt;/ul&gt; 
          &lt;ul&gt; Ccal13 -slot3(phi15),slot4(phi16),slot5(phi17) 
	  &lt;/ul&gt; 
          &lt;ul&gt; Ccal14 -slot3(phi18),slot4(phi19),slot5(phi20) 
	  &lt;/ul&gt; 
          &lt;ul&gt; Ccal15 -slot3(phi21),slot4(phi22),slot5(phi23) 
    &lt;/ul&gt; 
     &lt;ul&gt; &lt;li&gt; West Central Crates: 
          &lt;ul&gt; Ccal00- slot3(phi0) 
	  &lt;/ul&gt; 
          &lt;ul&gt; Ccal02 -slot3(phi6),slot4(phi7),slot5(phi8) 
	  &lt;/ul&gt; 
	  &lt;ul&gt; Ccal03 - slot3(phi9),slot4(phi10),slot5(phi11) 
	  &lt;/ul&gt; 
	  &lt;ul&gt; Ccal04 - slot3(phi12),slot4(phi13),slot5phi14) 
	  &lt;/ul&gt; 
          &lt;ul&gt; Ccal05 - slot3(phi15),slot4(phi16),slot5(phi17) 
	  &lt;/ul&gt; 
          &lt;ul&gt; Ccal06- slot3(phi18),slot5(phi20) 
	  &lt;/ul&gt; 
          &lt;ul&gt; Ccal07 -slot3(phi21),slot4(phi22),slot5(phi23) 
	  &lt;/ul&gt; 
 
     &lt;/ul&gt; 
&lt;/ul&gt; 
 
	</pre>
<!-- Author: byrum,lindgren -->


<!-- Date: Mon Jul 16 12:08:11 2001 -->
<pre>Wed Mar 21 16:34 
---------------- 
Summary of central preamp work done by Byrum, Lindgren, Drake:  
On the west 10-17 are now done, on the east 12-22 are installed  
but 22 has a crate problem and is powered off.  
SMDs are in west 9-23 and 0, east 0-5 and 12-23 but of course  
22 is off. 
 
 - Larry N.  
 
Tue Apr 3 13:24 
--------------- 
Fixed SMX calibration consumer writing to database by compiling in 3.14.0 and updating script which generates tcl 
file. Verified run 111132 in integration database using DBANA. SHIFT CREW PLEASE RESUME SMX CALIBRATIONS 
- convery,byrum :: (run 111132)  
 
 
Wed Apr 4 23:18:49  
------------------ 
WHile performing the SMX timing scan,  several of the  
SMXRs reported not responding when their timing was  
set to various values.  
 
Delay  
0             ccal13 slot5 stopped responding.  
110           ccal12 slot5 and ccal14, slot4 stopped responding  
132           all 3 above plus ccal04, slot5 and ccal14 slot3.  
 
We are clueless.       
 
When we set the timing back too 44ns, all 5 SMXRs return to  
the responsive. 
 
 - byrum,kuhlmann 
-- Wed Apr 4 23:39:26 comment by...Bill --   
 
Thu Apr 12 22:19:36  
-------------------- 
Working on SMX calibration saga.  
 
Several problems, some fixed but SMX calibrations still not successful and data are not appearing in 
DB.  
 
 
Heres a history of what i can remember from today.  
 
1. SMX Data is now written into vectorized tables.  These are listed as CESQIE2,etc banks inside 
DBANA.    
 
 
2. Thus, SMX Calib Data once again is written into production DB.  
(one caveat is we modified the SMQIECALIB parameter set to point back to the production db, but 
probably forgot to save it)  
 
 
3.  We were successful in calibrating 1 ccal SMX crate and 1 pcal crate and the data appeared in the 
production DB.  
 
 
4.  The new RC had a problem with the configuration in the hardware DB which caused reformatter 
errors if plug crates pcal10 and pcal11 were booked (thus all calibrations since using new RC have 
failed because of this).  Arnd fixed this problem today  around 4:30pm.  
 
 
5.  Even after the fix of the hardware database configuration problem, we could not calibrate with 
pcal1,2,4,5,7,8,10,11 and ccal3,4,12,13,14.   The error is not with the software event builder 
reformattor now.  In fact the software event builder  
 
now processes the data and the CSL appears to start  
processing the data, but then hangs.     
 
We will continue this saga tomorrow.  
 
 - byrum,cranshaw,convery,  
 
 
And the gaps between runs are due to runs that failed due 
to the SMX readout problems. Here is a fragment from the 
log file for 111286: 
 
  (MLE) b0ccal13:Messenger:7:25:53 PM-&gt;Runtime Error 2, Event 2: SMXR in slot 5 is not responding, 
header 0x0x3bfe500 
 
 
-- Wed Apr 4 23:48:34 comment by...bill orejudos --  One more thing: runs 111300 and 111303 were taken with nominal SMX settings, 
with no problem. 111300 had about 8K events, 111303 about 25K  
events.  
 
Fri Apr 13 08:49:06  
------------------- 
SMX calibration -  
 We modified SMQIECALIB to point to production database and  
saved this .   Future calibrtions will now point to correct  
database.  We booked, ccal3,4,5,12,13,14,15,pcal 1,2,4,5,7,8,10,11.  Current calibration data is now 
written to  
 
vectorized tables.  
 
CESQIE2  
CCRQIE2  
CPRQIE2  
PESQIE2  
PPRQIE2  
 
This is how they will show up in DBANA.  Pedestals   
are still in the same tables as before.  
 
Last evening when we tried this calibration, the Consumer (not CSL) appeared to hang once it started 
processing events.  
 
This morning, this did not happen and with our first attempt,  
it worked.   SMX calibration data was written to DB. 
 
 - cranshaw,byrum :: (run 111921)  
 
 
Tue Apr 17 22:57:55  
------------------- 
Shower Max SMQIE calibration (run 112373). Appeared to run OK: no errors in error display window, and log 
files appear in /cdf/code-common/cdfonline/smx_calib. Howere the rc errorfile shows the following message: (MLE) 
b0dap62.fnal.gov:sevb:10:47:55 PM-&gt;Problem on CSL connection. Status returned: -10 Tried to run the SMQIE again (run 112374), same 
result. Sent email to byrum, vaia, & vaiciuli@fnal.gov. - rob :: (run 112373)  
 
 
 Wed Apr 18 21:14:46  
---------------------- 
Ended the run due to:  
(MLE) b0ccal04:Messenger:8:58:34 PM-&gt;Runtime Error 1, Event 1355481: See nonsequential event number 
(old 8, new 0) in L2 message  
 
(MLE) b0ccal04:Messenger:8:58:34 PM-&gt;Runtime Error 3, Event 1355481: SMXR in slot 3 is not 
responding, header 0x0x3bfe322  
 
(MLE) b0ccal04:Messenger:8:58:34 PM-&gt;Runtime Error 5, Event 1355481: SMXR in slot 4 is not 
responding, header 0x0x3bfe422  
 
(MLE) b0ccal04:Messenger:8:58:34 PM-&gt;Runtime Error 7, Event 1355481: SMXR in slot 5 is not 
responding, header 0x0x3bfe522    
 
 
HRR had no effect.  
Ended the run. 
 
 - rob :: (run 112401) 
-- Wed Apr 18 21:20:57 comment by...rob --  About 7 hours of uninterrupted running, 1.3 M events!  
-- Wed Apr 18 21:33:55 comment by...rob --  Sent email to byrum & jsm.  
 
 Thu Apr 26 16:50:12  
-------------------- 
Just changed internal SMX timing to 0ns for central and 66ns for plug. If any SMXR's start acting up (giving not 
responding error) page the SMX pager and email byrum and kuhlmann.  - Steve Kuhlmann  
</pre>
<!-- Author: byrum -->


<!-- Date: Mon Jul 16 14:23:32 2001 -->
<pre>Tue May 1 16:45:26  
------------------ 
 SMX installaion continues: We installed 2 wedges of preamps in East phi=11,10. Fixed a problem with ordering of preamp boards in East 
 phi=18. 
 
 - k.byrum,m.lindgren  
 
 
Tue May 1 15:41:17  
------------------ 
Jim Proudfoot, Gary Drake and I studied the SMX readout problem seen at the beginning of the 36x36 store. We 
were able to reproduce it and isolate it to a certain fpga programming on the SMXR. It happened in calibrate mode as well with certain 
internal delay settings. Hopefully this can be reproduced at ANL tomorrow and new firmware produced to fix it. Now we are working on 
an improved calibration algorithm with as many cal crates as possible. - Steve Kuhlmann  
 
 
Wed May 2 16:03:32  
------------------ 
I am finished with ccal crates, but Karen Byrum and Mike Lindgren continue to install SMX hardware 
downstairs, turning off power whenever necessary. This will keep you from running. Check with them if you need a crate to run (entry 
outside this shift's time range ) - Steve Kuhlmann  
 
 Wed May 2 16:46:30  
------------------- 
Installed 4 crates of central SMX preamps on wedges 8,9,10,11 East. REplaced one SMD board on wedge 
8E(slot 2) - M. Lindgren, K. Byrum 
 
Thu May 3 15:50:26  
------------------ 
We swapped a SMXR timing prom on SMXR boards in  
ccal07, slot 3,4,5.  We will test these tonight and tomorrow  
to see if this fixes the problem observed in myron mode  
when the SMXRs stop responding. 
 
 - byrum,lindgren  
 
Thu May 3 16:36:47  
------------------ 
Fixed SMXR in pcal11 - reseated termination board in SMD crate 2  
read out by SMXR slot 6, b0pcal11.   Looks ok.   please  
include this in runs again.  
 
 - byrum,lindgren  
 
 
 Fri May 4 15:27:19  
------------------- 
We installed 4 more SMXR crates of preamps to central  
West Phi=6-9.  
 
The Summary of instrumennted SMX crates:  
ccal08  - ccal15 (entire  East end phi 0-23)  
 
ccal00 (phi=0),   
ccal02 -07 (phi=6-23 but excluding phi=19) 
 
 - byrum,lindgren  
 
 Tue May 8 16:14:44  
------------------- 
We installed 2 more  crates of showermax SMD preamps.  We  
only have  1 more wedge to go (east phi=19 is the only wedge  
without preamps)!  
 
Tried to fix a problem with the SMD crate on East Phi=4.  
It appears the Calenable line is never being released.  
Pedestals float to whatever value the dac was last set to.  
We swapped SMC's, SMXR's, tried new SMXR to SMC cable,  
examined all pins on SMD cards and backplane.   We were  
not able to fix the problem.  Need to take a scope up  
to the wedge tomorrow.  
 
 - byrum,lindgren  
 
 Wed May 9 11:05:48  
------------------- 
Tried to get a cosmics run going with SEVB. Immediately got a Done TO from CCAL06: SMXR in slot 4 is not 
responding. HRR does not help. - rob 
-- Wed May 9 13:12:33 comment by...rob --   
 I removed CCAL06, and Karen Byrum confirmed they were working on it. When I tried a run, however, I immediately got a "Done 
 TO[RXPT]", from some CCAL crates, and no other info messages. The crates which produced the Done TO changed, and when I 
 removed the CCAL crates, other crates (e.g., MUTR00, CLC) gave the Done TO. Note: I am running cosmics with SEVB. We also get 
 Done TOs with "Calib Continuous" + SEVB. We do NOT get Done TOs when neither SEVB nor HEVB is used. Experts consulted so 
 far: Byrum, Tesarek, Feild, Patrick, Chlebana. Switch to HEVB for now. 
 
Thu May 10 16:55:51  
------------------- 
Replaced Rabbit B supply on west plug smd crate 1.  +7.5 supply  
was sagging and causing calibration failures in the SMXR in  
pcal05 slot 5. 
 
 - lindgren, byrum  
 
 Fri May 11 12:34:12  
-------------------- 
SMX system -  
  replaced a SMD termination board on Central West phi=4.  
ccal01,  slot4 now looks good.  
  fixed loose cable on pcal08, slot4.  looks good now.  
  replaced various SMD boards on pcal08,ccal14, ccal15 to  
repair  cad problem and single channel problems.  
 
 
 - byrum,lindgren  
 
 Wed May 16 19:19:41  
-------------------- 
Installed 42 new SMXR proms to fix a queueing problem in the SMXR timing.   All Central SMXRs 
now have this fix.   Worked on a   problem with SmXR readout  in ccal01, slots4 and 5.  The problem 
appeared after the prom switch, however, it now looks to be an SMD problem. 
 
 - byrum,lindgren  
 Thu May 17 17:38:40  
-------------------- 
Upgraded the PROM's in the 24 endplug SMXR's today.  By the  
end of the day, all 24 were working and calibrated.  Discovered  
that the 3 SMD crate fans powered by circuit 14(60 cycle)  
on the west plug were not turning.  The circuit breaker had  
tripped - I suspect that this was the cause of the noxious  
smell in the hall yesterday.  This circuit is located to  
be convenient for plugging things into, but normally has just  
the 3 fans- which have 1 amp fuses in them.  So that breaker  
tripping was caused(probably) by someone plugging something  
else in.  They should have notified someone when it tripped,  
as those crates were quite hot by the time I found them.  
 
Also replaced the +-7.5 volt power supplies on central  
wedges 4 and 5 West.  Both were sagging badly on the pos.  
supply, and this cured the readout problems on ccal01 slots  
4 and 5.  Access to the wedge 5 power connectors is really  
difficult - we need to make extenders or move the connector  
to wedge 4(7 on south). 
 
 - lindgren, byrum  
 
 Fri May 18 16:17:43  
--------------------- 
Swapped out mapmt in position 17 of box 5 west.  Fixed  
SMD readout problem in channels 0 and 12 of ch 3 of corresponding   
smxr.  Swapped out smd board in east phi=2, ccal00, slot 4, ch3  
and fixed another two channels that were having problems calibrating.  Measured high voltage on East 
phi=2 wedge, on  
 
standby measured 104.5 volts(ok).  Looked at fan speeds in  
voltman, and noticed 13 central fan units were listed as having   
problems, either no valid data, or fans dead.  Found W19 fan  
was not plugged in, and that W7 was plugged in, but that the  
60 cycle power was unplugged(circuit 2 on sw arch).  Found a  
readout cable unplugged in E8.  Removed filter in east plug  
crate 11 because there did not seem to be sufficient air flow,  
and found the filter was very dirty.  Found the spare filters,  
and Dervins crew will swap all the plug filter tomorrow.  
Discovered a problem in voltman - E21 was listed as having  
fans off, and they were in fact running.  Unplugged the  
fan speed readout, and after waiting for a readout cycle,  
discovered that W21 was the unit that showed up as being   
unplugged.  Not only that, one unit showed up as being  
turned off at that point, and one turned on.  So there is  
some problem in the cabling of that fan unit.  We looked at  
it with a meter, but didn't remember the output format for  
the fans, so couldn't make to much progress before the   
access ended. 
 
 - Lindgren, Byrum  
 
 
Sat May 19 17:29:44  
---------------------- 
Ended run 115267 after ~50k events to take run for heather, who   
is trying to diagnose a hot tower in the trigger crate.   
Tried starting a COSMIC run, but kept getting  
DONE timeouts in PCAL08. A reboot did not help. Note  
that the aces on the last owl and day shifts also saw  
problems with this crate.   
 
In the meantime I had to clean up L3 and EVB. After this  
was done I tried with PCAL08 once more, again I get  
a DONE timeout with the message:  
 
  Runtime Error 6, event 3: SMXR in slot 4 is not responding,    
  header 0x3dfe473  
  Runtime Error 5, event 3: ShowerMax FE board has stopped     
  sending data, slot 4, header 0x3dfe473  
 
 
So I remove this crate from the run... 
 
 - Bill Orejudos :: (run 115268-115269) 
-- Sat May 19 18:15:24 comment by...bill --  I paged Shower Max folks, they responded to page. They will look into the problem.  
 
Mon May 21 10:48:29  
------------------- 
SMX fixes: We swapped termination boards for West central phi=2  
and looked at Pcal07.  It turns out Pcal07, slot4  was fixed  
last friday during access and then never updated in configuration  
file.     
 
 - byrum,lindgren  
 
 Tue May 22 22:20:47  
---------------------- 
 Reconnected SMD to SMXR loose cable on Pcal08, slot6. These channels were failing calibrations. Reseated termination board in 
 Ephi=16, ccal13, slot4 to fix calibration problem. Swapped SMD board in Wphi=19 ccal06, slot4 to fix 2 single channel problems.  
 
 - byrum,lindgren  
 
 Wed May 23 16:41:12  
--------------------- 
Kuhlmann and Byrum request that start doing regular "Jimmy Runs" for Shower Max. Instructions: 
 
 
 
1) Shower Max Calibration within the last hour.  (It may be  
best to consider running the cosmics routinely at the end of all  
calibrations.)  
 
2) Turn HV to standby on CES,CPR,CCR.   Take 10K cosmics using  
Cosmics[1,112]  or any tagset that will write at least  
10K to the look area.  
 
3) Turn HV to ON for CES,CPR,CCR.   Take cosmics until  
at least 36K is on disk in the look area.   Using  
Cosmics[1,112]  Jimmy had to take 3 separate runs  
to get 12K in each run in the look area.   If there  
is a different tagset that writes all events to  
the look area use it instead (like for Rick's run?). 
 
 - Amidei  
 
Wed Jun 6 22:38:49  
------------------- 
Looking into SMXRs in ccal01, slot3 and ccal08, slot4 which  
were giving both done timeout and SMXR stopped responding  
errors as reported by shift crew tonight.  
 
I tried to calibrate these SMXRs and noticed they appeared  
to be in a funny state since the status bits for readiness  
were reading 12 instead of ff0012.   I reset both crates   
and then calibrations were successful with no errors.    I believe shift crew can rebook these SMXRs 
now, but don't  
 
know why they were in the funny state.     
 
If they should give more errors this evening, please release  
them and send me email byrum@anl.gov and i will investigate  
further tomorrow.      
 
 - byrum  
 
 Fri Jun 8 01:37:47  
------------------- 
SMXR timing Scans  
-----------------  
 
We used a min bias trigger (MINIMUM_BIAS_1_V_2), with early  
myron mode to time in the central and plug showermax.  
Started by downloading a special lookup table which  
doesn't sum the 4 time slices in the central.  
 
SMXR Delay (ns)         Run Number  
---------------------------------  
     44                 117138  
      0                 117139  
     22                 117140  
     66                 117141  
     88                 117142  
    110                 117143  
    132                 117145  
 
    -22 (central)       117146  
     77 (plug)          117146  
 
     11  (central)      117147  
     66  (plug)         117147  
 
We leave the timing delay set to 66ns for the plug and  
0ns for the central.     
 
We also take one run with normal myron mode to study the  
pulse shape in the central.    
   SMXR delay        Run  
-------------------------  
      0 ns central    117148  
     66 ns plug                
 
We leave the SMXR delays set to 0ns for the central and  
66ns for the plug and reconfigure the central SMXRs to  
add the 4 time slices. 
 
 - byrum,lindgren,kuhlmann  
 
 Thu Jun 14 11:33:35  
-------------------- 
SMX access work.  
 
first attempt at fixing the intermittent ccal01, slot3 problem  
and the more recent ccal12, slot3 problem.   
 
 Swapped the SMXR in ccal12, slot3 and the one in   
ccal01, slot3.   opened up the SMD crates for ccal05  
slot 3 and checked/reseated wire cables 0-32 (they   
appeared seated correctly).  Also opened up SMD crate  
for cal12 slot 4 to check/reseat wire and strip cables  
0-31.   one cable of strips were disconnected, although  
i might have disconnected them when opening the crate.  
 
Ran standalone code on swapped smxrs to verify  
everything looked ok.     
 
 - byrum  
 
Thu Jun 14 17:05:23  
---------------------- 
Post access smqie calibration failed for 21e as observed  
using DBANA after aces took calibration (15:00). We tried to  
calibrate it separately, but all SMXR channels fail calibration.  
We looked at voltages using voltman.  they look ok.   Will  
need an access to physically inspect.  Could be the SMXR  
or one of the SMD cards. (We didn't touch   
this SMXR/SMD crate during controlled access today) 
 
 - Larry N.,byrum  
 
 Mon Jun 18 10:40:39  
--------------------- 
SMX work - Swapped the +7.5 power supply for Ephi=21. Also,  
swapped a SMD board in Ephi=9, SMXR channel=3.  using stand  
alone programs, things look ok.   Calibrations look good for  
these channels as well.   
 
 - byrum  
 
Mon Jun 25 17:57:11  
------------------- 
The power supply for SMD crate 21E shows the +7.5 V output at +6.64 V. This is similar to what it was showing 
before Mike Lindgren and Karen Byrum swapped out the power supply. We will leave it unmonitored so it does not create continual 
alarms. However, Karen says the crate is now reading out normally. However, this is what happened when they replaced this supply last 
time and then the crate eventually died. - Steve Hahn  
 
 
 Wed Jun 27 17:15:45  
---------------------- 
SMX - We swapped 15 central preamp boards and 4 central   
SMD boards and 2 plug SMD boards to plug crates to fix  
bad channels.   Looked at power supply on 0W.  this  
wedge had bad data the last few days and voltman was  
reporting a problem with the  5V supply.  both  
the 5V problem and the flaky data went away prior to  
access and during access, everything look ok.     
 
We believe things look improved based on DBANA and  
a short jimmy run.    
 
 - byrum,lindgren,kuhlmann,nodulman,proudfoot  
 
 Mon Jul 9 15:42:57  
-------------------- 
Pager for showermax (Lindgren/Byrum) never called back. If anyone sees them, CCAL00 for run 119709 gave the 
errors:(MLE) b0ccal00:Messenger:3:07:37 PM-&gt;Runtime Error 4, Event 2: SMXR in slot 3 is not responding, header 0x0x3dfe339 (MLE) 
b0ccal00:Messenger:3:08:33 PM-&gt;Runtime Error 6, Event 3: SMXR in slot 3 is not responding, header 0x0x3dfe31c etc etc  - hray :: (run 
119709)  
 
  Thu Jul 12 17:02:30  
---------------------- 
Replaced smd cards in:  
 
plug smd crate 8E, slot 8  
plug smd crate 10E, slot 8  which had single channel errors  
 
Also worked on central smx system.  Removed wire preamp board  
from slot 10 of crate on 22E after disconnecting the high  
voltage for that wedge of ces.  Will leave in this   
configuration for some time to try to debug preamp failure.  
 
Also checked three "A" power supplies on the central arches  
that were reading low in the voltman.fnal.gov smd power  
monitoring web page.  All +5 V supplies were reading ~5.45  
volts at the backplane.  Wedges checked were 20E, 22E, and 1W. 
 
 - Lindgren, Byrum 
-- Thu Jul 12 17:14:04 comment by...lindgren --  Wrote the wrong wedge above for the hv disconnect, the wedge was two above 22, in 
0E.  
 
 Mon Jul 16 09:42:40  
---------------------- 
Karen Byrum and Mike Lindgren returned ccal08. They couldn't find anything wrong with it, having checked the 
pedestals and the calibrations. They noted that it apparently had been read out successfully during running last night.  
 
They asked us to report the details of any problems observed. - Pekka  
</pre>
<!-- Author: byrum -->


<!-- Date: Tue Jul 17 15:11:35 2001 -->
<pre>Access work performed on Monday Jul 16 
--------------------------------------- 
We had swapped Strip cables to W phi-5 on friday 
even though the cable id was correct.   We  
returned the strip cables so cable id was 
correct and looked at front of SMD and SMXR. 
The strip cables appear to be correctly cabled. 
We wait for further evidence that a miscable 
exists. 
 
We looked at CPR cables for East and West phi=19. 
ljn reported these to be swapped from occupancies, 
but this was not the case.  cables as identified 
by labels were correct.  </pre>
<!-- Author: byrum -->


<!-- Date: Wed Jul 18 12:39:23 2001 -->
<pre>SMX work -  
 
  We swapped out the +7.5 V supply for ccal15, slot 3  
(east phi=21) which started sagging 2 days ago and  
all calibrations have failed for that wedge since then.    
This SMXR can now be included back in the run configuration.  
 
  We  swapped 3 plug SMD boards which were reporting  
capid and parity errors via YMON error reporting    
and verified in standalone code.  
(standalone code now shows no errors)  
 
                      old                    new 
pcal08 slot5, smx4   565004-207          564397-1B0 
pcal10 slot6, smx6   564244-117          564255-122 
pcal02 slot6, smx6   564418-1C5          564465-1F4 
 
We also swapped out the SMXR for ccal00, slot4 (West Phi=1) 
because we were not seeing trigger bits in the reces card. 
We first tried strobing data using the spare fiber.  After this 
didn't work, we swapped SMXR's. 
 
                new              old 
ccal00 slot4  564568-107     564481-20 
</pre>
<!-- Author: byrum,lindgren -->


<!-- Date: Wed Jul 18 12:56:55 2001 -->
<pre>Tue Jul 10 11:25:53  
-------------------- 
Entry that should have been made yesterday.  I replaced the  
A supply on wedge 0 West, and swapped the smxr in ccal08 slot 5.</pre>
<!-- Author: lindgren -->


<!-- Date: Tue Jul 24 11:19:58 2001 -->
<pre> The HV to Wedge East 0 has been disconnected since Jul 12 
and all 32 wire channels associated with SMX 2 still look 
alive.   Yesterday at 4:51 pm (Jul 23), we returned this 
voltage to Standby.  We then toggled the Voltage to on and 
standby several times and wrote a pedestal file with each 
configuration (see cdf_smx/smx/eastphi0_*.txt).  The 
preamps all still look alive at this point and we left the 
HV on.    Today, at 10:00am, we discover 3 of the preamps 
are now dead. 
  The plan is to continue looking at these preamps for 
the next few hours to see if more channels die. </pre>
<!-- Author: byrum,lindgren -->


<!-- Date: Tue Jul 24 15:45:27 2001 -->
<pre>SMX  work   - 
 
We swapped the preamp wire cards (ch 0-31) on West Phi=15 
which were dead.   We installed a protection circuit 
between the signal cable and the input to the preamp for 
these channels.    
 
We swapped wire preamp cards to match gains. 
 
SMX  2 (slot 10,wires 0-31) Number 465 Gain -1 
SMX  5 (slot 4, wires 32-63) Number 408 Gain -1</pre>
<!-- Author: byrum, kuhlmann -->


<!-- Date: Tue Jul 24 15:54:38 2001 -->
<pre> 
 
SMX  (shower max) work continued -  
We notied that calibrations taken at noon showed   
east phi=21 failing.   Using Voltman, we observed  
the +7.5V sagging.  We verified this at the detector  
and swapped the +7.5V rabbit supply for East Phi=21.  
 
Calibrations looked ok afterwareds.  
 
We also looked at the connections for the monitoring  
of the SMD crates for east phi 0-1, and 18-23.  These   
are all daisy-chained together and phi 0-1, 23-22  were  
giving alarms while the readout to phi 18-21 was broken.  
We pushed on connectors to the readout for phi=21.  
afterwards it all worked.   </pre>
<!-- Author: byrum,lindgren -->


<!-- Date: Tue Aug 21 11:54:52 2001 -->
<pre>Wed Jul 25 
 
Shower Max Work: 
   
 We swapped out the SMxR in ccal08, slot 4 which had been 
giving intermittent errors over the last 2-3 weeks. 
Please add this SMXR back into the run confiuration. 
 
Mon Aug 6 2001 
 
  Installed two new SMD term boards, one each on wedges 20E 
and 22E to test modes that will give better readback of ps 
voltages.  Replaced SMD boards in ccal07, slot5, smxr ch. 1,  
pcal01, slot6, smcrch 6, and pcal10, slot6, smxrch6. 
 
Tues Aug 7 2001 
 
  We isntalled new preamp boards and protection circuity on  
wire channels 0-31 for central wedges West15, East0 and east 13.  All channels are now alive. 
 
Wed Aug 8 2001 
   
  Shift crew notifies us of a hot channel in SMX in East 
Phi=22.   We run standalone code and cannot read ped. and also 
note last nights calibrations to this wedge had failed. 
 
 We had installed a modifed term. board in this wedge on 
monday and this board had wiggled loose.  Reinserted the 
board more tightly and recalibrated the wedge.  looks ok. 
</pre>
<!-- Author: byrum -->


<!-- Date: Wed Sep 12 14:07:19 2001 -->
<pre>Access Work from Mon Sep10 - Wed Sep12 
 
1.  Steve and Masa fixed some cable swaps in CES and CPR.  
(2 CPR on North side, 2 CES on North side) None of them is 
particularly easy.  
  
       3East - CES front strip cable swap on the SMD cards. 
       19West - CPR cables swapped. 
       19East - CPR cables swapped. 
Barry and Larry fixed the cable swap in 5West - Ces strip 
cables within zippertubing bundle were swapped. 
 
 
2) Karen and Mike Swapped SMD board, SMXRs and Termination 
baords: 
 
  
  Swapped 2 SMD boards on pcal10 because channels were failing 
pesqie calibrations; Didn't fix the problem so we swapped 
2 SMXRs and then all channels passed pesqie calibrations. 
 
       East Pcal10 Slot6 SMX0: (box11) 
         Old SMD board 564446-1E1  (this board OK) 
         New SMD board 565381-380 
	 Old SMXR 564542-81  (This card needs fixed) 
	 New SMXR 564518-57 
 
        
       East Pcal10 Slot5 SMX1: (box10) 
 	 Old SMD board 564285-140 (This card OK) 
	 New SMD board 564235-10E 
	 Old SMXR 564499-38  (This card needs fixed) 
	 New SMXR 564552-91 
 
  Swapped 1 SMD board on pcal02, slot5, SMX5 (Box7).  The 
channels on this board were failing pesqie calibrations. 
After swapping the SMD board, the channels were still failing 
calibrations.   We couldn't get to the SMXRs so we are left 
with these failures till the OCT shutdown. 
 
      	 Old SMD 564413- (Board OK) 
	 New SMD 564446-1E1	 
  
  Swapped an SMD board in ccal11, slot3 (East phi=9), SMX2 
because the channels in the card were failing cesqie 
calibrations.   This didn't fix the problem so we swapped the 
SMXR afterwhich the problem was fixed. 
 
	 Old SMD board 565279-31a (board OK) 
	 New SMD board 565376-37B 
	 Old SMXR 564540-79 (Fix this Board) 
	 New SMXR 564557-96 
 
 
  Swapped SMD board from ccal05, slot4 (Wphi=16) SMX0 because 
there were error bits being set in header word during data. 
 
	 Old SMD board 564265-12c 
	 New SMD board 565377-37c 
 
 
  swapped SMD board from ccal06 (slot5) Wphi=20, SMX6 because 
there were error bits being set in the header word during data. 
 
	 Old SMD board 565120-27b 
	 New SMD board 565372-377  
  
  We swapped the SMXR in ccal00 (slot3) Wphi=0 because there 
were error bits being set in the header word for all SMX channels 
and this wedge has always had a lower occupancy than any  
other.   This board had no calibration problems. 
 
We had 3 spare central SMXRs (some of which had 
been sent to argonne for repair after errors being reported 
at b0.  at argonne, no errors were detected and boards were 
returned) 
 
	Old SMXR 564512-51 
 
	New SMXR 564536-75 - All channels fail cesqie  
	 calibrations.   I include the problem and  
         repair report.  
problem report: 
"don't know - had a report of SMXR not responding - ask steve 
kuhlmann (from ccal08 slot 5 all smxr channels 7/11/01" 
repair report: 
"Ran card thru dianostics from emulator and from diagnostic ram. 
 No errorsin any channels.  ran emulator data for approx 3hours. 
no errors.  ran approx 1 week in gary drakes test stand.   
no errors" 
   
  But upon putting it into ccal00, slot3  and trying to 
perform cesqie, all channels fail calibrations. 
 
  
	 Second "good" SMXR 564574-12 (all channels fail  
	  cesqie calibration) 
 
problem report: 
"SMXR fails calibration repeatedly ie. cesqie on all channels 
in ccal12, slot3 3/14/01" 
 
repair report: 
"Ran emulator diagnostics approxe 2 hours - no errors. ran  
data capture approx 7 days. no errors.  found occasional dtr  
errors.   Found that Vcc on the board was +4.8V.  adjusted supply 
up to +5.0 - no dtr errors. 
 
	Put Orginal SMXR back in - calibrates OK. 
        Try swapping SMC.  maybe it will fix error bits 
	 being seen in header word in data taking. 
	 Old SMC 564642-42 
	 New SMC 564667-67 
 
  We swapped termination boards in Ephi=14, Wphi=13 and Wphi=14. 
JinYuan had modified 2 more boards, one of each type of his 
proposed 2 mods (rev 1.a and 1.b)  The third board was requested 
by Mike and had the bnb ground and board ground tied 
together through a 1k resister (rev 1.c) 
 
we will monitor these boards for a decision on what to do during 
the oct shutdown. 
 
3.  We measured ground between the signal and return line 
on a wire card on West phi=15 and on a strip card on East phi=20 
(?).   All grounding looked as expected (i.e. we found no 
floating strips or wires). 
 
We then studied pulses on the signal and return lines on  
a wire signal in west phi=15 where the preamps have been 
repeatedly dying.  We found large pulses.   </pre>
<!-- Author: byrum -->


<!-- Date: Tue Oct 2 12:15:50 2001 -->
<pre>Wed Sep 26 2001 
------------------- 
 
Mike and Karen installed 2 versions of protection circuits onto 
Eaat Phi=13 and West Phi=15 as follows.  
 
West Phi=15 - Install protection circuit Version E (is powered 
from the preamp card with +/- 5V).  Diodes turn on at 5.6 V 
or so ;  possiblity the .6 V difference above the 5V rail 
could still fry the preamps.   
 
New preamp card 296 X6 -1 
Old preamp card 401 X6-2 (removed and returned to argonne) 
 
East Phi=13 - Install protection circuit Version F .  This 
version guarentees the voltage to the preamps will never be 
above 5V, but there will be a slight non-linearity in the 
signal response at large energies. 
 
new preamp card 411 X6 -1 
 
We also swapped the CPR SMD card in  West phi=8. 
because these channels were failing charge injection calibrations 
and pedcal was reading garbage. 
 
New SMD card 565378-37D 
 
This did not fix the problem so we swapped SMXR boards 
which did fix the problem.    
 
</pre>
<!-- Author: byrum -->


<!-- Date: Tue Oct 2 14:28:57 2001 -->
<pre>Sep 26 2001 
 
_______________ 
 
Here are the numbers I forgot in the previous log. 
 
We also swapped the CPR SMD card in  West phi=8.  
because these channels were failing charge injection calibrations  
and pedcal was reading garbage.  
 
New SMD card 565378-37D  
Old SMD card 565324-347 
 
This did not fix the problem so we swapped SMXR boards  
which did fix the problem.     
 
New SMXR 564481-20 
Old SMXR 564535-74</pre>
<!-- Author: Karen -->


<!-- Date: Tue Oct 2 14:39:33 2001 -->
<pre>Oct 2, 2001 
 
Mike and Karen on controlled access. 
 
We installed a protection circuit on strip channels 0-31 
for East phi=13. 
Old preamp card 531 X12 0 
New preamp card 534 X12 -1 
 
Removed the protection circuit from East phi=13 (F), wire channels 0-31 and installed them on west phi=15 channels 0-31. 
 
Removed the protection circuit from West phi=15 (E), wire channels 0-31 and installed them on east phi=13 channels 0-31. 
Also installed new preamp card on west phi=15. 
 
New preamp card 254 X6 0 
Old preamp card 296 X6 -1 
 
---------------------- 
 
The reason we swapped protection circuits between Ephi=13 
and Wphi=15 is because the one on west phi=15 was the  
version we want to mass produce and Wphi=15 has the card 
with the most fried preamps.   
 
----------------------- 
 
After installation, calibrations look ok for Ephi=13, but 
Wphi=15 shows half the channels dead even though HV is off. 
 
We make another controlled access to verify connections are 
good and then recalibrate to find all but 2 channels dead. 
 
We make our third controlled access and remove preamp card + 
protection circuit to returne to argonne. 
We remove the preamp card + protection circuit from Ephi=13, 
wire channels 0-31 and insert this on Wphi=15, wire channels 
0,31.   
 
There is now no preamp card in Ephi=13 SMX2 and this cable 
is not terminated.   
 
We calibrate again  and 15 min later and Wphi=15 looks OK.</pre>
<!-- Author: Byrum -->