<!-- Title: 17:21:04  Sat Nov  8 2003 -->
<!-- Crewchief: maria -->
<!-- Op1: vivek -->
<!-- Op2: &nbsp; -->
<!-- Op3: &nbsp; -->
<!-- Op4: &nbsp; -->
<!-- Op5: &nbsp; -->
<!-- Op6: &nbsp; -->
<!-- Notes: -->
<pre>Cabletester</pre>


<!-- Date: Sat Nov 8 17:24:23 2003 -->
<pre>We were not in the schedule today -- they were supposed to keep  
with cosmics (silicon included). 
 
We called Steve H. and got permission to proceed. 
CDVME was redone Oct 31 and our code was recompiled/build last Oct 16, so we rebuild now while the crew is recovering from an SVX trip. 
 
* first thing we'll check if we get events in the cosmumers with SEV and CSL running. 
</pre>
<!-- Author: m/v -->


<!-- Date: Sat Nov 8 17:28:22 2003 -->
<pre>started CSL now-- 
finish the cosmic run--</pre>
<!-- Author: m/v -->


<!-- Date: Sat Nov 8 17:44:44 2003 -->
<pre>run 120,000 sumet[5] events with CSL and sevb. 
L1_SUMET5 in Fred Prescale menu shows 95 Hz--  
good calorimeter. 
deatime 98% but this is bogus b/c we don't use hevb or L3. 
L1 accept is showing 4 Hz for the same reason. total Fred L1A  
is 85 Hz. 
 
__EVENTS DO GO TO THE COSUMERS-- BUT WE CANNOT SEE RATES TO THE COSMUMERS IN CSL.__</pre>
<!-- Author: m/v -->
<!-- Comment: Sat Nov  8 17;48;18 comment by...m/v -->
<pre>BUT SEVB hangs when we end run, so we abort and reset</pre>


<!-- Date: Sat Nov 8 18:01:35 2003 -->
<pre>Try with 2 crates (wcal01, wcal02) 
 
time-out before we get events 
 
Code: 0x4101800000000  Mnemonic: FERML_DONE_TIMEOUT 
Node Name: b0tsi02; Node Id: 131.225.237.182 
Process: Messenger; PID: 15121520; Time: 5:56:36 PM 
Code Line: 769; Routine: FER_mess.c 
Parameters: no arguments 
MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_24 in slot 5 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_25 in slot 6 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_26 in slot 7 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_27 in slot 8 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_28 in slot 9 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_29 in slot 10 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_30 in slot 5 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_31 in slot 6 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_32 in slot 7 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_33 in slot 8 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_34 in slot 9 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:5:54:19 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_35 in slot 10 
(RC)   17:55:15 Config -&gt; READY 
(MLE) b0wcal01:Messenger:5:55:29 PM-&gt;Event 1: Bunchcounters in slot 16 (BC=0) and slot 17 (BC=128) disagree (L2B=0)  
 
</pre>
<!-- Author: m/v -->


<!-- Date: Sat Nov 8 18:02:11 2003 -->
<pre>something is screwed up with timing; 
we are running calib-continious 
will change to L1</pre>
<!-- Author: m/v -->


<!-- Date: Sat Nov 8 18:08:01 2003 -->
<pre> 18:3:29 Reset -&gt; IDLE 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_24 in slot 5 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_25 in slot 6 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_26 in slot 7 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_27 in slot 8 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_28 in slot 9 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_00 is missing card ADMEM_TOF_29 in slot 10 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_30 in slot 5 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_31 in slot 6 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_32 in slot 7 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_33 in slot 8 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_34 in slot 9 
(MLE) b0dap30.fnal.gov:rc.FSM.WatchConditionThread:6:03:48 PM-&gt;Crate WCAL_01 is missing card ADMEM_TOF_35 in slot 10 
(RC)   18:4:41 Config -&gt; READY 
(MLE) b0wcal01:Messenger:6:04:47 PM-&gt;Event 1: Bunchcounters in slot 16 (BC=116) and slot 17 (BC=155) disagree (L2B=0)  
L2B 16: 116  86  41 153 
L2B 17: 155  86  41 153 
EHx: D6010312 55D50312 55E60312 54370312 
(MLE) b0wcal01:Messenger:6:04:47 PM-&gt;Event 1: Bunchcounters in slot 16 (BC=116) and slot 18 (BC=155) disagree (L2B=0)  
L2B 16: 116  86  41 153 
L2B 18: 155  86  41 153 
EHx: D6010312 55D50312 55E60312 54370312 
(MLE) b0wcal01:Messenger:6:04:47 PM-&gt;Event 1: Bunchcounters in slot 16 (BC=116) and slot 19 (BC=155) disagree (L2B=0)  
L2B 16: 116  86  41 153 
L2B 19: 155  86  41 153 
EHx: D6010312 55D50312 55E60312 54370312 
(MLE) b0wcal01:Messenger:6:04:48 PM-&gt;Event 1: Bunchcounters in slot 16 (BC=116) and slot 20 (BC=155) disagree (L2B=0)  
L2B 16: 116  86  41 153 
L2B 20: 155  86  41 153 
EHx: D6010312 55D50312 55E60312 54370312 
(MLE) b0wcal01:Messenger:6:04:48 PM-&gt;Runtime Error 1, Event 1: Bunch counter mismatch, mismatch count = 4 
(RC)   18:4:50 Activate -&gt; ACTIVE 
(RUN Comment) rundb.RunComment@97e3a5 
  RunNumber   173602 
  CreateTime  2003-11-08 18:05:25.0 
  TextComment cabletest run, no events/ timing problems: Transition : none 
  Name        smaria/vivek 
  State       ACTIVATE 
(RUN Comment) rundb.RunComment@1e2c841 
  RunNumber   173602 
  CreateTime  2003-11-08 18:05:50.0 
  TextComment end testrun</pre>
<!-- Author: m/v -->


<!-- Date: Sat Nov 8 18:30:30 2003 -->
<pre>ADMEM_imp.c was making calles to ADMEM_cable.c which we had bypassed in FER_imp.c-- we commented out the calls in ADMEM_imp.c 
and rebuild- so upon activation we only inject charge in a particular slot/channel in the crates we use</pre>
<!-- Author: m/v -->


<!-- Date: Sat Nov 8 18:40:31 2003 -->
<pre>new table for test 
private\smaria\test_nov08_03 
 
nothing out of L3 
banchcounter mismatches</pre>
<!-- Author: m/v -->
<!-- Comment: Sat Nov  8 19;03;32 comment by...m/v -->
<pre>Code: 0x42b0814444447  Mnemonic: FERML_BC_MISMATCH_DETAIL
Node Name: b0wcal01; Node Id: 131.225.237.109
Process: Messenger; PID: 15193632; Time: 6:45:55 PM
Code Line: 875; Routine: FER_mess.c
Parameters: 10 16 90 19 131 0 
L2B 16:  90  91  91 144
L2B 19: 131 132 132 144
EHx: B60A0312 061D0312 55E60312 54370312 
</pre>
<!-- Date: Sat Nov 8 18:57:27 2003 -->
<pre>the code was not built correctly- 
we login in the crates and we still see FIFO stuff. 
we clean and remake</pre>
<!-- Author: m/v -->
<!-- Comment: Sat Nov  8 19;44;38 comment by...m -->
<pre>getting BC mimatches again</pre>


<!-- Date: Sat Nov 8 19:54:22 2003 -->
<pre>will continue sunday</pre>
<!-- Author: maria -->


<!-- Date: Sun Nov 9 16:40:55 2003 -->
* we tested the charge injection by hand 
* private version of FER_imp.c and ADMEM_imp.c need to be checked further. We still get BC mismatches, no charge injection and  
ADMEM_cableInit calls although we commented out the 
old ADMEM_cable calls.  
* we changed extra[4] to 88 and tried cherge injection  
* we will continue with Frank and/or Bill tomorrow. 
<!-- Author: maria/vivek -->


<!-- Date: Tue Nov 25 13:53:29 2003 -->
NOV 25 2003<br> 
 
Plan for debugging HAD eta=1 phi=3: 
 
 
<br> 
0. Check if the problem moves with cable (swap etc)  
upstairs. 
 
<br> 
1. wiggle cables of b0l1cl00 (pcal01 slot 15 output 5- channel 17) behind aux card. 
 
<br>INFO 
 
<br>DiracCh:2 AdMem:ADMEM_102 CalCrate:PCAL_01 Admem Slot:14 Admem Trigger Output:5 
 
<br> DiracCh:3 AdMem:ADMEM_103 CalCrate:PCAL_01 Admem Slot:15 Admem Trigger Output:5 
 
<br>DiracCrate:LEVEL1_CAL_00 Card:DIRAC_15 Slot:21 Tower:1 (0...5) 
<br> 
[Even Dirac channels are EM, odd are HAD 
<br> 
Even Admem slots are EM, odd are HAD] 
<br> 
CalorCrate: PCAL_01 Slot: 15 has 18 channels 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 11 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 11 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 11 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 11 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 9 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 9 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 9 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 9 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 7 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 7 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 7 
<br>  
DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 7 
 <br>DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 5 <br> 
 DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 3  
<br> 
 
<b>CAFE 17 in question </b> <br> 
 DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 1 
CAFE 18<br> 
 DiracCrate: LEVEL1_CAL_00 Card: DIRAC_15 Slot: 21 Channel: 1 CAFE 19 <br> 
 
2. Charge injection to offending channel - keep data for Carla 
 
 
Time needed ~1:30 h after plug sourcing (expecting around after 4pm)  
<!-- Author: maria/vivek -->
<!-- Comment: Wed Dec 10 16;52;30 comment by...m mattson and v tiwari -->
<pre>&lt;br&gt;We asked Maria to unmask HAD eta 1, phi 3.  The problem was still there.  We swapped the ADMEMs for 3W and 4W, and the problem has disappeared entirely.  So no channels are masked right now.&lt;p&gt;
If it comes back later, we will know whether it followed the ADMEM, or stayed with the trigger cable.</pre>