<!-- Title: 10:28:46  Mon Aug 22 2005 -->
<!-- Crewchief: Jen (MPC) -->
<!-- Op1: Marcel (SPL) -->
<!-- Op2: &nbsp; -->
<!-- Op3: &nbsp; -->
<!-- Op4: &nbsp; -->
<!-- Op5: &nbsp; -->
<!-- Op6: &nbsp; -->
<!-- Notes: -->
Always look on the bright side of death...


<!-- Date: Mon Aug 22 10:35:30 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7289&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7290  width='300' align='top'></a></td><td>Pinkie in IMON - bias current on SB1W3L4.  Bumped the upper limit from 1950 to 2050.</td></tr></table>
<!-- Author: Jen -->


<!-- Date: Mon Aug 22 10:40:38 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7291&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7291  width='300' align='top'></a></td><td>Bias current history of SB1W3L4.  Oscillating and all over the place.</td></tr></table>
<!-- Author: Jen -->


<!-- Date: Mon Aug 22 11:38:56 2005 -->
<h2> Glink troubles </h2> 
<pre> Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 15:04:35 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 15:04:37 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 15:04:39 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 15:04:41 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 15:04:43 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 15:04:45 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148624 at Sun Aug 21 15:20:39 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 22:55:19 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 22:55:21 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 22:55:23 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 22:55:25 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 22:55:27 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148504 at Sun Aug 21 22:55:29 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148488 at Sun Aug 21 23:29:28 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148488 at Sun Aug 21 23:31:27 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148488 at Sun Aug 21 23:35:02 CDT 2005: Glink Synch 
Received Directive on /mapSVX/svx/vrb/02from /_b0fib02_14148488 at Sun Aug 21 23:35:32 CDT 2005: Glink Synch 
</pre> 
 
So in both cases, when we had a massive trip after fib02 was llosing sync and started requesting to be synced again
<!-- Author: Marcel -->


<!-- Date: Mon Aug 22 11:50:57 2005 -->
<h4> e493 </h4> 
Is also fine in DS errmon as well for the most recent runs ...<br> 
Ideas what is funny in ADCMON ??? 
  
<!-- Author: Marcel -->
<!-- Comment: Mon Aug 22 14;43;08 comment by...boveia -->
<pre>e493 has ADCMon plots as well.   I don't find anything about it funny.</pre>
<!-- Date: Mon Aug 22 12:57:04 2005 -->
<h3>Tevatron RF glitch</h3> 
TRF7 (the same one as <a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=262&frame=2&anchor=14:59:24'>last week</a>) glitch caused spike in AGIGI2, see <a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/elog.pl?nb=2005&action=view&page=701&frame=2&anchor=12:35:45.115'>main elog</a>.  B0PAGC spiked up to 24 kHz. Shift crew immediately put silicon to standby and called me.  MCR says they saw the glitch and called in RF experts to have a look, but after the one glitch it had been stable for ~20 minutes.  I gave permission to ramp the silicon again.  Will keep a close eye on it, and see if the experts have anything to say.<br>
<!-- Author: Jen -->
<!-- Comment: Mon Aug 22 12;57;58 comment by...Jen -->
from MCR:
<pre>
It was found that TRF7 gap envelope took a dip that corelates with the rise in losses. John Reid has been notified and is taking a look. The station is still on and abort gap losses have come back down.
</pre>


<!-- Comment: Mon Aug 22 13;28;44 comment by...Jen -->
Now MCR says:
<pre>
-- Mon Aug 22 13:26:58 comment by...dln --  Station 7 mysteriously sparked. John Reid says everything looks good now.
</pre>
<!-- Date: Mon Aug 22 13:11:06 2005 -->
Redefined limits on IB4W0, some currents had changed after power supply swap <a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=261&frame=2&anchor=11:43:45'>two weeks ago</a>.  2V and 5V DOIM both dropped by ~30 mA, and AVDD for L0 and L3 increased by ~10 mA, and all are holding steady.<br>
<!-- Author: Jen -->


<!-- Date: Mon Aug 22 13:19:57 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7292&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7292  width='300' align='top'></a></td><td>Another bias line pinkie - this time SB0W3L3.  Increased upper limit from 235 to 250.</td></tr></table>
<!-- Author: Jen -->


<!-- Date: Mon Aug 22 13:24:13 2005 -->
<pre>Monitoring Summary for week of 8/15 - 8/21: 
(sorry for the delay) 
 
Problems for the detector group: 
f223 - changing ISL bits on the bad chips didn't help the problem. 
 
Problems for monitoring: 
e493 - Bit 1 problem didn't come back. 
e224 - Looks like ADCmon has a problem displaying this ladder in run 203091.  Verify it doesn't come back. 
 
Fixed problems: 
f833 - Problem that comes and goes has gone.  Maybe it will come back, maybe not. 
e142 - Nothing to be done for bumps from hot channels.</pre>
<!-- Author: Adam Scott -->
<!-- Comment: Mon Aug 22 14;14;28 comment by...boveia -->
<br>Also, there are new Monitoring needs_urgent_monitoring and needs_longterm_monitoring categories which should replace the old Monitoring needs_observation category.  Searches for problems in these categories are linked from the Monitoring WG page.


<!-- Date: Mon Aug 22 14:20:14 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7293&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7293  width='300' align='top'></a></td><td>Bias current history for SB0W3L3 (the pinkie above).  Also very oscillatory behavior.</td></tr></table>
<!-- Author: Jen -->



<!-- Date: Mon Aug 22 14:57:22 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7294&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7294  width='300' align='top'></a></td><td>Registers showing the RDBS length with the new VRB firmware.</td></tr></table>
<!-- Author: Marcel & Sebastian -->
<!-- Comment: Mon Aug 22 15;02;40 comment by...M&S -->
Note that every second register is not being filled. 
<br>
We double checked the RDBS length with the LA, above the
result is 0x2d8 x 40ns = 29.12 us, while the LA showed
29.08 (with a 64ns resolution). To change the RDBS signal
we changed the number of chips simulated by the DEM 
(FIB-DEM tab).


<!-- Comment: Tue Aug 23 12;19;00 comment by...Sebastian -->
The new firmware from Mark works fine. It keeps the longest RDBS length for that VRB (whatever channel) of the last 16 events:
<pre>
400 00000890 
404 00000890 
408 00000890 
40c 00000893 
410 00000893 
414 0000088c 
418 00000890 
41c 0000088c 
420 000008a3 
424 0000088c 
428 000008a7 
42c 0000088c 
430 0000088c 
434 00000890 
438 000008aa 
43c 00000890
</pre>
In the case above it was: 0x88c x 40ns = 87.5 us (using 16 chips in the DEM).
<!-- Date: Mon Aug 22 15:46:54 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: SB0W3L3 
<li>problem n: 1514 
<li>Status: needs_urgent_monitoring
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: marcel 
<li>description is: so this guy freaks again ... Powercycling the wedge had no impact as well. The history of this kind is interesting, see the e-log<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>230</td><td>230</td></tr>
<tr><td><b>Lower</b></td><td>0.5</td><td>0.5</td></tr>
<tr><td><b>Upper</b></td><td>250.0</td><td>275.0</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B0W3&layer=L3">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Mon Aug 22 16:41:39 2005 -->
<h3>BERT Test-Stand</h3> 
 
<p>As we now have a working chiller I decided to exercise the system.  After tidiying up the table for a bit I started the standard Bit-Test.  The system powered up fine and there were zero errors after ~3e10 transmitted words.  The TXs are warm but not boiling..so the chiller seems to be doing its job :-). </p> 
 
<p>The full test should take about 12 hours. So stay tuned to see what happens.</p>
<!-- Author: Ankush -->
<!-- Comment: Tue Aug 23 09;57;14 comment by...Ankush -->
<h3>Working BERT Test-Stand!!!</h3>

<p>I ran the bit-test over night and there were zero errors after 1e12 words transmitted.  The chiller stayed stable at 15C.  I touched the TX with my finger to check how hot they were and at most, were a few degrees above room temperature. ie:- they were slightly warm but not much.</p>

<p>So the BERT test stand is back in business !!!!</h3>
<!-- Date: Mon Aug 22 17:02:23 2005 -->
<h2> AGIGI2 over the last few stores </h2> 
So I had a look at AGIGI2 for the last few stores: 
<ul> 
<li> In two instances, AGIGI2 would have been really high without MCR cleaning the GAP </li> 
<li> The re is an offset of approx 1.5 as reported by Tev people as well in the AGIGI2 since Friday, so our 4 hard limit should be 5.5 then ... </li> 
<li> Losses for the current store look much better till now, if you subtract 1.5 </li> 
</ul> 
Plots to follow
<!-- Author: Marcel -->


<!-- Date: Mon Aug 22 17:18:07 2005 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7295&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7295' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7296&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7296' width='300'></a></center>
<!-- Author: Marcel -->


<!-- Date: Mon Aug 22 17:53:32 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7297&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7297  width='300' align='top'></a></td><td>History of Bias current of e033...weird</td></tr></table>
<!-- Author: Marcel -->


<!-- Date: Mon Aug 22 20:30:21 2005 -->
ADCMon isn't making plots for this e224, presumably because ADCMon is crashing.  Bitreporter detects something wrong with about 10% of the events starting with run 202696. The raw data are shown below.   
<PRE> 
Event Number: 272 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>0f</b></font><font color=cyan>fc</b></font> <font color=green><B>8d</b></font><font color=black>1b</b></font><font color=blue><B>00</b></font><font color=black>f3</b></font> <font color=green><B>8c</b></font><font color=black>1b</b></font><font color=red><b>ff</b></font><font color=black>2a</b></font> <font color=blue><B>63</b></font><font color=black>f3</b></font><font color=red><b>89</b></font><font color=black>1b</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=blue><B>7f</b></font><font color=black>f3</b></font> <font color=red><b>c2</b></font><font color=red><b>c2</b></font><font color=yellow>00</b></font><font color=yellow>00</b></font>                   <font color=red>120ns</font> 
 
Event Number: 1171 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>4a</b></font><font color=cyan>fc</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 2557 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>35</b></font><font color=cyan>fc</b></font> <font color=green><B>8d</b></font><font color=black>2a</b></font><font color=blue><B>00</b></font><font color=black>f3</b></font> <font color=green><B>8c</b></font><font color=black>2a</b></font><font color=green><B>8b</b></font><font color=black>2a</b></font> <font color=green><B>8a</b></font><font color=black>2a</b></font><font color=blue><B>70</b></font><font color=black>01</b></font> <font color=blue><B>71</b></font><font color=black>0a</b></font><font color=blue><B>72</b></font><font color=black>34</b></font> <font color=blue><B>73</b></font><font color=black>41</b></font><font color=red><b>ff</b></font><font color=black>2a</b></font> <font color=red><b>63</b></font><font color=black>f3</b></font><font color=green><B>89</b></font><font color=black>2a</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=blue><B>7f</b></font><font color=black>f3</b></font> <font color=red>360ns</font> 
<font color=red><b>c2</b></font><font color=red><b>c2</b></font><font color=yellow>00</b></font><font color=yellow>00</b></font>                                                                <font color=red>560ns</font> 
 
Event Number: 5594 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>35</b></font><font color=cyan>fd</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>00</b></font><font color=black>28</b></font> <font color=blue><B>63</b></font><font color=black>f3</b></font><font color=blue><B>64</b></font><font color=black>aa</b></font> <font color=blue><B>65</b></font><font color=black>f3</b></font><font color=blue><B>7f</b></font><font color=black>f3</b></font> <font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font><font color=yellow>00</b></font><font color=yellow>00</b></font>                            <font color=red>-4093120ns</font> 
 
Event Number: 5686 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>6d</b></font><font color=cyan>fc</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 7037 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>76</b></font><font color=cyan>fc</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 8971 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>56</b></font><font color=cyan>fc</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 9013 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>41</b></font><font color=cyan>fd</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 9157 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>88</b></font><font color=cyan>fe</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 11125 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>70</b></font><font color=cyan>fc</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 12307 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>44</b></font><font color=cyan>fc</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 12590 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>4d</b></font><font color=cyan>fc</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 13810 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>35</b></font><font color=cyan>fc</b></font> <font color=green><B>8d</b></font><font color=black>1b</b></font><font color=blue><B>00</b></font><font color=black>f3</b></font> <font color=green><B>8c</b></font><font color=black>1b</b></font><font color=green><B>8b</b></font><font color=black>1b</b></font> <font color=green><B>8a</b></font><font color=black>1b</b></font><font color=green><B>89</b></font><font color=black>1b</b></font> <font color=blue><B>2f</b></font><font color=black>07</b></font><font color=blue><B>70</b></font><font color=black>35</b></font> <font color=blue><B>71</b></font><font color=black>09</b></font><font color=blue><B>72</b></font><font color=black>09</b></font> <font color=blue><B>73</b></font><font color=black>04</b></font><font color=red><b>4d</b></font><font color=black>0d</b></font> <font color=blue><B>4e</b></font><font color=black>09</b></font><font color=blue><B>69</b></font><font color=black>03</b></font> <font color=red>440ns</font> 
<font color=blue><B>6a</b></font><font color=black>1f</b></font><font color=blue><B>6b</b></font><font color=black>2c</b></font> <font color=blue><B>6c</b></font><font color=black>05</b></font><font color=red><b>c2</b></font><font color=black>c2</b></font>                                                       <font color=red>680ns</font> 
 
Event Number: 15547 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>06</b></font><font color=cyan>fc</b></font> <font color=green><B>8d</b></font><font color=black>22</b></font><font color=blue><B>00</b></font><font color=black>f3</b></font> <font color=blue><B>2f</b></font><font color=black>04</b></font><font color=blue><B>30</b></font><font color=black>28</b></font> <font color=blue><B>31</b></font><font color=black>26</b></font><font color=blue><B>32</b></font><font color=black>06</b></font> <font color=green><B>8c</b></font><font color=black>22</b></font><font color=green><B>8b</b></font><font color=black>22</b></font> <font color=blue><B>3e</b></font><font color=black>f3</b></font><font color=blue><B>3f</b></font><font color=black>1a</b></font> <font color=blue><B>40</b></font><font color=black>14</b></font><font color=blue><B>41</b></font><font color=black>03</b></font> <font color=green><B>8a</b></font><font color=black>22</b></font><font color=blue><B>7e</b></font><font color=black>08</b></font> <font color=green>0ns</font> 
<font color=blue><B>7f</b></font><font color=black>23</b></font><font color=green><B>89</b></font><font color=black>22</b></font> <font color=blue><B>00</b></font><font color=black>66</b></font><font color=blue><B>41</b></font><font color=black>07</b></font> <font color=blue><B>65</b></font><font color=black>f3</b></font><font color=blue><B>7f</b></font><font color=black>f3</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>7f</b></font><font color=black>f3</b></font> <font color=red><b>c2</b></font><font color=red><b>c2</b></font><font color=yellow>00</b></font><font color=yellow>00</b></font>                            <font color=red>800ns</font> 
 
Event Number: 16395 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>47</b></font><font color=cyan>fc</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 18702 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>3e</b></font><font color=cyan>fd</b></font> <font color=green><B>8d</b></font><font color=black>17</b></font><font color=blue><B>00</b></font><font color=black>f3</b></font> <font color=green><B>8c</b></font><font color=black>17</b></font><font color=blue><B>0e</b></font><font color=black>06</b></font> <font color=blue><B>0f</b></font><font color=black>16</b></font><font color=blue><B>10</b></font><font color=black>10</b></font> <font color=blue><B>11</b></font><font color=black>06</b></font><font color=green><B>8b</b></font><font color=black>17</b></font> <font color=green><B>8a</b></font><font color=black>17</b></font><font color=green><B>89</b></font><font color=black>17</b></font> <font color=green><B>88</b></font><font color=black>17</b></font><font color=green><B>87</b></font><font color=black>17</b></font> <font color=blue><B>6a</b></font><font color=black>f3</b></font><font color=blue><B>6b</b></font><font color=black>0b</b></font> <font color=green>0ns</font> 
<font color=blue><B>6c</b></font><font color=black>f3</b></font><font color=green><B>a6</b></font><font color=black>17</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=blue><B>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=red><b>ff</b></font><font color=black>2a</b></font> <font color=red><b>7f</b></font><font color=black>f3</b></font><font color=red><b>c2</b></font><font color=red><b>c2</b></font>                            <font color=red>640ns</font> 
 
Event Number: 19441 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>73</b></font><font color=cyan>fe</b></font> <font color=green><B>8d</b></font><font color=black>27</b></font><font color=blue><B>00</b></font><font color=black>f3</b></font> <font color=green><B>8c</b></font><font color=black>27</b></font><font color=green><B>8b</b></font><font color=black>27</b></font> <font color=green><B>8a</b></font><font color=black>27</b></font><font color=green><B>89</b></font><font color=black>27</b></font> <font color=blue><B>5e</b></font><font color=black>05</b></font><font color=blue><B>5f</b></font><font color=black>25</b></font> <font color=blue><B>60</b></font><font color=black>03</b></font><font color=green><B>88</b></font><font color=black>27</b></font> <font color=green><B>87</b></font><font color=black>27</b></font><font color=green><B>a6</b></font><font color=black>27</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=blue><B>63</b></font><font color=black>f3</b></font> <font color=red>480ns</font> 
<font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=red><b>ff</b></font><font color=black>2a</b></font> <font color=red><b>7f</b></font><font color=black>f3</b></font><font color=red><b>c2</b></font><font color=red><b>c2</b></font>                                              <font color=red>680ns</font> 
 
Event Number: 20254 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>12</b></font><font color=cyan>fd</b></font> <font color=green><B>8d</b></font><font color=black>08</b></font><font color=blue><B>00</b></font><font color=black>f3</b></font> <font color=blue><B>22</b></font><font color=black>02</b></font><font color=blue><B>23</b></font><font color=black>0c</b></font> <font color=blue><B>24</b></font><font color=black>0a</b></font><font color=blue><B>25</b></font><font color=black>08</b></font> <font color=blue><B>74</b></font><font color=black>01</b></font><font color=blue><B>75</b></font><font color=black>0c</b></font> <font color=blue><B>76</b></font><font color=black>17</b></font><font color=blue><B>77</b></font><font color=black>0c</b></font> <font color=blue><B>78</b></font><font color=black>02</b></font><font color=green><B>8c</b></font><font color=black>08</b></font> <font color=green><B>8b</b></font><font color=black>08</b></font><font color=green><B>8a</b></font><font color=black>08</b></font> <font color=green>0ns</font> 
<font color=green><B>89</b></font><font color=black>08</b></font><font color=blue><B>32</b></font><font color=black>f3</b></font> <font color=blue><B>33</b></font><font color=black>0c</b></font><font color=blue><B>34</b></font><font color=black>1f</b></font> <font color=blue><B>35</b></font><font color=black>03</b></font><font color=blue><B>4f</b></font><font color=black>01</b></font> <font color=blue><B>50</b></font><font color=black>0a</b></font><font color=blue><B>51</b></font><font color=black>19</b></font> <font color=blue><B>52</b></font><font color=black>f3</b></font><font color=blue><B>76</b></font><font color=black>04</b></font> <font color=blue><B>77</b></font><font color=black>1b</b></font><font color=blue><B>78</b></font><font color=black>01</b></font> <font color=green><B>88</b></font><font color=black>08</b></font><font color=blue><B>12</b></font><font color=black>06</b></font> <font color=blue><B>13</b></font><font color=black>1e</b></font><font color=blue><B>14</b></font><font color=black>03</b></font> <font color=green>560ns</font> 
<font color=blue><B>52</b></font><font color=black>03</b></font><font color=blue><B>53</b></font><font color=black>0c</b></font> <font color=blue><B>54</b></font><font color=black>15</b></font><font color=blue><B>55</b></font><font color=black>03</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=blue><B>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=red><b>ff</b></font><font color=black>2a</b></font> <font color=red><b>7f</b></font><font color=black>f3</b></font><font color=red><b>c2</b></font><font color=red><b>c2</b></font>                   <font color=red>1360ns</font> 
 
Event Number: 21076 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>41</b></font><font color=cyan>fc</b></font> <font color=green><B>8d</b></font><font color=black>05</b></font><font color=blue><B>00</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>03</b></font><font color=green><B>8c</b></font><font color=black>05</b></font> <font color=blue><B>00</b></font><font color=black>09</b></font><font color=blue><B>01</b></font><font color=black>03</b></font> <font color=green><B>8b</b></font><font color=black>05</b></font><font color=green><B>8a</b></font><font color=black>05</b></font> <font color=blue><B>04</b></font><font color=black>05</b></font><font color=blue><B>05</b></font><font color=black>09</b></font> <font color=blue><B>06</b></font><font color=black>08</b></font><font color=blue><B>08</b></font><font color=black>05</b></font> <font color=blue><B>09</b></font><font color=black>0a</b></font><font color=blue><B>0a</b></font><font color=black>f3</b></font> <font color=green>0ns</font> 
<font color=blue><B>49</b></font><font color=black>07</b></font><font color=blue><B>4a</b></font><font color=black>44</b></font> <font color=blue><B>4b</b></font><font color=black>08</b></font><font color=blue><B>7e</b></font><font color=black>06</b></font> <font color=blue><B>7f</b></font><font color=black>09</b></font><font color=green><B>89</b></font><font color=black>05</b></font> <font color=blue><B>00</b></font><font color=black>04</b></font><font color=blue><B>7d</b></font><font color=black>01</b></font> <font color=blue><B>7e</b></font><font color=black>27</b></font><font color=blue><B>7f</b></font><font color=black>f3</b></font> <font color=green><B>88</b></font><font color=black>05</b></font><font color=blue><B>10</b></font><font color=black>05</b></font> <font color=blue><B>11</b></font><font color=black>42</b></font><font color=blue><B>12</b></font><font color=black>04</b></font> <font color=blue><B>21</b></font><font color=black>02</b></font><font color=blue><B>22</b></font><font color=black>1c</b></font> <font color=green>760ns</font> 
<font color=blue><B>23</b></font><font color=black>f3</b></font><font color=green><B>87</b></font><font color=black>05</b></font> <font color=green><B>a6</b></font><font color=black>05</b></font><font color=green><B>a5</b></font><font color=black>05</b></font> <font color=green><B>a4</b></font><font color=black>05</b></font><font color=red><b>ff</b></font><font color=black>2a</b></font> <font color=blue><B>63</b></font><font color=black>f3</b></font><font color=blue><B>64</b></font><font color=black>aa</b></font> <font color=blue><B>65</b></font><font color=black>f3</b></font><font color=blue><B>7f</b></font><font color=black>f3</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>7f</b></font><font color=black>f3</b></font> <font color=red><b>c2</b></font><font color=red><b>c2</b></font><font color=yellow>00</b></font><font color=yellow>00</b></font>          <font color=red>1400ns</font> 
 
Event Number: 24380 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>7f</b></font><font color=cyan>fc</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 24916 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>3b</b></font><font color=cyan>fc</b></font> <font color=green><B>8d</b></font><font color=black>2a</b></font><font color=blue><B>00</b></font><font color=black>f3</b></font> <font color=green><B>8c</b></font><font color=black>2a</b></font><font color=green><B>8b</b></font><font color=black>2a</b></font> <font color=blue><B>2f</b></font><font color=black>06</b></font><font color=blue><B>30</b></font><font color=black>1c</b></font> <font color=blue><B>31</b></font><font color=black>0b</b></font><font color=blue><B>32</b></font><font color=black>04</b></font> <font color=blue><B>54</b></font><font color=black>04</b></font><font color=blue><B>55</b></font><font color=black>0d</b></font> <font color=blue><B>56</b></font><font color=black>10</b></font><font color=blue><B>57</b></font><font color=black>04</b></font> <font color=blue><B>58</b></font><font color=black>1f</b></font><font color=blue><B>59</b></font><font color=black>05</b></font> <font color=green>0ns</font> 
<font color=blue><B>7e</b></font><font color=black>03</b></font><font color=blue><B>7f</b></font><font color=black>25</b></font> <font color=green><B>8a</b></font><font color=black>2a</b></font><font color=blue><B>00</b></font><font color=black>14</b></font> <font color=blue><B>01</b></font><font color=black>01</b></font><font color=blue><B>40</b></font><font color=black>f3</b></font> <font color=blue><B>41</b></font><font color=black>0b</b></font><font color=blue><B>42</b></font><font color=black>0c</b></font> <font color=blue><B>43</b></font><font color=black>23</b></font><font color=blue><B>44</b></font><font color=black>09</b></font> <font color=blue><B>45</b></font><font color=black>0a</b></font><font color=blue><B>46</b></font><font color=black>07</b></font> <font color=blue><B>47</b></font><font color=black>04</b></font><font color=blue><B>48</b></font><font color=black>0a</b></font> <font color=blue><B>49</b></font><font color=black>19</b></font><font color=blue><B>4a</b></font><font color=black>06</b></font> <font color=green>640ns</font> 
<font color=blue><B>69</b></font><font color=black>03</b></font><font color=blue><B>6a</b></font><font color=black>14</b></font> <font color=blue><B>6b</b></font><font color=black>28</b></font><font color=blue><B>6c</b></font><font color=black>1c</b></font> <font color=blue><B>6d</b></font><font color=black>f3</b></font><font color=blue><B>71</b></font><font color=black>02</b></font> <font color=blue><B>72</b></font><font color=black>1f</b></font><font color=red><b>ff</b></font><font color=black>2a</b></font> <font color=red><b>63</b></font><font color=black>f3</b></font><font color=blue><B>64</b></font><font color=black>aa</b></font> <font color=blue><B>65</b></font><font color=black>f3</b></font><font color=blue><B>7f</b></font><font color=black>f3</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>7f</b></font><font color=black>f3</b></font> <font color=green><B>89</b></font><font color=black>2a</b></font><font color=blue><B>00</b></font><font color=black>02</b></font> <font color=red>1480ns</font> 
<font color=blue><B>04</b></font><font color=black>f3</b></font><font color=blue><B>05</b></font><font color=black>10</b></font> <font color=blue><B>06</b></font><font color=black>08</b></font><font color=blue><B>39</b></font><font color=black>04</b></font> <font color=blue><B>3a</b></font><font color=black>2f</b></font><font color=blue><B>3b</b></font><font color=black>03</b></font> <font color=red><b>c2</b></font><font color=black>c2</b></font><font color=red><b>00</b></font><font color=black>00</b></font>                                     <font color=red>2080ns</font> 
 
Event Number: 26128 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>7c</b></font><font color=cyan>fe</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 27735 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>47</b></font><font color=cyan>fd</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
 
Event Number: 29741 
<font color=yellow><B>10</b></font><font color=yellow><B>50</b></font><font color=blue>0d</b></font><font color=cyan><B>0b</b></font> <font color=yellow><B>04</b></font><font color=yellow><B>10</b></font><font color=yellow><B>41</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font> <font color=yellow><B>08</b></font><font color=yellow><B>16</b></font><font color=yellow><B>08</b></font><font color=yellow><B>16</b></font> <font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font><font color=yellow><B>00</b></font>  
<font color=black>e2</b></font><font color=black>24</b></font><font color=green>21</b></font><font color=cyan>fd</b></font> <font color=red><b>ff</b></font><font color=black>2a</b></font><font color=red><b>63</b></font><font color=black>f3</b></font> <font color=blue><B>64</b></font><font color=black>aa</b></font><font color=blue><B>65</b></font><font color=black>f3</b></font> <font color=blue><B>7f</b></font><font color=black>f3</b></font><font color=yellow><B>c1</b></font><font color=yellow><B>c1</b></font>                                     <font color=red>-4093120ns</font> 
</pre>
<!-- Author: boveia -->

<!-- Date: Mon Aug 22 20:40:23 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: SB2W2L4 
<li>problem n: 1423 
<li>Status: needs_work
<li>Type: Unknown
<li>Action: Monitoring
<li>entered by: boveia 
<li>description is: Garbage <a href= 'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=263&frame=2&anchor=20:30:21'> data</a> for >10% of events. 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B2W2&layer=L4">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Tue Aug 23 06:25:27 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7298&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7298  width='300' align='top'></a></td><td>b0fib02 has done it again...</td></tr></table>
<!-- Author: Jen -->
<!-- Comment: Tue Aug 23 07;25;45 comment by...Jen &  Marcel -->
So b0fib02 lost the G-link again and tripped everything off.  Aces put the rest of the silicon to standby and called me; I told them to call Marcel and start a no-silicon run.  After Marcel and I arrived, Marcel powercycled the VME crate for fib02 from the iFix window (as we did to fix this problem back in <a href=
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=231&frame=2&anchor=18:59:14'>January</a>.)
<br>
We then tried to power everything back on, but b0fib02 wasn't config'ing the chips and things kept tripping.  Restarted svxinter and PSGui, which solved that problem.  Then the RTServer started freaking out.  Once that stabilized, we were able to power everything back to standby.  So, everything is recovered.  Right now RTServer is still giving problems, so they can't start another run; once that's fixed, we'll bias the silicon and run with it.<br>


<!-- Date: Tue Aug 23 08:33:31 2005 -->
<h4>B0PAGC rising</h4> 
See <a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/elog.pl?nb=2005&action=view&page=703&frame=2&anchor=08:05:30.074'>main elog</a> for plot.  B0PAGC suddenly started skyrocketing up, from 4kHz to 8kHz in ~10 mins.  For safety we put the silicon to standby before going to the 8am meeting.  By the time we returned, losses had stabilized around 8kHz and were beginning to drop.  According to Rick Tesarek, MCR was tuning the helix.  Since losses have been dropping steadily, we brought silicon back up and are now attempting a D-mode calibration with the new EVB.<br>
<!-- Author: Jen & Marcel -->
<!-- Comment: Tue Aug 23 10;44;48 comment by...Jen -->
D-mode didn't work with new EVB; immediate busy TO for svx06.  Markus is investigating; try again at the end of the next store?
<!-- Comment: Tue Aug 23 18;27;36 comment by...Marcel -->
the event size is to big for the new EVB, it has a maximum datasize per crate of 64 Kb. One ISL VRB alone has roughly 40 kbytes of data in readall mode
<!-- Date: Tue Aug 23 10:39:52 2005 -->
<h3>Not so quiet time</h3> 
 
<p>I thought I had some quiet time, so Sasha brought SB1W6L4 (e164) back into the HWDB and started it running.  We were ecpecting the ladder to freak out after 5,000 events.  We got to 3,000 events when the MCR called to say they were injecting beam.</p> 
 
<p>We quickly took e164 back out of the HWDB and did a COLD-START to check everything was OK...and it was.</p> 
 
<p>Hopefully we'll have more time later.</p>
<!-- Author: Ankush & Sasha -->




<!-- Date: Tue Aug 23 13:25:40 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7299&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7300  width='300' align='top'></a></td><td>SVTSpyMon plot for store 4347.  Everything looks good here and in SVXMon.  Started the run with luminosity ~ 126 and the default trigger table; L1A rate was about 24 kHz with deadtime ~ 10%.</td></tr></table>
<!-- Author: Jen -->

<!-- Date: Tue Aug 23 14:00:53 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: SB2W2L4 
<li>problem n: 1513 
<li>Status: fixed
<li>Type: Unknown
<li>Action: Monitoring
<li>entered by: alscott 
<li>description is: See thread 1423 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B2W2&layer=L4">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Tue Aug 23 14:03:31 2005 -->
<a href="http://www-cdfonline.fnal.gov/cgi/elog/elog.pl?nb=2005&action=view&page=704&frame=2&anchor=14:01:25.461">Working the SPL too hard</a>
<!-- Author: Random Silicon elog reader -->


<!-- Date: Tue Aug 23 14:31:09 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7303&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7303  width='300' align='top'></a></td><td>Is this what Grumpy dreams about? ...</td></tr></table>
<!-- Author: Not-so-random elog reader -->
<!-- Comment: Tue Aug 23 14;42;18 comment by...Another non-random elog reader -->
Whose hands are decorating Master Grumpy so nicely?

<!-- Comment: Tue Aug 23 14;46;50 comment by...Master Grumpy -->
<h2> This is a general lack of respect ..... </h2>

<!-- Comment: Tue Aug 23 14;51;38 comment by...An anonymous photographer -->
Who the heck cut my picture in twain???


<!-- Date: Tue Aug 23 15:37:43 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7309&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7309  width='300' align='top'></a></td><td><b>Timing of GAP and BZ</b><br> 
Blue signal is !GAP and yellow is !BZ, so there is no bucket (19ns) between the time GAP goes low and the BZ marker. </td></tr></table>
<!-- Author: Sebastian -->
<!-- Comment: Tue Aug 23 15;38;51 comment by...Sebastian -->
Thanks to Rick T. for pointing to the signals in his crates.


<!-- Date: Tue Aug 23 17:38:14 2005 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7310&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7310' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7311&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7311' width='300'></a></center>
<!-- Author: Ankush -->
<!-- Comment: Wed Aug 24 10;05;58 comment by...Ankush -->
<p>Here's the Bias-current history for IB3W0L4 (f304).  The upper IMON limit was bumped-up from 105.0 to 110.0.  For the moment this is fine.  However if you fit the data (a la Dr Schulz), the bias current will hit 110.0 around 13 September '05 (DS-Day 1716).  </p>
<!-- Date: Tue Aug 23 18:04:49 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7313&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7313  width='300' align='top'></a></td><td><p>From Dr. Moore 
<pre>I saw an entry in the elog referring to a rise and fall in C:B0PAGC this morning.  The rise/fall is correlated with orbit motion near F17 (a collimator location at a high dispersion area) apparently caused a D0 quad (C4Q4) pitching and rolling. </pre> 
</p></td></tr></table>
<!-- Author: Marcel -->



<!-- Date: Tue Aug 23 21:24:42 2005 -->
<h3>FIB02 lost synch again...</h3> 
 
Before could reset the crate the desease spread to other crates. 
After reseting b0fib02 two times I still get: 
<pre> 
b0fib02-> Requesting Glink Synch...Success after 0 tries                                        
Requesting Glink Synch...Success after 0 tries                                                  
Requesting Glink Synch...Success after 0 tries                                                  
Requesting Glink Synch...Requesting Glink Synch...Success after 1 tries                         
Requesting Glink Synch...Requesting Glink Synch...Success after 1 tries                         
Requesting Glink Synch...Success after 0 tries                                                  
Requesting Glink Synch...Requesting Glink Synch...Requesting Glink Synch...Success after 2 trie 
s                                                                                               
Requesting Glink Synch...Requesting Glink Synch...Success after 1 tries                         
 
</pre> 
<!-- Author: Sebastian -->
<!-- Comment: Tue Aug 23 23;17;16 comment by...s -->
See next entry too.
<!-- Comment: Wed Aug 24 09;17;15 comment by...Sebastian -->
Link to the incident in the main elog 
<a href=
'http://www-cdfonline.fnal.gov/cgi/elog/elog.pl?nb=2005&action=view&page=705&frame=2&anchor=21:27:14.042'>
here</a>.
<!-- Date: Tue Aug 23 22:15:17 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7314&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7314  width='300' align='top'></a></td><td>Another mess caused by b0fib02...</td></tr></table>
<!-- Author: Sebastian -->
<!-- Comment: Tue Aug 23 22;48;30 comment by...Sebastian -->
<br>
I was waking through the control room and b0fib02 was 
giving problems again. Jennifer was on the phone, and I told
her I would work on the problem (thinking it was going to be
20min or so). Everything went wrong:
<ul>
<li> Soft rebooting fib02 did nothing to help (just to try the simplest first...).
<li> reset_crate on b0fib02 did not sync'ed the glinks (see entry above) the first two times (at t his point I asked Shawn to take data without silicon). 
<li> The desease spread to other SVX fibs (see plot above) before
I could recover fib02.
<li> Once the glinks were synched I could not power up the wedges, so I rebooted svxinter (as I did last time, see
<a href
'http://www-cdfonline.fnal.gov/cgi-bin/det-system-elog.pl?nb=silicon&action=view&page=262&frame=2&anchor=17:41:40'>
here</a>) thought there was no error in the iFix-Gui comm.
<li> When restarting the Gui I saw that svxinter could not connect to the RTserver:
<pre>
Connecting to project  on  RTserver. 
Using tcp protocol. 
RTserver denied access. 
Message: Client name  is not unique.WARNING: Internal validation failed, file:
ipcmsg.c, line 1314Message from RTlm: Checking in  license. 
Cannot connect to the RTserver.
</pre>
<li> Aces were not sure if they could restart the RTserver, so I called Marcel to confirm that I would not cause more damage by asking them to restart it. 
<li> When the RTserver came back I could recover the wedges, but...
<li>SB2WB refused to come back. I hockerized the crate and was able to bring it back
<li> When starting the new run with silicon b0fib00 got stuck and 
refused to config. The CPU showed that something was wrong because it was not changing the message:<pre>
Sent ack to Run Control: -1 UNDEFINED SUCCESS</pre>
rebooted the CPU and then we could config it.
<li> Started taking data... SB0W7 DOIMs were pink... power
cycled the wedge and all fine now.
</ul>
<b>We need an access to work on fib02...</b>. See the related 
incidents: 
<a href=
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=262&frame=2&anchor=17:41:40'>
here</a>, <a href=
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=262&frame=2&anchor=00:08:37'>
here</a> and <a href=
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=263&frame=2&anchor=06:25:27'>
here</a>.













<!-- Comment: Wed Aug 24 07;45;12 comment by...Jen -->
Thanks for taking this one Sebastian!  :)
<!-- Comment: Wed Aug 24 12;22;14 comment by...Sebastian -->
Should have said that the SRC ok (form the LA downstairs) but svxdaq showed that it was in an undefined state, I did a HRR on it, and then the glinks were synched. At the moment I was not sure, but with the incident today it is clear that the SRC has to be in a good state to sync the FFO glinks.
<!-- Comment: Wed Aug 24 23;36;00 comment by...s -->
undefined state, meaning in HALT...
<!-- Date: Wed Aug 24 07:44:26 2005 -->
<h4>Electron lens tripped off</h4> 
At 4am, the electron lens tripped off.  According to MCR, "Modulator was tripped on an "air flow" bit."  Aces saw the drop in L1COLI and the change in abort gap losses, and put silicon to standby.  Unfortunately they didn't correlate this with a loss of electron lens.  When they paged me, they told me it was just an ACNET monitoring problem and that the abort gap losses had dropped to zero briefly, and were now normal (which is not what happened, see plot in <a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/elog.pl?nb=2005&action=view&page=706&frame=2&anchor=04:13:45.267'>main elog</a>).  They asked for permission to leave silicon up if it happened again.  I said NO, if it happened again they had to take silicon to standby and page me, but I gave them permission to bias the silicon again now that losses were back to normal.<br>
<!-- Author: Jen -->



<!-- Date: Wed Aug 24 09:23:03 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: SB2W2L3 
<li>problem n: 436 
<li>Status: needs_work
<li>Type: Chip_bit_error
<li>Action: Monitoring
<li>entered by: jpursley 
<li>description is: Chip bit error is back, starting with run 203139.  Looks like bit 5 problem again, occurs in ~40% of events. 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B2W2&layer=L3">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Wed Aug 24 10:03:07 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7315&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7315  width='300' align='top'></a></td><td>How can you not see that ...... there is no clearer case of the lense going off...</td></tr></table>
<!-- Author: Marcel -->


<!-- Date: Wed Aug 24 10:16:03 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: IB3W0L4 
<li>problem n: 1506 
<li>Status: fixed
<li>Type: BIAS
<li>Action: Monitoring
<li>entered by: amitra 
<li>description is: <p>For the moment, the current limit is fine.  However as the bias current is increasing due to radiation damage, the ladder will exceed the limit around 13 September '05 (DS-Day 1716).</p>  <p>The Bias-Current plots and fit can be found <a href= 'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=263&frame=2&anchor=17:38:14'> here</a>.</p>    
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=ISL&wedge=B3W0&layer=L4">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Wed Aug 24 10:42:29 2005 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7316&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7316' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7317&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7317' width='300'></a></center>
<!-- Author: Ankush -->
<!-- Comment: Wed Aug 24 10;44;46 comment by...Ankush -->
<p>Here's the bias-current history for IB1W2L1 (f121).  The upper IMON limit was bumped up to 105.0.  This is fine for the moment but as fit to the data suggests this limit will be exceeded on DS-Day 1739 (6 October '05).</p>

<!-- Date: Wed Aug 24 10:47:57 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: IB1W2L1 
<li>problem n: 1507 
<li>Status: fixed
<li>Type: BIAS
<li>Action: Diagnosis
<li>entered by: amitra 
<li>description is: <p>The upper IMON limits were increased to 105.0 which is satisfactory for the moment.  However the trend in the data this upper limit will be exceeded on DS-Day 1739 (6 October '05).</p>  <p>The graphs can be found <a href= 'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=263&frame=2&anchor=10:42:29'> here</a>.</p> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=ISL&wedge=B1W2&layer=L1">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Wed Aug 24 10:56:42 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7318&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7318  width='300' align='top'></a></td><td><p>The Bias-Current history for SB3W6L2 (e362).  The upper IMON limit was increased to 200.0.  This limit hasn't been exceeded.</p></td></tr></table>
<!-- Author: Ankush -->

<!-- Date: Wed Aug 24 10:59:55 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: SB3W6L2 
<li>problem n: 1508 
<li>Status: fixed
<li>Type: BIAS
<li>Action: Monitoring
<li>entered by: amitra 
<li>description is: <p>The upper IMON limit was increased to 200.0.  Since the change, the upper limit hasn't been exceeded.  So the upper limit is fine.  Closing this thread.</p>  <p>The graph can be found <a href= 'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=263&frame=2&anchor=10:56:42'> here</a>.</p> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B3W6&layer=L2">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Wed Aug 24 11:07:23 2005 -->
<b>BIAS on SB0W3L3</b>  
After the b0fib02 incident last night the bias current for this 
ladder was increasing, however it came down again...
<!-- Author: Sebastian -->


<!-- Date: Wed Aug 24 11:30:05 2005 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7319&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7319' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7320&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7320' width='300'></a></center>
<!-- Author: Ankush -->
<!-- Comment: Wed Aug 24 11;32;21 comment by...Ankush -->
<p>The Bias-history for IB2W0L3 (f203).  The upper IMON limit was increased to 105.0.  This limit is fine for the moment, but a fit to the data suggests this limit will be exceeded DS-Day 1719 (16 September '05).</p>

<!-- Date: Wed Aug 24 11:34:56 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: IB2W0L3 
<li>problem n: 1509 
<li>Status: fixed
<li>Type: BIAS
<li>Action: Monitoring
<li>entered by: amitra 
<li>description is: <p>The upper IMON limit was increased to 105.0.  This limit is satisfactory for the moment, but a fit to the data suggests this limit will be exceeded on DS-Day 1719 (16 September '05).</p>  The graphs can be found <a href= 'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=263&frame=2&anchor=11:30:05'> here</a>.</p>    
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=ISL&wedge=B2W0&layer=L3">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Wed Aug 24 11:43:10 2005 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7321&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7321' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7322&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7322' width='300'></a></center>
<!-- Author: Ankush -->
<!-- Comment: Wed Aug 24 11;45;31 comment by...Ankush -->
<p>The Bias-Current history for IB1W0L3 (f103).  The upper IMON limit was increased to 115.0.  This is satisfactory for the moment but a fit to the data suggests this limit will be exceeded on DS-Day 1744 (11 October '05).</p>

<!-- Date: Wed Aug 24 11:49:39 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: IB1W0L3 
<li>problem n: 1510 
<li>Status: fixed
<li>Type: BIAS
<li>Action: Monitoring
<li>entered by: amitra 
<li>description is: <p>The upper IMON limit was increased to 115.0.  This limit is fine for the moment but a fit to the data suggests this limit will be exceeded on DS-Day 1744 (11 October '05).</p>  <p>The graphs can be found <a href= 'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=263&frame=2&anchor=11:43:10'> here</a>.</p>    
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=ISL&wedge=B1W0&layer=L3">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Wed Aug 24 12:18:11 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: SB1W5L4 
<li>problem n: 11 
<li>Status: needs_access_8hr
<li>Type: DropReadOut_nonRX
<li>Action: Action_request
<li>entered by: amitra 
<li>description is: <p>I think believe the BE-Kludge for this ladder has slipped again. We did try to fix it earlier which cleared up some problems.  Let&339s try one more tiem before we throw this ladder in the bin.</p>  <p>This will have to be a planned access.  Ken from FCC needs to be told at least a day in advance and the test-stand at FCC must be free and working.</p> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B1W5&layer=L4">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Wed Aug 24 12:19:19 2005 -->
<h2> Hit me baby one more time ... </h2> 
And b0fib02 died again ... it takes longer and longer to get the link back. But finally, we had everything back online and hoping, it will last till 6 pm (access time)
<!-- Author: Sebastian, Jen and the old man -->



<!-- Date: Wed Aug 24 12:40:01 2005 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7323&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7323' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7324&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7325' ></a></center>
<!-- Author: Jen, Marcel, Sebastian -->
<!-- Comment: Wed Aug 24 12;42;32 comment by...Jen, Marcel, Sebastian -->
Screenshot of SVX after b0fib02 died this time; Marcel managed to save some things from tripping through quick config'ing.  Also an IMON snapshot of 2V DOIM for SB0W7; both 2V and 5V DOIMs for this wedge came back with currents much lower than they should be.  We tried powercycling the wedge 3 times without success.  Finally we hockerized Crate 6, and that fixed the problem.

<!-- Date: Wed Aug 24 12:55:53 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: SB0W0L2 
<li>problem n: 1490 
<li>Status: needs_urgent_monitoring
<li>Type: Chip_bit_error
<li>Action: Diagnosis
<li>entered by: yuji 
<li>description is: This ladder continues to have chip a3 read as a2. In addition, Occup Out of Limits rate is high recently (around 30% since run 203055) 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B0W0&layer=L2">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Wed Aug 24 13:17:28 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: IB4W1L4 
<li>problem n: 1454 
<li>Status: needs_urgent_monitoring
<li>Type: Unknown
<li>Action: Monitoring
<li>entered by: yuji 
<li>description is: Physics tail reduction problem has continued. In addition, high Occup Out of Limits rate (~30%) constantly. Also there is a hot channel in Chip4. 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=ISL&wedge=B4W1&layer=L4">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Wed Aug 24 14:38:51 2005 -->
<h2> New chiller </h2> 
We got a new chiller for B0, cooling capacity 2.5 cubic feet and can go down to 38 degree F. It is designed to preferrably cool down liquids, but can be used for Oberweis calibrations as well. The final commissioning will be a cold can of the SPL's favorite cold refreshment.<br> 
Stay tuned.   
<!-- Author: David C. and Marcel (Special Acquisition  Forces) -->

<!-- Date: Wed Aug 24 19:28:15 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: SB0W7All 
<li>problem n: 1517 
<li>Status: needs_access_2hr
<li>Type: VDOIM
<li>Action: Diagnosis
<li>entered by: jpursley 
<li>description is: When we turn this wedge off and back on again, the 2V and 5V DOIMs both come up with low currents.  Only way to get them back up to the right current level is to hockerize the crate.  Probably a power supply problem, swap out the supply when we have an opportunity (and more than one spare SVX supply).  See <a href= 'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=263&frame=2&anchor=12:40:01'>elog</a> for more details. 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B0W7&layer=All">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Wed Aug 24 20:40:52 2005 -->
<h3> Access report Team Albiceleste </h3> 
We went in and swapped the FFO in b0fib02. Let's see if that does the trick. If not, we have to think about something else going wrong, which is difficult to imagine from the symptoms we see.  
<!-- Author: M & S -->
<!-- Comment: Wed Aug 24 20;42;39 comment by...Marcel -->
bummer, I forgot. Jen and Mark were driving from upstairs


<!-- Date: Wed Aug 24 23:19:56 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7328&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7329  width='300' align='top'></a></td><td>this thing was nesting on the FFO</td></tr></table>
<!-- Author: fib02 problems explained -->
<!-- Comment: Wed Aug 24 23;38;33 comment by...tired elog reader -->
It is dead ... Jim 


<!-- Date: Wed Aug 24 23:53:45 2005 -->
<h4>fa33 troubles </h4> 
Failed to initialise...shit...Tried to reboot the FIB and powercycled the wedge, nothing worked. Since powerwise, everything looked ok, I masked the init readback ...  
<!-- Author: Marcel -->
<!-- Comment: Thu Aug 25 00;17;43 comment by...Marcel -->
ok, we are seeing data on it, but it seems like the bit 3 error is real
<!-- Date: Wed Aug 24 23:55:43 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: LB1W3L3 
<li>problem n: 1518 
<li>Status: needs_work
<li>Type: Chip_other
<li>Action: Incident
<li>entered by: marcel 
<li>description is: this ladder had problems with initialisation, so I had to mask the init readback. Looks like the return of the bit3 problem. We'll have the monitor this during data taking 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=L00&wedge=B1W3&layer=L3">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Thu Aug 25 00:01:45 2005 -->
<h4> more fun .....</h4> 
Our beloved PSGUI decided to die while we were ramping the Silicon.<br> 
Shit .... they need to fix the GUI<br>
<!-- Author: Marcel -->
<!-- Comment: Thu Aug 25 00;06;00 comment by...Marcel -->
on another note, this thing seems to die after a certain amount of transactions .... maybe we should restart after each massive trip ??? <br>
Or even better, actually fix the problem ....


<!-- Date: Thu Aug 25 00:12:31 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7330&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7331  width='300' align='top'></a></td><td>SVT plot for store 4339</td></tr></table>
<!-- Author: Marcel -->



<!-- Date: Thu Aug 25 07:54:34 2005 -->
Paged at 5am for the bias current of SB0W3L3, which accidentally got unmarked from Ignore at 2:40am.  See <a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/elog.pl?nb=2005&action=view&page=709&frame=2&anchor=04:44:56.300'>plot in main elog</a>.  Right now it's still oscillating and at a high value (293 when high end is 275) so I'm leaving it ignored.<br>
<!-- Author: Jen -->


<!-- Date: Thu Aug 25 08:57:13 2005 -->
<h4> FFO checkout </h4> 
It has not lost the link during the whole night ... so I decided to put some more pressure on it by running a HighSpeed Test. Let's see, if the FFO has to get warm to fail...
<!-- Author: Marcel -->


<!-- Date: Fri Aug 26 05:48:38 2005 -->
Trig table test, rate is L1 15kHz as before, the silicon is going in.
<!-- Author: Sebastian -->


<!-- Date: Fri Aug 26 07:36:19 2005 -->
<h4> Dmode calibration failed </h4> 
At the moment it looks like the old EVB is not working anymore. MArkus is not sure why. He will try to fix up the new EVB for use with the Dmode calibrations.  
<!-- Author: Marcel -->


<!-- Date: Fri Aug 26 14:40:44 2005 -->
<h3>Timestamps for svxinter</h3> 
 
Made some changes to the server code of svxinter, now it shows timestamps for some critical calls (may have to add more  
time stamps in the future). Seems to work: 
<pre> 
FRI AUG 26 19:16:45 2005 PowerSet file is $CAENCONTROL_DIR/powerset.dat 
FRI AUG 26 19:16:46 2005 LV Currents file is $CAENCONTROL_DIR/CAENLVcurrent.dat 
Using local rtlm  
Zap TipcSrvLmCheck  
</pre> 
 
To change back you have to: 
<ul> 
<li> be logged in svxinter and type 'bootChange' 
<li> press return till you ge to "startup script", there 
press "." followed by the old path:<br> 
/cdf/code-common/cdfonline/caencontrol/devel/examples/startup_rtlm 
<li> Exit the PSgui and reboot (svxinter) 
<li> restart the gui 
</ul>
<!-- Author: Sebastian -->


<!-- Date: Fri Aug 26 15:13:52 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7332&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7333  width='300' align='top'></a></td><td>SVT SpyMon for store 4351, initial lum ~120.  Everything looks good here and in SVXMon.</td></tr></table>
<!-- Author: Jen, Marcel, Sebastian -->


<!-- Date: Fri Aug 26 15:29:21 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7334&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7335  width='300' align='top'></a></td><td>Bias current on Bias1 of IB1W1L3.  Current is 106, high limit is 105.  Bumping up limit.</td></tr></table>
<!-- Author: Jen -->


<!-- Date: Fri Aug 26 15:35:00 2005 -->
Bias current on SB0W3L3 has been stable around 190 (after several days excursioning above 290!) for most of the last store and all of this one so far.  Unmark it for now, but leave the upper current limit at 275.<br>
<!-- Author: Jen -->


<!-- Date: Fri Aug 26 19:32:47 2005 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7336&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7336' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7337&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7337' width='300'></a></center>
<!-- Author: Ankush -->
<!-- Comment: Fri Aug 26 19;35;26 comment by...Ankush -->
<p>The graphs above show the increase in Bias current for IB3W0L3 (f303).  The upper IMON limit was changed last week to 105.0.  This is fine for the moment but a fit to the data (see graph right) suggests this limit will be exceeded on DS-Day 1706 (3 September 2005).</p>

<!-- Date: Fri Aug 26 19:42:11 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: IB3W0L3 
<li>problem n: 1503 
<li>Status: needs_longterm_monitoring
<li>Type: BIAS
<li>Action: Diagnosis_update
<li>entered by: amitra 
<li>description is: <p>The upper IMON limit for the Bias-Current was bumped up from 100.0 to 105.0.  THis limit is fine for the moment but a fit to the data suggests this limit will be exceeded on DS-Day 1706 (3 September 2005).</p>  <p>The graphs can be found in the silicon e-log <a href= 'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=263&frame=2&anchor=19:32:47'> here</a>.</p> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=ISL&wedge=B3W0&layer=L3">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Sat Aug 27 01:51:03 2005 -->
<pre>Since we know the bias current increases with luminosity. When not make a room for it? Especially you know it's going to hit the limit in a week. You want to detect the excursion but also want to allow the constant increases, right? </pre>
<!-- Author: Rong -->
<!-- Comment: Sun Aug 28 21;25;37 comment by...boveia -->
<br>I agree.  The increase in bias current is obvious and could be fit when automatically computing new IMON limits.

<!-- Date: Sat Aug 27 05:45:52 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7338&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7338  width='300' align='top'></a></td><td> </td></tr></table>
<!-- Author: Jen -->
<!-- Comment: Sat Aug 27 05;49;47 comment by...Jen -->
<h3>Cooling trip</h3>
Had a cooling trip, cooling alarms went off for ISL and L00.  The ace then
hit the Silicon Rack Power Crash button, so everything is off.  The Cryo  
tech told the control room that it was a monitoring problem.  From the ISL
status page, it looks like the monitoring is gone for most of the ISL flow
rates, they all read zero.  Ulrich and the Cryo tech are looking at things
now, while I wait and watch the completely red detector.
<br>
Also, when I came in, svxinter is spitting out continuous messages such as
<pre>
  Crate_info error
 Caenet_read: Error number ffffffff received
 Crate number = 15
 Error:  response = -1
</pre>
for all the power supplies in all the crates.  And PSGui had frozen; we had heartbeat alarms and the Gui was grayed out.  I had to manually kill the Gui, but now I can get it restarted; first it couldn't initialize CAEN at svxinter.  Now it gets stuck loading startup files from the server.  I'll wait until they get power back to the racks to try again.<br>





<!-- Comment: Sat Aug 27 05;52;07 comment by...Jen -->
Also, this is ALL MARCEL'S FAULT!  When I took the pager this week he said, "Hmmmm... we haven't had a cooling trip in a while!"

<!-- Comment: Sat Aug 27 06;14;24 comment by...Jen -->
Update from Ulrich:  trip caused by one sensor which went from a minimum reading of the humidity to a maximum reading.  He and the cryo tech are now trying to determine if it's a faulty sensor or a real leak somewhere.  So we could be down for a while as they sort things out...<br>
Meanwhile, I'm watching the portcard temps - we are once again in the situation where ISL flow has stopped but SVX flow is still going!  Looking at Port Card Temps West 1, the temp dropped rapidly down to about 2 degrees but is now dropping very slowly. PCW2 at ~5 degrees, PCW3 at 5, PCE1 at 2, PCE2 at 5, PCE3 at 4, all dropping slowly at this point.<br>

<!-- Comment: Sat Aug 27 07;05;48 comment by...Jen -->
More update: the troublesome sensor has now dropped back to its original minimum value, which is negative and still very suspicious.  After consultation with Andy Hocker, they determine the only thing left to try is powercycling all the RH supplies.  But this involves getting permission from Ops people, SPLs, etc...<br>


<!-- Comment: Sat Aug 27 08;24;42 comment by...Jen & Ulrich -->
Racks are now powered; I've restarted the PSGui and have the crates waiting in a coldstart.  We've got in touch with Marcel and Sebastian, they'll be coming in to look things over before deciding to try turning things back on.
<!-- Comment: Sat Aug 27 10;04;57 comment by...Jen/Ulrich/Marcel/Sebastian -->
<h3>Situation at 10am</h3>

<ul>
<li> Jen brought back L00 and almost all of ISL with no problems,
but then some L00 ladders and a few ISL ones tripped, mostly on VBIAS.
<li> We decided to try to bring the system to a well defined state by reseting all the CAEN PS and the FIB crates.
<li> However when we tried to bring L00 back up again, we had VBIAS trips immediately. 
<li> We changed back to the 'old' svxinter server code, no change in behavior..
<li> We turned on the PC for ISL and L00 in the hope that the VBIAS are related to charge discrarges in the ladders..
<li> We brought SVX up and it mostly came up fine.. right now we have 14 trips on VBIAS... 
</ul>
We are still working on this.

<!-- Comment: Sat Aug 27 11;32;32 comment by...J/M/U/A/S -->
After talking to Rainer we powercycled the SW Bot rack, we're waiting for it to coome back. We also took data with some
fib00 ladders, and the data looks fine (good!).
<!-- Comment: Sat Aug 27 16;07;21 comment by...Sebastian -->
The end of the story is that the wrong CAENcurrent.dat file was loaded (note that his file is not loaded by default when the Gui is started), the link was changed to CAENcurrent_02162005_0511PM.dat intead of CAENcurrent_gino.dat (see entry below for more detail).

<!-- Date: Sat Aug 27 08:05:44 2005 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7339&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7339' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7340&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7340' width='300'></a></center>
<!-- Author: Ulrich H. -->
<!-- Comment: Sat Aug 27 09;07;57 comment by...Eva, Andy, and Ulrich -->
<h3>Relative Humidity Sensors</h3>
The trip this morning was caused by a strange reading in the relative humidity (RH) sensor for ISL (<a href=
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=216&frame=2&anchor=20:58:25'>
SVX_RH_DETW1</a>, WX241 in the PLC). The RH is used (along with the temperature) to calculate the dewpoint of the system. The range of these sensors is 0-100%. In the PLC code, there is a 
<a href=
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=216&frame=2&anchor=14:22:55'>
lower cut-off of 3% RH for the dewpoint calculation</a>, hence negative readings do not cause trips. The ISL sensor jumped up from -28% (close to lower reading limit) to +139% (close to upper limit), stayed there for 1.5 hours and jumped back by itself (left plot).
<p>
Andy suggested to power-cycle the power-supply for the RH sensors and see if the reading go back to normal. The corresponding power supply is situated in the rack left of the PLC. Both the power supply and the power cord are properly labeled. I have unplugged the cord, made sure the readings were out of limits afterwards and plugged it back in. The readings came back to where the were before. Thus the strange readings are still there, and another jump may occur at any time.
<p>
SVX_RH_DETW1 is not the only sensor with strange readings. Also SVX_RH_DETE1 (RH in the SVX) is at negative values. The long-term plot (from May 1, 2005) shows a drift from normal to negative values. We will have to evaluate what went wrong with these sensors. A short-term fix would be to bypass the trip inside the PLC, but this needs authorization from the silicon SPLs and operations. Accessing the actual sensors would require opening the plugs.
<!-- Comment: Sat Aug 27 09;45;18 comment by...A tired pager carrier -->
It is all Eva's fault, she asked me kindly to carry the pager for her this weekend... Ok, it may also be Marcel's fault.
<!-- Comment: Sat Aug 27 10;30;30 comment by...Ulrich H. -->
<br>I forgot to mention that we carefully checked all pressures and flow (when available) and the air seperator pressure to see if the high RH is caused by a leak. There is no correlation with the air seperator, and all pressures/flow look normal.
<!-- Comment: Mon Aug 29 11;47;04 comment by...Ulrich H. -->
<br>
During the downtime, I have performed the 3-weekly reboot of our iFix PC, SVXIICON.
<!-- Date: Sat Aug 27 08:51:32 2005 -->
Problems with PSgui: 
<pre> 
[svxii@b0dasvx01 PSanywhere]$ User: svxii 
Display:  
Attempting initialization of CAEN at svxinter.fnal.gov... 
5 seconds passed ... 
10 seconds passed ... 
15 seconds passed ... 
20 seconds passed ... 
</pre> 
what is this?
<!-- Author: all -->
<!-- Comment: Sat Aug 27 16;01;09 comment by...Sebastian -->
Looks to me (from PWR.java) that it means that the PSgui could not communicate
with svxinter... (in any case rebooting svxinter and restarting the Gui worked).
<!-- Date: Sat Aug 27 13:12:40 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7341&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7341  width='300' align='top'></a></td><td>SVX after we tried to power it.</td></tr></table>
<!-- Author: All -->
<!-- Comment: Sat Aug 27 15;06;59 comment by...All... including Rong. -->
Tracked down the problem to the fact that the wrong CAENcurrent file was being used... more details to follow. We are in the process of bringing the system back up, things looks good now. 




<!-- Date: Sat Aug 27 16:21:32 2005 -->
<h2> A summary of this disaster </h2> 
This is a not so short summary about what the hell happenend today. 
<ol> 
<li> We had a cooling alarm at 05:00, one of the relative humidity sensors went off and the interlock system took care of that. A summary see <a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=263&frame=2&anchor=08:05:44'> 
here </a> </li> 
<li> The Ace (Sasha) panicked and pressed the crash button although the interlock system already took care of things </li> 
<li> At that point everything went down, DAQ,CAENS,detector, basically someone pulled the plug out of the Silicon. </li> 
<li> When Jen and Ulrich tried to recover things, the next round of problems started, a whole lot of bias trips even when you turn wedges to Standby. </li> 
<li> Sebastian and Marcel came in as well around 8 am.  </li> 
<li> reset all the Fibs again, hockerized all the CAENs but problems persisted. Suspect problems with surface charge communications </li> 
<li>Called up Rainer for advice, he suggested to see, if the Quadlog is ok, talked to Rob, Said Quadlog is fine.</li> 
<li> Rainers second suggestion was to powercycle a rack again to see, if that has any effect. He has not seen anything like this before </li> 
<li> At that point we were able to turn some of the critical ladders on by raising the bias limits from 50 to 500. </li> 
<li> At some point around noon we had all of the SVX on Standby </li> 
<li> An attempt to bias SVX failed miserably, a lot of Layer 0,1 and 3 failed. </li> 
<li> Back to square one. We noticed, that some of the trip limits had very odd numbers. 4914. 2866 etc.  </li> 
<li> Looks like there is something wrong with the trip limits, the assumption is,that pulling the plug somehow killed the trip limit settings</li> 
<li> We rewrote Caencurrent.dat, but thanks to Bill, that link was pointing to the wrong file owned by badgett. </li> 
<li> we corrected the link to caencurrent_gino.datand reloaded this one. From that point things looked a lot better than before. </li> 
<li> we were able to turn on everything but one ladder in the ISL (f543). That could be a casualty of this or just needs a break </li> 
 
</ol> 
Altogether 11 hours downtime (five people) thanks to Sasha for pushing the button without need and somebody for rewriting the link.  
<pre> 
 badgett  cdf          3487 Feb 16  2005 CAENcurrent_02162005_0511PM.dat 
 
</pre> Let's hope, nobody pushed this button again for the next 15 month. 
  
<!-- Author: Jen/Ankush/Ulrich/Sebastian/Marcel -->
<!-- Comment: Sat Aug 27 17;14;36 comment by...Sebastian & Marcel -->
<table border=0><td><tr><td bgcolor=#e0e030><h3> A big thanks to Rong and Rainer for Help and advice </h3></td></tr></td></table>


<!-- Comment: Sun Aug 28 04;51;57 comment by...Sleepless in Arlington -->
Smells <a href=
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=149&frame=2&anchor=20:46:14'>familiar</a>.
but more like 28 months, not 15.
<!-- Date: Sat Aug 27 17:17:30 2005 -->
<h3>Temporary change of Main-Pager</h3> 
 
<p>This is really a message for Jen, but I (Ankush) will be temporary main-pager from now (Sat Aug 27, 5:000pm) to Sun Aug 28, 9AM.</p> 
 
<p>Jen, if you&#39re reading...GO TO SLEEP !!!!!</p> 
<!-- Author: Ankush -->

<!-- Date: Sat Aug 27 19:10:50 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: SB1W4L2 
<li>problem n: 1270 
<li>Status: needs_observation
<li>Type: Unknown
<li>Action: Monitoring
<li>entered by: yuji 
<li>description is: Bump reappear. Chip5 has hot channels. Out of Limits rate constantly high (~33%) 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B1W4&layer=L2">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Sat Aug 27 22:09:45 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7342&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7343  width='300' align='top'></a></td><td><h3>It looks like we have a detector again !!!!</h3> 
 
<p>Store 4353 has just come in with an intial lumi of 112E30.  The proton and anti-proton losses are very low (< 1KHz).  SVXMon is fine and SVTSPYMON plot looks good. </p> 
 
<p>We saved the detector....<em>again!!!</em></td></tr></table>
<!-- Author: Ankush & Jen -->


<!-- Date: Sun Aug 28 00:42:31 2005 -->
<h3>Just what we need... another cooling trip</h3> 
So the same faulty sensor pulled the same shenanigans and tripped everything off again at 00:16.  Ulrich is on his way.  This time, no crash buttons have been hit, so we just have to deal with a cooling trip.  Now waiting until Ulrich arrives to assess our options.<br> 
Ah, Ulrich and Marcel have just arrived.  More to come, I'm sure...<br>
<!-- Author: Jen -->
<!-- Comment: Sun Aug 28 01;13;36 comment by...sebastian -->
sorry to miss the party..

<!-- Comment: Sun Aug 28 01;37;01 comment by...Marcel/Ankush/Ulrich/Jen -->
<h3> The Plan </h3>
So the faulty sensor stroke again. We have to modify the interlock code to fix it. This is a rather complicated procedure and also needs the approval of Ops. We decided not to do it tonight, but wait for tomorrow morning instead. The plan is to either make the trip condition always true or to bypass this interlock completly. Whatever we do, we still have to check, that we can trip everything. <br>
We have warmed up SVX up to -8 just in case ( we have Glycol now and we are good for -3, but we do not want to test this really).
<br>
We'll meet tomorrow morning to make the changes in the PLC.
<br>
<b>In other news, Tevatron just lost the store  </b>


<!-- Comment: Sun Aug 28 01;50;44 comment by...Marcel -->
just an update, this kind of trip does not kill the flow to the Portcards obviously, because the chiller itself is fine.
SVX PortCard East was changed from 65% to 55% 
and SVX PortCard West was changed from 90% to 80%



<!-- Comment: Sun Aug 28 07;53;40 comment by...Jen -->
From MCR elog:  the reason Feeder 46A went down & we lost the store...
<pre>
-- Sun Aug 28 04:57:36 comment by...ollie --  The air breaker for feeder 46A (P71) outside of A3 flashed over. The ball of fuzz on the left is (was) the mouse which caused this. Prem believes he can have this breaker bypassed in ~2hrs (work began on this ~30 minutes ago). Cryo, however will take another 6 hrs to pump down once compressors are back. 
</pre>

<!-- Comment: Sun Aug 28 09;10;57 comment by...Marcel -->
Willis gave his go ahead .... so we can start playing around

<!-- Comment: Sun Aug 28 11;28;04 comment by...Sebastian -->
We just tripped the silicon racks... (was it part of "the plan"?)

<!-- Comment: Sun Aug 28 11;29;14 comment by...Marcel -->
That was Plan B, if we are going down, we do it with style


<!-- Date: Sun Aug 28 12:35:58 2005 -->
<table border=0><td><tr><td bgcolor=#e0e030><h2> Flipped 5 V enables .... </h2> 
Just to be sure....</td></tr></td></table>
<!-- Author: Marcel -->


<!-- Date: Sun Aug 28 12:46:16 2005 -->
<h3>Interlock Change: ISL Relative Humidity Sensor</h3> 
 
Due to the dew point trips caused by a broken/degenerated relative humidity (RH) sensor in the ISL, we decided to bypass the variable reading of the dewpoint (V416) by a constant number of 5181 (-30C). 
The dew point trip is caused by a dew point reading above the minimum ISL temperature, and -30C is safely below any ISL temperature.  
<p> 
After the silicon SPLs and the head of CDF operations gave their ok, we started to change the interlock code, using the 
<a href=http://www-cdf.fnal.gov/~husemann/internal/CoolingInterlock/codechange.doc">CDF Silicon Interlock Code Change Request</a>, and following the <a href="http://www-cdf.fnal.gov/~husemann/internal/CoolingInterlock/Interlock_procedures.doc">Procedure for Validating and Modifying the Interlock Code</a>. 
<p> 
<b>Thanks to Eva and Andy for their advice and to the silicon crew (Sebastian, Ankush, Marcel, and Jen).</b>  
<!-- Author: Jennifer :-) & Ulrich -->


<!-- Date: Sun Aug 28 13:15:12 2005 -->
<h3>Problems with the ISL Chiller</h3> 
The cryo tech (Jim Humbert) observed increasing temperatures in the ISL chiller, starting from about 8:30 and reaching alarm limits about 1 hour later. Parallel to our work on the interlock code and <em>without the knowledge of the CDF control room or the cooling experts</em>, he decided to switch to the spare chiller. This caused an ISL chiller trip at about 10:30. At the same time, and possibly related, all silicon racks tripped. 
The pressure and flows delivered by the spare chiller were on the low side, but there are no other indications for leaks in the system. Stefano Moccia looked into the problem together with the cryo tech. After the third inspection, they found a valve which effectively worked as a bypass to the spare chiller. After they closed the valve, all pressures went back to normal. 
<p> 
We call in a technician from RAM to examine the problematic chiller. 
The silicon SPLs decided to keep the silicon off for another 30 minutes to see if flows and pressures from the spare chiller are stable.
<!-- Author: Jennifer :-), Ulrich, and the Silicon Crew -->
<!-- Comment: Sun Aug 28 14;51;05 comment by...Ulrich H. -->
<br>
The RAM technician came in and is currently checking out the ISL chiller (together with Stefano and Jim). Currently, all three chillers are being operated. Note that we had problems operating all chillers at the same time due to the chilled water flow to the chillers. I have been paged to watch temperatures. There is no heat-load on the system, and the SVX chiller holds its current setpoint of -8C. We will decide which chiller is to be used in the coming store, aber we hear from the RAM tech.

<!-- Comment: Sun Aug 28 14;58;50 comment by...Ulrich H. -->
<br>
The sensor for the ISL chiller return temperature (ISL_TE_CHRET) is currently attached to the wrong chiller (i.e. the broken ISL chiller, not the spare chiller). Therefore, the reading shows room temperature. I have deactivated the corresponding iFix alarm for the time being.

<!-- Comment: Sun Aug 28 16;06;24 comment by...Ulrich H. -->
<br>
The RAM technician could not fix the chiller on the spot. He needs to run it with some heat-load from a heater and a larger coolant volume. This will be done in between stores, maybe tomorrow. In the mean time, we are running on the spare chiller. All settings (valve settings, SVX temperature setpoint etc.) are back to their default values, and the RH sensor is bypassed in the modified PLC code. The system is ready to go, and we power up the silicon.


<!-- Date: Sun Aug 28 16:13:56 2005 -->
<h3>Silicon back up</h3> 
 
<p>Ulrich and I brought the detector back to standby.  We would&#39ve like to have recovered IB5W4L3 (f543) which was lost yesterday.  Unfortunalty, Tevatron are doing a wet squeeze and will go straight into shot-setup.  So we&#39ll have to wait till the end of the next store to get the ladder back. We also couldn&#39t take the COLD-START to ACTIVATE to really excercise the system.  So we should keep a careful eye on thing at the start of the next store.</p> 
 
<p>Otherwise Silicon should be good to go.</p>
<!-- Author: Ankush and Ulrich -->
<!-- Comment: Sun Aug 28 17;50;51 comment by...R -->
<pre>What a weekend.</pre>
<!-- Comment: Sun Aug 28 20;13;10 comment by...The Duke -->
Right on !
<!-- Date: Sun Aug 28 16:30:03 2005 -->
<h3>New VRB Firmware tests</h3> 
 
Brought a DEM form FCC and setup the teststand in B0 with 
two VRBs (DEMs & FIBs). Downloaded the new firmware and  
tested it. All looks fine: 
 
<pre> 
tstsvx1-> vrb_dumpVrbRDBS(9) 
Vrb RDBS 0x400: 88F   87.64 us   (err: 0) 
Vrb RDBS 0x404: 88C   87.52 us   (err: 0) 
Vrb RDBS 0x408: 88C   87.52 us   (err: 0) 
Vrb RDBS 0x40c: 8A7   88.60 us   (err: 0) 
... 
tstsvx1-> vrb_dumpVrbRDBS(13) 
Vrb RDBS 0x400: 893   87.80 us   (err: 0) 
Vrb RDBS 0x404: 88F   87.64 us   (err: 0) 
Vrb RDBS 0x408: 88C   87.52 us   (err: 0) 
Vrb RDBS 0x40c: 8A9   88.68 us   (err: 0) 
... 
</pre> 
 
The vrb_dumpVrbRDBS method was added to vrb_methods.c, but 
no changes were commited yet.<br>
<!-- Author: Sebastian -->


<!-- Date: Sun Aug 28 18:47:15 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: SB0W0L2 
<li>problem n: 1490 
<li>Status: needs_observation
<li>Type: Chip_bit_error
<li>Action: Monitoring
<li>entered by: yuji 
<li>description is: Occup Out of Limits rate back to zero since run 203334. Need observation. 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B0W0&layer=L2">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Sun Aug 28 19:13:16 2005 -->
<pre>---- Monitoring Summary ----     
  
NEW PROBLEMS DISCOVERED:     
  
SB1W4L2 Hot channels in chip5. Out of Limits rate high (~33%)  
IB4W1L4 - Physics tail reduction. High Occup Out of Limits rate. Hot channel.  
  
"FIXED" PROBLEMS:  
  
URGENT MONITORING:  
  
SB3W1L3 - Bit2 stuck high in Run 202973, but now looks ok?  
  
LONGTERM PROBLEMS:  
  
SB4W9L3 -   
  
OLD PROBLEMS:   
  
SB0W0L2 - Intermittent bit errors.  
SB2W8L0 - This ladder had bit error. No problem recently.  
LB0W5L3 (f853)  - Chip 2 possibly unbiased.  I need to look at this.    
SB2W10L4(e2a4)  - Long readout time.  Need to look at bias scans.  
</pre>
<!-- Author: Yuji -->

<!-- Date: Sun Aug 28 20:07:38 2005 -->
Entered in Silicon database: <ul>
<li>Ladder: IB5W4L3 
<li>problem n: 1520 
<li>Status: needs_observation
<li>Type: BIAS
<li>Action: Diagnosis_update
<li>entered by: yuji 
<li>description is: <p>We now have some unexpected quiet time. So I took the opportunity to bring IB5W4L3 (f543) back in.  It powered up fine and it ran fine with COLD-START.</p>   
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=ISL&wedge=B5W4&layer=L3">report</a></ul>
<!-- Author: Problem DB -->
<!-- Comment: Sun Aug 28 20;09;25 comment by...Ankush -->
<pre>Ooopppps...sorry yuji, I (Ankush) had made this entry.  Guess I didnn&#39t look too carefully at the user-id in the problem DB.</pre>



<!-- Date: Sun Aug 28 20:14:37 2005 -->
<h3>IB5W4L3 (f543) is back in</h3> 
 
<p>After yesterday&#39s incident IB5W4L3 (f543) would trip on bias when we tried to turn it on.  After the rest, it came back fine.  I&#39ve now biased this ladder and it&#39s staying up without tripping.</p> 
  
<!-- Author: Ankush -->


<!-- Date: Sun Aug 28 20:47:19 2005 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7344&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7345' ></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7346&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7347' ></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7348&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7349' ></a></center>
<!-- Author: Ankush -->
<!-- Comment: Sun Aug 28 20;48;35 comment by...Ankush -->
<p>To check IB5W4L3 was really OK, I baised it and left it up for 30 mins.  As you can see from the IMON plots above, the currents are nice and stabel and no trips.  I think this ladder is good to go for data taking.</p>

<!-- Comment: Sun Aug 28 20;49;25 comment by...Ankush -->
<pre>...and I put it back to STANDBY and did a config in RUN control and all it good again.</pre>



<!-- Date: Mon Aug 29 06:14:32 2005 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7352&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-7353  width='300' align='top'></a></td><td><h4>Back online</h4> 
Finally the solenoid is back up, COT, TOF, and silicon are all powered, and we're taking data again.  Everything looks good here and in SVXMon (although e414 had me worried for a bit; it took over 200 events for chip 2 to start seeing data, so it was yellow for several minutes at the start of the run).  Started run with initial lum of ~79.</td></tr></table>
<!-- Author: Jen -->
<!-- Comment: Mon Aug 29 06;22;34 comment by...Jen -->
Strip occupancy looks good for f543 too.  Oh, and this is store 4358.


<!-- Date: Mon Aug 29 09:01:46 2005 -->
<h3>Week summary</h3> 
<ul> 
<li> Store 4346 (ongoing Mon morning) 
<ul> 
<li> RF glitch caused spike in abort gaps, but soon settled down 
<li> b0fib02 died Tues 06:00, tried powercycling VME crate 
<li> Failed to do a D-mode calibration (event size too big for evb2b, no time 
to switch to old evb) 
</ul>    
<li> Store 4347 (Tues 13:00) 
<ul> 
<li> b0fib02 died again 21:00, requested access to swap FFO 
<li> Electron lens tripped off, recovered 
<li> b0fib02 died again Wed 12:00 
<li> Tried D-mode again, old evb failed config, no time to diagnose problem 
</ul> 
<li> Wed 18:45 
<ul>  
<li> Access to replace b0fib02 FFO 
<li> Had to mask init readback on fa33 before new store 
</ul> 
<li> Store 4349 (Thurs 00:00) 
<ul> 
<li> Again old evb failed config, can't do D-mode 
</ul> 
<li> Store 4351 (Fri 15:00) 
<ul>      
<li> Cooling trip due to faulty sensor, rack crash button hit, out for rest 
of store 
<li> Gui loaded wrong bias current trip limits for detector, once that was 
discovered everything came back but f543 
</ul> 
<li> Store 4353 (Sat 22:00) 
<ul> 
<li> Cooling trip due to faulty sensor Sun 00:16.  Decide to leave silicon 
out until we can bypass sensor in the morning 
<li> Power glitch ends store at 02:00 
</ul> 
<li> Sun 09:00 
<ul> 
<li> Changed interlock code to bypass faulty sensor 
<li> Racks tripped off 
<li> ISL chiller dies, switch to spare chiller 
<li> RAM tech comes to check ISL chiller, says it's a mechanical problem 
<li> f543 comes back to life 
<li> Feeder 47 glitch delays shot setup, causes dump of CDF solenoid 
</ul>      
<li> Store 4358 (Mon 02:40) 
<ul> 
<li> Start with solenoid off, no COT or silicon in 
<li> Solenoid stable by 05:00, start run with COT and silicon 06:00 
<li> RAM tech back to check out ISL chiller 07:00 
<li> Will try to take a D-mode calib with evb2b during daytime hours before end of store 
</ul> 
</ul>  
<!-- Author: Jen -->