<!-- Title: 09:59:14  Mon Dec 31 2007 -->
<!-- Crewchief: Sebastian Carron (MPC) -->
<!-- Op1: Sasha (SPL) -->
<!-- Op2: &nbsp; -->
<!-- Op3: &nbsp; -->
<!-- Op4: &nbsp; -->
<!-- Op5: &nbsp; -->
<!-- Op6: &nbsp; -->
<!-- Notes: -->
<pre>Start of a new shift, there may be beam today, last day of of the year. </pre>


<!-- Date: Mon Dec 31 10:29:44 2007 -->
The north wall moved in, we where able with Sasha to put to  
standby the SB3W10L4 succesfully after the wall moved in. Also there was a pinky in SB3W7L2, that was back to normal after a second coldstart
<!-- Author: Sebastian -->


<!-- Date: Mon Dec 31 15:48:03 2007 -->
Shot came in with 200E30 (store 5519). Silicon was not included to check beam lines. Crate 6 lost comunication, now everything is back.
<!-- Author: SGR -->


<!-- Date: Mon Dec 31 16:15:31 2007 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12177&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12177  width='300' align='top'></a></td><td>Store 5819 is in. Initial luminosity at the time the Silicon went in is 165E30. We did not put in the silicon imediately 
after shot setup because we wanted to observe the beam position. So there was a 15 minute run without silicon to make sure the beam position is fine. However with 15 minutes data the beam position  peak was not clear. So we could not 
ascertain for sure if it was ok, nevertheless given that the trigger rates were ok and the ratio of our luminosity to D0 was normal, this suggested the beam position was fine and we included silicon. The losses are under control and the Data looks ok, so we are in business. The usual spymon plot is here.</td></tr></table>
<!-- Author: Sebastian -->
<!-- Comment: Tue Jan  1 09;10;33 comment by...sasha -->
It looks like to new SVTspymon plot script is still not working. The plot posted here is a reference plot from the right side of the SVT SpyMon page, not a plot for the recent data. It is better to use the old (scatter) plot for SVTspymon for now until we fix the new script.
<!-- Date: Mon Dec 31 16:17:16 2007 -->
<pre>There is a large number of bias pinkies with all of them only 
barely over the limit. I will reset the limits given that they 
are barely over them and their history is not problematic</pre>
<!-- Author: Sebastian -->
<!-- Comment: Mon Dec 31 16;29;36 comment by...Sebastian -->
<pre>Actually in most cases the values fell below the limits again
by themselves, so there was no need to change the limits</pre>


<!-- Date: Tue Jan 1 09:05:15 2008 -->
Owl shift have few errors 
<pre> 
 "Exception in thread "AWT-EevntQueue-0"  
   java.lang.OutOfMemoryError: Java heap space"  
</pre> 
while trying to save history plots for pinkies. We had similar problem <a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=384&frame=2&anchor=08:52:37'> 
before</a>. Restarting <i>IMON</i> fixed the problem
<!-- Author: SashaS -->



<!-- Date: Tue Jan 1 09:48:06 2008 -->
<pre>There where a buch of pinkies yesterday night, One was DVDD and the other where BIAS, the DVDD one gotr fixed with a coldstart, the Bias ones we ignored until we could do a coldstart. Now after the end of the store the DVDD pinky on SB0W3L3 flared up again, and repeated coldstarts are not fixing it</pre>
<!-- Author: Sebastian -->
<!-- Comment: Tue Jan  1 10;10;49 comment by...Sebastian -->
<pre>The SB0W2L0 BIAS pinkie that I had marked to ignore is
now back to normal and I am unignoring it</pre>
<!-- Date: Tue Jan 1 10:02:57 2008 -->
<pre>There was a problem with the pinky plots not being able to be saved, but I restarted IMON and now the plots can be saved</pre>
<!-- Author: Sebastian -->



<!-- Date: Tue Jan 1 10:50:59 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12178&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12178  width='300' align='top'></a></td><td>The new store 5820 is in, The losses are low, trigger rates normal, beam stable in general, we had no problems in the shot setup. The data is looking ok. Here is the SpyMon plot, now I am posting the old version because the new version is not updating well</td></tr></table>
<!-- Author: Sebastian -->


<!-- Date: Tue Jan 1 10:53:23 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12179&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12179  width='300' align='top'></a></td><td>Posting the spymon plot again because I seem to have posted the reference plot. Here is the propper plot, oops...</td></tr></table>
<!-- Author: Sebastian  -->


<!-- Date: Tue Jan 1 10:58:15 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12180&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12180  width='300' align='top'></a></td><td>This is the problematic SB0W3L3 DVDD pinkie, now it is  
back in normal currents, but it is still ignored since it  
has not proven to be stable yet, if it remains stable I  
will unignore it</td></tr></table>
<!-- Author: Sebastian  -->
<!-- Comment: Tue Jan  1 11;10;39 comment by...sasha -->
I looked at the SVXmon (expert) strip plots for this ladder. It seems that when Dvdd current is in high state one of the chips (5th out of 6) does not return any data. Now it is ok


<!-- Date: Tue Jan 1 11:23:18 2008 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12182&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12182' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12183&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12183' width='300'></a></center>
<!-- Author: sasha -->
<!-- Comment: Tue Jan  1 11;25;26 comment by...sasha -->
SB0W3L3 SVXmon plots: mean charge vs strip in high Dvdd current state and normal state

<!-- Comment: Tue Jan  1 16;39;33 comment by...Sebastian -->
<pre>What do we conclude from this Sasha? I am not sure what can we try to do?</pre>


<!-- Comment: Tue Jan  1 16;48;26 comment by...Sebastian -->
<pre>The current seems to be consistently below the IMON limit now though, so we can at least unmark it, which is what I am going to do now</pre>
<!-- Date: Tue Jan 1 16:41:03 2008 -->
<pre>I just changed the IMON limits slight;y for SB3W5L2 and SB0W2L0 due to BIAS pinkies, both ladders are unmarked again. Entries in the database are to follow</pre>
<!-- Author: Sebastian -->



<!-- Date: Tue Jan 1 19:01:21 2008 -->
<pre>I got a number of alfanumeric pages, and talked to the control room, the cause was a PS trip, we do not know the cause yet, I tried to recover the situation from the phone and was unable to do this with the Ace, so I decided to drive to the lab to fix the problem, and instructed the ACE to run without silicon while I got here (with the snow I did not want to drive too fast), I did not intend for the silicon to be turned to standby, but the ACE did this, it was a misunderstanding, anyway when I got to B0 I reset the trips, turned on the silicon and we where able to take data again. Now we are back up taking silicon data. I still do not know the reason for the trip.</pre>
<!-- Author: Sebastian -->


<!-- Date: Tue Jan 1 19:06:08 2008 -->
<pre>There is a huge jump in the BIAS in the ladder SB2W0L4, I asked the ACE to do an HRR and it did not help, (a number of times), I am unwilling to stop the run, for a coldstart just for a BIAS pinky, so I am ignoring it, and when there is an oportunity to do a coldstart, we will try to see if we get back to normal conditions</pre>
<!-- Author: Sebastian -->
<!-- Comment: Tue Jan  1 22;59;19 comment by...An onlooker -->
Note that you need HRRs only for A/DVDD pinkies which don't take
long to execute. If you can HRR you don't need to coldstart. They
do the same thing in the present context. A large jump in bias 
(> 80 uA) means one or more chips are lost or back. Check the strip 
plots to be sure. Power cycling the wedge doesn't help in this situation but may be tried as the last resort.

<!-- Comment: Wed Jan  2 04;50;30 comment by...Sebastian -->
<pre>Thanks, now it is back to normal</pre>
<!-- Comment: Wed Jan  2 05;02;44 comment by...Sebastian -->
<pre>I did power cycle the ladder, will see how it behaves once we turn the silicon on again, now we are in shot setup</pre>
<!-- Comment: Wed Jan  2 05;16;56 comment by...Sebastian -->
Ok now the shot setup is finished and the ladder is back to very high voltages in BIAS1, so power cycling it did not help. So what now?, it is ignored once more
<!-- Date: Tue Jan 1 19:12:30 2008 -->
<pre>SVX Air separator is a bit low -- I e-mailed Bill Noe to have it replenished to 23''.</pre>
<!-- Author: Tom -->
<!-- Comment: Tue Jan  1 21;02;49 comment by...Ulrich -->
Thanks. I just came home and saw the flood of e-mails. I've called the cryo control room (Dean) and asked him to silence the SVX air separator level alarm until it is replentished.






<!-- Date: Wed Jan 2 05:34:15 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12184&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12184  width='300' align='top'></a></td><td>THe New Store 5821 is in. The LOSTP is a little high at 9kHz, but is is slowly falling and without spikes, so I decided to include the silicon. The silicon ramped up without problems. The trigger rates are normal and the radiation doses not too high. Here is the old version of the spymon plot, since the new version is not working from the webpage</td></tr></table>
<!-- Author: Sebastian -->


<!-- Date: Wed Jan 2 05:39:31 2008 -->
We have two still ongoing issues, there is one DVDD pinky that we are ignoring on ladder SB0W3L3, from the plots we are missing data from a chip here, However the current is back to normal on it, and we have one ignored BIAS1 pinky in IB2W0L4, in this case, repeated HRR's did not help, neither a powercycling of the ladder did and it is still exhibiting the high current state. These two pinkies are ignored at the moment
<!-- Author: Sebastian -->
<!-- Comment: Wed Jan  2 08;35;59 comment by...Sebastian -->
<pre>Looking at the chip plots these look ok now, I have unmarked the DVDD pinky, where the current is back to normal, but the BIAS pinky still has a very larve voltage</pre>
<!-- Date: Wed Jan 2 07:51:41 2008 -->
<pre>We have a large number of BIAS Pinkies, I do not know if this is related to the cooling issue, But More than half of the SVX ladders went pink at about the time the cryo filled the SVX air separator, Could this be related?</pre>
<!-- Author: Sebastian -->



<!-- Date: Wed Jan 2 08:39:12 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12185&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12185  width='300' align='top'></a></td><td>This was when a lot of pinkies (BIAS) misteriously appeared. We still do not know why. It seems to be cooling related because there was a small spike in the cooliant temperatures</td></tr></table>
<!-- Author: Sebastian -->


<!-- Date: Wed Jan 2 08:53:18 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12186&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12186  width='300' align='top'></a></td><td>Yes, it is all explained, there was a bump in the cooling temperatures caused by the filling of the SVX air separator</td></tr></table>
<!-- Author: Sebastian/Sasha/Ulrich -->


<!-- Date: Wed Jan 2 11:59:01 2008 -->
There was trip of multiple SVX ladders on Dvdd ovc: 
<pre> 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B0  W5 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B0  W7 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B1  W4 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B1  W5 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B1  W6 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B1  W8 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B1  W9 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B2  W4 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B2  W5 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B2  W6 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B2  W6 DVDD1 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B2  W7 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B2  W8 DVDD0 OverCurrent 
Wed Jan 02 11:32:45 CST 2008                        TRIP: SVX  B2  W9 DVDD0 OverCurrent 
Wed Jan 02 11:32:54 CST 2008                        ALARM:   SVX  B2  W9  L0 is reported OFF, but current is above 50 mA  
Wed Jan 02 11:32:54 CST 2008                        TRIP: SVX  B2  W8 DVDD1 OverCurrent 
Wed Jan 02 11:33:12 CST 2008                        Software protection trip: High DVDD Current  SVX B0 W9 L0 current 210.0 softLimit 150.0 
Wed Jan 02 11:33:23 CST 2008                        Software protection trip: High DVDD Current  SVX B0 W9 L0 current 163.0 softLimit 150.0 
Wed Jan 02 11:33:23 CST 2008                        TRIP: SVX  B0  W9 DVDD0 OverCurrent 
Wed Jan 02 11:34:13 CST 2008                        success: Resetting trips 
Wed Jan 02 11:35:36 CST 2008                        success: Power Supply SVX B0 W9 to STANDBY 
Wed Jan 02 11:37:52 CST 2008                        Turning b0fib02 to All standby 
Wed Jan 02 11:38:33 CST 2008                        TRIP: SVX  B2  W5 DVDD1 OverCurrent 
Wed Jan 02 11:38:33 CST 2008                        TRIP: SVX  B2  W5 DVDD3 OverCurrent 
Wed Jan 02 11:38:33 CST 2008                        TRIP: SVX  B2  W7 DVDD1 OverCurrent 
Wed Jan 02 11:38:33 CST 2008                        TRIP: SVX  B2  W8 DVDD3 OverCurrent 
Wed Jan 02 11:38:33 CST 2008                        ERROR in setFibStatus.  PAY ATTENTION, this is a problem.  At least one CAEN power supply failed to respond correctly.  Received 5 errors. 
Wed Jan 02 11:41:04 CST 2008                        Turning b0fib02 to All standby 
Wed Jan 02 11:43:04 CST 2008                        success: Channel0 SVX B2 W6 to STANDBY 
Wed Jan 02 11:43:39 CST 2008                        success: Resetting trips 
Wed Jan 02 11:43:52 CST 2008                        Turning b0fib02 to All on 
</pre> 
 
Most ladders are layers 0 or 1 and all ladders are Fib02. Recovered trips  
<!-- Author: SashaS -->


<!-- Date: Thu Jan 3 06:37:17 2008 -->
<pre>After a very quiet store we are in shot setup again with antiprotons finished loading, hopefully it will be as quiet as the last store</pre>
<!-- Author: Sebastian -->


<!-- Date: Thu Jan 3 06:53:59 2008 -->
<pre>After shot setup the LOSPP is looking too high at 17 kHz and 
climbing, so I am not turning the silicon on until they go down</pre>
<!-- Author: Sebastian -->
<!-- Comment: Thu Jan  3 06;57;53 comment by...Sebastian -->
Main control may re-scrape the beam

<!-- Comment: Thu Jan  3 07;03;38 comment by...Sebastian -->
<pre>They are not going to rescrape, the losses are still relatively high, but without peaks and now falling down, so I will put in the silicon and observe the LOSTP.</pre>

<!-- Comment: Thu Jan  3 07;09;49 comment by...Sebastian -->
<pre>The silicon is ramping up, silicon is still in warning due to relatively high LOSTP, but the losses show no peak and are slowly falling down now at 14 kHz. In all respects the beam seems stable, so I made the desition to include the silicon even though the LOSTP is a little high</pre>


<!-- Date: Thu Jan 3 07:25:57 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12187&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12187  width='300' align='top'></a></td><td>The new store 5824 is in. Initially the LOSTP was too high and climbing so I waited until the losses stabilized and started going down to put in the silicon. We called the control room and they refused to re-scrape, when I ramped up the silicon the LOSTP was at 14KHz and falling down, now it is at 12 kHz and falling down. The trigger rates seem normal and the data is looking ok, here is the usual (old version) spymon plot. For the radiation doses, the plots can be found in the main CDF elog, since I turned on the silicon the doses have not been too high</td></tr></table>
<!-- Author: Sebastian -->


<!-- Date: Thu Jan 3 09:42:59 2008 -->
<pre>So far the store is going very quietly only one pinky that was succesfully recovered</pre>
<!-- Author: Sebastian -->


<!-- Date: Thu Jan 3 10:48:20 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12188&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12188  width='300' align='top'></a></td><td>Clock glitch during run 255744.</td></tr></table>
<!-- Author: SebastianG -->
<!-- Comment: Thu Jan  3 10;57;32 comment by...s -->
Not coincident with muon trips.

<!-- Comment: Thu Jan  3 12;59;24 comment by...SebastianC -->
What to do in such a situation then?


<!-- Comment: Thu Jan  3 13;05;06 comment by...SebastianC -->
<pre>From the shift elog it reads that the crew recovered nicely fro this, is there anything we are supposed to do?</pre>
<!-- Comment: Thu Jan  3 15;06;05 comment by...s -->
There was another glitch, this time together with a BMU trip. See <a href=
'http://www-cdfonline.fnal.gov/cgi/elog/elog.pl?nb=2008&action=view&page=8&frame=2&anchor=14:41:41.912'>
this</a> entry.<br>

<!-- Comment: Thu Jan  3 15;41;58 comment by...Sebastian -->
<pre>I saved the glitch trace from the logic analyzer and left it running again. People on the control room seem to think this glitch is related to the BMU trip.</pre>
<!-- Date: Thu Jan 3 13:00:30 2008 -->
<pre>The silicon continues to be very well behaved....</pre>
<!-- Author: SebastianC -->





<!-- Date: Thu Jan 3 17:40:03 2008 -->
The followin error was repeatedly appearing in the run control: 
 
Attention !!!. CER_SVXMON_HALT_RECOVER_RUN_ERROR !!!   
 
which was causing an automatic HRR, I restarted the SVXMon  
and this seems to have fixed it. I wonder if it was a memory 
problem
<!-- Author: Sebastian -->


<!-- Date: Thu Jan 3 17:41:28 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12189&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12189  width='300' align='top'></a></td><td>Looks like the SVX air separator level started dropping steadily starting on Sep. 5.</td></tr></table>
<!-- Author: Tom -->
<!-- Comment: Thu Jan  3 17;42;39 comment by...Tom -->
Here is a <a href="http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=369">link to the e-log</a> starting Sep. 4.  


<!-- Comment: Thu Jan  3 22;10;08 comment by...Ulrich -->
Is that drop really more significant than previously? I remember that we had problems after the power outage to get things going again, so the level was unusually high and the initial drop faster. I wonder also when the piping in the alcove was changed (the only change in SVX during the shutdown).
<!-- Date: Thu Jan 3 20:42:51 2008 -->
THere was a new block of yellow in the ISL SVXMON plots, so I instructed the ACE to restart the run, but at that time the solenoid tripped so we waited around for the Solenoid to come back. When it did, there was a problem with the muon systems bu we decided to take some data anyway to verify if the yellow wedges in the ISL had been fixed. They where fixed indeed, but in order to run we got into problems with the TevMon which was stuck. This was solved restarting the ACNet monotor. After veryfying that the yellow block in the ISL was ok, we decided to take some D-mode calibrations
<!-- Author: Sebatian  -->


<!-- Date: Thu Jan 3 20:43:12 2008 -->
<pre>Now taking D-Mode Calibrations</pre>
<!-- Author: Sebastian -->


<!-- Date: Thu Jan 3 20:59:56 2008 -->
D-Mode Calibrations are done, now we are taking data with the silicon again, even though the muons are off. Data is looking ok
<!-- Author: Sebastian  -->



<!-- Date: Fri Jan 4 05:01:23 2008 -->
The control room paged me because the IMON was not updating, after messing around with the RT server for a while, it turned out the problem was that the svxii account was out of quota, for the time being I moved the imon_dev_backup to the spool/svxii area to clear some space, during the day with Sasha we will figure out how to more permanently solve the space situation and if I should move the directory back to the home area, maybee zipped
<!-- Author: Sebastian -->
<!-- Comment: Fri Jan  4 10;53;47 comment by...sasha -->
All the disk space in the svxii home area had been eaten by <i>.xsession-errors</i> file which grew to the size of more than 3.6G. Tail of the file showed a bunch of <i>SIGBUS</i> messages. I did not investigate what application generated these messages. Stopped <b>PSgui</b> and <b>IMON</b> on <i>b0dasvx01</i> and <i>b0dasvx02</i> and restarted X-sessions on both computers. Number of used blocks in the svxii home area dropped to 1885592 block - a way below quota. Re-started <b>PSgui</b> and <b>IMON</b>. Copied back old IMON distributions from the spool area
<!-- Comment: Sat Jan  5 17;22;54 comment by...Jose -->
This has happened several times. It is likely related with IMON but difficult to track...
<!-- Date: Fri Jan 4 07:28:20 2008 -->
<pre>The control room paged me because the PSGUI died, this after the silicon went to standby for beam studies (and the L00 to of as by my instructions), now I am restarting the ps gui and taking care of a few pinkies that appeared at about that time </pre>
<!-- Author: Sebastian -->
<!-- Comment: Fri Jan  4 09;48;21 comment by...SashaS -->
We had problem restarting <b>PSgui</b>. It turned out, that because of previous problems with RTserver, some processes in <i>svxinter</i> crate (ROBINserver, VISIONserver) were in <i>SUSPEND</i> state. We had to reboot <i>svxinter</i> crate. After that <b>PSgui</b> started without problem.



<!-- Date: Fri Jan 4 11:03:12 2008 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12190&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12190' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12191&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12191' width='300'></a></center>
<!-- Author: Tom -->
<!-- Comment: Fri Jan  4 11;05;00 comment by...Tom -->
<pre>These are the SVX levels before and after Sep. 5.  (iFix only allows 99-day plots).  The slope could have started as early as Aug. 28 or 29, but other things were going on then.  An 8-hour power outage on Aug. 29 had SVX warm up from -10C to +10C, which may explain the level excursion on that day.</pre>


<!-- Date: Fri Jan 4 11:09:58 2008 -->
<pre>The dripping I saw yesterday around the DI circuit was probably just the ice balls melting around the uninsulated joints.  I had visited just around 4:00 PM, and the DI electrovalve had just closed, allowing the coolant going through the flowmeter to warm up, allowing iceballs to melt.   The fluid in the bucket still smells a bit of glycol, however.  The valve is now open again, the iceballs are gone (but the exposed pipes are frosting up again), and it wasn't dripping noticeably.</pre>
<!-- Author: Tom -->


<!-- Date: Fri Jan 4 11:52:46 2008 -->
<pre>The solenoid is finally ramping up, it should be fully ramped up in 10 minutes and the Silicon would be turned on at that time. So far we have not taken any data with silicon in this new store</pre>
<!-- Author: Sebatian -->


<!-- Date: Fri Jan 4 12:19:38 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12192&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12193  width='300' align='top'></a></td><td>There was another clock glitch at the start of the data taking, here is the trace</td></tr></table>
<!-- Author: Sebastian -->


<!-- Date: Fri Jan 4 12:30:02 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12194&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12194  width='300' align='top'></a></td><td>The store 5825 has been going for some time, but due to a solenoid trip, we did not take data for about 3 hours. Now we are finally taking data with the silicon in. The losses are low, no current problems with the silicon, trigger rates normal. Here is the usual SpyMon plot (still a little low on statistics), the data is looking ok.</td></tr></table>
<!-- Author: Sebastian -->


<!-- Date: Fri Jan 4 12:51:37 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12195&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12195  width='300' align='top'></a></td><td>The spymon plot now that there are more statistics</td></tr></table>
<!-- Author: Sebastian  -->


<!-- Date: Fri Jan 4 13:48:50 2008 -->
<pre>The iFIX was extremely slow, so we called Steve Hahn and he restarted it, now it is ok</pre>
<!-- Author: Sebastian -->


<!-- Date: Fri Jan 4 13:50:40 2008 -->
<pre>In the morning I  forgot to make an entry about an AutoHockerization of crate 7, after this auto Hockerization it was that it was difficult to recover the L00, we had to turn it back to standby at the moment (before the begining of the store) wedge by wedge and in some cases ladder by ladder</pre>
<!-- Author: Sebastian  -->


<!-- Date: Fri Jan 4 16:47:48 2008 -->
At the end of the day shift the crew was finally able to begin taking data, there was a problem with fib05 failing config, which was solved with a reboot, now we are finally taking good data
<!-- Author: Sebastian -->
<!-- Comment: Fri Jan  4 16;49;25 comment by...Sebastian -->
<pre>Since the solenoid trip was recovered there where various problems (not silicon related), which prevented from taking data until almost 4 pm</pre>


<!-- Date: Fri Jan 4 18:21:41 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12196&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12196  width='300' align='top'></a></td><td>Another clock glitch in association with BMU trip</td></tr></table>
<!-- Author: sasha -->


<!-- Date: Fri Jan 4 21:14:04 2008 -->
There was a L00 B0 Wedge 1 trip probably caused by problems with the fib03, when I arrived also the PS GUI was unresponsive, so I restarted the PS GUI, asked the ace to end the run since I needed to do a coldstart toguether with the ramping up of the L00 wedge1 and, revovered the trip. Now we are back to normal with a new run taking silicon data again
<!-- Author: Sebastian -->


<!-- Date: Sat Jan 5 08:20:05 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12197&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12198  width='300' align='top'></a></td><td>There where a number of pinkies that I was paged about during the night, most of them recovered ok, however there is a AVSS pinky in SB5W5L1 that did not recover after repeated HRR's and  a few coldstarts (after the store had ended). Here is the pinky history</td></tr></table>
<!-- Author: Sebastian -->


<!-- Date: Sat Jan 5 08:26:01 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12199&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12199  width='300' align='top'></a></td><td>Related to the same pinky as the entry above the data looks ok, seems we where getting data from all of the chips. I further tried at the end of the store to power cycle the wedge, but this did not bring the current away from zero. So at the moment I am unable to restore the current, I am setting the ladder to ignore</td></tr></table>
<!-- Author: Sebastian -->
<!-- Comment: Sat Jan  5 10;03;35 comment by...sasha -->
<table border=0><td><tr><td bgcolor=#e0e030>It actually looks like a corrupted readout of current from this particular PS channel AVDD SB5W5L1. Try to hockerize PS crate, it should help.</td></tr></td></table>


<!-- Date: Sat Jan 5 13:20:31 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12200&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12200  width='300' align='top'></a></td><td>After Hockerizing Crate 14 the current is back to normal, thanks Sasha for the suggestion</td></tr></table>
<!-- Author: Sebastian -->


<!-- Date: Sat Jan 5 13:48:32 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12201&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12201  width='300' align='top'></a></td><td>The new store #5827 is in, the losses are relatively low (in comparison with the previous stores), the radiatio doses low, the silicon ramped up ok, trigger rates are normal and the silicon data is looking ok with no new yellow wedges. Here is the ususal spymon plot</td></tr></table>
<!-- Author: Sebastian -->



<!-- Date: Sat Jan 5 18:05:55 2008 -->
<pre>So far we are taking data very quietly, no problem at all. For some reason some of the silicon alarms were being ignored, I did not ignore them myself so I have set them not to be ignored. But so far no issues</pre>
<!-- Author: Sebsatian -->


<!-- Date: Sat Jan 5 20:40:45 2008 -->
<pre>After the prescale change at luminosity 110E30, there was a flurry of BIAS pinkies, I am increasing slightly the limits, for the changes where very small</pre>
<!-- Author: Sebastian -->

<!-- Date: Sat Jan 5 20:46:59 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB2W2L4 
<li>problem n: 672 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: sebastian 
<li>description is: Changed limits<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>100</td><td>110</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B2W2&layer=L4">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sat Jan 5 20:48:05 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB5W9L1 
<li>problem n: 2468 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: sebastian 
<li>description is: Changed limits<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>100</td><td>110</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B5W9&layer=L1">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sat Jan 5 20:49:26 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB5W7L3 
<li>problem n: 2469 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: sebastian 
<li>description is: Changed limits<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>100</td><td>110</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B5W7&layer=L3">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sat Jan 5 20:51:09 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB5W1L0 
<li>problem n: 1891 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed limits after pinkies at prescale change<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>130</td><td>135</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B5W1&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sat Jan 5 20:52:13 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB3W3L1 
<li>problem n: 1865 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed limits after pinkies at prescale change<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>135</td><td>140</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B3W3&layer=L1">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sat Jan 5 20:53:14 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB1W8L2 
<li>problem n: 2047 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed limits after pinkies at prescale change<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>120</td><td>125</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B1W8&layer=L2">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sat Jan 5 20:54:17 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB3W3L0 
<li>problem n: 1852 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed limits after pinkies at prescale change<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>140</td><td>145</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B3W3&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sat Jan 5 20:56:21 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB5W7L2 
<li>problem n: 1704 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed limits after pinkies at prescale change<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>150</td><td>160</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B5W7&layer=L2">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sat Jan 5 20:57:22 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB0W3L3 
<li>problem n: 1514 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed limits after pinkies at prescale change<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>125</td><td>135</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B0W3&layer=L3">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Sun Jan 6 09:08:32 2008 -->
There was a beam abohrt and wew stopped taking data. Coincident with the beam abohrt there was a number oif ladders in wedge 4 of the B5 ISL that had the BIAS drop to 0, I hockerized the crate 15, rebooted fib07 and did a coldstart after recovering the voltage to standby, some of the pinkies went away, some still remained at BIAS in 0.As an experiment I turned ON the ISL B5W4 and saw that the BIAS voltages shot up to normal levels, coming back to 0 when in standby, so I think this is OK, I unmarked the pinkies and we will see how this behaves again when we power up the silicon for the next store.
<!-- Author: Sebastian -->
<!-- Comment: Sun Jan  6 15;37;13 comment by...Sebastian -->
In fact now that we are in a new store, these ladders show their normal BIAS voltages. So we are ok.
<!-- Date: Sun Jan 6 10:57:12 2008 -->
MCR informs that shot setup should start shortly
<!-- Author: Sebastian -->


<!-- Date: Sun Jan 6 14:53:02 2008 -->
After scraping the LOSTP is way too high to include the silicon at about 100 kHz, We called the MCR and they are working on getting it down
<!-- Author: Sebastian -->


<!-- Date: Sun Jan 6 15:02:05 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12202&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12202  width='300' align='top'></a></td><td>Here is a picture of the LOSTP after scraping, too high to include silicon</td></tr></table>
<!-- Author: Sebastian -->


<!-- Date: Sun Jan 6 15:30:11 2008 -->
<pre>MCR re-scraped and now the losses are low at around 5kHz, so I am powering up the silicon for store #5830</pre>
<!-- Author: Sebastian -->



<!-- Date: Sun Jan 6 15:40:00 2008 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12203&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-12203  width='300' align='top'></a></td><td>We are finally taking data in the new store #5830, after MCR re-scrapped. The data is looking ok, as well as the trigger rates. Here is the typical SpyMon plot. No problems so far</td></tr></table>
<!-- Author: Sebastian -->


<!-- Date: Sun Jan 6 19:24:56 2008 -->
<pre>THe Control room paged me about a ISL Trip and then some pinkies, it turned out it was an Auto-Hockerization in Crate 3, and the pinkies where a result of the Hockerization. We are back to Normal now. The crew where also having trouble saving IMON plots because of memory problems, just restarting IMON solved this.</pre>
<!-- Author: Sebastian -->


<!-- Date: Sun Jan 6 21:27:40 2008 -->
There where about 19 BIAS pinkies after the prescale change at luminosity 110E30, in all cases slight increses of voltage over the limit, I am adjusting the limits in all of them, the database entries are to follow
<!-- Author: Sebastian -->

<!-- Date: Sun Jan 6 21:30:34 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB0W0L0 
<li>problem n: 2109 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed limits after pinkies during a pre-scale change<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>110</td><td>120</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B0W0&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:32:38 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB1W0L0 
<li>problem n: 1968 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed limits after pinkies during a pre-scale change<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>125</td><td>135</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B1W0&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:35:09 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB1W8L0 
<li>problem n: 2470 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed limits after pinkies during a pre-scale change<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>100</td><td>110</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B1W8&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:35:09 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB2W0L0 
<li>problem n: 1802 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed limits after pinkies during a pre-scale change<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>160</td><td>170</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B2W0&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:39:17 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB2W2L0 
<li>problem n: 1870 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed limits after pinkies during a pre-scale change<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>140</td><td>150</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B2W2&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:41:22 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB2W6L0 
<li>problem n: 1723 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: Changed IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>175</td><td>185</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B2W6&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:41:22 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB2W9L0 
<li>problem n: 1884 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: hanged IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>160</td><td>170</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B2W9&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:43:26 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB2W7L0 
<li>problem n: 1700 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: hanged IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>200</td><td>210</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B2W7&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:43:26 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB3W7L0 
<li>problem n: 1825 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: hanged IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>150</td><td>160</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B3W7&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:43:26 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB4W0L0 
<li>problem n: 1811 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: hanged IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>150</td><td>160</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B4W0&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:45:30 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB4W3L0 
<li>problem n: 1965 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: hanged IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>125</td><td>135</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B4W3&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:45:30 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB5W2L0 
<li>problem n: 2471 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: hanged IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>100</td><td>110</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B5W2&layer=L0">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:47:34 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB5W2L1 
<li>problem n: 2108 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: hanged IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>110</td><td>120</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B5W2&layer=L1">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:47:34 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB3W7L1 
<li>problem n: 1853 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: hanged IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>140</td><td>150</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B3W7&layer=L1">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:49:39 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB2W3L4 
<li>problem n: 2093 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: hanged IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>120</td><td>130</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B2W3&layer=L4">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:49:39 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB1W8L2 
<li>problem n: 2047 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: changed IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>125</td><td>135</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B1W8&layer=L2">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:51:43 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB1W3L3 
<li>problem n: 2472 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: changed IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>100</td><td>110</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B1W3&layer=L3">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:51:43 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB0W2L2 
<li>problem n: 1966 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: changed IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>125</td><td>135</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B0W2&layer=L2">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:53:47 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB0W0L3 
<li>problem n: 2473 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: changed IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>100</td><td>110</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B0W0&layer=L3">report</a></ul>
<!-- Author: Problem DB -->


<!-- Date: Sun Jan 6 21:54:43 2008 -->
Entered in Silicon database: <ul>
<li>Ladder: SB4W2L4 
<li>problem n: 1873 
<li>Status: fixed
<li>Type: BIAS
<li>Action: IMON_limits
<li>entered by: carron 
<li>description is: changed IMON limits after pre-scale change pinkies<table border=1>
<tr><th>IMON LIMITS</th><th>Old</th><th>New</th></tr>
<tr><td><b>Nominal</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Lower</b></td><td>??</td><td>??</td></tr>
<tr><td><b>Upper</b></td><td>1400</td><td>1500</td></tr></table> 
<li>See <a href="http://b0sili01.fnal.gov/cgi-bin/pdb/DBreport.pl?detsys=SVX&wedge=B4W2&layer=L4">report</a></ul>
<!-- Author: Problem DB -->



<!-- Date: Sun Jan 6 23:35:37 2008 -->
<pre>Monitoring Summary 
 
ADCMon plots were not created until Jan 4, due to an expired Kerberos ticket. Once they were created, I checked runs 255748 through 255816. There were no problems in any of these runs, everything looked good</pre>
<!-- Author: Mark -->


<!-- Date: Mon Jan 7 08:58:04 2008 -->

<p>

<ul>
<li>Week Summary 
<ul> 

<ul>
<li>Monday stated with store 5819, first thing I noticed was that the new spyMon plots do not work anymore, only the old plots. There was a large number of Pinkies, which was to be expected after the long time without running with the silicon 
</ul>
<p>
<ul> 
<li>Tuesday saw a new store in, 5820, there was a problem with a DVDD pinkie in SB0W3L3, looking at the strip data one opf the chips was not returning any data. We just run with the problem and it went away for the next store. In this store we also had a PS trip that was recovered without any problems. Also in this store there was a BIG jump in the bias of ladder SB2W0L4, which is not solved until now. 
</ul>
<p>
<ul> 
<li>Wednesday saw yet another store, 5821, we had initial problems here due to cooling issues, the SVX Air separator got filled in the middle of the store which caused a spike in the cooling temperatures and a LOT of BIAS pinkies, this came back to normal once the cooling temperatures where back to normal. There was also a trip on DVDD OC on several SVX ladders which was recovered rather fast. 
</ul>
<p>
<ul> 
<li>Thursday, and anmother store, 5824, for this store we saw a number of clock glitches. At the end of the store a block oif yellow ladders developed in the SVXMON, and we were starting a new run, when there was a solenoid trip. In the next store we saw that the yellow was gone. We took some D-mode calibrations during the downtime. When the solenoid was recovere we continued taking data 
</ul>
<p> 
<ul>
<li>On Friday, I got paged because the IMON was not updating, it turned out that it was a memory problem with the svxii memory quota all used up, so with Sasha we cleared up some space and things where back to normal. Friday saw another store 5825, with more clock glitches, There was an AutoHockerization of crate 7, and a L00 trip in the B0 wedge, coincidentally with this the PSGUI died, this was all recovered without much trouble. 
</ul>
<p>
<ul> 
<li>On Saturday there was a number of pinkies, but one in particular proved trouble, an AVDD in SB5W5L1 where the current went to zero, eventually the current was restored by Hockerizing crate 14. There was a new store, 5827, that came in, it showed LOSTP low, in contrast with the two previous stores that had relatively high LOSTP, no problems starting the silicon. In this store the prescale change at luminosity of 110E30 produced a lot of pinkies, so I set about in redefining the IMON limits in some of the ladders.  
</ul>
<p>
<ul> 
<li>On Sunday the beam was abhorted, we had a few problems with some ladders with the BIAS droping all the way to zero, but this was recovered later when tunring on the ladders, a hockerization and a coldstart. The MCR took a long time to start shot setup with various problems and when it finally did, the LOSTP was too high, 100kHz, so we asked them to rescrape, which they did and we where able to take data. Agai we had a large number of pinkies at 110E30 and again I redefines some of the IMON limits for the BIAS in those ladders. There was a problem with a block of red appearing in the L00 svxMON plots, but this was solved by re-starting the run. 
</ul>
<p>
<ul> 
<li>Monday, the previous store was dropped and at the moment we are awaiting the new store. No silicon problems so far. 
</ul>
<p>
<ul> 
<li>Ignored ladders: at the begining of my shift there where a number of ignored ladders, now there is only IB2W0L4 BIAS1 remaining ignored, this should be observed to see if it still shows zero bias in the next store.
</ul>
</ul>
</ul>
<!-- Author: Sebastian -->
<!-- Comment: Mon Jan  7 10;36;42 comment by...ronmoore -->
Note that rescraping for high LOSTP is not usually the cure.  It was on Sunday`s shot because one of the collimators did not get as
close to the protons as it should have.  The tunes and pbar emittances play a very big role in the proton lifetime and losses.