<!-- Title: 13:32:55  Tue Sep  4 2007 -->
<!-- Crewchief: Ulrich (alphanumeric) -->
<!-- Op1: Ignacio (SPL on call) -->
<!-- Op2: &nbsp; -->
<!-- Op3: &nbsp; -->
<!-- Op4: &nbsp; -->
<!-- Op5: &nbsp; -->
<!-- Op6: &nbsp; -->
<!-- Notes: -->
We are starting the working week after Labor Day with an 8-hour power outage.


<!-- Date: Tue Sep 4 16:15:53 2007 -->
b0dasvx03, b0sili01 and b0sili02 are up. The machines in the control room seems to be on  experimental power, still off.
<!-- Author: Ignacio -->


<!-- Date: Tue Sep 4 16:20:40 2007 -->
<h3>Scheduled Power Outage</h3> 
 
We prepared for the power outage by switching off the dehumidifiers 
with the large knife switches, turning off the water pump below the 
West IMU steel and the water supply and return below the stair well. 
 
<p> The power outage started around 8:28. Both the SVX and ISL backup 
pumps kicked in fine, but iFix thinks the ISL pump is off. The pump is 
running fine, so we just re-established flows. Looking at the breaker 
box, it seems that the pump switched on and off at least once. So we 
switched it on manually. 
 
<p> Dean and KC started to exchange filters on the SVX and ISL 
circuits (without telling us), so we were wondering why the flows 
dropped without any apparent trip. After they opened the bypass lines 
in the alcove, the flows went back to normal. As the ISL flow was 
rather low, I have closed the manual chiller bypass all the way. 
 
<p> Halftime report: as of 13:00, the temperatures in SVX and L00 have 
warmed up to around 4°C (from around -5.5°C). During the power 
outage, Dean and KC have exchanged all micro-particle filters on the 
SVX and ISL cooling circuits. They have also cleaned the strainer in 
the chilled water supply to both chillers. 
 
<p>At around 14:30, the building power came back. We established flows 
without major problems and changed chiller set points to -3°C 
(SVX) and 15°C (ISL). I'll post the actual SVX and L00 temperature 
curves later.  For the final settings we waited the usual 15-20 
minutes until the Diesel generator went offline.  One thing worth 
mentioning was getting the ISL chiller back to normal. We had switched 
the backup pump to "manual", so it stayed on when power came 
back. Before we switched it back, we had enough time to throttle the 
manual bypass and close the e-valves to their nominal 
values. Interestingly enough, the ISL backup pump showed that it was 
running fine. When everything was done, we had to re-tune the manual 
bypass to get enough flow to ISL. Dean and KC found a leak in the ISL 
filter, so they had to take it apart again. 
 
<p>We also put the bore tents back into operation by reverting the 
procedure described above. The dewpoints dropped to below -15°C 
very quickly. The COT baggie flows stay at their high levels.
<!-- Author: Ignacio & Ulrich (with guest appearances from Jose and Jennifer) -->
<!-- Comment: Tue Sep  4 17;30;31 comment by...Ulrich -->
The leak in the housing of the ISL micro-particle filter is fixed. The maintenance work is done except for two missing UV bulbs for the sterilizer (which can be swapped without interference).
<!-- Date: Tue Sep 4 16:51:53 2007 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11800&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11800' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11801&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11801' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11802&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11802' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11803&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11803' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11804&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11804' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11805&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11805' width='300'></a></center>
<!-- Author: Selection of SVX iFix pictures from the power outage --Jennifer :-) -->


<!-- Date: Tue Sep 4 16:55:12 2007 -->
<center><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11806&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11806' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11807&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11807' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11808&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11808' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11809&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11809' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11810&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11810' width='300'></a><a href='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11811&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11811' width='300'></a></center>
<!-- Author: Selection of ISL iFix Pictures from the power outage --Jennifer :-) -->



<!-- Date: Wed Sep 5 09:08:54 2007 -->
Experimental power came back around 8:30. b0sili03, b0dasvx01/2 are up. We had to reset svxinter to be able to ping it.  The CH crates are still off.
<!-- Author: Ignacio/Ricardo -->
<!-- Comment: Wed Sep  5 09;26;59 comment by...Ignacio -->
Restarted the spy scripts on b0dasvx02.


<!-- Comment: Wed Sep  5 15;50;33 comment by...Ignacio -->
CH racks are on. Did a Coldstart.
<!-- Date: Wed Sep 5 14:28:14 2007 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11812&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11813  width='300' align='top'></a></td><td>This morning events while working on APACS.</td></tr></table>
<!-- Author: Ulrich/Ignacio -->


<!-- Date: Wed Sep 5 14:41:36 2007 -->
<h3>The Big APACS Day</h3> 
Today the bulk of the cryo control room maintenance on the APACS system was going on, and all hell broke loose. The first problem was that the SVX chiller compressor stopped working while they pulled out APACS modules. We are not sure what exactly happened, but certainly the chilled water circuit got stuck. Maybe the system got stuck on high head pressure. On the other hand, the corresponding light on the chiller was off, and a reset by hand did not work. Anyway, after a while, the compressor came back fine after a while. 
<p> 
Minutes later we had to evacuate the building on a fake (fire?) alarm. We also had the QuadLog trip the pneumatic valves on the SVX and ISL supply lines, so that we could not get any flow to the detector. Del cleared them inside QuadLog, as there is still no iFix reset button. ISL came back fine, but SVX got stuck in a deadlock: the vacuum pumps were running (both!), but the valves downstream of the pumps were forced close. We first thought that was due to QuadLog as well. It is acutally part of the Siemens PLC logic that these valves close 
when the air separator level gets too high to avoid ruining the pumps with coolant. Without the vacuum pump, the air separator pressure goes up and closes the pneumatic valve for the main chiller loop, so that nothing flows and the air separator level stays high. The way out is to force-open the main chiller valve (press the little red button so that it blows off air) until the level is low enough for the pump valves to open. After that, we "just" had to get all flows back. 
<p> 
As a result of all of this, we now have an air separator level of 26 inches (slightly going down), and the SVX conductivity skyrocketed. Bill Noe and his crew will swap the resin cartridge to get it under control. Note also that both the SVX and the ISL air separators were refilled this morning at our request, so the levels were high to start with.
<!-- Author: Ignacio & Ulrich -->
<!-- Comment: Wed Sep  5 15;04;24 comment by...Ulrich -->
Dean told me he is done with the new resin cartridge.



<!-- Date: Wed Sep 5 17:27:08 2007 -->
 
<h3>Bore Access for Leak Repair: Day 11</h3> 
 
In a meeting earlier today we decided to make today the last day on 
the East side and move to the West side tomorrow morning, regardless 
if we get the East completely tight or not. The main motivation for 
this is that we do not know what to expect on the West side. Here is 
a report for today: 
 
<ul> 
   
  <li><b>16:00</b>: The work on upgrades of the cryo area iFix PCs is 
  done for today (except for CDF S4, which is connected to the 
  solenoid).  Ken and Peter return to the East bore to try and 
  apply a last layer of epoxy on the front return manifold. The 
  Silicon baggie will not be touched today, so the flow from the 
  West tent throught the Silicon baggie is not enabled. 
 
  <li><b>16:40</b>: Ken and Peter need to access the Silicon baggie 
  to get to the supply and return tubes. They enable the flow into 
  the West Silicon baggie and wait 20 minutes for three volume exchanges 
  in the Silicon volume. 
 
  <li><b>17:00</b>: Ken and Peter are done with the epoxy. They 
  applied another layer of epoxy around the corners of the existing 
  layer.  When they pulled a vacuum on the line, they saw a small 
  movement in the epoxy (unfortunately not caught on video). They did 
  not dogbone the epoxy in order not to blow it out of the hole again. 
 
</ul> 
 
The plan for tomorrow is to convene at 8:30 and start moving 
everything except for the pressure test equipment to the West bore. 
The iFix PC work will be done by 9:30, so that the actual work 
can start then. We will first do a visual inspection of the West 
portcard manifold and then continue with a suite of pressure tests.
<!-- Author: The ISL Repair Crew -->


<!-- Date: Wed Sep 5 18:36:28 2007 -->
<h3>PS GUI Problem</h3> 
I got paged by the alphanumeric pager for PS Logging. Apparently, SVXINTER was in a funny state. So I quit the PS GUI and rebooted SVXINTER. After that it could not connect to the RTServer again. I've asked the Aces to restart the RTServer. They are working on it, reading all possible instruction on what to check before they restart the RTServer... Now it up and running again. All those bad memories of MPC weeks come back...
<!-- Author: Ulrich -->
<!-- Comment: Wed Sep  5 18;57;22 comment by...Ignacio & Ulrich -->
I wondered why the aces hadn't reacted and paged Silicon for the incident. Ignacio came in and we found out that the volume on VNODE1 was muted! That's not a good idea given that there may be real alarms going off. We instructed the shift crew to page silicon for any alarm that might go off while nobody is around.


<!-- Date: Thu Sep 6 13:29:22 2007 -->
I started up the afs daemon on b0sili01.  Apparently it had not come on cleanly after the last power outage.
<!-- Author: Mark -->


<!-- Date: Thu Sep 6 18:39:14 2007 -->
Dervin tells me they have reset the formation variable that was tripping our trigger room test-stand straight ahead. Now we can test FIBs again.
<!-- Author: Ignacio -->


<!-- Date: Thu Sep 6 18:41:14 2007 -->
<h3>Bore Access for Leak Repair: Day 12</h3> 
 
<ul> 
   
  <li><b>9:00</b>: This morning was started with a pressure test of 
  the East portcard lines. It seems that result is slightly worse than 
  on Sunday, but due to the different ambient temperatures, it may 
  be difficult to compare the two. We keep the pressure test running 
  while we move all the equipment to the West bore. The plan is to 
  do a first round of inspections of the West cooling lines, finish 
  up the East pressure test and start systematic pressure testing 
  of the West portcard lines. At the same time, we will analyze the 
  videos from the inspection. The final result of the pressure 
  test was a drop from 30 in WC to 20.7 in WC in 7.5 minutes and to 
  12.5 in WC in 15 minutes. So the rate of drop is linear and 
  compatible with the result on Sunday. 
 
  <li><b>10:30</b>: The first video from the West side is from 
  an inspection of the supply. There is a larger and very visible 
  hole between the two tubes and also pittings inside the two front 
  tubes. All of this is in the heat-affected area around the welds. 
 
  <li><b>11:30</b>: We reconvene after the first round of inspections. 
  Apart from the big hole between the front tubes of the West supply 
  manifold there is a list of things that are different compared to 
  the East side: 
 
  <ul> 
 
    <li>The overall appearance of the manifolds is much better than on 
    the East. There are fewer discolorations and pittings around the 
    tubes. The discolorations have a different color as well. They 
    look more reddish-pink than brown. There is also a lot of little 
    reflecting pieces all over, as if the surface was covered in 
    diamond dust. We do not have good explanations for this 
    difference.  One obvious difference between the West and the East 
    is that we stopped flowing water through the East soon after the 
    first drain/flush, while the West has been seen clean water for 
    three month after that. Ken tried to remove some of the material, 
    but lost it somewhere on the way. 
 
    <li>The pressure test did not work well. One reason is that the 
    inner diameter of the manifold seems to be slightly larger than the 
    one on the East, so that the catheter balloon does not seal 
    properly. The change in diameter may still be within tolerance. We 
    will try to order catheters with bigger balloons a.s.a.p.  
 
    <li>The pressure test on both ends of the Cilran tubes was failing 
    as well. The problem was that the pressure dropped faster than we 
    could pressurize the lines to 30 in WC. Maybe we get a meaningful 
    pressure test after we deposited the first layer of epoxy on the 
    big hole. 
 
    <li>The texture of the Cilran tube seems to be different than 
    on the East side. On the East side all tools slid through the 
    Cilran easily. The West tubes (only the return?) seem to be much 
    much softer. We discussed possible reasons for this (external 
    heat source, radiation, flushing dry nitrogen for a longer time) 
    but none of them was really compelling. This may be a problem, as 
 
     
 
    <li>While working with a wire in the tube, Ken managed to puncture 
    the Cilran tube. Doug and Ken do not expect any large problem 
    from that. They will perform pressure tests on part of the 
    Cilran tube to confirm. 
 
    <li>We are getting more and more problems with the CompactFlash 
    cards we are using in the video system. Peter found out from the 
    vendor, that we should only used cards with capacities of 1 GB or 
    less. Maybe we should also avoid formatting them every time we 
    re-use them. Craig Olson was sent to purchase more 1 GB cards, 
    which arrived after lunch. 
     
  </ul> 
 
  <li><b>13:20</b>: Ken and Peter return to the West bore for another 
  inspection. They come back with detailed movies of the supply and return. 
  Apart from the big hole, there are a few other suspicious spots. In 
  the supply side there is a pitting inside the rear right tube, on the left 
  (visible with RAV scope). There is also stuff inside the front left 
  supply tube (the one closest to the big hole) and a massive 
  pink discoloration on the joint between the Cilran tube and the 
  aluminum of the manifold. We have no good idea yet, but found out 
  the pink aluminum usually has a layer of aluminum oxide and chromium 
  oxide. 
 
  <li><b>16:30</b>: The bore crew is done for the day. They measured 
  local temperatures in the supply tube all the way to the 
  manifold. The temperature was around 5&deg;C and dropping. So we 
  really need a heater to get the proper environment to deposit 
  epoxy. Ken layed a little epoxy on the big hole. Then he moved to 
  the return side and deposited epoxy to the outside of all four tubes 
  (i.e. not blocking the inside).  We will leave the nitrogen 
  heater running overnight to have a well tempered environment tomorrow 
  morning. 
 
    <li><b>18:00</b>: We had the problem that we could not read the 
  heater temperature in the West. We tracked it down to a cabling 
  mistake. Not it is running fine, and the alarm is enabled. Another 
  reading of the supply yields around 7.5&deg;C.  So we really seem to 
  have significant ambient cooling to the Cilran tube, maybe from an 
  SVX cooling line that crosses. We decide to warm up ISL to 20&deg;C 
  in order to warm up the environment a little more.  We also realize 
  that there is a problem with the iFix PC CDES3. The machine reboots 
  itself after a while.  S3 is only reading fairly unimportant chiller 
  variables and all the safety systems (including the auto-dialer) are 
  still in place. So we think we can survive the night without it. 
   
 
</ul> 
 
We will resume our work tomorrow morning at 8:30.
<!-- Author: The ISL Repair Crew -->


<!-- Date: Fri Sep 7 10:00:34 2007 -->
JDL found a VTM in the trigger room and was wondering how to test it (at prep?). He put it into the Silicon office with a note.
<!-- Author: Ulrich -->


<!-- Date: Fri Sep 7 12:44:49 2007 -->
PSGui is running in b0dasvx03. As Bill adviced I am using remote_PS, an alias to   
<pre> 
ssh -fX b0dasvx03 /cdf/onln/home/svxii/scriptToRunRemotely.csh 
</pre>  
<!-- Author: Ignacio -->


<!-- Date: Fri Sep 7 16:13:55 2007 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11814&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11815  width='300' align='top'></a></td><td><h3>Lost and Found</h3> 
 
Peter and Ignacio have found the small scope that was AWOL for the last year or so. Guess what, it showed up in the collision hall, as a tool for the WHA phototube work. Interesting... 
 
 
</td></tr></table>
<!-- Author: Ulrich -->


<!-- Date: Fri Sep 7 18:31:45 2007 -->
<h3>Bore Access for Leak Repair: Day 13</h3> 
 
<ul> 
   
  <li><b>9:00</b>: The bore crew for this morning consists of Ken and 
  Peter. During the preparatory work, the SVX nitrogen flow went into 
  alarm. Ignacio twiddled the knob a little, and the alarm went 
  away. The other problem was that we were running blind on tent 
  atmosphere parameters, because CDF S2 was down for the aftermath of 
  the Windows XP upgrade. The plan for this morning is to inspect the 
  work on the return line yesterday and deposit more epoxy on the 
  return.  Then we will turn on the heater again to get into good 
  working conditions for the supply. We have to plug the big crater in 
  the supply before we can lay epoxy on the supply, most probably 
  tomorrow. The SVX coolant conductivity was essentially at the same 
  level as yesterday, so we decided to exchange the resin cartridge 
  rather than hooking up the large resin bed. 
 
  <li><b>10:30</b>: Ken and Peter managed to lay epoxy between the 
  rear return tubes. Due to the fact that the tube makes a sharp bend 
  and is slightly pinched, they did not manage to apply epoxy to the 
  outside of the tubes. They ran into a few difficulties. First they 
  realized that the brass tube had arced against the beam pipe 
  protection. There seems to be an electrical connection 
  somewhere. Peter was able to measure about 12 volts between the 
  steel tube of the nitrogen heater and ground.  He suspects that this 
  is the cause of the stray currents they observe.  Del is looking 
  into grounding the steel tube. 
 
  <li><b>10:50</b>: The COT folks (Aseet, Bob, Morris) have started LV 
  work on the East side. They were not really careful about dew 
  points, so a few things went wrong: First of all the East tent dew 
  point went into alarm when they entered the bore, had the door open 
  too long, and went in with three people. Next the Silicon baggie dew 
  points shot up, all they way to -7&deg;C, i.e. very close to a trip. 
  They had opened the COT baggie at the spot where they wanted to 
  work.  We instructed them to direct the large trunk coming from the 
  dehumidifier straight to the Silicon baggie and open up the COT 
  baggie at that point, so that the dry air is blown behind the 
  baggie. That reduced the dew points to -12&deg;C and below.  They 
  also triggered an ODH alarm in the West tent (lowest oxygen level 
  around 19.5%), so our crew had to leave the bore. Probably they 
  created a pressure gradient that pushed all the nitrogen from the 
  Silicon baggie into the West bore. The Silicon volume seems to 
  be in equilibrium again, all dew ponts are within 4&deg;C. 
 
  <li><b>12:30</b>: In this round we applied epoxy around the rear PCW 
  supply tube.  The COT folks are done for today and leave their 
  equipment in the East bore. It is very unlikely that we will need to 
  work on the East, so that should be no problem. We still have the 
  problem of the supply tube temperature. After running the nitrogen 
  flow overnight, we ended up at a temperature of 9.5&deg;C, 2&deg;C 
  warmer than last night. Our best theory is still that the tube has 
  thermal contact to one of those cold SVX cooling lines. We have 
  several ideas (most of which have been discarded already last week): 
  connect the nitrogen heater at the supply, warm the tube with 
  something from inside, blow dry air into the Silicon baggie from the 
  East, blow dry air into the Silicon baggie from the West, warm up 
  SVX to 0&deg;C during the repair. After the lunch break, Ignacio 
  and Peter will re-install the freshly grounded heater. 
 
 
  <li><b>16:00</b>: Ken deposited a new layer of epoxy on the big 
  crater. We found the problem with the nitrogen heater grounding. We 
  had a floating ground before, which caused the brass tube to arc 
  against the beam pipe shielding. The root cause of all this was that 
  the housing of the Klixon (thermal switch) is electrically hot. We 
  grounded the housing properly, which fixed the problem. We still had 
  the problem of cold Cilran tubing. Last week we learned that the 
  West portcard temperatures went up by a couple of degrees when we 
  switched on the small dry air blower on the West side.  We enabled 
  that blower again, and the porcard temperatures are going up. Next 
  we will try to switch on the heater in addition. 
 
  <li><b>18:00</b>: Our double heating strategy seems to work. 
  Heating with the small blower increases the Cilran tube by 1.5&deg;C, 
  the additional nitrogen heater brings the temperature up by another 
  2&deg;C. The good news is that it took less than one hour to warm up, 
  so we can easily repeat the exercise tomorrow morning. The plan is to 
  coat the front tubes of the PCW supply then. Ken and Peter also had a 
  closer look at the "spongy" section of the Cilran tube. The section 
  is about 3-4 inches long. Ken is thinking about a solution with Peek 
  tubing (used in Run II silicon) inside the Cilran tubing. 
 
</ul> 
 
We will resume our work tomorrow morning at 8:00.
<!-- Author: The ISL Repair Crew -->


<!-- Date: Fri Sep 7 18:31:57 2007 -->
Conductivity 18.8 muSu/cm and pH 4.01. The SVX resin was replaced this morning.  I would say that conductivity has remained stable, maybe start decreasing in the last 24 h.
<!-- Author: Ignacio -->
<!-- Comment: Sat Sep  8 13;30;21 comment by...Ulrich -->
An experiment: what if we are not getting enough flow through the resin bed? Since low flow is not a real concern right now, I've closed SVX MV 2013 W a little such that the pressure drop across the filter is about 4 psid. Let's see if this has any influence on the conductivity. The flow to the detector is still around 40 lpm, and the chiller discharge pressure is around 29 psia.
<!-- Comment: Sat Sep  8 13;32;46 comment by...Ignacio -->
Conductivity this morning 8:00 was 18.0, pH 4.05.
<!-- Comment: Sat Sep  8 14;12;02 comment by...Ignacio -->
Ulrich's trick works! The controller displays a conductivity of 19.3, while before it was above range.
<!-- Comment: Sat Sep  8 16;40;50 comment by...Ulrich -->
Now at 16.6. At the current rate we will be back to normal tomorrow morning. I've also changed the warning/alarm limits on the filter DPT from 3.5/4.0 psid to 4.5/5.0 psid.
<!-- Comment: Mon Sep 10 08;33;07 comment by...Ulrich -->
Out of alarm now: 3.0 &mu;S/cm. That's consistent with the measurement of the sample:
<pre>
KC took an SVX sample this morning. 5.7µS/cm, 4.41pH. - Bill Noe
</pre>
Bill and I discussed this morning if the current setting could be a permanent solution. All pressures seem to be within the ratings of the devices. We will try if we can do a resin exchange under these conditions sometime later this week.
<!-- Date: Sat Sep 8 12:28:57 2007 -->
<h3>Bore Access for Leak Repair: Day 14</h3> 
 
<ul> 
   
  <li><b>8:00</b>: We have left the nitrogen heater on the supply tube 
  instead of the return tube last night. Comparing the PCW temperatures 
  with yesterday morning after a night of heating the return tube, they 
  are about 2&deg;C lower. This could either mean that the gas is 
  cooled more while flowing through the cold supply tube or that heating 
  from that side is somehow less effective for other (unknown) reasons. 
  Our real figure of merit is the temperature inside the Cilran tube. 
  We switch on the small blower in the West to increase the temperature 
  even more. 
 
  <li><b>8:30</b>: The first report from the bore is quite encouraging. 
  Ken and Peter did a pressure test of the line. The rate of drop went 
  from "cannot even apply 30 inches of water column pressure" to 
  30 in WC &rarr; 0 in 95 seconds or 0.32 in WC/second. 
  Compared to the final test in the East of 0.02 in WC/second this is only 
  a factor of 16 worse, and we haven't even coated everything or complete 
  covered the big crater. 
 
  <li><b>9:30</b>: Ken and Peter came back with detailed inspections 
  of the West supply and return manifold. We watched the movies 
  carefully to see how well things are covered. In general the epoxy 
  wetted out rather nicely.  There are several spots on the return 
  that need to be revisited. Ken found it impossible to direct the 
  brass tube to the outside of the front and rear tubes on the 
  left-hand side. A few other spots could need more epoxy. In the 
  supply side all tubes could need another layer of epoxy. The big 
  crates is filled with epoxy, but the epoxy sunk in overnight.  Ken 
  will work on the supply first, especially attacking the messy area 
  between the front supply tubes. In the end he will fill in the 
  last spots on the return. 
   
  <li><b>11:00</b>: Ken managed to coat the outside of the left return 
  tubes this time. He has also layed down more epoxy on the supply, 
  but the environment was too cold to do that efficiently. He pulled a 
  vacuum and inspected the new layer of epoxy. There were a few spots 
  where the epoxy started moving, but nothing big.  We will try 
  another Snoop test to find any remaining leaks.  Unfortunately we 
  cannot do the detailed pressure test with catheters, as we cannot 
  seal the manifold properly.  We decide to wait for two hours before 
  we switch on the nitrogen heater again, in order not to push the 
  fresh epoxy out of the holes. 
   
</ul> 
 
Of course there are also  
<a href="http://b0sili01.fnal.gov/cgi-bin/TWiki/bin/view/Silicon/BoreMoviesShutdown#West_Bore_Ongoing_started_Septem">more movies</a> 
for your viewing pleasure. 
The plan for Monday includes: pressure test, Snoop test to identify 
additional small leaks, warm up SVX to 0&deg;C to better coat supply 
manifold (based on the theory that the supply tube is so cold because 
it crosses SVX cooling lines). If we are lucky, we may be done with 
the West side by Monday night (but we said that before, remember Ken's 
law: there's always one more leak...).
<!-- Author: The ISL Repair Crew -->




<!-- Date: Sat Sep 8 13:54:43 2007 -->
I hockerized crate 3, It had lost communication.
<!-- Author: Ignacio -->




<!-- Date: Sun Sep 9 17:13:12 2007 -->
Got paged alphanumerically and by the shift crew around 14:30 because of a PS_LOGGING alarm. The Aces did the right thing and checked the iFix PC. Everything on there was ok (as far as I can tell), and the alarm went away by itself. There was some other iFix meltdown ongoing, so maybe that was the cause of the problem.
<!-- Author: Ulrich -->
<!-- Comment: Mon Sep 10 07;54;43 comment by...Ulrich -->
Coming in this morning, I see that the PS GUI has been restarted at 14:37, which explains why the PS_LOGGING alarm went away. Nobody told me...


<!-- Date: Mon Sep 10 07:56:09 2007 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11816&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=-11816  width='300' align='top'></a></td><td>SVX coolant conductivity over the weekend. The system reacted almost immediately after we throttled SVX MV 2013 W</td></tr></table>
<!-- Author: Ulrich -->