<!-- Title: 10:35:16  Mon May 24 2004 -->
<!-- Crewchief: rr -->
<!-- Op1: &nbsp; -->
<!-- Op2: &nbsp; -->
<!-- Op3: &nbsp; -->
<!-- Op4: &nbsp; -->
<!-- Op5: &nbsp; -->
<!-- Op6: &nbsp; -->
<!-- Notes: -->
<pre>Week of May 24th</pre>


<!-- Date: Mon May 24 12:29:16 2004 -->
<pre>Monday Status 
 
Well, the only thing we did not have this weekend was locusts... 
We had fire, we had flood, we had tornado's, we had no ac power 
and we had a VERY LONG weekend 
 
To recap Sunday, we took data quite smoothly.  there were some 
beam loss problems but not bad.  The store was dropped around 
6pm and we went into shot setup.  The current store was GREAT. 
They used about 160ma of pbars and we ended up with the second 
best lum store ever.  68e30.  D0 had a lum 5% lower.  The best  
store ever used 220ma of pbars so big difference.  Losses and 
the abort gap were great.  We got right in and started taking  
data.  With all the hard work of Kirsten, Kevin Pitts, and  
Jonathon, we were only 12% dead at the start of the store! 
 
During the store, we had a bearing seize up in the HVAC system. 
This created fire alarms in our hall and we had the fire dept 
show up.  That system is currently under repair.   It is  
interesting to note that the TeV guys saw the tunes change and 
we see the beam position change in our detector as a result of  
a c hange in the delta Temperature in our collision hall.  We 
are that sensitive! 
 
COT recirculation ran all weekend but with too much tweaking. 
After speaking with the engineers of the pump, we have decided 
to switch from a 60wt gear oil to a Mobil 1 light spindle oil. 
This should allow us to pump it around much easier and then 
hopefully not require us to prime the pump so much.  The system 
will be in single pass for a few hours today as we drain the 
heavy oil and replace it.    
 
We have very few outstanding issues at the moment.  We have 
one access request for L00 electronics repair.  A bunch of  
infrastructure needs attention including HVAC , solenoid  
vacuum, and COT recirculation pump.</pre>
<!-- Author: RR -->


<!-- Date: Tue May 25 20:53:45 2004 -->
<pre>WE finished out Monday's store running reasonably well.  We ended up collecting 2.4pb for the store, a little better than 75% of that delivered.  About half of the 25% we missed was us 
having to be off to deal with abort gap losses and the rest was 
a bunch of small problems. 
 
A new store was put in at 7am.  They shot from a stack of roughly 175ma and got a new record!!!  CDF had an initial lum 
of 72e30!  At the start of the store, we had a dead time of 15%. 
Level 1 accept was about 19khz, level 3 of 80hz.  I forget  
what level 2 was -- I want to say 800hz but don't quote me.  I 
put these down because we did quite well!  The losses were  
quite good and we got right in.   
 
(note:  be impressed with the lum given the parameters they 
shot from.  IT was not a record load of protons and a relatively 
small pbar stack).  This machine has 80e30 in it right now! 
 
Unfortunately, we are NOT having a GREAT store.  We had a problem with the TOF trigger.  It was originally misdiagnosed 
as a DAQ problem.  We then figured it out and masked out the 
monopole trigger.  We did NOT fix the problem, just removed 
it from the run.  This took too long and we lost alot of time. 
We have had to scrape or adjust collimators a few times to  
keep the abort gap under control as well.   
 
CMX west miniskirt has tripped twice -- different wedges but 
both on the west side.  Does not look like beam losses from 
the plots but this is a very stable system so my guess is that 
it is somehow beam related. 
 
The COT hv also tripped twice and cost us some real time.  SL7. 
We took some time to reconfigure the monitoring so that we can 
do a better job trouble shooting this.  This section of SL7  
had tripped once before -- in late december if my memory is any 
good.  Its too early to know whether we have a chronic problem 
or not.  We will monitor the situation.  Right now,  COT is back 
to full HV and the recirculation system is flat at 165 scfh (+ 
40 fresh to get a total of 205 scfh). 
 
Hopefully the last half of the evening and owl shift can rally. 
The store will stay in until tomorrow afternoon.  A few end of 
store studies are planned and then shot setup.</pre>
<!-- Author: RR -->


<!-- Date: Wed May 26 20:59:27 2004 -->
<pre>Status report 
 
COT remains at full HV.  Recirculation system working well 
with steady flow of 200scfh 
 
Finished Tuesday's store taking good data with good efficiency. 
We had smooth running overnight.  At 11:00, the AD did a few 
studies, they wanted to do an alpha bump study to try to fine 
tune the optics at CDF and  D0.  They then looked at the abort 
gap -- trying to measure it with the synch light detector and 
calibrate it to other detectors around the ring. 
 
The next shot went in about two hours ago.  A NEW record. 
CDF had an initial lum of 78e30.  D0 was 15% lower than that. 
We don't understand this substantial difference.  We took data 
with the silicon at the start of the store.  At 75e30, we were 
25% dead.  L1 trigger rate was 18khz, L2 was 410hz, and L3 was 
85hz.   We had to take silicon out while losses were adjusted -- 
that took about 20 min.  We have been running smoothly since. 
 
Nice job to the AD!!!</pre>
<!-- Author: RR -->


<!-- Date: Wed May 26 21:04:31 2004 -->
<table><tr><td><a href=/cgi/elog/det-system-elog.pl?nb=operations&action=view&page=-3&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/det-system-elog.pl?nb=operations&action=view&page=-4  width='300' align='top'></a></td><td>With a large discrepancy in the luminosity at the start 
of this store between CDF and D0, we asked the CLC folks 
to check our lum measurement.  The normal difference is 
10%.  This store was 15%. 
 
Sasha came in and made the following plot....What he has  
plotted is the CLC Luminosity, *10**30 cm**-2 s**-1 (in green), Loose min. bias trigger rate, Hz (blue) and the ratio of Min. bias rate to the luminosity, mkb (yellow). 
 
What this plot tells us is that the Min. bias effective cross-section (yellow curve) for the current store agrees with the two previous stores. For example, we have cross-section = 20000 mkb at L = ~70 * 10**30 cm**-2 s**-1 for the current store and two prev. stores.  
 
So, if we are off, we are off in a consistent fashion and 
there is no smoking gun with this store. 
 
 </td></tr></table>
<!-- Author: RR -->


<!-- Date: Thu May 27 10:46:37 2004 -->
<pre>Black Thursday.... 
 
The record store was kind to us and we were taking data smoothly 
all night with very good efficiency.  At 5:30am, there was 
a power glitch in feeder 45 which tripped off. 
 
This feeder provides power to all of the Tevatron service buildings, this is a particularly bad feeder to be without. We have taken a serious hit to helium inventory and the magnets are likely warming up fast. Recovery will likely be lengthy. 
 
Currently there is power everywhere except A1-A3 houses.   
This means ACNET is still down.  Without ACNET, we don't know  
what kind of dose our silicon got.  We are just now starting 
the checkout procedure.   We are in on access. 
 
We are turning systems on, doing calibrations and checkout. 
Silicon will do its checkout and replace a bad fib and blown L00 
fuses.  Other maintenance can also go on right now. 
 
Further details as we assess the damage -- at the moment, no one 
knows where the beam went when the store was lost.</pre>
<!-- Author: RR -->


<!-- Date: Thu May 27 17:54:40 2004 -->
<pre>Thursday update 
 
CDF completed its checkout and we think we are back to normal. 
We had a long access to address bmu hv, silicon power supply, 
l00 fuses and fib issues.  We worked on roman pot readout as well 
as a cem hv problem.   
 
Silicon completed its checkout without beam and it looks ok.  We 
dont believe the beam was dumped in or around our detector.   
In fact there is some indication that it was a clean abort and 
that all of the quenched magnets were the result of the power 
problem 
 
From Jim Morgans elog 
 
 Tevatron cooldown has progressed well so far. There hasn't been any "show-stoppers" yet. The most optimistic estimate for a high energy permit is noon tomorrow, any number of things could cause delays. We are going to try to resume beam operation to MiniBoone and Pbar within the hour, SY120 will be a few hours more.</pre>
<!-- Author: RR -->


<!-- Date: Fri May 28 11:03:17 2004 -->
<pre>Friday Status 
 
The accelerator crew has done a GREAT job recoving from the  
power glitch in Feeder 45.  The Tevatron is basically cold. 
They need to turn on some more compressors etc.  By noon, they 
hope to be ready to start turning on TeV power supplies.  There 
will be an access into MI today to fix an RF cavity.  The hope 
is that this work will finish about the same time all of the 
TeV power supplies have been checked out. 
 
IF all of this occurrs and no problems are found, then there will be of order a shift or two to check orbits, tunes etc 
and essentially check out the machine and make sure it is ready 
to go.  We already have a nice stack of pbars ready to go. 
 
We could get a shot in as early as late evening or Sat owl shift.  We will just have to see how it goes today. 
 
CDF is ready to go.  We made a brief access today to jumper 
out a BMU HV channel and check out a shower max problem on 
the west plug.  We are done with our work and are essentially 
just exercising the system and waiting. 
 
Will update later when we know more</pre>
<!-- Author: RR -->


<!-- Date: Sat May 29 08:26:40 2004 -->
<pre>Saturday Status 
 
Commissioning of the complex is still going on.  TeV has  
completed its checkout and it is ready for shotsetup.  There 
are currently two power supply issues -- one for a lambertson 
magnet and one for a sextapole magnet.  Earliest this would 
get fixed would be 9:00am.  Then a dry squeeze would follow 
and then shot setup.   
 
CDF is ready to go.  We will use this quiet time right now 
to do QT calibrations AND train the new aces. 
 
We will start the next store without silicon.  We will run 
for 30 minutes or so that way while we assess beam conditions 
and their stability.  IF all looks good, we would then turn 
silicon on and take data with the full detector. 
 
</pre>
<!-- Author: RR -->


<!-- Date: Sun May 30 08:00:27 2004 -->
<pre>Still in a holding pattern 
 
If its not one thing, its another.  Trouble with compressors, 
cryo, power supplies etc.  Lost half the stack (120 from 220) 
when they switched from shot lattice back to stacking.  Currently have a stack of 120ma and no good estimate for beam.   
 
The AD is trying hard and are throwing the resources they have 
available.  They have been unlucky -- but working hard to get 
the complex back up.</pre>
<!-- Author: rr -->


<!-- Date: Mon May 31 04:57:07 2004 -->
<pre>Store went in Sunday -- an adventure but we had data.  MCR had troubles with one of the magnets in the pbar transfer line.  As a result, efficiency was all over them map.  Initial lum was 23e30 or there abouts.  WE started up and took data -- made use 
of the lum to get a few trigger tests in as well. 
 
</pre>
<!-- Author: RR -->


<!-- Date: Mon May 31 05:04:28 2004 -->
<pre>This afternoon I got paged because we could not pump down the WATT can for the solenoid.  This is the location where the non superconducting leads connect with the superconducting ones. 
Recall, we already had problems with this since the power outage 
a week ago Friday. 
 
We determined that valves pv90 and pv91 were not working.  Their 
actuators were moving but it appeared to be disconnected from  
the valve itself.  I won't go into the trouble shooting.  We 
made an access and looked at the three key valves needed to pump the solenoid.  We were right.   
 
Replacing these valves is a pretty big job -- takes probably 4 hours or so.  Its not the job to undertake at 3:30am.  I am not 
even sure where the parts are.   We kludged it for now again. 
We opened a manual valve so we are pumping the watt can 
buffer volume with JUST the fore pump. (no turbo) This at least allows usto  get the watt can down to an acceptable level.  THE FALL OUT OF THIS IS THAT WE CAN NO LONGER PUMP THE WATT CAN WITH THE SOLENONID POWERED.  Therefore, every ~15 hours, we will need to power down and pump down until we can fix these valves.</pre>
<!-- Author: RR -->


<!-- Date: Mon May 31 12:38:40 2004 -->
<pre>Nothing is easy. 
 
When I tried to power the solenoid after the access and checkout, I noticed that the cryo plant was unstable.  We had lost about 10% of the liquid inventory.  Just what I wanted.  The real panic was did we introduce a heat leak that is blowing the liquid away.  It turns out we did not.  What we think we did 
was we disconnected (by accident) the control cable to the pvmf 
valve -- namely the one that governs the amount of flow to the 
solenoid.  This valve looks to fail open. 
 
What we are doing to stabalize the cryo plant is to control the  
flow by controlling the pressure differential between the control dewar and the storage dewar.  WE are now making back the 
liquid we lost.  I don't want to try to power it in such a state.  The feedback on this is slow and would most likely not be able to handle the initial heating during power up. 
 
WE have requested a brief access tomorrow to fix this valve 
so that we can stay the course outlined above.  We are still coming up with a plan to fix the two bad valves. 
 
</pre>
<!-- Author: RR -->


<!-- Date: Mon May 31 22:09:46 2004 -->
<pre>Jim Morgan allowed an evening access for us to fix the solenoid  
flow valve.  The problem was a loss of pneumatic pressure.  Finally an easy problem.  We will be powering up the solenoid 
shortly.   We will come up with a plan to deal with the wavv 
vacuum issues.</pre>
<!-- Author: RR -->