<!-- Title: Day shift. Tue Sep  9, 2003 -->
<!-- SciCo: Rei Tanaka -->
<!-- DAQAce: Luca Scodellaro -->
<!-- MonAce: - -->
<!-- CO: - -->
<!-- OpManager: Steve Hahn -->
<!-- Notes: -->
<pre>Supervised Access. <br>
<DL><DT><DD><LI> Solenoid up this morning </DL>
<DL><DT><DD><LI> Hope to open East plug later today. </DL>
</pre>

<!-- Date: Tue Sep 9 08:22:41.170 2003 -->
<pre>Crate COT_18 has been changed to TDCReadoutMode=0,  
indicating SPyMode and global done mode. 
</pre>
<!-- Author: W.Badgett -->


<!-- Date: Tue Sep 9 08:26:06.507 2003 -->
<pre>After changing TdcReadoutMode on COT_18, we  
take a baseline run before changing the tracer. 
 
The byte-swapping errors are reproduced for this  
run.</pre>
<!-- Author: W.Badgett, Frank Chlebana :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169110' target=_top>169110</a>) -->
<!-- Comment: Tue Sep  9 08;26;54 comment by...WB, FC -->
<pre>Terri Shaw and Lee have provided a 
specially modified tracer with extra 
buffering on the VME DTACK line;  we will 
now try this tracer in COT_18
</pre>


<!-- Date: Tue Sep 9 08:48:33.671 2003 -->
I observed again the problem with the L2 Torture. L2 expert paged.
<!-- Author: Luca -->
<!-- Comment: Tue Sep  9 08;56;15 comment by...Rei Tanaka -->
Paged L2 general. Expert is coming.


<!-- Date: Tue Sep 9 09:17:52.182 2003 -->
After Tracer in COT_18 was replaced with the  
Terri/Lee specially buffered DTACK version,  
the byte-swap errors for this crate went away. 
 
Tried a couple runs at high rate, using L3, but  
not L1 or L2.   (CalibContinuous) 
  
<!-- Author: W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169115' target=_top>169115</a>) -->

<!-- Date: Tue Sep 9 09:20:00.897 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169116">169116</A>
ACTIVATE: silly tests
<!-- Author: nahn 2080 -->



<!-- Date: Tue Sep 9 09:24:53.513 2003 -->
<pre>Now we're running at a higher rate with all of Level 3 
 in the partition.  The yield is about 388 Hz 
 
No byte-swapping errors during run. 
 
</pre>
<!-- Author: F.Chlebana,W.Badgett :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169117' target=_top>169117</a>) -->


<!-- Date: Tue Sep 9 09:28:16.813 2003 -->
Still PSM alarm at iFIX monitor. Called PSM expert, Dan Ryan (web phone page is out of date). Software is working fine. Will check it again.
<!-- Author: Rei Tanaka -->


<!-- Date: Tue Sep 9 09:29:34.108 2003 -->
<pre>We are able to run with the modified TRACER (with filter on DTACK) 
and with COT18 (Rev E/F TDCs). 
 
Running at a high rate with the calib continuous trigger.</pre>
<!-- Author: Bill and Frank :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169117' target=_top>169117</a>) -->


<!-- Date: Tue Sep 9 09:42:13.698 2003 -->
Cryo tripped off all the South Trigger Room racks working on 
IFIX software.  (Perhaps L2 will work now?)
<!-- Author: SCN -->
<!-- Comment: Tue Sep  9 09;47;09 comment by...SCN -->
Not first time-b0l1cl00,01,05 pulled ERROR immediately (and
RC reported the erroneous "TS failed to Start" and doesn't let me HRR)

<!-- Comment: Tue Sep  9 09;49;30 comment by...SCN -->
Not second time.  "Alpha no longer processing in spot -1", lots of "no ModDone" in the L2 minicom window.

<!-- Comment: Tue Sep  9 09;50;12 comment by...SCN -->
HRR leads to "Alpha not processing in spot 7"


<!-- Comment: Tue Sep  9 11;10;18 comment by...SCN -->
Update-L2 still broken-Gurus Feild and Wright on the case...
<!-- Date: Tue Sep 9 10:08:27.305 2003 -->
CEM, CHA and WHA were gray in the Global Alarm. I restarted 
the PMT HV process in the PisaBox and they returned green.
<!-- Author: Luca -->


<!-- Date: Tue Sep 9 10:10:58.221 2003 -->
Liquid He level is not adequate yet, so putting solenoid on will not happen soon.
<!-- Author: Rei Tanaka -->


<!-- Date: Tue Sep 9 10:40:59.443 2003 -->
<pre>Tried an experimental Tracer from Lee with  
the DTACK filter in a different location.  This did  
not work at all -- done timeouts on first event. 
 
Put back original new Tracer (serial number 104) and  
things returned to working condition. 
 
Lee has taken the experimental Tracer back to the  
highrise for tests. 
 
We will leave tracer 104 in the crate COT_18 and  
leave it running for a while.   Ron and/or Eric  
will install more Ref F TDCs in that crate perhaps  
today. 
 
Tracer serial number 18 (original tracer before  
we started working today) had a bad TDC Calib PECL  
input connector  (leads broken)   Will be sent  
for repairs.  
 
</pre>
<!-- Author: W.Badgett, F.Chlebana, Lee Scott :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169130' target=_top>169130</a>) -->


<!-- Date: Tue Sep 9 11:03:22.426 2003 -->
Paged BLM, they have to be pulled out at East side.
<!-- Author: Rei Tanaka -->

<!-- Date: Tue Sep 9 11:07:26.970 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169131">169131</A>
TERMINATE: end run
<!-- Author: Luca x2080 -->


<!-- Date: Tue Sep 9 11:08:51.300 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169129">169129</A>
TERMINATE: IMU test run
<!-- Author: camille 2080 -->



<!-- Date: Tue Sep 9 11:15:39.220 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169135">169135</A>
ACTIVATE: IMU test run
<!-- Author: camille 2080 -->



<!-- Date: Tue Sep 9 11:39:17.318 2003 -->
Nitrogen adsorber level at 81.4%
<!-- Author: Luca -->


<!-- Date: Tue Sep 9 11:46:03.474 2003 -->
<p>At about 1100 I bypassed the VESDA sensors.  Earlier today 
we had a level 2 latched alarm, apparently associated with  
storing sandbags.  I will restore the sensors around 1700.</p>  
<!-- Author: Steve Hahn -->

<!-- Date: Tue Sep 9 11:50:17.066 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169135">169135</A>
TERMINATE: IMU test run - modified configuration
<!-- Author: camille 2080 -->


<!-- Date: Tue Sep 9 11:55:41.126 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169146">169146</A>
ACTIVATE: IMU test run
<!-- Author: camille 2080 -->



<!-- Date: Tue Sep 9 12:13:15.840 2003 -->
<h1>It's raining in the east plug</h1> 
<p> 
While taking down the BLMs on the east side, Ricardo and I noticed puddles of water on the wooden platform and were getting dripped on.  Near as we could tell, it was condensation from the cooling pipes running underneath the PMT boxes that was collecting and running down cables.  That's just a guess; someone should investigate.</p>
<!-- Author: Andy H., Ricardo E. -->
<!-- Comment: Tue Sep  9 12;14;58 comment by...Andy H. -->
BLM HV off, east and west BLMs disassembled, RadCo pager thrown in a drawer and forgotten about for the next seven weeks.

<!-- Comment: Tue Sep  9 12;18;50 comment by...Rei Tanaka -->
Notified Rob Roser. He will check it.

<!-- Comment: Tue Sep  9 13;02;55 comment by...Rei Tanaka -->
Rob came up, and says it is OK now.
<!-- Date: Tue Sep 9 12:39:18.666 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169155">169155</A>
ACTIVE: Have set ErrorDisable and BusyDisable attributes of the Tracer 
in the EM_Timing_00 crate to false (0).   Now taking a run 
with this crate and the software event builder without problems.
Not sure why ERROR and BUSY were disabled for this crate -- probably 
because of early installation tests.
<!-- Author: W.Badgett -->



<!-- Date: Tue Sep 9 12:40:02.810 2003 -->
Nitrogen adsorber level at 79.6%
<!-- Author: Luca -->

<!-- Date: Tue Sep 9 12:56:04.339 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169151">169151</A>
TERMINATE: COT_18 successfully passes 1 million events 
with the new Tracer (with post-VME-buffer filter)
<!-- Author: Luca x2080 -->




<!-- Date: Tue Sep 9 13:03:42.504 2003 -->
Cryo called us. They will do Fire Alarm test, so just ignore it. 
<!-- Author: Rei Tanaka -->
<!-- Comment: Tue Sep  9 13;44;10 comment by...Rei Tanaka -->
Cryo called us again. They finished the test.
<!-- Date: Tue Sep 9 13:07:31.048 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169161">169161</A>
ACTIVE: Running EM_Timing_00 crate with the hardware event builder 
and ErrorDisable=0 and BusyDisable=0, without any problems.  Will leave 
these settings as such in this crate.
<!-- Author: W.Badgett -->



<!-- Date: Tue Sep 9 13:11:04.180 2003 -->
We have uncabled the roman pots and removed the readout electronics.  Waiting for word from BD as to the removal of the pots/beampipe.
<!-- Author: terashi, convery -->
<!-- Comment: Tue Sep  9 15;21;25 comment by...convery -->
<table border=0><td><tr><td bgcolor=#e0e030>Please don't take roman-pot calibrations until further notice.  The SMXR in fcal00 has been marked offline.</td></tr></td></table>
<!-- Date: Tue Sep 9 13:13:11.182 2003 -->
<pre>Have erased built versions v2_43 through v2_63  
of the fer product.  Of course, all versions are  
retained in the CVS repository. 
 </pre>
<!-- Author: W.Badgett -->


<!-- Date: Tue Sep 9 13:14:27.161 2003 -->
End Plug LV off alarm. Paged ADMEM guy.
<!-- Author: Rei Tanaka -->
<!-- Comment: Tue Sep  9 13;20;51 comment by...m mattson and v tiwari -->
<br>Vivek (the guy who did not get a page because he is in the detector hall) informed the ACE that we are doing work on pcal and ccal crates, so no surprise that we are power cycling.




<!-- Date: Tue Sep 9 13:33:40.094 2003 -->
Arch 07E Power Supply alarm. Karen Byrum is going into the hall to check it.
<!-- Author: Rei Tanaka -->


<!-- Date: Tue Sep 9 13:43:10.094 2003 -->
Nitrogen adsorber level at 79.9%
<!-- Author: Luca -->



<!-- Date: Tue Sep 9 13:50:29.440 2003 -->
L00 became yellow on Global Alarm Monitor. It returned green after few minutes.
<!-- Author: Luca -->
<!-- Comment: Tue Sep  9 15;11;44 comment by...Luca -->
I observed several situations like this. I page the cooling IFIX expert.
<!-- Comment: Tue Sep  9 19;06;36 comment by...Andy H. -->
I never received this page.... will investigate.
<!-- Comment: Tue Sep  9 19;27;07 comment by...Andy H. -->
see
<a href=
'http://www-cdfonline.fnal.gov/cgi/elog/elog.pl?nb=2003&action=view&page=756&frame=2&anchor=19:26:07.282'>
here</a> 

<!-- Date: Tue Sep 9 14:05:43.546 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030><h3>The Trigger Inhibit system is being taken down until further notice</h3></td></tr></td></table>
<!-- Author: Jonathan Lewis -->

<!-- Date: Tue Sep 9 14:25:50.397 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169171">169171</A>
TERMINATE: two src testing contimues ...
<!-- Author: feild -->



<!-- Date: Tue Sep 9 14:35:34.502 2003 -->
Got a PSM (Power Supply Monitoring) alarm for 1st floor 1RR12. Paged electronics infrastructure general.
<!-- Author: Rei Tanaka -->
<!-- Comment: Tue Sep  9 14;49;59 comment by...Rei Tanaka -->
Technician came up. Actually they are turned off. Related to above Trigger Inhibit system down. 
<!-- Date: Tue Sep 9 14:38:09.901 2003 -->
ICICLE heartbeat on the Global Alarm Monitor. I restarted ICICLE 
and it looks fine now.
<!-- Author: Luca -->

<!-- Date: Tue Sep 9 14:42:53.443 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169174">169174</A>
ACTIVATE: QIE Calib
<!-- Author: mattson x2080 -->



<!-- Date: Tue Sep 9 14:47:09.390 2003 -->
Nitrogen adsorber level at 79.7%.
<!-- Author: Luca -->


<!-- Date: Tue Sep 9 15:00:19.582 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169175">169175</A>
ACTIVATE: SMXR calibration
<!-- Author: mattson x2080 -->


<!-- Date: Tue Sep 9 15:00:42.253 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169175">169175</A>
TERMINATE: ccal10, slot 4 not responding
<!-- Author: mattson x2080 -->
<!-- Comment: Tue Sep  9 15;04;05 comment by...m mattson, v tiwari -->
<br>Karen and Mike were passing throught the control room.  They are about to work on ccal10.  I mentioned that we had power cycled pcal11 and ccal07, so they will want to keep an eye on those crates as well.
<!-- Date: Tue Sep 9 15:00:43.282 2003 -->
<b>Cal ADMEM Access Work</b><br> 
We investigated pcal11, slot 20, ch 0, which failed to calibrate.  When we swapped CAFE cards with ch 1, the problem persisted in ch 0.  We swapped in a different ADMEM, which calibrates successfully.  Also investigated ccal07, slot 20, which is stuck in a bizarre state since the power outage yesterday.  The "ready" light was off, and all attempts to get it back failed.  This ADMEM was swapped out.<p> 
Currently taking a Cal QIE Calibration and FRAM download.  This is to handle the two new ADMEMs, and to get physics LERs back into the other pcal crates.  There is still more work to be done downstairs, but this will get the cal ADMEMs in a better state if any cosmic runs are taken tonight.  Also taking a SMXR calib run to make sure all cards came back okay.<p> 
Work done for today, all cal crates returned to ACE.  We would like to have a spike run to see if the L1 cables we disconnected were reconnected properly, but the trigger is being used, and no consumers running.
<!-- Author: m mattson, v tiwari -->




<!-- Date: Tue Sep 9 15:32:42.380 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169183">169183</A>
ACTIVATE: pulsar test
<!-- Author: feild -->
<!-- Comment: Tue Sep  9 15;38;50 comment by...greg and burkard -->
<pre>pulsar fixed by Burkard - there was a register, which is not configured during coldstart, register needed to be configured 
by hand after the racks tripped this morning.
- - - -   - - - - -- - - - - - - - - - - - - - - - 
If pulsar crate trips off - page pulsar people</pre>

<!-- Date: Tue Sep 9 15:39:49.019 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169184">169184</A>
ACTIVATE: two src test
<!-- Author: feild -->



<!-- Date: Tue Sep 9 15:39:49.531 2003 -->
Nitrogen adsorbed level at 80.3% (<85%, OK).
<!-- Author: Luca -->

<!-- Date: Tue Sep 9 15:53:17.822 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=169185">169185</A>
TERMINATE: ending to add calorimeter
<!-- Author: feild -->


<!-- Date: Tue Sep 9 15:55:23.025 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:01</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Sep 9 15:57:16.444 2003 -->
<font color=red>Shift Summary: </font><pre>-------------------------------------------------------------------------- 
- Waiting for liquid He filled to bring solenoidal magnet up.  
- Watch nitrogen level (&lt;85%). If Cryo alarm, call Rob Roser (cell 399-2609). 
- Bypssed VESDA sensors for storing sandbags. Should be restored at 17:00. 
-------------------------------------------------------------------------- 
COT		Debugging crate COT_18 for byte-swapping errors. 
Calorimeter	Worked on ADMEM. Wants Spike run. 
		Arch 07E power supply alarm persists. 
Muon		IMU test is going on. 
Triger		L2 now working. Trigger inhibit system is taken down. 
		Pulser problem was fixed. 
BLM		East/West BLMs disassembled. 
Roman Pots	Uncabled. Waiting removal of pots/beam pipe. 
Consumers	PCs are replaced for RH7. 
..... and many other works. 
--------------------------------------------------------------------------</pre> 
<!-- Author: Rei Tanaka -->


<!-- Date: Tue Sep 9 16:08:48.382 2003 -->
SMX work -   On central Wedge East-phi=7, 5V rabbit supply went to 0V around noon today.  Verified this was indeed a bad rabbit supply and swapped.   Also noticed that around 2pm, on east plug crate=02, the 7.5 rabbit supply wennt to 0V.   Will investigate and fix tomorrow. 
 
In the meantime - pcal11, slot6  will fail calibrations until this is fixed.
<!-- Author: byrum,lindgren -->