<!-- Title: Day shift. Tue Mar  4, 2003 -->
<!-- SciCo: hyunsoo kim -->
<!-- DAQAce: Chun Lin -->
<!-- MonAce: Chun Lin -->
<!-- CO: Martin Erdmann  -->
<!-- OpManager: Andy Hocker -->
<!-- Notes: -->
<pre>Supervised access continues. Tornado alarm at 1000h. Sending CO home.</pre>


<!-- Date: Tue Mar 4 08:18:19 2003 -->
There was an HVAC alarm. Gone soon after.
<!-- Author: hyunsoo -->


<!-- Date: Tue Mar 4 08:36:19 2003 -->
Gas alarm
<!-- Author: Chun -->
<!-- Comment: Tue Mar  4 08;48;50 comment by...Chun -->
back to normal.
<!-- Date: Tue Mar 4 08:41:38 2003 -->
CMP tripped. Top A4 (Bluebeam), top A5, and North wall A5. 
Top A4 and A5 recovered quickly. But NA5 trips right away when turned on (tried twice). Leaving the section off till off duty expert comes in (on duty expert is this SciCo and cannot leave the shift station).
<!-- Author: hyunsoo -->
<!-- Comment: Tue Mar  4 08;59;45 comment by...hyunsoo -->
Unplugged NA5/D5 and raised HV. They went up ok. Plugged them back to CAEN and turned HV on. They tripped right away. HV on NA5/D5 still off.
<!-- Comment: Tue Mar  4 10;38;35 comment by...hyunsoo -->
Lucio Cerrito, the CMP guy, has been informed.
<!-- Date: Tue Mar 4 08:41:41 2003 -->
icicle is dead. restarted icicle.
<!-- Author: Chun -->


<!-- Date: Tue Mar 4 08:44:27 2003 -->
PSM alarm. EPNW_2 trip.
<!-- Author: Chun -->
<!-- Comment: Tue Mar  4 09;01;34 comment by...hyunsoo -->
Back to green.
<!-- Date: Tue Mar 4 08:44:46 2003 -->
Dervin and crew will replace ASDs on endplug for Run 2b EM Cal timing.
<!-- Author: hyunsoo -->



<!-- Date: Tue Mar 4 08:57:13 2003 -->
West toroid opened yesterday. Both muon walls opened today.
<!-- Author: hyunsoo -->




<!-- Date: Tue Mar 4 09:04:16 2003 -->
Guillelmo is working on L3 ( ~ hour)
<!-- Author: Chun -->


<!-- Date: Tue Mar 4 09:08:53 2003 -->
CLC expert taking clc00 for calibration.
<!-- Author: hyunsoo -->
<!-- Comment: Tue Mar  4 10;43;51 comment by...Chun -->
CLC expert finished his work and asked to leave CLC off.
<!-- Date: Tue Mar 4 09:22:11 2003 -->
PSM alarm on BSU_NE_1. BMU people are working on CCU there.
<!-- Author: hyunsoo -->
<!-- Comment: Tue Mar  4 09;32;30 comment by...hyunsoo -->
cleared
<!-- Date: Tue Mar 4 09:26:04 2003 -->
Deioniser bottle alarm and then cleared. 
<!-- Author: hyunsoo -->


<!-- Date: Tue Mar 4 09:27:28 2003 -->
Morris is putting COT HV on standby for 20-25 min for virus scan.
<!-- Author: hyunsoo -->



<!-- Date: Tue Mar 4 09:32:42 2003 -->
icicle crashed. restarted icicle.
<!-- Author: Chun -->


<!-- Date: Tue Mar 4 09:51:55 2003 -->
Node unreachable alarm for muon scint. BMU people are restarting the muon scint. PC.
<!-- Author: hyunsoo -->


<!-- Date: Tue Mar 4 09:58:57 2003 -->
All nodes on BigBrother are green now. During dau30 reboot this morning, elog is not accessible and some of the nodes are red.
<!-- Author: Chun -->


<!-- Date: Tue Mar 4 10:00:18 2003 -->
We have replaced run 2b EM Cal timing ASD with the new one and we have swapped the the connectors at the PMT box. The connectors were plug in wrong
<!-- Author: Dervin -->


<!-- Date: Tue Mar 4 10:01:43 2003 -->
Tornado alarm!!! had this been real, you wouldn't have seen this message.
<!-- Author: hyunsoo -->


<!-- Date: Tue Mar 4 10:11:14 2003 -->
Rack trip alarm and low level gas alarm. 
E-ALCOVE, SVNET, and SVNEB tripped. Steve Nahn down to the hall to invetsigate. 
Cryo is investigating the low level gas alarm.
<!-- Author: hyunsoo -->
<!-- Comment: Tue Mar  4 10;28;18 comment by...hyunsoo -->
electricians working on the 60Hz power relay rack causing the rack trip alarm.


<!-- Comment: Tue Mar  4 10;33;14 comment by...hyunsoo -->
most of east racks also in red.
<!-- Comment: Tue Mar  4 10;37;58 comment by...SCN -->
This means Silicon NE racks, East FCAL, and most of the East Muons are off for about 90 minutes.
<!-- Comment: Tue Mar  4 11;25;04 comment by...hyunsoo -->
The low level gas alarm is due to the electricians working on the power relay rack. it has nothing to do with the gas system itself.
<!-- Comment: Tue Mar  4 11;55;50 comment by...hyunsoo -->
low level gas warning gone. 
<!-- Comment: Tue Mar  4 13;54;36 comment by...hyunsoo -->
racks are all back.
<!-- Date: Tue Mar 4 10:30:40 2003 -->
<pre>We replaced the north-east CCU-A: CCU01->CCU11. 
There were some dead and noisy channels in half this CCU. 
We checked that the data are ok now.</pre>
<!-- Author: Akram Artikov and Camille Ginsburg -->
<!-- Comment: Tue Mar  4 10;31;11 comment by...Camille -->
This is for TSU.






<!-- Date: Tue Mar 4 10:54:00 2003 -->
expert is working on wcal00 - wcal07
<!-- Author: Chun -->


<!-- Date: Tue Mar 4 10:54:49 2003 -->
David is working on b0fib02.
<!-- Author: Chun -->


<!-- Date: Tue Mar 4 11:17:10 2003 -->
We took the run2b EMTiming ASD what we installed in the morning 
to modify the resistors on the board. As soon as we fix the resistors, we will install it again.     
<!-- Author: Sungwon -->


<!-- Date: Tue Mar 4 11:18:53 2003 -->
<B>Access work report on hadron calorimeter ASD/TDC system:</B> <BR><BR> 
 
We swapped ASD boards in the B0CCAL05 crate. Since last replacement of ASD board in the location (on feb/25/2003), we see longer lifetimes for the dying channels in the region (CHA 15-17W). The board installed on the day in the crate has higher thresholds to test noise effect on dying channels. Now we would like to make sure if the long lifetime caused by higher thresholds or a different board. Today I set higher thresholds with old board which was in the crate before feb/25/2003, and re-installed it. We will monitor the YMON list of dead channels for next 2-3 days.
<!-- Author: Min-Jeong and Kostas -->



<!-- Date: Tue Mar 4 11:58:33 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159727">159727</A>
 Activated at 2003.03.04 11:57:56
<!-- Author: RunControl -->


<!-- Date: Tue Mar 4 12:00:03 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159727">159727</A>
ACTIVATE: cosmic run
<!-- Author: Alberto -->



<!-- Date: Tue Mar 4 12:20:37 2003 -->
solenoid trip. Cryo investigating.
<!-- Author: hyunsoo -->
<!-- Comment: Tue Mar  4 12;26;23 comment by...hyunsoo -->
alarm stopped.
<!-- Date: Tue Mar 4 12:25:40 2003 -->
Jimmy says he smells smoke in the stairwell on the 3rd floor. Ops and Jimmy investigating.
<!-- Author: hyunsoo -->
<!-- Comment: Tue Mar  4 12;37;33 comment by...Andy H. -->
West stairwell definitely gots a funky stank, but couldn't find anything out of the ordinary.
<!-- Date: Tue Mar 4 12:37:26 2003 -->
HVMon++ died at ~1230h. Restarted it and came up nicely.
<!-- Author: hyunsoo -->




<!-- Date: Tue Mar 4 12:48:17 2003 -->
Nikolay will trun central laser on. Also he'll turn WHA off in random.
<!-- Author: hyunsoo -->
<!-- Comment: Tue Mar  4 14;27;30 comment by...hyunsoo -->
He's done. Laser is off and WHA are on.
<!-- Date: Tue Mar 4 13:11:49 2003 -->
CONWT_4, CONWB_1, CMP_T, and CMP_B rack alarm. For CONW*_*, all is at 0. FOr CMP_*, +5V reads 0.
<!-- Author: hyunsoo -->
<!-- Comment: Tue Mar  4 14;07;21 comment by...hyunsoo -->
all green now.
<!-- Date: Tue Mar 4 13:42:58 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159727">159727</A>
 Terminated at 2003.03.04 13:42:41
<!-- Author: RunControl -->


<!-- Date: Tue Mar 4 13:44:11 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159727">159727</A>
TERMINATE: end to check unmasking of error line in b0l2de00
<!-- Author: chun lin -->


<!-- Date: Tue Mar 4 13:51:32 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159728">159728</A>
 Activated at 2003.03.04 13:50:58
<!-- Author: RunControl -->


<!-- Date: Tue Mar 4 13:51:33 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159728">159728</A>
ACTIVATE: cosmics
<!-- Author: chun lin -->



<!-- Date: Tue Mar 4 13:56:44 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159728">159728</A>
 Terminated at 2003.03.04 13:55:55
<!-- Author: RunControl -->


<!-- Date: Tue Mar 4 13:56:45 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159728">159728</A>
TERMINATE: end the run to switch to hard evb
<!-- Author: chun lin -->




<!-- Date: Tue Mar 4 14:09:04 2003 -->
<pre>Run Control crashed with clicking on the Partitioning menu. error: 
 
An unexpected exception has been detected in native code outside the VM. 
Unexpected Signal : 11 occurred at PC=0x55125077 
Function=_XtWindowedAncestor+0x27 
Library=/usr/X11R6/lib/libXt.so.6 
 
Current Java thread: 
        at sun.awt.motif.MToolkit.run(Native Method) 
        at java.lang.Thread.run(Thread.java:536) 
 
</pre>
<!-- Author: Chun -->


<!-- Date: Tue Mar 4 14:13:47 2003 -->
PSM alarm from svx_set_1 and cleared in seconds
<!-- Author: Chun -->

<!-- Date: Tue Mar 4 14:19:29 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159730">159730</A>
ACTIVATE: trigger test run
<!-- Author: feild -->



<!-- Date: Tue Mar 4 14:36:12 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159734">159734</A>
ACTIVATE: Testing error lines on some problematic front end crates
<!-- Author: badgett -->


<!-- Date: Tue Mar 4 14:45:49 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159736">159736</A>
ACTIVATE: <PRE>Following crates have their error lines unmasked (i.e., they CAN assert 
error now):

    COT_18
    FCAL_00
    MUON_TRIGGER_00

Taking a test run with calibContinuous and things seem OK.  Other crates 
still have problems with persistent (and presumably "erroneous") error 
line assertion:

    CCAL_07
    CCAL_11
    PCAL_09
    WCAL_04

ADMEM experts should fix these problems.

The XFT linker crates:

    XFT_00, XFT_02, XFT_04

have been masked this way since many months;  Did not even 
try to test them, since no progress has been made.   XFT 
experts need to fix them.
</PRE>


<!-- Author: badgett -->
<!-- Comment: Thu Mar 13 14;46;30 comment by...Cheng-Ju -->
<pre>We have not seen a glitch in error lines for XFT_00 and
XFT_02 for many months now.  I think we can go ahead
and unmask the error lines for these two crates.</pre>
<!-- Date: Tue Mar 4 14:46:00 2003 -->
HADRON_TIMING crate slot 3 TDC (EM timing) channel IDs map updated after the cable swap fixed this morning.
<!-- Author: slava,dan -->


<!-- Date: Tue Mar 4 14:52:37 2003 -->
PSM alarm from svx_swb_1
<!-- Author: Chun -->
<!-- Comment: Tue Mar  4 14;55;29 comment by...Chun -->
People are working on that crate - according to Steve, who pointed out David Clark was working on it from the camera.


<!-- Date: Tue Mar 4 15:00:59 2003 -->
Donatella T. has cmu00, cmu01, cmx00, and cmx01.
<!-- Author: hyunsoo -->
<!-- Comment: Tue Mar  4 16;21;31 comment by...Donatella T. -->
I released these crates.
<!-- Date: Tue Mar 4 15:06:10 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159739">159739</A>
ACTIVATE: Plug laser normal run
<!-- Author: Chun -->



<!-- Date: Tue Mar 4 15:24:27 2003 -->
PSM alarm: 2RR22F_1.
<!-- Author: hyunsoo -->
<!-- Comment: Tue Mar  4 15;25;53 comment by...hyunsoo -->
Greg F. working on it.

<!-- Date: Tue Mar 4 15:30:07 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159739">159739</A>
TERMINATE: abort the run
<!-- Author: Chun -->


<!-- Date: Tue Mar 4 15:31:08 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159741">159741</A>
ACTIVATE: plug laser normal run
<!-- Author: Chun -->


<!-- Date: Tue Mar 4 15:38:44 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159741">159741</A>
TERMINATE: end normal run
<!-- Author: Chun -->



<!-- Date: Tue Mar 4 15:39:47 2003 -->
Roser says the solenoid probably will be dumped. don't be alarmed.
<!-- Author: hyunsoo -->

<!-- Date: Tue Mar 4 15:40:08 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159742">159742</A>
ACTIVATE: plug laser myron run
<!-- Author: Chun -->


<!-- Date: Tue Mar 4 15:41:24 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159742">159742</A>
TERMINATE: end myron run
<!-- Author: Chun -->



<!-- Date: Tue Mar 4 15:47:01 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030>Note: Plug laser calib run 159741 and 159742 were done with solenoid off.</td></tr></td></table>
<!-- Author: Chun -->

<!-- Date: Tue Mar 4 15:55:24 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:02</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Mar 4 15:56:22 2003 -->
Rupert Crouch and co. came by and fixed the integrated dose alarm button on the RadMon alarm panel.  We no longer need to use a pen to silence it.  He will also be back tomorrow to change the sound of the alarms, so that they don't sound like the cooling alarms. 
Additionally, we will ask him tomorrow to change the logic so that the "Abort Acknowledged" LED does not light up unless the  
permit light connected the CAMAC module is also green,  which happens once we do a "Global Reset".    We learned today that if the "Abort Acknowledged" button is pressed before we do a "Global Reset" we would have to press the button again in order for beam to really be permitted again in the Tevatron.
<!-- Author: Eva H., Ricardo E., Andy H., Paul D. -->


<!-- Date: Tue Mar 4 15:56:43 2003 -->
We have replaced EMTiming ASD board with the new one.
<!-- Author: Sungwon and Slava -->


<!-- Date: Tue Mar 4 15:56:56 2003 -->
We replaced an HV board in CMP stack 75 on the North Wall.  This 
cured the tripping problem in the upper-most HV section of North 
CMP Wall.
<!-- Author: Trevor and Lucio -->
<!-- Comment: Tue Mar  4 15;57;36 comment by...Trevor and Lucio -->
<pre>oops... that's stack 57 on the North Wall.</pre>


<!-- Date: Tue Mar 4 16:04:50 2003 -->
<pre>Level3 is back to work after the farm reboot</pre>
<!-- Author: level3 folks -->
<!-- Comment: Tue Mar  4 17;03;33 comment by...L3 folks -->
For details, see 
<a href=
'/cgi/elog/det-system-elog.pl?nb=l3&action=view&page=9&frame=2&anchor=17:00:45'>
here </a> 
<!-- Date: Tue Mar 4 16:07:47 2003 -->
<font color=red>Shift Summary: </font><pre>- supervised access continues. 
- b0dau30 rebooted. 
- Guillelmo worked on L3. subfarms 01, 02, and 08-12 off. 
- CMP tripped. could not recover one HV section (NA5). left it off. 
- solenoid tripped. Cryo investigating. 
  solenoid is off. 
- rack trip alarms on the Silicon NE racks, East FCAL, and  
  most of the East Muons due to work on a power relay rack. 
- HVMon++ died and came back up ok. 
- Nikolay worked on WHA and central laser. 
- COT off. 
- Plug laser runs taken. 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   
Delivered Luminosity   0  
Acquired Luminosity    0  
Efficiency             0-100
   
</td></tr></table></pre>
<!-- Author: hyunsoo -->

<!-- Date: Tue Mar 4 16:10:52 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159745">159745</A>
ACTIVATE: requested Plug laser (normal-mode) calibration begins 
<!-- Author: Kristian -->


<!-- Date: Tue Mar 4 16:16:50 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=159745">159745</A>
TERMINATE: Plug laser (normal-mode) calibration ends
<!-- Author: Kristian -->