<!-- Title: Owl shift. Fri Apr 25, 2003 -->
<!-- SciCo: hyunsoo kim -->
<!-- DAQAce: Alberto Belloni -->
<!-- MonAce: Jonata Piedra -->
<!-- CO: Igor Gorelov -->
<!-- OpManager: Masa Tanaka -->
<!-- Notes: -->
<pre>gigantic quiet time. 
Si HV is on. 
calibrate COT, torture L2 (yeah!), and take big cosmic ray runs. 
waiting for beams. 
asked CO to come back at 0500h.</pre>

<!-- Date: Fri Apr 25 00:16:39.023 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162052">162052</A>
ACTIVATE: Plug Laser Myron Mode
<!-- Author: Un-ki  -->


<!-- Date: Fri Apr 25 00:18:43.030 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162052">162052</A>
TERMINATE: Plug laser Calibration Myron Mode
<!-- Author: Un-ki  -->


<!-- Date: Fri Apr 25 00:23:03.348 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162053">162053</A>
ACTIVATE: COT Calibration
<!-- Author: Alberto/Jonatan -->


<!-- Date: Fri Apr 25 00:23:22.031 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162053">162053</A>
TERMINATE: COT Calibration
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 00:44:49.306 2003 -->
from MCR e-log-> 
start of Shift Notes: Pbar in standby, F sector access complete, racking in MOS 89, & F23. Establish beam to various machines, shot set up to follow TeV check 
out. - bS
<!-- Author: hyunsoo -->


<!-- Date: Fri Apr 25 00:45:28.965 2003 -->
<br> (RC)   0:35:49 Halt -> HALTED 
<br> Error (9) >>  SCPU-P0-E-VrbReadFailed: Error reading VRB in <br> slot 10 for event 1. 
<br> (RC)   0:36:15 Halt -> HALTED 
<br> Error (31) >>   - Timeout on global TDC Done 
<br> (RC)   0:38:11 Halt -> HALTED 
<br> Error (51) >>   - Timeout on global TDC Done 
<br> (RC)   0:40:20 Halt -> HALTED 
<br> Error (70) >>   - Timeout on global TDC Done
<!-- Author: alberto/jonatan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162054' target=_top>162054</a>) -->
<!-- Comment: Fri Apr 25 00;52;20 comment by...alberto/jonatan -->
<Br>Error (88) >>   - Timeout on global TDC Done
<br>(RC)   0:45:41 Halt -> HALTED
<br>Error (106) >>   - Timeout on global TDC Done
<br>(RC)   0:46:8 Halt -> HALTED
<br>Error (123) >>   - Timeout on global TDC Done
<!-- Date: Fri Apr 25 00:49:38.785 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162054">162054</A>
ACTIVATE: L2 Torture. Just for information

Crate CCAL_01 is missing card ADMEM_06 in slot 16
Crate CMX_00 is missing card TDC_CMX_00 in slot 3
Crate CMX_00 is missing card TDC_CMX_11 in slot 17
Crate MUON_SCINT_00 is missing card TDC_CSX_MT_00 in slot 8
Crate MUON_SCINT_00 is missing card TDC_CSX_MT_03 in slot 11

<!-- Author: Alberto/Jonatan -->
<!-- Comment: Fri Apr 25 01;45;01 comment by...hyunsoo -->
calorimeter FE electronics expert is not aware of any problem with ADMEM06 in CCAL01. it was good during the post access calibration. we are including the card after ongoing L2 TORTURE.
<!-- Date: Fri Apr 25 00:52:18.356 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162054">162054</A>
TERMINATE: After a few attempts to recover crate cmx00, giving done timout, we abort and try a manual reboot
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 01:04:08.628 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162055">162055</A>
TERMINATE: L2 Torture missed again...
<!-- Author: Alberto/Jonatan -->
<!-- Comment: Fri Apr 25 01;06;34 comment by...alberto/jonatan -->
<br>TRIGGER_INHIBITS00 included right now in the Run Configuration.
<br>(Still not in the default configuration)

<!-- Date: Fri Apr 25 01:09:15.962 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162056">162056</A>
ACTIVATE: L2 Torture
<!-- Author: Alberto/Jonatan -->


<!-- Date: Fri Apr 25 01:21:11.784 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162056">162056</A>
TERMINATE: L2 Torture ended at first event. DoneTimeout from CMX00, again.
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 01:22:11.434 2003 -->
DTO from cmx00 as soon as the run started. we had already 
taken slots 3 and 17 out. ACE talking to Eric James.
<!-- Author: hyunsoo -->
<!-- Comment: Fri Apr 25 01;24;45 comment by...hyunsoo -->
i meant the previous shift crew had taken them out.

<!-- Date: Fri Apr 25 01:30:11.266 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162057">162057</A>
ACTIVATE: l2 Torture
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 01:37:36.451 2003 -->
At last we started the L2 Torture run. As instructed by the TDC  
expert, we included in run config the cards which were missing:  
<br>CMX_00 slot 3 
<br>CMX_00 slot 17
<!-- Author: Alberto/Jonatan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162057' target=_top>162057</a>) -->


<!-- Date: Fri Apr 25 01:41:14.639 2003 -->
In the next runs also the other three missing cards will be included: 
<br>MUON_SCINT_00 slot 8 
<br>MUON_SCINT_00 slot 11 
<br>CCAL_01 slot 16 
<br>TDC expert asked to add the two cards in the MUON_SCINT_00 crate. We'll ask for the support of the admem pager in case CCAL 
complains
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 02:02:54.484 2003 -->
When End Run was pushed, we received an error from CLC:<br> 
AM->FER_E_MISC: Warning: restarted clcreceive task!<br> 
6 crates in error: b0l1cl00,b0l1cl01,b0l1cl02,b0l1cl03,c0l1cl04,b0l1cl05 in error [RXPT] 
<br> 
No pop-up windows and no major complaints. Just a red light in RunControlStatus panel (the one next to "Error")
<!-- Author: Alberto/Jonatan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162057' target=_top>162057</a>) -->


<!-- Date: Fri Apr 25 02:06:51.611 2003 -->
CLC and MNP turned on for a cosmic ray run.
<!-- Author: Jonata/hyunsoo -->


<!-- Date: Fri Apr 25 02:08:33.526 2003 -->
when trying to turn TOF on, it complains that magnet is off. magnet is on and COT is on. MonAce went down to investigate..
<!-- Author: hyunsoo -->
<!-- Comment: Fri Apr 25 02;19;24 comment by...hyunsoo -->
heartbeat is missing (dark purple on global alarms page). paged TOF expert and MonAce is talking to the expert on the phone.

<!-- Comment: Fri Apr 25 02;42;49 comment by...hyunsoo -->
Mike Mulhearn is coming in.

<!-- Date: Fri Apr 25 02:46:20.655 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162058">162058</A>
TERMINATE: ended to test 3 nodes in L3
<!-- Author: Alberto/Jonatan -->


<!-- Date: Fri Apr 25 03:05:13.060 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162059">162059</A>
TERMINATE: L3 got stuck during coldstart, after 8,11,20 were put back online. Run aborted
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 03:07:29.602 2003 -->
MCR called. they will be doing dry squeeze soon (est. 0345h). they'll inform us when that happens.
<!-- Author: hyunsoo -->
<!-- Comment: Fri Apr 25 03;08;14 comment by...hyunsoo -->
from MCR e-log->02:59:46-  The Tevatron is on an HEP ramp; the first of six. - marty 

<!-- Comment: Fri Apr 25 03;30;27 comment by...hyunsoo -->
from MCR e-log->-- Fri Apr 25 03:28:07 comment by...bS --  C:BQ7 tripped on "anti-quench" bit at the beginning of the 7th HEP ramp. 

<!-- Comment: Fri Apr 25 03;42;16 comment by...hyunsoo -->
from MCR e-log->03:29:56-  TeV was stopped at the top of the 7th HEP ramp, coming back down to address C:BQ7, currently on the back porch. - bS 

                                                                  
<!-- Date: Fri Apr 25 03:19:34.256 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162060">162060</A>
TERMINATE: end run to put TOF in
<!-- Author: Alberto/Jonatan -->




<!-- Date: Fri Apr 25 03:35:59.278 2003 -->
Mike still working on TOF HV control. decided to take cosmics without TOF for now.
<!-- Author: hyunsoo -->
<!-- Comment: Fri Apr 25 03;50;49 comment by...hyunsoo -->
TOF inhibit is taken out.
<!-- Date: Fri Apr 25 03:36:10.470 2003 -->
<pre>Trying to put 008, 011 , 020 back into Level3.  
Restart Level3 Proxy. Will try a test run. 	 </pre>
<!-- Author: Boris -->

<!-- Date: Fri Apr 25 03:38:10.831 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162061">162061</A>
TERMINATE: again L# got stuck: removing 8,11,20
<!-- Author: Alberto/Jonatan -->




<!-- Date: Fri Apr 25 03:42:31.434 2003 -->
<pre>Nodes 008, 011, 020  did not work from the first try.  
We decided to take them out until the next quiet time.  
 
</pre>
<!-- Author: Boris.  -->

<!-- Date: Fri Apr 25 03:46:43.794 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162062">162062</A>
TERMINATE: Coldstart got stuck
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 03:49:23.435 2003 -->
<pre>svx08 could not pass the Coldstart.  
Repartition again. 		</pre>
<!-- Author: Boris /Alberto -->


<!-- Date: Fri Apr 25 03:53:00.079 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162063">162063</A>
 Activated at 2003.04.25 03:51:15
<!-- Author: RunControl -->



<!-- Date: Fri Apr 25 03:53:37.606 2003 -->
<pre>Level3 is working, I am leaving. </pre>
<!-- Author: Boris. -->

<!-- Date: Fri Apr 25 03:54:40.650 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162063">162063</A>
ACTIVATE: Cosmic run, COSMIC_SILICON_TAPE. TOF trigger inhibit disabled.
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 03:54:41.414 2003 -->
<P>We are having trouble with TOF HV and IFIX.  We will operate in the following mode until the problem is fixed: 
<UL> 
<LI> Monitoring TOF HV upstairs is not working.  
<LI> If you need to turn TOF HV on or off, page the expert. 
<LI> At the end of the run, verify on the TOF HV PC that the TOF HV is on.  If this is the case, the run is GOOD for TOF. 
</UL>
<!-- Author: mulhearn -->


<!-- Date: Fri Apr 25 04:09:42.293 2003 -->
MCR called on a bad news. C:BQ7 keeps tripping. minumum 90 min. 
<!-- Author: hyunsoo -->


<!-- Date: Fri Apr 25 04:19:40.305 2003 -->
<pre> 
the monitor panels on b0dap53 were not refreshing. we stopped the consumers and restarted, we got the following when ./startDisplay.sh All 0 
 
b0dap51:116:~/consumer_scripts> aklog: can't get afs configuration (afsconf_Open(/usr/vice/etc)) 
aklog: can't get afs configuration (afsconf_Open(/usr/vice/etc)) 
aklog: can't get afs configuration (afsconf_Open(/usr/vice/etc)) 
aklog: can't get afs configuration (afsconf_Open(/usr/vice/etc)) 
aklog: can't get afs configuration (afsconf_Open(/usr/vice/etc)) 
</pre>
<!-- Author: hyunsoo -->
<!-- Comment: Fri Apr 25 04;30;02 comment by...hyunsoo -->
was this due to having xterms open on some of the consumer machines? after closing xterms, consumers started ok.

<!-- Comment: Fri Apr 25 04;34;15 comment by...hyunsoo -->
and could someone update CO instruction webpages with the notes stuck on the CO consoles?


<!-- Date: Fri Apr 25 04:40:38.020 2003 -->
MCR called. TeV on dry squeeze. will come back down after 20 minutes. will inject around 0510h.
<!-- Author: hyunsoo -->
<!-- Comment: Fri Apr 25 04;48;49 comment by...hyunsoo -->
MCR again. more problem on TeV. again, no beams minimum 90 minutes.

<!-- Comment: Fri Apr 25 04;49;50 comment by...hyunsoo -->
from MCR e-log->C:DQ0 aborted the TeV at the beginning of the squeeze.

<!-- Comment: Fri Apr 25 05;04;24 comment by...hyunsoo -->
from MCR e-log-> 04:48:59-  Since DQ0 tripped we've unsqueezed the Tevatron, ramped down to the back porch, and will wait here for PS techs to check out the two
offensive low beta supplies. - marty


<!-- Date: Fri Apr 25 05:11:10.879 2003 -->
<br>53'1" b0dau32.fnal.gov:csl_mon_send:3:53:54 AM->CSL received a "BAD EVENT" in partition 0.[MLW]CT: 4/25/2003, 4:0'14"  
<br>0'14" b0dau32.fnal.gov:csl_mon_send:4:01:06 AM->CSL received a "BAD EVENT" in partition 0.[MLW] 
<br>2'2" b0dau32.fnal.gov:csl_mon_send:4:02:55 AM->CSL received a "BAD EVENT" in partition 0.[MLW] 
<br>5'25" b0dau32.fnal.gov:csl_mon_send:4:06:18 AM->CSL received a "BAD EVENT" in partition 0.[MLW] 
<br>22'2" b0dau32.fnal.gov:csl_mon_send:4:22:55 AM->CSL received a "BAD EVENT" in partition 0.[MLW] 
<br>29'20" b0dau32.fnal.gov:csl_mon_send:4:30:13 AM->CSL received a "BAD EVENT" in partition 0.[MLW] 
<br>32'1" b0dau32.fnal.gov:csl_mon_send:4:32:54 AM->CSL received a "BAD EVENT" in partition 0.[MLW] 
<br>43'52" b0dau32.fnal.gov:csl_mon_send:4:44:44 AM->CSL received a "BAD EVENT" in partition 0.[MLW] 
<br> 
Bunch of errors appeared in ErrorDisplay; no alarms nor pop-up windows
<!-- Author: Alberto/Jonatan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162063' target=_top>162063</a>) -->


<!-- Date: Fri Apr 25 05:13:20.459 2003 -->
<br>SMACS crashed again and I restarted the PC. Then I turned on 
<br>the HV crate by crate, and it has been fine for a while 
<br>until almost all the boards on crate 3 lost HV. So I went 
<br>down again and turned on the HV on this crate. 
<br> 
<br>The PMTs on crate 3 had no HV for a while, and now half of 
<br>them are back (by themselves), half of them still with no HV. 
<br>It can be iFIX problem or/and SMACS problem
<!-- Author: jonatan -->


<!-- Date: Fri Apr 25 05:14:04.198 2003 -->
<a href= 
'/cgi/elog/det-system-elog.pl?nb=tof&action=view&page=12&frame=2&anchor=04:04:11'>details</a> 
<!-- Author: hyunsoo -->
<!-- Comment: Fri Apr 25 05;15;47 comment by...hyunsoo -->
on ToF woes.
<!-- Date: Fri Apr 25 05:15:19.559 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162063">162063</A>
 Terminated at 2003.04.25 05:13:12
<!-- Author: RunControl -->



<!-- Date: Fri Apr 25 05:15:27.776 2003 -->
MCR called. would like to know if they can inject the beams. stop the cosmic runb and power the detector down.
<!-- Author: hyunsoo -->
<!-- Comment: Fri Apr 25 05;17;10 comment by...hyunsoo -->
hmmm, changing plans every so often, eh?
<!-- Date: Fri Apr 25 05:15:36.826 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162063">162063</A>
TERMINATE: COSMIC_SILICON_TAPE
<!-- Author: Alberto/Jonatan -->





<!-- Date: Fri Apr 25 05:28:43.978 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030>Make sure that ADMEM_06, card in slot 3, crate CCAL_01, is used, 
especially when changing run configuration.</td></tr></td></table>
<!-- Author: Alberto/Jonatan -->


<!-- Date: Fri Apr 25 05:30:46.451 2003 -->
Detector in shot setup configuration in anticipation of beam injection.
<!-- Author: hyunsoo -->

<!-- Date: Fri Apr 25 05:35:17.775 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162064">162064</A>
ACTIVATE: AAA_SHOTSETUP testing trigger table Physics_1_04[6,271,365]
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 05:47:12.972 2003 -->
MCR called to say they are "injecting some protons."
<!-- Author: hyunsoo -->
<!-- Comment: Fri Apr 25 06;03;14 comment by...MCR groupie -->
from MCR e-log->05:47:19-  We have managed to successfully inject beam into the Tevatron. We're going to kill it, without ramping, and then let PS techs work on
BQ7. - marty 
<!-- Comment: Fri Apr 25 07;07;53 comment by...hyunsoo -->
from MCR e-log->06:02:06-  PS techs didn't find anything obviously wrong with BQ7 but a suspect module was replaced. We're going to do another dry squeeze and observe
DQ0. Techs are staging to work on that supply now. - marty 
<!-- Date: Fri Apr 25 05:52:34.794 2003 -->
the cursor disappears on scico monitor. ctl-alt-del'ed it. now it seems that it cannot see the network.
<!-- Author: hyunsoo -->
<!-- Comment: Fri Apr 25 05;57;59 comment by...hyunsoo -->
whereas b0dap50 can see it.
<!-- Comment: Fri Apr 25 05;59;11 comment by...hyunsoo -->
ctl-alt-del one more time fixed it.
<!-- Date: Fri Apr 25 05:57:13.016 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162064">162064</A>
TERMINATE: AAA_SHOTSETUP testing trigger table Physics_1_04[6,271,365]
<!-- Author: Alberto/Jonatan -->




<!-- Date: Fri Apr 25 05:58:15.765 2003 -->
53'38" 38 crate/s: b0imu00(80), b0imu01(81), b0cmu01(82), b0cmu00(83), b0cmp00(8 
4), b0musc00(85), b0cmx00(86), b0cmx01(87), b0xtrp00(96), b0xft01(98), b0xft03(1 
00), b0xft05(102), b0clc00(118), b0svt00(120), b0svt01(121), b0svt07(122), b0svt 
02(123), b0svt06(124), b0svt03(125), b0svt05(126), b0svt04(127), b0l1cl00(128),  
b0l1cl01(129), b0l1cl02(130), b0l1cl03(131), b0l1cl04(132), b0l1cl05(133), b0l1g 
l00(134), b0tsi03(138), b0puls00(139), b0l2cl00(144), b0l2cl01(145), b0l2cl02(14 
6), b0l2cl03(147), b0l2cl04(148), b0l2cl05(149), b0l2de00(150), b0htdc00(153),   
in error.[RXPT]  
<!-- Author: Alberto/Jonatan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162064' target=_top>162064</a>) -->
<!-- Comment: Fri Apr 25 06;02;52 comment by...Alberto/Jonatan -->
This list of crates appeared in the ErrorDisplay when the run was ended. No other major complaints, no pop-up windows... just 
a plain list of crates.


<!-- Date: Fri Apr 25 06:07:05.186 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162065">162065</A>
ACTIVATE: A few events with default trigger table 
<!-- Author: Alberto/Jonatan -->


<!-- Date: Fri Apr 25 06:07:52.484 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162065">162065</A>
TERMINATE: A few events with default trigger table
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 06:08:34.713 2003 -->
5'19" 14 crate/s: b0svt00(120), b0svt01(121), b0svt07(122), b0svt02(123), b0svt0 
6(124), b0svt03(125), b0svt05(126), b0svt04(127), b0l2cl00(144), b0l2cl01(145),  
b0l2cl02(146), b0l2cl04(148), b0l2cl05(149), b0l2de00(150),  in error.[RXPT]
<!-- Author: Alberto/Jonatan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162065' target=_top>162065</a>) -->

<!-- Date: Fri Apr 25 06:14:52.510 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162066">162066</A>
ACTIVATE: A few events with the trigger table Physics_1_04[6,271,365]
<!-- Author: Alberto/Jonatan -->


<!-- Date: Fri Apr 25 06:15:44.974 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162066">162066</A>
TERMINATE: A few events with the trigger table Physics_1_04[6,271,365]
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 06:15:59.624 2003 -->
12'39" 6 crate/s: b0l1cl00(128), b0l1cl01(129), b0l1cl02(130), b0l1cl03(131), b0 
l1cl04(132), b0l1cl05(133),  in error.[RXPT]
<!-- Author: Alberto/Jonatan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162066' target=_top>162066</a>) -->

<!-- Date: Fri Apr 25 06:34:44.560 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162067">162067</A>
TERMINATE: Just loaded trigger table Minimum_bias_1[10,267,318] in L3
<!-- Author: Alberto/Jonatan -->


<!-- Date: Fri Apr 25 06:41:22.288 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162068">162068</A>
 Activated at 2003.04.25 06:39:49
<!-- Author: RunControl -->



<!-- Date: Fri Apr 25 06:42:09.896 2003 -->
We started loading L3exe's in the L3 farm. No problems with the trigger tables Physics_1_04[6,271,360] (standard TT) and Physics_1_04[6,271,365], with run config AAA_SHOTSETUP. We needed 
to use run config AAA_MINBIAS in order to have the trigger table 
Minimum_bias_1[10,267,318] available. Besides, we loaded the files corresponding to Cosmic[9,257,318], run config ACE_COSMICS_ALL, while instructed to use Cosmic[8,200,327], no longer available.
<!-- Author: Alberto/Jonatan -->

<!-- Date: Fri Apr 25 06:43:15.494 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162068">162068</A>
ACTIVATE: A few events with Cosmic[19,257,318]
<!-- Author: Alberto/Jonatan -->


<!-- Date: Fri Apr 25 06:43:16.332 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162068">162068</A>
 Terminated at 2003.04.25 06:41:25
<!-- Author: RunControl -->


<!-- Date: Fri Apr 25 06:43:17.542 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162068">162068</A>
TERMINATE: A few events with Cosmic[19,257,318]
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 06:44:25.824 2003 -->
40'34" 6 crate/s: b0l1cl00(128), b0l1cl01(129), b0l1cl02(130), b0l1cl03(131), b0 
l1cl04(132), b0l1cl05(133),  in error.[RXPT]
<!-- Author: Alberto/Jonatan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162068' target=_top>162068</a>) -->


<!-- Date: Fri Apr 25 06:46:28.092 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-3864&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-3864' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-3865&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-3865' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-3866&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-3866' width='300'></a></center>
<!-- Author: alberto/jonatan -->
<!-- Comment: Fri Apr 25 06;48;23 comment by...jonatan -->
ACNET 6 hours plots

<!-- Date: Fri Apr 25 06:53:38.689 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162069">162069</A>
 Activated at 2003.04.25 06:51:52
<!-- Author: RunControl -->


<!-- Date: Fri Apr 25 06:54:17.873 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162069">162069</A>
ACTIVATE: Cosmics run, with trigger table Cosmic[9,257,318]
<!-- Author: Alberto/Jonatan -->




<!-- Date: Fri Apr 25 07:26:11.913 2003 -->
<br>53'30" b0dau32.fnal.gov:csl_mon_send:6:54:23 AM->CSL received a "BAD EVENT" in partition 0.[MLW] 
<br>56'9" b0dau32.fnal.gov:csl_mon_send:6:57:03 AM->CSL received a "BAD EVENT" in partition 0.[MLW] 
<br>57'15" b0dau32.fnal.gov:csl_mon_send:6:58:09 AM->CSL received a "BAD EVENT" in partition 0.[MLW] 
CT: 4/25/2003, 7:4'19"  
<br>4'19" b0dau32.fnal.gov:csl_mon_send:7:05:12 AM->CSL received a "BAD EVENT" in partition 0.[MLW]  
<!-- Author: Alberto/Jonatan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162069' target=_top>162069</a>) -->
<!-- Comment: Fri Apr 25 07;33;54 comment by...Alberto/Jonatan -->
21'35" b0dau32.fnal.gov:csl_mon_send:7:22:28 AM->CSL received a "BAD EVENT" in partition 0.[MLW]
<br>27'52" b0dau32.fnal.gov:csl_mon_send:7:28:46 AM->CSL received a "BAD EVENT" in partition 0.[MLW]
<!-- Date: Fri Apr 25 07:30:46.789 2003 -->
After ~30mins of cosmic run, 13 processor nodes have experienced severe filter errors: 
<br>CT_TrackingModule-globalCT_HL2: CT_TrackingModule 
<br>is the message that appears when clicking on the nodes which had errors.
<!-- Author: Alberto/Jonatan :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162069' target=_top>162069</a>) -->
<!-- Comment: Fri Apr 25 07;54;16 comment by...Alberto/Jonatan -->
After ~60 mins, 18 processor nodes with severe filter errors.
<!-- Date: Fri Apr 25 07:44:40.109 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030>After selecting the run config, check that in CCAL_01 the board ADMEM_06 is used and that the crate TRIGGER_INHIBITS_00 is included as well. They should be used but it looks like the default configuration does not include them.</td></tr></td></table>
<!-- Author: Alberto/Jonatan -->


<!-- Date: Fri Apr 25 07:57:14.707 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>07:55:01</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->


<!-- Date: Fri Apr 25 07:58:29.067 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162069">162069</A>
 Terminated at 2003.04.25 07:55:49
<!-- Author: RunControl -->


<!-- Date: Fri Apr 25 07:58:30.423 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=162069">162069</A>
TERMINATE: Cosmic run
<!-- Author: Alberto/Jonatan -->



<!-- Date: Fri Apr 25 07:58:47.879 2003 -->
<font color=red>Shift Summary: </font><pre>some problems with crate configuration. 
CLC HV PC not reachable from the control room.  
  - CLC, BSC, RPS, and MNP controlled from CLC HV PC console. 
ToF HV control problems: 
  - unable to control it from the control room. iFix problem? 
  - unresolved: can be turned on and off only by experts.    
  - ToF inhibit needs to be masked off. 
TeV keeps having problems. 
  - C0 shunt not turning on 
  - TRF2 sparking. 
  - C:BQ7 tripped on "anti-quench" bit 
  - C:DQ0 aborted. 
  - managed to put some protons into TeV for test. 
L2 torture test. 
a cosmic ray run with all HV on. 
  - all detector checked out ok. 
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   cosmic runs, torture
Delivered Luminosity   0  
Acquired Luminosity    0  
Efficiency             NA
   
</td></tr></table></pre>
<!-- Author: hyunsoo -->