<!-- Title: Day shift. Tue Jun 24, 2003 -->
<!-- SciCo: Steve Nahn -->
<!-- DAQAce: Alberto/Gilles -->
<!-- MonAce: Maria/Jason -->
<!-- CO: Dave Pellett -->
<!-- OpManager: Masa Tanaka -->
<!-- Notes: -->
Inherit Store 2718, Run 165200, seems smooth (no experts in the room, anyway...)<BR> 
L = 27.15, Stack =62, Rate = 0 (Booster work). 
Plan after 8 AM meeting


<!-- Date: Tue Jun 24 08:21:45.687 2003 -->
<pre>(MLE) b0cot10:Messenger:8:12:50 AM->Event 716337: Bunchcounters in slot 5 (BC=86) and slot 9 (BC=53) disagree (L2B=2) --- An Auto HRR recovered.</pre>
<!-- Author: Gilles/Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165200' target=_top>165200</a>) -->
<!-- Comment: Tue Jun 24 08;34;28 comment by...Gilles/Alberto -->
<pre>(MLE) b0cot19:Messenger:8:27:08 AM->Event 894705: Bunchcounters in slot 5 (BC=71) and slot 20 (BC=18) disagree (L2B=3) -- </pre>
<!-- Comment: Tue Jun 24 08;35;16 comment by...Gilles/Alberto -->
<pre>b0cot19:Messenger:8:27:56 AM->Event 900958: Bunchcounters in slot 5 (BC=71) and slot 20 (BC=109) disagree (L2B=2)</pre>
<!-- Comment: Tue Jun 24 08;35;48 comment by...Gilles/Alberto -->
b0cot19:Messenger:8:28:38 AM->Event 906809: Bunchcounters in slot 5 (BC=109) and slot 20 (BC=124) disagree (L2B=0)
<!-- Comment: Tue Jun 24 08;47;44 comment by...Gilles/Alberto -->
<pre>b0cot17:Messenger:8:43:35 AM->Event 1088651: Bunchcounters in slot 3 (BC=0) and slot 16 (BC=56) disagree (L2B=2)</pre>
<!-- Comment: Tue Jun 24 08;55;09 comment by...Gilles/Alberto -->
<pre>b0cot19:Messenger:8:49:05 AM->Runtime Error 6, Event 1159208: Timeout on global TDC Done. Crate successfully shepherded</pre>
<!-- Comment: Tue Jun 24 09;18;32 comment by...Gilles/Maria -->
<pre>Stuck Cellid S/B5/W6/L4/C0-6. HRR issued
In the same time we have a deadtime of 99.98 %. Investigating source of hot triggers.</pre>
<!-- Date: Tue Jun 24 08:26:24.667 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6949&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6949' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6950&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6950' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6951&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6951' width='300'></a></center>
<!-- Author: Jason -->
<!-- Comment: Tue Jun 24 08;26;49 comment by...Jason -->
Hourly ACNet plots.





<!-- Date: Tue Jun 24 08:44:35.078 2003 -->
<pre>Busy Timeouts: 
b0eb12.fnal.gov, task tRec_0 
SCPU-P0-E-VrbHeader: Dump of header words for event 1041189 from VRB in slot 10: 
0x0000000c 0x0000000e 0x00000032 0x00000056 0x0000007a 0x0000009e 0x000000c2 0x000000e6</pre>
<!-- Author: Gilles/Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165200' target=_top>165200</a>) -->




<!-- Date: Tue Jun 24 09:21:06.808 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165200">165200</A>
 Terminated at 2003.06.24 09:17:52
<!-- Author: RunControl -->


<!-- Date: Tue Jun 24 09:21:40.805 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165200">165200</A>
TERMINATE: End run for maria to mask a hot tower.
<!-- Author: Gilles/Alberto 2080 -->
<!-- Comment: Tue Jun 24 09;32;10 comment by...maria -->
<pre>Hot tower EM phi=18, eta=17 detector energy always 0 or 1  trigger energy 512 or 513; it looks like a cable problem before the AUX card.

/data1/consumer/results/TrigMon/L1TriggerSummary165200.log


1405842      em[18][17] = 0.  em_et[18][17] = 512.  eta = 17, phi = 18
1405842      sumet_pf 5c sumet_cs 5c sumet_dirac(dcas) 5c sumet_admem 1c

more details and plot
</pre>
<!-- Comment: Tue Jun 24 09;35;15 comment by...maria -->


         <a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6954&button=yes' target='xxx' onclick='jswindow()'><img
                       src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6954' width='300'></a>
<!-- Comment: Tue Jun 24 09;36;38 comment by...maria -->
<a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6955&button=yes' target='xxx' onclick='jswindow()'><img
                       src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6955' width='300'></a>
<!-- Comment: Tue Jun 24 09;40;29 comment by...maria -->
<a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6956&button=yes' target='xxx' onclick='jswindow()'><img
                       src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6956' width='300'></a>
<!-- Comment: Tue Jun 24 09;48;06 comment by...maria -->
<pre>where it is (PLUG b0pcal10-south east):
===================
DiracCrate: LEVEL1_CAL_04 Card: DIRAC_73 Slot: 14 Tower: 5 
DiracCh:10 AdMem:ADMEM_180 CalCrate:PCAL_10 Admem Slot:20 Admem Trigger Output:0</pre>
<!-- Date: Tue Jun 24 09:27:07.613 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-6953&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-6953  width='300' align='top'></td><td>Hot L1 trigger towers cause all the Met and Jet trigger running with xsing rate </a></td></tr></table>
<!-- Author: Maria/Masa -->

<!-- Date: Tue Jun 24 09:27:20.745 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201">165201</A>
 Activated at 2003.06.24 09:24:19
<!-- Author: RunControl -->


<!-- Date: Tue Jun 24 09:27:43.092 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201">165201</A>
ACTIVATE: Start a new physics run.
<!-- Author: Gilles/Alberto 2080 -->







<!-- Date: Tue Jun 24 09:43:03.036 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-6959&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-6959  width='300' align='top'></td><td>j</a></td></tr></table>
<!-- Author: j -->


<!-- Date: Tue Jun 24 09:43:40.728 2003 -->
<h3>PSM for COT_NE3</h3> 
The PSM expert "thinks" he masked off the alarm for the 
12V channel.  We should test it but there is a non-zero probability it didn't work, so we'll wait for when we are not taking data to give it a try (like at the next END->CONFIG).
<!-- Author: SCN -->
<!-- Comment: Tue Jun 24 15;50;01 comment by...SCN -->
Never mind.  He said it is more complicated than this (he needs
to unmask the crate, then he can mask a channel).  Hopefully he
will be able to do this during his evening shift.
<!-- Date: Tue Jun 24 09:44:35.984 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6957&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6957' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6958&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6958' width='300'></a></center>
<!-- Author: Jason -->
<!-- Comment: Tue Jun 24 09;45;26 comment by...Jason -->
Hourly ACNet plots (hit the wrong button so 3 plots are split between two log entries.  Appologies.
<!-- Date: Tue Jun 24 09:45:16.560 2003 -->
<pre>(MLE) b0cot09:Messenger:9:33:43 AM->Event 102124: Bunchcounters in slot 2 (BC=118) and slot 17 (BC=65) disagree (L2B=0).  Shepparded the crate and then issued an auto HRR and recovered.</pre>
<!-- Author: Gilles/Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->
<!-- Comment: Tue Jun 24 10;02;49 comment by...Gilles/Alberto -->
Error (124) >>  (MLE) b0cot19:Messenger:9:57:01 AM->Event 379017: Bunchcounters in slot 5 (BC=53) and slot 11 (BC=127) disagree (L2B=1). -- Auto HRR recovered.
<!-- Comment: Tue Jun 24 10;35;49 comment by...Gilles/Alberto -->
<pre>(MLE) b0cot17:Messenger:10:27:25 AM-&gt;Event 796521: Bunchcounters in slot 3 (BC=121) and slot 18 (BC=74) disagree (L2B=1) --- Auto HRR recovered.
</pre>
<!-- Comment: Tue Jun 24 10;36;38 comment by...Gilles/Alberto -->
<pre>(MLE) b0pcal02:Messenger:10:28:58 AM-&gt;Event 814140: Bunchcounters in slot 14 (BC=53) and slot 17 (BC=80) disagree (L2B=3)----Auto HRR recovered.</pre>
<!-- Comment: Tue Jun 24 11;21;37 comment by...Gilles/Alberto -->
<pre>(MLE) b0cot10:Messenger:11:16:44 AM-&gt;Event 1470797: Bunchcounters in slot 5 (BC=112) and slot 10 (BC=56) disagree (L2B=0). ---An auto HRR recovered.</pre>
<!-- Comment: Tue Jun 24 11;35;00 comment by...Gilles/Alberto -->
<pre>(MLE) b0cot17:Messenger:11:30:12 AM-&gt;Event 1659723: Bunchcounters in slot 3 (BC=65) and slot 15 (BC=127) disagree (L2B=2).  ---Auto HRR recovered.</pre>
<!-- Comment: Tue Jun 24 12;18;15 comment by...Gilles/Alberto -->
<pre>(MLE) b0ccal13:Messenger:12:13:10 PM-&gt;Event 2249660: Bunchcounters in slot 17 (BC=68) and slot 18 (BC=74) disagree (L2B=1). --- Auto HRR recovered.</pre>
<!-- Comment: Tue Jun 24 12;43;14 comment by...Gilles/Alberto -->
<pre>(MLE) b0cot17:Messenger:12:39:04 PM-&gt;Event 2599310: Bunchcounters in slot 3 (BC=9) and slot 15 (BC=27) disagree (L2B=1) 
---Auto HRR recovered.</pre>
<!-- Comment: Tue Jun 24 13;18;20 comment by...Gilles/Alberto -->
<pre>(MLE) b0fcal01:Messenger:1:13:47 PM-&gt;Event 3054577: Bunchcounters in slot 8 (BC=83) and slot 6 (BC=27) disagree (L2B=0) 
An Auto HRR recovered.</pre>
<!-- Comment: Tue Jun 24 14;04;39 comment by...Gilles/Alberto -->
(MLE) b0cot19:Messenger:2:00:03 PM->Event 3645236: Bunchcounters in slot 5 (BC=18) and slot 18 (BC=86) disagree (L2B=1) 
An Auto HRR recovered.
<!-- Comment: Tue Jun 24 14;37;43 comment by...Gilles/Alberto -->
<pre>(MLE) b0ccal14:Messenger:2:32:21 PM-&gt;Event 4042155: Bunchcounters in slot 17 (BC=121) and slot 19 (BC=106) disagree (L2B=3) 
An auto HRR recovered.</pre>
<!-- Comment: Tue Jun 24 15;30;27 comment by...Gilles/Alberto -->
<pre>(MLE) b0cot17:Messenger:3:22:17 PM-&gt;Event 4644611: Bunchcounters in slot 3 (BC=18) and slot 17 (BC=12) disagree (L2B=1)</pre>
<!-- Date: Tue Jun 24 09:52:28.620 2003 -->
<pre>b0l3gate1.fnal.gov:main:9:42:04 AM->Host b0eb12.fnal.gov, task tRec_0 
SCPU-P0-E-TracerEventId: Event 169334, crate 0, channel 5 has either bad Tracer ID or bad markers around Tracer word. 
 Tracer word event ID is 0, should be 6. 
Tracer word = 0x00000000 (I think). 
Channel data = 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 ... 
... 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x05000000 0x00000000 0x00000000 .  This caused an  SCPU_TRACER_EVENT_ID Error in SCPU b0eb12 ( FER crate : NOT_AVAILABLE).  In addition we had a  SCPU_BAD_VRB_BYTE_COUNT Error.  An auto HRR recovered.</pre>
<!-- Author: Gilles/Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->
<!-- Comment: Tue Jun 24 12;55;16 comment by...Gilles/Alberto -->
<pre>(MLE) b0l3gate1.fnal.gov:main:12:47:36 PM-&gt;Host b0eb16.fnal.gov, task tRec_0
SCPU-P0-E-VrbHeader: Dump of header words for event 2710788 from VRB in slot 10:
0x00000000 0x000018e8 0x00340074 0x02ec051c 0x055001a0 0x03fc05c8 0x00000000 0x00000000
44'36" b0l3gate1.fnal.gov:main:12:47:36 PM-&gt;Host b0eb16.fnal.gov, task tRec_0
SCPU-P0-E-TracerEventId: Event 2710789, crate 36, channel 3 has either bad Tracer ID or bad markers around Tracer word.
 Tracer word event ID is 4, should be 5.
Tracer word = 0x54140024 (I think).
Channel data = 0x02e10032 0x02e20032 0x02e30033 0x02e4003a 0x02e6002b 0x02e8002b 0x02ea0031 0x03160032 ...
... 0x000002e0 0x00000000 0x00000000 0x00000000 0xaaaaaaaa 0x55555555 0x54140024 0x80000000.  
This caused an  SCPU_TRACER_EVENT_ID Error inSCPU b0eb16 (forwarded by FER crate PCAL_03).
Auto HRR recovered. </pre>
<!-- Comment: Tue Jun 24 13;35;21 comment by...Gilles/Alberto -->
<pre>b0l3gate1.fnal.gov:main:1:26:17 PM-&gt;Host b0eb12.fnal.gov, task tRec_0
SCPU-P0-E-TracerEventId: Event 3214023, crate 148, channel 3 has either bad Tracer ID or bad markers around Tracer word.
 Tracer word event ID is 7, should be 7.
Tracer word = 0x54170094 (I think).
Channel data = 0x000000f8 0x54170090 0x54433244 0x00000000 0x00000000 0x00000040 0x00000003 0x00000000 ...
... 0x000003d4 0x00000000 0x00276db4 0x00000000 0xaaaaaaaa 0x00054514 0x54170094 0x80000000 
This created an SCPU_TRACER_EVENT_ID Error in SCPU b0eb12 (forwarded by FER crate LEVEL2_CAL_03).  
An auto HRR recovered.</pre>
<!-- Date: Tue Jun 24 10:24:50.656 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6960&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6960' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6961&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6961' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6962&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6962' width='300'></a></center>
<!-- Author: Jason -->
<!-- Comment: Tue Jun 24 10;26;37 comment by...Jason -->
Hourly ACNet plots.  Note spike in C:B0PBSM around 9:30 am.  Silicon expert is aware.




<!-- Date: Tue Jun 24 11:05:50.522 2003 -->
<pre> L2 Decision Timeout.[RXPT]   b0l2de00:Messenger:10:53:57 AM-&gt;SvtMonitor: No data sent from client, event 114554. 
An auto HRR recovered.</pre>
<!-- Author: Gilles/Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->


<!-- Date: Tue Jun 24 11:20:14.453 2003 -->
Noticed two Pink cells in IMon: B1W5L3, B3W1L3.  Unmarked them and they both stayed green.
<!-- Author: Jason :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->
<!-- Comment: Tue Jun 24 11;21;35 comment by...Jason -->
To be clear, both of these IMon cells were in ISL, DVDD.



<!-- Date: Tue Jun 24 11:26:49.868 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6963&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6963' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6964&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6964' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6965&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6965' width='300'></a></center>
<!-- Author: Jason -->
<!-- Comment: Tue Jun 24 11;27;46 comment by...Jason -->
Hourly ACNet plots.


<!-- Date: Tue Jun 24 11:31:00.831 2003 -->
Two more Pink cells in IMon: ISL DVDD B3W1L3, B5W3L4.  After unmarking them, they stayed green.
<!-- Author: Jason :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->



<!-- Date: Tue Jun 24 11:49:24.523 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-6967&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-6968  width='300' align='top'></td><td>Here is the history plot for ISL B3W1L3 DVDD.</a></td></tr></table>
<!-- Author: Jason -->
<!-- Comment: Tue Jun 24 11;51;10 comment by...Jason -->
Three pink cells in IMon: B3W1L3 (again - see history plot above), B1W2L0, B5W5L4.  Unmarked all, and they're staying green.


<!-- Date: Tue Jun 24 11:56:53.004 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-6969&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-6970  width='300' align='top'></td><td>IMon history plot for ISL B5W5L4 DVDD. <BR> This is the second time this cell has turned Pink in the last 15 min.</a></td></tr></table>
<!-- Author: Jason -->
<!-- Comment: Tue Jun 24 12;01;27 comment by...Jason -->
This cell was unmarked, but it turned pink again within 5 min.  I unmarked it for the third time.  According to the latest history plot, the current is dropping back toward the "green" level.  I'll watch it.


<!-- Comment: Tue Jun 24 12;36;40 comment by...Jason -->
ISL B5W5L4 DVDD cell is pink again.  I unmarked it, and it stayed green.  The history plot shows that the current is just oscillating a little around the "yellow" region.
<!-- Date: Tue Jun 24 12:03:17.896 2003 -->
New cdfsoftb0 release, 4.11.0c is build this morning. 
This is NOT decleared 'default', yet.  Default is still 4.11.0a. 
StartMon.sh script is set to run the new version of XMon, but 
all the other monitors are still running exactly the same version 
as what's been running.  Please contact Charles if you find any 
problems with the new XMon behaviour.  XMon has been restarted 
with the new version about 15 min. ago.  It seems to be running 
fine.  It has some improvements; 1) non monitored triggers are 
indicated by 'grey'. 2) another line is added to indidated 'how 
off' from the nominal values.
<!-- Author: kaori :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->


<!-- Date: Tue Jun 24 12:03:30.583 2003 -->
<pre>b0dap57.fnal.gov:resmgr.ReplyMonitor 7:11:55:19 AM-&gt; Dead Time is High [MLE] 
52'24" L2 Decision Timeout.[RXPT].  After the auto HRR recovered the deadtime returned to ~3.4%.</pre>
<!-- Author: Gilles/Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->



<!-- Date: Tue Jun 24 12:23:36.771 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6971&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6971' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6972&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6972' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6973&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6973' width='300'></a></center>
<!-- Author: Jason -->
<!-- Comment: Tue Jun 24 12;23;59 comment by...Jason -->
Hourly ACNet plots.


<!-- Date: Tue Jun 24 12:32:41.392 2003 -->
Global Alarms: L00 is Yellow intermittently.  PT-COTL00E pressure is oscillating around the high warning value of 13.0 psia.  I believe this is a known problem.
<!-- Author: Jason :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->
<!-- Comment: Tue Jun 24 14;05;15 comment by...SCN -->
This is being addressed and should go away in the next week (Vacuum pumps are being reconstituted, I believe)
<!-- Date: Tue Jun 24 13:09:57.461 2003 -->
<pre>bodap56.fnal.gov shows as having a RED disk.  </pre>
<!-- Author: Gilles/Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->



<!-- Date: Tue Jun 24 13:24:55.248 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6974&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6974' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6975&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6975' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6976&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6976' width='300'></a></center>
<!-- Author: Jason -->
<!-- Comment: Tue Jun 24 13;25;24 comment by...Jason -->
Hourly ACNet plots.



<!-- Date: Tue Jun 24 13:52:52.980 2003 -->
Trigger Inhibits from BFLD, SVX, TEV, RACKS, VME; it went away immediately.  We saw nothing on the monitoring side of the control room.
<!-- Author: Jason :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->




<!-- Date: Tue Jun 24 14:07:16.028 2003 -->
Cryo guys would like to work on IFIX node S2, but as the Inhibits use this node, we convince him to wait for a better opportunity.
<!-- Author: SCN -->


<!-- Date: Tue Jun 24 14:09:54.477 2003 -->
<pre>We issued a manual HRR as per request of the SciCo.</pre>
<!-- Author: Gilles/Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->
<!-- Comment: Tue Jun 24 14;25;01 comment by...Gilles/Alberto -->
<pre>This was done to clear yellow cells in svxmon.</pre>


<!-- Date: Tue Jun 24 14:29:40.695 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6977&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6977' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6978&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6978' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6979&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6979' width='300'></a></center>
<!-- Author: Jason -->
<!-- Comment: Tue Jun 24 14;30;08 comment by...Jason -->
Hourly ACNet plots.



<!-- Date: Tue Jun 24 14:57:09.073 2003 -->
<pre>We had three Proc Mon errors for Tomcat in a 5 minute span, but each time the status returned to green.</pre>
<!-- Author: Gilles/Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->



<!-- Date: Tue Jun 24 15:32:28.612 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6980&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6980' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6981&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6981' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-6982&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-6982' width='300'></a></center>
<!-- Author: Jason -->
<!-- Comment: Tue Jun 24 15;33;01 comment by...Jason -->
Hourly ACNet plots.


<!-- Date: Tue Jun 24 15:53:26.719 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201">165201</A>
 Terminated at 2003.06.24 15:49:41
<!-- Author: RunControl -->


<!-- Date: Tue Jun 24 15:53:27.692 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201">165201</A>
TERMINATE: End the run to clean EVB.
<!-- Author: Gilles/Alberto 2080 -->


<!-- Date: Tue Jun 24 15:58:58.494 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165200>
165200</A> 
x28550</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_1_05 [3,298,382]</TD>                                       
<TD ALIGN=CENTER>07:17:38</TD>                                          
<TD ALIGN=CENTER>09:17:52</TD>                                          
<TD ALIGN=CENTER>01:42:19</TD>                                          
<TD ALIGN=RIGHT>     85,289,683</TD>                                    
<TD ALIGN=RIGHT>     1,581,128</TD>                                     
<TD ALIGN=RIGHT>     329,727</TD>                                       
<TD ALIGN=RIGHT>  164.340</TD>                                          
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD><A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201>
165201</A> 
x28551</TD>                                                             
<TD>BEAM</TD>                                                           
<TD>PHYSICS_1_05 [3,298,382]</TD>                                       
<TD ALIGN=CENTER>09:24:19</TD>                                          
<TD ALIGN=CENTER>15:49:41</TD>                                          
<TD ALIGN=CENTER>06:07:59</TD>                                          
<TD ALIGN=RIGHT>    313,273,027</TD>                                    
<TD ALIGN=RIGHT>     4,958,666</TD>                                     
<TD ALIGN=RIGHT>   1,112,356</TD>                                       
<TD ALIGN=RIGHT>  473.202</TD>                                          
<TD ALIGN=CENTER></TD>                                                  
<TD ALIGN=CENTER>1</TD>                                                 
<TD ALIGN=CENTER>1</TD></TR>                                            
                                                                        
<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:01</TD>                                                       
<TD ALIGN=CENTER>07:50:19</TD>                                          
<TD ALIGN=RIGHT>     398,562,710</TD>                                   
<TD ALIGN=RIGHT>      6,539,794</TD>                                    
<TD ALIGN=RIGHT>     1,442,083</TD>                                     
<TD ALIGN=RIGHT>  637.542</TD>                                          
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Jun 24 16:00:33.978 2003 -->
<pre>We received a scanner manager sm_scpu_timeout, but we had to abort because the EVB hung.  Cleaned up EVB and restarted the run.</pre>
<!-- Author: Gilles/Alberto :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->


<!-- Date: Tue Jun 24 16:01:02.467 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-6983&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-6983  width='300' align='top'></td><td>Shift luminosity plots. </a></td></tr></table>
<!-- Author: Jason -->


<!-- Date: Tue Jun 24 16:01:31.451 2003 -->
<font color=red>Shift Summary: </font><h3>Only two bumps in the road...</h3> 
Ongoing:<BR> 
Continuous normal rate of BC mismatches giving DONE timeouts, 
EVB corruption from non-silicon crates giving BUSY timeouts, and 
a few "Global TDC Done" timeouts requiring shepherding <P> 
Incidents: 
<ul> 
<li> Inherit Store and Run, Stack at 60, no Stacking due to Booster work 
<li> B physics triggers somewhat high in Xmon,  experts asked to look at it (deadtime ok-a little high in beginning of run, then falls off) 
<li> <a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/elog.pl?nb=2003&action=view&page=524&frame=2&anchor=09:21:40.805'>Hot EM trigger tower Phi=18, eta=17</a> but  
Maria squashes the problem like a bug.  Tower masked, start new run 
<li> <a 
href=http://www-bd.fnal.gov/cgi-mcr/elog.pl?nb=2003&action=view&page=474&anchor=131005&hilite=13:10:05- 
target=_top> Stacking Resumes </a> but rate is erratic 
<li> 14:00 Cyro wants to restart IFIX node S2, which runs HVAC, WATER, and  
<font color=red>Trigger Inhibits</font>.  We say no. 
<li> Rebooted b0dap56 because it had 3 MB of memory available and no swap... 
<li> At the end of the shift, the EVB suggests it needs cleaning up 
</ul> 
Shift ends with L = 18.5, Stack at 81.0 but stacking still erratic, 
and we need to clean up the EVB. 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   165200, 165201
Delivered Luminosity   633.46  
Acquired Luminosity    568.68  
Efficiency             89.77
   
</td></tr></table></pre>
<!-- Author: SCN -->


<!-- Date: Tue Jun 24 16:02:07.941 2003 -->
<TABLE bgcolor=#cdc9a5> 
<TR><TH>Date</th><th>Time</th><th>BLM</th><th colspan=2>Dose</th></tr> 
<tr><td>2003.06.24</td><td>15:55:14</td><td>W Inner BLM</td><td>494.81</td><td>RADS</td></tr> 
<tr><td>2003.06.24</td><td>15:55:14</td><td>W Outer BLM</td><td>0.00</td><td>RADS</td></tr> 
<tr><td>2003.06.24</td><td>15:55:14</td><td>E Inner BLM</td><td>0.00</td><td>RADS</td></tr> 
<tr><td>2003.06.24</td><td>15:55:14</td><td>E Outer BLM</td><td>403.01</td><td>RADS</td></tr> 
</TABLE> 
<strong>Integrated dosage</strong>
<!-- Author: Jason -->


<!-- Date: Tue Jun 24 16:02:55.439 2003 -->
<TABLE bgcolor=#add8e6> 
<TR><TH>Date</th><th>Time</th><th colspan=3>Quantity</th></tr> 
<tr><td>2003.06.24</td><td>15:56:22</td><td>TEVpr</td><td>6565.27</td><td>1E09</td></tr> 
<tr><td>2003.06.24</td><td>15:56:22</td><td>TEVpb</td><td>2010.21</td><td>1E09</td></tr> 
<tr><td>2003.06.24</td><td>15:57:23</td><td>C:B0ILUM</td><td>18.13</td><td>E30</td></tr> 
<tr><td>2003.06.24</td><td>15:57:23</td><td>C:B0LLUM</td><td>0.00</td><td>E30</td></tr> 
<tr><td>2003.06.24</td><td>15:57:23</td><td>C:B0PLOS</td><td>2217.09</td><td>Hz</td></tr> 
<tr><td>2003.06.24</td><td>15:57:23</td><td>C:B0ALOS</td><td>103.93</td><td>Hz</td></tr> 
</TABLE> 
<strong>Luminosity and losses</strong> 
  
<!-- Author: Jason :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=165201' target=_top>165201</a>) -->