<!-- Title: Day shift. Tue Dec  2, 2003 -->
<!-- SciCo: GP Yeh -->
<!-- DAQAce: Dale Stentz -->
<!-- MonAce: Taka Maruyama -->
<!-- CO: Alexander Sukhanov -->
<!-- OpManager: JJ Schmidt -->
<!-- Notes: -->
<pre>Stack at 23, stacking rate 7.5 
quenched at 5:15 AM during Shot Setup</pre>


<!-- Date: Tue Dec 2 08:10:26.434 2003 -->
<pre>Inheriting active COSMICS_NOSILICON_TAPE run with all HV on except for silicon, CLC, and MNP (which are all off).  Consumer State Manager complains via ProcMon but Kaori may have just been working on this.  Inhibits are automatically masked for silicon (as they should be) and also all the ones for the IMU (4 in total) and also the TRIP:CLC.</pre>
<!-- Author: Dale :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175420' target=_top>175420</a>) -->
<!-- Comment: Tue Dec  2 08;14;32 comment by...Dale -->
<pre>IMU a-ok so got rid of the masked IMU guys.  Since the CLC was not triped techically (just off) we also unmasked him.  The all went to green and our inhibit status is still clear.  [No more masked guys except for silicon.]</pre>

<!-- Date: Tue Dec 2 08:30:18.532 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175420">175420</a>
 Terminated at 2003.12.02 08:29:32
<!-- Author: RunControl -->


<!-- Date: Tue Dec 2 08:30:44.630 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175420">175420</a>
TERMINATE: End th run to remove EMtiming, HADtiming and PCAL crates.
<!-- Author: Dale x2080 -->


<!-- Date: Tue Dec 2 08:36:56.711 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175421">175421</a>
 Activated at 2003.12.02 08:36:17
<!-- Author: RunControl -->


<!-- Date: Tue Dec 2 08:37:33.007 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175421">175421</a>
ACTIVATE: Start the cosmic ray run w/o timing guys and PCAL guys 
<!-- Author: Dale x2080 -->



<!-- Date: Tue Dec 2 08:43:16.092 2003 -->
<table border=0><td><tr><td bgcolor=#e0e030>Kaori said "please igonore red ProcMon mark on CONSUMER STATE MANAGER until further notice". 
So, please neglect it for a while.</td></tr></td></table>
<!-- Author: Kaori and Taka -->


<!-- Date: Tue Dec 2 08:56:39.025 2003 -->
There is "done crate state" for xtrp00 and xft02 sometime.
<!-- Author: Taka -->


<!-- Date: Tue Dec 2 08:59:09.560 2003 -->
BigBrother says that CPU of b0dap57 is in attention state. 
<!-- Author: Taka -->
<!-- Comment: Tue Dec  2 09;03;23 comment by...Dale and Taka -->
He says "LOAD AVG on b0dap57.fnal.gov is 2.18".


<!-- Date: Tue Dec 2 09:07:43.321 2003 -->
HV status in cosmic ray run: 
 
(1) SVX, ISL, L00, CLC and MNP is off. 
(2) All other guys are tuning on. 
 
We still have umbiguous signitures in CSP, BSU and TSU.  
<!-- Author: Taka -->
<!-- Comment: Tue Dec  2 09;30;53 comment by...Phil Schlabach -->
Nothing has changed here. It is clear that those tags aren't being filled on the PC. The problem may not be resolved until the expert returns mid month. There is a suggestion <a href=
'http://www-cdfonline.fnal.gov/cgi/elog/elog.pl?nb=2003&action=view&page=992&frame=2&anchor=18:44:54.975'>here</a> 
 (and links to other comments).
<!-- Comment: Tue Dec  2 14;25;46 comment by...Taka -->
<pre>Thanks for pointing out.
I also make note about this on the HV summary display. </pre>
<!-- Date: Tue Dec 2 09:12:44.642 2003 -->
TOF HV is alarmed. So, trigger inhibit worked.
<!-- Author: Taka -->
<!-- Comment: Tue Dec  2 09;13;54 comment by...Taka -->
But, very soon, this problem went away. now, we have normal situation.


<!-- Date: Tue Dec 2 09:15:04.200 2003 -->
Stack is now 31.18E10, AccRt os 6.60mA/h
<!-- Author: Taka -->

<!-- Date: Tue Dec 2 09:27:14.288 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175421">175421</a>
 Terminated at 2003.12.02 09:26:19
<!-- Author: RunControl -->


<!-- Date: Tue Dec 2 09:30:24.352 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175421">175421</a>
TERMINATE: ending run for Nikolay (caliormeter work - voltages to go off).
<!-- Author: Dale x2080 -->




<!-- Date: Tue Dec 2 09:45:52.035 2003 -->
<pre>Before ending the run I tried to update the Inhibit Interface (we didn't restart it after paritioning).  We got this message with the inhibit set 
 
Trigger Inhibit is set from the components: 
 IFIX:SVX HV  		[128] Silicon Tracker High Voltage from iFix 
 IFIX:ISL HV  		[129] Intermediate Silicon High Voltage from iFix 
 IFIX:L00  		[150] Silicon Layer 00 from iFix 
 
Clearly this was a bit of an error on our part.  We restarted the inhibit interface.  It corrently automatically masked the silicon and the PCAL crates but also the same 4 IMU buttons and the CLC (these can be unmasked or enabled). 
 
However, I try to use the 'ti_enable_current' command which to our limited understanding should unmask all active channels seems to set the inhbit for IFIX:SVX {also ISL & L00}.  We would have thought that active channels are guys you can unmask or enable - (in fact this is most likly true) but the errors seems to continue.  We will try as before by unmasking each guy (the 5 extra channels) one by one.  This should solve the problem.</pre>
<!-- Author: Dale -->

<!-- Date: Tue Dec 2 09:46:09.821 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175430">175430</a>
 Activated at 2003.12.02 09:45:36
<!-- Author: RunControl -->
<!-- Comment: Tue Dec  2 09;55;21 comment by...Dale -->
<pre>Nikolay is done and has restarted the monitoring program extra for the caliormeter.</pre>
<!-- Date: Tue Dec 2 09:54:26.476 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175430">175430</a>
ACTIVATE: Starting COSMICS_NOSILICON_TAPE w/o PCAL crates, etc.<br>
<pre>
Trigger Inhibit is set from the components:
 IFIX:SVX HV  		[128] Silicon Tracker High Voltage from iFix
 IFIX:ISL HV  		[129] Intermediate Silicon High Voltage from iFix
 IFIX:L00  		[150] Silicon Layer 00 from iFix
</pre>
<p>
Didn't work how we thought.  We solved the problem by using 'ti_enable_standby'.  This cleared the inhibit.
Now we will play with unmasking each channel 1 by 1.  We'll consult with the expert after a bit of smoth running.
</p>
<!-- Author: Dale x2080 -->
<!-- Comment: Tue Dec  2 09;56;50 comment by...Dale -->
Manual unmasking worked.  Inhibit status still clear.


<!-- Date: Tue Dec 2 10:05:04.353 2003 -->
We will be working on the nim crate for the beam halo counters. 
We will not interfere with the signals, so they should retain their usual characteristics. However, if something unnormal is noticed, please let us know so that we are aware of the problem (i will be in the counting room, by the crate, most probably). 
We will also put a notice when we are finished working on the crate.  
<!-- Author: Muge -->
<!-- Comment: Tue Dec  2 17;27;03 comment by...muge -->
we have already finished working on the beam halo nim crate for today.
<!-- Date: Tue Dec 2 10:15:04.798 2003 -->
CMP, CMX and CPR was tripped.
<!-- Author: Taka -->
<!-- Comment: Tue Dec  2 10;16;26 comment by...Taka -->
<pre>CMX SE 8,9,10,11,12,13
    NE 2,3
    SW 9,10,11,12 
    SW 22,23,0,1,2,3

was tripped</pre>


<!-- Comment: Tue Dec  2 10;19;46 comment by...Dale and Taka -->
CMP NorthWall 2,3,4
    SouthWall 2,3 
    Top       2 


All trips appear in those sense.

<!-- Comment: Tue Dec  2 10;21;09 comment by...Taka -->
<pre>CPR SE 6,7,8,9,10,11
    NE 0,1,2,3,4,5
       18,19,20,21,22,23</pre>
<!-- Comment: Tue Dec  2 10;26;25 comment by...Taka -->
<pre>Dale turn on the HVs for these guys.</pre>
<!-- Comment: Tue Dec  2 10;58;21 comment by...Dale & Taka -->
<pre>Just to clarify:

"all trips appear in the sense" means that all the trips alarmed on the "sense wire" which can also be called an anode wire.  Thus field = cathode = 'drift voltage' (also called the 'grid' voltage by experts) while sense = anode = 'wire voltage'.  If there is a repeated trip this can be useful information.  In this case it is clear that the trips were due to beam losses (the trips are correlated in space and across several detectors).  The fact that it happened on the anode is iceing on the cake.

As a result, although good to note what triped if in a non-time sensitive mode (which we are in now), this can be streamlined to say CMP, CMX, CPR triped due to beam losses.  Of course, when this happens its a good idea to lower the voltages to the 'default stand-by' to protect the various systems.</pre>
<!-- Date: Tue Dec 2 10:16:28.616 2003 -->
Inhibit came on due to CMX and CMP trips.  Paused the run as CPR also triped (this doesn't set an inhibit).
<!-- Author: Dale :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175430' target=_top>175430</a>) -->





<!-- Date: Tue Dec 2 10:28:00.547 2003 -->
Even if there is no beam, we have tripping on muon system.
<!-- Author: Taka -->
<!-- Comment: Wed Dec  3 09;22;02 comment by...Camille Ginsburg -->
Actually, I think there was some beam in the machine: <a href= 
'http://www-bd.fnal.gov/cgi-mcr/elog.pl?nb=2003&action=view&page=911&anchor=16:00:22'> MCR e-log entry </a>.
<!-- Date: Tue Dec 2 10:30:07.914 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175430">175430</a>
 Terminated at 2003.12.02 10:29:35
<!-- Author: RunControl -->


<!-- Date: Tue Dec 2 10:31:36.617 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175430">175430</a>
TERMINATE: Ending run to put in PCAL crates, etc.
<!-- Author: Dale x2080 -->



<!-- Date: Tue Dec 2 10:31:36.927 2003 -->
We don't see anyone working on PCAL now. 
So, we will include PCAL and timing stuff.  
<!-- Author: Dale and Taka -->
<!-- Comment: Tue Dec  2 10;40;17 comment by...Taka -->
<pre>But, we see PCAL modules are occupied.  These are PCAL00-11, EM_TIMING_00, and HADRON_TIMING_00.</pre>
<!-- Date: Tue Dec 2 10:33:49.812 2003 -->
HV of COT,CMP,CMX,BMU and CPR are alarm
<!-- Author: Taka -->
<!-- Comment: Tue Dec  2 10;35;34 comment by...Dale and Taka -->
Dale did stand-by using main control.

<!-- Comment: Tue Dec  2 10;36;31 comment by...Taka -->
COT --> SL2 was tripped.


<!-- Date: Tue Dec 2 10:37:45.842 2003 -->
We don't know plug calorimeters are used by experts, but try 
to turn on these guys.
<!-- Author: Taka -->



<!-- Date: Tue Dec 2 10:41:06.700 2003 -->
Took advantage of the quench to investigated plug laser problems. 
The system now appears to be working. 
Trouble is I dont know why. 
Only the East laser trigger was present as I began loking at the signals. The west laser trigger appeared later. 
Possibilities:   
1)a bad cable connection which was re-established as I touched the cables while looking at signals 
2)the DDG was half bad to begin with and starte working as I continued pulsing the laser. 
3)Someone was messing with the S/W while I was messing with the H/W. 
 
Hope its the last one.
<!-- Author: Giovanni pauletta -->


<!-- Date: Tue Dec 2 10:42:41.869 2003 -->
<pre>HV status:  stand-by:  COT, CMU, CMP, CMX, SMU, CES, CPR, CCR 
            turn off:  SVX, L00, ISL, CLC, MNP 
            turn on :  CSW, MSK, CSX, CSP, BSU, TSU, CEM, PHA,   
                       PSH, GAM, BSC, RPS 
 
TOF is very confusing: HV looks on, but controller directs "OFF".</pre>
<!-- Author: Dale and Taka -->


<!-- Date: Tue Dec 2 10:52:42.260 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-12907&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-12907  width='300' align='top'></a></td><td>Plots for abort gaps: many delta functions.</td></tr></table>
<!-- Author: Taka -->


<!-- Date: Tue Dec 2 10:53:33.739 2003 -->
COT is now in stand-by. Someone did this.
<!-- Author: Taka -->


<!-- Date: Tue Dec 2 10:59:51.678 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175435">175435</a>
ACTIVATE: Starting COSMICS_NOTRACKS (w/o <a href=
'/cgi/elog/elog.pl?nb=2003&action=view&page=1006&frame=2&anchor=10:31:36.927'>
these guys </a>)
<!-- Author: Dale x2080 -->



<!-- Date: Tue Dec 2 11:00:11.345 2003 -->
<pre>Now, we have AccRt = 0. It seems that acclarator people  
stopped storing pbars.</pre>
<!-- Author: Taka -->


<!-- Date: Tue Dec 2 11:12:43.410 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-12908&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-12908  width='300' align='top'></a></td><td>Plots for abort gap (loss?). Playing with something.</td></tr></table>
<!-- Author: JJ and Taka -->
<!-- Comment: Tue Dec  2 12;17;18 comment by...ronmoore -->
Looks like proton injections for a 12x0 store.
<!-- Date: Tue Dec 2 11:15:16.584 2003 -->
Proton bunches 1-12 has 2.3E11 particles with 150GeV.
<!-- Author: Taka -->

<!-- Date: Tue Dec 2 11:24:02.106 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175435">175435</a>
TERMINATE: Ending run
<!-- Author: Dale x2080 -->



<!-- Date: Tue Dec 2 11:33:17.535 2003 -->
<pre>Failing to book PCAL crates: 
 
Failed to Book: 
EM_TIMING_00 
HADRON_TIMING_00 
PCAL_** 
 
Giovanni Pauletta had these and he said that he was done.  He logged out etc. so they should be free.  Just talked to him now - we should be good to go (they have been let go - We've booked'em). 
</pre>
<!-- Author: Dale -->
<!-- Comment: Tue Dec  2 12;19;26 comment by...Taka -->
<pre>If you finished your working, please tell ACEs that you finished it. Otherwise, we can't understand the situation.
At this case, plug laser was kept tuning on also.
</pre>
<!-- Date: Tue Dec 2 11:36:42.512 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175436">175436</a>
ACTIVATE: Starting ACE_COSMICS_NOTRACKS (w/ Inhibit enabled to test it out)
<!-- Author: Dale x2080 -->
<!-- Comment: Tue Dec  2 11;42;54 comment by...Dale -->
<pre>After partitioning, we restarted the Inhibit Interface after closing it at the end of the previous run. Inhibit was set when we started.  </pre>
<!-- Comment: Tue Dec  2 13;16;56 comment by...Dale -->
<p>
Trigger Inhibit is set from the components:
</p>
 IFIX:SVX HV  		[128] Silicon Tracker High Voltage from iFix<br>
 IFIX:ISL HV  		[129] Intermediate Silicon High Voltage from iFix<br>
 IFIX:COT HV  		[130] Central Outer Tracker High Voltage from iFix<br>
 IFIX:TOF HV  		[132] Time of Flight High Voltage from iFix<br>
 IFIX:CES HV  		[135] Central EM Strip High Voltage from iFix<br>
 IFIX:CMU HV  		[140] Central Muon High Voltage from iFix
<br>
 IFIX:IMU HV  		[143] Intermediate Muon High Voltage from iFix<br>
 IFIX:L00  		[150] Silicon Layer 00 from iFix
<br>
 IFIX:CMP HV  		[151] Central Muon Upgrade High Voltage from iFix<br>
 IFIX:CMX HV  		[152] Central Muon Extension High Voltage from iFix
<p>
The muon guys were 'correct' as they were at stand-by.  Masking of the Silicon guys had to be done with a standby comand and (remaining guys  TOF, CES, etc. had to be masked by hand).  Seems that the only the IFIX:{silicon} guys (like before) have this little bug.  The rest are working correctly with the GUI for the Inhibit interface.  JDL knows about this and will consult with Steve (Nahn?) about this.
</p>
<!-- Date: Tue Dec 2 11:37:55.214 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-12910&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-12910  width='300' align='top'></a></td><td>Plot for TeV losses. TeVMON shows that MEAN(LOSTP) and B0PAGC is red.</td></tr></table>
<!-- Author: Taka -->



<!-- Date: Tue Dec 2 11:53:18.701 2003 -->
Total Deadtime is at 99.71% -  
 
musc00 is NOT DONE, DONE last, Realtime BUSY, and lachted BUSY at various time bia the return crosspoints.  L3 rate is 354 Hz (as well as L2) with L1 376 kHz.
<!-- Author: Dale :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175436' target=_top>175436</a>) -->
<!-- Comment: Tue Dec  2 11;54;37 comment by...Guru -->
L2A rate is too high.  Which trigger is it?

<!-- Comment: Tue Dec  2 11;57;50 comment by...Dale -->
With the help of the SciCo we scared away the problem (we were about to page).  L3 droped to 25 Hz.  Nothing is NOT DONE - nothing is BUSY.  Dead time is currently 0.00 Hz.

<!-- Comment: Tue Dec  2 11;58;15 comment by...Dale -->
0.00% - sorry.


<!-- Comment: Tue Dec  2 12;03;52 comment by...Sage  -->
<pre>The L2 cal triggers were going nuts.  Was the plug laser on?

</pre>
<!-- Comment: Tue Dec  2 13;21;24 comment by...Dale -->
<pre>We don't remember when we turned it off (plug was on but laser was off once we ened a run and tried to start a new run).  We are certain that we turned off before we were successful in including the PCAL crates etc.</pre>
<!-- Date: Tue Dec 2 12:01:34.290 2003 -->
<pre>Via the Error handler:   
 
 
(MLE) b0l3pcom2.fnal.gov:main:11:58:37 AM->Error on L3 node b0l3c16 (partition 5) Tue Dec 2 11:58:37 2003 l3_node  
  in chain_loop (l3_chain.c:624) 
  @L3_INPUT_FAILURE:  chain 1 code Success (17610 good, 5721 bad) 
 
(MLE) b0l3pcom2.fnal.gov:main:11:58:39 AM->Error on L3 node b0l3c16 (partition 5) Tue Dec 2 11:58:38 2003 l3_node  
  in chain_loop (l3_chain.c:624) 
  @L3_INPUT_FAILURE:  chain 0 code Success (17616 good, 5651 bad)</pre>
<!-- Author: Dale :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175436' target=_top>175436</a>) -->
<!-- Comment: Tue Dec  2 12;09;23 comment by...Dale -->
<p>
Expert says this is single events being rejected.  It should be ingored by the ACE as long as we are running ok (which we are). 
<a href=
'/cgi/elog/elog.pl?nb=2003&action=view&page=989&frame=2&anchor=17:13:59.042'>
See here for details. </a>
</p>





<!-- Date: Tue Dec 2 12:23:37.489 2003 -->
<pre>Currently 107 reformatter rejected events (.16% of the total so far).  These have appeared at processors 194 (error count 1/1), 263 (10/11), and 267 (2/2).   
 
One such message: 
 
ERROR at Tue Dec  2 11:37:49 2003 partition 5 
    in refoInt_reformatProc() [l3_refevt.c:610] 
    info: @L3_REFORMAT_ERROR 
 
</pre>
<!-- Author: Dale :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175436' target=_top>175436</a>) -->
<!-- Comment: Tue Dec  2 12;25;58 comment by...Dale -->
We've reset the messages for thoes processors.


<!-- Comment: Tue Dec  2 12;37;14 comment by...Guillelmo -->
You can investigate why there are so many reformatter <br>
errors, finding the "guilty" crate (You should use the <br> reformatter decode tool, available in the L3/EVB Ace  <br>
Control Panel).
<!-- Comment: Tue Dec  2 12;49;19 comment by...Dale -->
<pre>Forgot to say something about that - thanks.   When we tried that it pop-up a blank dialog window (where the crate info would be).  We tried again and same thing occured.  Stoped at that point.  We'll try again if it comes up.</pre>
<!-- Comment: Tue Dec  2 12;51;16 comment by...Dale -->
<pre>Currently 221  reformatter rejected (.15 %)</pre>
<!-- Comment: Tue Dec  2 13;26;53 comment by...Dale -->
<pre>Guillelmo came by and help us track down a possible trouble maker.  We found the mutr00 [muon trigger] was pointed at by one of the processors.  Looking at the return crossing points we see that offten mutr00 is done last.  Not definative that he's the only guilty party but a possible conclusion novertheless.</pre>
<!-- Comment: Tue Dec  2 13;34;14 comment by...Dale -->
<pre>Message form processors 264:

ERROR at Tue Dec  2 13:27:56 2003 partition 5
    in refoInt_reformatProc() [l3_refevt.c:627]
    info: @L3_REFORMAT_ERROR

RAWREF Error - BNK-TRAC-2 - with code 36 -- START
 Line -  648 in: src/library/rr_refevt.c
 Buffer position: -1
 Error count: 10 of 11
 Reject rate: 0.810 percent

 Found same CrateId twice!
...

via decoder ---> MUON_TRIGGER_00</pre>
<!-- Date: Tue Dec 2 12:35:33.241 2003 -->
<center><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-12911&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-12911' width='300'></a><a href='/cgi/elog/elog.pl?nb=2003&action=view&page=-12912&button=yes' target='xxx' onclick='jswindow()'><img src='/cgi/elog/elog.pl?nb=2003&action=view&page=-12912' width='300'></a></center>
<!-- Author: Taka and Dale -->
<!-- Comment: Tue Dec  2 12;38;27 comment by...Taka & Dale -->
<pre>SVRAD* levels went up - (from 10:00-12:30 today) - no obvious cause and effect.</pre>




<!-- Date: Tue Dec 2 13:01:59.734 2003 -->
There is no beam (p and pbar) in TeVatron.
<!-- Author: Taka -->


<!-- Date: Tue Dec 2 13:04:39.553 2003 -->
Plug calorimeters HVs are syand-by to take defalut of the system. 
<!-- Author: Taka -->


<!-- Date: Tue Dec 2 13:05:51.505 2003 -->
HV of PEM (crate#1) alarmed, but went away. 
<!-- Author: Taka -->
<!-- Comment: Tue Dec  2 13;22;31 comment by...Dale -->
<pre>The trigger inhibit didn't seem to go away.  We masked everything - going to see what will set it.</pre>
<!-- Comment: Tue Dec  2 13;42;26 comment by...Dale -->
<pre>I manually unmasked all the guys who should be ok (TRIP:***, IFIX:*** LV, & IFIX: VME POWER).  Inhibit is still clear.  Everyone is happy.</pre>
<!-- Date: Tue Dec 2 13:08:24.337 2003 -->
BigBorther: b0dap58 --> attention.
<!-- Author: Taka -->


<!-- Date: Tue Dec 2 13:09:17.042 2003 -->
Heart Beat alarm for CMX, BMU, CES, CPR and CCR.
<!-- Author: Taka -->
<!-- Comment: Tue Dec  2 13;12;09 comment by...Taka -->
errors are happened when I try to investigate the problem.

Error number 2147212502(8004232a):
A network transaction is in progress.


<!-- Comment: Tue Dec  2 13;12;50 comment by...Taka -->
All of this alarm went away.







<!-- Date: Tue Dec 2 14:01:42.299 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175438">175438</a>
ACTIVATE: ending to try new physics table [new L3 parent manager script in use]
<!-- Author: Dale x2080 -->


<!-- Date: Tue Dec 2 14:01:59.679 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175438">175438</a>
TERMINATE: now we are ending ;-)
<!-- Author: Dale x2080 -->


<!-- Date: Tue Dec 2 14:03:25.357 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175436">175436</a>
TERMINATE: ending run for Shara to try a new script for the L3 parent manager.
<!-- Author: Dale x2080 -->
<!-- Comment: Tue Dec  2 15;00;23 comment by...Dale -->
<pre>We were able to get this [the next run which we foolishly forgot to make an entry for] to run using ACE_COSMICS_NOTRACKS (no errors, etc.)</pre>
<!-- Comment: Tue Dec  2 15;10;06 comment by...Dale -->
<table border=0><td><tr><td bgcolor=#e0e030><p>
The run # for the successful COSMICS_NOTRACKS with the modified L3 parent manager was<b> 175438 </b>with 3,095 events accepted at L3.
</p></td></tr></td></table>
<!-- Date: Tue Dec 2 14:03:58.216 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175439">175439</a>
ACTIVATE: test src test
<!-- Author: feild -->


<!-- Date: Tue Dec 2 14:07:45.589 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175440">175440</a>
ACTIVATE: kghajte:IGJW;OJG
<!-- Author: JACKO -->


<!-- Date: Tue Dec 2 14:12:13.176 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175440">175440</a>
TERMINATE: Try a different input
<!-- Author: JACKO -->


<!-- Date: Tue Dec 2 14:14:21.302 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175442">175442</a>
TERMINATE: This worked
<!-- Author: JACKO -->



<!-- Date: Tue Dec 2 14:17:00.859 2003 -->
<pre>Current BLM summary values (Sum): 
 
W Inner BLM  10.76372 
W Outer BLM  5.802134 
E Inner BLM  10.85504 
E Outer BLM  19.22164 
 
</pre>
<!-- Author: Taka -->


<!-- Date: Tue Dec 2 14:29:59.965 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175444">175444</a>
ACTIVATE: starting run with (AAA_SHOTSETUP) TEST_UBER_PRESCALE[4, 359, 406] - New trigger table
<!-- Author: Dale x2080 -->


<!-- Date: Tue Dec 2 14:33:45.230 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175444">175444</a>
TERMINATE: ending run - short test sucessful
<p>
Switching back to the new parent manager to see if we get a  L3CalibTag not found error again..
</p>
<!-- Author: Dale x2080 -->


<!-- Date: Tue Dec 2 14:37:49.429 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175446">175446</a>
ACTIVATE: Starting TEST_UBER_PRESCALE[4, 359, 406] (via AAA_SHOTSETUP)
<!-- Author: Dale x2080 -->



<!-- Date: Tue Dec 2 14:40:43.281 2003 -->
<pre>L3CalibTag not found.  Very possible that this related to the test of the new parent manager.  Calling Sarah Demers (L3 manager expert).</pre>
<!-- Author: Dale -->
<!-- Comment: Tue Dec  2 14;42;50 comment by...Dale -->
This should have gone <a href=
'/cgi/elog/elog.pl?nb=2003&action=view&page=1006&frame=2&anchor=14:03:25.357'>
here. </a>

<!-- Date: Tue Dec 2 14:47:27.492 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175446">175446</a>
TERMINATE: ending run to give wcal crates to Gervasio (for calibration).
<!-- Author: Dale x2080 -->



<!-- Date: Tue Dec 2 14:57:27.132 2003 -->
We tried to solve <a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=tsi&action=view&page=12&frame=2&anchor=09:01:51'>this</a> problem and we found <a href= 
'http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=tsi&action=view&page=12&frame=2&anchor=14:50:59'>this</a>
<!-- Author: Us -->

<!-- Date: Tue Dec 2 14:58:30.766 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175447">175447</a>
ACTIVATE: Starting TEST_UBER_PRESCALE[4, 359, 406] (via AAA_SHOTSETUP) 
<p>
Without wcal** crates.
</p>
<p>
3rd time - it continues to work although the rate is very slow (almost zero).  No collisions.  L2 accept rate is only ~ 6 Hz.
</p>
<!-- Author: Dale x2080 -->
<!-- Comment: Tue Dec  2 15;01;09 comment by...Dale -->
<pre>Also note that we are now running on partition 0 (not 5).</pre>


<!-- Date: Tue Dec 2 15:20:05.920 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175447">175447</A>
TERMINATE: Ending run of TEST_UBER_PRESCALE[4, 359, 406]
<p>
Tested new trigger table (over 5 min of testing --> ~2000 events at L3)
</p>
<!-- Author: Dale x2080 -->


<!-- Date: Tue Dec 2 15:27:00.102 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175448">175448</A>
ACTIVATE: Starting cosmic run [ACE_COSMICS_NOTRACKS]
<p>
w/o wcal crates (using partition 0 - the norm for now)
</p>
<!-- Author: Dale x2080 -->



<!-- Date: Tue Dec 2 15:29:09.617 2003 -->
Olga and I tested new YMon enabling new DQM part in tcl.  
In runarea of YMon, we copied CDF_channelStatus_ref.dat.  
We are now running 5.3.0pre1a version of YMon in the control room.  YMon seems to be running ok, so 
we leave it this way.  Please page 'online monitor' if you find 
any problems running YMon.
<!-- Author: Olga and Kaori -->

<!-- Date: Tue Dec 2 15:35:12.516 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175448">175448</A>
TERMINATE: aborting - LEVEL1_CAL_01 suspected problem - more to come
<!-- Author: Dale x2080 -->
<!-- Comment: Tue Dec  2 15;44;35 comment by...Dale -->
<pre>deadtime was high (99%) we looked at the return crosspoints and saw that l1cl01 had a lachted ERROR. (8 guys were busy - a result of the error most likly)

Tried shepherding the crate [b0l1cl01] then we got:

FrontEnd Crate Error Condition from:
LEVEL1_CAL_01

(Lots of Done time out because of that)

Did a HRR.  Went back in active with same error in l1cl01.  Noticed that tsi00 came back as in error via run control (unlikly that he be the problem).  Additional shepherd and then a HR - but we did not recover into active.  Re-trying.</pre>
<!-- Date: Tue Dec 2 15:35:18.625 2003 -->
B0PAGC and MEAN(LOSTP) are red in TeVMon.
<!-- Author: Taka -->


<!-- Date: Tue Dec 2 15:39:27.411 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-12913&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-12913  width='300' align='top'></a></td><td>Loss of TeV from ACNET.</td></tr></table>
<!-- Author: Taka  -->


<!-- Date: Tue Dec 2 15:42:58.381 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-12914&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-12914  width='300' align='top'></a></td><td>Nice plot for beam position movement from Sep/01/2002 to 
Sep/01/2003. (from SVT)</td></tr></table>
<!-- Author: Taka -->

<!-- Date: Tue Dec 2 15:44:34.984 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175451">175451</A>
ACTIVATE: starting run - no events - l1b01 in latched error.
<!-- Author: Dale x2080 -->
<!-- Comment: Tue Dec  2 16;09;10 comment by...Dale -->
<pre>Major error on the out going DAQ ace part - I forgot to change the parition on the RXPT monitor.  Thus I was in the dark to what was the error.  </pre>
<!-- Date: Tue Dec 2 15:45:59.957 2003 -->
TeV abort. (No proton in TeV as a result of this). 
We had 12 proton bunches in TeV. 
<!-- Author: Taka -->


<!-- Date: Tue Dec 2 15:49:32.341 2003 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2003&action=view&page=-12915&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2003&action=view&page=-12915  width='300' align='top'></a></td><td>Integrated radiation doses.</td></tr></table>
<!-- Author: Taka -->
<!-- Comment: Tue Dec  2 15;50;20 comment by...Taka -->
<pre>Small increment can be seen recent 30 min.</pre>

<!-- Comment: Tue Dec  2 15;52;29 comment by...Taka -->
<pre>W Inner BLM (Sum: rad):  12.40605
W Outer BLM           :  5.813189
E Inner BLM           :  11.61766
E Outer BLM           :  21.33591
</pre>

<!-- Date: Tue Dec 2 15:54:39.758 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175451">175451</A>
TERMINATE: ending run - pageing L1 Cal trigger expert
<!-- Author: Dale x2080 -->


<!-- Date: Tue Dec 2 15:55:54.271 2003 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>Run Number</TH>
<TH>Data Type</TH>
<TH>Physics Table</TH>
<TH>Begin Time</TH>
<TH>End Time</TH>
<TH>Live Time</TH>
<TH>L1 Accepts</TH>
<TH>L2 Accepts</TH>
<TH>L3 Accepts</TH>
<TH>Live Lumi, nb-1</TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>

<TR><TD>Totals</TD>                                                     
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD>15:55:02</TD>                                                       
<TD ALIGN=CENTER>::</TD>                                                
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD ALIGN=RIGHT></TD>                                                   
<TD> </TD>                                                              
<TD> </TD>                                                              
<TD> </TD></TR>                                                         
                                                                        
</TABLE>
<!-- Author: End of Shift Report -->



<!-- Date: Tue Dec 2 15:59:45.367 2003 -->
<font color=red>Shift Summary: </font><pre>    No collisions till Owl Shift,  lots of TeV studies 
    Lots of little tests. 
        Giovanni pauletta  
             plug laser appears to be working, don't know why 
        Sarah Demers' new L3 parent manager script 
	wcal crates to Gervasio (for calibration) 
        Johnathan's   TEST_UBER_PRESCALE  
</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   
Delivered Luminosity   0  
Acquired Luminosity      
Efficiency             
   
</td></tr></table></pre>
<!-- Author: GP Yeh -->

<!-- Date: Tue Dec 2 16:05:38.894 2003 -->
Run <A HREF="/java/cdfdb/servlet/RunSummary?RUN_NUMBER=175459">175459</A>
 Activated at 2003.12.02 16:05:07
<!-- Author: RunControl -->