<!-- Title: Day shift. Mon Aug  6, 2001 -->
<!-- SciCo: John Conway -->
<!-- DAQAce: Michael & Koji Sato -->
<!-- MonAce: Koji & Matt Worcester -->
<!-- CO: none -->
<!-- OpManager: Jay Dittman -->
<!-- Notes: -->
<pre>No beam...estimate Tuesday.  Supervised access - make requests to Dee or Jay to get on the list.  Coordinate 
requests for crates through SciCo/Aces.</pre>


<!-- Date: Mon Aug 6 08:26:56 2001 -->
<pre>Take a CLC calibration. 
 
Get a lot of errors in the beginning: 
 
"Error LINERESPONSE no component CLA" 
 
Run appears in database.</pre>
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122806' target=_top>122806</a>) -->


<!-- Date: Mon Aug 6 08:34:20 2001 -->
<table><tr><td><a href=/cgi/elog/elog.pl?nb=2001&action=view&page=-1781&button=yes target='xxx' onclick='jswindow()'; align=top><img src=/cgi/elog/elog.pl?nb=2001&action=view&page=-1781  width='300' align='top'></td><td>CLC calibration result. Is there hot channel?</a></td></tr></table>
<!-- Author: Koji I and Koji S -->


<!-- Date: Mon Aug 6 08:47:54 2001 -->
COT calibration done: DB okay.
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122807' target=_top>122807</a>) -->


<!-- Date: Mon Aug 6 08:57:49 2001 -->
Muon Calibration: done timeout from b0imu01.
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122808' target=_top>122808</a>) -->


<!-- Date: Mon Aug 6 09:00:49 2001 -->
<pre>Please make an LED and Xenon calibration as soon as you have the 
central crates back. 
We want these two calibrations before we change HV and perhaps 
3 PMTs as well. We also want an additional LED and Xenon calibration 
afte the changes have happened.</pre>
<!-- Author: vaia -->


<!-- Date: Mon Aug 6 09:03:55 2001 -->
<pre>New muon calibration done. No timeout. Get some bunch counter mismatches: events 355 and 652, between slot 11 and slot 12.</pre>
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122809' target=_top>122809</a>) -->


<!-- Date: Mon Aug 6 09:22:55 2001 -->
<h2>Calorimeter Electronics Checkout</h2> 
<p>I took all of the calorimeter crates to check out the electronics status and obtain pedestal distributions.  All readout electronics are functioning normally.  Pedestal data is being analyzed to determine if access is needed.
<!-- Author: R. Erbacher -->
<!-- Comment: Mon Aug  6 09;29;31 comment by...R. Erbacher -->
For more information, please see wedge and plug e-logs.
<!-- Date: Mon Aug 6 09:23:52 2001 -->
 
Take CLC crate (b0clc00) for about 2 hours to debug CLC LED gain calibration script and consumer.
<!-- Author: Sasha Sukhanov -->



<!-- Date: Mon Aug 6 09:33:33 2001 -->
<ul> 
<li> Rebooted all Si Crates, two didn't "make it".  One (b0fib06)  
did not have FER code loaded, the other (b0svx07) apparently 
did not even run the startup script (judging from the prompt  
of ">" and the processes running). 
<li>Rebooted these two crates, got the following message repeated many times on both:<pre> 
Using tcp protocol.                                        
RTserver denied access. 
Message: Number of client licenses exceeded 
Message from RTlm: Checking in <RTclient> license. 
Message from RTlm: License for <RTclient> granted (64 licenses left). 
Connecting to project <cdf_daq> on <tcp:b0dau30> RTserver.            
</pre> 
<li>Asked ACE to investigate rtserver problems (which he is doing  
now) 
</ul>
<!-- Author: SCN -->
<!-- Comment: Mon Aug  6 09;40;37 comment by...Michael -->
Restarted RTserver.
<!-- Date: Mon Aug 6 09:39:08 2001 -->
Cal-QIE calibration: run appears in database.
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122816' target=_top>122816</a>) -->



<!-- Date: Mon Aug 6 09:41:40 2001 -->
Cal-LED calibration: run appears in database.
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122819' target=_top>122819</a>) -->


<!-- Date: Mon Aug 6 09:54:28 2001 -->
Cal-Xenon pedestal calibration: run appears in database.
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122820' target=_top>122820</a>) -->


<!-- Date: Mon Aug 6 10:01:02 2001 -->
Took Cal-Xenon laser calibration: run appears in database.
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122821' target=_top>122821</a>) -->


<!-- Date: Mon Aug 6 10:06:43 2001 -->
Had to disrupt EVB system a little since <a href= 
'/cgi/elog/fixlist.pl?nb=fixlist&action=view&page=5&frame=2&anchor=09:56:16'> 
"reboot" didn't work</a>.  Aces will need to clean up before next 
using the EVB (and it was discussed before I did it)
<!-- Author: SCN -->


<!-- Date: Mon Aug 6 10:13:48 2001 -->
SMX calibration: run appears in database.
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122822' target=_top>122822</a>) -->


<!-- Date: Mon Aug 6 10:20:27 2001 -->
TOF calibration: run appears in database.
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122824' target=_top>122824</a>) -->


<!-- Date: Mon Aug 6 10:27:56 2001 -->
ScpuDropout: Lost LAN connection to SCPU b0eb24, b0eb20, b0eb23.  Cleanup EVB.
<!-- Author: aces -->


<!-- Date: Mon Aug 6 10:35:41 2001 -->
Aseet says we can ignore COT alarms for awhile.
<!-- Author: monitoring aces -->


<!-- Date: Mon Aug 6 10:38:57 2001 -->
Successfully took 30k event Rick Run.
<!-- Author: aces :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122825' target=_top>122825</a>) -->


<!-- Date: Mon Aug 6 10:40:07 2001 -->
Koji Terashi says we can ignore CLC and BBC alarms.
<!-- Author: monitoring aces -->


<!-- Date: Mon Aug 6 11:08:15 2001 -->
We are about try to access the transition board side of 
b0wcal02 and b0wcal06 to pull the Penn prototype TOF 
electronics.  We intend to do this without powering off 
the crate.
<!-- Author: M Jones -->


<!-- Date: Mon Aug 6 11:24:17 2001 -->
 
Have done CLC LED gain calibration (run # 122811,122813-122815,122817,122818)
<!-- Author: Sasha Sukhanov :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=122811' target=_top>122811</a>) -->


<!-- Date: Mon Aug 6 11:26:42 2001 -->
Ilya takes EVB and L3.
<!-- Author: aces -->


<!-- Date: Mon Aug 6 11:30:13 2001 -->
Swap out the controller board for the CEM/CHA pisa box on <br> 
wedge 20E. Everything is back to normal.
<!-- Author: Nikolay and Fotis -->


<!-- Date: Mon Aug 6 11:37:33 2001 -->
<pre>Run Control now has a new thread which monitors the total memory usage 
of the Java virtual machine.   You will see periodic messages 
on your xterm of the type: 
 
    2001.08.06 11:32:02 SetSize 57588 kB 
    2001.08.06 11:32:02 NoSwapSize 57588 kB 
    2001.08.06 11:32:02 Shared 5204 kB 
    2001.08.06 11:32:02 DataResident 57568 kB 
    2001.08.06 11:32:02 DirtyPages 52384 kB 
 
which also show up in the Run Control log file for later expert 
inspection.  In general, do not be alarmed by these messages 
unless the values exceed something like 90000 kB.  In this case, 
explicit error messages will be sent to the Error Logger.   If 
you see a message of the type: 
 
  2001.08.06 11:21:57 SetSize 95644 exceeds limit of 90000 kB 
  2001.08.06 11:21:57 Java VM is running out of memory; restart Run Control 
 
then the Java virtual machine is going into "memory hog" mode and 
an "OutOfMemory error is imminent, so you should restart Run Control as soon as humanly/computerly possible. 
 
Package fer (Run Control) has just been rebuild to effect  
this change.</pre>
<!-- Author: W.Badgett -->


<!-- Date: Mon Aug 6 11:43:32 2001 -->
<pre>Finished removing prototype TOF electronics from b0wcal02 
and b0wcal06.  Gervasio will soon be asking for these crates 
in order to run qietest on them prior to installation of 
production TOF electronics.</pre>
<!-- Author: M Jones -->


<!-- Date: Mon Aug 6 11:47:14 2001 -->
PSM alarm, arch 6E, channel 4 (upper fan).  Paged front end electronics pager.  Alarm reset itself.
<!-- Author: monitoring aces -->


<!-- Date: Mon Aug 6 12:12:24 2001 -->
<pre>   Finished with the Event Builder. By request of Steve Nahn 
I have disabled all 9 silicon SCPUs (disconnected from scramnet 
and marked offline, also rearranged scramnet cables). 
  To integrate silicon with HEVB aces will need to page L3 pager. 
</pre>
<!-- Author: Ilya -->


<!-- Date: Mon Aug 6 12:31:34 2001 -->
Experts may have to power off b0wcal02 and b0wcal06.  We can ignore alarms from these crates for now.
<!-- Author: monitoring aces -->


<!-- Date: Mon Aug 6 12:53:43 2001 -->
Released PCAL and PCAL source crates to Giovanni Pauletta.
<!-- Author: aces -->


<!-- Date: Mon Aug 6 13:09:00 2001 -->
PSM alarm from EndWall, COSEB_3.  All channels return O.  Paged Rick Tesarek.
<!-- Author: monitoring aces -->
<!-- Comment: Mon Aug  6 13;13;48 comment by...monitoring aces -->
Ignoring this alarm per instructions from calorimeter experts who say that TOF is being worked on.


<!-- Comment: Mon Aug  6 13;45;18 comment by...monitoring aces -->
Alarm clears itself.
<!-- Comment: Mon Aug  6 14;06;16 comment by...Robin Erbacher -->
Please note that when you page the calorimeter electronics pager, ~1/2 the time you will not get Rick Tesarek, but rather me.
<p>[The corollary is that people in general should not try to contact Rick via the electronics pager unless it is certain he is carrying it. This didn't happen this time but happens a lot.]
<!-- Date: Mon Aug 6 13:14:08 2001 -->
Turn on central hadron laser for work on the calorimeter
<!-- Author: fotis -->


<!-- Date: Mon Aug 6 13:15:09 2001 -->
SVX expert informs us that they are working on SVX and may be causing alarms.
<!-- Author: monitoring aces -->
<!-- Comment: Mon Aug  6 13;29;08 comment by...monitoring aces -->
Several SVX alarms.  We ignore them.
<!-- Date: Mon Aug 6 13:17:07 2001 -->
Rebooted l1cl, l2cl, and xft crates with new front-end code, 
another attempt at the 'creeping deadtime'.  
<!-- Author: Arnd -->


<!-- Date: Mon Aug 6 13:19:02 2001 -->
Nathan Eddy and Bill Ashmanskas have SVT06-07 and XTRP crates for L2 tracking studies.
<!-- Author: aces -->




<!-- Date: Mon Aug 6 13:59:41 2001 -->
Problems with run control: upon clicking ColdStart, the rc window hangs with the ColdStart box grey and the IDLE oval yellow.  Attempts to click on Abort or Reset result in those windows greying out as well, but no other response.  Tried killing rc and restarting one time, but the problem came back.  Bill Badgett is investigating.
<!-- Author: aces -->



<!-- Date: Mon Aug 6 14:07:33 2001 -->
Eric James has the muons.
<!-- Author: aces -->


<!-- Date: Mon Aug 6 14:12:53 2001 -->
PSM alarm, arch 20E.  Expert informs us that he is aware of the problem, and that he is on his way to tell Byrum and Lindgren who are swapping power supplies.  Alarm resets itself.
<!-- Author: monitoring aces -->
<!-- Comment: Mon Aug  6 14;37;54 comment by...monitoring aces -->
Expert has masked this alarm, so it should be quiet for now.


<!-- Date: Mon Aug 6 14:41:07 2001 -->
Donatella has EVB and L3 to test the Error Display.
<!-- Author: aces -->


<!-- Date: Mon Aug 6 15:30:46 2001 -->
<pre>Installed TOF transistion boards in b0wcal06. 
Need the wcal crates a little longer to do the checkout. 
We'll need the CMX arch move out on the south west side 
to install transition boards in the b0wcal02.</pre>
<!-- Author: Matthew/Gervasio/Rolf -->


<!-- Date: Mon Aug 6 15:37:02 2001 -->
PSM alarm, CASWT_1 and 2, CASWB_1 and 2.  We will inform the experts.  Arch 6E also turns red a little bit later, but this alarm was probably silenced by the expert (see previous entry).
<!-- Author: monitoring aces -->
<!-- Comment: Mon Aug  6 15;50;50 comment by...monitoring aces -->
They were rebooting a crate.


<!-- Date: Mon Aug 6 15:52:19 2001 -->
<font color=red>Shift Summary: </font><pre>No beam - work on various issues by ACEs/experts.   
</pre> 
<!-- Author: John -->


<!-- Date: Mon Aug 6 16:09:24 2001 -->
<pre>Run Control was getting stuck during the ColdWarmStart  
transition, just after fetching the run number. 
 
I traced it to the Run Control database session waiting  
on a lock on the RUNSETS table.   Did not have time to  
trace who had the lock.    Bounced the database in order  
to clear it by brute force.   Seems to have worked. 
 
</pre>
<!-- Author: W.Badgett -->