<!-- Title: Eve shift. Wed May 16, 2007 -->
<!-- SciCo: Krzysztof Sliwa -->
<!-- DAQAce: Guido Volpi -->
<!-- MonAce: &nbsp; -->
<!-- CO: David Mielnicki -->
<!-- OpManager: Max Goncharov -->
<!-- Notes: -->
<pre>CDF access underway, no estimate yet for when it will end</pre>


<!-- Date: Wed May 16 16:06:58.560 2007 -->
I let David, our CO, go, I have his cell phone number in case we need him later on
<!-- Author: krzysztof :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241933' target=_top>241933</a>) -->

<!-- Date: Wed May 16 16:08:02.831 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241933>241933</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] put svtin with xft only 
<!-- Author: Koji -->


<!-- Date: Wed May 16 16:14:53.540 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241934>241934</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] 
<!-- Author: guido -->


<!-- Date: Wed May 16 16:24:49.259 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241935>241935</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] 
<!-- Author: guido -->


<!-- Date: Wed May 16 16:30:22.035 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241936>241936</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] 
<!-- Author: guido -->


<!-- Date: Wed May 16 17:09:08.666 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241941>241941</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] 
<!-- Author: guido -->


<!-- Date: Wed May 16 17:11:57.653 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241940>241940</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] 
<!-- Author: guido -->


<!-- Date: Wed May 16 17:17:58.810 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241942>241942</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] 
<!-- Author: guido -->



<!-- Date: Wed May 16 17:28:11.697 2007 -->
EM_TIMING_00 was removed by the configuration.
<!-- Author: guido :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241944' target=_top>241944</a>) -->

<!-- Date: Wed May 16 17:39:54.488 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241946>241946</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] 
<!-- Author: guido -->



<!-- Date: Wed May 16 17:53:10.756 2007 -->
<pre>from the RunCoordinator eLog: 
 
CDF Update:   
 
    * Current Status: 
          o CDF has found a leak on an Aluminum manifold inside that they will not be able to repair tonight.  In addition, experts believe they have found another hole in the system with a borescope.   Experts will continue to check out the system this evening and then will start the process of closing up.  
          o The leak will not be fixed on this access.  CDF experts will go back to the drawing board and figure out what to do next. 
    * 11pm:   
          o CDF experts go home for the night. 
          o We had looked into getting a special search and secure to run studies overnight, but CDF is in a configuration with the BLMs down and no abort protection.   No studies for the night. 
    * Overnight: 
          o The Tevatron Machine Coordinator will leave turn on instructions. 
    * 6am: 
          o CDF resumes their access and will start to close the steel. 
    * ?10am: 
          o CDF access complete 
          o Search and Secure CDF. 
 
</pre>
<!-- Author: krzysztof :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241946' target=_top>241946</a>) -->

<!-- Date: Wed May 16 18:15:00.733 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241949>241949</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] start L2CAL test (no xft ) reces is ignored in both systems
<!-- Author: guido -->
<!-- Comment: Wed May 16 18;34;54 comment by...L2 -->
We are running with BOTH SYSTEMS in !!!!!!!! 

<!-- Comment: Wed May 16 18;39;07 comment by...L2 -->
with both new system in, we had a few decision timeouts earlier, but when we started this new run, it has been running smooth for a while. trying to understand the problem seen earlier, we decided to increase the L1A rate to stress the system more... from 41KHz to
45Khz FredL1A... deadtime went up from 5.5% to ~8%. so far so good.

<!-- Comment: Wed May 16 18;45;05 comment by...L2 -->
now with FredL1A up to 56KHz, deadtime at 21%... not bad. this is the first time we are pushing the L1A rate way beyond 41KHz. we are learning something new.

<!-- Comment: Wed May 16 18;45;52 comment by...L2 -->
note that this is still without RECES... not yet. 

<!-- Comment: Wed May 16 19;08;27 comment by...L2 -->
now with FredL1A at ~64KHz, deadtime at 34%, final L1A at ~51KHz.
tried HRR by hand a few times. the first 2 manual HRR caused
decision timeout, but couldn't reproduce it since. will keep trying.

<!-- Date: Wed May 16 19:29:46.223 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241949>241949</A>
TERMINATE: end of the run wit both systems working together 
<!-- Author: guido -->


<!-- Date: Wed May 16 19:34:07.743 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241950>241950</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] start test L2CAL+XFT (just commented out the cout)
<!-- Author: guido -->


<!-- Date: Wed May 16 20:07:16.900 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241952>241952</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] start test L2CAL+XFT together; the commetns are back in 
<!-- Author: guido -->


<!-- Date: Wed May 16 20:20:35.222 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241953>241953</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] test with the main system only (still reces ignored)
<!-- Author: guido -->
<!-- Comment: Wed May 16 20;23;32 comment by...L2 -->
this run is to see if manual HRRs can cause decision timeouts for the default system as well.

<!-- Date: Wed May 16 20:36:06.597 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241954>241954</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] 
<!-- Author: guido -->


<!-- Date: Wed May 16 20:37:21.177 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241954>241954</A>
TERMINATE: mistake .. both in !
<!-- Author: guido -->


<!-- Date: Wed May 16 20:48:06.924 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241955>241955</A>
TERMINATE: L2CAL in, XFT out, RECES out, parasitic: 14 manual HRR's before L2 DTO from waiting for L2CAL3.
<!-- Author: dan -->


<!-- Date: Wed May 16 20:49:38.667 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241956>241956</A>
ACTIVATE: RunSet: COT_ACE ASDQ calibration to check electronics after ISL access
<!-- Author: Eiko X 2080 -->



<!-- Date: Wed May 16 21:02:03.592 2007 -->
<pre>==== Summary: what we learned this afternoon === 
 
(1) With L2_Torture run, we first had trouble with decision timeouts... this even happens with the default system alone. excluding RECES was the solution.  
 
(2) after we ignore the RECES in the new system (hard coded in 
the CPU software, this needs to be automated via runcontrol soon), we were able to run much longer without decision timeouts... but still, from time to time, we encounter DTOs. 
we tried L2CAL alone, XFT alone, and L2CAL+XFT combinations. 
the only configuration didn't have DTOs was with L2CAL alone. but the run wasn't long enough to be conclusive. 
 
(3) later in the afternoon, the DTOs problem disappeared totally, 
even with L2CAL+XFT combo configuration... this happened without any new changes to the system. this is still puzzling. nevertheless, we were able to push the FREDL1A up to 64KHz to stress the new system, without problem. This is good. 
 
(4) we then decided to do manual HRRs, and see how the system recovers. From time to time, a manual HRR can cause decision timeouts, and another HRR solves the problem. This seems to be a feature related to the new system, because we did the same thing with the default system alone, and there is no problem like this. 
 
anyway, Eiko and Bob are here for COT testing, and we are hungry, 
so we will give the system to Eiko for now. and will test the system with RECES again later... to see if the RECES problem is still there. </pre>
<!-- Author: L2 (Anadi, Laura, Dan/Ted) -->
<!-- Comment: Wed May 16 21;04;08 comment by...Ted -->
 Anadi and Laura will stay here to finish the RECES test.

<!-- Date: Wed May 16 21:05:51.767 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241957>241957</A>
ACTIVATE: RunSet: COTCALIB_ACE 
<!-- Author: Eiko X 2080 -->


<!-- Date: Wed May 16 21:10:18.289 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241957>241957</A>
CALIBRATION: <U><B>cot</B></U> calibration <A HREF=http://www-cdfonline.fnal.gov/internal/daq/Calibrations/web.html#cot target=_calibresults>results</A> ready for review
<!-- Author: CDFCALIB -->


<!-- Date: Wed May 16 21:16:51.976 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241958>241958</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] running the main system only with reces enable
<!-- Author: guido -->



<!-- Date: Wed May 16 21:16:54.902 2007 -->
Dirac replacement (Rack 2RR28c - slot 14). 
Today with Carla we tested a lot a strange effect we saw in l2cal pulsars side (1 LVDS line stucked to 1). 
We discovered that the problem was the Dirac (probably it didn't drive correctly the splitted cable), so we replaced it. 
<!-- Author: Lucas and Laura -->


<!-- Date: Wed May 16 21:18:25.889 2007 -->
<pre>COT check out after the access: 
  
  We performed ASDQ calibration and compared the results with those  
on May 15th (before opening the plugs). We didnt see new dead  
channels or hot channels caused by the access. Superlayer 4 cells  
80-81 are a little warmer than yesterday (occupancy changed from  
1.05 to 1.10), but these two cells have become warm and quiet from time to time. We expect them to be colder after closing the plugs. 
</pre>
<!-- Author: Shin-Shan Yu (Eiko) -->

<!-- Date: Wed May 16 21:30:32.658 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241958>241958</A>
TERMINATE: end of run with main only and reces included
<!-- Author: guido -->


<!-- Date: Wed May 16 21:36:08.672 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241959>241959</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] start the (final) test of MAIN+ L2CAL + XFT (reces is enables in both)
<!-- Author: guido -->


<!-- Date: Wed May 16 21:36:09.547 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241959>241959</A>
TERMINATE: mistake .... 
<!-- Author: guido -->


<!-- Date: Wed May 16 21:40:30.009 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241960>241960</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] test the MAIN + L2CAL + XFT (reces in)
<!-- Author: guido -->


<!-- Date: Wed May 16 22:10:36.862 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241960>241960</A>
TERMINATE: end the run with all in 
<!-- Author: guido -->


<!-- Date: Wed May 16 22:16:12.107 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241961>241961</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] start the test which should run all night
<!-- Author: guido -->
<!-- Comment: Wed May 16 22;19;01 comment by...Anadi, Laura, Dan/Ted -->
Finally we have put the full system together (with Reces, with new L2CAL and XFT) and we are running the system with L2TORTURE without problem. This is the best we could do (to stress the new system) without beam. We are ready to request the beam run tomorrow, hopefully at the beginning of store.


<!-- Date: Wed May 16 22:52:28.858 2007 -->
<h3> Today access </h3> 
We went in again for our n<sup>th</sup> access day  in a row to chase for the ISL PCE leak. This time the plug was pulled so we could access to the innermost parts of the detector. Doug Glenzinski and Ken Schultz worked in the bore assisted by Warren and Ulrich. It was quite rapidly determined that the leak was localized inside the silicon baggie. They introduced two catheters from the supply and return ends of the line (Portcard East): the leak was isolated to the Aluminum manifold and the cilran-Al connections (innermost possible part). The boroscope revealed several "brownish" features inside of the Al manifold. One of them was identified with a hole. 
 
<p>We have checkout SVX east: no new errors appeared. We are bringing SVX and ISL cooling set points to -6 and 10 C. 
 
<p>More details about what happened can be found as usual in the silicon <a href=http://www-cdfonline.fnal.gov/cgi/elog/det-system-elog.pl?nb=silicon&action=view&page=last&scroll=true>e-log</a>.  
<!-- Author: The Silis -->
<!-- Comment: Wed May 16 22;56;17 comment by...The Silis -->
As Drendel predicted we are going home now...
<pre>
17:40:33- CDF Update:  
...
11pm:  
    * CDF experts go home for the night.
    * We had looked into getting a special search and secure to run studies overnight, but CDF is in a configuration with the BLMs down and no abort protection.   No studies for the night.
</pre>
<!-- Comment: Wed May 16 23;11;58 comment by...Peter -->
The prediction is actually from Convery/Wilson as reported by Drendel!
<!-- Date: Wed May 16 22:53:43.467 2007 -->
<pre>Some PSM additions: 
 
The following supplies were added to the Voltman 
PC for monitoring: 
 
1RR06F_1 (NIM_CAMAC, Address 101) 
1RR15E_1 (VME, Address 133) 
1RR27C_2 (Alacrity 1, Address 246) 
1RR30D_1 (Alacrity 1.3, Address 48) 
2RR02E_2 (NIM_CAMAC, Address 118) 
2RR22I_1 (NIM_CAMAC, Address 115) 
22R33C_2 (NIM_CAMAC, Address 86) 
 
All but 1RR06F_1 have been masked, as I  
have, so far, only partially updated  
the iFix Pages for these new locations. 
 
</pre>
<!-- Author: Ben W -->


<!-- Date: Wed May 16 22:55:01.399 2007 -->
L2 DTO. auto-HRR fiexed it.. for few seconds. The next manual HRR seems to work.
<!-- Author: guido :: (run <a href='/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241961' target=_top>241961</a>) -->


<!-- Date: Wed May 16 23:10:49.067 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241963>241963</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633] non-parasitic test, MAIN system only, for benchmark comparison
<!-- Author: guido -->



<!-- Date: Wed May 16 23:42:45.450 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241965>241965</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633]
 testing L2 parasitic configuration with FILAR0: MAIN; FILAR1: CAL; FILAR2: XFT
<!-- Author: guido -->



<!-- Date: Wed May 16 23:51:35.964 2007 -->
<font color=red>Shift Summary: </font><pre>16:00  CDF access underway, L2 upgrade tests 
                
17:50  the leak was isolated to the Aluminum manifold and the cilran-Al connections  
       (innermost possible part). This cannot be repaired during current access 
        
16:21  COT check out after the access succesfull; no new dead or hot channels caused by the access 
        
18:00  Ben Whitehouse working on adding new power supplies to the Voltman system 
 
22:16  L2 upgrade crew were able to put together a system (with Reces, new L2CAL and XFT) that  
       was running with L2TORTURE without problem; they want A LONG RUN with it to test it better 
        
22:52  silicon crew checked SVX east; no new errors found 
 
22:53  Ben added 7 new supplies to the Voltman system, so far one included in updated iFix pages, 
       the remaining 6 masked for the time being 
        
        
23:30  Andrew playing with L2 configuration, investigating deadtime; after he is done, the plan is  
       to leave the NEW L2 system running for as long as possible</pre> 
<br><b>End of Shift Numbers</b>
<table><tr><td width=60% align=left>
<b>CDF Run II <p></b>                       
<pre>
Runs                   none
Delivered Luminosity   0  
Acquired Luminosity    0  
Efficiency             na
   
</td></tr></table></pre>
<!-- Author: krzysztof -->
<!-- Comment: Wed May 16 23;54;02 comment by...krzysztof -->
CDF access will resume at 6 am 

<!-- Date: Wed May 16 23:56:10.441 2007 -->
<TABLE BORDER=2 CELLSPACING=1 CELLPADDING=1 BGCOLOR=WHITE>
<TR BGCOLOR=YELLOW><TH>RunNumber</TH>
<TH>DataType</TH>
<TH>PhysicsTable</TH>
<TH>Begin</TH>
<TH>End</TH>
<TH>LiveTime</TH>
<TH>L3Accepts</TH>
<TH>DelivLumi nb<SUP>-1</SUP></TH>
<TH>LiveLumi nb<SUP>-1</SUP></TH>
<TH>GR</TH>
<TH>SC</TH>
<TH>RC</TH></TR>
<TR><TD>Totals</TD>
<TD> </TD>
<TD> </TD>
<TD> </TD>
<TD>23:55:01</TD>
<TD ALIGN=CENTER>::</TD>
<TD ALIGN=RIGHT></TD>               <TD ALIGN=RIGHT></TD>
<TD ALIGN=RIGHT></TD>
<TD> </TD>
<TD> </TD>
<TD> </TD></TR>

</TABLE>
<!-- Author: End of Shift Report -->


<!-- Date: Thu May 17 00:01:56.667 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241966>241966</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633]
 L2 parasitic configuration: 
   FILAR0: MAIN + big L2CAL; FILAR1: L2CAL + CLUSTER; FILAR2: XFT
<!-- Author: guido -->


<!-- Date: Thu May 17 00:01:56.789 2007 -->
Run <A HREF=/java/cdfdb/servlet/RunSummary?RUN_NUMBER=241966>241966</A>
ACTIVATE: RunSet: L2TORTURE  Trigger: L2_TORTURE [18,791,633]
 L2 parasitic configuration: 
   FILAR0: MAIN + big L2CAL; FILAR1: L2CAL + CLUSTER; FILAR2: XFT
<!-- Author: guido -->