<!-- Title: 08:30:31  Mon Mar 22 2004 -->
<!-- Crewchief: New day -->
<!-- Op1: &nbsp; -->
<!-- Op2: &nbsp; -->
<!-- Op3: &nbsp; -->
<!-- Op4: &nbsp; -->
<!-- Op5: &nbsp; -->
<!-- Op6: &nbsp; -->
<!-- Notes: -->
<pre>database activity</pre>


<!-- Date: Mon Mar 22 08:31:23 2004 -->
<pre>streams calib simulation test full day & interrupt network interruption for 1 hour.  from 1pm to 2pm</pre>
<!-- Author: nstanfield -->
<!-- Comment: Mon Mar 22 12;41;19 comment by...nstanfield  -->
<pre>...   there was some confusion so Matt did not start the simulation this a.m   He will be starting it by 1:30 ...then
Richard will interrupt the network at 3:30....

Unless someome wants to reschedule for tomorrow!     Matt
will run for 12 hours starting at 1:30 then we will interrupt the network for 1 hour at 3:30  </pre>
<!-- Comment: Mon Mar 22 14;26;35 comment by...ns -->
<pre>Hi Nelly,
                 The test is running. It should finish at about 4am 
tomorrow morning.

cheers

Mat</pre>
<!-- Comment: Mon Mar 22 16;45;30 comment by...nstanfield  -->
<pre>Richard --&gt; made network unavailable --&gt; 2 types of errors received thru OEM...   

error 1. 

Name : cdfonint_alert_log
Target Name : cdfonint
Target Type : Database
Node Name : b0dau36.fnal.gov
Status : WARNING

Alert
The following errors are in the ALERT file : ORA-12535: TNS:operation timed out.
WARNING
Mar 22 2004 04:37:16 PM


Error 2

&gt; Alert
&gt; The following errors are in the ALERT file : ORA-12012: error on auto
execute of job 175592 ORA-02068: following severe error from CDFREP23 ORA-03113: end-of-file on communication channel ORA-02068: following severe
error from CDFREP23 ORA-03113: end-of-file on communication channel ORA-25254: time-out in LISTEN while waiting for a message ORA-06512: at
"SYS.DBMS_AQADM_SYS", line 5642 ORA-06512: at "SYS.DBMS_AQADM_SYS", line
6067 ORA-06512: at "SYS.DBMS_AQADM", line 895 ORA-06512: at line 1.
&gt; WARNING
&gt; Mar 22 2004 04:17:16 

</pre>
<!-- Comment: Mon Mar 22 17;06;04 comment by...nstanfield  -->
<pre>richard reconnecting network for fcdfora5...  simulation will run till 4am.   

we have 18G available in the archive area /dbs4 
</pre>
<!-- Comment: Tue Mar 23 09;32;28 comment by...ns  -->
<pre>***no space alert.. i have snapshots of before & after the run and i see no changes..    for cdfonint & cdfrep23...

**** 103 archives created each 10M in size..during Matt's
12 hour simulation run   between 1:30 p.m. and 4 a.m.  

*****richard made network unavailable between 4 & 5 p.m.  </pre>
<!-- Date: Mon Mar 22 08:41:53 2004 -->
<pre>new externally authenticated acct on dev &int & prd with 
create sessions and good_run_czar role. 
 
 
Dera CDF Db'ers, 
 
Could you please create an externally authenticated 
account called "cdfdqm" on cdfonint and cdfonprd?  With 
the GOOD_RUN_CZAR role? 
 
Mario Martinez-Perez &lt;mmp@fnal.gov&gt; will be the primary 
person responsible for this account. 
 
Thanks, 
Bill 
</pre>
<!-- Author: nstanfield  -->


<!-- Date: Mon Mar 22 09:21:44 2004 -->
<pre>several alerts now on incomplete queries due insufficient undo  
 
undo_retention 900 
 
compared to cdfonprd 
undo_retention3600 
 
changed on cdfrep01  : 
 
Connected. 
SQL&gt; alter system set undo_retention=1800; 
 
System altered. 
 
 
 
&gt; Name : cdfrep01_alert_log 
&gt; Target Name : cdfrep01.fnal.gov 
&gt; Target Type : Database 
&gt; Node Name : fcdflnx1.fnal.gov 
&gt; Status : WARNING 
&gt;  
&gt; Alert 
&gt; The following errors are in the ALERT file : ORA-01555 caused by SQL statement below (Query Duration=8039 sec, SCN: 0x050d.f95e2e8a):. 
&gt; WARNING 
&gt; Mar 22 2004 04:17:04 AM 
 
SELECT * FROM COTCHANT0 where COTCHANT0.CID in (294536,294664,296046,299155,299295,299437,300794,302450,303008,304030,304824,305279,305745,306892,307122,309409,310343,311912,312102) 
&gt; </pre>
<!-- Author: nstanfield  -->


<!-- Date: Mon Mar 22 14:18:13 2004 -->
<pre>
Target Name : cdfofpr1.fnal.gov 
Target Type : Database 
Node Name : fcdfora4.fnal.gov 
Status : CRITICAL 

Multiple Extents 
Segment SAMPRD.CONF_CFS_FK_I in tablespace PARTITIONED_IDX_01 is comprised of 429 extents. Segment SAMPRD.DFLOC_VOL_FK_I in tablespace PARTITIONED_IDX_01 is comprised of 406 extents. Segment HERBER.EN_FILES_FILE_BASE_FK in tablespace USERDATA_01 is comprised of 401 extents. Segment HDWDB_PRD_REP.SYS_LOB0000012087C00005$$ in tablespace HDWDB_PRD_REP_DATA is comprised of 1563 extents. 
CRITICAL 
Mar 22 2004 02:17:32 PM 



</pre>
<!-- Author: oem-admin (email) -->




<!-- Date: Mon Mar 22 15:44:37 2004 -->
<pre>Dmitri 
 
I spoke to Jeff and we maybe able to get the full rman to another machine for testing altho' we do not have a machine that will house the full PRODUCTION instance. 
 
&gt; the cdfonprd rman to ANOTHER HOST  since we don't have room on dau35? 
&gt;it can be copied *to* anywhere, from b0backup. this host is not totally 
kerberos-kosher... 
 
My investigation of the cadserv2 machine(Sun platform) will allow us to test with development (cdfondev)  rman.... altho'  there is not enough disk space for testing with production (cdfonprd) rman. 
 
In summary, we will forge ahead (next week) and test a full db recovery (using cdfondev) to another host....but we will not be able to follow-up with cdfonprd. 
 
As I mentioned earlier,   we need to have same platform for testing a 'Restoring a Database to another host' http://www-css.fnal.gov/dsg/internal/backups/compatible_hardwarehtm.htm 
We don't have any other Sun machines available. 
 
Nelly</pre>
<!-- Author: nstanfield  -->
<!-- Comment: Mon Mar 22 16;37;29 comment by...sb -->
<pre>Nelly,

we have second SUN which should be used for restore/testing rman's in
future but do not know how fast we can make it avaliable now.
FYI: We have Gb Ethernet now in B0 and have extra space for DB computers
so cdfdata012 could be moved in B0 close to PRD DB.

Sergei.

</pre>



<!-- Date: Tue Mar 23 00:01:21 2004 -->
<pre>
Target Name : cdfofpr1.fnal.gov 
Target Type : Database 
Node Name : fcdfora4.fnal.gov 
Status : CLEARED 

Alert 
Event test "Alert" is cleared 
CLEARED 
Mar 23 2004 12:00:47 AM 



</pre>
<!-- Author: oem-admin (email) -->


<!-- Date: Tue Mar 23 00:04:00 2004 -->
<pre>
Target Name : cdfonprd 
Target Type : Database 
Node Name : b0dau35.fnal.gov 
Status : CLEARED 

Alert 
Event test "Alert" is cleared 
CLEARED 
Mar 23 2004 12:03:16 AM 



</pre>
<!-- Author: oem-admin (email) -->