Tuesday, 14 February 2017

Move OCR/Voting Disk/SPFILE to New ASM Disk Group on Exadata

Overview
In Oracle database 11.2 and above it is recommended to place the OCR and voting disks in ASM disk group. In my case the OCR, Voting disk and SPFILE are stored in +DBFS_DG disk group. I would like to move them to +DATA disk group. The ASM disk groups are configured using ASM Normal redundancy for protection.

 In this article I will demonstrate how move/replace OCR, Voting disk and SPFILE from one disk group to another ASM disk group.

 Environment

  • Oracle Exadata X2-2
  • ASM Disk Groups +DATA, +RECO, +DBFS_DG
  • Oracle GI/RDBMS version 11.2.0.4

Steps to move/replacec OCR/Voting disk/SPFILE to new disk group.

  • Locate the current OCR, Voting disk  and SPFILE locations

OCR file location:

 [root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       4808
         Available space (kbytes) :     257312
         ID                       : 1556021409
         Device/File Name         :   +DBFS_DG
                                    Device/File integrity check succeeded

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

          Cluster registry integrity check succeeded

          Logical corruption check succeeded

 Voting Disk location:

 dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   8f84a639c9ac4fbabf581bb6972f3f8f (o/192.168.1.9/DBFS_DG_CD_02_dm01cel01) [DBFS_DG]
 2. ONLINE   3b079cf1cba24f42bfda7a8b18f0e22f (o/192.168.1.10/DBFS_DG_CD_02_dm01cel02) [DBFS_DG]
 3. ONLINE   ad837de087dd4f6bbf72800ecd028573 (o/192.168.1.11/DBFS_DG_CD_07_dm01cel03) [DBFS_DG]

 ASM SPFILE location:

 SQL> show parameter spfile

 NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
spfile                               string      +DBFS_DG/dm01-cluster/asmparameterfile/registry.253.790181847

  • Create New ASM diskgroup with suitable redundancy for OCR and Voting files.

Here I am moving OCR/Voting disks from +DBFS_DG to +DATA with NORMAL redundancy
The disk group +DATA already exists.

  • Ensure that the new diskgroup is mounted on all cluster nodes.

ASMCMD> lsdg
State    Type    Rebal  Sector  Block       AU  Total_MB   Free_MB  Req_mir_free_MB  Usable_file_MB  
Offline_disks  Voting_files  Name
MOUNTED  NORMAL  N         512   4096  4194304  71470080  58440508           433152        29003678              
0             N  DATA/
MOUNTED  NORMAL  N         512   4096  4194304   4085888   4068444            29824         2019310              
0             Y  DBFS_DG/
MOUNTED  NORMAL  N         512   4096  4194304   9460160   7874420           108224         3883098              
0             N  RECO/

 SQL> select name, state, type from v$asm_diskgroup;

 NAME                           STATE       TYPE
------------------------------ ----------- ------
DATA                           MOUNTED     NORMAL
DBFS_DG                        MOUNTED     NORMAL
RECO                           MOUNTED     NORMAL

  • Move OCR and Vote file from +DBFS_DG to +DATA

dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/ocrconfig -add +DATA
PROT-20: Insufficient permission to proceed. Require privileged user

 Switch to root user and execute the command again.

 [root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrconfig -add +DATA

 [root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       4808
         Available space (kbytes) :     257312
         ID                       : 1556021409
         Device/File Name         :   +DBFS_DG
                                    Device/File integrity check succeeded
         Device/File Name         : +DATA
                                    Device/File integrity check succeeded

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

          Cluster registry integrity check succeeded

          Logical corruption check succeeded

 [root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrconfig -delete +DBFS_DG

 [root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       4808
         Available space (kbytes) :     257312
         ID                       : 1556021409
         Device/File Name         : +DATA
                                    Device/File integrity check succeeded

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

          Cluster registry integrity check succeeded

          Logical corruption check succeeded

 [root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/crsctl replace votedisk +DATA
Successful addition of voting disk 560494cd61f64fd3bfeca18aa876e5bc.
Successful addition of voting disk 15b8c8b5b80c4f7cbf3eadd516af60bc.
Successful addition of voting disk 7cff6119f09b4f99bfd0d6a1fd399a00.
Successful deletion of voting disk 8f84a639c9ac4fbabf581bb6972f3f8f.
Successful deletion of voting disk 3b079cf1cba24f42bfda7a8b18f0e22f.
Successful deletion of voting disk ad837de087dd4f6bbf72800ecd028573.
Successfully replaced voting disk group with +DATA.
CRS-4266: Voting file(s) successfully replaced

[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   560494cd61f64fd3bfeca18aa876e5bc (o/192.168.3.10/DATA_CD_00_dm01cel02) [DATA]
 2. ONLINE   15b8c8b5b80c4f7cbf3eadd516af60bc (o/192.168.3.11/DATA_CD_10_dm01cel03) [DATA]
 3. ONLINE   7cff6119f09b4f99bfd0d6a1fd399a00 (o/192.168.3.12/DATA_CD_00_dm01cel04) [DATA]
Located 3 voting disk(s).

  • Change ASM SPFILE location from +DBFS_DG to +DATA Diskgroup.

SQL> show parameter spfile

 NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
spfile                               string      +DBFS_DG/dm01-cluster/asmparameterfile/registry.253.790181847

 SQL> create pfile='/tmp/initasm.ora' from spfile;

 File created.

 SQL> create spfile='+DATA' from pfile='/tmp/initasm.ora';

 File created.

 Now GPNPTOOL will get updated with new ASM SPFILE location.

 That can be verified by below command :

 dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/gpnptool get
Warning: some command line parameters were defaulted. Resulting command line:
         /u01/app/11.2.0.4/grid/bin/gpnptool.bin get -o-<?xml version="1.0" encoding="UTF-8"?><gpnp:GPnP-Profile Version="1.0" xmlns="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:gpnp="http://www.grid-pnp.org/2005/11/gpnp-profile"xmlns:orcl="http://www.oracle.com/gpnp/2005/11/gpnp-profile" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.grid-pnp.org/2005/11/gpnp-profile gpnp-profile.xsd" ProfileSequence="5" 
ClusterUId="154e3eadf63effb1bf594bae93566a45" ClusterName="dm01-cluster" PALocation=""><gpnp:Network-Profile><gpnp:HostNetwork id="gen" HostName="*"><gpnp:Network id="net1" IP="10.204.26.1" Adapter="bondeth0" Use="public"/><gpnp:Network id="net2" IP="192.168.0.0" Adapter="bondib0" Use="cluster_interconnect"/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profile id="css" DiscoveryString="+asm" LeaseDuration="400"/><orcl:ASM-Profile id="asm" DiscoveryString="o/*/*" SPFile="+DATA/dm01-cluster/asmparameterfile/registry.253.934093287"/><ds:Signature xmlns:ds="http://www.w3.org/2000/09/xmldsig#"><ds:SignedInfo><ds:CanonicalizationMethod 
Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/><ds:SignatureMethod Algorithm="http://www.w3.org/2000/09/xmldsig#rsa-sha1"/><ds:Reference URI=""><ds:Transforms><ds:Transform Algorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/><ds:Transform Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"> <InclusiveNamespaces xmlns="http://www.w3.org/2001/10/xml-exc-c14n#" PrefixList="gpnp orcl xsi"/></ds:Transform></ds:Transforms><ds:DigestMethod Algorithm="http://www.w3.org/2000/09/xmldsig#sha1"/>ds:DigestValue>SEdtgDVCAmvafpr2sb2YbZh0NvE=</ds:DigestValue></ds:Reference></ds:SignedInfo> ds:SignatureValue>AcWa+ZnR6F+qAoCAy3uqZPSdxPbYnXpMbaTozjfeQb0HEtQsK7nT3r
+jO8AZkFUXqvSZa77D9d18/mYPXiPdQKJndpr+4cIM1Yg8K+fSC4HgD8hUgh5vl7YYJ2T9YoYVyfSbX6EQFOKZMKHM5IGZk0d8ls+4AD/1OO+LhijtEM4=</ds:SignatureValue></ds:Signature></gpnp:GPnP-Profile>
Success.

  • Shutdown and Start the CRS on all the nodes

[root@dm01db01 ~]# dcli -g dbs_group -l root '/u01/app/11.2.0.4/grid/bin/crsctl stop crs'
dm01db01: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.crsd' on 'dm01db01'
dm01db01: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.DATA_dm01.dg' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.DBFS_DG.dg' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.RECO_dm01.dg' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.registry.acfs' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.dm01db01.vip' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ttsrv_dm01db01' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.LISTENER_IB.lsnr' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ttsrv_dm01db01' on 'dm01db01' succeeded
dm01db01: CRS-2673: Attempting to stop 'ttrmi_dm01db01' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ora.LISTENER_IB.lsnr' on 'dm01db01' succeeded
dm01db01: CRS-2673: Attempting to stop 'ora.dm01db01-ibvip.vip' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ttrmi_dm01db01' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.dm01db01.vip' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.RECO_dm01.dg' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.dm01db01-ibvip.vip' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.registry.acfs' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.DATA_dm01.dg' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.DBFS_DG.dg' on 'dm01db01' succeeded
dm01db01: CRS-2679: Attempting to clean 'ora.DBFS_DG.dg' on 'dm01db01'
dm01db01: CRS-2681: Clean of 'ora.DBFS_DG.dg' on 'dm01db01' succeeded
dm01db01: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ora.asm' on 'dm01db01' succeeded
dm01db01: CRS-2673: Attempting to stop 'ora.net2.network' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.ons' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ora.net2.network' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.ons' on 'dm01db01' succeeded
dm01db01: CRS-2673: Attempting to stop 'ora.net1.network' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ora.net1.network' on 'dm01db01' succeeded
dm01db01: CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'dm01db01' has completed
dm01db01: CRS-2677: Stop of 'ora.crsd' on 'dm01db01' succeeded
dm01db01: CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.ctssd' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.evmd' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.mdnsd' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ora.ctssd' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.mdnsd' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.evmd' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.asm' on 'dm01db01' succeeded
dm01db01: CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ora.drivers.acfs' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'dm01db01' succeeded
dm01db01: CRS-2673: Attempting to stop 'ora.cssd' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ora.cssd' on 'dm01db01' succeeded
dm01db01: CRS-2673: Attempting to stop 'ora.diskmon' on 'dm01db01'
dm01db01: CRS-2673: Attempting to stop 'ora.crf' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ora.crf' on 'dm01db01' succeeded
dm01db01: CRS-2673: Attempting to stop 'ora.gipcd' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ora.diskmon' on 'dm01db01' succeeded
dm01db01: CRS-2677: Stop of 'ora.gipcd' on 'dm01db01' succeeded
dm01db01: CRS-2673: Attempting to stop 'ora.gpnpd' on 'dm01db01'
dm01db01: CRS-2677: Stop of 'ora.gpnpd' on 'dm01db01' succeeded
dm01db01: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'dm01db01' has completed
dm01db01: CRS-4133: Oracle High Availability Services has been stopped.
dm01db02: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.crsd' on 'dm01db02'
dm01db02: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.LISTENER_IB.lsnr' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ttsrv_dm01db02' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.DATA_dm01.dg' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.DBFS_DG.dg' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.RECO_dm01.dg' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.registry.acfs' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ttsrv_dm01db02' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ttrmi_dm01db02' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ttrmi_dm01db02' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.LISTENER_IB.lsnr' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.dm01db02-ibvip.vip' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.dm01db02.vip' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.scan1.vip' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.RECO_dm01.dg' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.registry.acfs' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.dm01db02.vip' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.scan1.vip' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.dm01db02-ibvip.vip' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.DATA_dm01.dg' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.DBFS_DG.dg' on 'dm01db02' succeeded
dm01db02: CRS-2679: Attempting to clean 'ora.DBFS_DG.dg' on 'dm01db02'
dm01db02: CRS-2681: Clean of 'ora.DBFS_DG.dg' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.asm' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.net2.network' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.ons' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.net2.network' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.ons' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.net1.network' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.net1.network' on 'dm01db02' succeeded
dm01db02: CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'dm01db02' has completed
dm01db02: CRS-2677: Stop of 'ora.crsd' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.ctssd' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.evmd' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.mdnsd' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.evmd' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.mdnsd' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.ctssd' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.asm' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.cssd' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.cssd' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.diskmon' on 'dm01db02'
dm01db02: CRS-2673: Attempting to stop 'ora.crf' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.drivers.acfs' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.crf' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.gipcd' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.diskmon' on 'dm01db02' succeeded
dm01db02: CRS-2677: Stop of 'ora.gipcd' on 'dm01db02' succeeded
dm01db02: CRS-2673: Attempting to stop 'ora.gpnpd' on 'dm01db02'
dm01db02: CRS-2677: Stop of 'ora.gpnpd' on 'dm01db02' succeeded
dm01db02: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'dm01db02' has completed
dm01db02: CRS-4133: Oracle High Availability Services has been stopped.
dm01db03: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.crsd' on 'dm01db03'
dm01db03: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ttrmi_dm01db03' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.DATA_dm01.dg' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.DBFS_DG.dg' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.RECO_dm01.dg' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.registry.acfs' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.LISTENER_IB.lsnr' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ttrmi_dm01db03' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.RECO_dm01.dg' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'dm01db03' succeeded
dm01db03: CRS-2673: Attempting to stop 'ora.dm01db03.vip' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ora.LISTENER_IB.lsnr' on 'dm01db03' succeeded
dm01db03: CRS-2673: Attempting to stop 'ora.dm01db03-ibvip.vip' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ora.dm01db03-ibvip.vip' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.dm01db03.vip' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.registry.acfs' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.DATA_dm01.dg' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.DBFS_DG.dg' on 'dm01db03' succeeded
dm01db03: CRS-2679: Attempting to clean 'ora.DBFS_DG.dg' on 'dm01db03'
dm01db03: CRS-2681: Clean of 'ora.DBFS_DG.dg' on 'dm01db03' succeeded
dm01db03: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ora.asm' on 'dm01db03' succeeded
dm01db03: CRS-2673: Attempting to stop 'ora.ons' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.net2.network' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ora.net2.network' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.ons' on 'dm01db03' succeeded
dm01db03: CRS-2673: Attempting to stop 'ora.net1.network' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ora.net1.network' on 'dm01db03' succeeded
dm01db03: CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'dm01db03' has completed
dm01db03: CRS-2677: Stop of 'ora.crsd' on 'dm01db03' succeeded
dm01db03: CRS-2673: Attempting to stop 'ora.ctssd' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.evmd' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.mdnsd' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ora.ctssd' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.evmd' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.mdnsd' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.asm' on 'dm01db03' succeeded
dm01db03: CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'dm01db03' succeeded
dm01db03: CRS-2673: Attempting to stop 'ora.cssd' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ora.drivers.acfs' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.cssd' on 'dm01db03' succeeded
dm01db03: CRS-2673: Attempting to stop 'ora.diskmon' on 'dm01db03'
dm01db03: CRS-2673: Attempting to stop 'ora.crf' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ora.crf' on 'dm01db03' succeeded
dm01db03: CRS-2673: Attempting to stop 'ora.gipcd' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ora.diskmon' on 'dm01db03' succeeded
dm01db03: CRS-2677: Stop of 'ora.gipcd' on 'dm01db03' succeeded
dm01db03: CRS-2673: Attempting to stop 'ora.gpnpd' on 'dm01db03'
dm01db03: CRS-2677: Stop of 'ora.gpnpd' on 'dm01db03' succeeded
dm01db03: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'dm01db03' has completed
dm01db03: CRS-4133: Oracle High Availability Services has been stopped.
dm01db04: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.crsd' on 'dm01db04'
dm01db04: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ttrmi_dm01db04' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.LISTENER_IB.lsnr' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.dm01db04-ibvip.vip' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.DATA_dm01.dg' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.DBFS_DG.dg' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.RECO_dm01.dg' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.registry.acfs' on 'dm01db04'
dm01db04: CRS-2677: Stop of 'ttrmi_dm01db04' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.RECO_dm01.dg' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.dm01db04-ibvip.vip' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'dm01db04' succeeded
dm01db04: CRS-2673: Attempting to stop 'ora.dm01db04.vip' on 'dm01db04'
dm01db04: CRS-2677: Stop of 'ora.LISTENER_IB.lsnr' on 'dm01db04' succeeded
dm01db04: CRS-2673: Attempting to stop 'ora.dm01db07-ibvip.vip' on 'dm01db04'
dm01db04: CRS-2677: Stop of 'ora.dm01db04.vip' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.dm01db07-ibvip.vip' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.registry.acfs' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.DATA_dm01.dg' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.DBFS_DG.dg' on 'dm01db04' succeeded
dm01db04: CRS-2679: Attempting to clean 'ora.DBFS_DG.dg' on 'dm01db04'
dm01db04: CRS-2681: Clean of 'ora.DBFS_DG.dg' on 'dm01db04' succeeded
dm01db04: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db04'
dm01db04: CRS-2677: Stop of 'ora.asm' on 'dm01db04' succeeded
dm01db04: CRS-2673: Attempting to stop 'ora.net2.network' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.ons' on 'dm01db04'
dm01db04: CRS-2677: Stop of 'ora.net2.network' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.ons' on 'dm01db04' succeeded
dm01db04: CRS-2673: Attempting to stop 'ora.net1.network' on 'dm01db04'
dm01db04: CRS-2677: Stop of 'ora.net1.network' on 'dm01db04' succeeded
dm01db04: CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'dm01db04' has completed
dm01db04: CRS-2677: Stop of 'ora.crsd' on 'dm01db04' succeeded
dm01db04: CRS-2673: Attempting to stop 'ora.mdnsd' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.crf' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.ctssd' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.evmd' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'dm01db04'
dm01db04: CRS-2677: Stop of 'ora.crf' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.ctssd' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.evmd' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.mdnsd' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.asm' on 'dm01db04' succeeded
dm01db04: CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'dm01db04'
dm01db04: CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'dm01db04' succeeded
dm01db04: CRS-2673: Attempting to stop 'ora.cssd' on 'dm01db04'
dm01db04: CRS-2677: Stop of 'ora.drivers.acfs' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.cssd' on 'dm01db04' succeeded
dm01db04: CRS-2673: Attempting to stop 'ora.gipcd' on 'dm01db04'
dm01db04: CRS-2673: Attempting to stop 'ora.diskmon' on 'dm01db04'
dm01db04: CRS-2677: Stop of 'ora.gipcd' on 'dm01db04' succeeded
dm01db04: CRS-2673: Attempting to stop 'ora.gpnpd' on 'dm01db04'
dm01db04: CRS-2677: Stop of 'ora.diskmon' on 'dm01db04' succeeded
dm01db04: CRS-2677: Stop of 'ora.gpnpd' on 'dm01db04' succeeded
dm01db04: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'dm01db04' has completed
dm01db04: CRS-4133: Oracle High Availability Services has been stopped.
dm01db05: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.crsd' on 'dm01db05'
dm01db05: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.cvu' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.DATA_dm01.dg' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.DBFS_DG.dg' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.RECO_dm01.dg' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.registry.acfs' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ttrmi_dm01db05' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.LISTENER_IB.lsnr' on 'dm01db05'
dm01db05: CRS-2677: Stop of 'ttrmi_dm01db05' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.cvu' on 'dm01db05' succeeded
dm01db05: CRS-2672: Attempting to start 'ora.cvu' on 'dm01db08'
dm01db05: CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'dm01db05' succeeded
dm01db05: CRS-2673: Attempting to stop 'ora.scan3.vip' on 'dm01db05'
dm01db05: CRS-2677: Stop of 'ora.LISTENER_IB.lsnr' on 'dm01db05' succeeded
dm01db05: CRS-2673: Attempting to stop 'ora.dm01db05-ibvip.vip' on 'dm01db05'
dm01db05: CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'dm01db05' succeeded
dm01db05: CRS-2673: Attempting to stop 'ora.dm01db05.vip' on 'dm01db05'
dm01db05: CRS-2676: Start of 'ora.cvu' on 'dm01db08' succeeded
dm01db05: CRS-2677: Stop of 'ora.RECO_dm01.dg' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.scan3.vip' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.dm01db05-ibvip.vip' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.registry.acfs' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.dm01db05.vip' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.DATA_dm01.dg' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.DBFS_DG.dg' on 'dm01db05' succeeded
dm01db05: CRS-2679: Attempting to clean 'ora.DBFS_DG.dg' on 'dm01db05'
dm01db05: CRS-2681: Clean of 'ora.DBFS_DG.dg' on 'dm01db05' succeeded
dm01db05: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db05'
dm01db05: CRS-2677: Stop of 'ora.asm' on 'dm01db05' succeeded
dm01db05: CRS-2673: Attempting to stop 'ora.ons' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.net2.network' on 'dm01db05'
dm01db05: CRS-2677: Stop of 'ora.net2.network' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.ons' on 'dm01db05' succeeded
dm01db05: CRS-2673: Attempting to stop 'ora.net1.network' on 'dm01db05'
dm01db05: CRS-2677: Stop of 'ora.net1.network' on 'dm01db05' succeeded
dm01db05: CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'dm01db05' has completed
dm01db05: CRS-2677: Stop of 'ora.crsd' on 'dm01db05' succeeded
dm01db05: CRS-2673: Attempting to stop 'ora.mdnsd' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.crf' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.ctssd' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.evmd' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'dm01db05'
dm01db05: CRS-2677: Stop of 'ora.crf' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.mdnsd' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.evmd' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.ctssd' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.asm' on 'dm01db05' succeeded
dm01db05: CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'dm01db05'
dm01db05: CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'dm01db05' succeeded
dm01db05: CRS-2673: Attempting to stop 'ora.cssd' on 'dm01db05'
dm01db05: CRS-2677: Stop of 'ora.drivers.acfs' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.cssd' on 'dm01db05' succeeded
dm01db05: CRS-2673: Attempting to stop 'ora.gipcd' on 'dm01db05'
dm01db05: CRS-2673: Attempting to stop 'ora.diskmon' on 'dm01db05'
dm01db05: CRS-2677: Stop of 'ora.gipcd' on 'dm01db05' succeeded
dm01db05: CRS-2673: Attempting to stop 'ora.gpnpd' on 'dm01db05'
dm01db05: CRS-2677: Stop of 'ora.diskmon' on 'dm01db05' succeeded
dm01db05: CRS-2677: Stop of 'ora.gpnpd' on 'dm01db05' succeeded
dm01db05: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'dm01db05' has completed
dm01db05: CRS-4133: Oracle High Availability Services has been stopped.
dm01db06: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.crsd' on 'dm01db06'
dm01db06: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.DATA_dm01.dg' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.DBFS_DG.dg' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.RECO_dm01.dg' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.registry.acfs' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ttrmi_dm01db06' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.LISTENER_IB.lsnr' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ttrmi_dm01db06' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.LISTENER_IB.lsnr' on 'dm01db06' succeeded
dm01db06: CRS-2673: Attempting to stop 'ora.dm01db06-ibvip.vip' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'dm01db06' succeeded
dm01db06: CRS-2673: Attempting to stop 'ora.dm01db06.vip' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ora.RECO_dm01.dg' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.dm01db06.vip' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.dm01db06-ibvip.vip' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.registry.acfs' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.DATA_dm01.dg' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.DBFS_DG.dg' on 'dm01db06' succeeded
dm01db06: CRS-2679: Attempting to clean 'ora.DBFS_DG.dg' on 'dm01db06'
dm01db06: CRS-2681: Clean of 'ora.DBFS_DG.dg' on 'dm01db06' succeeded
dm01db06: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ora.asm' on 'dm01db06' succeeded
dm01db06: CRS-2673: Attempting to stop 'ora.net2.network' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.ons' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ora.net2.network' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.ons' on 'dm01db06' succeeded
dm01db06: CRS-2673: Attempting to stop 'ora.net1.network' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ora.net1.network' on 'dm01db06' succeeded
dm01db06: CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'dm01db06' has completed
dm01db06: CRS-2677: Stop of 'ora.crsd' on 'dm01db06' succeeded
dm01db06: CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.ctssd' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.evmd' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.mdnsd' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ora.ctssd' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.evmd' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.mdnsd' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.drivers.acfs' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.asm' on 'dm01db06' succeeded
dm01db06: CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'dm01db06' succeeded
dm01db06: CRS-2673: Attempting to stop 'ora.cssd' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ora.cssd' on 'dm01db06' succeeded
dm01db06: CRS-2673: Attempting to stop 'ora.diskmon' on 'dm01db06'
dm01db06: CRS-2673: Attempting to stop 'ora.crf' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ora.crf' on 'dm01db06' succeeded
dm01db06: CRS-2673: Attempting to stop 'ora.gipcd' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ora.diskmon' on 'dm01db06' succeeded
dm01db06: CRS-2677: Stop of 'ora.gipcd' on 'dm01db06' succeeded
dm01db06: CRS-2673: Attempting to stop 'ora.gpnpd' on 'dm01db06'
dm01db06: CRS-2677: Stop of 'ora.gpnpd' on 'dm01db06' succeeded
dm01db06: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'dm01db06' has completed
dm01db06: CRS-4133: Oracle High Availability Services has been stopped.
dm01db08: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.crsd' on 'dm01db08'
dm01db08: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.dm01db08.vip' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ttrmi_dm01db08' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.LISTENER_IB.lsnr' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.oc4j' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.DATA_dm01.dg' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.DBFS_DG.dg' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.RECO_dm01.dg' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.registry.acfs' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ttrmi_dm01db08' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.dm01db08.vip' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.RECO_dm01.dg' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.LISTENER_IB.lsnr' on 'dm01db08' succeeded
dm01db08: CRS-2673: Attempting to stop 'ora.dm01db08-ibvip.vip' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'dm01db08' succeeded
dm01db08: CRS-2673: Attempting to stop 'ora.scan2.vip' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.dm01db07.vip' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.cvu' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ora.cvu' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.dm01db08-ibvip.vip' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.dm01db07.vip' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.registry.acfs' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.scan2.vip' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.oc4j' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.DATA_dm01.dg' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.DBFS_DG.dg' on 'dm01db08' succeeded
dm01db08: CRS-2679: Attempting to clean 'ora.DBFS_DG.dg' on 'dm01db08'
dm01db08: CRS-2681: Clean of 'ora.DBFS_DG.dg' on 'dm01db08' succeeded
dm01db08: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ora.asm' on 'dm01db08' succeeded
dm01db08: CRS-2673: Attempting to stop 'ora.net2.network' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.ons' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ora.net2.network' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.ons' on 'dm01db08' succeeded
dm01db08: CRS-2673: Attempting to stop 'ora.net1.network' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ora.net1.network' on 'dm01db08' succeeded
dm01db08: CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'dm01db08' has completed
dm01db08: CRS-2677: Stop of 'ora.crsd' on 'dm01db08' succeeded
dm01db08: CRS-2673: Attempting to stop 'ora.ctssd' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.evmd' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.asm' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.mdnsd' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ora.ctssd' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.mdnsd' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.evmd' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.asm' on 'dm01db08' succeeded
dm01db08: CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'dm01db08' succeeded
dm01db08: CRS-2673: Attempting to stop 'ora.cssd' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ora.drivers.acfs' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.cssd' on 'dm01db08' succeeded
dm01db08: CRS-2673: Attempting to stop 'ora.diskmon' on 'dm01db08'
dm01db08: CRS-2673: Attempting to stop 'ora.crf' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ora.crf' on 'dm01db08' succeeded
dm01db08: CRS-2673: Attempting to stop 'ora.gipcd' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ora.diskmon' on 'dm01db08' succeeded
dm01db08: CRS-2677: Stop of 'ora.gipcd' on 'dm01db08' succeeded
dm01db08: CRS-2673: Attempting to stop 'ora.gpnpd' on 'dm01db08'
dm01db08: CRS-2677: Stop of 'ora.gpnpd' on 'dm01db08' succeeded
dm01db08: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'dm01db08' has completed
dm01db08: CRS-4133: Oracle High Availability Services has been stopped.

 [root@dm01db01 ~]# dcli -g dbs_group -l root '/u01/app/11.2.0.4/grid/bin/crsctl start crs'
dm01db01: CRS-4123: Oracle High Availability Services has been started.
dm01db02: CRS-4123: Oracle High Availability Services has been started.
dm01db03: CRS-4123: Oracle High Availability Services has been started.
dm01db04: CRS-4123: Oracle High Availability Services has been started.
dm01db05: CRS-4123: Oracle High Availability Services has been started.
dm01db06: CRS-4123: Oracle High Availability Services has been started.
dm01db08: CRS-4123: Oracle High Availability Services has been started.

  • Ensure ALL Cluster resources are started successfully using below sample commands :

dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl stat res -init -t
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
      1        ONLINE  ONLINE       dm01db01                 Started
ora.cluster_interconnect.haip
      1        ONLINE  ONLINE       dm01db01
ora.crf
      1        ONLINE  ONLINE       dm01db01
ora.crsd
      1        ONLINE  ONLINE       dm01db01
ora.cssd
      1        ONLINE  ONLINE       dm01db01
ora.cssdmonitor
      1        ONLINE  ONLINE       dm01db01
ora.ctssd
      1        ONLINE  ONLINE       dm01db01                 OBSERVER
ora.diskmon
      1        ONLINE  ONLINE       dm01db01
ora.drivers.acfs
      1        ONLINE  ONLINE       dm01db01
ora.evmd
      1        ONLINE  ONLINE       dm01db01
ora.gipcd
      1        ONLINE  ONLINE       dm01db01
ora.gpnpd
      1        ONLINE  ONLINE       dm01db01
ora.mdnsd
      1        ONLINE  ONLINE       dm01db01

 dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl check cluster -all
**************************************************************
dm01db01:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db02:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db03:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db04:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db05:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db06:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db07:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db08:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db01-+ASM1 {/home/oracle}:

 dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl stat res -t
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA_dm01.dg
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               ONLINE  ONLINE       dm01db07
               ONLINE  ONLINE       dm01db08
ora.DBFS_DG.dg
               ONLINE  OFFLINE      dm01db01
               ONLINE  OFFLINE      dm01db02
               ONLINE  OFFLINE      dm01db03
               ONLINE  OFFLINE      dm01db04
               ONLINE  OFFLINE      dm01db05
               ONLINE  OFFLINE      dm01db06
               ONLINE  ONLINE       dm01db07
               ONLINE  OFFLINE      dm01db08
ora.LISTENER.lsnr
               OFFLINE OFFLINE      dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               ONLINE  ONLINE       dm01db07
               ONLINE  ONLINE       dm01db08
ora.LISTENER_IB.lsnr
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               ONLINE  ONLINE       dm01db07
               ONLINE  ONLINE       dm01db08
ora.RECO_dm01.dg
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               ONLINE  ONLINE       dm01db07
               ONLINE  ONLINE       dm01db08
ora.asm
               ONLINE  ONLINE       dm01db01                 Started
               ONLINE  ONLINE       dm01db02                 Started
               ONLINE  ONLINE       dm01db03                 Started
               ONLINE  ONLINE       dm01db04                 Started
               ONLINE  ONLINE       dm01db05                 Started
               ONLINE  ONLINE       dm01db06                 Started
               ONLINE  ONLINE       dm01db07                Started
               ONLINE  ONLINE       dm01db08                 Started
ora.gsd
               OFFLINE OFFLINE      dm01db01
               OFFLINE OFFLINE      dm01db02
               OFFLINE OFFLINE      dm01db03
               OFFLINE OFFLINE      dm01db04
               OFFLINE OFFLINE      dm01db05
               OFFLINE OFFLINE      dm01db06
               OFFLINE OFFLINE      dm01db07
               OFFLINE OFFLINE      dm01db08
ora.net1.network
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               OFFLINE OFFLINE      dm01db07
               ONLINE  ONLINE       dm01db08
ora.net2.network
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               OFFLINE OFFLINE      dm01db07
               ONLINE  ONLINE       dm01db08
ora.ons
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               OFFLINE OFFLINE      dm01db07
               ONLINE  ONLINE       dm01db08
ora.registry.acfs
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               OFFLINE OFFLINE      dm01db07
               ONLINE  ONLINE       dm01db08
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       dm01db08
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       dm01db06
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       dm01db05
ora.dm01db01-ibvip.vip
      1        ONLINE  ONLINE       dm01db01
ora.dm01db01.vip
      1        ONLINE  ONLINE       dm01db01
ora.dm01db02-ibvip.vip
      1        ONLINE  ONLINE       dm01db02
ora.dm01db02.vip
      1        ONLINE  ONLINE       dm01db02
ora.dm01db03-ibvip.vip
      1        ONLINE  ONLINE       dm01db03
ora.dm01db03.vip
      1        ONLINE  ONLINE       dm01db03
ora.dm01db04-ibvip.vip
      1        ONLINE  ONLINE       dm01db04
ora.dm01db04.vip
      1        ONLINE  ONLINE       dm01db04
ora.dm01db05-ibvip.vip
      1        ONLINE  ONLINE       dm01db05
ora.dm01db05.vip
      1        ONLINE  ONLINE       dm01db05
ora.dm01db06-ibvip.vip
      1        ONLINE  ONLINE       dm01db06
ora.dm01db06.vip
      1        ONLINE  ONLINE       dm01db06
ora.dm01db08-ibvip.vip
      1        ONLINE  ONLINE       dm01db08
ora.dm01db08.vip
      1        ONLINE  ONLINE       dm01db08
ora.cvu
      1        ONLINE  ONLINE       dm01db03
ora.oc4j
      1        ONLINE  ONLINE       dm01db03
ora.scan1.vip
      1        ONLINE  ONLINE       dm01db08
ora.scan2.vip
      1        ONLINE  ONLINE       dm01db06
ora.scan3.vip
      1        ONLINE  ONLINE       dm01db05

 SQL> show parameter spfile

 NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
spfile                               string      +DATA/dm01-cluster/asmpar
                                                 ameterfile/registry.253.934093
                                                 287

 Conclusion
In this article we have learned how to move/replace OCR, Voting disks and ASM SPFILE from one ASM disk group to another.

By at
Labels: , , , ,

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Comparing Oracle Database Appliance X8-2 Model Family

September 2019 Oracle announced Oracle Database Appliance X8-2 (Small, Medium and HA). ODA X8-2 comes with more computing resources com...

  • Discover Exadata Database Machine in OEM 13c
    Overview To manage and monitor Exadata Database Machine you must discover it in Oracle Enterprise Manager. Before you discover Exadata D...
  • How to Login AWS Console
    Overview Amazon Web Services (AWS) is a secure  cloud  services platform, offering compute power, database storage, evolving cloud compu...
  • Exadata Diagnostic Utilities
    Overview As we know Exadata database machine is a combination of Hardware and Software. Over a period of time these hardware and softw...