Skip to main content
RAC

root.sh on four node RAC failed with CRS Disk group creation failed

By March 21, 2022August 29th, 2022No Comments13 min read

The four-node RAC was installed successfully, and now, the next step is to run the OraInventory.sh & the root.sh script on all four nodes.
After running the root.sh from node 1, initially it looks fine but finally failed the root.sh with the below-highlighted error.

[root@ORA-X1 ~]# /oracle/GRID/12201/root.sh
Performing root user operation.

The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /oracle/GRID/12201

Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /oracle/GRID/12201/crs/install/crsconfig_params
The log of current session can be found at:
/oracle/BASE/crsdata/ORA-X1/crsconfig/rootcrs_ORA-X1_2022-02-14_04-21-17PM.log
2022/02/14 16:21:19 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2022/02/14 16:21:20 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
2022/02/14 16:21:20 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2022/02/14 16:21:20 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2022/02/14 16:21:21 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2022/02/14 16:21:22 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2022/02/14 16:21:23 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'.
2022/02/14 16:21:25 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'.
2022/02/14 16:21:25 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'.
2022/02/14 16:21:25 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'.
2022/02/14 16:21:27 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2022/02/14 16:21:27 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2022/02/14 16:22:14 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2022/02/14 16:22:14 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2022/02/14 16:22:15 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2022/02/14 16:22:17 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ORA-X1'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
2022/02/14 16:22:36 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2022/02/14 16:22:39 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ORA-X1'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'ORA-X1'
CRS-2677: Stop of 'ora.drivers.acfs' on 'ORA-X1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.evmd' on 'ORA-X1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'ORA-X1'
CRS-2676: Start of 'ora.mdnsd' on 'ORA-X1' succeeded
CRS-2676: Start of 'ora.evmd' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'ORA-X1'
CRS-2676: Start of 'ora.gpnpd' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ORA-X1'
CRS-2672: Attempting to start 'ora.gipcd' on 'ORA-X1'
CRS-2676: Start of 'ora.cssdmonitor' on 'ORA-X1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'ORA-X1'
CRS-2672: Attempting to start 'ora.diskmon' on 'ORA-X1'
CRS-2676: Start of 'ora.diskmon' on 'ORA-X1' succeeded
CRS-2676: Start of 'ora.cssd' on 'ORA-X1' succeeded
[FATAL] [DBT-30002] Disk group CRS creation failed.
ORA-15018: diskgroup cannot be created
ORA-15238: 12.2.0.1 is not a valid value for attribute compatible.advm
ORA-15477: cannot communicate with the volume driver
2022/02/14 16:23:37 CLSRSC-184: Configuration of ASM failed
2022/02/14 16:23:39 CLSRSC-258: Failed to configure and start ASM
Died at /oracle/GRID/12201/crs/install/crsinstall.pm line 2091.
The command '/oracle/GRID/12201/perl/bin/perl -I/oracle/GRID/12201/perl/lib -I/oracle/GRID/12201/crs/install /oracle/GRID/12201/crs/install/rootcrs.pl ' execution failed

The error message clearly refers to the Disk Group issues, so the best practice is to format the partitions of the OCR Disks and rerun the root.sh should fix the issue.

[root@ORA-X1 ~]# sestatus
SELinux status: disabled
[root@ORA-X1 ~]# lsblk |grep 60G |grep part
+-sdbg1 67:161 0 60G 0 part
+-sdbh1 67:177 0 60G 0 part
+-sdbi1 67:193 0 60G 0 part
[root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbg1 bs=1M count=10
10+0 records in
10+0 records out
10485760 bytes (10 MB) copied, 0.0128387 s, 817 MB/s
[root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbh1 bs=1M count=10
10+0 records in
10+0 records out
10485760 bytes (10 MB) copied, 0.0122807 s, 854 MB/s
[root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbi1 bs=1M count=10
10+0 records in
10+0 records out
10485760 bytes (10 MB) copied, 0.0112617 s, 931 MB/s

[root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbg1 bs=1M count=10
10+0 records in
10+0 records out
10485760 bytes (10 MB) copied, 0.0133768 s, 784 MB/s
[root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbh1 bs=1M count=10
10+0 records in
10+0 records out
10485760 bytes (10 MB) copied, 0.0116495 s, 900 MB/s
[root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbi1 bs=1M count=10
10+0 records in
10+0 records out
10485760 bytes (10 MB) copied, 0.0117127 s, 895 MB/s

After performing header, cleanup started root.sh script and the root.sh script completed successfully on all the nodes.

[root@ORA-X1 ~]# /oracle/GRID/12201/root.sh
Performing root user operation.

The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /oracle/GRID/12201

Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /oracle/GRID/12201/crs/install/crsconfig_params
The log of current session can be found at:
/oracle/BASE/crsdata/ORA-X1/crsconfig/rootcrs_ORA-X1_2022-02-14_04-30-33PM.log
2022/02/14 16:30:36 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2022/02/14 16:30:36 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
2022/02/14 16:30:36 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2022/02/14 16:30:36 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2022/02/14 16:30:37 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2022/02/14 16:30:39 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2022/02/14 16:30:40 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'.
2022/02/14 16:30:41 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'.
2022/02/14 16:30:41 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'.
2022/02/14 16:30:41 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'.
2022/02/14 16:30:43 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2022/02/14 16:30:44 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2022/02/14 16:30:44 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2022/02/14 16:30:44 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2022/02/14 16:30:45 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2022/02/14 16:30:48 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2022/02/14 16:30:49 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2022/02/14 16:30:51 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ORA-X1'
CRS-2673: Attempting to stop 'ora.asm' on 'ORA-X1'
CRS-2673: Attempting to stop 'ora.ctssd' on 'ORA-X1'
CRS-2673: Attempting to stop 'ora.evmd' on 'ORA-X1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'ORA-X1'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'ORA-X1'
CRS-2677: Stop of 'ora.ctssd' on 'ORA-X1' succeeded
CRS-2677: Stop of 'ora.evmd' on 'ORA-X1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'ORA-X1' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'ORA-X1' succeeded
CRS-2677: Stop of 'ora.asm' on 'ORA-X1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ORA-X1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ORA-X1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'ORA-X1'
CRS-2677: Stop of 'ora.cssd' on 'ORA-X1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'ORA-X1'
CRS-2677: Stop of 'ora.gipcd' on 'ORA-X1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.evmd' on 'ORA-X1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'ORA-X1'
CRS-2676: Start of 'ora.mdnsd' on 'ORA-X1' succeeded
CRS-2676: Start of 'ora.evmd' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'ORA-X1'
CRS-2676: Start of 'ora.gpnpd' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ORA-X1'
CRS-2672: Attempting to start 'ora.gipcd' on 'ORA-X1'
CRS-2676: Start of 'ora.cssdmonitor' on 'ORA-X1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'ORA-X1'
CRS-2672: Attempting to start 'ora.diskmon' on 'ORA-X1'
CRS-2676: Start of 'ora.diskmon' on 'ORA-X1' succeeded
CRS-2676: Start of 'ora.cssd' on 'ORA-X1' succeeded

Disk groups created successfully. Check /oracle/BASE/cfgtoollogs/asmca/asmca-220214PM043141.log for details.


2022/02/14 16:32:20 CLSRSC-482: Running command: '/oracle/GRID/12201/bin/ocrconfig -upgrade oracle oinstall'
CRS-2672: Attempting to start 'ora.crf' on 'ORA-X1'
CRS-2672: Attempting to start 'ora.storage' on 'ORA-X1'
CRS-2676: Start of 'ora.storage' on 'ORA-X1' succeeded
CRS-2676: Start of 'ora.crf' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'ORA-X1'
CRS-2676: Start of 'ora.crsd' on 'ORA-X1' succeeded
CRS-4256: Updating the profile
Successful addition of voting disk 258d62614ed04f66bfbbb3cf393f3071.
Successful addition of voting disk 8b8da446b21a4fc9bfb537a7d86e0b48.
Successful addition of voting disk f366f266e5844feebfe877bb480003e8.
Successfully replaced voting disk group with +CRS.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE 258d62614ed04f66bfbbb3cf393f3071 (/dev/oracleasm/disks/CRS_XP8_001) [CRS]
2. ONLINE 8b8da446b21a4fc9bfb537a7d86e0b48 (/dev/oracleasm/disks/CRS_XP8_003) [CRS]
3. ONLINE f366f266e5844feebfe877bb480003e8 (/dev/oracleasm/disks/CRS_XP8_002) [CRS]
Located 3 voting disk(s).
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ORA-X1'
CRS-2673: Attempting to stop 'ora.crsd' on 'ORA-X1'
CRS-2677: Stop of 'ora.crsd' on 'ORA-X1' succeeded
CRS-2673: Attempting to stop 'ora.storage' on 'ORA-X1'
CRS-2673: Attempting to stop 'ora.crf' on 'ORA-X1'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'ORA-X1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'ORA-X1'
CRS-2677: Stop of 'ora.crf' on 'ORA-X1' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'ORA-X1' succeeded
CRS-2677: Stop of 'ora.storage' on 'ORA-X1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'ORA-X1'
CRS-2677: Stop of 'ora.mdnsd' on 'ORA-X1' succeeded
CRS-2677: Stop of 'ora.asm' on 'ORA-X1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ORA-X1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ORA-X1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'ORA-X1'
CRS-2673: Attempting to stop 'ora.evmd' on 'ORA-X1'
CRS-2677: Stop of 'ora.ctssd' on 'ORA-X1' succeeded
CRS-2677: Stop of 'ora.evmd' on 'ORA-X1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'ORA-X1'
CRS-2677: Stop of 'ora.cssd' on 'ORA-X1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'ORA-X1'
CRS-2677: Stop of 'ora.gipcd' on 'ORA-X1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
2022/02/14 16:33:15 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.evmd' on 'ORA-X1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'ORA-X1'
CRS-2676: Start of 'ora.mdnsd' on 'ORA-X1' succeeded
CRS-2676: Start of 'ora.evmd' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'ORA-X1'
CRS-2676: Start of 'ora.gpnpd' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'ORA-X1'
CRS-2676: Start of 'ora.gipcd' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.drivers.acfs' on 'ORA-X1'
CRS-2674: Start of 'ora.drivers.acfs' on 'ORA-X1' failed
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ORA-X1'
CRS-2676: Start of 'ora.cssdmonitor' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'ORA-X1'
CRS-2672: Attempting to start 'ora.diskmon' on 'ORA-X1'
CRS-2676: Start of 'ora.diskmon' on 'ORA-X1' succeeded
CRS-2676: Start of 'ora.cssd' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'ORA-X1'
CRS-2672: Attempting to start 'ora.ctssd' on 'ORA-X1'
CRS-2676: Start of 'ora.ctssd' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.drivers.acfs' on 'ORA-X1'
CRS-2674: Start of 'ora.drivers.acfs' on 'ORA-X1' failed
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'ORA-X1'
CRS-2676: Start of 'ora.asm' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'ORA-X1'
CRS-2676: Start of 'ora.storage' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'ORA-X1'
CRS-2676: Start of 'ora.crf' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'ORA-X1'
CRS-2676: Start of 'ora.crsd' on 'ORA-X1' succeeded
CRS-6023: Starting Oracle Cluster Ready Services-managed resources
CRS-6017: Processing resource auto-start for servers: ORA-X1
CRS-6016: Resource auto-start has completed for server ORA-X1
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
2022/02/14 16:35:32 CLSRSC-343: Successfully started Oracle Clusterware stack
2022/02/14 16:35:32 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
CRS-2672: Attempting to start 'ora.ASMNET1LSNR_ASM.lsnr' on 'ORA-X1'
CRS-2676: Start of 'ora.ASMNET1LSNR_ASM.lsnr' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'ORA-X1'
CRS-2676: Start of 'ora.asm' on 'ORA-X1' succeeded
CRS-2672: Attempting to start 'ora.CRS.dg' on 'ORA-X1'
CRS-2676: Start of 'ora.CRS.dg' on 'ORA-X1' succeeded
2022/02/14 16:36:59 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2022/02/14 16:37:32 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@ORA-X1 ~]#
[root@ORA-X1 ~]#

Leave a Reply