The four-node RAC was installed successfully, and now, the next step is to run the OraInventory.sh & the root.sh script on all four nodes.
After running the root.sh from node 1, initially it looks fine but finally failed the root.sh with the below-highlighted error.
[root@ORA-X1 ~]# /oracle/GRID/12201/root.sh Performing root user operation. The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /oracle/GRID/12201 Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Relinking oracle with rac_on option Using configuration parameter file: /oracle/GRID/12201/crs/install/crsconfig_params The log of current session can be found at: /oracle/BASE/crsdata/ORA-X1/crsconfig/rootcrs_ORA-X1_2022-02-14_04-21-17PM.log 2022/02/14 16:21:19 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'. 2022/02/14 16:21:20 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector. 2022/02/14 16:21:20 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector. 2022/02/14 16:21:20 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'. 2022/02/14 16:21:21 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'. 2022/02/14 16:21:22 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'. 2022/02/14 16:21:23 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'. 2022/02/14 16:21:25 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'. 2022/02/14 16:21:25 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'. 2022/02/14 16:21:25 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'. 2022/02/14 16:21:27 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'. 2022/02/14 16:21:27 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'. 2022/02/14 16:22:14 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'. 2022/02/14 16:22:14 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'. 2022/02/14 16:22:15 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'. 2022/02/14 16:22:17 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' has completed CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Oracle High Availability Services has been started. 2022/02/14 16:22:36 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'. 2022/02/14 16:22:39 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'ORA-X1' CRS-2677: Stop of 'ora.drivers.acfs' on 'ORA-X1' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' has completed CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Oracle High Availability Services has been started. CRS-2672: Attempting to start 'ora.evmd' on 'ORA-X1' CRS-2672: Attempting to start 'ora.mdnsd' on 'ORA-X1' CRS-2676: Start of 'ora.mdnsd' on 'ORA-X1' succeeded CRS-2676: Start of 'ora.evmd' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'ORA-X1' CRS-2676: Start of 'ora.gpnpd' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ORA-X1' CRS-2672: Attempting to start 'ora.gipcd' on 'ORA-X1' CRS-2676: Start of 'ora.cssdmonitor' on 'ORA-X1' succeeded CRS-2676: Start of 'ora.gipcd' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'ORA-X1' CRS-2672: Attempting to start 'ora.diskmon' on 'ORA-X1' CRS-2676: Start of 'ora.diskmon' on 'ORA-X1' succeeded CRS-2676: Start of 'ora.cssd' on 'ORA-X1' succeeded [FATAL] [DBT-30002] Disk group CRS creation failed. ORA-15018: diskgroup cannot be created ORA-15238: 12.2.0.1 is not a valid value for attribute compatible.advm ORA-15477: cannot communicate with the volume driver 2022/02/14 16:23:37 CLSRSC-184: Configuration of ASM failed 2022/02/14 16:23:39 CLSRSC-258: Failed to configure and start ASM Died at /oracle/GRID/12201/crs/install/crsinstall.pm line 2091. The command '/oracle/GRID/12201/perl/bin/perl -I/oracle/GRID/12201/perl/lib -I/oracle/GRID/12201/crs/install /oracle/GRID/12201/crs/install/rootcrs.pl ' execution failed
The error message clearly refers to the Disk Group issues, so the best practice is to format the partitions of the OCR Disks and rerun the root.sh should fix the issue.
[root@ORA-X1 ~]# sestatus SELinux status: disabled [root@ORA-X1 ~]# lsblk |grep 60G |grep part +-sdbg1 67:161 0 60G 0 part +-sdbh1 67:177 0 60G 0 part +-sdbi1 67:193 0 60G 0 part [root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbg1 bs=1M count=10 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0128387 s, 817 MB/s [root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbh1 bs=1M count=10 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0122807 s, 854 MB/s [root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbi1 bs=1M count=10 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0112617 s, 931 MB/s [root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbg1 bs=1M count=10 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0133768 s, 784 MB/s [root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbh1 bs=1M count=10 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0116495 s, 900 MB/s [root@ORA-X1 ~]# dd if=/dev/zero of=/dev/sdbi1 bs=1M count=10 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0117127 s, 895 MB/s
After performing header, cleanup started root.sh script and the root.sh script completed successfully on all the nodes.
[root@ORA-X1 ~]# /oracle/GRID/12201/root.sh Performing root user operation. The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /oracle/GRID/12201 Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Relinking oracle with rac_on option Using configuration parameter file: /oracle/GRID/12201/crs/install/crsconfig_params The log of current session can be found at: /oracle/BASE/crsdata/ORA-X1/crsconfig/rootcrs_ORA-X1_2022-02-14_04-30-33PM.log 2022/02/14 16:30:36 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'. 2022/02/14 16:30:36 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector. 2022/02/14 16:30:36 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector. 2022/02/14 16:30:36 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'. 2022/02/14 16:30:37 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'. 2022/02/14 16:30:39 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'. 2022/02/14 16:30:40 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'. 2022/02/14 16:30:41 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'. 2022/02/14 16:30:41 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'. 2022/02/14 16:30:41 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'. 2022/02/14 16:30:43 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'. 2022/02/14 16:30:44 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'. 2022/02/14 16:30:44 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'. 2022/02/14 16:30:44 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'. 2022/02/14 16:30:45 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'. 2022/02/14 16:30:48 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'. 2022/02/14 16:30:49 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'. 2022/02/14 16:30:51 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' CRS-2673: Attempting to stop 'ora.asm' on 'ORA-X1' CRS-2673: Attempting to stop 'ora.ctssd' on 'ORA-X1' CRS-2673: Attempting to stop 'ora.evmd' on 'ORA-X1' CRS-2673: Attempting to stop 'ora.mdnsd' on 'ORA-X1' CRS-2673: Attempting to stop 'ora.gpnpd' on 'ORA-X1' CRS-2677: Stop of 'ora.ctssd' on 'ORA-X1' succeeded CRS-2677: Stop of 'ora.evmd' on 'ORA-X1' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'ORA-X1' succeeded CRS-2677: Stop of 'ora.gpnpd' on 'ORA-X1' succeeded CRS-2677: Stop of 'ora.asm' on 'ORA-X1' succeeded CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ORA-X1' CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ORA-X1' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'ORA-X1' CRS-2677: Stop of 'ora.cssd' on 'ORA-X1' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'ORA-X1' CRS-2677: Stop of 'ora.gipcd' on 'ORA-X1' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' has completed CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Oracle High Availability Services has been started. CRS-2672: Attempting to start 'ora.evmd' on 'ORA-X1' CRS-2672: Attempting to start 'ora.mdnsd' on 'ORA-X1' CRS-2676: Start of 'ora.mdnsd' on 'ORA-X1' succeeded CRS-2676: Start of 'ora.evmd' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'ORA-X1' CRS-2676: Start of 'ora.gpnpd' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ORA-X1' CRS-2672: Attempting to start 'ora.gipcd' on 'ORA-X1' CRS-2676: Start of 'ora.cssdmonitor' on 'ORA-X1' succeeded CRS-2676: Start of 'ora.gipcd' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'ORA-X1' CRS-2672: Attempting to start 'ora.diskmon' on 'ORA-X1' CRS-2676: Start of 'ora.diskmon' on 'ORA-X1' succeeded CRS-2676: Start of 'ora.cssd' on 'ORA-X1' succeeded Disk groups created successfully. Check /oracle/BASE/cfgtoollogs/asmca/asmca-220214PM043141.log for details. 2022/02/14 16:32:20 CLSRSC-482: Running command: '/oracle/GRID/12201/bin/ocrconfig -upgrade oracle oinstall' CRS-2672: Attempting to start 'ora.crf' on 'ORA-X1' CRS-2672: Attempting to start 'ora.storage' on 'ORA-X1' CRS-2676: Start of 'ora.storage' on 'ORA-X1' succeeded CRS-2676: Start of 'ora.crf' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'ORA-X1' CRS-2676: Start of 'ora.crsd' on 'ORA-X1' succeeded CRS-4256: Updating the profile Successful addition of voting disk 258d62614ed04f66bfbbb3cf393f3071. Successful addition of voting disk 8b8da446b21a4fc9bfb537a7d86e0b48. Successful addition of voting disk f366f266e5844feebfe877bb480003e8. Successfully replaced voting disk group with +CRS. CRS-4256: Updating the profile CRS-4266: Voting file(s) successfully replaced ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 258d62614ed04f66bfbbb3cf393f3071 (/dev/oracleasm/disks/CRS_XP8_001) [CRS] 2. ONLINE 8b8da446b21a4fc9bfb537a7d86e0b48 (/dev/oracleasm/disks/CRS_XP8_003) [CRS] 3. ONLINE f366f266e5844feebfe877bb480003e8 (/dev/oracleasm/disks/CRS_XP8_002) [CRS] Located 3 voting disk(s). CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' CRS-2673: Attempting to stop 'ora.crsd' on 'ORA-X1' CRS-2677: Stop of 'ora.crsd' on 'ORA-X1' succeeded CRS-2673: Attempting to stop 'ora.storage' on 'ORA-X1' CRS-2673: Attempting to stop 'ora.crf' on 'ORA-X1' CRS-2673: Attempting to stop 'ora.gpnpd' on 'ORA-X1' CRS-2673: Attempting to stop 'ora.mdnsd' on 'ORA-X1' CRS-2677: Stop of 'ora.crf' on 'ORA-X1' succeeded CRS-2677: Stop of 'ora.gpnpd' on 'ORA-X1' succeeded CRS-2677: Stop of 'ora.storage' on 'ORA-X1' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'ORA-X1' CRS-2677: Stop of 'ora.mdnsd' on 'ORA-X1' succeeded CRS-2677: Stop of 'ora.asm' on 'ORA-X1' succeeded CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ORA-X1' CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ORA-X1' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'ORA-X1' CRS-2673: Attempting to stop 'ora.evmd' on 'ORA-X1' CRS-2677: Stop of 'ora.ctssd' on 'ORA-X1' succeeded CRS-2677: Stop of 'ora.evmd' on 'ORA-X1' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'ORA-X1' CRS-2677: Stop of 'ora.cssd' on 'ORA-X1' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'ORA-X1' CRS-2677: Stop of 'ora.gipcd' on 'ORA-X1' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ORA-X1' has completed CRS-4133: Oracle High Availability Services has been stopped. 2022/02/14 16:33:15 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'. CRS-4123: Starting Oracle High Availability Services-managed resources CRS-2672: Attempting to start 'ora.evmd' on 'ORA-X1' CRS-2672: Attempting to start 'ora.mdnsd' on 'ORA-X1' CRS-2676: Start of 'ora.mdnsd' on 'ORA-X1' succeeded CRS-2676: Start of 'ora.evmd' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'ORA-X1' CRS-2676: Start of 'ora.gpnpd' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'ORA-X1' CRS-2676: Start of 'ora.gipcd' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.drivers.acfs' on 'ORA-X1' CRS-2674: Start of 'ora.drivers.acfs' on 'ORA-X1' failed CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ORA-X1' CRS-2676: Start of 'ora.cssdmonitor' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'ORA-X1' CRS-2672: Attempting to start 'ora.diskmon' on 'ORA-X1' CRS-2676: Start of 'ora.diskmon' on 'ORA-X1' succeeded CRS-2676: Start of 'ora.cssd' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'ORA-X1' CRS-2672: Attempting to start 'ora.ctssd' on 'ORA-X1' CRS-2676: Start of 'ora.ctssd' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.drivers.acfs' on 'ORA-X1' CRS-2674: Start of 'ora.drivers.acfs' on 'ORA-X1' failed CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.asm' on 'ORA-X1' CRS-2676: Start of 'ora.asm' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.storage' on 'ORA-X1' CRS-2676: Start of 'ora.storage' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.crf' on 'ORA-X1' CRS-2676: Start of 'ora.crf' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'ORA-X1' CRS-2676: Start of 'ora.crsd' on 'ORA-X1' succeeded CRS-6023: Starting Oracle Cluster Ready Services-managed resources CRS-6017: Processing resource auto-start for servers: ORA-X1 CRS-6016: Resource auto-start has completed for server ORA-X1 CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources CRS-4123: Oracle High Availability Services has been started. 2022/02/14 16:35:32 CLSRSC-343: Successfully started Oracle Clusterware stack 2022/02/14 16:35:32 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'. CRS-2672: Attempting to start 'ora.ASMNET1LSNR_ASM.lsnr' on 'ORA-X1' CRS-2676: Start of 'ora.ASMNET1LSNR_ASM.lsnr' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.asm' on 'ORA-X1' CRS-2676: Start of 'ora.asm' on 'ORA-X1' succeeded CRS-2672: Attempting to start 'ora.CRS.dg' on 'ORA-X1' CRS-2676: Start of 'ora.CRS.dg' on 'ORA-X1' succeeded 2022/02/14 16:36:59 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'. 2022/02/14 16:37:32 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded [root@ORA-X1 ~]# [root@ORA-X1 ~]#
