Deploy Oracle11.2.0.3.0 2-Node RAC with ASM on RHEL 6.4 64bit Platform

Day-1

We had installed OS of RHEL 6.2 and we are struggling to get ASMLib for same version

We did googling  and R&D on OTN Forum OCFS2 vs ASM for RHEL-6.0 onwards

we decided to go with ASM so we have only choice to format existing RHEL 6.2 and reinstall RHEL 6.4 Operating System

OCFS2 RPM not available from RHEL-6.0 onwards. Below is the work-around.

• Install RHEL-5.x. OCFS2 RPM available for suitable kernel version.
• Install RHEL-6.4 or above (In this we have kmod-oracleasm) RPM available from RHN (RedHat Network)
• Install Oracle Unbreakable Linux-6.0 (We need to check Licensing part for production setup). Both OCFS2 and ASM Library RPM available with this release.
• Anyone can create UDEV rules is also for disk management. (So far we have not used this option)

Day-2

we have Storage of Dell PowerVault MD Series

we are facing issues with Device mapper multipathing

we fixed the multipathing issue and you can refer final configuration as reference
multipath.conf for Dell Server with RHEL 6.4

then
We started to install 11.2.0.1.0 GI

but during execution of root.sh on node-1 we got below error

: Inappropriate ioctl for device (Doc ID 1557677.1)

We had refer below metalink note and decided to go with 11.2.0.3.0

Oracle Metalink-RHEL6 with ohasd failed to start Inappropriate ioctl for device

We don’t have setup of 11.2.0.1.0 so we were download the same

Day-3

We had tried installation of GI

root.sh failed on node-1

sh /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@slic-ecdbsv-001 ~]# sh /u01/app/11.2.0/grid/root.sh
Performing root user operation for Oracle 11g

The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME=  /u01/app/11.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of “dbhome” have not changed. No need to overwrite.
The file “oraenv” already exists in /usr/local/bin.  Overwrite it? (y/n)
[n]: y
Copying oraenv to /usr/local/bin …
The file “coraenv” already exists in /usr/local/bin.  Overwrite it? (y/n)
[n]: y
Copying coraenv to /usr/local/bin …

Creating /etc/oratab file…
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
Creating trace directory
User ignored Prerequisites during installation
OLR initialization – successful
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
Adding Clusterware entries to upstart
CRS-2672: Attempting to start ‘ora.mdnsd’ on ‘slic-ecdbsv-001’
CRS-2676: Start of ‘ora.mdnsd’ on ‘slic-ecdbsv-001’ succeeded
CRS-2672: Attempting to start ‘ora.gpnpd’ on ‘slic-ecdbsv-001’
CRS-2676: Start of ‘ora.gpnpd’ on ‘slic-ecdbsv-001’ succeeded
CRS-2672: Attempting to start ‘ora.cssdmonitor’ on ‘slic-ecdbsv-001’
CRS-2672: Attempting to start ‘ora.gipcd’ on ‘slic-ecdbsv-001’
CRS-2676: Start of ‘ora.cssdmonitor’ on ‘slic-ecdbsv-001’ succeeded
CRS-2676: Start of ‘ora.gipcd’ on ‘slic-ecdbsv-001’ succeeded
CRS-2672: Attempting to start ‘ora.cssd’ on ‘slic-ecdbsv-001’
CRS-2672: Attempting to start ‘ora.diskmon’ on ‘slic-ecdbsv-001’
CRS-2676: Start of ‘ora.diskmon’ on ‘slic-ecdbsv-001’ succeeded
CRS-2676: Start of ‘ora.cssd’ on ‘slic-ecdbsv-001’ succeeded

Disk Group CLUSTER creation failed with the following message:
ORA-15100: invalid or missing diskgroup name

Configuration of ASM … failed
see asmca logs at /u01/app/oracle/cfgtoollogs/asmca for details
Did not succssfully configure and start ASM at /u01/app/11.2.0/grid/crs/install/crsconfig_lib.pm line 6763.
/u01/app/11.2.0/grid/perl/bin/perl -I/u01/app/11.2.0/grid/perl/lib -I/u01/app/11.2.0/grid/crs/install /u01/app/11.2.0/grid/crs/install/rootcrs.pl execution failed

Solution

Refer OTN

apparently using the name CLUSTER as your Disk Group Name isn’t allowed.

Once I changed that value it installed successfully

again we had manually remove GI installation using below commands from both the nodes

blog

Deconfigure Oracle Clusterware without removing the binaries:

Log in as the root user on a node where you encountered an error.

Change directory to $GRID_HOME/crs/install. For example:
# cd $GRID_HOME/crs/install

Run rootcrs.pl with the -deconfig -force flags on all but the last node.
# perl rootcrs.pl -deconfig -force

Deinstall Command for Oracle Clusterware and ASM

$ cd /u01/app/11.2.0/grid/deinstall/ 
$ ./deinstall 

 

Start the GI and Installation and this time we have given ASM Disk name as ‘CLSTR’

finally I had successfully installed GI 🙂

then we were go ahead for below steps

Oracle SWONLY Installation

Create ASM Disk Group

Create RAC Database with below standard practices

#Please note down below parameter for configure the multiplexing controlfile and redolog file

db_create_file_dest=+ORASYS
db_create_online_log_dest_1=+ORASYS
db_create_online_log_dest_2=+ORAFRA
db_recovery_file_dest=+ORAFRA

We had create +ORADATA1 for applications purpose

You can check control file Location

show parameter control_files
control_files=+ORASYS/ORCL/controlfile/current.258.824657227,+ORAFRA/ORCL/controlfile/current.256.824657227

You can check REDOLOG Location

SELECT MEMBER FROM V$LOGFILE;

MEMBER
--------------------------------------------------------------------------------
+ORASYS/ORCL/onlinelog/group_2.256.824657241
+ORAFRA/ORCL/onlinelog/group_2.259.824657247
+ORASYS/ORCL/onlinelog/group_1.257.824657229
+ORAFRA/ORCL/onlinelog/group_1.260.824657235
+ORASYS/ORCL/onlinelog/group_3.265.824657417
+ORAFRA/ORCL/onlinelog/group_3.258.824657423
+ORASYS/ORCL/onlinelog/group_4.266.824657427
+ORAFRA/ORCL/onlinelog/group_4.257.824657431

Let me know if any questions

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.