06 Installing Oracle Clusterware

References

Oracle® Clusterware Installation Guide 11g Release 1 (11.1) for Linux

Installing Oracle Clusterware

Followed the procedure in Installing Oracle Clusterware.

Verifying Oracle Clusterware Requirements with CVU

The procedure in Verifying Oracle Clusterware Requirements with CVU was already done in 04 Oracle Clusterware Preinstallation Tasks.

Preparing to Install Oracle Clusterware with OUI

There was nothing to do according to Preparing to Install Oracle Clusterware with OUI as this was a complete new installation of OS and HW as well.

Installing Oracle Clusterware with OUI

Followed the procedure in Installing Oracle Clusterware with OUI.

The installation software location has been moved from a VMware Shared folder (/mnt/hgfs/OCM/Software) to a NFS filesystem (/u00 mounted on freenas:/mnt/SOFTWARE). This was done because I had started experimenting with the remote operations feature of VMware Workstation 8 which requires all files to be in a shared folder under Windows.

su - crs cd /u00/product/11.1.0.6/clusterware ./runInstaller

Running Oracle Inventory Root Scripts

On PENRITH1,

[root@penrith1 ~]# cd /u01/app/oraInventory/ [root@penrith1 oraInventory]# ./orainstRoot.sh Changing permissions of /u01/app/oraInventory to 770. Changing groupname of /u01/app/oraInventory to oinstall. The execution of the script is complete

On PENRITH2,

[root@penrith2 ~]# cd /u01/app/oraInventory/ [root@penrith2 oraInventory]# ./orainstRoot.sh Changing permissions of /u01/app/oraInventory to 770. Changing groupname of /u01/app/oraInventory to oinstall. The execution of the script is complete

Running CRS Root Scripts

On PENRITH1,

[root@penrith1 oraInventory]# cd /u01/app/crs/product/11.1.0/crs/ [root@penrith1 crs]# ./root.sh WARNING: directory '/u01/app/crs/product/11.1.0' is not owned by root WARNING: directory '/u01/app/crs/product' is not owned by root WARNING: directory '/u01/app/crs' is not owned by root WARNING: directory '/u01/app' is not owned by root Checking to see if Oracle CRS stack is already configured /etc/oracle does not exist. Creating it now. Setting the permissions on OCR backup directory Setting up Network socket directories Oracle Cluster Registry configuration upgraded successfully The directory '/u01/app/crs/product/11.1.0' is not owned by root. Changing owner to root The directory '/u01/app/crs/product' is not owned by root. Changing owner to root The directory '/u01/app/crs' is not owned by root. Changing owner to root The directory '/u01/app' is not owned by root. Changing owner to root Successfully accumulated necessary OCR keys. Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897. node : node 1: penrith1 penrith1-priv penrith1 node 2: penrith2 penrith2-priv penrith2 Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. Now formatting voting device: /u04/voting Now formatting voting device: /u05/voting Now formatting voting device: /u06/voting Format of 3 voting devices complete. Startup will be queued to init within 30 seconds. Adding daemons to inittab Expecting the CRS daemons to be up within 600 seconds. Cluster Synchronization Services is active on these nodes. penrith1 Cluster Synchronization Services is inactive on these nodes. penrith2 Local node checking complete. Run root.sh on remaining nodes to start CRS daemons.

On PENRITH2,

[root@penrith2 oraInventory]# cd /u01/app/crs/product/11.1.0/crs/ [root@penrith2 crs]# ./root.sh WARNING: directory '/u01/app/crs/product/11.1.0' is not owned by root WARNING: directory '/u01/app/crs/product' is not owned by root WARNING: directory '/u01/app/crs' is not owned by root WARNING: directory '/u01/app' is not owned by root Checking to see if Oracle CRS stack is already configured /etc/oracle does not exist. Creating it now. Setting the permissions on OCR backup directory Setting up Network socket directories Oracle Cluster Registry configuration upgraded successfully The directory '/u01/app/crs/product/11.1.0' is not owned by root. Changing owner to root The directory '/u01/app/crs/product' is not owned by root. Changing owner to root The directory '/u01/app/crs' is not owned by root. Changing owner to root The directory '/u01/app' is not owned by root. Changing owner to root clscfg: EXISTING configuration version 4 detected. clscfg: version 4 is 11 Release 1. Successfully accumulated necessary OCR keys. Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897. node : node 1: penrith1 penrith1-priv penrith1 node 2: penrith2 penrith2-priv penrith2 clscfg: Arguments check out successfully. NO KEYS WERE WRITTEN. Supply -force parameter to override. -force is destructive and will destroy any previous cluster configuration. Oracle Cluster Registry for cluster has already been initialized Startup will be queued to init within 30 seconds. Adding daemons to inittab Expecting the CRS daemons to be up within 600 seconds. Cluster Synchronization Services is active on these nodes. penrith1 penrith2 Cluster Synchronization Services is active on all the nodes. Waiting for the Oracle CRSD and EVMD to start Oracle CRS stack installed and running under init(1M) Running vipca(silent) for configuring nodeapps Creating VIP application resource on (2) nodes... Creating GSD application resource on (2) nodes... Creating ONS application resource on (2) nodes... Starting VIP application resource on (2) nodes... Starting GSD application resource on (2) nodes... Starting ONS application resource on (2) nodes... Done.

Confirming Oracle Clusterware Function

Followed th procedure in Confirming Oracle Clusterware Function.

[root@penrith1 ~]# su - crs [crs@penrith1 ~]$ cd /u01/app/crs/product/11.1.0/crs/bin/ [crs@penrith1 bin]$ ./crs_stat -t -v Name Type R/RA F/FT Target State Host ---------------------------------------------------------------------- ora....th1.gsd application 0/5 0/0 ONLINE ONLINE penrith1 ora....th1.ons application 0/3 0/0 ONLINE ONLINE penrith1 ora....th1.vip application 0/0 0/0 ONLINE ONLINE penrith1 ora....th2.gsd application 0/5 0/0 ONLINE ONLINE penrith2 ora....th2.ons application 0/3 0/0 ONLINE ONLINE penrith2 ora....th2.vip application 0/0 0/0 ONLINE ONLINE penrith2