Install Grid Infrastructure 11.2.0.3.3 on GRIDCTRL

Overview

While upgrading the REPOS database to 11.2.0.3.3, I thought it would be a good opportunity to install Grid Infrastructure 11.2.0.3.3 on GRIDCTRL. This might solve the problem I had encountered in Problem in Starting Oracle Cloud Control 12c

Pre-Installation Checks

Using the same software I had downloaded for the database in the 11.2.0.3.3 upgrade, I used the following commands:

cd /opt/oracle/software/p10404530/grid

./runcluvfy.sh stage -pre crsinst -verbose -n gridctrl >/tmp/pre_crsinst_cluvfy.lst

The only failure was with NTP:

Starting Clock synchronization checks using Network Time Protocol(NTP)...

NTP Configuration file check started...

The NTP configuration file "/etc/ntp.conf" is available on all nodes

NTP Configuration file check passed

No NTP Daemons or Services were found to be running

PRVF-5507 : NTP daemon or service is not running on any node but NTP configuration file exists on the following node(s):

gridctrl

Result: Clock synchronization check using Network Time Protocol(NTP) failed

The full listing is attached as pre_crsinst_cluvfy.lst

I decided to ignore this error as I will be running GRIDCTRL as a single node cluster.

Installation

To install Grid Infrastructure, I used the following commands:

cd /opt/oracle/software/p10404530/grid

./runInstaller

Step 1: Download Software Updates

After the splash screen, the following appearred:

I entered my details, and tested the connection. All was okay. I clicked Next, and got the following error message:

This is strange because I have been downloading patches all of the time.

Clicked OK. Changed my selection to Skip software updates, and clicked Next.

Step 2: Installation Option

Choose to install only the software at this time as I need to add several patches:

Clicked Next.

Step 3: Product Languages

Left the defaults:

Clicked Next.

Step 4: Operating System Groups

Changed all groups to DBA.

Clicked Next.

Got the following error messages:

Clicked Yes.

Step 5: Installation Location

Changed the GRID home to /opt/oracle/11.2.0.3/grid. This is incompatible with the existing Oracle homes on GRIDCTRL.

Clicked Next.

Got an error message about the software location not being under the Oracle base. I ignored this message and continued.

Step 6 Prerequisite Checks

I selected Ignore all, then clicked Next.

I got the following message:

I clicked Yes.

Step 7: Summary

Clicked Install.

Step 8: Install Product

Got the following scripts to run:

sudo su -

/opt/oracle/11.2.0.3/grid/root.sh

The output is:

Performing root user operation for Oracle 11g

The following environment variables are set as:

ORACLE_OWNER= oracle

ORACLE_HOME= /opt/oracle/11.2.0.3/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The contents of "dbhome" have not changed. No need to overwrite.

The contents of "oraenv" have not changed. No need to overwrite.

The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

To configure Grid Infrastructure for a Stand-Alone Server run the following command as the root user:

/opt/oracle/11.2.0.3/grid/perl/bin/perl -I/opt/oracle/11.2.0.3/grid/perl/lib -I/opt/oracle/11.2.0.3/grid/crs/install /opt/oracle/11.2.0.3/grid/crs/install/roothas.pl

To configure Grid Infrastructure for a Cluster execute the following command:

/opt/oracle/11.2.0.3/grid/crs/config/config.sh

This command launches the Grid Infrastructure Configuration Wizard. The wizard also supports silent operation, and the parameters can be passed through the response file that is available in the installation media.

Clicked OK.

Step 9: Finish

Clicked Close.

Post Installation Verification

Ran the following command to verify the installation:

/opt/oracle/11.2.0.3/grid/bin/cluvfy stage -post crsinst -verbose -n gridctrl

The following error message appears:

ERROR: Oracle Grid Infrastructure not configured. You cannot run '/opt/oracle/11.2.0.3/grid/bin/cluvfy' without the Oracle Grid Infrastructure.

I leave this until I have applied all of the patches, and configured the Grid Infrastructure.

Apply Patch 13919095

Before configuring Grid Infrastructure, I want to apply patch 13919095 11.2.0.3.3 GI Patch Set Update (Includes Database PSU 11.2.0.3.3).

Patch Home

The patch has been unzipped into /opt/oracle/software/p13919095

Check OPatch Version

To check the version of OPatch in the new Grid Infrastructure home, I ran the following command:

/opt/oracle/11.2.0.3/grid/OPatch/opatch version

The output is:

Invoking OPatch 11.2.0.1.7 OPatch Version: 11.2.0.1.7 OPatch succeeded.

Install Patch 6880880

So, I will have to apply patch 6880880 here as patch 13919095 requires OPatch 11.2.0.3.0 or later. Used the following commands:

mv /opt/oracle/11.2.0.3/grid/OPatch \

  /opt/oracle/11.2.0.3/grid/OPatch_11.2.0.1.7

unzip60_lnx -d /opt/oracle/11.2.0.3/grid/ \

  /opt/oracle/software/p6880880_112000_LINUX.zip

Verified the installation as follows:

$ /opt/oracle/11.2.0.3/grid/OPatch/opatch version OPatch Version: 11.2.0.3.0 OPatch succeeded.

One-off Patch Conflict Detection and Resolution

I decided against using My Oracle Support Patch Plans, and used the following commands instead:

export GRID_HOME=/opt/oracle/11.2.0.3/grid

export DB_HOME=/opt/oracle/app/OracleHomes/db11.2.0.3

cd /opt/oracle/11.2.0.3/grid/OPatch

./opatch prereq CheckConflictAgainstOHWithDetail -ph /opt/oracle/software/p13919095/13923374 -oh $GRID_HOME

./opatch prereq CheckConflictAgainstOHWithDetail -ph /opt/oracle/software/p13919095/13923374 -oh $DB_HOME

./opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /opt/oracle/software/p13919095/13919095 -oh $GRID_HOME

./opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /opt/oracle/software/p13919095/13919095/custom/server/13919095 -oh $DB_HOME

All four (4) checks passed with the following messages:

Invoking prereq "checkconflictagainstohwithdetail" Prereq "checkConflictAgainstOHWithDetail" passed. OPatch succeeded.

Patch Installation in Grid Home

I am following the procedure in Case 5: Patching a Software Only GI Home Installation or Before the GI Home Is Configured:

/opt/oracle/11.2.0.3/grid/OPatch/opatch napply -oh /opt/oracle/11.2.0.3/grid -local /opt/oracle/software/p13919095/13919095

The result is:

Patch 13919095 successfully applied. OPatch Session completed with warnings. Log file location: /opt/oracle/11.2.0.3/grid/cfgtoollogs/opatch/opatch2012-10-01_15-52-02PM_1.log OPatch completed with warnings.

The log file is uploaded as opatch2012-10-01_15-52-02PM_1.log.

/opt/oracle/11.2.0.3/grid/OPatch/opatch apply -oh /opt/oracle/11.2.0.3/grid -local /opt/oracle/software/p13919095/13923374

The result is:

Verifying the update... Composite patch 13923374 successfully applied. Log file location: /opt/oracle/11.2.0.3/grid/cfgtoollogs/opatch/opatch2012-10-01_16-12-23PM_1.log OPatch succeeded.

The log file is uploaded as opatch2012-10-01_16-12-23PM_1.log.

Patch Installation in Oracle Home

The README for patch 13919095 does not mentioned the Oracle Home in Case 5: Patching a Software Only GI Home Installation or Before the GI Home Is Configured, but the README for patch 13923374 says that the patch 13919095 should also be applied to the Oracle Home.

/opt/oracle/app/OracleHomes/db11.2.0.3/OPatch/opatch napply -oh /opt/oracle/app/OracleHomes/db11.2.0.3 -local /opt/oracle/software/p13919095/13919095

The result is:

Verifying environment and performing prerequisite checks... UtilSession failed: Patch 13919095 requires component(s) that are not installed in OracleHome. These not-installed components are oracle.crs:11.2.0.3.0, oracle.usm:11.2.0.3.0, Log file location: /opt/oracle/app/OracleHomes/db11.2.0.3/cfgtoollogs/opatch/opatch2012-10-01_16-42-39PM_1.log OPatch failed with error code 73

Configure Grid Infrastructure for a Stand-Alone Server

The root script from the Grid Infrastructure Software Installation says to run the following commands:

sudo su -

/opt/oracle/11.2.0.3/grid/perl/bin/perl -I/opt/oracle/11.2.0.3/grid/perl/lib -I/opt/oracle/11.2.0.3/grid/crs/install /opt/oracle/11.2.0.3/grid/crs/install/roothas.pl

The output is:

Using configuration parameter file: /opt/oracle/11.2.0.3/grid/crs/install/crsconfig_params Creating trace directory User ignored Prerequisites during installation /opt/oracle/app/OracleHomes/db10g/bin/crsctl query crs activeversion ... failed rc=4 with message: Unexpected parameter: crs /opt/oracle/app/OracleHomes/db10g/bin/crsctl query crs activeversion ... failed rc=4 with message: Unexpected parameter: crs LOCAL ADD MODE Creating OCR keys for user 'oracle', privgrp 'oinstall'.. Operation successful. Failure 1 contacting CSS daemon. CRS-4664: Node gridctrl successfully pinned. Adding Clusterware entries to inittab gridctrl 2012/10/01 19:17:02 /opt/oracle/11.2.0.3/grid/cdata/gridctrl/backup_20121001_191702.olr Successfully configured Oracle Grid Infrastructure for a Standalone Server

Check CRS Status

Updated /etc/oratab as follows:

cat >>/etc/oratab <<DONE grid:/opt/oracle/11.2.0.3/grid:N DONE

The following commands were run:

export ORAENV_ASK=NO export ORACLE_SID=grid . oraenv crs_stat -t

The following result was obtained:

Name Type Target State Host ------------------------------------------------------------ ora.cssd ora.cssd.type OFFLINE OFFLINE ora.diskmon ora....on.type OFFLINE OFFLINE ora.evmd ora.evm.type ONLINE ONLINE gridctrl ora.ons ora.ons.type OFFLINE OFFLINE

Ran the following command to check the OCR:

sudo $(which ocrcheck)

The result is:

Status of Oracle Cluster Registry is as follows : Version : 3 Total space (kbytes) : 262120 Used space (kbytes) : 76 Available space (kbytes) : 262044 ID : 1098189611 Device/File Name : /opt/oracle/11.2.0.3/grid/cdata/localhost/local.ocr Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check succeeded

Post CRS Installation Cluster Verification Check

Ran the following command to check the CRS installation:

/opt/oracle/11.2.0.3/grid/bin/cluvfy stage -post crsinst -verbose -n gridctrl

I got the following error messages:

Performing post-checks for cluster services setup ERROR: PRVG-5745 : CRS Configuration detected, Restart configuration check not valid in this environment Verification cannot proceed Post-check for cluster services setup was unsuccessful on all the nodes.