2014-06-17 Integrate BI Publisher into OEM

Overview

The word from Oracle (on the Information Publisher Reports page) is:

Oracle Business Intelligence (BI) Publisher is replacing Information Publisher as Enterprise Manager's comprehensive reporting system. Information Publisher is deprecated as of Enterprise Manager release 12 with no planned future enhancements. Oracle strongly recommends migrating your reports to BI Publisher

References

• Oracle® Enterprise Manager Cloud Control Advanced Installation and Configuration Guide 12c Release 3 (12.1.0.3)
  • 15 Integrating BI Publisher with Enterprise Manager
    • 15.1 Overview
      • 15.1.2 Downloading Oracle BI Publisher
    • 15.2 BI Publisher Installation and Integration with Enterprise Manager 12c
      • 15.2.2 Installing Enterprise Manager and Required Infrastructure
        • 15.2.2.1 Installing BI EE Using Software-only Install
        • 15.2.2.2 Integrating BI Publisher with Enterprise Manager using the configureBIP Script
          • 15.2.2.2.1 Integrating BI Publisher with Enterprise Manager using the configureBIP Script in Normal Mode
    • 15.3 Verifying Integration of BI Publisher with Enterprise Manager
• Oracle® Enterprise Manager Cloud Control Administrator's Guide 12c Release 3 (12.1.0.3)
  • 31 Backing Up and Recovering Enterprise Manager
    • 31.4 Oracle Management Service Backup
• Michael Kerrisk - man7.org
  • chown
  • date
  • df
  • ls
  • mkdir
  • vmstat
  • xargs
  • yum

Procedure

Update Oracle Bash Profile

In order to make it easier for me to remember where everything is, I have updated .bash_profile as follows:

cat >>~/.bash_profile <<DONE export ORACLE_BASE=/opt/app/oracle export EM_HOME=\${ORACLE_BASE}/em export AGENT_INSTANCE=\${EM_HOME}/agent/agent_inst export AGENT_HOME=\${EM_HOME}/agent/core/12.1.0.3.0 export MW_HOME=\${EM_HOME}/middleware export OMS_HOME=\${MW_HOME}/oms export WLS_HOME=\${MW_HOME}/wlserver_10.3 DONE

Download Software

Following the procedure in 15.1.2 Downloading Oracle BI Publisher, I downloaded the following five (5) files from Oracle Business Intelligence Publisher 11.1.1.6.0 for Linux x86-64-bit:

1. bi_linux_x86_111160_64_disk1_1of2.zip
2. bi_linux_x86_111160_64_disk1_2of2.zip
3. bi_linux_x86_111160_64_disk2_1of2.zip
4. bi_linux_x86_111160_64_disk2_2of2.zip
5. bi_linux_x86_111160_64_disk3.zip

Copied these files to D:\VM\Software which is a shared folder mounted on CRONULLA.

Checking System Resources

In 15.2.2 Installing Enterprise Manager and Required Infrastructure,

In order to support the required resources for BI Publisher, the first OMS system (where BI Publisher is initially installed) needs the following additional system requirements above and beyond what is already required by Enterprise Manager:

• +1.5 GB of RAM
• +10 GB of disk space

Checking Memory Usage

I used the following command to see what the memory usage on CRONULLA is:

vmstat -s -S M|grep memory

The results are:

5970 M total memory

4514 M used memory

3617 M active memory

653 M inactive memory

1455 M free memory

199 M buffer memory

There seems to be almost enough free memory to accommodate BI Publisher. However, I will add 500 MB just to be safe.

Checking Disk Space Usage

I used the following command to see what the disk space usage on CRONULLA is:

df -hl

The results are:

Filesystem Size Used Avail Use% Mounted on

/dev/mapper/vg_cronulla-lv_root 36G 25G 10G 71% /

tmpfs 3.0G 0 3.0G 0% /dev/shm

/dev/sda1 477M 55M 398M 13% /boot

Software 932G 222G 710G 24% /media/sf_Software

There seems to be just enough free disk space to accommodate BI Publisher. (The Software file-system is an artefact of VirtualBox for a shared folder.) However, I will add 20 GB to /dev/mapper/vg_cronulla-lv_root file-system just to be safe, and to allow for future expansion.

Add Extra Resources

I shutdown CRONULLA and made adjustments to the VirtualBox settings for that VM image.

I used the procedure in 05 Add Extra Disk Space to add the following disk:

The final settings are:

I found that there was no need to add the extra disk as I had only used 10G of the second disk leaving 10G unused. In the end, I added an extra 29G to the root file system.

Installing BI EE Using Software-only Install

The outline of the procedure is in 15.2.2.1 Installing BI EE Using Software-only Install.

Back-up OMS

Using the procedure in 31.4 Oracle Management Service Backup, I ran the following commands:

{

backup_dir=${ORACLE_BASE}/backup/oms/$(date --iso-8601)

mkdir -p ${backup_dir}

${OMS_HOME}/bin/emctl exportconfig oms -dir ${backup_dir}

}

The output is:

Oracle Enterprise Manager Cloud Control 12c Release 3 Copyright (c) 1996, 2013 Oracle Corporation. All rights reserved. Enter Enterprise Manager Root (SYSMAN) Password : ExportConfig started... Machine is Admin Server host. Performing Admin Server backup... Exporting emoms properties... Exporting secure properties... Export has determined that the OMS is not fronted by an SLB. The local hostname was NOT exported. The exported data can be imported on any host but resecure of all agents will be required. Please see the EM Advanced Configuration Guide for more details. Exporting configuration for pluggable modules... Preparing archive file... Backup has been written to file: /opt/app/oracle/backup/oms/2014-05-24/opf_ADMIN_20140524_170410.bka The export file contains sensitive data. You must keep it secure. ExportConfig completed successfully!

Extract the Software

Because of the way VirtualBox has mounted the shared folder, I had to use root to extract the files as follows:

sudo su -

cd /media/sf_Software/

ls|xargs -n1 unzip -o -q -d /opt/app/oracle/software

chown -R oracle:oinstall /opt/app/oracle/software/bishiphome/

Run the Installer

Used the following commands (as oracle) to start the installer:

cd /opt/app/oracle/software/bishiphome

Disk1/runInstaller

Step 1: Welcome

The following screen appears:

Clicked Next to get the next screen.

Step 2: Skip Software Updates

I chose to Skip Software Updates as shown below:

Clicked Next to get the next screen.

Step 3: Software Only Install

I chose to do a Software Only Install as shown below:

Clicked Next to get the next screen.

Step 4: Prerequisite Checks

The results of the prerequisite checks is shown below:

The results are:

Root Checking operating system certification Expected result: One of oracle-6,oracle-5.6,enterprise-5.4,enterprise-4,enterprise-5,redhat-5.4,redhat-4,redhat-5,SuSE-10,SuSE-11 Actual Result: oracle-6 Check complete. The overall result of this check is: Passed Checking recommended operating system packages Checking for binutils-2.20.51.0.2-5.11.el6-x86_64; found binutils-2.20.51.0.2-5.36.el6-x86_64. Passed Checking for compat-libcap1-1.10-1-x86_64; Not found. Failed <<<< Checking for compat-libstdc++-33-3.2.3-69.el6-x86_64; Not found. Failed <<<< Checking for compat-libstdc++-33-3.2.3-69.el6-i686; Not found. Failed <<<< Checking for libgcc-4.4.4-13.el6-i686; Not found. Failed <<<< Checking for libgcc-4.4.4-13.el6-x86_64; found libgcc-4.4.7-4.el6-x86_64. Passed Checking for libstdc++-4.4.4-13.el6-x86_64; found libstdc++-4.4.7-4.el6-x86_64. Passed Checking for libstdc++-4.4.4-13.el6-i686; Not found. Failed <<<< Checking for libstdc++-devel-4.4.4-13.el6-x86_64; found libstdc++-devel-4.4.7-4.el6-x86_64. Passed Checking for sysstat-9.0.4-11.el6-x86_64; found sysstat-9.0.4-22.el6-x86_64. Passed Checking for gcc-4.4.4-13.el6-x86_64; found gcc-4.4.7-4.el6-x86_64. Passed Checking for gcc-c++-4.4.4-13.el6-x86_64; found gcc-c++-4.4.7-4.el6-x86_64. Passed Checking for glibc-2.12-1.7.el6-i686; found glibc-2.12-1.132.el6-i686. Passed Checking for glibc-2.12-1.7.el6-x86_64; found glibc-2.12-1.132.el6-x86_64. Passed Checking for glibc-devel-2.12-1.7.el6-x86_64; found glibc-devel-2.12-1.132.el6-x86_64. Passed Checking for glibc-devel-2.12-1.7.el6; found glibc-devel-2.12-1.132.el6-x86_64. Passed Checking for libaio-0.3.107-10.el6-x86_64; found libaio-0.3.107-10.el6-x86_64. Passed Checking for libaio-devel-0.3.107-10.el6-x86_64; Not found. Failed <<<< Check complete. The overall result of this check is: Failed <<<< Problem: Some recommended packages are missing (see above). Recommendation: You may actually have installed packages which have obsoleted these, in which case you can successfully continue with the install. If you have not, it is recommended that you do not continue. Refer to the product release notes to find out how to get the missing packages and update the system. Checking kernel parameters Checking for VERSION=2.6.32-100.28.5.el6; found VERSION=3.8.13-16.2.1.el6uek.x86_64. Passed Checking for hardnofiles=4096; found hardnofiles=4096. Passed Checking for softnofiles=4096; found softnofiles=4096. Passed Check complete. The overall result of this check is: Passed Checking Recommended glibc version Expected result: ATLEAST=2.12-1.7.el6 Actual Result: 2.12-1.132.el6 Check complete. The overall result of this check is: Passed Checking physical memory Expected result: 1024MB Actual Result: 6472MB Check complete. The overall result of this check is: Passed Checking for LD_ASSUME_KERNEL environment variable Expected result: LD_ASSUME_KERNEL environment variable should not be set in the environment. Actual Result: Variable Not set. Check complete. The overall result of this check is: Passed

Install Missing Packages

Based on the output above, I installed the missing packages as follows (corrected after I found I had mad e a mistake in the names):

yum install compat-libcap1.x86_64 compat-libstdc++-33.x86_64 compat-libstdc++-33.i686 libgcc.i686 libstdc++.i686 libaio-devel.x86_64

The actual results using the actual commands I ran were (even though I got one name wrong!):

[root@cronulla ~]# yum install compat-libcap1.x86_64 compat-libstdc++-33.x86_64 ompat-libstdc++-33.i686 libgcc.i686 libstdc++.i686 libaio-devel.x86_64 Loaded plugins: security Setting up Install Process No package ompat-libstdc++-33.i686 available. Resolving Dependencies --> Running transaction check ---> Package compat-libcap1.x86_64 0:1.10-1 will be installed ---> Package compat-libstdc++-33.x86_64 0:3.2.3-69.el6 will be installed ---> Package libaio-devel.x86_64 0:0.3.107-10.el6 will be installed ---> Package libgcc.i686 0:4.4.7-4.el6 will be installed ---> Package libstdc++.i686 0:4.4.7-4.el6 will be installed --> Finished Dependency Resolution Dependencies Resolved =============================================================================================================== Package Arch Version Repository Size =============================================================================================================== Installing: compat-libcap1 x86_64 1.10-1 public_ol6_latest 17 k compat-libstdc++-33 x86_64 3.2.3-69.el6 public_ol6_latest 183 k libaio-devel x86_64 0.3.107-10.el6 public_ol6_latest 13 k libgcc i686 4.4.7-4.el6 public_ol6_latest 112 k libstdc++ i686 4.4.7-4.el6 public_ol6_latest 300 k Transaction Summary =============================================================================================================== Install 5 Package(s) Total download size: 623 k Installed size: 1.9 M Is this ok [y/N]: y Downloading Packages: (1/5): compat-libcap1-1.10-1.x86_64.rpm | 17 kB 00:00 (2/5): compat-libstdc++-33-3.2.3-69.el6.x86_64.rpm | 183 kB 00:00 (3/5): libaio-devel-0.3.107-10.el6.x86_64.rpm | 13 kB 00:00 (4/5): libgcc-4.4.7-4.el6.i686.rpm | 112 kB 00:01 (5/5): libstdc++-4.4.7-4.el6.i686.rpm | 300 kB 00:01 --------------------------------------------------------------------------------------------------------------- Total 141 kB/s | 623 kB 00:04 Running rpm_check_debug Running Transaction Test Transaction Test Succeeded Running Transaction Installing : libaio-devel-0.3.107-10.el6.x86_64 1/5 Installing : compat-libstdc++-33-3.2.3-69.el6.x86_64 2/5 Installing : compat-libcap1-1.10-1.x86_64 3/5 Installing : libgcc-4.4.7-4.el6.i686 4/5 Installing : libstdc++-4.4.7-4.el6.i686 5/5 Verifying : compat-libcap1-1.10-1.x86_64 1/5 Verifying : libstdc++-4.4.7-4.el6.i686 2/5 Verifying : compat-libstdc++-33-3.2.3-69.el6.x86_64 3/5 Verifying : libaio-devel-0.3.107-10.el6.x86_64 4/5 Verifying : libgcc-4.4.7-4.el6.i686 5/5 Installed: compat-libcap1.x86_64 0:1.10-1 compat-libstdc++-33.x86_64 0:3.2.3-69.el6 libaio-devel.x86_64 0:0.3.107-10.el6 libgcc.i686 0:4.4.7-4.el6 libstdc++.i686 0:4.4.7-4.el6 Complete! [root@cronulla ~]# yum install compat-libstdc++-33.i686 Loaded plugins: security Setting up Install Process Resolving Dependencies --> Running transaction check ---> Package compat-libstdc++-33.i686 0:3.2.3-69.el6 will be installed --> Finished Dependency Resolution Dependencies Resolved =============================================================================================================== Package Arch Version Repository Size =============================================================================================================== Installing: compat-libstdc++-33 i686 3.2.3-69.el6 public_ol6_latest 188 k Transaction Summary =============================================================================================================== Install 1 Package(s) Total download size: 188 k Installed size: 716 k Is this ok [y/N]: y Downloading Packages: compat-libstdc++-33-3.2.3-69.el6.i686.rpm | 188 kB 00:00 Running rpm_check_debug Running Transaction Test Transaction Test Succeeded Running Transaction Installing : compat-libstdc++-33-3.2.3-69.el6.i686 1/1 Verifying : compat-libstdc++-33-3.2.3-69.el6.i686 1/1 Installed: compat-libstdc++-33.i686 0:3.2.3-69.el6 Complete!

I re-ran the Prerequisite Checks to get the following all-clear:

Clicked Next to get the next screen.

Step 5: Specify Installation Location

The procedure in 15.2.2.1 Installing BI EE Using Software-only Install says to continue, although I am worried about the warning message below:

Clicked Next to get the next screen.

Step 6: Specify Security Updates

I decided against getting security updates as shown below:

Clicked Next to get the next screen.

Clicked Yes on the warning message to get the next screen.

Step 7: Summary

Clicked Install to get the next screen.

Step 8: Installation Progress

Once the installation had completed, I clicked Next to get the next screen.

Step 9: Complete

Clicked Finish to exit.

Integrating BI Publisher with Enterprise Manager using the configureBIP Script

Backup Domain Configuration

Following the procedure in 15.2.2.2 Integrating BI Publisher with Enterprise Manager using the configureBIP Script, I backed up the domain configuration as follows:

cd /opt/app/oracle/em/gc_inst/user_projects/domains

zip -r GCDomain.zip GCDomain

Integrating BI Publisher with Enterprise Manager using the configureBIP Script in Normal Mode

Since this is a fresh install of OEM 12.1.0.3, I will follow the procedure in 15.2.2.2.1 Integrating BI Publisher with Enterprise Manager using the configureBIP Script in Normal Mode:

cd ${OMS_HOME}/bin

./configureBIP

The result is:

Configuring BI Publisher Version "11.1.1.6.0" to work with Enterprise Manager Logging started at /opt/app/oracle/em/middleware/oms/cfgtoollogs/bip/bipca_20140524203854.log. It it strongly recommended to backup the domain before configuring BI Publisher. Are you sure you want to continue with BI Publisher configuration [no] ? yes Enter sysdba user name (sys): Enter sysdba user password: Enter Administration Server user password: Checking for SYSMAN_BIPLATFORM schema... Attempting to create SYSMAN_BIPLATFORM schema... Processing command line .... Repository Creation Utility - Checking Prerequisites Checking Global Prerequisites Repository Creation Utility - Checking Prerequisites Checking Component Prerequisites Repository Creation Utility - Creating Tablespaces Validating and Creating Tablespaces Repository Creation Utility - Create Repository Create in progress. Percent Complete: 0 Percent Complete: 10 Percent Complete: 30 Percent Complete: 50 Percent Complete: 50 Percent Complete: 100 Repository Creation Utility: Create - Completion Summary Database details: Connect Descriptor : (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=gridctrl.yaocm.id.au)(PORT=1521)))(CONNECT_DATA=(SID=repos))) Connected As : sys Prefix for (prefixable) Schema Owners : SYSMAN RCU Logfile : /opt/app/oracle/em/middleware/oms/cfgtoollogs/bip/emBIPLATFORM.log Component schemas created: Component Status Logfile Business Intelligence Platform Success /opt/app/oracle/em/middleware/oms/cfgtoollogs/bip/biplatform.log Repository Creation Utility - Create : Operation Completed Driver: oracle.jdbc.driver.OracleDriver creating logger.. Connection exception in action logger path calculated: /opt/app/oracle/em/middleware/oms/sysman/log/schemamanager/ action logger path calculated: /opt/app/oracle/em/middleware/oms/sysman/log/schemamanager/ action logger path calculated finally: /opt/app/oracle/em/middleware/oms/sysman/log/schemamanager/ no action logger file name from previous session action logger filename after search: emschema.log action logger filename finally: emschema.log Logger FileName:/opt/app/oracle/em/middleware/oms/sysman/log/schemamanager/emschema.log already exists: /opt/app/oracle/em/middleware/oms/sysman/log/schemamanager/emschema.log jdbcUrl = jdbc:oracle:thin:@(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=gridctrl.yaocm.id.au)(PORT=1521)))(CONNECT_DATA=(SID=repos))) Successfully created SYSMAN_BIPLATFORM schema... Enter an integer between 9701 and 49152 for the BI Publisher HTTP server port. Enter -1 to disable the port (9701): Enter an integer between 9702 and 49152 for the BI Publisher HTTPS server port. Enter -1 to disable the port (9702): Extending domain with BI Publisher. This may take a few minutes... BI Publisher server running at http://cronulla.yaocm.id.au:9701/xmlpserver. BI Publisher server running at https://cronulla.yaocm.id.au:9702/xmlpserver. Registering BI Publisher with Enterprise Manager and deploying reports... Successfully setup BI Publisher with Enterprise Manager

Update Firewall

I need to update the firewall in order to access BI Publisher. I followed the procedure in 08 Configure Firewall Rules to add the following rules:

iptables --insert INPUT 23 --proto tcp --match state --state NEW --match tcp --dport 9701 --jump ACCEPT iptables --insert INPUT 24 --proto tcp --match state --state NEW --match tcp --dport 9702 --jump ACCEPT service iptables save

Resource Usage After BI Publisher Installation

After installation of BI Publisher, the resource usage is as follows:

[root@cronulla ~]# vmstat -s -S M|grep memory 6474 M total memory 6360 M used memory 3626 M active memory 2337 M inactive memory 113 M free memory 89 M buffer memory [root@cronulla ~]# df -hl Filesystem Size Used Avail Use% Mounted on /dev/mapper/vg_cronulla-lv_root 65G 42G 20G 69% / tmpfs 3.2G 0 3.2G 0% /dev/shm /dev/sda1 477M 55M 398M 13% /boot Software 932G 249G 683G 27% /media/sf_Software

In summary, I was right to add the extra disk space and memory. The space used by BI Publisher was 17G instead of 10G. The extra memory usage was 1846M.