10 Configure ASM Storage

References

Overview

The ASM storage is configured on the FREENAS NFS server using the Oracle DirectNFS driver.

Corrections have been made based on information in 13 Create Database Successful.

Even more corrections have been made based on information in 14 Set Up DirectNFS for Example Database.

Procedure

Create NFS Volume and Share

Using the FreeNAS Web Gui at http://freenas.yaocm.id.au, I created a ZFS dataset called ASMDATA which is 7GB in size, and is owned by asm:asmdba.

I also created a NFS Share for /mnt/PENRITH/ASMDATA for access only by the 192.168.2.0/24 network and having a Maproot User of root.

Enabling Direct NFS Client Oracle Disk Manager Control of NFS

Following the procedure in Enabling Direct NFS Client Oracle Disk Manager Control of NFS, first on PENRITH1:

su - mkdir /u07 chown asm:asmdba /u07 cat >>/etc/fstab <<DONE freenas-nas:/mnt/PENRITH/ASMDATA /u07 nfs rw,bg,hard,nointr,rsize=32768,wsize=32768,tcp,noac,actimeo=0,vers=3,timeo=600 DONE mount /u07 su - asm cd /u01/app/asm/product/11.1.0/db_1/dbs cat >oranfstab <<DONE server: freenas path: 192.168.2.1 local: 192.168.2.2 export: /mnt/PENRITH/ASMDATA mount: /u07 DONE

This is repeated on PENRITH2. Here, I am mounting the NFS share for ASM files on /u07 and setting up the DirectNFS driver configuration.

The driver is enabled as follows, on PENRITH2,:

[asm@penrith2 dbs]$ cd ../lib [asm@penrith2 lib]$ cp libodm11.so libodm11.so_stub [asm@penrith2 lib]$ ln -s libnfsodm11.so libodm11.so ln: creating symbolic link `libodm11.so' to `libnfsodm11.so': File exists [asm@penrith2 lib]$ ls -l libodm11.so lrwxrwxrwx 1 asm oinstall 12 Jan 2 08:18 libodm11.so -> libodmd11.so

This was repeated on PENRITH1.

Create the NFS Disk Drives

Followed the procedure in How To Create ASM Diskgroups using NFS/NAS Files? (Doc ID 731775.1), to create two (2) NFS disk drives:

recovery.dbf of size 4GB
data.dbf of size 3GB

[asm@penrith1 u07]$ dd if=/dev/zero of=/u07/recovery.dbf bs=8192 count=520000 520000+0 records in 520000+0 records out 4259840000 bytes (4.3 GB) copied, 2078.18 seconds, 2.0 MB/s [asm@penrith1 u07]$ dd if=/dev/zero of=/u07/data.dbf bs=8192 count=400000 dd: writing `/u07/data.dbf': Disk quota exceeded 397393+0 records in 397392+0 records out 3255435264 bytes (3.3 GB) copied, 1646.34 seconds, 2.0 MB/s [asm@penrith1 u07]$ ls -lh total 7.1G -rw-r--r-- 1 asm asmdba 3.1G Jan 4 23:31 data.dbf -rw-r--r-- 1 asm asmdba 4.0G Jan 4 21:47 recovery.dbf [asm@penrith1 u07]$ df -h . Filesystem Size Used Avail Use% Mounted on freenas-nas:/mnt/PENRITH/ASMDATA 7.1G 7.1G 0 100% /u07

Change Permissions

The permissions on the ASM files are changed as follows:

[root@penrith1 ~]# chmod 775 /u07 [root@penrith1 ~]# chown -R asm:oinstall /u07 [root@penrith1 ~]# chmod 664 /u07/*.dbf

Change Startup Parameters

The following is added to the pfile, $ORACLE_HOME/dbs/init+ASM1.ora,:

FILESYSTEMIO_OPTIONS = directIO

09 Install Oracle Database Software

11 Create Database Failed