Monthly Archives: June 2014

12c RAC: ORA-15477: cannot communicate with the volume driver

I received ORA-15477 when I was trying to set attribute  compatible.advm  for DATA diskgroup to 12.1

– Using SQL –

SQL> alter diskgroup DATA set attribute 'compatible.advm'='12.1';

alter diskgroup DATA set attribute 'compatible.advm'='12.1'
*
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15242: could not set attribute compatible.advm
ORA-15238: 12.1 is not a valid value for attribute compatible.advm
ORA-15477: cannot communicate with the volume driver

– using ASMCMD

ASMCMD> setattr -G DATA compatible.advm 12.1

ORA-15032: not all alterations performed
ORA-15242: could not set attribute compatible.advm
ORA-15238: 12.1 is not a valid value for attribute compatible.advm
ORA-15477: cannot communicate with the volume driver (DBD ERROR: OCIStmtExecute)
 A

– I tried to load advm drivers : again got error as version oracleasm rpm’s installed
did not match that of the OS

[root@host01 bin]# /u01/app/12.1.0/grid/bin/acfsload start

ACFS-9459: ADVM/ACFS is not supported on this OS version: '2.6.32-100.26.2.el5'

– checked version of oracleasm rpm’s installed – 2.6.18.238.el5

[grid@host01 bin]$ rpm -qa |grep oracleasm

oracleasm-2.6.18-238.el5-2.0.5-1.el5
oracleasmlib-2.0.4-1.el5
oracleasm-2.6.18-238.el5debug-2.0.5-1.el5
oracleasm-2.6.18-238.el5-debuginfo-2.0.5-1.el5
oracleasm-2.6.18-238.el5xen-2.0.5-1.el5
oracleasm-support-2.1.7-1.el5

– Checked kernel version : Kernel version = 2.6.32-100.26.2.el5 : different from oracleasm rpms (2.6.18-238.el5-2.0.5-1.el5)

[grid@host01 bin]$ uname -a
Linux host01.example.com 2.6.32-100.26.2.el5 #1 SMP Tue Jan 18 20:11:49 EST 2011 x86_64 x86_64 x86_64 GNU/Linux

– checked /etc/grub.conf : Two kernels were there and by default 2.6.32-100.26.2.el5 was getting loaded

[root@host01 bin]# cat /etc/grub.conf

# grub.conf generated by anaconda
#
# Note that you do not have to rerun grub after making changes to this file
# NOTICE:  You have a /boot partition.  This means that
#          all kernel and initrd paths are relative to /boot/, eg.
#          root (hd0,0)
#          kernel /vmlinuz-version ro root=/dev/sda2
#          initrd /initrd-version.img
#boot=/dev/sda
default=0
timeout=5
splashimage=(hd0,0)/grub/splash.xpm.gz
hiddenmenu
title Oracle Linux Server (2.6.32-100.26.2.el5uek)
root (hd0,0)
kernel /vmlinuz-2.6.32-100.26.2.el5 ro root=/dev/sda2 rhgb quiet
initrd /initrd-2.6.32-100.26.2.el5.img
title Oracle Linux Server-base (2.6.18-238.el5)
root (hd0,0)
kernel /vmlinuz-2.6.18-238.el5 ro root=LABEL=/ rhgb quiet
initrd /initrd-2.6.18-238.el5.img

– Edited /etc/grub.conf and modified default=1 so that kernel 2.6.18-238.el5 was loaded at boot time

# grub.conf generated by anaconda
#
# Note that you do not have to rerun grub after making changes to this file
# NOTICE:  You have a /boot partition.  This means that
#          all kernel and initrd paths are relative to /boot/, eg.
#          root (hd0,0)
#          kernel /vmlinuz-version ro root=/dev/sda2
#          initrd /initrd-version.img
#boot=/dev/sda

default=1

timeout=5
splashimage=(hd0,0)/grub/splash.xpm.gz
hiddenmenu
title Oracle Linux Server (2.6.32-100.26.2.el5uek)
root (hd0,0)
kernel /vmlinuz-2.6.32-100.26.2.el5 ro root=/dev/sda2 rhgb quiet
initrd /initrd-2.6.32-100.26.2.el5.img
title Oracle Linux Server-base (2.6.18-238.el5)
root (hd0,0)
kernel /vmlinuz-2.6.18-238.el5 ro root=LABEL=/ rhgb quiet
initrd /initrd-2.6.18-238.el5.img

– Rebooted and verified that loaded  kernel is 2.6.18-238.el5

[root@host01 ~]# init 6

uname -a
Linux host01.example.com 2.6.18-238.el5 #1 SMP Tue Jan 415:41:11 EST 2011 x86_64 x86_64 x86_64 GNU/Linux

- Checked that oracleacfs and oracleadvm modules were not loaded

[root@host01 ~]# lsmod |grep oracle
oracleasm              84136  1

– Tried to load ADVM modules – got error as ADVM/ACFS was not installed

[root@host01 ~]# $ORACLE_HOME/bin/acfsload start
ACFS-9391: Checking for existing ADVM/ACFS installation.
ACFS-9129: ADVM/ACFS not installed

– Used oerr to diagnose ACFS-9129

[root@host01 ~]# oerr ACFS 9129

09129, 0, "ADVM/ACFS not installed"
// *Cause:  No ADVM/ACFS drivers or commands have been found on the system.
//          All ADVM and ACFS actions will be disabled.
// *Action: Install components using 'acfsroot install <options>'.  No ACFS
//          file systems or ADVM volume devices will be available until
//          ADVM/ACFS has been installed.

– Installed ADVM/ACFS as advised by oerr

[root@host01 ~]# acfsroot install -h

ACFS-9161:  acfsroot install: Install ADVM/ACFS components.
ACFS-9185:  Usage: acfsroot install [-h] [-s | -v | -t <0,1,2>] [-l <directory>]
ACFS-9132:         [-h]             - print help/usage information
ACFS-9131:         [-s]             - silent mode (error messages only)
ACFS-9159:         [-v]             - verbose mode
ACFS-9332:         [-l <directory>] - location of the installation directory
ACFS-9189:         [-t <0,1,2> ]    - trace level
[root@host01 ~]# acfsroot install -v

ACFS-9500: Location of Oracle Home is '/u01/app/12.1.0/grid' as determined from the internal configuration data
ACFS-9505: Using acfsutil executable from location: '/u01/app/12.1.0/grid/usm/install/cmds/bin/acfsutil'
ACFS-9300: ADVM/ACFS distribution files found.
ACFS-9155: Checking for existing 'oracleoks.ko' driver installation.
ACFS-9155: Checking for existing 'oracleadvm.ko' driver installation.
ACFS-9155: Checking for existing 'oracleacfs.ko' driver installation.
ACFS-9307: Installing requested ADVM/ACFS software.
ACFS-9503: ADVM and ACFS driver media location is '/u01/app/12.1.0/grid/usm/install/Oracle/EL5/x86_64/2.6.18-8/2.6.18-8.el5-x86_64/bin'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/Oracle/EL5/x86_64/2.6.18-8/2.6.18-8.el5-x86_64/bin/oracleadvm.ko' to the path '/lib/modules/2.6.18-8.el5/extra/usm/oracleadvm.ko'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/Oracle/EL5/x86_64/2.6.18-8/2.6.18-8.el5-x86_64/bin/oracleoks.ko' to the path '/lib/modules/2.6.18-8.el5/extra/usm/oracleoks.ko'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/Oracle/EL5/x86_64/2.6.18-8/2.6.18-8.el5-x86_64/bin/oracleacfs.ko' to the path '/lib/modules/2.6.18-8.el5/extra/usm/oracleacfs.ko'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/advmutil' to the path '/sbin/advmutil'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/advmutil.bin' to the path '/sbin/advmutil.bin'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/fsck.acfs' to the path '/sbin/fsck.acfs'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/fsck.acfs.bin' to the path '/sbin/fsck.acfs.bin'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/mkfs.acfs' to the path '/sbin/mkfs.acfs'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/mkfs.acfs.bin' to the path '/sbin/mkfs.acfs.bin'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/mount.acfs' to the path '/sbin/mount.acfs'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/mount.acfs.bin' to the path '/sbin/mount.acfs.bin'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/acfsdbg' to the path '/sbin/acfsdbg'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/acfsdbg.bin' to the path '/sbin/acfsdbg.bin'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/acfsutil' to the path '/sbin/acfsutil'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/acfsutil.bin' to the path '/sbin/acfsutil.bin'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/umount.acfs' to the path '/sbin/umount.acfs'
ACFS-9504: Copying file '/u01/app/12.1.0/grid/usm/install/cmds/bin/umount.acfs.bin' to the path '/sbin/umount.acfs.bin'
ACFS-9308: Loading installed ADVM/ACFS drivers.
ACFS-9321: Creating udev for ADVM/ACFS.
ACFS-9323: Creating module dependencies - this may take some time.

- Checked that  ACFS/ADVM modules have been loaded

[root@host01 ~]# lsmod |grep oracle

 oracleacfs           2837904  0
oracleadvm            342512  2
oracleoks             409560  2 oracleacfs,oracleadvm
oracleasm              84136  1

– Now I could change the attribute compaible.advm for diskgroup DATA to 12.1 successfully

SQL> alter diskgroup DATA set attribute 'compatible.advm'='12.1';

Diskgroup altered.

I hope this post was useful.

Your comments and suggestions are always welcome.

————————————————————————————————————————

Related Links:

Home

12c RAC Index

 

————————–

12c RAC: ADD A NEW NETWORK INTERFACE

During installation I had configured  one network interface (eth1) for private interconnect .

[root@host01 stage]# oifcfg getif

eth0  192.9.201.0  global  public
eth1  10.0.0.0  global  cluster_interconnect,asm

Post installation, when I tried to add another network interface for private interconnect , I got the error :

[root@host01 stage]# oifcfg setif -global eth2/20.0.0.0:cluster_interconnect,asm
/proc/net/ipv6_route: No such file or directory

 

It appears that IPV6 should be enabled so that a network interface can be added  .

– Verified that  ipv6 is not enabled

[root@host01 ~]# ifconfig |grep inet6

To resolve this error, I enabled IPV6 on host01 as follows:

– Added the below entry in the /etc/modprobe.conf file

          alias net-pf-10 ipv6

– Deleted following entries from /etc/modprobe.conf file

     alias net-pf-10 off  

      alias ipv6 off

      options ipv6 disable=1

–    Changed the “ NETWORKING_IPV6” parameter value to yes in the /etc/sysconfig/network file.

      NETWORKING_IPV6=yes

– Restarted the server to enable the IPV6 support

 [root@host01 ~]# init 6

– After restart verified that IPV6 has been enabled

[root@host01 ~]# ifconfig |grep inet6
inet6 addr: fe80::20c:29ff:fe65:bedd/64 Scope:Link
 inet6 addr: fe80::20c:29ff:fe65:bee7/64 Scope:Link
 inet6 addr: fe80::20c:29ff:fe65:bef1/64 Scope:Link
 inet6 addr: ::1/128 Scope:Host

– Added another network interface (eth2) for private interconnect

[root@host01 stage]# oifcfg setif -global eth2/20.0.0.0:cluster_interconnect,asm

– Verified that new interface eth2 has been added to cluster configuration

[root@host01 ~]# oifcfg getif

eth0 192.9.201.0 global public
eth1 10.0.0.0 global cluster_interconnect,asm
eth2 20.0.0.0 global cluster_interconnect,asm

— Stopped and restarted clusterware on all nodes

[root@host01 ~]# crsctl stop cluster -all

[root@host01 ~]# crsctl start cluster -all

-- Verified that  clusterware has implemented HAIP by configuring private VIPs on eth1:1 and eth2:1 using IP addresses on the reserved 169.254.*.* subnet to support HAIP

[root@host01 ~]# ifconfig

eth0 Link encap:Ethernet HWaddr 00:0C:29:65:BE:DD
inet addr:192.9.201.183 Bcast:192.9.201.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe65:bedd/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:808244 errors:0 dropped:0 overruns:0 frame:0
TX packets:806090 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:862174440 (822.2 MiB) TX bytes:383633712 (365.8 MiB)

eth0:1 Link encap:Ethernet HWaddr 00:0C:29:65:BE:DD
inet addr:192.9.201.180 Bcast:192.9.201.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
...

eth1 Link encap:Ethernet HWaddr 00:0C:29:65:BE:E7 inet addr:10.0.0.1 Bcast:10.0.0.255 Mask:255.255.255.0 inet6 addr: fe80::20c:29ff:fe65:bee7/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:266399 errors:0 dropped:0 overruns:0 frame:0 TX packets:313687 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:179508582 (171.1 MiB) TX bytes:245137239 (233.7 MiB)

eth1:1 Link encap:Ethernet HWaddr 00:0C:29:65:BE:E7
inet addr:169.254.121.23 Bcast:169.254.127.255 Mask:255.255.128.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1

eth2 Link encap:Ethernet HWaddr 00:0C:29:65:BE:F1 inet addr:20.0.0.1 Bcast:20.0.0.255 Mask:255.255.255.0 inet6 addr: fe80::20c:29ff:fe65:bef1/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:60421 errors:0 dropped:0 overruns:0 frame:0 TX packets:60539 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:38334236 (36.5 MiB) TX bytes:48027009 (45.8 MiB) 

eth2:1 Link encap:Ethernet HWaddr 00:0C:29:65:BE:F1 
inet addr:169.254.143.152 Bcast:169.254.255.255 Mask:255.255.128.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:36703 errors:0 dropped:0 overruns:0 frame:0 TX packets:36703 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:41656757 (39.7 MiB) TX bytes:41656757 (39.7 MiB)

I hope this post was useful.

Your comments and suggestions are always welcome.

——————————————————————————–

Related Links :

Home

12c RAC Index

11g R2 RAC : Highly Available IP (HAIP)

11g R2 RAC: NIC Bonding

 

 

 

Regards

12c RAC INDEX

Home

12c RAC: Add A New Network Interface
12c RAC: CRS-2917: The ‘Free’ server pool cannot be removed from the system.
12c RAC: ORA-15477: cannot communicate with the volume driver
ASM Proxy: New Instance Type in Oracle 12c
Automatic Big Table Caching In RAC
CRS-4995: The command ‘Modify resource’ is invalid in crsctl. Use srvctl for this command.
Highly Available Unified Logging in RAC 
java.lang nullpointerexception While Installing 12.1.0.2 RAC Database Sftware
Oracle 12c Cluster: ACFS Leverages Flex ASM
Oracle 12.1.0.2c Standard Cluster: Empty Alert Log
Oracle 12.1.0.2c Standard Cluster: New Location / Name For Alert Log
Oracle ACFS High Availability NFS Services (HANFS) Part-I
Oracle ACFS High Availability NFS Services (HANFS) Part-II
Oracle Automatic Storage Management Filter Driver (Oracle ASMFD)
Oracle Clusterware 12c: What-If Command Evalulation-Part-I
Oracle Clusterware 12c: What-If Command Evalulation-Part-II
Oracle Flex Custer: Leaf Node Application Failover
Oracle Flex Cluster: Leaf Node Failover
Oracle Multitenant: Convert Single Instance PDB to RAC Plugging It Into  A RAC CDB
Policy Based Cluster Management In Oracle 12c
Policy Managed RAC One Node Databases
Re-registering Databases In A Cluster With srvctl: Problems And Solutions
Server Pools : What’s New In Oracle 12c?
Split Brain: What’s New In 12.1.0.2c?
Troubleshooting ASM Proxy instance startup
Upgrade 11g R2 RAC Database To 12c RAC Pluggable Database Using Full Transportable Export / Import

12c RAC : CRS-2917: The ‘Free’ server pool cannot be removed from the system.

I got following error when I was trying to configure a user defined policy set using a policy set definition file.

[grid@host01 ~]$ crsctl modify policyset -file policy.txt

CRS-2917: The ‘Free’ server pool cannot be removed from the system.
CRS-4000: Command Modify failed, or completed with errors.

- I tried to diagnose the error using oerr as follows:

[grid@host01 ~]$ oerr CRS 2917

2917, 1, "The '%s' server pool cannot be removed from the system."
// *Cause: The command to remove the server pool from the policy set
// would have caused it to be removed from the system completely.
// *Action: Reissue the 'crsctl modify policyset' command with the -ksp option.

- I reissued the command with -ksp option as advised

[grid@host01 ~]$ crsctl modify policyset -file policy.txt -ksp

- The command succeeded successfully.

I hope this post was useful.

Your commands and suggestions are always welcome.

——————————————————————————-

Related Links :

Home

12c RAC Index

CRS-2615: Could not find server pool ‘smallpool’

Oracle Enterprise Manager Cloud Control 12c Release 4 Released

The long awaited OEM 12c R4 has finally been released ….

You can download it here and experience a whole lot of its new features.

To find out about its new features , click here for oracle documentation.

Click here for the video Introducing  OEM 12c Release 4.

References:

https://blogs.oracle.com/partnernews/entry/introducing_oracle_enterprise_manager_12c?utm_source=feedburner&utm_medium=email&utm_campaign=Feed%3A+orana+%28OraNA%29

http://oramanageability.wordpress.com/2014/06/03/whats-new-in-oem-12c-release-4-12-1-0-4/?utm_source=feedburner&utm_medium=email&utm_campaign=Feed%3A+orana+%28OraNA%29

———————————————————————————————–

Related links :

Home

OraNews