Whilst adding a node failing with following errors in the addnode.log
INFO: /u01/app/11.2.0.4/grid/oui/bin/../bin/lsnodes: struct size 0
INFO: Vendor clusterware is not detected.
INFO: Error ocurred while retrieving node numbers of the existing nodes. Please check if clusterware home is properly configured.
SEVERE: Error ocurred while retrieving node numbers of the existing nodes. Please check if clusterware home is properly configured.
INFO: User Selected: Yes/OK
There were few obvious reasons for this
1. bug in 11.2.0.4 which overwrite the lsnodes
Resolution:- copy the olsnodes.bin to lsnodes.bin and olsnodes to lsnodes in the node where you were running
2. Look at the permission of your grid home
Resolution: chown –R oracle:oinstall /u01/app/grid/11.2.0.4/grid
3. The node you are adding is not properly deleted i.e you have not performed update nodelist after your rootcrs.pl deconfig
Resolution: In any other nodes apart from the deleted node run ./runInstaller -updateNodeList ORACLE_HOME= "CLUSTER_NODES={rac1}" CRS=TRUE
-Thanks
Geek DBAGeek DBA
This is also an issue and valid workaround on 12.1.0.2
In Oracle RAC 12cR1:
====================
You must also check the content of the file called inventory.xml, for example in my situation:
grid@ovmsol02:~$ cat /u01/app/oraInventory/ContentsXML/inventory.xml
12.1.0.2.0
2.1.0.6.0
<==== This node was remove
grid@ovmsol02:~$
If this is your situation, that you forgot to execute the following command after execute $ORACLE_HOME/deinstall/desinstall -local, over the node to be deleted;
grid@ovmsol02:~$ $ORACLE_HOME/oui/bin/runInstaller -updateNodeList ORACLE_HOME=$ORACLE_HOME CLUSTER_NODES=ovmsol02 CRS=TRUE -silent
Starting Oracle Universal Installer…
Checking swap space: must be greater than 500 MB. Actual 11588 MB Passed
The inventory pointer is located at /var/opt/oracle/oraInst.loc
‘UpdateNodeList’ was successful.
grid@ovmsol02:~$
If you check the file inventory.xml;
grid@ovmsol02:~$ cat /u01/app/oraInventory/ContentsXML/inventory.xml
12.1.0.2.0
2.1.0.6.0
</INVENTORY
grid@ovmsol02:~$
You can see that just only the node ovmsol02 remain in the file.
After that the message error:
grid@ovmsol02:/u01/app$ $ORACLE_HOME/addnode/addnode.sh -silent "CLUSTER_NEW_NODES={ovmsol01}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={ovmsol01-vip.obe.com}" -ignorePreReq -ignoreSysPrereqs
Starting Oracle Universal Installer…
Checking Temp space: must be greater than 120 MB. Actual 9881 MB Passed
Checking swap space: must be greater than 150 MB. Actual 11604 MB Passed
Prepare Configuration in progress.
Prepare Configuration successful.
………………………………………….. 8% Done.
You can find the log of this install session at:
/u01/app/oraInventory/logs/addNodeActions2017-08-22_04-13-38PM.log
SEVERE:Error ocurred while retrieving node numbers of the existing nodes. Please check if clusterware home is properly configured.
[FATAL] [INS-10008] Session initialization failed
CAUSE: An unexpected error occured while initializing the session.
ACTION: Contact Oracle Support Services or refer logs
SUMMARY:
–
grid@ovmsol02:/u01/app$
If you check the content of the log file relate with the error to execute addnode.sh:
grid@ovmsol02:~$ cat /u01/app/oraInventory/logs/addNodeActions2017-08-22_04-13-38PM.log
INFO: ORACLE_HOME=/u01/app/12.1.0.2/grid
INFO: fwhome=/u01/app/12.1.0.2/grid
INFO: Gathering system details…
INFO: Building Flow
INFO: Opening bean stores from which the beans can be loaded
INFO: Loaded BeanStore using the flow data defaults
INFO: No global condition definition found.
INFO: Building the flow graph
INFO: Loaded state init
INFO: Loaded state CRSNodeScalerDetails
INFO: Loaded state RootConfigurationMethodUI
INFO: Loaded state prereqExecutionDecider
INFO: Loaded state performChecks
INFO: Loaded state showSummary
INFO: Loaded state setup
INFO: Loaded state finish
INFO: Linking states
INFO: State[CRSNodeScalerDetails]: route=success; to=prereqExecutionDecider
INFO: State[RootConfigurationMethodUI]: route=success; to=prereqExecutionDecider
INFO: Condition of state[RootConfigurationMethodUI]: route=matched; to=prereqExecutionDecider
INFO: State[init]: route=success; to=CRSNodeScalerDetails
INFO: State[performChecks]: route=success; to=showSummary
INFO: State[prereqExecutionDecider]: route=executeprereqs; to=performChecks
INFO: State[prereqExecutionDecider]: route=ignoreprereqs; to=showSummary
INFO: State[setup]: route=success; to=finish
INFO: State[showSummary]: route=success; to=setup
INFO: Successfully built the flow
.
.
.
INFO: Checking if nodes are alive…
INFO: Checking if nodes are alive…
INFO: Checking if nodes are alive…
INFO: Validating user equivalence…
INFO: Validating user equivalence…
INFO: Validating user equivalence…
INFO: Validating nodes ovmsol01…
INFO: Validating nodes ovmsol01…
INFO: Validating nodes ovmsol01…
INFO: Checking if nodes are alive…
INFO: Checking if nodes are alive…
INFO: Checking if nodes are alive…
INFO: Validating user equivalence…
INFO: Validating user equivalence…
INFO: Validating user equivalence…
INFO: Checking if remote nodes are clean machines…
INFO: Checking if remote nodes are clean machines…
INFO: Checking if remote nodes are clean machines…
INFO: Status of nodes in the cluster:
Status of node ‘ovmsol01’:
Node is okay
Status of node ‘ovmsol01’:
Node is okay
————————————————————————–
INFO: Setting variable ‘REMOTE_CLEAN_MACHINES’ to ‘ovmsol01’. Received the value from a code block.
INFO: /u01/app/12.1.0.2/grid/oui/bin/../bin/lsnodes: struct size 0
INFO: Vendor clusterware is not detected.
INFO: Error ocurred while retrieving node numbers of the existing nodes. Please check if clusterware home is properly configured.
SEVERE: Error ocurred while retrieving node numbers of the existing nodes. Please check if clusterware home is properly configured.
INFO: Alert Handler not registered, using Super class functionality
INFO: Alert Handler not registered, using Super class functionality
INFO: User Selected: Yes/OK
INFO: Shutting down OUISetupDriver.JobExecutorThread
SEVERE: [FATAL] [INS-10008] Session initialization failed
CAUSE: An unexpected error occured while initializing the session.
ACTION: Contact Oracle Support Services or refer logs
SUMMARY:
– .
Refer associated stacktrace #oracle.install.commons.util.exception.DefaultErrorAdvisor:299
INFO: Advice is ABORT
SEVERE: Unconditional Exit
INFO: Adding ExitStatus FAILURE to the exit status set
INFO: Finding the most appropriate exit status for the current application
INFO: Exit Status is -1
INFO: Shutdown Oracle Grid Infrastructure 12c Release 1 Installer
INFO: Unloading Setup Driver
grid@ovmsol02:~$
Don’t happend again…this is for Oracle RAC 12cR1.
Hi
Thanks for posting about 12c fix. It helps.
Regards
Suresh