Subscribe to Posts by Email

Subscriber Count

    696

Disclaimer

All information is offered in good faith and in the hope that it may be of use for educational purpose and for Database community purpose, but is not guaranteed to be correct, up to date or suitable for any particular purpose. db.geeksinsight.com accepts no liability in respect of this information or its use. This site is independent of and does not represent Oracle Corporation in any way. Oracle does not officially sponsor, approve, or endorse this site or its content and if notify any such I am happy to remove. Product and company names mentioned in this website may be the trademarks of their respective owners and published here for informational purpose only. This is my personal blog. The views expressed on these pages are mine and learnt from other blogs and bloggers and to enhance and support the DBA community and this web blog does not represent the thoughts, intentions, plans or strategies of my current employer nor the Oracle and its affiliates or any other companies. And this website does not offer or take profit for providing these content and this is purely non-profit and for educational purpose only. If you see any issues with Content and copy write issues, I am happy to remove if you notify me. Contact Geek DBA Team, via geeksinsights@gmail.com

Pages

addnode.sh failed with bin/lsnodes: struct size 0

Whilst adding a node failing with following errors in the addnode.log

INFO: /u01/app/11.2.0.4/grid/oui/bin/../bin/lsnodes: struct size 0
INFO: Vendor clusterware is not detected.
INFO: Error ocurred while retrieving node numbers of the existing nodes. Please check if clusterware home is properly configured.
SEVERE: Error ocurred while retrieving node numbers of the existing nodes. Please check if clusterware home is properly configured.
INFO: User Selected: Yes/OK

 

There were few obvious reasons for this

1. bug in 11.2.0.4 which overwrite the lsnodes

Resolution:- copy the olsnodes.bin to lsnodes.bin and olsnodes to lsnodes in the node where you were running

2. Look at the permission of your grid home

Resolution: chown –R oracle:oinstall /u01/app/grid/11.2.0.4/grid

3. The node you are adding is not properly deleted i.e you have not performed update nodelist after your rootcrs.pl deconfig

Resolution: In any other nodes apart from the deleted node run ./runInstaller -updateNodeList ORACLE_HOME= "CLUSTER_NODES={rac1}" CRS=TRUE

 

-Thanks

Geek DBAGeek DBA

3 comments to addnode.sh failed with bin/lsnodes: struct size 0

  • Jason

    This is also an issue and valid workaround on 12.1.0.2

  • Miguel Miranda

    In Oracle RAC 12cR1:
    ====================
    You must also check the content of the file called inventory.xml, for example in my situation:

    grid@ovmsol02:~$ cat /u01/app/oraInventory/ContentsXML/inventory.xml


    12.1.0.2.0
    2.1.0.6.0

    <==== This node was remove

    grid@ovmsol02:~$

    If this is your situation, that you forgot to execute the following command after execute $ORACLE_HOME/deinstall/desinstall -local, over the node to be deleted;

    grid@ovmsol02:~$ $ORACLE_HOME/oui/bin/runInstaller -updateNodeList ORACLE_HOME=$ORACLE_HOME CLUSTER_NODES=ovmsol02 CRS=TRUE -silent
    Starting Oracle Universal Installer…

    Checking swap space: must be greater than 500 MB. Actual 11588 MB Passed
    The inventory pointer is located at /var/opt/oracle/oraInst.loc
    ‘UpdateNodeList’ was successful.
    grid@ovmsol02:~$

    If you check the file inventory.xml;
    grid@ovmsol02:~$ cat /u01/app/oraInventory/ContentsXML/inventory.xml


    12.1.0.2.0
    2.1.0.6.0

    </INVENTORY
    grid@ovmsol02:~$

    You can see that just only the node ovmsol02 remain in the file.
    After that the message error:

    grid@ovmsol02:/u01/app$ $ORACLE_HOME/addnode/addnode.sh -silent "CLUSTER_NEW_NODES={ovmsol01}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={ovmsol01-vip.obe.com}" -ignorePreReq -ignoreSysPrereqs
    Starting Oracle Universal Installer…

    Checking Temp space: must be greater than 120 MB. Actual 9881 MB Passed
    Checking swap space: must be greater than 150 MB. Actual 11604 MB Passed

    Prepare Configuration in progress.

    Prepare Configuration successful.
    ………………………………………….. 8% Done.
    You can find the log of this install session at:
    /u01/app/oraInventory/logs/addNodeActions2017-08-22_04-13-38PM.log
    SEVERE:Error ocurred while retrieving node numbers of the existing nodes. Please check if clusterware home is properly configured.
    [FATAL] [INS-10008] Session initialization failed
    CAUSE: An unexpected error occured while initializing the session.
    ACTION: Contact Oracle Support Services or refer logs
    SUMMARY:

    grid@ovmsol02:/u01/app$

    If you check the content of the log file relate with the error to execute addnode.sh:

    grid@ovmsol02:~$ cat /u01/app/oraInventory/logs/addNodeActions2017-08-22_04-13-38PM.log
    INFO: ORACLE_HOME=/u01/app/12.1.0.2/grid
    INFO: fwhome=/u01/app/12.1.0.2/grid
    INFO: Gathering system details…
    INFO: Building Flow
    INFO: Opening bean stores from which the beans can be loaded
    INFO: Loaded BeanStore using the flow data defaults
    INFO: No global condition definition found.
    INFO: Building the flow graph
    INFO: Loaded state init
    INFO: Loaded state CRSNodeScalerDetails
    INFO: Loaded state RootConfigurationMethodUI
    INFO: Loaded state prereqExecutionDecider
    INFO: Loaded state performChecks
    INFO: Loaded state showSummary
    INFO: Loaded state setup
    INFO: Loaded state finish
    INFO: Linking states
    INFO: State[CRSNodeScalerDetails]: route=success; to=prereqExecutionDecider
    INFO: State[RootConfigurationMethodUI]: route=success; to=prereqExecutionDecider
    INFO: Condition of state[RootConfigurationMethodUI]: route=matched; to=prereqExecutionDecider
    INFO: State[init]: route=success; to=CRSNodeScalerDetails
    INFO: State[performChecks]: route=success; to=showSummary
    INFO: State[prereqExecutionDecider]: route=executeprereqs; to=performChecks
    INFO: State[prereqExecutionDecider]: route=ignoreprereqs; to=showSummary
    INFO: State[setup]: route=success; to=finish
    INFO: State[showSummary]: route=success; to=setup
    INFO: Successfully built the flow

    .
    .
    .
    INFO: Checking if nodes are alive…
    INFO: Checking if nodes are alive…
    INFO: Checking if nodes are alive…
    INFO: Validating user equivalence…
    INFO: Validating user equivalence…
    INFO: Validating user equivalence…
    INFO: Validating nodes ovmsol01…
    INFO: Validating nodes ovmsol01…
    INFO: Validating nodes ovmsol01…
    INFO: Checking if nodes are alive…
    INFO: Checking if nodes are alive…
    INFO: Checking if nodes are alive…
    INFO: Validating user equivalence…
    INFO: Validating user equivalence…
    INFO: Validating user equivalence…
    INFO: Checking if remote nodes are clean machines…
    INFO: Checking if remote nodes are clean machines…
    INFO: Checking if remote nodes are clean machines…
    INFO: Status of nodes in the cluster:
    Status of node ‘ovmsol01’:
    Node is okay

    Status of node ‘ovmsol01’:
    Node is okay

    ————————————————————————–

    INFO: Setting variable ‘REMOTE_CLEAN_MACHINES’ to ‘ovmsol01’. Received the value from a code block.
    INFO: /u01/app/12.1.0.2/grid/oui/bin/../bin/lsnodes: struct size 0
    INFO: Vendor clusterware is not detected.
    INFO: Error ocurred while retrieving node numbers of the existing nodes. Please check if clusterware home is properly configured.
    SEVERE: Error ocurred while retrieving node numbers of the existing nodes. Please check if clusterware home is properly configured.
    INFO: Alert Handler not registered, using Super class functionality
    INFO: Alert Handler not registered, using Super class functionality
    INFO: User Selected: Yes/OK

    INFO: Shutting down OUISetupDriver.JobExecutorThread
    SEVERE: [FATAL] [INS-10008] Session initialization failed
    CAUSE: An unexpected error occured while initializing the session.
    ACTION: Contact Oracle Support Services or refer logs
    SUMMARY:
    – .
    Refer associated stacktrace #oracle.install.commons.util.exception.DefaultErrorAdvisor:299
    INFO: Advice is ABORT
    SEVERE: Unconditional Exit
    INFO: Adding ExitStatus FAILURE to the exit status set
    INFO: Finding the most appropriate exit status for the current application
    INFO: Exit Status is -1
    INFO: Shutdown Oracle Grid Infrastructure 12c Release 1 Installer
    INFO: Unloading Setup Driver
    grid@ovmsol02:~$

    Don’t happend again…this is for Oracle RAC 12cR1.