ORAchk Health Checks For The Oracle Stack (ORACHK 2.2.4 and above)


Oracle Database 12c (12.0.1.*) and 11g (11.2.0.4) comes with new feature called RACcheck.
Although the RACcheck already exists before these releases. (In 2011 I posted about benefits of RACcheck)

Brief of RACcheck.
.....
RACcheck - The Oracle RAC Configuration Audit Tool
RACcheck is designed to audit vital configuration settings for the Oracle Database, single instance databases, as well as Oracle Real Application Clusters (Oracle RAC) databases. It also includes checks for Oracle Clusterware, Oracle Automatic Storage Management (Oracle ASM) and Oracle Grid Infrastructure.

RACcheck provides best practices recommedations considering the whole stack, including Maximum Availability Architecture (MAA) configurations and is therefore the ideal tool for regular health checks as well as pre- and post-upgrade best practices assessments.
.....

Now Oracle replace/renamed Oracle RACcheck to ORAchk.

ORAchk- Health Checks for the Oracle Stack

ORAchk replaces the popular RACcheck to support a wider range of products. ORAchk version 2.2.4 is now available for download and includes the following key features:

  • RACcheck renamed to ORAchk
  • ORAchk daemon auto-start mode after node reboot (init integration)
  • Merge multiple ORAchk collection reports
  • Upload of installed patches to database
  • Collection Manager for ORAchk, RACcheck and Exachk (Document 1602329.1)
  • ORAchk signature file in /tmp on all nodes to verify last ORAchk run
  • New checks and bug fixes, including
  • 30 Oracle Ebusiness AP module data integrity checks
  • 12 new Database checks
  • 8 new Solaris system checks
  • Supported Platforms

  • Linux x86-64* (Enterprise Linux, RedHat and SuSE 9, SuSE 10 & SuSE 11)
  • Oracle Solaris SPARC (Solaris 10 and 11)
  • Oracle Solaris x86-64 (Solaris 10 and 11)
  • AIX **
  • HPUX**
  • * 32-bit platforms not supported, no planned support for Linux Itanium
    **Requires BASH Shell 3.2 or higher to be installed

    Supported Oracle Releases

  • 10gR2
  • 11gR1
  • 11gR2
  • 12cR1
  • When to Run ORAchk

  • After initial Oracle RAC deployment
  • Before planned system maintenance
  • After planned system maintenance
  • At least once every three months
  • Install/Configure

    It is recommended to run the tool as the database software owner (e.g. oracle). The user may run the tool as the Grid Infrastructure software owner (e.g. grid) and it will collect the same data but database credentials must manually be supplied to perform the database related audit checks. Typically when run as oracle the customer will have OS authentication set up for the oracle database software owner and the database login credentials will not be needed.

    Download ORAchk

    Stage Location:
    It is recommended that the kit be staged and operated from a local filesystem on a single database server in order to provide the best performance possible.


    $ mkdir -p /u01/app/oracle/orachk

    [oracle@node11g01 install]$ cd /u01/app/oracle/orachk

    [oracle@node11g01 orachk]$ unzip orachk.zip
    Archive: orachk.zip
    inflating: raccheck
    inflating: rules.dat
    inflating: collections.dat
    inflating: readme.txt
    inflating: orachk
    creating: .cgrep/
    inflating: .cgrep/ogghc_12101.sql
    inflating: .cgrep/lcgrep4
    inflating: .cgrep/checkDiskFGMapping.sh
    inflating: .cgrep/ogghc_11204.sql
    inflating: .cgrep/lcgreps9
    inflating: .cgrep/ogghc_11203.sql
    inflating: .cgrep/scgrepx86
    inflating: .cgrep/acgrep
    inflating: .cgrep/oracle-upstarttmpl.conf
    inflating: .cgrep/check_reblance_free_space.sql
    inflating: .cgrep/CollectionManager_App.sql
    inflating: .cgrep/exalogic_zfs_checks.aksh
    inflating: .cgrep/hiacgrep
    inflating: .cgrep/init.tmpl
    inflating: .cgrep/lcgreps10
    inflating: .cgrep/preupgrd.sql
    inflating: .cgrep/diff_collections.pl
    inflating: .cgrep/merge_collections.pl
    inflating: .cgrep/ggdiscovery.sh
    creating: .cgrep/profiles/
    inflating: .cgrep/profiles/DA94919CD0DE0913E04312C0E50A7996.prf
    inflating: .cgrep/profiles/D49C0FBF8FBF4B1AE0431EC0E50A0F24.prf
    extracting: .cgrep/profiles/F13E11974A282AB3E04312C0E50ABCBF.prf
    inflating: .cgrep/profiles/EF6C016813C51366E04313C0E50AE11F.prf
    inflating: .cgrep/profiles/D8367AD6754763FEE04312C0E50A6FCB.prf
    inflating: .cgrep/profiles/DF65D6117CB41054E04312C0E50A69D1.prf
    inflating: .cgrep/profiles/EA5EE324E7E05128E04313C0E50A4B2A.prf
    inflating: .cgrep/profiles/E1BF012E8F210839E04313C0E50A7B68.prf
    inflating: .cgrep/profiles/D462A6F7E9C340FDE0431EC0E50ABE12.prf
    inflating: .cgrep/profiles/D49AD88F8EE75CD8E0431EC0E50A0BC3.prf
    inflating: .cgrep/profiles/E2E972DDE1E14493E04312C0E50A1AB1.prf
    inflating: .cgrep/profiles/F32F44CE0BCD662FE04312C0E50AB058.prf
    inflating: .cgrep/profiles/E8DF76E07DD82E0DE04313C0E50AA55D.prf
    inflating: .cgrep/profiles/D49B218473787400E0431EC0E50A0BB9.prf
    inflating: .cgrep/profiles/D49C0AB26A6D45A8E0431EC0E50ADE06.prf
    inflating: .cgrep/profiles/DFE9C207A8F2428CE04313C0E50A6B0A.prf
    inflating: .cgrep/profiles/D49C4F9F48735396E0431EC0E50A9A0B.prf
    inflating: .cgrep/profiles/D49BDC2EC9E624AEE0431EC0E50A3E12.prf
    inflating: .cgrep/profiles/DF65D0F7FB6F1014E04312C0E50A7808.prf
    inflating: .cgrep/scnhealthcheck.sql
    inflating: .cgrep/pxhcdr.sql
    inflating: .cgrep/lcgrep5
    inflating: .cgrep/scgrep
    inflating: .cgrep/raw_data_browser.pl
    inflating: .cgrep/profiles.dat
    inflating: .cgrep/rack_comparison.py
    inflating: .cgrep/versions.dat
    inflating: .cgrep/create_version.pl
    inflating: .cgrep/lcgreps11
    inflating: .cgrep/utluppkg.sql
    inflating: .cgrep/utlusts.sql
    inflating: .cgrep/reset_crshome.pl
    inflating: .cgrep/asrexacheck
    inflating: .cgrep/lcgrep6
    inflating: .cgrep/utlu112i.sql
    inflating: UserGuide.txt

    Running ORAchk Interactively

    [oracle@node11g01 orachk]$ ./orachk

    CRS stack is running and CRS_HOME is not set. Do you want to set CRS_HOME to /u01/app/11.2.0/grid?[y/n][y]

    Checking ssh user equivalency settings on all nodes in cluster

    Node node11g02 is configured for ssh user equivalency for oracle user

    Searching for running databases . . . . .

    . .
    List of running databases registered in OCR
    1. dborcl
    2. None of above

    Select databases from list for checking best practices. For multiple databases, select 1 for All or comma separated number like 1,2 etc [1-2][1].1
    . .

    Checking Status of Oracle Software Stack - Clusterware, ASM, RDBMS

    . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
    -------------------------------------------------------------------------------------------------------
    Oracle Stack Status
    -------------------------------------------------------------------------------------------------------
    Host Name CRS Installed ASM HOME RDBMS Installed CRS UP ASM UP RDBMS UP DB Instance Name
    -------------------------------------------------------------------------------------------------------
    node11g01 Yes Yes Yes Yes Yes Yes dborcl_1
    node11g02 Yes Yes Yes Yes Yes Yes dborcl_2
    -------------------------------------------------------------------------------------------------------

    Copying plug-ins

    . . . . . . . . . . . . . . . . . . . . . . . . . . .

    . . . . . .

    17 of the included audit checks require root privileged data collection . If sudo is not configured or the root password is not available, audit checks which require root privileged data collection can be skipped.

    1. Enter 1 if you will enter root password for each host when prompted

    2. Enter 2 if you have sudo configured for oracle user to execute root_orachk.sh script

    3. Enter 3 to skip the root privileged collections

    4. Enter 4 to exit and work with the SA to configure sudo or to arrange for root access and run the tool later.

    Please indicate your selection from one of the above options for root access[1-4][1]:- 2

    *** Checking Best Practice Recommendations (PASS/WARNING/FAIL) ***

    Collections and audit checks log file is
    /u01/app/oracle/orachk/orachk_node11g01_dborcl_031814_170552/log/orachk.log
    .
    .
    .
    .
    ---------------------------------------------------------------------------------
    CLUSTERWIDE CHECKS
    ---------------------------------------------------------------------------------
    ---------------------------------------------------------------------------------

    Detailed report (html) - /u01/app/oracle/orachk/orachk_node11g01_dborcl_031814_170552/orachk_node11g01_dborcl_031814_170552.html

    UPLOAD(if required) - /u01/app/oracle/orachk/orachk_node11g01_dborcl_031814_170552.zip


    Below the report generated in this test.
    Oracle RAC Assessment Report

    orachk usage options

    [oracle@node11g01 orachk]$ ./orachk -h
    Usage : ./orachk [-abvhpfmsuSo:c:t:]
    -a All (Perform best practice check and recommended patch check)
    -b Best Practice check only. No recommended patch check
    -h Show usage
    -v Show version
    -p Patch check only
    -m exclude checks for Maximum Availability Architecture (MAA) scorecards(see user guide for more details)
    -u Run orachk to check pre-upgrade or post-upgrade best practices for 11.2.0.3,11.2.0.4.0 and 12.1.0.1
    -o pre or -o post is mandatory with -u option like ./orachk -u -o pre
    -f Run Offline.Checks will be performed on data already collected from the system
    -o Argument to an option. if -o is followed by v,V,Verbose,VERBOSE or Verbose, it will print checks which passs on the screen
    if -o option is not specified,it will print only failures on screen. for eg: orachk -a -o v

    -clusternodes
    Pass comma separated node names to run orachk only on subset of nodes.
    -dbnames
    Pass comma separated database names to run orachk only on subset of databases
    -localonly
    Run orachk only on local node.
    -debug
    Run orachk in debug mode. Debug log will be generated.
    eg:- ./orachk -debug
    -nopass
    Skip PASS'ed check to print in orachk report and upload to database.

    -noscore
    Do not print healthscore in HTML report.

    -diff [-outfile ]
    Diff two orachk reports. Pass directory name or zip file or html report file as &

    -exadiff
    Compare two different Exalogic rack and see if both are from the same release.Pass directory name or zip file as & (applicable for Exalogic only)

    -c Used only under the guidance of Oracle support or development to override default components

    -
    initsetup : Setup auto restart. Auto restart functionality automatically brings up orachk daemon when node starts
    initrmsetup : Remove auto restart functionality
    initcheck : Check if auto restart functionality is setup or not
    initpresetup : Sets root user equivalency for COMPUTE, STORAGE and IBSWITCHES.(root equivalency for COMPUTE nodes is mandatory for setting up auto restart functionality)

    -d
    start : Start the orachk daemon
    start_debug : Start the orachk daemon in debug mode
    stop : Stop the orachk daemon
    status : Check if the orachk daemon is running
    info : Print information about running orachk daemon
    stop_client : Stop the orachk daemon client
    nextautorun : print the next auto run time
    -daemon
    run orachk only if daemon is running
    -nodaemon
    Dont use daemon to run orachk
    -set
    configure orachk daemon parameter like "param1=value1;param2=value2... "

    Supported parameters are:-

    AUTORUN_INTERVAL :- Automatic rerun interval in daemon mode.Set it zero to disable automatic rerun which is zero.

    AUTORUN_SCHEDULE * * * * :- Automatic run at specific time in daemon mode.
    - - - -
    ▒ ▒ ▒ ▒
    ▒ ▒ ▒ +----- day of week (0 - 6) (0 to 6 are Sunday to Saturday)
    ▒ ▒ +---------- month (1 - 12)
    ▒ +--------------- day of month (1 - 31)
    +-------------------- hour (0 - 23)

    example: orachk -set "AUTORUN_SCHEDULE=8,20 * * 2,5" will schedule runs on tuesday and friday at 8 and 20 hour.

    AUTORUN_FLAGS : orachk flags to use for auto runs.

    example: orachk -set "AUTORUN_INTERVAL=12h;AUTORUN_FLAGS=-profile sysadmin" to run sysadmin profile every 12 hours

    orachk -set "AUTORUN_INTERVAL=2d;AUTORUN_FLAGS=-profile dba" to run dba profile once every 2 days.

    NOTIFICATION_EMAIL : Comma separated list of email addresses used for notifications by daemon if mail server is configured.

    PASSWORD_CHECK_INTERVAL : Interval to verify passwords in daemon mode

    COLLECTION_RETENTION : Purge orachk collection directories and zip files older than specified days.

    -unset
    unset the parameter
    example: orachk -unset "AUTORUN_SCHEDULE"

    -get
    Print the value of parameter

    -excludeprofile
    Pass specific profile.
    List of supported profiles is same as for -profile.

    -merge
    Pass comma separated collection names(directory or zip files) to merge collections and prepare single report.
    eg:- ./orachk -merge orachk_hostname1_db1_120213_163405.zip,orachk_hostname2_db2_120213_164826.zip

    -vmguest
    Pass comma separated filenames containing exalogic guest VM list(applicable for Exalogic only)

    -hybrid [-phy]
    phy :Pass comma separated physical compute nodes(applicable for Exalogic only)
    eg:- ./orachk -hybrid -phy phy_node1,phy_node2

    -profile Pass specific profile.
    List of supported profiles:

    asm asm Checks
    clusterware Oracle clusterware checks
    compute_node Compute Node checks (Exalogic only)
    control_VM Checks only for Control VM(ec1-vm, ovmm, db, pc1, pc2). No cross node checks
    dba dba Checks
    ebs Oracle E-Business Suite checks
    el_extensive Extensive EL checks
    el_lite Exalogic-Lite Checks(Exalogic Only)
    el_rackcompare Data Collection for Exalogic Rack Comparison Tool(Exalogic Only)
    goldengate Oracle GoldenGate checks
    maa Maximum Availability Architecture Checks
    obiee obiee Checks(Exalytics Only)
    storage Oracle Storage Server Checks
    switch Infiniband switch checks
    sysadmin sysadmin checks
    timesten timesten Checks(Exalytics Only)
    virtual_infra OVS, Control VM, NTP-related and stale VNICs check (Exalogic Only)
    zfs ZFS storage appliances checks (Exalogic Only)

    -cells
    Pass comma separated storage server names to run orachk only on selected storage servers.

    -ibswitches
    Pass comma separated infiniband switch names to run orachk only on selected infiniband switches.

    -zfsnodes
    Pass comma separated ZFS storage appliance names to run orachk only on selected storage appliances.

    ORAchk Other Useful Options Not Covered Here

  • Using ORAchk Silently
  • ORAchk can be optionally run in “silent” or “non-interactive” mode in order to enable scheduling and automation
    Is required only if customer does not want to use orachk daemon functionality.

  • Using ORAchk Daemon Mode Operation
  • This functionality permit non-interactive (batch or silent mode) execution on a regular interval.

    When running ORAchk in daemon mode, the most recent and next most recent (if any) collection reports are automatically compared. If the mail address is configured a summary will be emailed along with attachments for the reports and the comparison report.

  • Report Comparisons with ORAchk
  • ORAchk has the ability to perform report comparisons between 2 ORAchk reports.
    This allows for trending of Success Factor and Best Practice changes over time, after planned maintenance, etc within a user friendly HTML report.

  • ORAchk in Upgrade Readiness Mode
  • ORAchk can be used to obtain an automated 11.2.0.3 (or above) Upgrade Readiness Assessment.
    The goal of the ORAchk Upgrade Readiness Assessment is to make the process of upgrade planning for Oracle RAC and Oracle Clusterware target versions 11.2.0.3 and above as smooth as possible by automating many of the
    manual pre and post checks detailed in various upgrade related documents.

    Refer MoS Notes for more details:
    ORAchk - Oracle Configuration Audit Tool (Doc ID 1268927.2)

    ORAchk Users Guide
    For details instructions on how to run ORAchk including troubleshooting steps, available options, etc.

    Enjoy!!!


    Troubleshooting: Oracle Clusterware/Database on Windows

     

    OracleCRService Will Not Start

    Could not start the OracleCRService service on Local Computer.
    Error 1067: The process terminated unexpectedly.
    
    [  clsdmt][2580]Listening to (ADDRESS=(PROTOCOL=tcp)(HOST=127.0.0.1)(PORT=61200))
    [  OCRAPI][3888]a_is_valid_user_group: User name [wnt-sim\27235] not in user database
    [  OCRAPI][3888]a_is_valid_user_group: scls ret [27] slos [Information of error OS: Category: [1234] Operation: [scls_iddb_get_user_id_by_name] : [LookupAccoun]  Others: [LookupAccountName failed]  Dep: [1332]]
    [  OCRAPI][3888]a_create_key: THE SECURITY ATTRIBUTE PASSED is invalid user [wnt-sim\27235] group []
    2011-02-08 17:32:46.835: [  CRSOCR][3888]32OCR api procr_create_key failed for key SYSTEM.crs.versions.config_versions.
    OCR error code = 32OCR api procr_create_key failed for key SYSTEM.crs.versions.config_versions. OCR error code = 27 OCR error msg: PROC-27: Error in authentication layer Authentication error [SLOS error information: Category: [1234] Operation: [scls_iddb_get_user_id_by_name] Location: [LookupAccoun] Other: [LookupAccountName failed] Dep: [1332]] [1][ default][3888]Error in writing config version to OCR
    

    Solution:

    OracleCRService Will Not Start Due To Unavailability of CRS Install Owner User Account [ID 601299.1]

    https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&doctype=PROBLEM&id=601299.1


    OUI Clusterware/RAC reports ‘access denied’

    During the final stage (Remote operations) of a RAC install (CRS or RDBMS), the installer reports an error while copying files to a remote node.

    WARNING: Error while copying directory C:\oracle\product\10.2.0\crs with exclude file list
    'C:\DOCUME~1\oracle\LOCALS~1\Temp\OraInstall2011-02-07_09-14-01PM\installExcludeFile.lst' to nodes 'NODE2'.
    [PRKC-1073 : Failed to transfer directory "C:\oracle\product\10.2.0\crs" to any of the given nodes "NODE2 ". Error on node NODE2:Access denied]
    

    Solution:
    Disable Antivirus while install Oracle CRS or RAC

    Or use this note…

    RAC install reports ‘access denied’ error while copying files to remote node [ID 373470.1]

    https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&doctype=PROBLEM&id=373470.1


    Runing patch102.bat fails with process running on Windows

    C:\oracle\product\10.2.0\crs\install>patch102.bat
    Successful validation check of Oracle CRS services status
    Failed to patch all the files in the ORA_CRS_HOME C:\oracle\product\10.2.0\crs
    Please ensure that all processes running from the home have been stopped.
    

    Solution:

    ERROR: “FAILED TO PATCH ALL THE FILES IN THE ORA_CRS_HOME…” running patch102.bat on Windows [ID 415526.1]

    https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&doctype=PROBLEM&id=415526.1



    RMAN Performance Tuning / Notes – My Oracle Support (Metalink)

    I’ll post here useful notes from MOS about the RMAN Performance and Tuning.

    To view these documents you must have access to the MOS.

     

    RMAN Myths Dispelled: Common RMAN Performance Misconceptions [ID 134214.1]

    This document will help dispel some of the common misconceptions related to proper usage of Recovery Manager (RMAN).

    https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&id=134214.1

     

     

    RMAN Restore Database Slow / How To Improve RMAN Restore Performance [ID 467694.1]

    Goal: RMAN Restore database is slow.  Backup to tape takes 13 hours and the restore takes over 26hrs.

    https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&doctype=HOWTO&id=467694.1

     

    Advise On How To Improve Rman Performance [ID 579158.1]

    Goal: How  to boost RMAN performance ?

    Also is a recommended for improving RMAN performance on AIX5L based system. IBM suggestions the AIX related advices

    https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&doctype=HOWTO&id=579158.1

     

    RMAN Performance Tuning Diagnostics [ID 311068.1]

    Provide diagnostic reference for collecting RMAN backup performance diagnostic information.

    https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&doctype=TROUBLESHOOTING&id=311068.1

     

    RMAN Performance Tuning Using Buffer Memory Parameters [ID 1072545.1]

    The purpose of RMAN performance tuning is to identify the bottlenecks for a given backup or restore job and use RMAN commands, initialization parameters, or adjustments to physical media to improve overall performance.

    https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&doctype=BULLETIN&id=1072545.1

     

     

    RMAN: Monitoring Recovery Manager Jobs [ID 144640.1]

    To inform all the Oracle Recovery Manager Documentation has the information to resolve most problems.

    All RMAN users should review the RMAN Troubleshooting section of the online documentation provided.

    https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&doctype=BULLETIN&id=144640.1

     


    Minimum Software Versions and Patches Required to Support Oracle Products on IBM Power Systems

    This is a dynamic document; users should check back for any document updates before installing or updating software. This document contains:

    The latest required software versions and patches for both IBM and Oracle software to enable Oracle products using AIX 6 or AIX 5L on IBM System p servers.

    The latest information about significant interoperability issues and frequently encountered problems.

    Use this Note:

    Minimum Software Versions and Patches Required to Support Oracle Products on IBM Power Systems [ID 282036.1]


    Troubleshooting: Oracle Database on AIX 6.1

    Recently installed Oracle Database on AIX 6.1 system I’ll post here the problems and solutions encountered during implementation.

    As problems arise I’ll post new problems and solutions.


    Installing Oracle Database 11gR2 (11.2.0.3.0) on AIX fail at Prerequisites Check. Missing : IZ97457 and IZ89165

    IZ97457: SEA/VIO CLIENT HANG – INTERRUPTS DO NOT REACH THE TRUNK ADAPTER APPLIES TO AIX 6100-05

    IZ89165: BIND64 CORES WITH -BLAZY OPTION ON 61TL6 APPLIES TO AIX 7100-00

    An Authorized Program Analysis Report, or APAR, is a formal report to IBM development of a problem caused by a suspected defect in a current release of an IBM program.

    IBM release  an new APAR number for each TL.

    IZ97457: SEA/VIO CLIENT HANG - INTERRUPTS DO NOT REACH THE TRUNK ADAPTER APPLIES TO AIX 6100-05
    5300-11 - use AIX APAR IZ98424
    5300-12 - use AIX APAR IZ98126
    6100-04 - use AIX APAR IZ97605
    6100-05 - use AIX APAR IZ97457
    6100-06 - use AIX APAR IZ96155
    7100-00 - use AIX APAR IZ97035
    
    IZ89165: BIND64 CORES WITH -BLAZY OPTION ON 61TL6 APPLIES TO AIX 7100-00
    6100-03 - use AIX APAR IZ89304
    6100-04 - use AIX APAR IZ89302
    6100-05 - use AIX APAR IZ89300
    6100-06 - use AIX APAR IZ89514
    7100-00 - use AIX APAR IZ89165
    

    In your case Oracle OUI don’t know if APAR is installed because it check only one APAR Number.

    So see this example:

    root:/> oslevel -r
    6100-06
    
    #### Check if apar number IZ89165 is installed.
    ### Using APAR number required by Oracle
    root:/> instfix -a -i |grep IZ89165
    #### nothing found
    
    root:/> instfix -a -i |grep IZ89514
    IZ89514 Abstract: Linking with -blazy and -G or -brtl causes core dump
    IZ89514 Symptom Text:
        All filesets for IZ89514 were found.
    

    So, just Ignore warning, if you make sure which APAR already installed.


    Install Oracle 10g R2 on AIX 6.1 and the installation hangs at 83% in Prereqs Check.

    I have installed the 11.2.0.2 Grid Infrastructure in different  User and directory on the same system.

    Oracle Grid Infrastructure for Standalone allows you to install the binaries to User (eg grid) different operating system User (eg Oracle) Oracle Database.
    This helps in the administration and security. But I do not recommend doing this because many problems are still solved with workaround.
    Solution:
    To solve this problem use note on MOS:
    Instalation Software Oracle 10.2.0.1 In AIX hangs [ID 1162824.1]
    Bug 9916876 the hang was due to 10.2 install attempting to connect to 11.2 Grid Infrastructure home.
    It was unable to connect due to different OS Users and Groups for the different installation

    Linking Fails With “ld: 0706-010 The binder was killed by a signal: Segmentation fault” On AIX 6.1

    INFO:
    ld: 0706-010 The binder was killed by a signal: Segmentation fault
            Check for binder messages or use local problem reporting procedures.
    
    INFO: make: 1254-004 The error code from the last command is 254.
    
    Stop.
    
    INFO: make: 1254-004 The error code from the last command is 2.
    
    Stop.
    
    INFO: End output from spawned process.
    INFO: ----------------------------------
    INFO: Exception thrown from action: make
    Exception Name: MakefileException
    Exception String: Error in invoking target 'agent nmo nmb' of makefile '/u01/app/oracle/product/10.2.0/db_1/sysman/lib/ins_sysman.mk'.
    
    

    Solution:

    This a bug on AIX 6.1

    IZ88711: BIND64 CORES WITH -BLAZY OPTION ON AIX61
    https://www-304.ibm.com/support/docview.wss?uid=isg1IZ88711
    Check this note on MOS:

    Linking Fails With “ld: 0706-010 The binder was killed by a signal: Segmentation fault” On AIX 6.1 [ID 1264074.1]

    If you already in the TL 06, I have the address to download the fix. Only apply the fix.

    ftp://public.dhe.ibm.com/aix/efixes/iz88711/


    Unable to create 10.2.0.4 database on 11.2.0.2 Grid Infrastructure on AIX 6.1

    DBCA displays the following error:

    
    " In order to use Automatic Storage Management (ASM), the ORacle CLuster Synchronization Service (CSS) must be up and running. Run $ORACLE_HOME/localconfig reset script from command prompt to start CSS.
    
    The trace file in $ORACLE_HOME/cfgtoollogs/dbca contains the following error:
    
    [AWT-EventQueue-0] [15:41:8:479] [StorageOptionsPage.validate:522] CSS Not Running
    
    

    Solution:

    Pre 11.2 Database Issues in 11gR2 Grid Infrastructure Environment [ID 948456.1]

    Due to unpublished bug 8288940, DBCA will fail if database files are located in ASM.

    As of now, patch 8288940 is available for 10.2.0.4, 11.1.0.6 and 11.1.0.7 as a .jar file as it is platform independent; fix will be included in the 10.2.0.5 patchset.


    OUI FAILS TO DETECT RUNNING PROCESSES CORRECTLY ON AIX 6.1 ML 4 SP1

    Oracle Universal Installer has detected that there are processes running in the currently selected Oracle Home. The following processes need to be shutdown before continuing:
    java

    This a bug on AIX.

    IZ67400: FUSER GIVES INCORRECT PIDS WITH -X OPTION

    Solution:

    Check this note on MOS:
    The Installer (OUI) Detects Processes Running on ORACLE_HOME on AIX 6.1 TL04 SP1 [ID 980602.1]

    Or

    http://forums.oracle.com/forums/thread.jspa?messageID=4070170&#4070170


    Installing the Oracle Database 10gR2 (10.2.0.1.0) on AIX 6.1  error OUI-18001 is raised

    
    OUI-18001: The operating system 'AIX Version 6100.01' is not supported.
    
    

    Check all pre-requesistes in documentation.

    http://download.oracle.com/docs/cd/B19306_01/install.102/b19075/pre_install.htm

    And install 10gR2 (10.2.0.1.0), invoking the OUI (runInstaller) using “-ignoreSysPrereqs” option.

    ./runInstaller -ignoreSysPrereqs



    Oracle Database 11g Release 2 (11.2.0.2) is available in the latest media pack

    Oracle Database 11g Release 2 (11.2.0.2) is available in the latest media pack.

    Patch Number10098816 Oracle Database Family: Patchset
    11.2.0.2.0 PATCH SET FOR ORACLE DATABASE SERVER

    ..

    Installation Type Zip File
    Oracle Database (includes Oracle Database and Oracle RAC)

    Note: you must download both zip files to install Oracle Database.

    p10098816_112020_platform_1of7.zip

    p10098816_112020_platform_2of7.zip

    Oracle Grid Infrastructure (includes Oracle ASM, Oracle Clusterware, and Oracle Restart) p10098816_112020_platform_3of7.zip
    Oracle Database Client p10098816_112020_platform_4of7.zip
    Oracle Gateways p10098816_112020_platform_5of7.zip
    Oracle Examples p10098816_112020_platform_6of7.zip
    Deinstall p10098816_112020_platform_7of7.zip

    Click here to download your Patch Set 11.2.0.2.0


    How to Deinstall and Reinstall XML Database (XDB)

    How to Deinstall and Reinstall XML Database (XDB) [ID 243554.1]

    This article provides the steps to manually deinstall and install the XML Database feature into a database that is version 9i R2 through 10g release 2.

    https://support.oracle.com/CSP/main/article?cmd=show&type=NOT&doctype=BULLETIN&id=243554.1