The curious case of database crash and ORA_NLS10

-
Case Facts:

Database Version ==> 10.2.0.3.0
Oracle Apps Version ==> 11.5.10.2
Node Type ==> Multi-node
RAC ==> No
OS & version ==> Sun SPARC Solaris (64-Bit) 10 (5.10)
Symptom ==> Database crashes with ORA-07445

Case Description:

While trying to bring up an Oracle Apps instance, I found that the database was crashing with ORA-07445 errors (as below) as soon as I brought up the concurrent managers.
_____________________________________________________________

Mon Feb 2 00:26:24 2009
Errors in file $ORACLE_HOME/admin/[CONTEXT_NAME]/udump/cpek_ora_6085.trc:
ORA-07445: exception encountered: core dump [lfilic()+328] [SIGSEGV] [Address not mapped to object] [0x000000040] [] []
ORA-29282: invalid file ID
Mon Feb 2 00:26:27 2009
Errors in file $ORACLE_HOME/admin/[CONTEXT_NAME]/udump/cpek_ora_5512.trc:
ORA-07445: exception encountered: core dump [lfilic()+328] [SIGSEGV] [Address not mapped to object] [0x000000040] [] []
Mon Feb 2 00:26:34 2009
Errors in file $ORACLE_HOME/admin/[CONTEXT_NAME]/udump/cpek_ora_5468.trc:
ORA-07445: exception encountered: core dump [lfilic()+328] [SIGSEGV] [Address not mapped to object] [0x000000040] [] []
Mon Feb 2 00:26:51 2009
Errors in file $ORACLE_HOME/admin/[CONTEXT_NAME]/udump/cpek_ora_5573.trc:
ORA-07445: exception encountered: core dump [lfilic()+328] [SIGSEGV] [Address not mapped to object] [0x000000040] [] []
Mon Feb 2 00:28:02 2009
Errors in file $ORACLE_HOME/admin/[CONTEXT_NAME]/udump/cpek_ora_5486.trc:
ORA-07445: exception encountered: core dump [lfilic()+328] [SIGSEGV] [Address not mapped to object] [0x000000040] [] []
Mon Feb 2 00:28:37 2009
.....
..
..
..
Mon Feb 2 00:38:10 2009
Errors in file $ORACLE_HOME/admin/[CONTEXT_NAME]/udump/cpek_ora_5560.trc:
ORA-07445: exception encountered: core dump [lfilic()+328] [SIGSEGV] [Address not mapped to object] [0x000000040] [] []
Mon Feb 2 00:40:15 2009
Incremental checkpoint up to RBA [0x27c.48028.0], current log tail at RBA [0x27d.1fc8.0]
Mon Feb 2 00:42:30 2009
Completed checkpoint up to RBA [0x27d.2.10], SCN: 10245291290327
Mon Feb 2 00:48:19 2009
MMNL: terminating instance due to error 472
Instance terminated by MMNL, pid = 4493
_____________________________________________________________

Suspects:

I found that this error is caused because the ORA_NLS10 variable is not set when the database was started or is set to an incorrect value.

Case Resolution:

1. set the env variable ORA_NLS10 as below:
export ORA_NLS10=$ORACLE_HOME/nls/data/9idata (for an Apps instance).

2. Startup the database.

3. Startup all the Apps services.

Witnesses:

1. Metalink Note: 420069.1

2. Metalink Note: 567472.1


Comments

Anonymous said…
Wow Praveen,

I had exactly the same issue, and your solution has helped me a lot

A.Kishore

http://www.appsdba.info
April 7, 2012 at 3:48 AM
Post a Comment

Popular posts from this blog

java.lang.ExceptionInInitializerError while trying to Access login page

-
Today morning, we (the DBAs) were faced with a strange issue. On Saturday (the 14th of February - (St.) Valentine's day!!), the UNIX boxes hosting our critical test instance went down for scheduled maintenance without any prior information. So, we could not bring down our databases and applications. As soon as the unix box came up, we encountered this issue. Let me briefly describe the environment, the issue, the analysis performed and of course, the solution to this most vexing problem. Environment : Apps Version : 11.5.10.2 with ATG RUP 5 DB Version : 10.2.0.3 Architecture : Two Node instance with database + admin on one tier and web server on another. PS : Another instance (development) exists on the same server with the same configuration, which was working fine. Issue : When trying to access the login page of Oracle Apps, received the below error. Even OAM login page was throwing the same error. Request URI: /OA_HTML/AppsLocalLogin.jsp Exception: java.lang.ExceptionInIniti
Read more

Solution to "End Program - WMS Idle"

-
Image
Though this topic is unrelated any Apps DBA topics, I found it necessary to share the solution so that everyone benifits out of it ! Issue: I used to receive the below error message whenever I tried to shutdown windows XP. A rather vexing problem, no doubt. Cause: This message appears because when windows is trying to shutdown and end all the running processes, the WMS idle process keeps working. Thus an end-program message appears. The two most common reasons for this are: Scout service run by Nero 7 Microsoft Office Communicator 2005 Solution: The fix is simple, disable the Nero 7 scout service if it is enabled. For this, go to Start > All Programs > Nero > Tools > Nero Scout . On this screen , Uncheck Enable the Nero scout. This will fix the issue for most of the users, for the rest of you who are not using Nero are most probably getting this error because of Microsoft Office Communicator 2005. For that you need to either manually exit the communicator 2005 from the s
Read more

WGET shell Script for downloading patches

-
What I have to offer this time is a script using which you can download patches using WGET from Meta.....oops, from My Oracle Support, I should say! This script needs (or accepts) the following parameters: 1. Me...oops...MOS Username 2. MOS (I got it right this time!) password 3. Patch file name 4. ARU Number You can get 3 and 4 in the following way: Using MOS: Query for the particular patch, click on the download link, click on WGET Options on the left side bottom corner and then copy the WGET script to clipboard. That script will have both the patch name and the ARU number. Using HTML (supporthtml.oracle.com): Query for the particular patch, click on the patch, then RIGHT CLICK on the patch zip file link and click on copy shortcut in IE (or copy link location in Mozilla Firefox). This link will have both the patch file name and the ARU number. Using the classic patches window: Query for the particular patch, then RIGHT CLICK on the DOWNLOAD button and click on copy shortcut in IE (or
Read more