After Adcfgclone appsTier for a newly cloned ebs 12.2.13 environment from an SSL-enabled ebs precloned stage backup prevents me from logging in to non-SSL EBS login URL, despite it was completed 100% successfully without any error.
CAUSE:
EBS Context file variable s_enable_sslterminator was empty and was required to be changed as shown below:
It was discovered that the EBS App Context file was having below entry only and Even after changing the required parameters in the context file, Switching all https to http did not disable SSL and the URL still rerouted to https.
From – >>> http://ebsclone.aot.sa:8010/OA_HTML/AppsLogin Redirecting to –>> https://ebsclone.aot.sa:4443/OA_HTML/AppsLocalLogin.jsp
SOLUTION:
The ssl_terminator variable value in the context value tags needs to be included as shown below:
From: <sslterminator oa_var=”s_enable_sslterminator”/> to <sslterminator oa_var=”<s_enable_terminator”>#</sslterminator>
After updating Context file, stopped EBS App Services, run autoconfig and restart the App Services Resolved the NON SSL URL redirection.
—————————————
Official interrelated Oracle EBS SSL Documents: Enabling TLS in Oracle E-Business Suite Release 12.2 (Doc ID 1367293.1) How to Completely Disable the SSL Listener for E-Business Suite R12.2 Using Fusion Middleware Control (Doc ID 2203482.1)03482.1)
Unable to connect apps user from a Recently cloned and EBS RUP 12.2.12 applied Application node sqlplus apps/***** ORA-12514: TNS:listener does not currently know of service requested in connect descriptor.[oracle@clone admin]$ sqlplus apps/**** SQL*Plus: Release 10.1.0.5.0 – Production on Mon Sep 2 11:25:55 2024 Copyright (c) 1982, 2005, Oracle. All rights reserved.
ERROR:
ORA-12514: TNS:listener does not currently know of service requested in connect descriptor
SP2-0157: unable to CONNECT to ORACLE after 3 attempts, exiting SQL*Plus
================================ [oracle@clone clone_clone]$ sqlplus / as sysdba SQL*Plus: Release 19.0.0.0.0 – Production on Mon Sep 2 11:53:30 2024 Version 19.19.0.0.0 Copyright (c) 1982, 2022, Oracle. All rights reserved. Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 – Production Version 19.19.0.0.0 SQL> Select name from v$active_services; NAME —————————————————————- cdbclone cdbcloneXDB SYS$BACKGROUND SYS$USERS clone_ebs_patch clone 7 rows selected. SQL> exit ebs_<PDB_SID> found missing in the above result ================== root cause identified as below: service name : ebs_<PDB_SID> was not up and running NOTE: ebs_clone : is the service name in our case ====================
SOLUTION:
========
1. open a linux terminal 2. Source CDB env Our pdb sid is: clone 3. export ORACLE_PDB_SID=clone ( set the PDB env temporarily) 4-a. sqlplus / as sysdba 4-b. Start the PDB service – ebs_clone BEGIN DBMS_SERVICE.START_SERVICE( service_name => ‘ebs_clone’ ); END; / 5. connect EBS node, source run fs environment and test now sqlplus apps/*** OR sqlplus apps/*** connected to apps user successfully now. =================================== Recorded session below: [oracle@clone clone_clone]$ export ORACLE_PDB_SID=clone (Having sourced CDB env)[oracle@clone clone_clone]$ sqlplus / as sysdba SQL*Plus: Release 19.0.0.0.0 – Production on Mon Sep 2 11:52:49 2024 Version 19.19.0.0.0 Copyright (c) 1982, 2022, Oracle. All rights reserved. Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 – Production Version 19.19.0.0.0 SQL> BEGIN DBMS_SERVICE.START_SERVICE( service_name => ‘ebs_clone’ ); END; /SQL> 2 3 4 5 6 PL/SQL procedure successfully completed. SQL> commit; Commit complete. SQL> exit Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 – Production Version 19.19.0.0.0 [oracle@clone clone_clone]$ =================================== Now Make sure to save the PDB State with above ebs_clone service configured and running. [oracle@clone clone_clone]$ [oracle@clone clone_clone]$ [oracle@clone clone_clone]$ export ORACLE_PDB_SID=clone [oracle@clone clone_clone]$ sqlplus / as sysdba SQL*Plus: Release 19.0.0.0.0 – Production on Mon Sep 2 11:54:12 2024 Version 19.19.0.0.0 Copyright (c) 1982, 2022, Oracle. All rights reserved. Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 – Production Version 19.19.0.0.0 SQL> alter pluggable database “clone” save state; Pluggable database altered. SQL> SQL> ================ Verify the service ebs_clone is now coming as active and running. [oracle@clone clone_clone]$ [oracle@clone clone_clone]$ export ORACLE_PDB_SID=”” [oracle@clone clone_clone]$ sqlplus / as sysdba SQL*Plus: Release 19.0.0.0.0 – Production on Mon Sep 2 11:53:30 2024 Version 19.19.0.0.0 Copyright (c) 1982, 2022, Oracle. All rights reserved. Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 – Production Version 19.19.0.0.0 SQL> Select name from v$active_services; NAME ——————- cdbclone ebs_clone <<<— service ebs_clone is now coming as active and running. cdbcloneXDB SYS$BACKGROUND SYS$USERS clone_ebs_patch clone 7 rows selected. SQL> exit Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 – Production Version 19.19.0.0.0 [oracle@clone clone_clone]$ ======================================
In this Blog we are going to learn about How To Find a Particular Database Session ID From the SQLID. One of my customer informed me I have query running since 10 hours and He already confirmed with Business user that this query session is safe to be terminated.
Here we will not discuss about invetigating if that is really applicable to be terminated
Instead this is a just to share the method on:
GOAL: How to find particular Database session ID from the SQLID we could see from Oracle 19c Enterprise Manager Database Express console
Note that we could not see the session id from same console.
SOLUTION:
select * from V$SESSION where SQL_ID = ‘7upkztdrajyay’
better to see the detailed row data returned from above select statement.
then check the sid in below sql which will generate kill statement to be run from database superuser account ( sysdba )
select ‘alter system kill session ‘||””|| vs.sid||’,’||vs.serial#||””|| ‘ immediate;’ from v$session vs, v$process vp where vs.paddr = vp.addr and vs.sid in ();
OR merge both queries for one shot result
select ‘alter system kill session ‘||”|| vs.sid ||’,’ || vs.serial# || ” || ‘ immediate;’ from v$session vs, v$process vp where vs.paddr=vp.addr and vs.sid in (select sid from v$session where sql_id =’7upkztdrajyay’);
sqlplus / as sysdba
SQL> ALTER SYSTEM KILL SESSION ‘275,44741’ immediate; SQL> ALTER SYSTEM KILL SESSION ‘279,44749’ immediate;
Issue: While accessing the EBS 12.2.13 Weblogic Console to check health status of EBS managed server the browser redirects to below error as a security restriction: The Server is not able to service this request: [Socket:000445]Connection rejected, filter blocked Socket, weblogic.security.net.FilterException: [Security:090220]rule 2
Solution: Connect to application from OS/Linux terminal/putty
Source EBS 12.2 Run File system environment
Last login: Mon Apr 15 09:35:16 2024
E-Business Suite Environment Information
File System Type: SINGLE RUN File System : /d01/UAT/ebiz/fs1/EBSapps/appl PATCH File System : NOT APPLICABLE Non-Editioned File System : /d01/UAT/ebiz/fs_ne
Jython scans all the jar files it can find at first startup. Depending on the system, this process may take a few minutes to complete, and WLST may not return a prompt right away.
Welcome to WebLogic Server Administration Scripting Shell
Type help() for help on available commands wls:/offline>
Connecting to t3://ebsuat.erp.com:7011 with userid weblogic … Successfully connected to Admin Server ‘AdminServer’ that belongs to domain ‘EBS_domain’.
Warning: An insecure protocol was used to connect to the server. To ensure on-the-wire security, the SSL port or Admin port should be used instead
wls:/EBS_domain/serverConfig> for i in x: state(i,’Server’) … Current state of ‘AdminServer’ : RUNNING Current state of ‘forms-c4ws_server1’ : SHUTDOWN Current state of ‘forms_server1’ : RUNNING Current state of ‘oacore_server1’ : RUNNING Current state of ‘oafm_server1’ : RUNNING wls:/EBS_domain/serverConfig> wls:/EBS_domain/serverConfig> … wls:/EBS_domain/serverConfig> exit
NOTE: I am still trying to find a way to check Health Status of each managed server, would update here once I found it.
Environment: Oracle EBS Release that is 12.2.13 with 19c that is 19.22 which is Running on Red Hat Enterprise Linux release 8.9 (Ootpa)
Issue:
After Applying :
R12.AD.C.delta.15 -> 34695811
R12.TXK.C.delta.15 -> 34785677
Oracle E-Business Suite 12.2.13 Release Update Pack -> 34776655
We started facing problem i.e Concurrent Request Output and Log output displays Blank Page in the Browser.
SOLUTION:
Make sure to shutdown EBS Services including Weblogic
Then Run the following commands to unzip the container and WLS patch respectively and then Apply below Weblogic Server Patch ( for OL8/RHEL8 customers only ):
cd /u01/8005_uat_app/ebiz/fs1/FMW_Home/utils/bsu/cache_dir/
2-a. unzip -o /u01/EBS_UPDATE_12_2_13/CONC_LOG_NO_OUTPUT/p32931976_R12_GENERIC.zip 2-b. unzip -o /u01/EBS_UPDATE_12_2_13/CONC_LOG_NO_OUTPUT/p31090393_1036_Linux-x86-64.zip —-> EG54.jar delivered by this patch is actually going to fix.
[appluat@ebsappuat CONC_LOG_NO_OUTPUT]$ ls -lrt total 213624 -rw-r–r–. 1 appluat dba 196680280 Dec 9 2020 patch-catalog_27387.xml -rw-r–r–. 1 appluat dba 449 Dec 9 2020 README.txt -rw-r–r–. 1 appluat dba 4088 Dec 9 2020 EG54.jar -rw-r–r–. 1 appluat dba 673 May 27 2021 Readme.txt -rw-r–r–. 1 appluat dba 11081624 May 27 2021 p31090393_1036_Linux-x86-64.zip -rw-r–r–. 1 appluat dba 10970736 Feb 21 16:09 p32931976_R12_GENERIC.zip [appluat@ebsappuat CONC_LOG_NO_OUTPUT]$
OS level error while starting WebLogic Admin adadminsrvctl.sh service in EBS 12.2 on Redhat and or Oracle Linux 8.9 :
You are running adadminsrvctl.sh version 120.10.12020000.11
Starting WLS Admin Server… Refer /u01/8005_uat_app/ebiz/fs1/inst/apps/PREUPG_ebsappuat/logs/appl/admin/log/adadminsrvctl.txt for details
AdminServer logs are located at /u01/8005_uat_app/ebiz/fs1/FMW_Home/user_projects/domains/EBS_domain/servers/AdminServer/logs
adadminsrvctl.sh: exiting with status 0
adadminsrvctl.sh: check the logfile /u01/8005_uat_app/ebiz/fs1/inst/apps/PREUPG_ebsappuat/logs/appl/admin/log/adadminsrvctl.txt for more information …
.end std out.
sh: scl: line 1: syntax error: unexpected end of file sh: error importing function definition for scl’ sh: ml: line 1: syntax error: unexpected end of file sh: error importing function definition forml’ sh: switchml: line 1: syntax error: unexpected end of file sh: error importing function definition for switchml’ sh: which: line 1: syntax error: unexpected end of file sh: error importing function definition forwhich’ sh: ml: line 1: syntax error: unexpected end of file sh: error importing function definition for ml’ sh: _module_raw: line 1: syntax error: unexpected end of file sh: error importing function definition for_module_raw’ sh: scl: line 1: syntax error: unexpected end of file
.end err out.
To solve the error while starting weblogic admin server, follow the given below
Solution:
vi .bash_profile of your EBS Application OS user unset which unset scl
Extraction of EBS 12.1.x or EBS 12.2.x Workflow Mailer logs having Error, Exception or UNEXPECTED Keywords in your target logfiles.
By following the given below steps you will easily extract EBS 12.1.x or EBS 12.2.x Workflow Mailer logs having Error, Exception or UNEXPECTED Keywords in your target logfiles.
Steps:
Source EBS Run file system/
cd $APPLCSF/logs
Generate the subject logs with the following commands:
Check Clone Context logfile /u01/DEV8010/db/19.0.0/appsutil/clone/bin/CloneContext_0202132410.log for details.
[oradev@erpdevdb bin]$
=========================================
4.1.4 Configure the Database Technology Stack
IMPORTANT:Ensure oraInventory pointed in /etc/oraInst.loc must not contain the Same target PATH OR same Target Oracle Home Names, If exist then it is better deAttach those which may conflict with your Cloning session. ( Example : /u01/orainventory/ContentsXML/inventory.xml can be reviewed before proceeding)
CREATE RMAN DUPLICATE SCRIPT FOR RESTORING YOUR TARGET DATABASE:
SAMPLE COMMAND duplicate database to “<TARGET CDB>” backup location ‘<PATH OF RMAN BACKUP DIRECTORY>’;
DEV CREATION COMMAND duplicate database to “DEVCDB” backup location ‘/u01/DEV8010/RMAN_BKP_02FEB22_02AM’;
RMAN DUPLICATE SCRIPT:
cd /u01/DEV8010/
vi restoredevcdb.sql
INSERT Below duplicate script to clone the Production Backup to Restore to DEV CDB
run
{
allocate auxiliary channel a1 type disk;
allocate auxiliary channel a2 type disk;
allocate auxiliary channel a3 type disk;
duplicate database to “DEVCDB” backup location ‘/u01/DEV8010/RMAN_BKP_02FEB22_02AM’;
release channel a1;
release channel a2;
release channel a3;
}
This above script will restore the CDB + PDB Database plugged already in CDB
============================
STEP
======
[oradev@erpdevdb dbs]$ rman auxiliary /
Recovery Manager: Release 19.0.0.0.0 – Production on Wed Feb 2 19:02:18 2022
Version 19.12.0.0.0
Copyright (c) 1982, 2019, Oracle and/or its affiliates. All rights reserved.
connected to auxiliary database: DEVCDB (not mounted)
RMAN> @/u01/DEV8010/restoredevcdb.sql
RMAN>
============================
Take a new/fresh Putty Session Source Environment of this recently Restored Container Database DEVCDB
. /u01/DEV8010/db/19.0.0/DEVCDB_erpdevdb.env
Start the Container Database DEVCDB
Note: if the Database is already up then it is better to bounce the Database and ensure CDB has no issue shutting and starting up this newly Cloned DEVCDB.
Check the Datafiles, Controlfiles, Redolog Files and Temporary Tablespace files are correctly restored on the Target File System PATH
You should be able to connect to apps schema on this new ERPDEV PDB Connect using TOAD or xyz Tool Verify the UTL FILE directory is correctly populated : select * from apps.v$parameter2 where name=’utl_file_dir’
Since Our ORACLE_BASE is /u01/DEV8010 Therefore we ensured a temp folder inside ORACLE_BASE /u01/DEV8010/temp
Check Table FND_NODES ( If Source PDB records does not exist then skip the FND_CONC_CLONE.SETUP_CLEAN; )
EXEC FND_CONC_CLONE.SETUP_CLEAN;
COMMIT; EXIT;
cd /u01/DEV8010/db/19.0.0/appsutil/clone/bin perl adcfgclone.pl dbconfig /u01/DEV8010/db/19.0.0/appsutil/ERPDEV_erpdevdb.xml
X =============END OF DATABASE CLONING STEPS=============X
EBS 12.2.X – APPLICATION TIER CLONING:
3.2 Prepare the Source System Application Tier
Run Preclone on Source App Tier: cd $ADMIN_SCRIPTS_ADMIN perl adpreclone.pl appsTier Ensure completion is 100% Successful.
Now Take TAR backup of EBS Run File System
cd <backup PATH> tar -czf /backup_apps/EBS_BKPS/APPS_BKP_EBSapps`date +%d%m%y`.tgz $RUN_BASE/EBSapps
Transfer the tar file backup to Target EBS App Server and extract it ======================================
5.2 Configure the Target System Application Tier Nodes
IMPORTANT:Ensure oraInventory pointed in /etc/oraInst.loc must not contain the Same target PATH OR same Target Oracle Home Names, If exist then it is better deAttach those which may conflict with your Cloning session. ( Example : /u01/orainventory/ContentsXML/inventory.xml can be reviewed before proceeding) Start the Cloning process as below :
[appldev@erpdevapp bin]$ cd /u01/Ebiz_Dev8010/fs1/EBSapps/comn/clone/bin
[appldev@erpdevapp bin]$ pwd
/u01/Ebiz_Dev8010/fs1/EBSapps/comn/clone/bin
[appldev@erpdevapp bin]$ ls -lrt
total 296
-rwxrwxr-x. 1 appldev dba 5101 Nov 26 2012 adchkutl.sh
-rwxrwxr-x. 1 appldev dba 100123 Jan 15 04:03 adclone.pl
-rwxrwxr-x. 1 appldev dba 48314 Jan 15 04:03 adclonectx.pl
-rwxrwxr-x. 1 appldev dba 128221 Jan 15 04:03 adcfgclone.pl
-rwxrwxr-x. 1 appldev dba 10887 Jan 15 04:03 adaddnode.pl
Check Clone Context logfile /u01/Ebiz_Dev8010/fs1/EBSapps/comn/clone/bin/CloneContext_0116110816.log for details.
Running Rapid Clone with command:
============END OF CLONING PROCESS==============
POST CLONING ACTIONS:
1. Change sysadmin password ( Different from Production ) 2. Change apps password in EBS 12.2 requires below steps:After Finishing the Cloning Process Must change the apps password to differentiate it from Production
3.Run autoconfig with the newly changed password.
./autocfg.sh
Enter the APPS user password:
Start AdminServer using the $INST_TOP/admin/scripts/adadminsrvctl.sh script. Do not start any other application tier services.
$INST_TOP/admin/scripts/adadminsrvctl.sh start
Change the �apps� password in WLS Datasource as follows:Log in to WLS Administration Console.
b. Click Lock & Edit in Change Center.
c. In the Domain Structure tree, expand Services, then select Data Sources.
d. On the �Summary of JDBC Data Sources� page, select EBSDataSource.
e. On the �Settings for EBSDataSource� page, select the Connection Pool tab.
f. Enter the new password in the �Password� field.
g. Enter the new password in the �Confirm Password� field.
h. Click Save.
i. Click Activate Changes in Change Center.
http://srrco.server.com:7011/console
Username/Password <of weblogic>
Start all the application tier services using the below script
$INST_TOP/admin/scripts/adstrtal.sh
Verify the WLS Datastore changes as follows:Log in to WLS Administration Console.
b. In the Domain Structure tree, expand Services, then select Data Sources.
c. On the �Summary of JDBC Data Sources� page, select EBSDataSource.
d. On the �Settings for EBSDataSource� page, select Monitoring > Testing.
e. Select �oacore_server1�.
f. Click Test DataSource
g. Look for the message �Test of EBSDataSource on server oacore_server1 was successful
Steps to STOP Oracle EBS 12.2.x Application Services:
1. Connect Putty to Application Sever IP:
2. Login with Application OS User ( Username / password ) and source EBS Application Env
3. cd $ADMIN_SCRIPTS_HOME 4. [applprod@erp scripts]$ pwd
/u01/Ebiz/fs1/inst/apps/ERPPROD_erp/admin/scripts
[applprod@erp scripts]$
5. ./adstpall.sh apps/< password
Enter Weblogic Password when Prompted
Now EBS services will proceed to shut down…….
Ensure All processes are cleared on Linux terminal
Use the command : ps –ef | grep applprod
Except vnc process , Wait for each applprod process to be cleared out itself.
Incase of delay only we may proceed to kill the pending OS applprod processes in order to proceed next.
AFTER SHUTDOWN of All EBS Services including all OS Processes
Perform the TAR Backup of the EBS FileSystem:
Command to run TAR Backup ( For Full Backup of EBS File System ): cd <Backup Direcory> nohup tar -czf [Compressed file name].tgz /u01/Ebiz &
Command to run TAR Backup ( For Cloning Purpose Only – EBS Backup of EBS File System ): cd <Backup Direcory> nohup tar -czf [Compressed file name].tgz /u01/Ebiz/fs1/EBSapps &
NOTE: For cloning purpose, Ensure to run PRECLONE on Apps Tier before EBS Backup:
Steps to START Oracle EBS 12.2.x Application Services:
cd $ADMIN_SCRIPTS_HOME 4. ( a ) To start Weblogic and EBS Services in One Shot [applprod@erp scripts]$ pwd
/u01/Ebiz/fs1/inst/apps/ERPPROD_erp/admin/scripts
[applprod@erp scripts]$ ./adstrtal.sh apps/***** You are running adadminsrvctl.sh version 120.10.12020000.11
Enter the WebLogic Admin password: < Enter the Weblogic password >
Enter the APPS Schema password: < Enter the apps password >
NOTE: ( On the Safe Side ) It is a Good Practice to start the Weblogic Admin before starting EBS Services to ensure there is no Weblogic startup issue. 4. ( b-1 ) To start Weblogic First Alone [applprod@erp scripts]$ pwd
/u01/Ebiz/fs1/inst/apps/ERPPROD_erp/admin/scripts
[applprod@erp scripts]$ ./adadminsrvctl.sh start
You are running adadminsrvctl.sh version 120.10.12020000.11
Enter the WebLogic Admin password: < Enter the Weblogic password >
Enter the APPS Schema password: < Enter the apps password >
Now login to Weblogic Console :
AdminServer-(admin) should be up and running.
4. ( b-2 ) NOW start EBS Services to start the Managed Services ( Forms_server1, oacore_server1 and oaf_server1 ) under the Weblogic Admin Control[applprod@erp scripts]$ pwd
/u01/Ebiz/fs1/inst/apps/ERPPROD_erp/admin/scripts
[applprod@erp scripts]$ ./adstrtal.sh apps/***** You are running adadminsrvctl.sh version 120.10.12020000.11
Enter the WebLogic Admin password: < Enter the Weblogic password > Enter the APPS Schema password: < Enter the apps password > Once All the Services are ensure ( Forms_server1, oacore_server1 and oaf_server1 )that they are RUNNING
1. Connect Putty to Database Sever IP: 172.10.18.17 2. Login with Database OS User ( Username / password ) 3. Source Container Database Env
. env_filename.env
NOTE: Since there are 2 separate env files ( one for CDB and one for PDB ( EBS Database ) Therefore Environment is not configured to be auto sourced on Login
Issue command shu immediate
Since you are connected to Container Database , Shutdown immediate will first shutdown the Pluggable (PDB) EBS Database and then shutdown itself (CDB) at the end.
Go to the main directory where all datafiles of CDB and PDB are located.
In my case the dir is “/u01/erpprod/db “
cdb_data = Directory containing Container Data Files ebs_data = Directory containing Pluggable EBS Data Files
19.0.0 is the home directory having 19c binaries.
temp directory is a mandatory directory acting as utl_file directory path location: 19c CDB Database.
ONLY FOR INFORMATION ( REFERENCE SCREENSHOT BELOW)
AFTER SHUTDOWN of All Oracle Database Processes
For Cold Backup of Database ( both CDB and PDB ) This cold Backup may help DBA to recover during a Patching situation on the EBS Application or some major Updates in the Database. Perform the Cold TAR Backup using the below command:
Command to run TAR Backup ( For Full Backup of DB File System including both CDB and PDB ): cd <Backup Direcory> nohup tar -czf [To be name of compressed file].tgz /u01/erpprod/db&
For RMAN online Backup
Backup has been already scheduled in Linux crontab – Daily 02:00 AM
Visit Today : 4
Visit Yesterday : 27
This Month : 44
This Year : 1216
Total Visit : 1448
Hits Today : 6
Total Hits : 2000
Who's Online : 3