My Collaborate '17 presentation about our story to engineered systems.

1. Session ID:
Prepared by:
Uponor Exadata E-Business
Suite Migration Case Study
True story to Engineered Systems in three months
10032
Simo Vilmunen, Uponor Business Solutions
@svilmune

2. "If I had eight hours to chop down
a tree, I'd spend six sharpening my
axe."
- Abraham Lincoln

3. April 2-6, 2017 in Las Vegas, NV USA #C17LV
About me
Simo Vilmunen Technical Architect and DBA
Oracle eBS 10+ years
Oracle databases 15+ years
blogger: http://finnishingthoughts.wordpress.com
Lately focused on virtualization &
infrastructure of Oracle technology stack

4. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Uponor Oyj
“Partnering with professionals to create better plumbing,
indoor climate and infrastructure solutions”

5. 100 000

6. WHY did we choose Exadata
HOW did we migrate
and WHAT did we learn after

7. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Our Oracle footprint
Oracle e-
Business Suite
Oracle Business
Intelligence
Oracle
Hyperion
2006 2009 2010
12.1.3 11.1.1.7 11.1.2.4
11.2.0.3 x2 11.2.0.4 12.1.0.2
1000 600 100
“Business critical applications are operated in most European countries”
Implemented
Version
Database
Users
Oracle VM 3.3.3
Oracle Enterprise Linux 5 & 6
Oracle Enterprise Manager 13c

8. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Architecture for Oracle Systems

9. April 2-6, 2017 in Las Vegas, NV USA #C17LV
We had
Database hardware for EBS and
OBIEE over three years old
Increased application usage
New business requirements
Already standardised
platforms

10. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Things we were looking for
Cost & Consolidation
Manageability
Scalability & Availability
Future architecture

11. April 2-6, 2017 in Las Vegas, NV USA #C17LV
In the end two choices
vs
Commodity
hardware
upgrade
Exadata

12. April 2-6, 2017 in Las Vegas, NV USA #C17LV
COST
CONSOLIDATION
SCALABILITY
MANAGEABILITY
EXADATA COMMODITY
HARDWARE

13. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Proof of Concept with X3-2 ¼ & OBIEE
No changes
Reduced DOP
No bitmap indexes
SGA 2G
Parallel
13X
36X
62X
62X
36X

14. April 2-6, 2017 in Las Vegas, NV USA #C17LV
With Exadata we get all the evaluated
benefits with similar cost compared
to commodity hardware upgrade
without the need to extend our
license footprint.

15. September 4th, 2015 we made decision
to migrate our production databases to
Oracle Exadata X5-2 1/8 rack.
December 19th, 2015 we had migrated
our main business applications to
Exadata without major issues.

16. But where to start?

17. April 2-6, 2017 in Las Vegas, NV USA #C17LV
3 months for e-Business Suite
Review EBS setup
Migration Plan
Focused testing &
background work
KEEP IT SIMPLE!

18. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Remember 3 months? I lied.

19. WHY did we choose Exadata
HOW did we migrate
and WHAT did we learn after

20. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Migration before end of 2015
1 Business project Go-Live 1st of January
2016 with performance impact to EBS
2 Decide:
Migration method
Testing focus areas
New operational processes
Exadata setup
3 Implementation partner with
EBS & Exadata knowledge

21. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Migration schedule

22. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Configuration – 2 days
Before: Oracle Exadata Deployment Assistant
Day 1: Physical Installation & Setup
Day 2: Exadata installation & Configuration

23. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Database distribution by Enkitec’s Sizing
and Provisioning tool
Database node 2Database node 1
EBS ERP
HYPERION
EBS ASCP (APS)
OBIEE

24. First EBS migration?

25. 35 hours…

26. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Revisited
Oracle RMAN restore configuration
Network setup
Demantra & db_32k_cache_size

27. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Testing
Test all key functionality from each EBS business area
Focus on database specific areas & performance
Interfaces: utl_file & NFS
EBS Batch jobs: Data collections, DB links & JDBC
Exadata specific test cases:
System failures
Infiniband database listener vs normal
Write-through vs Write-back flash cache
I/O Resource Manager profile

28. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Results
100% of test cases
passed without
performance issues
Use write-back cache
Configure infiniband
listener for database
links
EBS specific setup
separate listener
Oracle Home
NFS mounts (dNFS)
No IORM configuration
Database parameters
keep large SGA
parallel settings

29. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Infiniband listener for Exadata DB-to-DB
traffic
SYS@ERP> select db_link, host from dba_db_links where db_link like 'ERP%';
DB_LINK HOST
--------------- ----------
ERP_TO_ASCP ASCP_IB
SYS@ERP> select name, value from v$parameter where name like
'listener%';
NAME VALUE
----------- -----------
listener_networks ((NAME=network2)(LOCAL_LISTENER=LISTENER_IBLOCAL)),
((NAME=network1)(LOCAL_LISTENER=LISTENER_IPLOCAL))
## IB Listener configuration
LISTENER_IBLOCAL =
(DESCRIPTION = (ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = upoex1dbadm01-ib)(PORT = 1535))
(ADDRESS = (PROTOCOL = SDP)(HOST = upoex1dbadm01-ib)(PORT = 1535))))
LISTENER_IPLOCAL =
(DESCRIPTION = (ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = upoex1db01-vip.uponor.local)(PORT = 1521))))
ERP_IB =
(DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = upoex1dbadm01-ib)(PORT = 1535))
(CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = ERP)))
ASCP_IB =
(DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = upoex1dbadm02-ib)(PORT = 1535))
(CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = ASCP)))

30. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Performance
EMEA VAT Report 23 hours
Picking info page 15 seconds
Planning data pull 40 minutes
Print sales order 302 seconds
Book sales order 16 seconds
BI Daily Load 420 minutes
Full EBS backup (5TB) 800 minutes
8 hours
1 second
8 minutes
38 seconds
14 seconds
282 minutes
92 minutes
Before Exadata

31. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Cutover plan
Place concurrent requests ON HOLD in PUPONI 20/11/2015 22:00
Shutdown ERP DB application services on host1, host2, host3, host4
Shutdown ERP DB; startup mount; last archives to rman backup
Shutdown ERP DB database & listener on host X
Confirm services are shutdown and all backups are under /xx/hostX/orabackups including last
archive logs by refreshing /xx mount and verify migration start
00:30
Apply remaining archive logs from backup pieces 20/11/2015 23:30
Validate recovery of ERP DB & startup database
Validate listener is up & running on port 1522
Validate IB listener is up & running
Change database init parameters for ERP DB (based on values on sheet 2)
Validate poststep for PSU/CPU patches are done according to Doc ID 1995261.1
Validate ERP DB is using DirectNFS
Validate huge pages are in use
Gather fixed stats for ERP DB using: exec dbms_stats.gather_fixed_objects_stats;
Modify $ORACLE_HOME/rdbms/admin/externaljob.ora and add following in the end: run_user =
oraexa
run_group = oinstall and follow steps from 6 - Extra tasks B3
00:30
Change Kemp loadbalancer to use port pool 1 and port 8001 20/11/2015 23:30 00:30
01:00
03:00
Restore RMAN level 0 backup & daily level 1 backup
Data validation & shutdown services
Get final archives and finalize restore on Exadata node
Validate recovery & database specific configuration
Run EBS scripts on all nodes (adcfgclone & autoconfig)
Startup EBS services & Gather statistics including fixed stats
Validate services, data, monitoring and backups

32. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Results after cutover
Issue on getting getting listener properly configured
One non-critical report failing with ORA-600
User comments from warehouse: Seems like earlier..
User comments from finance departments:
Unbelievable!!

33. 30 000 concurrent requests daily
Average runtime for requests
during month end closing 65
seconds
After migration 17 seconds

34. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Additional things for migration
Enterprise Manager
Backups
exachk
Default passwords
Communication

35. WHY did we choose Exadata
HOW did we migrate
and WHAT did we learn after

36. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Lessons learned after using EBS with
Exadata for one year

37. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Data loads to OBIEE
420 min 282 min 152 min
Before Exadata EBS on Exadata EBS & OBIEE on
Exadata
We now gather full daily set of
EBS data to OBIEE on 1/3 of time
compared to pre-Exadata

38. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Exachk – EBS specifics
Status Type Message Status On Details
Workflow
FAIL SQL Check
One or more major
Workflow Looping
Items found
All Databases View
Status on EBS ERP:
FAIL => One or more major Workflow Looping Items found
DATA FOR EBS ERP FOR WF_CHECK FOR LOOPING ITEMS
Item_Type Item_key Count Begin_Date End_Date User_Key
---------- ---------------------------------------- ---------------- --------------- --------------- ----------------------------------------
OEOL 1111111 12,880 2015-03-26 Return Order 1222222, Line 3.1..
Checks are run for the following EBS areas: Workflow, Sales and
Marketing, Service and Contracts, Fixed Assets, Payables, Projects, Receivables, Human
Resources Management System, Process Manufacturing, Procurement, Order Management,
Discrete Manufacturing, Price Management

39. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Useful documentation
• Expert Oracle Exadata book
• Exadata Discovery cookbook PDF for Enterprise Manager
• Exadata Dashboard PDF
• MAA Best Practises for Exadata & Oracle Applications
• Setup Listener on Infiniband Network using both SDP and
TCP Protocol (Doc ID 1580584.1)
• MOS Information Center: Oracle Exadata Database
Machine

40. Remember 30 000 concurrent
requests daily?
Today we run 100 000 requests
daily with same performance as
earlier.

41. Please Complete Your
Session Evaluation
Evaluate this session in your COLLABORATE app.
Pull up this session and tap "Session Evaluation"
to complete the survey.
Session ID: 10032

42. Q&A