SlideShare a Scribd company logo
1 of 17
Ab Initio
From the Data Warehousing
Perspective
Data Warehousing
Why did it arise?
 Large Corporations gathered huge amounts of
data.
 Sooner, they were data rich but information
poor.
 Large body of disparate data, difficult to make
informed business decisions.
Solution!!!
 Users wanted more control over their data
 Each department request data specific to their
department.
 Varying amounts of data from the same
source.
One Solution to the PROBLEMS---
Information/Data Warehouse.
What is Data Warehousing?
 Data Warehousing is an architecture
 System for storing, retrieving and managing
large amounts of any type of data.
 Data warehousing concerned in moving data
from its current location to the data warehouse
and transforming data into information.
E.T.L-----What is it??
 E.T.L stands for Extraction, Transformation
Loading.
 This is the principle used in Data Warehousing
Characteristics of Data Warehousing
 Application independent
 Collected at any moment in a business cycle.
 Metadata has been created for it.
 Easily understood by a non-technical
Characteristics of data in data warehouse
 Subject Oriented
 Integrated
 Non-volatile
 Time Variant
Subject-Oriented
 Focus on entities rather than on process.
 A Subject-Oriented data warehouse is called a
Data Mart
ETL Tools
 Many tools are being used in Data
Warehousing for the purpose of ETL.
 Ab Initio is one of the major ETL tool.
What is Ab Initio?
 Latin word, meaning “From First Principles”
 ETL tool, developed by Ab Initio software
corporation (http://www.abinitio.com)
 Used in data warehousing, batch processing
and application integration.
Why Ab Initio?
 Achieving Scalability
 Reduced Development Time
 Managing Metadata
 Integrating Other Applications
Features
 Basic Components: Filter by Expression, Reformat, Sort, Join,
Rollup, Dedup
 Database Components: Input, Output and Update Table;
db_config_utility
 Built in Functions: Ab Initio built-in functions are those which
 can manipulate strings, dates, and numbers
 can access system properties
 Vectors: An array of same type of elements that is repeated
Look Up Function
 Built-in function within a transform function that
allows a transform component to retrieve records
from a look up file
 Held in main memory
 Faster as searching and retrieval is key based
 Not connected to other components in a graph
Alternatives for Ab Initio
 Informatica and Ascential are alternatives for
Ab Initio but the main disadvantage is they are
tougher to work with.
Highlights
 Every plug-in facility available from industry
leaders Informatica and Ascential incorporated
into Ab Initio
 Fastest ETL, possible to extract 41 million
rows of data from an Oracle 8i database
(Geneva billing system!) in about 5.2 minutes
Success Stories
 Bank of Montreal-Moving 10 terabytes (TB)
of data daily and analyzing it done using Ab
Initio
 Premier Inc. (www.premierinc.com health
care services) successfully handled 14 TB of
data using Ab Initio to achieve scalability and
data quality
End
 Thank You for your time!!

More Related Content

What's hot

Infrastructure And Application Consolidation Analysis And Design
Infrastructure And Application Consolidation Analysis And DesignInfrastructure And Application Consolidation Analysis And Design
Infrastructure And Application Consolidation Analysis And Design
Alan McSweeney
 
Logical database design and the relational model(database)
Logical database design and the relational model(database)Logical database design and the relational model(database)
Logical database design and the relational model(database)
welcometofacebook
 

What's hot (20)

Abinitio.ppt
Abinitio.pptAbinitio.ppt
Abinitio.ppt
 
Infrastructure And Application Consolidation Analysis And Design
Infrastructure And Application Consolidation Analysis And DesignInfrastructure And Application Consolidation Analysis And Design
Infrastructure And Application Consolidation Analysis And Design
 
Logical database design and the relational model(database)
Logical database design and the relational model(database)Logical database design and the relational model(database)
Logical database design and the relational model(database)
 
Denodo Data Virtualization Platform Architecture: Performance (session 2 from...
Denodo Data Virtualization Platform Architecture: Performance (session 2 from...Denodo Data Virtualization Platform Architecture: Performance (session 2 from...
Denodo Data Virtualization Platform Architecture: Performance (session 2 from...
 
Power BI
Power BIPower BI
Power BI
 
Informatica PowerCenter Tutorial | Informatica Tutorial for Beginners | Edureka
Informatica PowerCenter Tutorial | Informatica Tutorial for Beginners | EdurekaInformatica PowerCenter Tutorial | Informatica Tutorial for Beginners | Edureka
Informatica PowerCenter Tutorial | Informatica Tutorial for Beginners | Edureka
 
Power BI: Types of gateways in Power BI
Power BI: Types of gateways in Power BIPower BI: Types of gateways in Power BI
Power BI: Types of gateways in Power BI
 
Introduction to ETL and Data Integration
Introduction to ETL and Data IntegrationIntroduction to ETL and Data Integration
Introduction to ETL and Data Integration
 
ETL Using Informatica Power Center
ETL Using Informatica Power CenterETL Using Informatica Power Center
ETL Using Informatica Power Center
 
Informatica Tutorial For Beginners | Informatica Powercenter Tutorial | Edureka
Informatica Tutorial For Beginners | Informatica Powercenter Tutorial | EdurekaInformatica Tutorial For Beginners | Informatica Powercenter Tutorial | Edureka
Informatica Tutorial For Beginners | Informatica Powercenter Tutorial | Edureka
 
Rdbms
RdbmsRdbms
Rdbms
 
PowerBI Training
PowerBI Training PowerBI Training
PowerBI Training
 
Pentaho Enterprise vs. Pentaho Community
Pentaho Enterprise vs. Pentaho CommunityPentaho Enterprise vs. Pentaho Community
Pentaho Enterprise vs. Pentaho Community
 
Power BI Interview Questions and Answers | Power BI Certification | Power BI ...
Power BI Interview Questions and Answers | Power BI Certification | Power BI ...Power BI Interview Questions and Answers | Power BI Certification | Power BI ...
Power BI Interview Questions and Answers | Power BI Certification | Power BI ...
 
Enterprise Master Data Architecture
Enterprise Master Data ArchitectureEnterprise Master Data Architecture
Enterprise Master Data Architecture
 
Introduction to Power BI and Data Visualization
Introduction to Power BI and Data VisualizationIntroduction to Power BI and Data Visualization
Introduction to Power BI and Data Visualization
 
Database design process
Database design processDatabase design process
Database design process
 
Planning Data Warehouse
Planning Data WarehousePlanning Data Warehouse
Planning Data Warehouse
 
Introduction - Lecture 1 - Advanced Topics in Information Systems (4016792ENR)
Introduction - Lecture 1 - Advanced Topics in Information Systems (4016792ENR)Introduction - Lecture 1 - Advanced Topics in Information Systems (4016792ENR)
Introduction - Lecture 1 - Advanced Topics in Information Systems (4016792ENR)
 
ETL Process
ETL ProcessETL Process
ETL Process
 

Viewers also liked

Optimization Analysis Case Example
Optimization Analysis Case ExampleOptimization Analysis Case Example
Optimization Analysis Case Example
bjk002
 
Teamcenter – sap integration gateway
Teamcenter – sap integration gatewayTeamcenter – sap integration gateway
Teamcenter – sap integration gateway
Panso Solutions India Pvt Ltd
 
Branding in Pharmaceuticals
Branding in PharmaceuticalsBranding in Pharmaceuticals
Branding in Pharmaceuticals
Sheraz Pervaiz
 

Viewers also liked (20)

Aboutsip - SIP Routing
Aboutsip - SIP RoutingAboutsip - SIP Routing
Aboutsip - SIP Routing
 
Optimization Analysis Case Example
Optimization Analysis Case ExampleOptimization Analysis Case Example
Optimization Analysis Case Example
 
Tanglewood 3
Tanglewood 3Tanglewood 3
Tanglewood 3
 
The welch way
The welch wayThe welch way
The welch way
 
Advanced Work Packaging in Construction: An Introduction
Advanced Work Packaging in Construction: An IntroductionAdvanced Work Packaging in Construction: An Introduction
Advanced Work Packaging in Construction: An Introduction
 
Teamcenter – sap integration gateway
Teamcenter – sap integration gatewayTeamcenter – sap integration gateway
Teamcenter – sap integration gateway
 
Hedge Fund Strategies: Credit Funds
Hedge Fund Strategies: Credit FundsHedge Fund Strategies: Credit Funds
Hedge Fund Strategies: Credit Funds
 
Real-time, Sensor-based Monitoring of Shipping Containers
Real-time, Sensor-based Monitoring of Shipping ContainersReal-time, Sensor-based Monitoring of Shipping Containers
Real-time, Sensor-based Monitoring of Shipping Containers
 
Designing your Product as a Platform
Designing your Product as a PlatformDesigning your Product as a Platform
Designing your Product as a Platform
 
Pilling and abrasion Testing of fabrics
Pilling and abrasion Testing of fabricsPilling and abrasion Testing of fabrics
Pilling and abrasion Testing of fabrics
 
Shear centre
Shear centreShear centre
Shear centre
 
Chapter 1 modes of international trade transactions
Chapter 1   modes of international trade transactionsChapter 1   modes of international trade transactions
Chapter 1 modes of international trade transactions
 
Office 365-single-sign-on-with-adfs
Office 365-single-sign-on-with-adfsOffice 365-single-sign-on-with-adfs
Office 365-single-sign-on-with-adfs
 
Revenue assurance 101
Revenue assurance 101Revenue assurance 101
Revenue assurance 101
 
XRF Theory and Application
XRF Theory and ApplicationXRF Theory and Application
XRF Theory and Application
 
One Page Talent Management
One Page Talent ManagementOne Page Talent Management
One Page Talent Management
 
Acquisition Candidate Analysis
Acquisition Candidate AnalysisAcquisition Candidate Analysis
Acquisition Candidate Analysis
 
Textile management system review iii
Textile management system   review iiiTextile management system   review iii
Textile management system review iii
 
Branding in Pharmaceuticals
Branding in PharmaceuticalsBranding in Pharmaceuticals
Branding in Pharmaceuticals
 
Metadata in data warehouse
Metadata in data warehouseMetadata in data warehouse
Metadata in data warehouse
 

Similar to What is the future of etl tools like ab initio

ETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptxETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptx
ParnalSatle
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
sumit621
 
UNIT-5 DATA WAREHOUSING.docx
UNIT-5 DATA WAREHOUSING.docxUNIT-5 DATA WAREHOUSING.docx
UNIT-5 DATA WAREHOUSING.docx
DURGADEVIL
 
What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?
RTTS
 

Similar to What is the future of etl tools like ab initio (20)

DW 101
DW 101DW 101
DW 101
 
Implementation of Data Marts in Data ware house
Implementation of Data Marts in Data ware houseImplementation of Data Marts in Data ware house
Implementation of Data Marts in Data ware house
 
Unit 1
Unit 1Unit 1
Unit 1
 
Big data analytics beyond beer and diapers
Big data analytics   beyond beer and diapersBig data analytics   beyond beer and diapers
Big data analytics beyond beer and diapers
 
Data warehouse presentation
Data warehouse presentationData warehouse presentation
Data warehouse presentation
 
ETL
ETLETL
ETL
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
Datawarehouse
DatawarehouseDatawarehouse
Datawarehouse
 
Top 60+ Data Warehouse Interview Questions and Answers.pdf
Top 60+ Data Warehouse Interview Questions and Answers.pdfTop 60+ Data Warehouse Interview Questions and Answers.pdf
Top 60+ Data Warehouse Interview Questions and Answers.pdf
 
ETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptxETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptx
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
 
[IJET-V1I5P5] Authors: T.Jalaja, M.Shailaja
[IJET-V1I5P5] Authors: T.Jalaja, M.Shailaja[IJET-V1I5P5] Authors: T.Jalaja, M.Shailaja
[IJET-V1I5P5] Authors: T.Jalaja, M.Shailaja
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
Data Warehouse
Data Warehouse Data Warehouse
Data Warehouse
 
UNIT-5 DATA WAREHOUSING.docx
UNIT-5 DATA WAREHOUSING.docxUNIT-5 DATA WAREHOUSING.docx
UNIT-5 DATA WAREHOUSING.docx
 
Data Warehouse Basic Guide
Data Warehouse Basic GuideData Warehouse Basic Guide
Data Warehouse Basic Guide
 
Data warehouse concepts
Data warehouse conceptsData warehouse concepts
Data warehouse concepts
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
A Comparitive Study Of ETL Tools
A Comparitive Study Of ETL ToolsA Comparitive Study Of ETL Tools
A Comparitive Study Of ETL Tools
 
What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?
 

Recently uploaded

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 

Recently uploaded (20)

Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 

What is the future of etl tools like ab initio

  • 1. Ab Initio From the Data Warehousing Perspective
  • 2. Data Warehousing Why did it arise?  Large Corporations gathered huge amounts of data.  Sooner, they were data rich but information poor.  Large body of disparate data, difficult to make informed business decisions.
  • 3. Solution!!!  Users wanted more control over their data  Each department request data specific to their department.  Varying amounts of data from the same source. One Solution to the PROBLEMS--- Information/Data Warehouse.
  • 4. What is Data Warehousing?  Data Warehousing is an architecture  System for storing, retrieving and managing large amounts of any type of data.  Data warehousing concerned in moving data from its current location to the data warehouse and transforming data into information.
  • 5. E.T.L-----What is it??  E.T.L stands for Extraction, Transformation Loading.  This is the principle used in Data Warehousing
  • 6. Characteristics of Data Warehousing  Application independent  Collected at any moment in a business cycle.  Metadata has been created for it.  Easily understood by a non-technical
  • 7. Characteristics of data in data warehouse  Subject Oriented  Integrated  Non-volatile  Time Variant
  • 8. Subject-Oriented  Focus on entities rather than on process.  A Subject-Oriented data warehouse is called a Data Mart
  • 9. ETL Tools  Many tools are being used in Data Warehousing for the purpose of ETL.  Ab Initio is one of the major ETL tool.
  • 10. What is Ab Initio?  Latin word, meaning “From First Principles”  ETL tool, developed by Ab Initio software corporation (http://www.abinitio.com)  Used in data warehousing, batch processing and application integration.
  • 11. Why Ab Initio?  Achieving Scalability  Reduced Development Time  Managing Metadata  Integrating Other Applications
  • 12. Features  Basic Components: Filter by Expression, Reformat, Sort, Join, Rollup, Dedup  Database Components: Input, Output and Update Table; db_config_utility  Built in Functions: Ab Initio built-in functions are those which  can manipulate strings, dates, and numbers  can access system properties  Vectors: An array of same type of elements that is repeated
  • 13. Look Up Function  Built-in function within a transform function that allows a transform component to retrieve records from a look up file  Held in main memory  Faster as searching and retrieval is key based  Not connected to other components in a graph
  • 14. Alternatives for Ab Initio  Informatica and Ascential are alternatives for Ab Initio but the main disadvantage is they are tougher to work with.
  • 15. Highlights  Every plug-in facility available from industry leaders Informatica and Ascential incorporated into Ab Initio  Fastest ETL, possible to extract 41 million rows of data from an Oracle 8i database (Geneva billing system!) in about 5.2 minutes
  • 16. Success Stories  Bank of Montreal-Moving 10 terabytes (TB) of data daily and analyzing it done using Ab Initio  Premier Inc. (www.premierinc.com health care services) successfully handled 14 TB of data using Ab Initio to achieve scalability and data quality
  • 17. End  Thank You for your time!!