SlideShare a Scribd company logo
1 of 13
INTERNAL USE ONLY
Using a Data Lake at the core of a Life Assurance business
Hadoop World Summit
April 13th 2016
Rajdeep Mukherjee & Chris Murphy
INTERNAL USE ONLY
 Zurich is a global insurance company founded in
1872 ,Head Quartered in Zurich Switzerland.
 Zurich business is organized into three core business
segments: General Insurance, Global Life and
Farmers.
 Zurich’s customers include
– Individuals.
– small businesses.
– mid-sized and large companies, including
multinational corporations.
in more than 170 countries.
Zurich Insurance – Introduction
2
INTERNAL USE ONLY
Insurance Industry – Key trends
 The key trends impacting the business
– Digital Trends : Consumers are looking for simplicity ,
transparency and speed in their transaction with business .
Relentless march of online and mobile technologies is continuing to
fuel this change . A Digital transformation needs easy and quick
access to data as a foundation.
– Technological : IOT and sensors presenting new opportunities and
challenges at the same time and advent of Big data techs is
allowing companies to process unstructured data to gain insights in
conjunction with the structured data.
– Risks: Emerging risks due to new technology ,human interaction ,
habits needs advanced analytical models to predict losses.
– Regulatory : The effect of global regulations such as SOX , GLB
and solvency II are driving insurers to ramp up Enterprise data
management
3
Insurance
Digital
Trends
Analytics
Emerging
Risks
Regulations
INTERNAL USE ONLY
State of Data Management
 Fragmented Landscape.
 Rigid data design fails to Incorporate local business requirements
 Very long Change cycles.
4
O
P
E
R
A
T
I
O
N
S
o
P
E
R
A
T
I
O
N
L
O
B
A
d
h
o
c
C
or
p
or
at
e
CRM Policy
Mgmt
Claim
Mgmt
ERP
ODS LoB Marts Spread sheets EDW
External Data
Business Users
INTERNAL USE ONLY
What Capabilities are required to Keep up with the Trends
 Capability to store all data(Internal, External , Structured , Unstructured ) at Low cost.
 Capability to curate and expose Business Views on Demand.
 Data Fabric to support different workloads (Operational and Analytical).
 Support Rapid Change cycles.
 Enable metadata management and data Lineage.
 Govern where required don’t govern everything.
 Scaling up should be a low cost effort.
 Enable business Friendly tooling
“Make App , Analytics and Data a seamless process “
5
Speed
App
AnalyticsData
INTERNAL USE ONLY
Zurich Data Lake – Conceptual Architecture
6
CRM Policy
Mgmt
Claim
Mgmt
ERP
Life GC UK-GI BU
Customer
Policy
Claim
Customer
Policy
Claim
Customer
Policy
Claim
Customer
Policy
Claim
Customer Policy Claim
Raw Store
Everything
with History
Enterprise
Provisioning
Curation
Layer
LoB Views
Curation
Group Level
Views
Consumption Real-time Interactive Batch
Flattening
Labelling
Data Sources
INTERNAL USE ONLY
Zurich Data Lake - Technical Architecture
7
Batch
Ingestion
Micro
Batch
Real Time
Ingestion
Frameworks
Adapters
Ingest Persist ,Process, Provision Curate
RAW Layer
Enterprise Provision
layer
LoB
Views
Corporate
Views
Security Mgmt
Metadata Mgmt
Operations Mgmt
Consume
API
Interactive
SQL
Batch SQL
S
O
U
R
C
E
Kerberos
AD
IBM
Ambari
RANGER
Hcatalogue
INTERNAL USE ONLY
Putting the Customer First
8
INTERNAL USE ONLY
Getting to our data
Legacy technology landscape
9
INTERNAL USE ONLY
Customer Matching
Guess Who
10
INTERNAL USE ONLY
Tapping the Data lake
In the Pipeline
11
INTERNAL USE ONLY
Learnings
12
INTERNAL USE ONLY
Any Questions?
13

More Related Content

What's hot

Accelerate Digital Transformation with Data Virtualization in Banking, Financ...
Accelerate Digital Transformation with Data Virtualization in Banking, Financ...Accelerate Digital Transformation with Data Virtualization in Banking, Financ...
Accelerate Digital Transformation with Data Virtualization in Banking, Financ...
Denodo
 
Defining a Digitalization Reference Architecture for the Pharma Industry
Defining a Digitalization Reference Architecture for the Pharma IndustryDefining a Digitalization Reference Architecture for the Pharma Industry
Defining a Digitalization Reference Architecture for the Pharma Industry
Capgemini
 
CWIN17 san francisco-kiran murthy-cloud native - sf v4
CWIN17 san francisco-kiran murthy-cloud native - sf v4CWIN17 san francisco-kiran murthy-cloud native - sf v4
CWIN17 san francisco-kiran murthy-cloud native - sf v4
Capgemini
 

What's hot (20)

Big Data LDN 2017: Creating ROI from Big Data Investments - Monetizing your B...
Big Data LDN 2017: Creating ROI from Big Data Investments - Monetizing your B...Big Data LDN 2017: Creating ROI from Big Data Investments - Monetizing your B...
Big Data LDN 2017: Creating ROI from Big Data Investments - Monetizing your B...
 
Creating a Healthcare Data Fabric, and Providing a Single, Unified, and Curat...
Creating a Healthcare Data Fabric, and Providing a Single, Unified, and Curat...Creating a Healthcare Data Fabric, and Providing a Single, Unified, and Curat...
Creating a Healthcare Data Fabric, and Providing a Single, Unified, and Curat...
 
A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)
 
Introduction to Modern Data Virtualization 2021 (APAC)
Introduction to Modern Data Virtualization 2021 (APAC)Introduction to Modern Data Virtualization 2021 (APAC)
Introduction to Modern Data Virtualization 2021 (APAC)
 
Accelerate Digital Transformation with Data Virtualization in Banking, Financ...
Accelerate Digital Transformation with Data Virtualization in Banking, Financ...Accelerate Digital Transformation with Data Virtualization in Banking, Financ...
Accelerate Digital Transformation with Data Virtualization in Banking, Financ...
 
Dell hans timmerman v1.1
Dell hans timmerman v1.1Dell hans timmerman v1.1
Dell hans timmerman v1.1
 
A Successful Data Strategy for Insurers in Volatile Times (EMEA)
A Successful Data Strategy for Insurers in Volatile Times (EMEA)A Successful Data Strategy for Insurers in Volatile Times (EMEA)
A Successful Data Strategy for Insurers in Volatile Times (EMEA)
 
Advanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data VirtualizationAdvanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data Virtualization
 
Terminology guide for digital health in 2021
Terminology guide for digital health in 2021Terminology guide for digital health in 2021
Terminology guide for digital health in 2021
 
Denodo DataFest 2016: The Governed Data Lake – Putting Big Data to Work
Denodo DataFest 2016: The Governed Data Lake – Putting Big Data to WorkDenodo DataFest 2016: The Governed Data Lake – Putting Big Data to Work
Denodo DataFest 2016: The Governed Data Lake – Putting Big Data to Work
 
Denodo DataFest 2016: Data Science: Operationalizing Analytical Models in Rea...
Denodo DataFest 2016: Data Science: Operationalizing Analytical Models in Rea...Denodo DataFest 2016: Data Science: Operationalizing Analytical Models in Rea...
Denodo DataFest 2016: Data Science: Operationalizing Analytical Models in Rea...
 
Denodo DataFest 2016: Metadata and Data: Search and Exploration
Denodo DataFest 2016: Metadata and Data: Search and ExplorationDenodo DataFest 2016: Metadata and Data: Search and Exploration
Denodo DataFest 2016: Metadata and Data: Search and Exploration
 
Defining a Digitalization Reference Architecture for the Pharma Industry
Defining a Digitalization Reference Architecture for the Pharma IndustryDefining a Digitalization Reference Architecture for the Pharma Industry
Defining a Digitalization Reference Architecture for the Pharma Industry
 
CWIN17 san francisco-kiran murthy-cloud native - sf v4
CWIN17 san francisco-kiran murthy-cloud native - sf v4CWIN17 san francisco-kiran murthy-cloud native - sf v4
CWIN17 san francisco-kiran murthy-cloud native - sf v4
 
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)
 
Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...
Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...
Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...
 
Data may be the new gold. Can we say the same about data centres?
Data may be the new gold. Can we say the same about data centres?Data may be the new gold. Can we say the same about data centres?
Data may be the new gold. Can we say the same about data centres?
 
The Proof is in the Pudding
The Proof is in the PuddingThe Proof is in the Pudding
The Proof is in the Pudding
 
Data Virtualization for Compliance – Creating a Controlled Data Environment
Data Virtualization for Compliance – Creating a Controlled Data EnvironmentData Virtualization for Compliance – Creating a Controlled Data Environment
Data Virtualization for Compliance – Creating a Controlled Data Environment
 
Crowdsourcing Data Governance
Crowdsourcing Data GovernanceCrowdsourcing Data Governance
Crowdsourcing Data Governance
 

Viewers also liked

February 2016 HUG: Apache Kudu (incubating): New Apache Hadoop Storage for Fa...
February 2016 HUG: Apache Kudu (incubating): New Apache Hadoop Storage for Fa...February 2016 HUG: Apache Kudu (incubating): New Apache Hadoop Storage for Fa...
February 2016 HUG: Apache Kudu (incubating): New Apache Hadoop Storage for Fa...
Yahoo Developer Network
 
Acting presentation about Zurich insurance use only in class
Acting presentation about Zurich insurance use only in classActing presentation about Zurich insurance use only in class
Acting presentation about Zurich insurance use only in class
Kageri Rajid
 
GRUTER가 들려주는 Big Data Platform 구축 전략과 적용 사례: 인터넷 쇼핑몰의 실시간 분석 플랫폼 구축 사례
GRUTER가 들려주는 Big Data Platform 구축 전략과 적용 사례: 인터넷 쇼핑몰의 실시간 분석 플랫폼 구축 사례GRUTER가 들려주는 Big Data Platform 구축 전략과 적용 사례: 인터넷 쇼핑몰의 실시간 분석 플랫폼 구축 사례
GRUTER가 들려주는 Big Data Platform 구축 전략과 적용 사례: 인터넷 쇼핑몰의 실시간 분석 플랫폼 구축 사례
Gruter
 

Viewers also liked (20)

Rocking the World of Big Data at Centrica
Rocking the World of Big Data at CentricaRocking the World of Big Data at Centrica
Rocking the World of Big Data at Centrica
 
Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...
Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...
Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...
 
The Heterogeneous Data lake
The Heterogeneous Data lakeThe Heterogeneous Data lake
The Heterogeneous Data lake
 
NLP Structured Data Investigation on Non-Text
NLP Structured Data Investigation on Non-TextNLP Structured Data Investigation on Non-Text
NLP Structured Data Investigation on Non-Text
 
Securing Hadoop in an Enterprise Context
Securing Hadoop in an Enterprise ContextSecuring Hadoop in an Enterprise Context
Securing Hadoop in an Enterprise Context
 
Hadoop in the Cloud: Real World Lessons from Enterprise Customers
Hadoop in the Cloud: Real World Lessons from Enterprise CustomersHadoop in the Cloud: Real World Lessons from Enterprise Customers
Hadoop in the Cloud: Real World Lessons from Enterprise Customers
 
Smart data for a predictive bank
Smart data for a predictive bankSmart data for a predictive bank
Smart data for a predictive bank
 
HHS: Opening Data, Influencing Innovation - Damon Davis
HHS: Opening Data, Influencing Innovation - Damon DavisHHS: Opening Data, Influencing Innovation - Damon Davis
HHS: Opening Data, Influencing Innovation - Damon Davis
 
Open Data Fueling Innovation - Kristen Honey
Open Data Fueling Innovation - Kristen HoneyOpen Data Fueling Innovation - Kristen Honey
Open Data Fueling Innovation - Kristen Honey
 
Hadoop World 2011: Mike Olson Keynote Presentation
Hadoop World 2011: Mike Olson Keynote PresentationHadoop World 2011: Mike Olson Keynote Presentation
Hadoop World 2011: Mike Olson Keynote Presentation
 
Intro to Apache Kudu (short) - Big Data Application Meetup
Intro to Apache Kudu (short) - Big Data Application MeetupIntro to Apache Kudu (short) - Big Data Application Meetup
Intro to Apache Kudu (short) - Big Data Application Meetup
 
LinkedIn
LinkedInLinkedIn
LinkedIn
 
Life insurance basic concepts (United Kingdom)
Life insurance basic concepts (United Kingdom)Life insurance basic concepts (United Kingdom)
Life insurance basic concepts (United Kingdom)
 
Advanced Sqoop
Advanced Sqoop Advanced Sqoop
Advanced Sqoop
 
February 2016 HUG: Apache Kudu (incubating): New Apache Hadoop Storage for Fa...
February 2016 HUG: Apache Kudu (incubating): New Apache Hadoop Storage for Fa...February 2016 HUG: Apache Kudu (incubating): New Apache Hadoop Storage for Fa...
February 2016 HUG: Apache Kudu (incubating): New Apache Hadoop Storage for Fa...
 
Acting presentation about Zurich insurance use only in class
Acting presentation about Zurich insurance use only in classActing presentation about Zurich insurance use only in class
Acting presentation about Zurich insurance use only in class
 
GRUTER가 들려주는 Big Data Platform 구축 전략과 적용 사례: 인터넷 쇼핑몰의 실시간 분석 플랫폼 구축 사례
GRUTER가 들려주는 Big Data Platform 구축 전략과 적용 사례: 인터넷 쇼핑몰의 실시간 분석 플랫폼 구축 사례GRUTER가 들려주는 Big Data Platform 구축 전략과 적용 사례: 인터넷 쇼핑몰의 실시간 분석 플랫폼 구축 사례
GRUTER가 들려주는 Big Data Platform 구축 전략과 적용 사례: 인터넷 쇼핑몰의 실시간 분석 플랫폼 구축 사례
 
Life insurance ppt
Life insurance pptLife insurance ppt
Life insurance ppt
 
Data Process Systems, connecting everything
Data Process Systems, connecting everythingData Process Systems, connecting everything
Data Process Systems, connecting everything
 
The Future of Apache Storm
The Future of Apache StormThe Future of Apache Storm
The Future of Apache Storm
 

Similar to Using a Data Lake at the core of a Life Assurance business

BigData_WhitePaper
BigData_WhitePaperBigData_WhitePaper
BigData_WhitePaper
Reem Matloub
 
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docx
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docxProject 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docx
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docx
stilliegeorgiana
 

Similar to Using a Data Lake at the core of a Life Assurance business (20)

How Insurers Can Tame Data to Drive Innovation
How Insurers Can Tame Data to Drive InnovationHow Insurers Can Tame Data to Drive Innovation
How Insurers Can Tame Data to Drive Innovation
 
D2 d turning information into a competive asset - 23 jan 2014
D2 d   turning information into a competive asset - 23 jan 2014D2 d   turning information into a competive asset - 23 jan 2014
D2 d turning information into a competive asset - 23 jan 2014
 
The top trends changing the landscape of Information Management
The top trends changing the landscape of Information ManagementThe top trends changing the landscape of Information Management
The top trends changing the landscape of Information Management
 
The value of our data
The value of our dataThe value of our data
The value of our data
 
Modernizing Insurance Data to Drive Intelligent Decisions
Modernizing Insurance Data to Drive Intelligent DecisionsModernizing Insurance Data to Drive Intelligent Decisions
Modernizing Insurance Data to Drive Intelligent Decisions
 
Big data – A Review
Big data – A ReviewBig data – A Review
Big data – A Review
 
Acumen insurance Data Warehouse
Acumen insurance Data WarehouseAcumen insurance Data Warehouse
Acumen insurance Data Warehouse
 
IMPACT OF BIG DATA ON BUSINESS DECISIONS THROUGH THE VIEW OF DATASCIENCE-BASE...
IMPACT OF BIG DATA ON BUSINESS DECISIONS THROUGH THE VIEW OF DATASCIENCE-BASE...IMPACT OF BIG DATA ON BUSINESS DECISIONS THROUGH THE VIEW OF DATASCIENCE-BASE...
IMPACT OF BIG DATA ON BUSINESS DECISIONS THROUGH THE VIEW OF DATASCIENCE-BASE...
 
Big Data: Opportunities, Strategy and Challenges
Big Data: Opportunities, Strategy and ChallengesBig Data: Opportunities, Strategy and Challenges
Big Data: Opportunities, Strategy and Challenges
 
Big data Readiness white paper
Big data  Readiness white paperBig data  Readiness white paper
Big data Readiness white paper
 
BigData_WhitePaper
BigData_WhitePaperBigData_WhitePaper
BigData_WhitePaper
 
IABE Big Data information paper - An actuarial perspective
IABE Big Data information paper - An actuarial perspectiveIABE Big Data information paper - An actuarial perspective
IABE Big Data information paper - An actuarial perspective
 
SFScon19 - Giuliana Viviano - Big Data e Data Analytics
SFScon19 - Giuliana Viviano - Big Data e Data AnalyticsSFScon19 - Giuliana Viviano - Big Data e Data Analytics
SFScon19 - Giuliana Viviano - Big Data e Data Analytics
 
Addressing Storage Challenges to Support Business Analytics and Big Data Work...
Addressing Storage Challenges to Support Business Analytics and Big Data Work...Addressing Storage Challenges to Support Business Analytics and Big Data Work...
Addressing Storage Challenges to Support Business Analytics and Big Data Work...
 
Unlocking Value of Data in a Digital Age
Unlocking Value of Data in a Digital AgeUnlocking Value of Data in a Digital Age
Unlocking Value of Data in a Digital Age
 
Business intelligence and big data
Business intelligence and big dataBusiness intelligence and big data
Business intelligence and big data
 
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docx
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docxProject 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docx
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docx
 
What is big data ? | Big Data Applications
What is big data ? | Big Data ApplicationsWhat is big data ? | Big Data Applications
What is big data ? | Big Data Applications
 
Big Data LDN 2017: Applied AI for GDPR
Big Data LDN 2017: Applied AI for GDPRBig Data LDN 2017: Applied AI for GDPR
Big Data LDN 2017: Applied AI for GDPR
 
Thriving in the world of Big Data
Thriving in the world of Big DataThriving in the world of Big Data
Thriving in the world of Big Data
 

More from DataWorks Summit/Hadoop Summit

How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient
DataWorks Summit/Hadoop Summit
 
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS HadoopBreaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
DataWorks Summit/Hadoop Summit
 

More from DataWorks Summit/Hadoop Summit (20)

Running Apache Spark & Apache Zeppelin in Production
Running Apache Spark & Apache Zeppelin in ProductionRunning Apache Spark & Apache Zeppelin in Production
Running Apache Spark & Apache Zeppelin in Production
 
State of Security: Apache Spark & Apache Zeppelin
State of Security: Apache Spark & Apache ZeppelinState of Security: Apache Spark & Apache Zeppelin
State of Security: Apache Spark & Apache Zeppelin
 
Unleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache RangerUnleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache Ranger
 
Enabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science PlatformEnabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science Platform
 
Revolutionize Text Mining with Spark and Zeppelin
Revolutionize Text Mining with Spark and ZeppelinRevolutionize Text Mining with Spark and Zeppelin
Revolutionize Text Mining with Spark and Zeppelin
 
Double Your Hadoop Performance with Hortonworks SmartSense
Double Your Hadoop Performance with Hortonworks SmartSenseDouble Your Hadoop Performance with Hortonworks SmartSense
Double Your Hadoop Performance with Hortonworks SmartSense
 
Hadoop Crash Course
Hadoop Crash CourseHadoop Crash Course
Hadoop Crash Course
 
Data Science Crash Course
Data Science Crash CourseData Science Crash Course
Data Science Crash Course
 
Apache Spark Crash Course
Apache Spark Crash CourseApache Spark Crash Course
Apache Spark Crash Course
 
Dataflow with Apache NiFi
Dataflow with Apache NiFiDataflow with Apache NiFi
Dataflow with Apache NiFi
 
Schema Registry - Set you Data Free
Schema Registry - Set you Data FreeSchema Registry - Set you Data Free
Schema Registry - Set you Data Free
 
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
 
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
 
Mool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and MLMool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and ML
 
How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient
 
HBase in Practice
HBase in Practice HBase in Practice
HBase in Practice
 
The Challenge of Driving Business Value from the Analytics of Things (AOT)
The Challenge of Driving Business Value from the Analytics of Things (AOT)The Challenge of Driving Business Value from the Analytics of Things (AOT)
The Challenge of Driving Business Value from the Analytics of Things (AOT)
 
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS HadoopBreaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
 
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
 
Backup and Disaster Recovery in Hadoop
Backup and Disaster Recovery in Hadoop Backup and Disaster Recovery in Hadoop
Backup and Disaster Recovery in Hadoop
 

Recently uploaded

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Recently uploaded (20)

Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 

Using a Data Lake at the core of a Life Assurance business

  • 1. INTERNAL USE ONLY Using a Data Lake at the core of a Life Assurance business Hadoop World Summit April 13th 2016 Rajdeep Mukherjee & Chris Murphy
  • 2. INTERNAL USE ONLY  Zurich is a global insurance company founded in 1872 ,Head Quartered in Zurich Switzerland.  Zurich business is organized into three core business segments: General Insurance, Global Life and Farmers.  Zurich’s customers include – Individuals. – small businesses. – mid-sized and large companies, including multinational corporations. in more than 170 countries. Zurich Insurance – Introduction 2
  • 3. INTERNAL USE ONLY Insurance Industry – Key trends  The key trends impacting the business – Digital Trends : Consumers are looking for simplicity , transparency and speed in their transaction with business . Relentless march of online and mobile technologies is continuing to fuel this change . A Digital transformation needs easy and quick access to data as a foundation. – Technological : IOT and sensors presenting new opportunities and challenges at the same time and advent of Big data techs is allowing companies to process unstructured data to gain insights in conjunction with the structured data. – Risks: Emerging risks due to new technology ,human interaction , habits needs advanced analytical models to predict losses. – Regulatory : The effect of global regulations such as SOX , GLB and solvency II are driving insurers to ramp up Enterprise data management 3 Insurance Digital Trends Analytics Emerging Risks Regulations
  • 4. INTERNAL USE ONLY State of Data Management  Fragmented Landscape.  Rigid data design fails to Incorporate local business requirements  Very long Change cycles. 4 O P E R A T I O N S o P E R A T I O N L O B A d h o c C or p or at e CRM Policy Mgmt Claim Mgmt ERP ODS LoB Marts Spread sheets EDW External Data Business Users
  • 5. INTERNAL USE ONLY What Capabilities are required to Keep up with the Trends  Capability to store all data(Internal, External , Structured , Unstructured ) at Low cost.  Capability to curate and expose Business Views on Demand.  Data Fabric to support different workloads (Operational and Analytical).  Support Rapid Change cycles.  Enable metadata management and data Lineage.  Govern where required don’t govern everything.  Scaling up should be a low cost effort.  Enable business Friendly tooling “Make App , Analytics and Data a seamless process “ 5 Speed App AnalyticsData
  • 6. INTERNAL USE ONLY Zurich Data Lake – Conceptual Architecture 6 CRM Policy Mgmt Claim Mgmt ERP Life GC UK-GI BU Customer Policy Claim Customer Policy Claim Customer Policy Claim Customer Policy Claim Customer Policy Claim Raw Store Everything with History Enterprise Provisioning Curation Layer LoB Views Curation Group Level Views Consumption Real-time Interactive Batch Flattening Labelling Data Sources
  • 7. INTERNAL USE ONLY Zurich Data Lake - Technical Architecture 7 Batch Ingestion Micro Batch Real Time Ingestion Frameworks Adapters Ingest Persist ,Process, Provision Curate RAW Layer Enterprise Provision layer LoB Views Corporate Views Security Mgmt Metadata Mgmt Operations Mgmt Consume API Interactive SQL Batch SQL S O U R C E Kerberos AD IBM Ambari RANGER Hcatalogue
  • 8. INTERNAL USE ONLY Putting the Customer First 8
  • 9. INTERNAL USE ONLY Getting to our data Legacy technology landscape 9
  • 10. INTERNAL USE ONLY Customer Matching Guess Who 10
  • 11. INTERNAL USE ONLY Tapping the Data lake In the Pipeline 11
  • 13. INTERNAL USE ONLY Any Questions? 13

Editor's Notes

  1. Completely fragmented Insight EDW meets corporate goals only doesn’t include all the local details Spread sheet has fidelity problem Point to point Interfaces But the problem with such an is you try to create one schema which we think will fit all but it almost never does This gives rise to Spread sheets and more Lob Data Marts This is just with Internal Structured data !