Hortonworks - IBM Cognitive - The Future of Data Science

1. 1 © Hortonworks Inc. 2011–2018. All rights reserved.
Hortonworks & IBM Cognitive
The Future of Data Science
Hortonworks & IBM Better Together

2. 2 © Hortonworks Inc. 2011–2018. All rights reserved.
Hortonworks & IBM Cognitive
The future of global data management
Thiago Santiago
Solution Engineer – Latam

3. 3 © Hortonworks Inc. 2011–2018. All rights reserved.
Customer data trends and barriers to success
The Hortonworks difference
Customer examples
Agenda

4. 4 © Hortonworks Inc. 2011–2018. All rights reserved.
• Connected Customers,
Vehicles, Devices
• Socially crowd-sourced
requirements
• Digital design and
analysis
• Digital prototypes and
tests (simulations)
• Connected Factories,
Sensors, Devices
• Human-robotic
interaction
• 3D-printing on demand
• Connected Trucks,
Inventory
• Location, traffic,
weather-aware
distribution
• Real-time inventory
visibility
• Dynamic rerouting
• Connected Customers,
Devices
• Omni- channel demand
sensing
• Real-Time
Recommendations
• Connected Assets
• Remote service
monitoring & delivery
• Predictive maintenance
• OTA Updates
Development Manufacturing Distribution Marketing/Sales Service
The New Way of Business Is Fueled By Connected Data

5. 5 © Hortonworks Inc. 2011–2018. All rights reserved.
Technology Trends: Shifting the Data Paradigm
Artificial IntelligenceInternet of Things Cloud Computing Streaming Data
Industrial Internet
Connected Business
Consumer Devices
Smart Devices
Autonomy
Prescriptive Analytics
SaaS/PaaS Applications
Ephemeral Use Cases
Operational Efficiency
Collaboration
Real-time Applications
Targeted Retail
Recommendations
Industrial Applications

6. 6 © Hortonworks Inc. 2011–2018. All rights reserved.
Do These Problems Sound Familiar?
Data Analytics
Governance
- Don’t have the right data
- Data resides in silos
- High volumes of data
- Lack of unstructured data
- Difficult to access
- Data is hard to find and access
- Self-Service is limited
- No centrally managed security system
Data source not trusted -
Impossible to audit or track data lineage -
Lack of skills and tools -
Departmental silos -
Need for “fail fast” strategy -
Technology has limitations -

7. 7 © Hortonworks Inc. 2011–2018. All rights reserved.
The Hortonworks difference
Customer data trends and barriers to success
Customer examples
Agenda

8. 8 © Hortonworks Inc. 2011–2018. All rights reserved.
Powering the Modern Data Architecture
DATA AT RESTDATA IN MOTION
ACTIONABLE
INTELLIGENCE
COMPLETE DATA
LIFECYCLE
MANAGEMENT
RUN CONTAINERIZED
APPLICATIONS
CONCURRENTLY
EDGECLOUD
H O L I S T I C M A N A G E M E N T, G OV E R N A N C E A N D S E C U R I T Y
ON-PREMISES
MULTI-WORKLOADS MULTI-TYPE MULTI-TIER
Data Science SQL Query Engine

9. 9 © Hortonworks Inc. 2011–2018. All rights reserved.9 © Hortonworks Inc. 2011–2018. All rights reserved.
Client
Use CasesLegacy Cluster
Lambda Architecture in Hortonworks
Tooling Data Science, Machine
Learning
Model Pré-
processing
Analytics, BI, Ad-hoc
Exploration
Data
Exploration
Complex
Event
Processing
Kafka SAM
Analytics, BI, Ad-hoc
Exploration
Visualization
& Reporting
All Data
HDFS
Tooling
Hive
Bach Views
Tooling
SuperSet
Real Time Views
Custom Applications
Dashboards
BatchLayerSpeedLayerServingLayer
Ingest
Atlas/Ranger
Model
Building
R
Spark
Druid
Marketing
Others
Customer Sentiment & Churn
Use Case
Zeppelin
Network Optimization Journey
Real-time Marketing &
Advertising
Relational Bases
Social Networks
WebSites
Mobile Apps
CDR - Network
OOT
Adwords/adserver
Beacon
TWW/Smart Focus
…
CRM

10. 10 © Hortonworks Inc. 2011–2018. All rights reserved.10 © Hortonworks Inc. 2011–2018. All rights reserved.
Clients
ApplicationsLegacy On Premises
Lambda Architecture in Hortonworks complementing IBM investments
Tooling Data Science, Machine
Learning
Model Pré-
processing
Analytics, BI, Ad-hoc
Exploration
Data
Exploration
Complex
Event
Processing
Kafka SAM
Analytics, BI, Ad-hoc
Exploration
Visualization
& Reporting
All Data
HDFS
Tooling
Hive
Bach Views
Tooling
SuperSet
Real Time Views
Custom Applications
Dashboards
BatchLayerSpeedLayerServingLayer
Ingest
Atlas/Ranger
Model
Building
IBM DB2
Big SQL
Druid
Marketing
Zeppelin
Relational Bases
Social Networks
WebSites
Mobile Apps
CDR - Network
OOT
Adwords/adserver
Beacon
TWW/Smart Focus
CRM
…
IBM Spectrum
Scale
…
…
IBM Stream
Computing

11. 11 © Hortonworks Inc. 2011–2018. All rights reserved.11 © Hortonworks Inc. 2011–2018. All rights reserved.
Global Data Management EnablesModern Data Architecture
© Hortonworks, Inc. 2011-2018. All rights reserved. | Hortonworks confidential and proprietary information.
DATASOURCES
DATA CENTER CLOUD EDGE
Exception
Monitoring
Telemetry –
Connected
Devices
Legacy/
Operational
Data
Cyber
Security
Telemetry –
Connected
Devices
Time Series
Sensors,
Control
Systems
Time Series
Sensors,
Control
Systems
Exception
Monitoring
Cyber
Security
Legacy/
Operational
Data

12. 12 © Hortonworks Inc. 2011–2018. All rights reserved.12 © Hortonworks Inc. 2011–2018. All rights reserved.
Global Data Management
© Hortonworks, Inc. 2011-2018. All rights reserved. | Hortonworks confidential and proprietary information.
DATASOURCES
DATA CENTER CLOUD EDGE
Exception
Monitoring
Legacy/
Operational
Data
Cyber
Security
Telemetry –
Connected
Devices
Time Series
Sensors,
Control
Systems

13. 13 © Hortonworks Inc. 2011–2018. All rights reserved.
Hortonworks DataPlane Service and IBM
Extensible DataPlane Services
Leverage core capabilities to extend value
across multiple data sources and asset types
⬢ IBM Data Science Experience
⬢ IBM DB2 BigSQL
⬢ IBM Information Governance Catalog
⬢ IBM BigQuality
⬢ IBM BigIntegrate

14. 14 © Hortonworks Inc. 2011–2018. All rights reserved.
Why Customers Choose Hortonworks
Global Data Management
• Hybrid
• Multi-cloud
• End-to-end security and governance
100% Open Source –
“We are the Linux of Big Data”
• Innovation
• Interoperability
• No vendor lock-in
• Rapid community innovation
Proven Business Model:
• 1,300 enterprise customers
• First to IPO
• Fastest to $100M
• First to profitability
Most Comprehensive Platform
• Data at Rest and Data in Motion
• Any style of workload
• Centralized management, security,
governance

15. 15 © Hortonworks Inc. 2011–2018. All rights reserved.
Why Do Customers Migrate to Hortonworks?
Open source model aligned to
customer success with no vendor
lock-in
Cost advantage
Strong references from customers
Best practices captured from 1,300
customer engagements
Dozens of successful large-scale
migrations to HDP
Latest and greatest Hadoop stack

16. 16 © Hortonworks Inc. 2011–2018. All rights reserved.16 © Hortonworks Inc. 2011–2018. All rights reserved.
A Continuous Track Record
of Leading Innovation
DATA-AT-REST
HADOOP 1.0
100% Open
YARN HADOOP 2.0
Enable multiple
workloads
DATA-IN-MOTION
HDP & HDF
Out to the edge
CONNECT DATA
PLATFORMS
Cloud/On-Prem
Performance and
cost control
Hortonworks 3.0
HDP IPO
Dec 2014
First OSS IPO
in 10 years
Innovation
Hortonworks 1.0
Hadoop as an
enterprise
viable data platform
Time
Fastest Company
to $100M in Revenue
August 2015
Hortonworks 2.0
Bring this to the edge
with connected
platforms
Ecosystem consolidation
IBM
First to Cash Flow
Breakeven
2011 2013 2015
2016
2017
2018
First to Multi-Cloud
DataPlane Service

17. 17 © Hortonworks Inc. 2011–2018. All rights reserved.17 © Hortonworks Inc. 2011–2018. All rights reserved.
• Forrester names Hortonworks
as a leader in the Big Data
Warehouse space
• On-par with the likes of Oracle,
SAP, IBM
• Outpacing our competition like
MapR
Source: The Forrester Wave: Big Data Warehouse, Q2 2017
Analysts Validate Our Approach

18. 18 © Hortonworks Inc. 2011–2018. All rights reserved.18 © Hortonworks Inc. 2011–2018. All rights reserved.
Hortonworks Customer Growth
23 39 54
95
143
196
233
332
437
556
708
1,000
1,300
Q4 2017

19. 19 © Hortonworks Inc. 2011–2018. All rights reserved.
Customer examples
The Hortonworks difference
Customer data trends and barriers to success
Agenda

20. 20 © Hortonworks Inc. 2011–2018. All rights reserved.
Merck’s Journey—Manufacturing
Scientific
Search
Sensor Data
Storage
Vaccine Yield
Optimization
Innovate
Renovate
The Journey to
the Golden Batch
Combined 10 years data amounted to
1 billion records
5.5 million batch comparisons
1st year yield boost of 40K more doses
à $10M profit impact
McKinsey: 50% yield improvement
Epidemiology
DATA
D I S COV E RY
A C T I V E
A R C H I V E
D A T A
D I S C O V E R Y
D A T A
D I S C O V E R Y
DESTINATION
The Golden
Batch

21. 21 © Hortonworks Inc. 2011–2018. All rights reserved.
PREDICTIVE
ANALYTICS
JPMC’s Journey
Wealth
Mgmt.
Data
Mining
Credit
& Risk
Customer
Activity
Capital
Markets
Trading Floor,
CyberSecurity,
Activity Monitoring
Micro-
persona
Marketing
Customer
Value
EDW
Offload
Fraud
Detection
Credit
Score
Better Insights
Through Analytics
Optimized EDW provides
shortened time to higher quality
data
Value to Consumer (Credit
Accuracy & Reporting) leads to
business growth
Multi-tenant user community,
data resources are shared across
many LOBs; less data duplication
provides deeper insights and
leads to significant cost savings
Innovate
Renovate
Business Agility
D A T A
D I S C O V E R Y
S I N G L E
V I E W
D A T A
D I S C O V E R Y
S I N G L E
V I E W
A C T I V E
A R C H I V E
A C T I V E
A R C H I V E
A C T I V E
A R C H I V E
D A T A
E N R I C H M E N T
E T L
O N B O A R D
P R E D I C T I V E
A N A L Y T I C S

22. 22 © Hortonworks Inc. 2011–2018. All rights reserved.
Industries Investing in Data Science
Improve patient care and accuracy
of diagnosis, ensure regulatory
compliance and auditability.
HEALTH CARE MANUFACTURING
Predictive maintenance, reduce
processing flaws, improve production
quality, and increase efficiencies
Increase customer loyalty and
advocacy by measuring and
improving customer experience.
TELECOMMUNICATIONS
FINANCIAL SERVICES
Gain insights to reveal trading and client
behavior, cultivate trust, and manage
regulatory compliance
RETAIL
Personalize the customer experience,
optimize merchandising,
supply chain, and staffing.
Improve customer retention, reduce
financial crimes, and prevent fraud
BANKING

23. 23 © Hortonworks Inc. 2011–2018. All rights reserved.
Actionable Intelligence Powers Today’s Financial Services
OFAC
Lists
Credit
Records
ATM
Streams Transactions &
Wires
Stock
Tickers
Trade
Settlements
DIGITAL
CUSTOMER 360
RISK DATA
AGGREGATION
ANTI-MONEY
LAUNDERING
FRAUD
DETECTION
TRADE
SURVEILLANCE
Mobile App
Data
Trade
Data
Web
Logs
Banker
Notes
Demographic
Data
Customer
Transaction
Data

24. 24 © Hortonworks Inc. 2011–2018. All rights reserved.
Actionable Intelligence Drives Retail Sales Growth
Product
Catalogs
Sales
Forecasts
Beacons &
RFID Server
Logs
In-Store
WiFi Logs
Store
Communications
SINGLE VIEW OF
THE CUSTOMER
PRODUCT
RECOMMENDATIONS
INVENTORY &
SUPPLY CHAIN
PRICING
OPTIMIZATION
TARGETED
PROMOTIONS
Clickstream
ERP
Data
Social
Media
Staffing
Plans
Store
Reporting
CRM
Records

25. 25 © Hortonworks Inc. 2011–2018. All rights reserved.
Actionable Intelligence Makes Healthcare Precise and Personal
Patient
Records
Lab Data
Pharmacy
Data
Patient
Locations
Wearables
Intra-Network
Data
Sensor
Data
Claims
Data
Social
Media Physician
Notes
Patient
Satisfaction Data
Clinical
(EMR) Data
SINGLE VIEW OF
PATIENT
REAL-TIME VITAL
SIGN MONITORING
BILLING &
REIMBURSEMENTS
EMR
OPTIMIZATION
SUPPLY CHAIN
OPTIMIZATION

26. 26 © Hortonworks Inc. 2011–2018. All rights reserved.
Actionable Intelligence Makes Pharmaceuticals Safe & Effective
Research
Cohort Data
Molecular
Data
RFID Data
Social Media
Biometrics
Sensor
Data
DRUG TRIAL
COHORT SELECTION
YIELD
OPTIMIZATION
RAW MATERIAL
WASTE REDUCTION
SEARCHABLE
RESEARCH REPOS
NEXT-GEN
SEQUENCING (NGS)
Supply Chain
Geo-location Data
Scientific
Studies
Manufacturing
Machine Data
Clinical
Records
Sales
Reports
Genomic
Data

27. 27 © Hortonworks Inc. 2011–2018. All rights reserved.
Actionable Intelligence Powers Modern Manufacturing
Defect Testing
Data
Product
Designs
MES
Systems
RFID
Streams
SCADA
Systems
Shop Floor
Sensors
PREVENTATIVE
MAINTENANCE
SUPPLY CHAIN
OPTIMIZATION
YIELD
MAXIMIZATION
QUALITY
CONTROL
RECALL
AVOIDANCE
ERP
Systems
Supplier
Receipts
Machine
Data
Assembly
Line Sensors
Data
Historians
Work
Orders

28. 28 © Hortonworks Inc. 2011–2018. All rights reserved.
Actionable Intelligence Enhances Public Sector Efficiency
Historical
Archives
Cyber Threat
Metadata
Vehicle
Telemetry Data
Disease
Outbreaks
Natural
Disasters
PUBLIC
TRANSPORTATION
INFRASTUCTURE
MAINTENANCE
PUBLIC
HEALTH
NATIONAL
DEFENSE
HOMELAND
SECURITY
Social
MediaWork
Orders
Meeting
Notes
Voter Rolls
Public Benefits
Claims
Financial
Audits
Extreme
Weather Alerts

29. 29 © Hortonworks Inc. 2011–2018. All rights reserved.
Connected Data Drives Success in Telecommunications
Call Detail
Records
Product
Catalogs
Cyber Threat
Metadata
Sensor
Data
Server
Logs
Voice-to-Text
SINGLE VIEW OF
THE CUSTOMER
CHURN
REDUCTION
CDR
ANALYSIS
NETWORK
OPTIMIZATION
DYNAMIC BANDWIDTH
ALLOCATION
Clickstream
ERP System
Data
Social
Media Billing
Data
Subscriber
Profiles
CRM
Records

30. 30 © Hortonworks Inc. 2011–2018. All rights reserved.
Where Are You on the Data Evolution Journey?

31. 31 © Hortonworks Inc. 2011–2018. All rights reserved.
Thank you