Azure Big Data: “Got Data? Go Modern and Monetize”. In this session you will learn how to architected, developed, and build completely in the open, Hortonworks Data Platform (HDP) that provides an enterprise ready data platform to adopt a Modern Data Architecture.

1. Azure Café Marketplace
Hortonworks Data Platform
M
A
R
K
T
P
L
A
C
E
Learn how to architected, developed, and build completely in the
open, Hortonworks Data Platform (HDP).
Enterprise ready data platform to adopt a Modern Data
Architecture.
A
Z
U
R
E
C
A
F
E

2. Azure Café Marketplace Series
Explore what you can build with Microsoft Azure Marketplace Solutions.

3. Agenda
• Introductions
• Big Data Market Trends
• Hortonworks Marketplace Solutions
• Demo with Q&A
• Next Steps

6. An online store for highly optimized and integrated
applications and services ready to deploy on
Microsoft Azure
Growing ecosystem of 3,000+ apps or components
Reduced sales cycle with pre-configured, ready-to-run
apps and services
Streamlined configuration, deployment, and management
Integrated platform experience
Top scenarios include: Big data, security, networking,
DevOps & automation, business continuity & backup,
management apps
Microsoft Azure Marketplace

8. M
A
R
K
T
P
L
A
C
E
A
Z
U
R
E
C
A
F
E

9. Solving Big Data Scenarios
using Hortonworks
© Hortonworks Inc. 2011 – 2015. All Rights Reserved

10. ONLY
100open source
Apache Hadoop data platform
% Founded in 2011
HADOOP
1ST
provider to go public
IPO 4Q14 (NASDAQ: HDP)
employees across
800+
countries
technology partners
1,350
17
TM
Hortonworks Company Profile
Fastest company to reach $100 M in revenue

11. Page11 © Hortonworks Inc. 2011 – 2015. All Rights Reserved
HDP FOR DATA AT
REST
HDF FOR DATA IN
MOTION
ACTIONABLE
INTELLIGENCE
MODERN DATA APPS
Hortonworks Delivers
Two Connected Data
Platforms: HDP and HDF
PERISHABLE
INSIGHTS
HISTORICAL
INSIGHTS
INTERNET
OF
ANYTHING

12. HDP + HDF Create Modern Data Apps
Real-Time Cyber Security
protects systems with superior threat detection
Smart Manufacturing
dramatically improves yields by managing more
variables in greater detail
Connected, Autonomous Cars
drive themselves and improve road safety
Future Farming
optimizing soil, seeds and equipment to
measured conditions on each square foot
Automatic Recommendation Engines
match products to preferences in milliseconds
DATA AT
REST
HDF DATA
IN MOTION
ACTIONABLE
INTELLIGENCE
MODERN DATA APPS

13. SOURCES REGIONAL
INFRASTRUCTURE
CORE
INFRASTRUCTURE
HDF Manages Bidirectional Dataflow
Constrained
High-Latency
Localized Context
Hybrid – Cloud/On-Premise
Low-Latency
Global Context

14. Hortonworks Data Flow
Visual User Interface
Drag and drop for efficient, agile operations
Immediate Feedback
Start, stop, tune, replay dataflows in real-time
Adaptive to Volume and Bandwidth
Any data, big or small
Event Level Data Provenance
Governance, compliance & data evaluation
Secure Data Acquisition & Transport
Fine grained encryption for controlled data
sharing and selective data democratization
Powered by
Apache NiFi

15. Hortonworks Data Platform Processes Data at Rest
GOVERNANCE
Manage and audit
data according to
policy
OPERATIONS
Manage, Monitor
and Maintain
cluster operations
DATA ACCESS
YARN: Data Operating System
(Cluster Resource Management)
Batch
1 • • • • • • • • • • •
• • • • • • • • • • • •
HDFS
(Hadoop Distributed File System)
Deployment
SECURITY
Authentication,
Authorization &
Encryption for data
at rest or in motion
Interactive
Machine
Learning
Search Real Time

16. Page16 © Hortonworks Inc. 2011 – 2015. All Rights Reserved
Hortonworks Influences
the Apache Community
We Employ the Committers
--one third of all committers to the Apache®
Hadoop™ project, and a majority in Apache
NiFi and other important projects
Our Committers Innovate
and improve Connected Data Platforms
We Influence the Hadoop Roadmap
by communicating important requirements to
the community through our leaders
A P A C H E H A D O O P C O M M I T T E R S

17. HDP and HDF – Flexible Deployment Options
On-Premises Cloud
Virtualized
Your deployment of Hadoop
• VMWare
• Docker
• OpenStack
HDP on Your Hardware
• Linux or Windows
HDP on Appliance
Turnkey Hadoop Appliances
• Teradata
• Microsoft
• PSSC Labs
Infrastructure as a Service (IAAS)
• Amazon EC2
• Microsoft Azure
• Rackspace
Hadoop as a Service (HAAS)
Managed Hadoop Service
• Microsoft HDInsight

18. HDP on Azure
HDP Sandbox on
Marketplace
HDP Azure IaaS on
Marketplace
HDInsight on
Marketplace
Cloudbreak on
launch.hortonworks…
• Single node HDP
Cluster on
Marketplace
• Fully functional – all
HDP components
are preinstalled and
running
• Centos 7.1 VM
• Great for getting
started
• Multi node HDP on
Azure IaaS
• Users specify
number of nodes,
type of VM, HA/non-
HA.
• Processes HDFS
data on VHD disks
attached to VMs
• Can connect to
WASB
• Great for maximally
performing non-
elastic clusters
• Managed PaaS
offering by Microsoft
• Great for elastic
clusters -- compute
scaling independent
of storage
• Can spin up more
nodes on demand
automatically
• Processes data in
WASB (ADLS
coming soon)
• Autoscaling HDP
Clusters on Azure
• Runs HDP in Docker
containers
• Processes WASB
data
• Great for elastic
clusters – scale
compute layer
independently from
storage
• Periscope scales
clusters depending
on SLA
requirements

19. Use Cases

20. Classic Hadoop Driver: Cost optimization
Archive Data off EDW
Move rarely used data to Hadoop as active
archive, store more data longer
Onboard costly ETL process
Free your EDW to perform high-value functions
like analytics & operations, not ETL
Enrich the value of your EDW
Use Hadoop to refine new data sources, such as
web and machine data for new analytical context
ANALYTICS
Data
Marts
Business
Analytics
Visualization
& Dashboards
HDP helps you reduce costs and optimize the value associated with your EDW
ANALYTICSDATASYSTEMS
Data
Marts
Business
Analytics
Visualization
& Dashboards
HDP 2.3
ELT
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
N
Cold Data,
Deeper Archive
& New Sources
Enterprise Data
Warehouse
Hot
MPP
In-Memory
Clickstream Web
& Social
Geolocation Sensor
& Machine
Server
Logs
Unstructured
Existing Systems
ERP CRM SCM
SOURCES

21. Case Study: 12 month Hadoop evolution at TrueCar
DataPlatformCapabilities
12 months execution plan
June 2013
Begin
Hadoop
Execution
July 2013
Hortonworks
Partnership
May ‘14
IPO
Aug 2013
Training
& Dev
Begins
Nov 2013
Production
Cluster
60 Nodes
2 PB
Jan 2014
40% Dev
Staff
Perficient
Dec 2013
Three
Production
Apps
(3 total)
Feb 2014
Three More
Production
Apps
(6 total)
12 Month Results at TRUECar
• Six Production Hadoop Applications
• Sixty nodes/2PB data
• Storage Costs/Compute Costs
from $19/GB to $0.12/GB
“We addressed our data platform capabilities
strategically as a pre-cursor to IPO.”

22. Common Apache NiFi Use Cases
Predictive Analytics
Ensure the highest value data is captured and available for analysis
Compliance
Gain full transparency into provenance and flow of data
IoT Optimization
Secure, Prioritize, Enrich and Trace data at the edge
Fraud Detection
Move sales transaction data in real time to analyze on demand
Big Data Ingest
Easily and efficiently ingest data into Hadoop
Value Resources
Gain visibility into how data sources are used to determine value

23. Hortonworks Data Platform

24. 20092006
1 ° ° ° ° °
° ° ° ° ° N
HDFS
(Hadoop Distributed File
System)
MapReduce
Largely Batch Processing
Hadoop w/
MapReduce
YARN: Data Operating System
1 ° ° ° ° ° ° ° ° °
° ° ° ° ° ° ° ° °
°
°N
HDFS
(Hadoop Distributed File System)
Hadoop2 & YARN based Architecture
Silo’d clusters
Largely batch system
Difficult to integrate
MR-279: YARN
Hadoop 2 & YARN
Interactive Real-TimeBatch
Architected &
led development
of YARN to enable
the Modern Data
Architecture
October 23, 2013

25. YARN: A Data Operating System
Enables Multi-Tenancy
Better Utilization of existing clusters
• 60% – 150% improvement on node utilization
Enable next-generation Vendor Integration
• YARN is an application framework. (e.g: SAS, R, SAP)
Run Next-Generation Workloads
• Interactive SQL + Streaming + ML +…
YARN in Production
• Yahoo: ~40,000 nodes, multiple clusters running YARN across over 365PB of data
• Spotify, Progressive, Kohls, UHG, Sprint, JPMC, Target, AIG, Samsung
YARN: Data Operating System
(Cluster Resource Management)
1 ° ° ° ° ° ° °
° ° ° ° ° ° ° °
Script
Pig
SQL
Hive
TezTez
Java
Scala
Cascading
Tez
° °
° °
° ° ° ° °
° ° ° ° °
Others
ISV
Engines
HDFS
(Hadoop Distributed File System)
Stream
Storm
Search
Solr
NoSQL
HBase
Accumulo
Slider Slider
BATCH, INTERACTIVE & REAL-TIME DATA ACCESS
In-Memory
Spark

26. How do you Operate a Hadoop Cluster?
Apache Ambari is a
platform to provision,
manage and monitor
Hadoop clusters

27. Storm/Spark Streaming
Storm
Detailed Reference Architecture for IoT Applications
HDF
Flume
Sink to
HDFS
Transform
Interactive
UI Framework
Hive
Hive
HDFS
HDFS
SOURCE DATA
Server logs
Application Logs
Firewall Logs
CRM/ERP
Sensor
Kafka
Kafka
Stream to
HDF
Forward to
Storm
Real Time Storage
Spark-ML
Pig
Alerts
Bolt to
HDFS
Dashboard
Silk
JMS
Alerts
Hive Server
HiveServer
Reporting
BI Tools
High Speed
Ingest
Real-Time
Batch Interactive
Machine Learning
Models
Spark
Pig
Alerts SQOOP
Flume
Iterative ML
Hbase/Pheonix
HBaseEvent Enrichment
Spark-Thrift
Pig

28. Demo Hortonworks Sandbox
Thank You!
Want to learn more HDP?
http://hortonworks.com/training/

29. Azure Café Next Steps
For more information regarding the Azure Marketplace and Hortonworks solutions
contact:
• Marti Stephens-Hartka – Microsoft ISV Leader East Region martish@microsoft.com
• Saptak Sen – Hortonworks Group Manager Partner Solutions ssen@hortonworks.com
Additional Resources:
• Azure HDInsight: https://azure.microsoft.com/en-us/services/hdinsight/
• Hortonworks Sandbox on Azure Marketplace: https://azure.microsoft.com/en-
us/marketplace/partners/hortonworks/hortonworks-sandbox/
• Hortonworks Data Platform on Azure Marketplace: https://azure.microsoft.com/en-
us/marketplace/partners/hortonworks/hortonworks/
• Hortonworks Customer Stories: http://hortonworks.com/customers/
• Hortonworks Blog: http://hortonworks.com/blog/
• Microsoft Cortana Analytics Suite: http://www.microsoft.com/en-us/server-cloud/cortana-analytics-suite/overview.aspx
• Azure Data Lake Analytics: https://azure.microsoft.com/en-us/solutions/data-lake/
• Hortonworks and Microsoft on YouTube: https://www.youtube.com/watch?v=zWVlOMlzZgw&feature=youtu.be

30. https://tryazuremarketplace.com/
Complete Labs for top AMP ISVs Hortonworks, Barracuda, Chef, Docker, Kemp and Coming Soon (Hanu and
more)

31. • Most popular Azure
Marketplace solutions in
4 tracks
Holistic
• 3 week intervals
between same track ISV
• Onboarding assistance
with lab set up
Programmatic
• Need access to Azure
Subscription
Targeted
Dev Ops Security Big Data Management
Chef Barracuda Hortonworks Cloud Cruiser
April 27th April 20th May 5th May 18th
Docker Kemp DataStax Hanu
May 11th May 18th May 25th June 8th
Core OS Nasuni
June 1st June 15th
*Registration links not yet available

32. Barracuda Bus Tour Brief
Activity Name Barracuda + Microsoft North America Bus/MTC Tour
Approximate
Length
15 cities 02/09/16 – 04/21/16
General
Overview
The Barracuda Bus Tour is an annual event. – this is Barracuda’s fifth annual tour, but
first with a partner. The goal of this year’s tour with Microsoft is to:
- Drive awareness of the Barracuda/Microsoft solutions – Office 365 and Azure
- Target engagement across three focus areas: Customers, Partners and Microsoft
Sellers
- Drive pipeline/revenue – Azure consumption and Office 365 active usage
Event Track 10:30am – 12:45pm Customer Seminar - Migration and Security for Azure and
Office 365 –
1:30pm – 3:30pm Partner & Seller Seminar – Migration and Security for Azure and
Office 365 –
Goals/Metrics - Solution Awareness
- Education
- Leads/Revenue
- Drive Azure consumption
- Drive Office 365 active usage
Registration
Link https://httpswww.barracuda.com/programs/expedition
Date(s) Location/ State
Tues, 2/16 Mountain View, CA
Tues, 2/23 Irvine, CA
Wed, 2/24 Los Angeles, CA
We, 3/16 Portland, OR
Thurs, 3/17 Seattle, WA
Wed, 3/30 Dallas, TX
Thurs, 3/31 Houston, TX
Wed, 4/6 Minneapolis, MN
Thurs, 4/7 Chicago, IL
Mon, 4/11 Detroit, MI
Wed, 4/13 Boston, MA
Thurs, 4/14 New York, NY
Mon, 4/18 Philadelphia, PA
Tues, 4/19 Reston, VA
Wed, 4/20 Charlotte, NC
Thurs, 4/21 Atlanta, GA

33. An online store for highly optimized and integrated
applications and services ready to deploy on
Microsoft Azure
Growing ecosystem of 3,000+ apps or components
Reduced sales cycle with pre-configured, ready-to-run
apps and services
Streamlined configuration, deployment, and management
Integrated platform experience
Top scenarios include: Big data, security, networking,
DevOps & automation, business continuity & backup,
management apps
Microsoft Azure Marketplace

34. session.
Keeping it simple and making it fun (KIS+MIF)