[2024]Digital Global Overview Report 2024 Meltwater.pdf
Â
NYC Data Amp - Microsoft Azure and Data Services Overview
1.
2. How do you
differentiate
in the crowded
casual dining
market? $3TAnnual worldwide consumer
food service revenue
3.
4. Where
guests click
Sheâd like another
glass of wine
Make a suggestion for
a good pasta pairing
Delight her
Receive her praise
on social media
Ziosk uses big data and table-side
tablets to delight diners
Capture
guest data
Predict
preferences
Deliver
customized
experiences in
real-time
Increase
customer
satisfaction
Encourage
return and
advocacy
5. Tableside data also powers a
real-time manager dashboard
Sped average
table turnover
by 7 min
⢠Reassign servers to relieve
back-ups
⢠Respond to guest dissatisfaction
before they leave the dining room
⢠Integrate with loyalty programs
⢠Automatically send reports
to corporate
6. Explore new business
opportunities with
data-driven services
Improve visibility to
make more accurate
predictions with
remote monitoring
Get the right products
to the right places
with inventory
management
Offer customers
exactly what they
want, when they want
it, with personalization
Fix problems
proactively before
they start with
predictive maintenance
Integrate historic, real-time and predictive insights within your apps
7. ď¨ Instantaneous response times
ď¨ Robust and scalable security
ď¨ Intelligence built-in
ď¨ Flexibility for changes in demand
ď¨ Powerful analytics
ď¨ Intuitive visualization tools
8. Cloud-
powered
Enjoy the scale, flexibility
and affordability of
the cloud
Layered with
security
Secure your data and
apps with built-in tools
Integrated
development
Leverage open, flexible
and extensible cross-
platform DevOps tools
Built for
intelligence
Drive decisions with
predictive intelligence
10. Always encrypted Row level security Threat detection
DATA ISOLATION
Azure Active
Directory
Report
generation
11. Any data Scale to petabytes
Run apps anywhereCross-platform
12. DEVELOPER SERVICES APPLICATION SERVICES
.NET JAVASCRIPT PHPNODE.JS
C++PYTHON R CORDOVA UNITY
Robust development platform for any app
Visual Studio
Azure SDK
Team Project
Application Insights
Visual Studio
+ Xamarin
Web Apps
Mobile Apps
API Apps
API Management
Logic Apps
Notification Hubs
14. Filtering the signal from the noise
Rolls-Royce
âOur goal is not data for the sake of data, but to embrace the cloud and analytical technologies
to deliver more expert insights to the right stakeholders at the right time.â
Nick Farrant
Senior Vice President
ROLLS-ROYCE
Objectives
Connect Rolls-Royce jet
engine data to Microsoft's
intelligent cloud for insights to
improve aircraft performance,
safety and maintenance.
Tactics
Use Cortana Intelligence to
scale quickly and
efficiently, aggregate data
across customer fleets and
process data
in real time.
Results
⢠More efficient flight and
maintenance plans
⢠Targeted and actionable fuel
efficiency insights
⢠Quickly-generated reports and
dashboards that tell compelling
stories and deliver high-quality
insights
15. Data Factory
Files
Query
Events
Push/
Pull
Data Ingestion Data Storage
Azure Storage
DocumentDB
HDInsight App Service
Power
BI
Operations
Engineering
Pilots
Weather
data
Maintenance
data
Flight Plan
data
Airplane data
Data Visualization
Machine Learning
HDInsight
Data Analysis
Security / Identity
Azure Key
Vault
Azure AD
MFA
Data Analyst Data Scientist
Azure SQL
Operations /
Monitoring
App Insights
Azure
Search
Logic App Batch
Security Center
Governance
Data Catalog
SQL Data
Warehouse
Example: Data and Service Architecture
Files
Query
Events
Push/
Pull
Data Ingestion
0
Data Storage
Operations
Engineering
Pilots
Weather
data
Maintenance
data
Flight Plan
data
Airplane data
Data Visualization
Data Analysis
Security / Identity
Digital Collaboration Platform Instance
Data Analyst Data Scientist
Operations /
Monitoring
Processing Step 1
CopyFormatSummarise
Processing Step n
Machine Learning
Published Data
Enriched Data
Raw Data
Dashboards
Reports
Analytics
Models
RBACDevOps Metadata
Governance
16. Business intelligence
Advanced analytics
Any language, any platform, anywhere
Security
Structured
Unstructured
OLTP
CRM
ERP
LOB
Graph
Social
IoT
Media
Datavirtualization
Dataintegration
Big data processing
Data warehousing
Operational data
Dashboards
Reporting
Mobile BI
Cubes
Predictive Analytics
Machine learning
Stream analytics
Cognitive AI
DATA SOURCES DATA INSIGHTSDATA STORAGE AND PROCESSING DEVELOPMENT CONSUMPTION
Build powerful big data analytics apps with a comprehensive platform
App services
Dev services
App health
Data visualization
Developers
Customers
Sellers
Warehouse
managers
17. Business intelligence
Advanced analytics
Structured
Unstructured
OLTP
CRM
ERP
LOB
Graph
Social
IoT
Media
Datavirtualization
Dataintegration
Big data processing
Data warehousing
Operational data
DATA SOURCES DATA INSIGHTSDATA STORAGE AND PROCESSING DEVELOPMENT CONSUMPTION
Build powerful big data analytics apps with a comprehensive platform
Azure SQL Data
Warehouse
Azure Data Lake
Azure Machine
Learning
Azure Stream
Analytics
Power BI
Embedded
Visual Studio
Enterprise
Visual Studio
Team Services
Cognitive
Services
Azure Analysis
ServicesHDInsight
Xamarin
Developers
Customers
Sellers
Warehouse
managers
Any language, any platform, anywhere
Security: least vulnerable for the last 7 years 0
50
100
150
200
SQL Server MySQL Oracle IBM DB2 PostgreSQL SAP HANA
Vulnerabilities
(2010-2016)
.NET Azure 3rd
18. Hyper-scale repository for big data analytics
LOB Apps
SocialDevices
Clickstream
Sensors
Video
Web
Relational
ADL Store
Big Data Stores
Data Lake Store
SQL Data
Warehouse
ADL Analytics
HDInsight
R
Spark
Machine Learning
⢠A Hadoop Distributed File System for the cloud
⢠No fixed limits on file size
⢠No fixed limits on account size
⢠Unstructured and structured data in their native format
⢠Massive throughput to increase analytic performance
⢠High durability, availability, and reliability
⢠Azure Active Directory access control
19. Power BI
App Service
SQL Database
SQL Data Warehouse
Machine Learning
Hadoop
Intelligent App
Big Data Stores
Data Lake Store
SQL Data
Warehouse
⢠Petabyte scale with massively parallel processing
⢠Independent scaling of compute and storageâin seconds
⢠Transact-SQL queries across relational and
non-relational data
⢠Full enterprise-class SQL Server experience
⢠Works seamlessly with Power BI, Machine Learning,
HDInsight, and Data Factory
Elastic data warehouse with enterprise-class features
20. Machine Learning
and Analytics
Predictive analytics solutions with easy deployment
HDInsight
(Hadoop
and Spark)
Stream
Analytics
Data Lake
Analytics
Machine
Learning
⢠Simple, scalable, cutting edge. A fully managed cloud service that enables you to easily build, deploy, and share predictive analytics solutions.
⢠Deploy in minutes. Azure Machine Learning means business. You can deploy your model into production as a web service that can be called
from any device, anywhere and that can use any data source.
⢠Publish, share, monetize. Share your solution with the world in the Gallery or on the Azure Marketplace.
21. Machine Learning
and Analytics
HDInsight
(Hadoop
and Spark)
Stream
Analytics
Data Lake
Analytics
Machine
Learning
SQL Data Warehouse SQL DB Storage BlobsData Lake Store SQL DB in a VM
⢠Analyze data of any kind and size
⢠Develop faster, debug and optimize smarter
⢠Interactively explore patterns in your data
⢠No learning curveâuse U-SQL, Spark, Hive, HBase and Storm
⢠Managed and supported with an enterprise-grade SLA
⢠Dynamically scales to match your business priorities
⢠Enterprise-grade security with Azure Active Directory
⢠Built on YARN, designed for the cloud
Big data analytics for every data source
Data Lake Analytics
22. Core Engine
Batch
Map Reduce
Script
Pig
SQL
Hive
NoSQL
HBase
Streaming
Storm
In-Memory
Spark
Machine Learning
and Analytics
HDInsight
(Hadoop
and Spark)
Data Lake
Analytics
Machine
Learning
⢠Scale to petabytes on demand
⢠Process unstructured and semi-structured data
⢠Develop in Java, .NET, and more
⢠Skip buying and maintaining hardware
⢠Deploy in Windows or Linux
⢠Spin up an Apache Hadoop cluster in minutes
⢠Visualize your Hadoop data in Excel
⢠Easily integrate on-premises Hadoop clusters
Operational data suite powered by Apache
Stream
Analytics
23. Machine Learning
and Analytics
HDInsight
(Hadoop
and Spark)
Stream
Analytics
Data Lake
Analytics
Machine
Learning
⢠Scale to petabytes on demand
⢠Process unstructured and semi-structured data
⢠Develop in Java, .NET, and more
⢠Skip buying and maintaining hardware
⢠Deploy in Windows or Linux
⢠Spin up an Apache Hadoop cluster in minutes
⢠Visualize your Hadoop data in Excel
⢠Easily integrate on-premises Hadoop clusters
Real-time stream processing in the cloud
Event Hubs
Blob Storage
Stream Analytics
SQL Database
Blob Storage
Event Hubs
Table Storage
Power BI
24. Smart applications built to understand people
Machine Learning
& Analytics
⢠Faces, images, emotion recognition and video intelligence
⢠Spoken language processing, speaker recognition, custom speech
recognition
⢠Natural language processing, sentiment and topics analysis,
spelling errors
⢠Complex tasks processing, knowledge exploration, intelligent
recommendations
⢠Bing engine capabilities for Web, Autosuggest, Image, Video and
News
Cortana
Bot
Framework
Cognitive
Services
Language Understanding
Intelligent Service
Bing Auto Suggest API
Speaker Recognition
Speech
CRIS
Text Analytics
Bing Speller
Web Language Model
Linguistic Analysis
Academic Knowledge
Entity Linking Service
Knowledge Exploration
Service
Recommendations
Bing Search API
Bing Image Search API
Bing Video Search API
Bing News Search API
Computer Vision
Face
Emotion
Video
25. Intelligent agents to interact with users
Machine Learning
& Analytics
⢠Bot Connector Service: A service to register your bot, configure channels and publish to the Bot Directory. Connect your bot(s) seamlessly to
text/sms, Office 365 mail, Skype, Slack, Twitter, and more.
⢠Bot Builder SDK: An open source SDK hosted on GitHub. Everything you need to build great dialogs within your Node.js or C# bot
⢠Bot Directory: A public directory of bots registered through the Bot Connector Service. Discover, try, and add bots to conversation experiences
Cortana
Bot
Framework
Cognitive
Services
27. Machine Learning
Event HubsStream Analytics
HDInsight
Storage
SQL Database
Live dashboards for interactive business intelligence
Dashboards &
Visualizations
⢠Analytics for everyone, even non-data experts
⢠Your whole business on one dashboard
⢠Create stunning, interactive reports
⢠Drive consistent analysis across your organization
⢠Embed visuals in your applications
⢠Get real-time alerts when things change
Power BI
Power BI
28. Most consistent experience
across on-premises and cloud
Any data
Any platform Any language
Most secure database
T-SQL
Java
PHP
Node.js
C/C++
C#/VB.NET
Python
Ruby
29. Redefining commerce through transparency
Jet.com
âTo be one of the best e-commerce destinations in the US, we will have to handle millions of customers, placing tens
of thousands of orders a day. That requires a top-class e-commerce system built on a flexible, open cloud platform.
That is exactly what we got with Azure.â
Mike Hanrahan
Chief Technical Officer
JET.COM
Objectives
Create a flexible, scalable
data warehouse infrastructure
with capabilities to handle an
aggressive growth strategy.
Tactics
Adopted Microsoft SQL
Data Warehouse and
Azure HD Insight to
handle vast amounts of
data and streamline the
development process.
Results
⢠Developed a full-fledged e-
commerce marketplace in 12
months
⢠Achieved rapid and flexible
scalability enterprise-wide.
30. Using data to help save lives in the fight against pediatric AIDS
Elizabeth Glaser Pediatric AIDS Foundation
âEvery day we make life-and-death decisions, so we canât go on gut feelings or opinions.
The data is the most important thing we have. Using Microsoft BI and analytics tools
helps us make better decisions and save more childrenâs lives.â
Stephanie Bruno
Data Architecture Manager â Informatics
ELIZABETH GLASER PEDIATRIC AIDS FOUNDATION
Objectives
Create a robust solution to
accelerate the slow, inefficient
collection of vital health
information across at-risk
populations and provide
actionable intelligence from
the data.
Tactics
Used SQL Server
Reporting Services and
Power BI to build a
standardized set of
reports, capture and
summarize data, and roll
it up to centralized
reporting.
Results
⢠Easily accessible reports that
helped communicate with donors
and partners
⢠Increased data reliability and
accuracy
⢠Improved data availability and
reporting despite limited network
capabilities
31. Moving from insight to action
Rockwell Automation
âWhat weâre talking about is delivering a degree of collaboration and visibility unheard
of in the oil and gas industry. With sensors, software and the cloud, these disparate assets can become part of a
connected enterprise, powered at its core by a rich flow of data.â
Doug Weber
Business Manager, Remote Application Monitoring
ROCKWELL AUTOMATION
Objectives
Support high volume data to
improve production efficiency,
drive better performance and
enable rapid innovation and
go to market.
Tactics
Used Microsoft Azure
SQL Database and HD
Insight to collect sensor
data from remote
equipment across global
supply chains and support
real-time insight, analytics
and predictive
maintenance.
Results
⢠Improved access to production
and supply chain data worldwide
⢠Supported accelerated business
growth with a highly scalable
cloud platform
⢠Utilized new features to get to
market faster and make
development easier
32. Assess with a partner-led
data estate assessment
Test with a partner-led
proof of concept
Get started today
Learn and Experiment using
self-service templates and training
33. Harnessing an ocean of data
Carnival Maritime
Objectives
Improve visibility and gain
deeper insight into their
business operations by
centralizing data
management for thousands
of devices and sensors across
a fleet of 26 cruise ships
sailing all over the world .
Tactics
Implemented Azure SQL
Data Warehouse to
leverage data captured
by existing industrial
hardware, and utilized the
big-data platform to
improve operations by
analyzing historical data
with custom models.
Results
⢠Connected thousands of devices
and sensors into a centralized
data repository
⢠Created a scalable platform to
extend, monitor and improve
equipment maintenance across the
fleet
⢠Used predictive analytics to optimize
water consumption, saving an
estimated $200,000 a year
âTo build a big data and analytics strategy, our company needs to better understand what kind of data we
can collect on the ships and what kind of data we need to have in the futureâŚwe want to use the data to
get a better understanding of our operations and to help our ships be more efficient and sustainable.â
Alexander Klingelhoefer
Director of Continuous Improvement
CARNIVAL MARITIME
35. Data management
⢠Azure Data Lake
⢠Azure SQL Data
Warehouse
⢠Azure HDInsight
Analytics
⢠Azure Machine Learning
⢠Azure Stream Analytics
Development
⢠Visual Studio Enterprise
⢠Visual Studio Team Services
⢠Azure Application Insights
⢠Power BI Embedded
⢠Xamarin
36. ⢠Specifically designed to work with multiple analytics
frameworks
⢠Seamlessly scales from a few KBs to several PBs
⢠Data is never lost or unavailableâeven under failures
⢠Offers enterprise-grade security for even the most
sensitive data
DATA MANAGEMENT
Azure Data Lake
ADL Analytics
Spark
Azure Machine
Learning
HDInsight
R
Azure
Data Lake Store
LOB Applications
Social
Clickstream
Sensors
Video
Web
Relational
Devices
A cost-effective cloud repository
for big data
37. True cloud elasticity
for freedom with control
⢠Fully managed, Petabyte scale
⢠Provision in minutes, scale in seconds
⢠Query across relational and non-relational data with PolyBase
⢠True cloud savings, with independent scaling of compute and
storage, as well as pause & resume feature
⢠Unmatched innovations in security with Threat Detection
⢠Industry leading SLA â guaranteeing 99.9% uptime in GA
regions
⢠Availability in more regions than any other cloud data
warehouse provider
DATA MANAGEMENT
Azure SQL Data Warehouse
INGEST
INSIGHT
STORE
A data warehouse that grows with your needs
38. Optimized open source analytics clusters
⢠Fully managed Hadoop and Spark for the cloud
⢠Enterprise-grade security and monitoring
⢠Easy to manage, clusters up and running in minutes
⢠Reliable with the industryâs best enterprise SLA
⢠Familiar BI tools for analysis, or open source notebooks for
interactive data science
⢠Cost-effective cloud scale
⢠63% lower total cost of ownership than deploying your own
Hadoop on-premises*
⢠The most comprehensive protection against intellectual property
risks with Azure IP Advantage
*IDC study âThe Business Value and TCO Advantage of Apache Hadoop in the Cloud with Microsoft Azure HDInsightâ
DATA MANAGEMENT
Azure HDInsight
39. Powerful cloud-based predictive analytics
⢠Easily build, deploy, and share predictive analytics solutions
⢠Hundreds of built-in packages and support for custom code
⢠Interactive, visual workspace â no programming required
⢠Unlimited extensibility and one-click operationalization
Collect & manage data
Create machine
learning models
ML STUDIO
SAAS APP
MACHINE LEARNING SERVICE
Run regular algorithms
through connected database
WEB SERVICE
Add intelligence to app or
provide insights in BI tools
BI VISUALIZATIONS
ANALYTICS
Azure Machine Learning
40. Intelligence to enhance the user experience
⢠Add smart API capabilities to enable contextual interactions
⢠Tap into powerful AI algorithms for vision, speech, language,
knowledge, and search
⢠Allow your apps to apt to what users want and learn from
your data
⢠Map complex data to provide intelligent cross-sell
recommendations
Improved
customization and
engagement
SaaS app
ANALYTICS
Microsoft Cognitive Services
41. Converge digital and physical worlds
⢠Use pre-configured solutions such as Remote Monitoring and
Predictive Maintenance to accelerate your IoT projects and
jump ahead of the competition
⢠Connect a broad range of existing device types and harness
disparate data to create new intelligence
⢠Predict with advanced analytics and machine learning to
capture previously impossible insights
⢠Tailor IoT solutions to your companyâs business needs to quickly
move from proof of concept to broader deployments
⢠Integrate Azure IoT Suite with existing systems to make the best
use of the data and processes you already have
ANALYTICS
Azure IoT Suite
42. Share code, track work, and ship
softwareâin any language
DEVELOPMENT
Visual Studio Team Services
⢠Secure code management to effectively create, manage and
deliver against your backlog
⢠Unparalleled flexibility for evolving codebases
⢠Code is linked directly to the story, bug, or task
⢠A toolset optimized for QA professionals, providing work style
flexibility and team collaboration
⢠Build apps with any tools and languages across multiple
platforms
⢠Streamline and automate the workflow between development
and IT Ops to deliver higher quality SW more frequently
⢠Customize and extend the Visual Studio platform to create the
perfect dev environment
43. An integrated, end-to-end DevOps solution
⢠Greater productivity for enterprise application development &
delivery
⢠Create mobile business applications for Android, iOS and Windows
⢠Manage complexity and close the loop between
Development & IT Ops
⢠Plan, execute & monitor your entire testing effort
⢠Full support across the DevOps lifecycle
DEVELOPMENT
Visual Studio Enterprise
iOS
Android
Windows
Visual Studio Enterprise
Data Analyst
Developer
ITDM
BDM
.NET JAVASCRIPT PHPNODE.JS
C++PYTHON R CORDOVA UNITY
44. Interactive data visualization and
compelling reports
⢠Author interactive data reports without writing any code
using Power BI Desktop
⢠Choose modern data visualizations out-of-the-box or
customize without from scratch
⢠Embed interactive visuals in your app using REST APIs and
the Power BI SDK
⢠Use your existing authentication and authorization
methods
⢠Speed up time to value without redesigning your existing
app
⢠Pay only for what you use with no upfront costs
DEVELOPMENT
Power BI Embedded
45. Create amazing cloud-powered
mobile apps faster
⢠Scale your apps to millions of customers
across multiple geographies
⢠Quickly add authentication, push notifications,
and offline data sync
⢠Connect your apps to enterprise systems, in
the cloud or on premises
⢠Use infinitely scalable storage to manage app
resources
⢠Build powerful apps with integrated tools,
cloud services, and mobile SDKs
⢠Integrate your mobile DevOps processes and
systems with a few lines of code
DEVELOPMENT
Xamarin
46. Sign up for a free trial of Microsoft Azure
https://azure.microsoft.com/en-us/free/
47. Cutting energy costs through machine learning
Carnegie Mellon University
Objectives
Resolve complex big data
challenges across fields as
diverse as astrophysics and
building management.
Tactics
Used Azure Machine
Learning to address the
challenge of fault
detection and diagnosis
for control-system
components hidden from
visual inspection.
Results
⢠Realized estimated energy savings
of 20 percent
⢠Simplified and accelerated the
time-consuming process of
creating and testing machine
learning models
âWe see Azure Machine Learning ushering in an era of self-service predictive analytics for the masses. We can only
imagine the possibilities.â
Bertrand Lasternas
Researcher
CARNEGIE MELLON UNIVERSITY
48. Creating a crystal ball for appliance manufacturing
Arçelik A.Ĺ.
Objectives
Replace an outdated
forecasting system with a new
solution to improve accuracy
and ensure the right spare
parts are available anytime
and anywhere theyâre needed.
Tactics
Used Azure Machine
Learning to test
algorithms and identify
the most accurate ones
to forecast the needs for
spare parts 12 months in
advance.
Results
⢠Forecasting accuracy increased up
to 80%
⢠Inventory turnover expected to
climb by 10%
⢠Increased forecasts from 100,000
to all 350,000 spare parts SKUs
âWith more spare parts in our warehouse, we needed a way to respond to customer needs quickly. We reached that
goal by using Azure Machine Learning to increase forecast accuracy.â
Burcu Aksoy,
Spare Part Team Leader, Customer Care
ARCELIK
49. Filtering the signal from the noise
Rolls-Royce
âOur goal is not data for the sake of data, but to embrace the cloud and analytical technologies
to deliver more expert insights to the right stakeholders at the right time.â
Nick Farrant
Senior Vice President
ROLLS-ROYCE
Objectives
Connect Rolls-Royce jet
engine data to Microsoft's
intelligent cloud for insights
to improve aircraft
performance, safety and
maintenance.
Tactics
Use Cortana Intelligence
and Azure Machine
Learning to scale quickly
and efficiently, aggregate
data across customer
fleets and process data
in real time.
Results
⢠More efficient flight and
maintenance plans
⢠Targeted and actionable fuel
efficiency insights
⢠Quickly-generated reports and
dashboards that tell compelling
stories and deliver high-quality
insights
50. Business intelligence turns customers into fans
Metro Bank
âAs we grew, we needed something more dynamic, more visually appealing and more user-friendlyâŚPower BI
fits the bill in all of those respects.â
Bruce Rioch
Head of Business Information and Customer Systems
METRO BANK
Objectives
Innovate customer service by
capturing data that is clear
and easy to understand, and
available to the right person
at the right time.
Tactics
Used Power BI to gather
deeper and more detailed
information about what
customers wants and
needs to guide analysis
and decision-making.
Results
⢠Continuous improvement in
customer experience
⢠Expanded offerings built on new
capabilities
⢠At-a-glance visualizations of how
customers interact with bank
services
51. Using data to help save lives in the fight against pediatric AIDS
Elizabeth Glaser Pediatric AIDS Foundation
âEvery day we make life-and-death decisions, so we canât go on gut feelings or opinions.
The data is the most important thing we have. Using Microsoft BI and analytics tools
helps us make better decisions and save more childrenâs lives.â
Stephanie Bruno
Data Architecture Manager â Informatics
ELIZABETH GLASER PEDIATRIC AIDS FOUNDATION
Objectives
Create a robust solution to
accelerate the slow, inefficient
collection of vital health
information across at-risk
populations and provide
actionable intelligence from
the data.
Tactics
Used SQL Server
Reporting Services and
Power BI to build a
standardized set of
reports, capture and
summarize data, and roll
it up to centralized
reporting.
Results
⢠Easily accessible reports that
helped communicate with donors
and partners
⢠Increased data reliability and
accuracy
⢠Improved data availability and
reporting despite limited network
capabilities
52. Redefining commerce through transparency
Jet.com
âTo be one of the best e-commerce destinations in the US, we will have to handle millions of customers, placing tens
of thousands of orders a day. That requires a top-class e-commerce system built on a flexible, open cloud platform.
That is exactly what we got with Azure.â
Mike Hanrahan
Chief Technical Officer
JET.COM
Objectives
Create a flexible, scalable
data warehouse infrastructure
with capabilities to handle an
aggressive growth strategy.
Tactics
Adopted Microsoft SQL
Data Warehouse and
Azure HD Insight to
handle vast amounts of
data and streamline the
development process.
Results
⢠Developed a full-fledged e-
commerce marketplace in 12
months
⢠Achieved rapid and flexible
scalability enterprise-wide.
53. Moving from insight to action
Rockwell Automation
âWhat weâre talking about is delivering a degree of collaboration and visibility unheard
of in the oil and gas industry. With sensors, software and the cloud, these disparate assets can become part of a
connected enterprise, powered at its core by a rich flow of data.â
Doug Weber
Business Manager, Remote Application Monitoring
ROCKWELL AUTOMATION
Objectives
Support high volume data to
improve production efficiency,
drive better performance and
enable rapid innovation and
go to market.
Tactics
Used Microsoft Azure
SQL Database and HD
Insight to collect sensor
data from remote
equipment across global
supply chains and support
real-time insight, analytics
and predictive
maintenance.
Results
⢠Improved access to production
and supply chain data worldwide
⢠Supported accelerated business
growth with a highly scalable
cloud platform
⢠Utilized new features to get to
market faster and make
development easier
Editor's Notes
Itâs big news: BIG data reveals BIG insights which lead to BIG bucks. Which begs the question, what, specifically, are you doing to make the most of all the new data sources?
Many businesses want to use big data but their IT teams struggle with how to make it comprehensible and cost effective â largely because, up until, now it has been neither.
Today, weâre going to illustrate how you can bring big data analytics to your teams through smart apps that revolutionize the way they work.
Starting with a single app, you can pivot your role in the company â from the team that takes care of computers to the team that makes dreams come true.
Take for example the casual dining market. Itâs flooded with tens of thousands of competing restaurants such as TGIFridays, Olive Garden, Cheesecake Factory... All of whom are fighting for a piece of the $3 trillion pie.
How do they stand out to their customers? How do they make their somewhat generic experience favorable enough to win more business?
Source:Â https://www.firstresearch.com/Industry-Research/Casual-Restaurants.html
Â
Enter Ziosk: the maker of the worldâs first ordering, entertainment, and pay-at-the-table tablet.
Zioskâs tablets began as a way to help restaurants improve customer service and satisfaction by offering self-service capabilities and a direct line of communication to the staff â as well as personal entertainment.
Today, using the wealth of big data the tablets accumulate from individualsâ interactions, Ziosk runs predictive analytics applications to help restaurants know their customersâ preferences and tailor each customerâs experience on the fly.
Ziosk tablets make the causal dining experience more convenient, more engaging and now more personal for customers.
On the flip side, the data Ziosk collects and analyzes can be piped into restaurant managers as a real-time dashboard that allows them to quickly understand whatâs happening on the floor at any minute.
With this information, they can adjust staff and resources, coach employees through challenging situations, and head off negative experiences before they arise.
Of course, optimizing the restaurant experience isnât the limit of what can be done with big data, itâs inspiration for what YOU can do with big data.
From inventory management to customer service to financial market positioning and more, big data analytics applications can improve nearly every aspect of your business by making it easier for teams to make smart, fast and efficient decisions.
Remote monitoring improves visibility of assets to help you make more accurate predictions.
Inventory management ensures you get the right products to the right places.
Personalized profiles enable you to offer customers exactly what they want, when they want it.
Predictive maintenance allows you to fix problems proactively before they start.
And data-driven services help you explore new business opportunities.
A big data analytics app integrates all varieties and sources of data into a focused and easy-to-understand UI tailored for the needs of a particular audience.
It puts the past, present and future in the hands of the app user, to enable her to quickly and easily understand the many facets of her business, their interconnectedness and her points of influence.
Of course, building a big data analytics application that is as powerful as it is useful requires a serious toolkit. You have to be able to ensure:
Instantaneous response times with up-to-date information
Robust and scalable security that covers your users from any device and any location without compromising your data, customers or employees
Intelligence built-in to the database that runs as close to the data source as possible
Flexibility for changes in demand that keeps the app running even when usage spikes
Powerful analytics to make simple work of serious problems, and
Intuitive visualization tools that bring data to life and respond to explorative probing
Itâs a daunting list of requirements to fill, especially if you have to cobble together different vendors and solutions.
With Microsoft, you get everything you need built to work together in a flexible and affordable cloud environment. Whether you work exclusively in Microsoft, or supplement your existing assets with Microsoft cloud services and solutions, we can help you create a robust, cohesive and secure application that delivers the latest in big data analytics.
The Microsoft solution for big data analytics is:
built for intelligence,
layered with security,
powered by the cloud and
integrated with development tools.
Letâs take a closer look at what each of those mean.
Built for intelligence:
Your apps are only as useful as they are intelligent. You canât make breakthrough business decisions if you donât have breakthrough insights.
The Microsoft environment facilitates the process that turns data into intelligence â aggregating diverse data sources, detecting complicated patterns, predicting likely outcomes, automating decisions â by building in technology that streamlines each stage and connects to the next.
Other vendors offer partial or unconnected assets that make each of these steps tedious and sometimes incompatible. When you build your app with Microsoft, data flows into decisions.
Built-in intelligence, in the form of predictive analytics, machine learning and interactive visualizations, strips away layers of manual analysis and IT obstacles to get you to the business opportunity faster.
Layered with security:
Security is paramount no matter who you are or what you do. Your reputation hinges on data control and privacy which means our reputation hinges on it too.
Big data applications pose unique security challenges in that they incorporate diverse and oftentimes unsecured data sources, rely on cloud-based engines to run, and are typically accessed from personal devices across the globe.
We understand the risk and exposure you face with every click and transaction which is why we constantly invest in innovative measures to keep you in control of your data. The layers of security built into the Microsoft environment make it easy for you to use data and administer resources without forcing you to make trade offs in security.
Most recently weâve added advanced capabilities such as Always Encrypted, Row level security, dynamic data masking to the database layer to keep data secure at the source.
In the operating system, weâve created robust authentication and threat detection tools to help you monitor users and control access.
And in case of an unforeseen event or disaster, our high availability and disaster recovery solutions guarantee to keep you running - business as usual.
With Microsoft, you can rest assured weâre constantly going above and beyond to give you full and exclusive control of your data so itâs as safe as you need it to be.
Cloud powered:
For most companies, big data analytics wouldnât be possible without the cloud. From managing massive amounts of all types of data, to providing data access anywhere in the world on any device - your analytics app needs the scale, flexibility, affordability and access only the cloud can offer.
Microsoftâs cloud-first commitment means that new technology is launched, tested and perfected in the cloud FIRST, so you can be sure the technology you need lives there already and has been fully proven.
Integrated development:
Only Microsoft enables an open, flexible and extensible cross-platform experience for building applications.
Rich with DevOps tools that support any developer of any app, the Visual Studio and Xamarin environment empower innovative collaboration across teams to support continuous and rapid development.
Best of all, you can easily move the data and app layers between Azure and on-premises databases and take advantage of the best of both worlds for your production and development needs.
Video: https://www.youtube.com/watch?v=B3CZXp-RK0g
Rolls Royce: from selling engine to hours: cannot ever fail. Use sensors data =>CIS
http://rolls-royce.azurewebsites.net/#/fleetlocation
http://enterprise.microsoft.com/en-us/industries/discrete-manufacturing/rolls-royce-and-microsoft-collaborate-to-create-new-digital-capabilities-2/ â Microsoft Customer Story
Flight delays are a familiar headache for most people who fly on commercial airlines. At a personal level, they are disruptive and costly, but for the airlines the impact is exponentially larger. Minimizing the cost and disruption of maintenance activities is a key focus for these businesses.
Rolls-Royce has more than 13,000 engines for commercial aircraft in service around the world, and for the past 20 years, it has offered customers comprehensive engine maintenance services that help keep aircraft available and efficient. As the rapidly increasing volume of data coming from many different types of aircraft equipment overtakes the airlinesâ ability to analyze and gain insight from it, Rolls-Royce is using the Microsoft Azure platform to fundamentally transform how it uses data to better serve its customers.
Worldwide, flight delays and disruptions cost the airline industry millions of dollars every year. Even a small reduction in âaircraft on groundâ (AOG) time can translate into significant amount of money, so airlines are always looking for ways to improve the efficiency of maintenance activities.
To bring its vision of a powerful and scalable data analytics system to life, Rolls-Royce chose to build it on the Microsoft Azure platform.
Starting with Azure IoT Suite, Rolls-Royce will be able to collect and aggregate data from disparate and geographically distributed sources at an unprecedented scale. Initially, the types of data being processed include snapshots of engine performance that the planes send wirelessly during a flight, massive downloads of comprehensive âblack boxââtype data, technical logs, and flight plans as well as forecast and actual weather data provided by third parties.
Using Microsoft Cortana Intelligence Suite, Rolls-Royce will be able to analyze a rich set of data and perform data modeling at scale to accurately detect operational anomalies and help customers plan relevant actions.
In expanding the scope of services Rolls-Royce offers its customers, fuel efficiency is one of the first and highest-yield areas that the company is targeting. By analyzing new data against existing forecasts, reference tables, and historical trends, Rolls-Royce will be able to help airlines understand exactly which factorsâincluding flight plans, equipment maintenance, weather, and discretionary fuelâhave the most impact on fuel performance.
All of this requires a massive level of scalability that is greatly facilitated by employing a wide range of Azure platform services. From using Azure Data Factory for orchestration and Azure HDInsight for high-level data aggregation and summarization, to using Azure SQL and Azure Blob Storage to handle all the different types of storage needs, Rolls-Royce is taking full advantage of the integrated Azure platform services.
According to the PwC Global Airline CEO Survey 2014, 71 percent of airline CEOs reported that they are developing future strategies or have concrete plans for making changes to their data management and data analytics. With highly scalable and sophisticated data analytics services built on the Azure platform, Rolls-Royceâs plan to use data to improve the reliability and efficiency of air travel has already taken off.
Talk track aroun the problems that the data estate can address
Modern Data Warehousing lays the foundation for integrating any data using any language for both on-prem & cloud.
This platform can ingest both relational and non-relational data, and through data virtualization it can process and manage with Data Warehousing and Big data processing.
BI tools and Advanced Analytics drive insights and visualize them for your organization.
Weâll now show the Microsoft Modern Data Warehouse solution.
Talk track aroun the problems that the data estate can address
Modern Data Warehousing lays the foundation for integrating any data using any language for both on-prem & cloud.
This platform can ingest both relational and non-relational data, and through data virtualization it can process and manage with Data Warehousing and Big data processing.
BI tools and Advanced Analytics drive insights and visualize them for your organization.
Weâll now show the Microsoft Modern Data Warehouse solution.
Your data are valuable assets to your organization and have both present and future value. Because of this, all data should be stored for future analysis. Today this is often not done because of the restrictions of traditional analytics infrastructure, like the pre-definition of schemas, the cost of storing large datasets, and the propagation of different data silos.
To address this challenge, the data lake concept was introduced as an enterprise-wide repository to store every type of data collected in a single place. For the purpose of operational and exploratory analytics, data of all types can be stored in a data lake prior to defining requirements or schema.
Microsoft Azure Data Lake Store is a Hadoop file system thatâs compatible with Hadoop Distributed File System (HDFS) and works with the Hadoop ecosystem. Data Lake Store is integrated with Azure Data Lake Analytics and Azure HDInsight and will be integrated with Microsoft offerings like Revolution-R Enterprise; industry-standard distributions like Hortonworks, Cloudera, and MapR; and individual Hadoop projects like Spark, Storm, Flume, Sqoop, and Kafka.
Data Lake Store is a very open, massive scale data store designed for extremely high throughput and low latency for analytics workloads.
At the same time, its built-in security ensures you can include even your most critical workloads on it.
T: You may have noticed we are emphasizing these services are all built to scale, and SQL Data Warehouse is no different.
Historically, data warehouses have required fixed combinations of storage and compute, often underutilizing expensive resources. With Azure SQL Data Warehouse, storage and compute scale independently. You can dynamically deploy, grow, shrink, and even pause compute, taking advantage of best-in-class price/performance. Also, SQL Data Warehouse uses the power and familiarity of T-SQL to let you easily integrate query results across relational data in your data warehouse and non-relational data in Azure blob storage.
SQL Data Warehouse uses Microsoftâs massively parallel processing (MPP) architecture. You pay for time-to-insight, not hardware, based on performance objectives for fundamental data warehousing operations like scanning, loading, and query processing. SQL Data Warehouse uses SQL Server in-memory columnstore indexes and an advanced cost-based query optimizer to deliver optimal price/performance.
T: Next letâs look at Machine Learning and Analytics
Azure Machine Learning is a fully managed cloud service that enables you to easily build, deploy, and share predictive analytics solutions.
You can deploy your model into production as a web service in minutesâa web service that can be called from any device, anywhere and that can use any data source.
You can also Share your solution with the world in the Gallery or on the Azure Marketplace.
Weâll get into more details about what Machine Learning can do in our demo later on.
T: Next is Data Lake Analytics.
Azure Data Lake Analytics is a new distributed service in the Azure Data Lake. We built Azure Data Lake Analytics from the ground up for cloud scale and performance. Data Lake Analytics makes the complex task of managing distributed infrastructure and complex code easy. It dynamically provisions resources and lets you do analytics on exabytes of data. When the job completes, it winds down resources automatically, and you pay only for the processing power used. As you increase or decrease the size of data stored or the amount of compute used, you donât have to rewrite code. This lets you focus on your business logic only and not on how to process and store large datasets. It also takes away the complexities normally associated with big data in the cloud and ensures that Data Lake will meet your current and future business needs.
Azure Data Lake is the only solution that uses U-SQL, A powerful new language that brings the best of SQL and C# together with open source capabilities like Hive or Spark.
It is built for cloud scale and performance, itâs managed and itâs easy to set up. It seamlessly integrates with existing systems to make you productive from day one.
T: Next, letâs discuss HDInsight.
Azure HDInsight is an Apache Hadoop distribution powered by the cloud. This means that it handles any amount of data, scaling from terabytes to petabytes on demand. Spin up any number of nodes at any time. We charge only for the compute and storage that you use.
Because it's 100 percent Apache Hadoop, HDInsight can process unstructured or semi-structured data from web clickstreams, social media, server logs, devices and sensors, and more. This lets you analyze new sets of data and uncover new business possibilities that drive your organization forward.
HDInsight has powerful programming extensions for languages including C#, Java, and.NET. Use your programming language of choice on Hadoop to create, configure, submit, and monitor Hadoop jobs. With HDInsight, deploy Hadoop in the cloud without buying new hardware or incurring other up-front costs. Thereâs also no time-consuming installation or set up. Azure does it for you. Launch your first cluster in minutes.
Because it's integrated with Excel, HDInsight lets you visualize and analyze your Hadoop data in compelling new ways using a tool that's familiar to your business users. From Excel, users can select HDInsight as a data source. HDInsight is also integrated with Hortonworks Data Platform, letting you move Hadoop data from an on-site datacenter to the Azure cloud for backup, Dev/Test, and cloud-bursting scenarios. Using the Microsoft Analytics Platform System, you can even query your on-premises and cloud-based Hadoop clusters at the same time.
T: Next up is Azure Stream Analytics
Azure Stream Analytics lets you rapidly develop and deploy low-cost solutions to gain real-time insights from streaming data from devices, sensors, infrastructure, and applications. Use it for Internet of Things (IoT) scenarios, such as real-time remote management and monitoring or gaining insights from devices like mobile phones and connected cars.
With every device, service, and process becoming a data point, the problem can often be analyzing and acting on data fast enough. Stream Analytics is easy to deploy, and simple to develop for, a low cost end to end event stream processing solution, that scales on demand.
Use fewer lines of code with built in analysis processes. Combine Stream Analytics with Event Hubs to analyze millions of points of data in a reliable environment.
T: Next, weâll take a look at a demo that illustrates the value of the intelligence capabilities that Cortana Intelligence offers.
Whatâs incredibly unique is the intelligence capabilities Cortana Intelligence offers, building on years of Microsoft research and innovation. These capabilities enable our customers to build intelligent systems and agents that can augment their organizational capabilities. For example, organizations can interact with customers and stakeholders in new ways and infer intent with vision, face, speech, text and sentiment analysis to customize responses and drive appropriate actions.
Microsoft Cognitive Services, a set of cloud services, APIs and SDKs that enable organizations to build intelligent systems that can see, hear, interpret and understand the world around you and makes all applications more intelligent, engaging and discoverable. Cognitive Services expands the existing perceptual intelligence capabilities like Vision, Speech, Text and Face detection to include new cognitive capabilities such as Emotion and customized Language Understanding. What we showcased with www.how-old.net is one example of what is possible.
T: Next, Bot Frameworks.
Microsoft Bot Framework enables organizations to build intelligent agents (Bots) that allow your intelligent systems to interact with your users in more contextual and natural ways, from text/sms to Office365 mail to Skype, Slack and other services. The Bot Framework provides developers with a developer portal & SDK to build your bot, a bot connector service to connect to social channels such as Twitter, Slack etc. and a bot directory to discover and use existing bots.
T: Next, Cortana.
Many of the services weâve been talking about today are on the back-end. But your data and the results of analytics are only useful if they can be provided to those who need them â often people without deep data expertise.
Thatâs where Power BI comes in. Power BI is a cloud-based dashboard and visualization service that provides faster time to insight. It is used for visualizing, exploring and extracting insights from data. It brings together data from diverse sources to deliver rich, comprehensive views of your business. With Power BI, you can see all of your data in one place and share reports. Live dashboards and reports show visualizations and KPIs from data that reside both on-premises and in the cloud, providing a consolidated view across your business regardless of where your data lives.
T: Now that weâve walked through everything, letâs take a look at the whole picture.
Just imagine: any data, any language, on any platform on the most secure database in the industry.
Microsoftâs comprehensive environment gives you the tools to create apps that turn data into decision and transform not only the way your teams do business, but the business opportunities they create.
Source:
https://www.microsoft.com/en-us/cloud-platform/customer-stories-rockwell-automation
https://customers.microsoft.com/en-US/story/fueling-the-oil-and-gas-industry-with-iot-1
(Correct as of 11/11/16)
Rockwell Automation, the worldâs largest industrial automation and information firm, wanted to strengthen its competitive advantage and open new business opportunities in the oil and gas industry by automating the collection and analysis of data from remote installations across the petroleum supply chain.
Rockwell worked with Microsoft to create a solution to monitor expensive capital assets and use that data to improve efficiency, drive better performance and enable innovation. Based on Azure IoT services, the solution collects, integrates and organizes sensor data from remote equipment across global supply chains to support real-time insight, predictive analytics and preventive maintenance. With this solution, Rockwell can now help alert customers to potential issues and failures and provide remote troubleshooting to reduce costly downtime.
As Business Manager Doug Weber noted, âThe ability to automate these transactions across thousands of machines and countless miles is transformational for this industryâŚNow all parties involved can have immediate electronic records of transactions, real accountability in these remote locations, immediate awareness for maintenance and diagnostics, and new levels of information about every transaction.â
By working with Microsoft to automate the collection and analysis of data from remote installations across the petroleum supply chain, Rockwell Automation strengthened its competitive advantage and opened new business opportunities in the oil and gas industry.
Relevant products:
Azure
Azure IoT Suite
You can get started for free today through an estate assessment and proof of concept that brings the abstract to life.
For the assessment, Microsoft provides a partner of your choosing to help you evaluate your current estate and create a roadmap that leads to your application goals. Using that information, a qualified partner will set up a test environment that meets your specific requirements.
Big data is here to stay. Why not be the who brings it into your business?
In summary, with Visual Studio Enterprise, .NET developers get the tools and services for all phases of the end-to-end DevOps lifecycle out of the box.
For mobile developers, looking to meet the highest quality standards, VSE provides exclusive mobile-specific quality assurance tools that not only significantly speed up the developer inner loop but also enables effortless testing on thousands of real mobile devices, crash analytics, app distribution to beta testers, and user feedback collection.
In a DevOps world where continuous testing is the new normal, Visual Studio Enterprise enables teams to plan, execute and monitor the entire testing effort continuously with a full range of integrated testing tools, including test management, exploratory testing, performance testing, automated UI testing, and more.
.NET teams embracing DevOps at scale or in complex environments can now benefit from learnings that Microsoft has productized and put as features into VSE exclusively. VSE unlocks massive productivity and quality gains and provides a complete end-to-end DevOps solution. With VSE, .NET teams of any size can leverage advanced tools and services to design, build, deploy and manage complex solutions, modern applications and services for Android, iOS, Windows, web, cloud and desktop.
http://enterprise.microsoft.com/en-us/industries/discrete-manufacturing/rolls-royce-and-microsoft-collaborate-to-create-new-digital-capabilities-2/ â Microsoft Customer Story
Flight delays are a familiar headache for most people who fly on commercial airlines. At a personal level, they are disruptive and costly, but for the airlines the impact is exponentially larger. Minimizing the cost and disruption of maintenance activities is a key focus for these businesses.
Rolls-Royce has more than 13,000 engines for commercial aircraft in service around the world, and for the past 20 years, it has offered customers comprehensive engine maintenance services that help keep aircraft available and efficient. As the rapidly increasing volume of data coming from many different types of aircraft equipment overtakes the airlinesâ ability to analyze and gain insight from it, Rolls-Royce is using the Microsoft Azure platform to fundamentally transform how it uses data to better serve its customers.
Worldwide, flight delays and disruptions cost the airline industry millions of dollars every year. Even a small reduction in âaircraft on groundâ (AOG) time can translate into significant amount of money, so airlines are always looking for ways to improve the efficiency of maintenance activities.
To bring its vision of a powerful and scalable data analytics system to life, Rolls-Royce chose to build it on the Microsoft Azure platform.
Starting with Azure IoT Suite, Rolls-Royce will be able to collect and aggregate data from disparate and geographically distributed sources at an unprecedented scale. Initially, the types of data being processed include snapshots of engine performance that the planes send wirelessly during a flight, massive downloads of comprehensive âblack boxââtype data, technical logs, and flight plans as well as forecast and actual weather data provided by third parties.
Using Microsoft Cortana Intelligence Suite, Rolls-Royce will be able to analyze a rich set of data and perform data modeling at scale to accurately detect operational anomalies and help customers plan relevant actions.
In expanding the scope of services Rolls-Royce offers its customers, fuel efficiency is one of the first and highest-yield areas that the company is targeting. By analyzing new data against existing forecasts, reference tables, and historical trends, Rolls-Royce will be able to help airlines understand exactly which factorsâincluding flight plans, equipment maintenance, weather, and discretionary fuelâhave the most impact on fuel performance.
All of this requires a massive level of scalability that is greatly facilitated by employing a wide range of Azure platform services. From using Azure Data Factory for orchestration and Azure HDInsight for high-level data aggregation and summarization, to using Azure SQL and Azure Blob Storage to handle all the different types of storage needs, Rolls-Royce is taking full advantage of the integrated Azure platform services.
According to the PwC Global Airline CEO Survey 2014, 71 percent of airline CEOs reported that they are developing future strategies or have concrete plans for making changes to their data management and data analytics. With highly scalable and sophisticated data analytics services built on the Azure platform, Rolls-Royceâs plan to use data to improve the reliability and efficiency of air travel has already taken off.
Source:
https://www.microsoft.com/en-us/cloud-platform/customer-stories-rockwell-automation
https://customers.microsoft.com/en-US/story/fueling-the-oil-and-gas-industry-with-iot-1
(Correct as of 11/11/16)
Rockwell Automation, the worldâs largest industrial automation and information firm, wanted to strengthen its competitive advantage and open new business opportunities in the oil and gas industry by automating the collection and analysis of data from remote installations across the petroleum supply chain.
Rockwell worked with Microsoft to create a solution to monitor expensive capital assets and use that data to improve efficiency, drive better performance and enable innovation. Based on Azure IoT services, the solution collects, integrates and organizes sensor data from remote equipment across global supply chains to support real-time insight, predictive analytics and preventive maintenance. With this solution, Rockwell can now help alert customers to potential issues and failures and provide remote troubleshooting to reduce costly downtime.
As Business Manager Doug Weber noted, âThe ability to automate these transactions across thousands of machines and countless miles is transformational for this industryâŚNow all parties involved can have immediate electronic records of transactions, real accountability in these remote locations, immediate awareness for maintenance and diagnostics, and new levels of information about every transaction.â
By working with Microsoft to automate the collection and analysis of data from remote installations across the petroleum supply chain, Rockwell Automation strengthened its competitive advantage and opened new business opportunities in the oil and gas industry.
Relevant products:
Azure
Azure IoT Suite