Big Data - BIGIT 2016

1. Beyond Big Data
Opportunities & Challenges

2. MOBILE | PERSONAL | NATURAL | TRUSTED
THE DISRUPTIVE DIGITAL REVOLUTION

3. Big data+
IoT
44 ZB
By 2020, IoT will include
26B units causing explosion
in the amount of data
available.
Mobile
>50%
More than half of
information workers across
17 countries report using
3+ devices for work
Social HyperScale
Cloud
~50%
Nearly half of total IT spend
will be cloud-related
by 2020
Devices: “Info Workers Will Erase Boundary Between enterprise And Consumer Technologies.” Forrester Research. August 30, 2012
Apps: Gartner: “Predicts 2013: Business Impact of Technology Drives the Futures Application Services Market.” Nov. 21, 2012
Big data: Paraphrased from "The Impact of the Internet of Things on Data Centers." Gartner Research, Feb 27, 2014
Cloud: “Prepare For 2020: Transform Your IT Infrastructure And Operations Practice.” Forrester Research. Oct. 24, 2012
*Microsoft: Cyberspace 2025: Today’s Decisions, Tomorrow’s Terrain
The combination is Disruptive & Game Changing
“Third Platform” (IDC), “Nexus of Forces” (Gartner),
Internet Plus (China PM)

4. Cloud
Social
Big data
Mobility
Mobility

5. Cost-effective, innovative processing…
Level setting – What is Big Data?
VOLUME
(>500GB?)
VARIETY
(Unstructured,
unexpected etc)
VELOCITY
(RT, changes in
related data sets at
different speeds)
http://www.gartner.com/it-glossary/big-data/
http://www.forbes.com/sites/gartnergroup/2013/03/27/gartners-big-data-definition-consists-of-three-parts-not-to-be-confused-with-three-vs/

6. https://www.datanami.com/2015/08/26/why-gartner-dropped-big-
data-off-the-hype-curve/

7. 44
2020
ZETTABYTES
OF DATA
4.4
2013
0.16
2006
1 ZETTABYTE = 1 B TERABYTES
“Data creates opportunity. It's the oil of the 21st century.
Whoever has the right data will ultimately win.”
Peter Sondergaard, senior vice president of Global Research at Gartner
https://www.nyse.com/network/article/Gartner-Whats-Next
Data analytics:
Refers to qualitative and quantitative techniques and processes used to
enhance productivity and business gain from data.

8. Predictive
• Perform
predictions of
outcomes and
behaviors.
Prescriptive.
• How to
achieve
something
(self driving
car)
Descriptive++
• Reports.
• Measurement
• Trends
Diagnostics++
• Web logs.

9. Data analytics:
Refers to qualitative and quantitative techniques and processes used to
enhance productivity and business gain from data.
Descriptive
(What
happened).
Diagnostic.
(Why it
happened)
Predictive.
(What may
happen)
Prescriptive.
(What will happen)

10. Is it A or B?
e.g Will the HDD fail
next month? Yes/No.
How much/how
many?
e.g. what is the
temperature next
Tuesday?
Which option?
e.g. do the car stop
or go on an orange
light.
Is it weird?
e.g. Fraud Detection.
Which groups? e.g.
which viewers like
the same type of
movie.
Reinforcement
Learning

11. EXAMPLE SOLUTIONS

13. Get more
data
Ask a
sharp
question
Put data
in a table
Check for
quality
Transform
features
Answer
the
question
no no no no no
Use the
Answer
no

14. Data
Science Team
Data
Engineering
Math/Stats
Algorithms
Application
Development
Business
Acumen
Data
Management
Data
Dividend

15. Transform data into intelligent action at lower cost , time and skilled resources.
DATA INTELLIGENCE ACTION
Reusable
Intelligence
Dashboards &
Visualizations
Information
Management
Data Stores Machine Learning
and Analytics
Event Hubs
HDInsight
(Hadoop and
Spark)
Stream
Analytics
SQL Data
WarehouseData Catalog
Data Lake
Analytics
Data Factory
Machine
Learning
Data Lake Store
Power BI
Cortana
Web
Mobile
Bots
Bot
Framework
Cognitive
Services
SQL Server

16. MICROSOFT CONFIDENTIAL
Continuous Rapid Disruption
What’s next (The 4th Platform)?
Mobile
Social
“Internet of
Things”
Natural interfaces
Machine Learning
Quantum computing
Delivering
crowdsourced
services
Bridging
physical and
digital worlds
Reinventing the
value chain
Achieving
continuous
uptime
Advancing
human-centric
design
Delivering
faster, smarter
serviceGrowing
sustainably
Cloud
Data
3-D Printing

19. • Went viral : 50 Million Users in 7 Days, 1.2M users/hour.

22. www.botframework.com

23. • Embrace Open Source
• Evolutionary Path to Cloud
• Democratize Data Science
• Skill Re-Use
• Transparent Scaling
• Facilitate Collaboration
• Decouple Data Science from Platforms
• Leverage Hybrid Cloud Architecture
• Accelerate Experimentation
• Streamline Deployment
Broaden The
Talent Pool
Increase
Productivity
Modernize
Infrastructure
Maximize
Innovation
Drive Down
TCO

24. “CYBER SECURITY IS A CEO ISSUE.”
Cyber threats are a
material risk to your
business
200+DAYS
Median number of days
attackers are present on
a victims network before
detection
$3 TRILLION
Impact of lost
productivity and
growth
Average cost of a
data breach
(15% YoY increase)
$3.5 MILLION
Attacks are fast,
efficient, and easier
than you think
46%
of compromised systems
had no malware on them
23%
of recipients opened
phishing messages
50%
of those who open,
click attachments within
the first hour

25. Benefits
Balancing Big Data
Data Governance and
Progressive Privacy Policy
Security and Privacy Controls
BenefitsBenefits Privacy RisksConsumer ExperienceConsumer Experience
Enabling people to work the way they want
Benefits Privacy Risks

26. 28
Real-time access
to reliable data
Self-service access
for everybody
within the
organization
Data-driven
decisions

27. First (1800’s) Second (1900’s) Third (1960) Fourth (TBD)
Steam power took over
horse powered transport
and hand made goods.
Electricity, etc (plane,
engine, movies)
1st and 2nd Platforms
(Digital technology, PC and
Internet)
3rd and 4th Platforms
(Cloud, Big Data, Social,
Mobility, IoT, ML,
Quantum)
Improved logistics and
Manufacturing.
Mass production and
Globalization of products.
Digitally enabled business,
manufacturing and
commerce.
Artificial Intelligence, 3D
printing manufacturing.
Cottage industry to
Manufacturing.
Increased manufacturing
efficiency, enhanced
logistics, Local business to
global business.
Business efficiency,
productive and move from
physical business to online
business.
Digitally powered Physical
would automation,
Innovative business model.
Cottage industry became
irrelevant.
Steam based industry
become irrelevant.
Only 11% of F500
companies in 1950s exist.
TBD 
Industrial Revolution

28. 30
Summary
• Big Data is now pervasive – one of the many tools that is used for processing data.
30