Nervana was just acquired by Intel for their capabilities and platform focused on Deep Learning and Artificial Intelligence. This is an overview deck of what they do.
3. Proprietary and confidential. Do not distribute.
World class team and investors
3
…as well as leading research labs
Exceptional talent
Drawing from experience at world class technology companies…
Steve Jurvetson Matt Ocko Naveen Rao Amir Khosrowshahi
Experienced investors & board
Experienced board members
Elite investors behind industry-shaping companies
4. Proprietary and confidential. Do not distribute.
nervana is built on state of the art deep learning
4
• Features are discovered from data
• Performance improves with more data
Extract features at multiple levels of abstraction
• High degree of representational power
5. Proprietary and confidential. Do not distribute.
Deep learning techniques
Deep learning has significantly improved accuracy
5
Source: ImageNet
1: ImageNet top 5 error rate
Error rate1
human performance
6. Proprietary and confidential. Do not distribute.
Implementing deep learning at scale is hard and expensive
6
Pre-process training
data
Augment
data
Design
model
Perform
hyperparameter
search
• Team of data scientists with deep
learning expertise
• Enormous compute (CPUs /GPUs)
and engineering resources
7. Proprietary and confidential. Do not distribute.
The nervana platform - a full stack solution
7
neon deep learning
framework
nervana
cloud
import trainbuild deploy
8. Proprietary and confidential. Do not distribute.
A new processor technology …
8
• Training and inference
• Scalable distributed architecture
• Memory near computation
• Power efficient
• Unprecedented compute density
9. Proprietary and confidential. Do not distribute.
… will provide 10 to 100x gain in speed
9
ImageNet training
1: Standard Nvidia TitanX GPU
2: TitanX GPU optimized with Nervana software
3: Distributed training across multiple NervanaGPUs
4: Custom Nervana deep learning processor
Traintime(hours)
0
500
1,000
1,500
2,000
CPU Single GPU NervanaGPU Multi NervanaGPU Nervana Engine
11033
100
2,000
2 3 41
10. Proprietary and confidential. Do not distribute.
nervana
solutions
nervana implementation libraries (MOP layer)
nervana deep learning functions
customer
algorithms
customer models nervana models
customer solution
Our software stack is easy to use and extend
10
customer data
Out of the box solutions that are easy to extend
Standard deep networks definitions
Rapid model prototyping and exploration.
Model training and hyperparameter search.
Integration with H/W for training & deployment
• Fastest GPU implementations
• Seamless access to cloud or local CPU/GPU
HARDWARE AGNOSTIC
• Video activity recognition
• Speech recognition
• Time-series prediction
• Object localizer
• Image classifier
• Semantic parsing
• Easy data ingestion
• Curated state of the art models
• Flexible deployment
• REST API for training, inference
11. Proprietary and confidential. Do not distribute.
Create solutions that are trained on YOUR data
11
neon deep
learning
framework
nervana
cloud
Solutions
Images
Text
Tabular
Speech
Time series
Video
12. Proprietary and confidential. Do not distribute.
Image classification and video activity detection
12
Deep learning model Potential applications
• Trained on a public dataset1 of
13K videos in 100 categories
• Training was approximately 3
times faster than competitive
framework
• Can be extended to perform
scene and object detection,
action similarity labeling, video
retrieval, anomaly detection
1: UCF101 dataset: http://crcv.ucf.edu/data/UCF101.php
• Activity detection and
monitoring for security
• Drone detection and tracking
for air traffic mgmt.
• Facial recognition and image
based retrieval
• Sense and avoid systems for
autonomous driving
• Baggage screening at airports
and other public venueshttps://www.youtube.com/watch?v=ydnpgUOpdBw
13. Proprietary and confidential. Do not distribute.
Speech to text conversion
13
1: LibriSpeech: http://www.openslr.org/12/
Deep learning model Potential applications
• Trained on a public
dataset2 of 1,000 hours
of English speech
• Trained in 5 days (vs.
the normal 70 days) on
nervana’s mGPU system
• Can be easily extended
to support other
languages, detect
sentiment, etc.
• Speech recognition for
command and control
systems
• Speech to text conversion
for audio surveillance
• Speech recognition and
automated response for
radio communication
https://youtu.be/NaqZkV_fBIM
14. Proprietary and confidential. Do not distribute.
14
Deep learning model Potential applications
• Includes 20 Q&A types1
ranging from single
supporting facts to
positional reasoning
and agent motivation
• Can be extended to
more complex text
analysis apps like
theme identification
and sentiment analysis
1: Facebook GRU/LSTM: https://research.facebook.com/researchers/1543934539189348
• Summarization and
Identification of themes
in documents, financial
reports or news articles
• Q&A system for querying
any large corpus of text
• Social media monitoring
and sentiment analysis
for intelligence and
security
Natural language processing
15. Proprietary and confidential. Do not distribute.
Why nervana?
15
Fast Easy to use Scalable
Bring your own data Cloud vs. on-premise Professional services
16. Proprietary and confidential. Do not distribute.
Why nervana?
16
Fastest deep learning
framework
Fast
Wide array of out of the box
DL solutions
Easy to use
Scale based on training and
inference needs
Scalable
Solutions are optimized for
your specific use case
Bring your own data
Available either via :
cloud service or
on-premise appliance
Cloud vs. on-premise
Industry leading in-house
team
Professional services
17. Proprietary and confidential. Do not distribute.
Two distinct engagement models
17
Scope
Nervana
HW
Nervana
SW
Nervana
DL Team
Nervana Cloud
• Access to out of the box solutions,
industry leading Nervana framework
and hardware infrastructure
Full
engagement
Nervana Cloud plus:
• Data science support
• Fully optimized deep learning solution
18. Proprietary and confidential. Do not distribute.
Sample Engagements
18
Description
NON-EXHAUSTIVE
Identification and measurement of crops to
drive decisions for precision agriculture
Description
Analysis of speech samples from in-vehicle
communications system
Applying video activity detection techniques to
analyze urban surveillance data
Analysis of uploaded images to detect
fraudulent activity
NLP analysis of financial documents, analyst
and industry reports
Helping predict the occurrence and severity of
storms in climate simulations
Transcription and analysis of customer sales
calls to predict outcomes
Predicting performance of hybrid seeds from
genetic, phenotype, environmental data
Enhancing exchange-traded products and
detecting anomalous patterns in order books
Using NLP techniques to analyze RFPs and
generate recommendations
Precision
Agriculture
Asset
Management
Enterprise
Infrastructure
Genomics
Financial
Services
Security
Sales
Automation
Automotive
Online
Services
Climate
Science
24. Proprietary and confidential. Do not distribute.
nervana has the fastest library
24
neon benchmarks
1: Developed by Facebook and Nvidia
2: Developed by Google
SOURCE: Soumith Chintala; http://github.com/soumith/convnet-benchmarks
1
1
2
25. Proprietary and confidential. Do not distribute.
25
SOURCE: Compiled by Baidu: http://svail.github.io/
nervana has the fastest library
neon benchmarks