SlideShare a Scribd company logo
1 of 32
Download to read offline
February 6, 2020
5G+AI:
The ingredients fueling tomorrow’s
technology innovations
@qualcomm_tech
2
Delivering
on the 5G vision
$13.2 trillion in goods & services by 2035*
3
On-device AI processing
augmented by edge cloud
New experiences Privacy/security
New verticals
Immediacy
Private/public networks Personalization
Customized/
local value Reliability
The intelligent
wireless edge
Efficiency
Processing
over 5G
Edge cloud On-device
4
Process data at the source to scale AI
and make sense of a digitized world
Past
Cloud-centric AI
AI training and AI inference
in the central cloud
Future
Fully-distributed AI
With lifelong on-device learning
Today
Partially-distributed AI
Power-efficient
on-device AI inference
On-device
5
Applying AI to overcome
wireless challenges
+
6
Wireless challenges
Hard-to-model problems
Computational infeasibility of
optimal solution
Efficient modem parameter
optimization
Dealing with non-linearity
AI strengths
Determining appropriate
representations for hard-to-
model problems
Finding near-ideal and
computationally realizable
solutions
Modeling non-linear functions
Applying AI to solve difficult wireless challenges
Deep wireless domain knowledge is required to optimally use AI capabilities
AI-enhanced
wireless communications
7
AI enables intelligent 5G network management
Enhanced service quality
Better mobility management, user
localization, and user behavior and
demand prediction
Higher network efficiency
More efficient scheduling, radio
resource utilization, congestion
control and routing
Simplified deployment
More capable Self Organizing
Networks (SON) for e.g., mmWave
network densification
Improved network security
More effective detection and defense
against malicious attacks by analyzing a
massive quantity of data
8
On-device AI improves the 5G end-to-end system
Radio awareness
Environmental and contextual
sensing that reduces access
overhead and latency
On-device
AI
Enhanced device experience
More intelligent beamforming & power management
improve throughput, robustness, and battery life
Improved system performance
On-device inference reduces network data traffic
for more efficient mobility and spectrum utilization
Better radio security
Detecting and defending against malicious base
station spoofing and jamming with fingerprinting
9
Radio awareness
Achieved by advanced
on-device AI algorithms
Spectrum sensing and access
Predict activities of other devices for more efficient
access and better scheduling to improve 5G system
performance
Contextual awareness
Use device context (e.g., position, velocity, or in-
car) derived from RF, sensors, traffic activities to
improve device experience
Environment (RF) sensing
Detect gestures, movements, and objects by monitoring
signal reflection patterns to enable new use cases
10
On-device AI enhances 5G device experience
Agent
Environment
Action
Select Tx/Rx
beams
State
M strongest
RSRPs
Reward
Throughput,
power savings
Deep reinforcement learning
example
On-device
AI
Better beam management
Incorporate location, velocity, other aspects
of environmental and application awareness
to improve robustness and throughput
More power saving
Optimize performance/power consumption
tradeoffs by taking advantage of better
contextual awareness on device
11
On-device AI improves 5G system performance
Better link adaptation
Position-aware interference prediction can improve
overall system throughput and spectral efficiency
More seamless mobility
Device-centric mobility utilizes on-device
AI and sensors to predict handovers
Reduced network loading
On-device AI inference reduces the amount of
raw data needed be sent across the network
AI inference result
121 Channel State Feedback
Applying AI for enhanced 5G air interface efficiency
Example: for uplink transmissions
Improving device
power efficiency
Improving system
spectral efficiency
Implementing a neural network framework for CSI1 on non-linear temporal encoding & decoding
Encoder
at the device
Decoder
at the base station
Data or
control
channel
Downlink
channel
estimates
CSI
encoder
Data or
control
channel
Reconstructed
downlink channel
estimates
Allowing receiver to recover signal from a
device operating in the non-linear PA region
Optimizing transmit waveform to reduce
peak-to-average power ratio (PAPR)
CSI
decoder
131. For example, Observed Time Difference of Arrival (OTDOA), Multiple Round Trip Time (Multi-RTT), Angle of Arrival (AoA)
Applying AI for contextual awareness & environmental sensing
More accurate device positioning
Learning device position over time
without prior knowledge with RF
sensing — complementing existing
positioning methodologies1
Blockage
RF sensing
Multi-path detection
NLOS
LOS
Motion and gesture detection
Sensing changes in environment to
infer location and type of motion for
a wide range of use cases (e.g.,
vital sign tracking, fall detection)
14
Channel estimation Radio resource allocation
Power saving
Vehicular communicationsPositioning
Security
Device non-linearity Contextual awareness
Environmental sensingMIMO detection
Full duplex
TCP optimization Beam management
and optimization
Spectrum sensing
AI research areas to
enhance 5G
15
Applying 5G to enhance
AI-powered experiences
+
16
5G + AI deliver enhanced
services and experiences
Distribute AI processing between the device and
cloud over wireless
Compute, vision, sensing
AI powered use cases
Internal AI optimizations
5G low latency
Customized/local value
Content/storage/AI/processing
Longer latency
Big data/aggregated value
Content/storage/AI/processing
Distributed functionality
New services
Cloud computing, storage,
instant access
Real time assisted
services like voice UI
Low-latency gaming
On-device intelligence
assisted by cloud
Central cloud Edge cloud Device
Performance and economic tradeoffs per use case may determine how to distribute functions
e.g. to reach required latency or compute
Distributed processing,
like boundless XR
On-premise control for
ultra-low latency
17
Personalized shopping through boundless AR
AI processing split between device and edge cloud
18
Head pose, image, …
Encoded data
On-device
adjustment to
latest pose1
XR headset
Deeper
in network
On-premise,
e.g. venue
Rendering, scene understanding,
classification, recommendation, …
Cloud
The edge cloud augments on-device processing for
boundless XR
Edge cloud
Partial processing offload possible with 5G’s
low latency, capacity and quality of service
Power-efficient, latency sensitive on-
device intelligence and rendering
Today’s latency is
unpredictable
Less latency sensitive content
(e.g. recorded streaming video)
Rendering, perception, prediction,
personalization
1. Asynchronous time warp reduces Motion to Photon (MTP) latency by using on-device processing based on the latest available pose. MTP below 20 ms generally avoids discomfort — has to be processed on the device
19
Intuitive virtual
assistants through
vastly improved
voice UI
v
Designed to be:
Always-on
Conversational
Personal
Private
20
Automatic speech
recognition
Natural language
understanding
Text-to-speech
Distributed computing enables a responsive voice UI
5G low latency allows AI tasks to be split between the device and cloud
AI agent
Sensor
fusion
Voice
activation
Echo cancel,
speech denoising
Automatic speech
recognition
Natural language
understanding
Text-to-speech
News
SMS
Music
Maps
Weather
Video
Service
manager
Continuously
learns based on
personal
information and
acts intuitively
with immediacy
Less privacy and
personalization
Both ends are needed — 5G allows various implementation for appropriate tradeoffs
21
The reconfigurable factory of the future will thrive
in the 5G+AI era
22
Enhanced
mobile broadband
Massive
IoT
Ultra-reliable
low-latency
Automated guided vehicle (AGV)
Wireless edge analytics
Computer vision
Sensors
Head mounted display
Industrial robot
Handheld terminal
23
Distributed learning
over wireless
24
Distributed learning for an
intelligent world
2525
On-device AI processing of sensors and personal information conserves
bandwidth while providing contextual intelligence, personalization, and privacy
Devices generate and possess massive amounts of data
Calendar
Messaging
Apps
On-device data
Cloud data/rich content
Off-device data
IoT data
Gyroscope
Compass
Camera
Ambient light
Temperature
FingerprintEnvironment
Pulse
HumidityMicrophone
Sensor data
Eye tracking C-V2X
Sensor fusion
and processing
26
Distributed learning over 5G is the way to scale intelligence
D1
D2
DN
...
Each device collects
personal data and performs
on-device training
Cloud
A state-of-art global AI
model is distributed to
devices
1 2
Privacy
Raw data stays on the device
Scale
Processing is spread over
many devices
Personalization
Model customized based on your
personal data
27
5G
Distributed learning over 5G is the way to scale intelligence
D1
D2
DN
...
Each device:
1. Adds perturbation to the
parameters of the AI model
2. Compresses the parameters
3. Encrypts them
4. Sends the update to the cloud
The cloud updates the AI
model and then sends it to
the devices again
4 3
Cloud
PrivacyScale Personalization
Only noisy and encrypted
weights sent to the cloud
Network bandwidth is
conserved
28
Research directions
for distributed learning
over wireless
Optimizing the communication network
Compressing information sent on the uplink and downlink
Tackling statistical heterogeneity in data
Smartly combining model updates from a broad distribution
Privacy
Model parameter perturbations with privacy guarantees
...
Personalization
Meta learning with optimized global model starting point
On-device training efficiency
Light-weight models and training
Advanced topologies for distributed learning
Peer-to-peer, multi-cloud, and hierarchical privacy
29
Foundational
R&D
Qualcomm AI
Research
Ecosystem
investment
Advanced
silicon
5G + AI
technology
leadership
Qualcomm
Ventures AI
Fund
Uniquely positioned to power the
intelligently connected future
X55
Qualcomm AI Research is an initiative of Qualcomm Technologies, Inc. Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.
3030
AI is making 5G better —
in the network and on the device
On-device AI processing is
essential, and even more so in the
5G era
5G is empowering a new
computing paradigm:
distributed learning over wireless
31
Connect with Us
Questions?
@qualcomm_tech
SlideShare
YouTube
www.qualcomm.com/ai
www.qualcomm.com/5g
BLOG
www.qualcomm.com/news/onq
Follow us on:
For more information, visit us at:
www.qualcomm.com & www.qualcomm.com/blog
Thank you
Nothing in these materials is an offer to sell any of the
components or devices referenced herein.
©2018-2020 Qualcomm Technologies, Inc. and/or its
affiliated companies. All Rights Reserved.
Qualcomm and Snapdragon are trademarks of Qualcomm
Incorporated, registered in the United States and other
countries. Other products and brand names may be
trademarks or registered trademarks of their respective
owners.
References in this presentation to “Qualcomm” may mean
Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or
other subsidiaries or business units within the Qualcomm
corporate structure, as applicable. Qualcomm Incorporated
includes Qualcomm’s licensing business, QTL, and the vast
majority of its patent portfolio. Qualcomm Technologies, Inc.,
a wholly-owned subsidiary of Qualcomm Incorporated, operates,
along with its subsidiaries, substantially all of Qualcomm’s
engineering, research and development functions, and
substantially all of its product and services businesses, including
its semiconductor business, QCT.

More Related Content

What's hot

6G Training Course Part 8: 6G Devices
6G Training Course Part 8: 6G Devices6G Training Course Part 8: 6G Devices
6G Training Course Part 8: 6G Devices3G4G
 
5 g wireless system
5 g wireless system5 g wireless system
5 g wireless systemSanjit Shaw
 
Technology trends towards 6G
Technology trends towards 6GTechnology trends towards 6G
Technology trends towards 6GAlain Mourad
 
5G Presentation
5G Presentation5G Presentation
5G PresentationEricsson
 
5G positioning for the connected intelligent edge
5G positioning for the connected intelligent edge5G positioning for the connected intelligent edge
5G positioning for the connected intelligent edgeQualcomm Research
 
Understanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdfUnderstanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdfQualcomm Research
 
Advanced: Private Networks & 5G Non-Public Networks
Advanced: Private Networks & 5G Non-Public NetworksAdvanced: Private Networks & 5G Non-Public Networks
Advanced: Private Networks & 5G Non-Public Networks3G4G
 
5G wireless technology
5G wireless technology5G wireless technology
5G wireless technologyAndeAkash
 
Scaling 5G to new frontiers with NR-Light (RedCap)
Scaling 5G to new frontiers with NR-Light (RedCap)Scaling 5G to new frontiers with NR-Light (RedCap)
Scaling 5G to new frontiers with NR-Light (RedCap)Qualcomm Research
 
Beginners: 5G Spectrum - Short Version
Beginners: 5G Spectrum - Short VersionBeginners: 5G Spectrum - Short Version
Beginners: 5G Spectrum - Short Version3G4G
 
5G technology
5G technology 5G technology
5G technology Taha Baig
 
gi-fi :the next generation wireless technology
gi-fi :the next generation wireless technologygi-fi :the next generation wireless technology
gi-fi :the next generation wireless technologyHarshad Kale
 
Ericsson Distributed Cloud
Ericsson Distributed CloudEricsson Distributed Cloud
Ericsson Distributed CloudEricsson
 
5G and Automative : Cellular V2X (vehicle-to-everything)
5G and Automative : Cellular V2X (vehicle-to-everything)5G and Automative : Cellular V2X (vehicle-to-everything)
5G and Automative : Cellular V2X (vehicle-to-everything)ITU
 

What's hot (20)

Nb iot presentation
Nb iot presentationNb iot presentation
Nb iot presentation
 
6G Training Course Part 8: 6G Devices
6G Training Course Part 8: 6G Devices6G Training Course Part 8: 6G Devices
6G Training Course Part 8: 6G Devices
 
5 g wireless system
5 g wireless system5 g wireless system
5 g wireless system
 
5G
5G5G
5G
 
Technology trends towards 6G
Technology trends towards 6GTechnology trends towards 6G
Technology trends towards 6G
 
5G Presentation
5G Presentation5G Presentation
5G Presentation
 
5G positioning for the connected intelligent edge
5G positioning for the connected intelligent edge5G positioning for the connected intelligent edge
5G positioning for the connected intelligent edge
 
Understanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdfUnderstanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdf
 
Advanced: Private Networks & 5G Non-Public Networks
Advanced: Private Networks & 5G Non-Public NetworksAdvanced: Private Networks & 5G Non-Public Networks
Advanced: Private Networks & 5G Non-Public Networks
 
6 g tecnology
6 g tecnology6 g tecnology
6 g tecnology
 
5G wireless technology
5G wireless technology5G wireless technology
5G wireless technology
 
Scaling 5G to new frontiers with NR-Light (RedCap)
Scaling 5G to new frontiers with NR-Light (RedCap)Scaling 5G to new frontiers with NR-Light (RedCap)
Scaling 5G to new frontiers with NR-Light (RedCap)
 
Beginners: 5G Spectrum - Short Version
Beginners: 5G Spectrum - Short VersionBeginners: 5G Spectrum - Short Version
Beginners: 5G Spectrum - Short Version
 
5G technology
5G technology 5G technology
5G technology
 
5 g technology
5 g technology5 g technology
5 g technology
 
gi-fi :the next generation wireless technology
gi-fi :the next generation wireless technologygi-fi :the next generation wireless technology
gi-fi :the next generation wireless technology
 
5G wireless technology
5G wireless technology5G wireless technology
5G wireless technology
 
5G Fundamentals
5G Fundamentals5G Fundamentals
5G Fundamentals
 
Ericsson Distributed Cloud
Ericsson Distributed CloudEricsson Distributed Cloud
Ericsson Distributed Cloud
 
5G and Automative : Cellular V2X (vehicle-to-everything)
5G and Automative : Cellular V2X (vehicle-to-everything)5G and Automative : Cellular V2X (vehicle-to-everything)
5G and Automative : Cellular V2X (vehicle-to-everything)
 

Similar to 5G + AI: The Ingredients For Next Generation Wireless Innovation

5G AI the Ingredients for Next Gen Wireless Innovation
5G AI the Ingredients for Next Gen Wireless Innovation5G AI the Ingredients for Next Gen Wireless Innovation
5G AI the Ingredients for Next Gen Wireless InnovationTakayuki Yamazaki
 
Boundless Photorealistic Mobile XR Over 5G
Boundless Photorealistic Mobile XR Over 5GBoundless Photorealistic Mobile XR Over 5G
Boundless Photorealistic Mobile XR Over 5GQualcomm Research
 
Intelligently connecting our world in the 5G era
Intelligently connecting our world in the 5G eraIntelligently connecting our world in the 5G era
Intelligently connecting our world in the 5G eraQualcomm Research
 
How 5G Will Transform Industrial IoT
How 5G Will Transform Industrial IoTHow 5G Will Transform Industrial IoT
How 5G Will Transform Industrial IoTQualcomm Research
 
Leading Research Across the AI Spectrum
Leading Research Across the AI SpectrumLeading Research Across the AI Spectrum
Leading Research Across the AI SpectrumQualcomm Research
 
IoT from edge to cloud: bringing order to the chaos
IoT from edge to cloud: bringing order to the chaosIoT from edge to cloud: bringing order to the chaos
IoT from edge to cloud: bringing order to the chaosXylos
 
How will sidelink bring a new level of 5G versatility.pdf
How will sidelink bring a new level of 5G versatility.pdfHow will sidelink bring a new level of 5G versatility.pdf
How will sidelink bring a new level of 5G versatility.pdfQualcomm Research
 
Israel's First Internet of Things Conference
Israel's First Internet of Things ConferenceIsrael's First Internet of Things Conference
Israel's First Internet of Things ConferenceGeminiVC
 
A Comprehensive Exploration of Fog Computing.pdf
A Comprehensive Exploration of Fog Computing.pdfA Comprehensive Exploration of Fog Computing.pdf
A Comprehensive Exploration of Fog Computing.pdfEnterprise Wired
 
Brian Vogelsang (Qualcomm): 5G and the Augmented Enterprise
Brian Vogelsang (Qualcomm): 5G and the Augmented EnterpriseBrian Vogelsang (Qualcomm): 5G and the Augmented Enterprise
Brian Vogelsang (Qualcomm): 5G and the Augmented EnterpriseAugmentedWorldExpo
 
EDGE SEMINAR.pptx
EDGE SEMINAR.pptxEDGE SEMINAR.pptx
EDGE SEMINAR.pptxSachuS16
 
What Is Edge Computing? Everything You Need to Know
What Is Edge Computing? Everything You Need to KnowWhat Is Edge Computing? Everything You Need to Know
What Is Edge Computing? Everything You Need to KnowDigital Carbon
 

Similar to 5G + AI: The Ingredients For Next Generation Wireless Innovation (20)

5G AI the Ingredients for Next Gen Wireless Innovation
5G AI the Ingredients for Next Gen Wireless Innovation5G AI the Ingredients for Next Gen Wireless Innovation
5G AI the Ingredients for Next Gen Wireless Innovation
 
Making AI Ubiquitous
Making AI UbiquitousMaking AI Ubiquitous
Making AI Ubiquitous
 
Boundless Photorealistic Mobile XR Over 5G
Boundless Photorealistic Mobile XR Over 5GBoundless Photorealistic Mobile XR Over 5G
Boundless Photorealistic Mobile XR Over 5G
 
More Immersive XR through Split-Rendering
More Immersive XR through Split-RenderingMore Immersive XR through Split-Rendering
More Immersive XR through Split-Rendering
 
Intelligently connecting our world in the 5G era
Intelligently connecting our world in the 5G eraIntelligently connecting our world in the 5G era
Intelligently connecting our world in the 5G era
 
How 5G Will Transform Industrial IoT
How 5G Will Transform Industrial IoTHow 5G Will Transform Industrial IoT
How 5G Will Transform Industrial IoT
 
Leading Research Across the AI Spectrum
Leading Research Across the AI SpectrumLeading Research Across the AI Spectrum
Leading Research Across the AI Spectrum
 
IoT from edge to cloud: bringing order to the chaos
IoT from edge to cloud: bringing order to the chaosIoT from edge to cloud: bringing order to the chaos
IoT from edge to cloud: bringing order to the chaos
 
Edge Computing.pdf
Edge Computing.pdfEdge Computing.pdf
Edge Computing.pdf
 
How will sidelink bring a new level of 5G versatility.pdf
How will sidelink bring a new level of 5G versatility.pdfHow will sidelink bring a new level of 5G versatility.pdf
How will sidelink bring a new level of 5G versatility.pdf
 
M2M-IoT towards 5G
M2M-IoT towards 5GM2M-IoT towards 5G
M2M-IoT towards 5G
 
Israel's First Internet of Things Conference
Israel's First Internet of Things ConferenceIsrael's First Internet of Things Conference
Israel's First Internet of Things Conference
 
A Comprehensive Exploration of Fog Computing.pdf
A Comprehensive Exploration of Fog Computing.pdfA Comprehensive Exploration of Fog Computing.pdf
A Comprehensive Exploration of Fog Computing.pdf
 
Edge Computing.pptx
Edge Computing.pptxEdge Computing.pptx
Edge Computing.pptx
 
Iot how it works
Iot   how it worksIot   how it works
Iot how it works
 
Brian Vogelsang (Qualcomm): 5G and the Augmented Enterprise
Brian Vogelsang (Qualcomm): 5G and the Augmented EnterpriseBrian Vogelsang (Qualcomm): 5G and the Augmented Enterprise
Brian Vogelsang (Qualcomm): 5G and the Augmented Enterprise
 
Presentation1.pptx
Presentation1.pptxPresentation1.pptx
Presentation1.pptx
 
5g-vision-document.pdf
5g-vision-document.pdf5g-vision-document.pdf
5g-vision-document.pdf
 
EDGE SEMINAR.pptx
EDGE SEMINAR.pptxEDGE SEMINAR.pptx
EDGE SEMINAR.pptx
 
What Is Edge Computing? Everything You Need to Know
What Is Edge Computing? Everything You Need to KnowWhat Is Edge Computing? Everything You Need to Know
What Is Edge Computing? Everything You Need to Know
 

More from Qualcomm Research

Generative AI at the edge.pdf
Generative AI at the edge.pdfGenerative AI at the edge.pdf
Generative AI at the edge.pdfQualcomm Research
 
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AI
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AIQualcomm Webinar: Solving Unsolvable Combinatorial Problems with AI
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AIQualcomm Research
 
Enabling the metaverse with 5G- web.pdf
Enabling the metaverse with 5G- web.pdfEnabling the metaverse with 5G- web.pdf
Enabling the metaverse with 5G- web.pdfQualcomm Research
 
Presentation - Model Efficiency for Edge AI
Presentation - Model Efficiency for Edge AIPresentation - Model Efficiency for Edge AI
Presentation - Model Efficiency for Edge AIQualcomm Research
 
Realizing mission-critical industrial automation with 5G
Realizing mission-critical industrial automation with 5GRealizing mission-critical industrial automation with 5G
Realizing mission-critical industrial automation with 5GQualcomm Research
 
AI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-conceptAI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-conceptQualcomm Research
 
Setting off the 5G Advanced evolution with 3GPP Release 18
Setting off the 5G Advanced evolution with 3GPP Release 18Setting off the 5G Advanced evolution with 3GPP Release 18
Setting off the 5G Advanced evolution with 3GPP Release 18Qualcomm Research
 
Enabling on-device learning at scale
Enabling on-device learning at scaleEnabling on-device learning at scale
Enabling on-device learning at scaleQualcomm Research
 
How AI research is enabling next-gen codecs
How AI research is enabling next-gen codecsHow AI research is enabling next-gen codecs
How AI research is enabling next-gen codecsQualcomm Research
 
Role of localization and environment perception in autonomous driving
Role of localization and environment perception in autonomous drivingRole of localization and environment perception in autonomous driving
Role of localization and environment perception in autonomous drivingQualcomm Research
 
Intelligence at scale through AI model efficiency
Intelligence at scale through AI model efficiencyIntelligence at scale through AI model efficiency
Intelligence at scale through AI model efficiencyQualcomm Research
 
How to build high performance 5G networks with vRAN and O-RAN
How to build high performance 5G networks with vRAN and O-RANHow to build high performance 5G networks with vRAN and O-RAN
How to build high performance 5G networks with vRAN and O-RANQualcomm Research
 
What's in the future of 5G millimeter wave?
What's in the future of 5G millimeter wave? What's in the future of 5G millimeter wave?
What's in the future of 5G millimeter wave? Qualcomm Research
 
Efficient video perception through AI
Efficient video perception through AIEfficient video perception through AI
Efficient video perception through AIQualcomm Research
 
Enabling the rise of the smartphone: Chronicling the developmental history at...
Enabling the rise of the smartphone: Chronicling the developmental history at...Enabling the rise of the smartphone: Chronicling the developmental history at...
Enabling the rise of the smartphone: Chronicling the developmental history at...Qualcomm Research
 
5G spectrum innovations and global update
5G spectrum innovations and global update5G spectrum innovations and global update
5G spectrum innovations and global updateQualcomm Research
 
Transforming enterprise and industry with 5G private networks
Transforming enterprise and industry with 5G private networksTransforming enterprise and industry with 5G private networks
Transforming enterprise and industry with 5G private networksQualcomm Research
 
The essential role of technology standards
The essential role of technology standardsThe essential role of technology standards
The essential role of technology standardsQualcomm Research
 

More from Qualcomm Research (20)

Generative AI at the edge.pdf
Generative AI at the edge.pdfGenerative AI at the edge.pdf
Generative AI at the edge.pdf
 
The future of AI is hybrid
The future of AI is hybridThe future of AI is hybrid
The future of AI is hybrid
 
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AI
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AIQualcomm Webinar: Solving Unsolvable Combinatorial Problems with AI
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AI
 
Enabling the metaverse with 5G- web.pdf
Enabling the metaverse with 5G- web.pdfEnabling the metaverse with 5G- web.pdf
Enabling the metaverse with 5G- web.pdf
 
Presentation - Model Efficiency for Edge AI
Presentation - Model Efficiency for Edge AIPresentation - Model Efficiency for Edge AI
Presentation - Model Efficiency for Edge AI
 
Realizing mission-critical industrial automation with 5G
Realizing mission-critical industrial automation with 5GRealizing mission-critical industrial automation with 5G
Realizing mission-critical industrial automation with 5G
 
AI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-conceptAI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-concept
 
Setting off the 5G Advanced evolution with 3GPP Release 18
Setting off the 5G Advanced evolution with 3GPP Release 18Setting off the 5G Advanced evolution with 3GPP Release 18
Setting off the 5G Advanced evolution with 3GPP Release 18
 
Enabling on-device learning at scale
Enabling on-device learning at scaleEnabling on-device learning at scale
Enabling on-device learning at scale
 
How AI research is enabling next-gen codecs
How AI research is enabling next-gen codecsHow AI research is enabling next-gen codecs
How AI research is enabling next-gen codecs
 
Role of localization and environment perception in autonomous driving
Role of localization and environment perception in autonomous drivingRole of localization and environment perception in autonomous driving
Role of localization and environment perception in autonomous driving
 
Pioneering 5G broadcast
Pioneering 5G broadcastPioneering 5G broadcast
Pioneering 5G broadcast
 
Intelligence at scale through AI model efficiency
Intelligence at scale through AI model efficiencyIntelligence at scale through AI model efficiency
Intelligence at scale through AI model efficiency
 
How to build high performance 5G networks with vRAN and O-RAN
How to build high performance 5G networks with vRAN and O-RANHow to build high performance 5G networks with vRAN and O-RAN
How to build high performance 5G networks with vRAN and O-RAN
 
What's in the future of 5G millimeter wave?
What's in the future of 5G millimeter wave? What's in the future of 5G millimeter wave?
What's in the future of 5G millimeter wave?
 
Efficient video perception through AI
Efficient video perception through AIEfficient video perception through AI
Efficient video perception through AI
 
Enabling the rise of the smartphone: Chronicling the developmental history at...
Enabling the rise of the smartphone: Chronicling the developmental history at...Enabling the rise of the smartphone: Chronicling the developmental history at...
Enabling the rise of the smartphone: Chronicling the developmental history at...
 
5G spectrum innovations and global update
5G spectrum innovations and global update5G spectrum innovations and global update
5G spectrum innovations and global update
 
Transforming enterprise and industry with 5G private networks
Transforming enterprise and industry with 5G private networksTransforming enterprise and industry with 5G private networks
Transforming enterprise and industry with 5G private networks
 
The essential role of technology standards
The essential role of technology standardsThe essential role of technology standards
The essential role of technology standards
 

Recently uploaded

DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 

Recently uploaded (20)

DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 

5G + AI: The Ingredients For Next Generation Wireless Innovation

  • 1. February 6, 2020 5G+AI: The ingredients fueling tomorrow’s technology innovations @qualcomm_tech
  • 2. 2 Delivering on the 5G vision $13.2 trillion in goods & services by 2035*
  • 3. 3 On-device AI processing augmented by edge cloud New experiences Privacy/security New verticals Immediacy Private/public networks Personalization Customized/ local value Reliability The intelligent wireless edge Efficiency Processing over 5G Edge cloud On-device
  • 4. 4 Process data at the source to scale AI and make sense of a digitized world Past Cloud-centric AI AI training and AI inference in the central cloud Future Fully-distributed AI With lifelong on-device learning Today Partially-distributed AI Power-efficient on-device AI inference On-device
  • 5. 5 Applying AI to overcome wireless challenges +
  • 6. 6 Wireless challenges Hard-to-model problems Computational infeasibility of optimal solution Efficient modem parameter optimization Dealing with non-linearity AI strengths Determining appropriate representations for hard-to- model problems Finding near-ideal and computationally realizable solutions Modeling non-linear functions Applying AI to solve difficult wireless challenges Deep wireless domain knowledge is required to optimally use AI capabilities AI-enhanced wireless communications
  • 7. 7 AI enables intelligent 5G network management Enhanced service quality Better mobility management, user localization, and user behavior and demand prediction Higher network efficiency More efficient scheduling, radio resource utilization, congestion control and routing Simplified deployment More capable Self Organizing Networks (SON) for e.g., mmWave network densification Improved network security More effective detection and defense against malicious attacks by analyzing a massive quantity of data
  • 8. 8 On-device AI improves the 5G end-to-end system Radio awareness Environmental and contextual sensing that reduces access overhead and latency On-device AI Enhanced device experience More intelligent beamforming & power management improve throughput, robustness, and battery life Improved system performance On-device inference reduces network data traffic for more efficient mobility and spectrum utilization Better radio security Detecting and defending against malicious base station spoofing and jamming with fingerprinting
  • 9. 9 Radio awareness Achieved by advanced on-device AI algorithms Spectrum sensing and access Predict activities of other devices for more efficient access and better scheduling to improve 5G system performance Contextual awareness Use device context (e.g., position, velocity, or in- car) derived from RF, sensors, traffic activities to improve device experience Environment (RF) sensing Detect gestures, movements, and objects by monitoring signal reflection patterns to enable new use cases
  • 10. 10 On-device AI enhances 5G device experience Agent Environment Action Select Tx/Rx beams State M strongest RSRPs Reward Throughput, power savings Deep reinforcement learning example On-device AI Better beam management Incorporate location, velocity, other aspects of environmental and application awareness to improve robustness and throughput More power saving Optimize performance/power consumption tradeoffs by taking advantage of better contextual awareness on device
  • 11. 11 On-device AI improves 5G system performance Better link adaptation Position-aware interference prediction can improve overall system throughput and spectral efficiency More seamless mobility Device-centric mobility utilizes on-device AI and sensors to predict handovers Reduced network loading On-device AI inference reduces the amount of raw data needed be sent across the network AI inference result
  • 12. 121 Channel State Feedback Applying AI for enhanced 5G air interface efficiency Example: for uplink transmissions Improving device power efficiency Improving system spectral efficiency Implementing a neural network framework for CSI1 on non-linear temporal encoding & decoding Encoder at the device Decoder at the base station Data or control channel Downlink channel estimates CSI encoder Data or control channel Reconstructed downlink channel estimates Allowing receiver to recover signal from a device operating in the non-linear PA region Optimizing transmit waveform to reduce peak-to-average power ratio (PAPR) CSI decoder
  • 13. 131. For example, Observed Time Difference of Arrival (OTDOA), Multiple Round Trip Time (Multi-RTT), Angle of Arrival (AoA) Applying AI for contextual awareness & environmental sensing More accurate device positioning Learning device position over time without prior knowledge with RF sensing — complementing existing positioning methodologies1 Blockage RF sensing Multi-path detection NLOS LOS Motion and gesture detection Sensing changes in environment to infer location and type of motion for a wide range of use cases (e.g., vital sign tracking, fall detection)
  • 14. 14 Channel estimation Radio resource allocation Power saving Vehicular communicationsPositioning Security Device non-linearity Contextual awareness Environmental sensingMIMO detection Full duplex TCP optimization Beam management and optimization Spectrum sensing AI research areas to enhance 5G
  • 15. 15 Applying 5G to enhance AI-powered experiences +
  • 16. 16 5G + AI deliver enhanced services and experiences Distribute AI processing between the device and cloud over wireless Compute, vision, sensing AI powered use cases Internal AI optimizations 5G low latency Customized/local value Content/storage/AI/processing Longer latency Big data/aggregated value Content/storage/AI/processing Distributed functionality New services Cloud computing, storage, instant access Real time assisted services like voice UI Low-latency gaming On-device intelligence assisted by cloud Central cloud Edge cloud Device Performance and economic tradeoffs per use case may determine how to distribute functions e.g. to reach required latency or compute Distributed processing, like boundless XR On-premise control for ultra-low latency
  • 17. 17 Personalized shopping through boundless AR AI processing split between device and edge cloud
  • 18. 18 Head pose, image, … Encoded data On-device adjustment to latest pose1 XR headset Deeper in network On-premise, e.g. venue Rendering, scene understanding, classification, recommendation, … Cloud The edge cloud augments on-device processing for boundless XR Edge cloud Partial processing offload possible with 5G’s low latency, capacity and quality of service Power-efficient, latency sensitive on- device intelligence and rendering Today’s latency is unpredictable Less latency sensitive content (e.g. recorded streaming video) Rendering, perception, prediction, personalization 1. Asynchronous time warp reduces Motion to Photon (MTP) latency by using on-device processing based on the latest available pose. MTP below 20 ms generally avoids discomfort — has to be processed on the device
  • 19. 19 Intuitive virtual assistants through vastly improved voice UI v Designed to be: Always-on Conversational Personal Private
  • 20. 20 Automatic speech recognition Natural language understanding Text-to-speech Distributed computing enables a responsive voice UI 5G low latency allows AI tasks to be split between the device and cloud AI agent Sensor fusion Voice activation Echo cancel, speech denoising Automatic speech recognition Natural language understanding Text-to-speech News SMS Music Maps Weather Video Service manager Continuously learns based on personal information and acts intuitively with immediacy Less privacy and personalization Both ends are needed — 5G allows various implementation for appropriate tradeoffs
  • 21. 21 The reconfigurable factory of the future will thrive in the 5G+AI era
  • 22. 22 Enhanced mobile broadband Massive IoT Ultra-reliable low-latency Automated guided vehicle (AGV) Wireless edge analytics Computer vision Sensors Head mounted display Industrial robot Handheld terminal
  • 24. 24 Distributed learning for an intelligent world
  • 25. 2525 On-device AI processing of sensors and personal information conserves bandwidth while providing contextual intelligence, personalization, and privacy Devices generate and possess massive amounts of data Calendar Messaging Apps On-device data Cloud data/rich content Off-device data IoT data Gyroscope Compass Camera Ambient light Temperature FingerprintEnvironment Pulse HumidityMicrophone Sensor data Eye tracking C-V2X Sensor fusion and processing
  • 26. 26 Distributed learning over 5G is the way to scale intelligence D1 D2 DN ... Each device collects personal data and performs on-device training Cloud A state-of-art global AI model is distributed to devices 1 2 Privacy Raw data stays on the device Scale Processing is spread over many devices Personalization Model customized based on your personal data
  • 27. 27 5G Distributed learning over 5G is the way to scale intelligence D1 D2 DN ... Each device: 1. Adds perturbation to the parameters of the AI model 2. Compresses the parameters 3. Encrypts them 4. Sends the update to the cloud The cloud updates the AI model and then sends it to the devices again 4 3 Cloud PrivacyScale Personalization Only noisy and encrypted weights sent to the cloud Network bandwidth is conserved
  • 28. 28 Research directions for distributed learning over wireless Optimizing the communication network Compressing information sent on the uplink and downlink Tackling statistical heterogeneity in data Smartly combining model updates from a broad distribution Privacy Model parameter perturbations with privacy guarantees ... Personalization Meta learning with optimized global model starting point On-device training efficiency Light-weight models and training Advanced topologies for distributed learning Peer-to-peer, multi-cloud, and hierarchical privacy
  • 29. 29 Foundational R&D Qualcomm AI Research Ecosystem investment Advanced silicon 5G + AI technology leadership Qualcomm Ventures AI Fund Uniquely positioned to power the intelligently connected future X55 Qualcomm AI Research is an initiative of Qualcomm Technologies, Inc. Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.
  • 30. 3030 AI is making 5G better — in the network and on the device On-device AI processing is essential, and even more so in the 5G era 5G is empowering a new computing paradigm: distributed learning over wireless
  • 32. Follow us on: For more information, visit us at: www.qualcomm.com & www.qualcomm.com/blog Thank you Nothing in these materials is an offer to sell any of the components or devices referenced herein. ©2018-2020 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved. Qualcomm and Snapdragon are trademarks of Qualcomm Incorporated, registered in the United States and other countries. Other products and brand names may be trademarks or registered trademarks of their respective owners. References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm’s engineering, research and development functions, and substantially all of its product and services businesses, including its semiconductor business, QCT.