Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
TOMTOM’S AI: WORLD-CLASS MAPS AND
TRAFFIC FOR AUTONOMOUS DRIVING
Soeren Sonnenburg
TomTom AI Geospatial Research (TAIGR)
T...
TomTom?!?!
TomTom 2019 ©. All right reserved.3
WE ARE
TOMTOM
Leading independent location technology
specialist, shaping mobility with highly
accurate maps, navigation s...
Highly accurate maps
Navigation software
The leading
independent
location
technology
specialist
Highly accurate maps
Navig...
Founded Launched first
navigation
software
Introduced the
portable navigation
device
Acquired
HD Traffic
technology
Acquir...
Switch from software to hardware
and back again
30
70
2003
82
18
2008
62
38
2013
31
69
2018
Software Hardware
CURRENTLY TR...
Headquartered in Amsterdam,
with 41 offices in 29 countries and
more than 5,000 people worldwide.
Making it happen around ...
BERLIN OFFICE
TomTom 2019 ©. All right reserved.9
BERLIN OFFICE FACTS
• About 200 people
• Traffic and Travel Information
• Navigation
• Autonomous
• Telematics
TomTom 2019...
02 0301TomTom? HD Maps for
Autonomous
Driving
Connected
Services
TomTom 2019 ©. All right reserved.11
MAPS FOR
AUTONOMOUS
DRIVING
TomTom 2019 ©. All right reserved.12
TomTom 2019 ©. All right reserved.13
COMFORT
SAFETY
Autonomous vehicles in Berlin
Environmental model
AUTONOMOUS
DRIVING
I...
TomTom 2019 ©. All right reserved.
The pillars of automated driving
Sensing Driving policy Actuators
14
Maps complement
sensors to ensure
high reliability
Maps are not affected by adverse
weather conditions, working even when
...
Maps help
automated
vehicles
understand the
environment
Maps help automated vehicles see
well beyond the range of the
sens...
L0 L1 L2 L3 L4 L5
Driver controls all
aspects of driving
Automated
subsystems
Combined automated
subsystems
Hands-off
cond...
The road as
we see it
TomTom 2019 ©. All right reserved.18
I-15, Las Vegas, NV
As a
navigation
system sees it
TomTom 2019 ©. All right reserved.19
I-15, Las Vegas, NV
As an
automated
driving system
sees it
TomTom 2019 ©. All right reserved.20
I-15, Las Vegas, NV
TomTom 2019 ©. All right reserved.
TomTom
focuses on
mapping for
autonomous
driving
21
Task: Determine
Lane Separators /
Boundary Lines
Line Mapping
22
Generative Adversarial Networks
”Generative Adversarial Nets”, Goodfellow et al., Google, NeurIPS 2014
A game between two ...
“BEGAN: Boundary Equillibrium Generative Adversarial Networks”, Berthelot et al, 2017
Generative Adversarial Networks
24
EL-GAN
Discriminator
• Uses both predictions and labels
• Is trained to minimize the difference
between predictions and la...
Predictions are structurally
much more similar to the
training labels without
needing
complicated post
processing
Groundtr...
LOCALIZATION PERCEPTION PATH PLANNING
The role of HD Maps in automated
driving
TomTom 2019 ©. All right reserved.27
RoadDNA
ROADSIDE
POLES
MARKINGS
REFLECTIVITY
RADAR
Powers sensor-agnostic localization
SIGNS
RoadDNA
SIGNS
ROADSIDE
POLES
...
The Eyes of a Self-Driving Car
29
HD map-as-a-service - Map Making
TomTom 2019 ©. All right reserved.30
Governmental
Sources
GPS traces
Survey
vehicles
Comm...
HD map-as-a-service – Map delivery
TomTom 2019 ©. All right reserved.31
Governmental
Sources
GPS traces
Survey
vehicles
Co...
HD map maintenance
TomTom 2019 ©. All right reserved.32
Governmental
Sources
GPS traces
Survey
vehicles
Community
input
Ma...
TomTom is a leader in HD Map coverage
More than 400,000 km across US, Europe, Japan and South Korea freeways. China offere...
TomTom works
with key partners
towards
autonomous driving
TomTom 2019 ©. All right reserved.34
is to build the most advanced map-as-a-service
to help make autonomous driving a reality
Our vision
TomTom 2019 ©. All rig...
TomTom 2019 ©. All right reserved.36
CONNECTED
SERVICES –
LIVE TRAFFIC
TomTom 2019 ©. All right reserved.37
WHAT HAPPENED ON 21ST
OF OCTOBER 2017?
TomTom 2019 ©. All right reserved.38
WHAT HAPPENED ON 21ST
OF OCTOBER 2017? SOLAR ECLIPSE DURING DAY!
TomTom 2019 ©. All right reserved.39
WHAT HAPPENED ON JULY 27TH
2018?
https://www.tomtom.com/en_gb/traffic-news/hamburg-traffic/traffic-flow
TomTom 2019 ©. All...
WHAT HAPPENED ON JULY 27TH
2018? SOCCER WORLD CUP GERMANY – SOUTH KOREA
https://www.tomtom.com/en_gb/traffic-news/hamburg-...
What do we do?
TomTom Traffic Speed Layer (“Traffic Flow”)
https://www.tomtom.com/en_gb/traffic-index/berlin-trafficTomTom...
What do we do?
TomTom Traffic Incidents Layer (Traffic Jams, Road Closures, Road Works etc)
https://www.tomtom.com/en_gb/t...
How do we create Traffic Information?
Data-Driven Content Generation from various sources, but mainly GPS from Floating Ca...
TomTom 2019 ©. All right reserved.45
TomTom Traffic Automotive
customers
TomTom 2019 ©. All right reserved.
46
And many more…
742.000.000 KM Every Day
18000 x
TomTom 2019 ©. All right reserved.47
Raw GPS Data
Example Berlin, single GPS points
TomTom 2019 ©. All right reserved.48
Raw GPS Data
Example Berlin, connected GPS points
TomTom 2019 ©. All right reserved.49
Raw GPS Data
Example Berlin, color-coded by bearing angle
TomTom 2019 ©. All right reserved.50
Heavy Machinery
51
Runways / Airfields
52
MAP
MATCHED
FLOATING
CAR DATA
TomTom 2019 ©. All right reserved.53
RAW DATA: TIME-STAMPED GEO-
POSITIONS
MAP MATCHING
1. Projection to Map Edges
(lat,lon, timestamp, id)
(map segment id, sp...
Speed Probe Data for single Edge
Freeway, A9 south of Berlin, in Southbound direction
TomTom 2019 ©. All right reserved.56
Historic Speeds per Day of Week
A9 Berlin
Sun Mon Tue Wed Thu Fri Sat
speed
TomTom 2019 ©. All right reserved.57
Historic Speed Probe Data
Urban road segment, e.g. Berlin City
TomTom 2019 ©. All right reserved.58
Historic Speeds per Day of Week
Urban road segment, e.g. Berlin City
Sun Mon Tue Wed Thu Fri Sat
speed
TomTom 2019 ©. All ...
Historic Speed Frequencies
For a week-day on urban segment (Berlin)
6 km/h 43 km/h
numberofprobes
TomTom 2019 ©. All right...
Application: Historic Speed Profiles
Historic profiles for each day of week with 5min resolution
TomTom 2019 ©. All right ...
TomTom
Office
Berlin
Detecting
Map Changes
Image: Google Earth
TomTom 2019 ©. All right reserved.62
TomTom
Office
Berlin
Detecting Map
Changes
TomTom 2019 ©. All right reserved.63
Detect
Changes
based on
GPS Probe
Data
August
TomTom 2019 ©. All right reserved.64
Detect
Changes
based on
GPS Probe
Data
September
1-3
TomTom 2019 ©. All right reserved.65
Detect
Changes
based on
GPS Probe
Data
October
TomTom 2019 ©. All right reserved.66
TomTom
Office
Berlin
TomTom 2019 ©. All right reserved.67
Detect
Changes
based on
GPS Probe
Data
Speed Limit
Change
TomTom 2019 ©. All right reserved.68
Detect
Changes
based on
GPS Probe
Data
Number of Lanes
TomTom 2019 ©. All right reserved.69
FROM
SINGLE
PROBES TO
TRAFFIC
TomTom 2019 ©. All right reserved.70
From Single Probe to Traffic
Map-Matched Data from single floating car
TomTom 2019 ©. All right reserved.71
From Single Probe to Traffic
Map-Matched Data all floating cars
TomTom 2019 ©. All right reserved.72
Fundamental Diagram of Traffic Flow
For a given Road Stretch
Flow [cars/h]
Density [cars/km]
Free Congested
Observables:
•...
Congested Traffic Patterns
Typical pattern of congested traffic
time
distance
time
time
time
distancedistance
distance
Tom...
TomTom 2019 ©. All right reserved.75
TomTom 2019 ©. All right reserved.76
TomTom 2019 ©. All right reserved.77
TomTom 2019 ©. All right reserved.78
TomTom 2019 ©. All right reserved.79
TomTom 2019 ©. All right reserved.80
TomTom 2019 ©. All right reserved.81
Application: Traffic Jam Warning Service
01: Collecting probe vehicle data
02: Map-Matching, Fusion and Aggregation
03: De...
Application: Traffic Jam Tail Warnings
Creating Traffic Jam Content in Live Fusion Engine and add Information about Jam
01...
Application: Traffic Management Monitor
TomTom Pro Dashboard integrating several views along stretch of road
TomTom 2019 ©...
Application: Traffic Management Monitor
TomTom Pro Dashboard integrating several views along stretch of road
TomTom 2019 ©...
02 0301TomTom is the
leading independent
location technology
specialist
HD Maps for
Autonomous
Driving
Connected
Services
...
THANK YOU
Soeren.Sonnenburg@tomtom.com | Internships? Jobs? Apply!
How TomTom uses AI to create stellar transportation maps
Upcoming SlideShare
Loading in …5
×

0

Share

Download to read offline

How TomTom uses AI to create stellar transportation maps

Download to read offline

Soren Sonnenburg talks about how TomTom uses AI to create stellar maps for optimal transportation. The event took place in the idalab office in Berlin, with more than 40 attendees.

  • Be the first to like this

How TomTom uses AI to create stellar transportation maps

  1. 1. TOMTOM’S AI: WORLD-CLASS MAPS AND TRAFFIC FOR AUTONOMOUS DRIVING Soeren Sonnenburg TomTom AI Geospatial Research (TAIGR) Traffic and Travel Information Product Unit (TTI) TomTom 2019 ©. All right reserved.2
  2. 2. TomTom?!?! TomTom 2019 ©. All right reserved.3
  3. 3. WE ARE TOMTOM Leading independent location technology specialist, shaping mobility with highly accurate maps, navigation software, real-time traffic information and services.
  4. 4. Highly accurate maps Navigation software The leading independent location technology specialist Highly accurate maps Navigation software Real-time traffic and services TomTom 2019 ©. All right reserved.5
  5. 5. Founded Launched first navigation software Introduced the portable navigation device Acquired HD Traffic technology Acquired mapping company, Tele Atlas 1991 201820172008200620041996 Launched TomTom HD Map for AD 2015 Launched AutoStream and MotionQ Short History of TomTom Strong foundation… for shaping the future of mobility Acquired autonomous driving company, Autonomos TomTom 2019 ©. All right reserved.6
  6. 6. Switch from software to hardware and back again 30 70 2003 82 18 2008 62 38 2013 31 69 2018 Software Hardware CURRENTLY TRANSITIONING TO AI COMPANY
  7. 7. Headquartered in Amsterdam, with 41 offices in 29 countries and more than 5,000 people worldwide. Making it happen around the world TomTom 2019 ©. All right reserved.8
  8. 8. BERLIN OFFICE TomTom 2019 ©. All right reserved.9
  9. 9. BERLIN OFFICE FACTS • About 200 people • Traffic and Travel Information • Navigation • Autonomous • Telematics TomTom 2019 ©. All right reserved.10
  10. 10. 02 0301TomTom? HD Maps for Autonomous Driving Connected Services TomTom 2019 ©. All right reserved.11
  11. 11. MAPS FOR AUTONOMOUS DRIVING TomTom 2019 ©. All right reserved.12
  12. 12. TomTom 2019 ©. All right reserved.13 COMFORT SAFETY Autonomous vehicles in Berlin Environmental model AUTONOMOUS DRIVING ISAREALITY EFFICIENCY
  13. 13. TomTom 2019 ©. All right reserved. The pillars of automated driving Sensing Driving policy Actuators 14
  14. 14. Maps complement sensors to ensure high reliability Maps are not affected by adverse weather conditions, working even when sensors can’t function properly, for greater safety TomTom 2019 ©. All right reserved.15
  15. 15. Maps help automated vehicles understand the environment Maps help automated vehicles see well beyond the range of the sensors, and help the vehicle understand what the sensors see. TomTom 2019 ©. All right reserved.16
  16. 16. L0 L1 L2 L3 L4 L5 Driver controls all aspects of driving Automated subsystems Combined automated subsystems Hands-off conditionally Automated on certain roads Automated on all roads AD ADAS ADAS Map HD Map or ADAS Map HD Map HD MapADAS Map HD Map TomTom powers all levels of autonomous driving TomTom 2019 ©. All right reserved.17
  17. 17. The road as we see it TomTom 2019 ©. All right reserved.18 I-15, Las Vegas, NV
  18. 18. As a navigation system sees it TomTom 2019 ©. All right reserved.19 I-15, Las Vegas, NV
  19. 19. As an automated driving system sees it TomTom 2019 ©. All right reserved.20 I-15, Las Vegas, NV
  20. 20. TomTom 2019 ©. All right reserved. TomTom focuses on mapping for autonomous driving 21
  21. 21. Task: Determine Lane Separators / Boundary Lines Line Mapping 22
  22. 22. Generative Adversarial Networks ”Generative Adversarial Nets”, Goodfellow et al., Google, NeurIPS 2014 A game between two networks • Generator to fool Discriminator • Discriminator to outsmart Generator Goal: Discriminator cannot distinguish between real & fake 23
  23. 23. “BEGAN: Boundary Equillibrium Generative Adversarial Networks”, Berthelot et al, 2017 Generative Adversarial Networks 24
  24. 24. EL-GAN Discriminator • Uses both predictions and labels • Is trained to minimize the difference between predictions and labels 25
  25. 25. Predictions are structurally much more similar to the training labels without needing complicated post processing Groundtruth No Adversarial Adversarial EL-GAN 26
  26. 26. LOCALIZATION PERCEPTION PATH PLANNING The role of HD Maps in automated driving TomTom 2019 ©. All right reserved.27
  27. 27. RoadDNA ROADSIDE POLES MARKINGS REFLECTIVITY RADAR Powers sensor-agnostic localization SIGNS RoadDNA SIGNS ROADSIDE POLES MARKINGS REFLECTIVITY RADAR Powers sensor-agnostic localization RoadDNA SIGNS ROADSIDE POLES MARKINGS REFLECTIVITY RADAR Powers sensor-agnostic localization RoadDNA SIGNS ROADSIDE POLES MARKINGS REFLECTIVITY RADAR Powers sensor-agnostic localization RoadDNA SIGNS ROADSIDE POLES MARKINGS REFLECTIVITY RADAR Powers sensor-agnostic localization RoadDNA Suite Powers sensor-agnostic localization SIGNS ROADSIDE POLES MARKINGS REFLECTIVITY RADAR TomTom 2019 ©. All right reserved.28
  28. 28. The Eyes of a Self-Driving Car 29
  29. 29. HD map-as-a-service - Map Making TomTom 2019 ©. All right reserved.30 Governmental Sources GPS traces Survey vehicles Community input Map Making
  30. 30. HD map-as-a-service – Map delivery TomTom 2019 ©. All right reserved.31 Governmental Sources GPS traces Survey vehicles Community input Map Making Map Delivery
  31. 31. HD map maintenance TomTom 2019 ©. All right reserved.32 Governmental Sources GPS traces Survey vehicles Community input Map Making Map Maintenance Map Delivery
  32. 32. TomTom is a leader in HD Map coverage More than 400,000 km across US, Europe, Japan and South Korea freeways. China offered through partner product. TomTom 2019 ©. All right reserved.33 TomTom HD Map and RoadDNA available on n2c0 roads TomTom HD Map and RoadDNA available on n2c1 roads
  33. 33. TomTom works with key partners towards autonomous driving TomTom 2019 ©. All right reserved.34
  34. 34. is to build the most advanced map-as-a-service to help make autonomous driving a reality Our vision TomTom 2019 ©. All right reserved.35
  35. 35. TomTom 2019 ©. All right reserved.36
  36. 36. CONNECTED SERVICES – LIVE TRAFFIC TomTom 2019 ©. All right reserved.37
  37. 37. WHAT HAPPENED ON 21ST OF OCTOBER 2017? TomTom 2019 ©. All right reserved.38
  38. 38. WHAT HAPPENED ON 21ST OF OCTOBER 2017? SOLAR ECLIPSE DURING DAY! TomTom 2019 ©. All right reserved.39
  39. 39. WHAT HAPPENED ON JULY 27TH 2018? https://www.tomtom.com/en_gb/traffic-news/hamburg-traffic/traffic-flow TomTom 2019 ©. All right reserved.40
  40. 40. WHAT HAPPENED ON JULY 27TH 2018? SOCCER WORLD CUP GERMANY – SOUTH KOREA https://www.tomtom.com/en_gb/traffic-news/hamburg-traffic/traffic-flow South Korea – Germany 2:0 TomTom 2019 ©. All right reserved.41
  41. 41. What do we do? TomTom Traffic Speed Layer (“Traffic Flow”) https://www.tomtom.com/en_gb/traffic-index/berlin-trafficTomTom 2019 ©. All right reserved.42
  42. 42. What do we do? TomTom Traffic Incidents Layer (Traffic Jams, Road Closures, Road Works etc) https://www.tomtom.com/en_gb/traffic-index/berlin-trafficTomTom 2019 ©. All right reserved.43
  43. 43. How do we create Traffic Information? Data-Driven Content Generation from various sources, but mainly GPS from Floating Cars TomTom 2019 ©. All right reserved.44
  44. 44. TomTom 2019 ©. All right reserved.45
  45. 45. TomTom Traffic Automotive customers TomTom 2019 ©. All right reserved. 46 And many more…
  46. 46. 742.000.000 KM Every Day 18000 x TomTom 2019 ©. All right reserved.47
  47. 47. Raw GPS Data Example Berlin, single GPS points TomTom 2019 ©. All right reserved.48
  48. 48. Raw GPS Data Example Berlin, connected GPS points TomTom 2019 ©. All right reserved.49
  49. 49. Raw GPS Data Example Berlin, color-coded by bearing angle TomTom 2019 ©. All right reserved.50
  50. 50. Heavy Machinery 51
  51. 51. Runways / Airfields 52
  52. 52. MAP MATCHED FLOATING CAR DATA TomTom 2019 ©. All right reserved.53
  53. 53. RAW DATA: TIME-STAMPED GEO- POSITIONS MAP MATCHING 1. Projection to Map Edges (lat,lon, timestamp, id) (map segment id, speed, avg-map-matching error, timestamp, id) 2. Measure Map Matching Error TomTom 2019 ©. All right reserved.54
  54. 54. Speed Probe Data for single Edge Freeway, A9 south of Berlin, in Southbound direction TomTom 2019 ©. All right reserved.56
  55. 55. Historic Speeds per Day of Week A9 Berlin Sun Mon Tue Wed Thu Fri Sat speed TomTom 2019 ©. All right reserved.57
  56. 56. Historic Speed Probe Data Urban road segment, e.g. Berlin City TomTom 2019 ©. All right reserved.58
  57. 57. Historic Speeds per Day of Week Urban road segment, e.g. Berlin City Sun Mon Tue Wed Thu Fri Sat speed TomTom 2019 ©. All right reserved.59
  58. 58. Historic Speed Frequencies For a week-day on urban segment (Berlin) 6 km/h 43 km/h numberofprobes TomTom 2019 ©. All right reserved.60
  59. 59. Application: Historic Speed Profiles Historic profiles for each day of week with 5min resolution TomTom 2019 ©. All right reserved.61
  60. 60. TomTom Office Berlin Detecting Map Changes Image: Google Earth TomTom 2019 ©. All right reserved.62
  61. 61. TomTom Office Berlin Detecting Map Changes TomTom 2019 ©. All right reserved.63
  62. 62. Detect Changes based on GPS Probe Data August TomTom 2019 ©. All right reserved.64
  63. 63. Detect Changes based on GPS Probe Data September 1-3 TomTom 2019 ©. All right reserved.65
  64. 64. Detect Changes based on GPS Probe Data October TomTom 2019 ©. All right reserved.66
  65. 65. TomTom Office Berlin TomTom 2019 ©. All right reserved.67
  66. 66. Detect Changes based on GPS Probe Data Speed Limit Change TomTom 2019 ©. All right reserved.68
  67. 67. Detect Changes based on GPS Probe Data Number of Lanes TomTom 2019 ©. All right reserved.69
  68. 68. FROM SINGLE PROBES TO TRAFFIC TomTom 2019 ©. All right reserved.70
  69. 69. From Single Probe to Traffic Map-Matched Data from single floating car TomTom 2019 ©. All right reserved.71
  70. 70. From Single Probe to Traffic Map-Matched Data all floating cars TomTom 2019 ©. All right reserved.72
  71. 71. Fundamental Diagram of Traffic Flow For a given Road Stretch Flow [cars/h] Density [cars/km] Free Congested Observables: • Q – Traffic Flow • D – Traffic Density Insights: • v = Q/D • v_0 free flow speed • v_jam_shockwave = - 15 km/h Q = D = Synchronized/Bound Jam Speeds TomTom 2019 ©. All right reserved.73
  72. 72. Congested Traffic Patterns Typical pattern of congested traffic time distance time time time distancedistance distance TomTom 2019 ©. All right reserved.74
  73. 73. TomTom 2019 ©. All right reserved.75
  74. 74. TomTom 2019 ©. All right reserved.76
  75. 75. TomTom 2019 ©. All right reserved.77
  76. 76. TomTom 2019 ©. All right reserved.78
  77. 77. TomTom 2019 ©. All right reserved.79
  78. 78. TomTom 2019 ©. All right reserved.80
  79. 79. TomTom 2019 ©. All right reserved.81
  80. 80. Application: Traffic Jam Warning Service 01: Collecting probe vehicle data 02: Map-Matching, Fusion and Aggregation 03: Delivery 04: Dynamic Routing TomTom 2019 ©. All right reserved.82
  81. 81. Application: Traffic Jam Tail Warnings Creating Traffic Jam Content in Live Fusion Engine and add Information about Jam 01: Collecting probe vehicle data 02: Map-Matching, Fusion and Aggregation 03: Delivery 04: Dynamic Routing TomTom 2019 ©. All right reserved.83
  82. 82. Application: Traffic Management Monitor TomTom Pro Dashboard integrating several views along stretch of road TomTom 2019 ©. All right reserved.84
  83. 83. Application: Traffic Management Monitor TomTom Pro Dashboard integrating several views along stretch of road TomTom 2019 ©. All right reserved.85
  84. 84. 02 0301TomTom is the leading independent location technology specialist HD Maps for Autonomous Driving Connected Services TomTom 2019 ©. All right reserved.86
  85. 85. THANK YOU Soeren.Sonnenburg@tomtom.com | Internships? Jobs? Apply!

Soren Sonnenburg talks about how TomTom uses AI to create stellar maps for optimal transportation. The event took place in the idalab office in Berlin, with more than 40 attendees.

Views

Total views

563

On Slideshare

0

From embeds

0

Number of embeds

17

Actions

Downloads

21

Shares

0

Comments

0

Likes

0

×