Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
CA Data Engineering and Data Analysis (CADEDA) #7
1
l
−
− ⇔
−
l :
− CS
− →
l :
2
3
re:Invent 2018
(?)
AI Services
ML Frameworks & Infrastructure
ML Services (SageMaker)
re:Invent
Amazon Web Services
5
50,000 1,381
: AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube
https://www.youtube.com/watch?v=ZOIkOnW640A
655
2,100
: AWS re:Invent 2018
https://www.portal.reinvent.awsevents.com/connect/search.ww
3501
7
: Campus | AWS re:Invent https://reinvent.awsevents.com/campus/
3.2km
l 50,000+
− 7
l 2,100+
l 100+
8
9
re:Invent 2018
…
10
Andy Jassy (CEO)
AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube
https://www.youtube.com/watch?v=ZOIkOnW640A
• G...
l Amazon Personalize
l Amazon Forecast
l Amazon Textract
l Amazon Comprehend Medical
l Amazon Translate Custom
Terminology...
12
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Amazon Machine Learning stack
A I S E R V...
13
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Amazon Machine Learning stack
A I S E R V...
l Amazon Personalize
−
− Amazon.com
l Amazon Forecast
−
− Amazon.com
14
l Textract: OCR; ;
l Comprehend Medical: ;
l Trans...
15
| Amazon
Personalize | AWS https://aws.amazon.com/jp/personalize/
Amazon Personalize
( )
( )
l
l
− API
: Rekognition
l
− :
16
17
Time Series Forecasting | Machine Learning | Amazon Forecast
https://aws.amazon.com/forecast/
Amazon Forecast
Timestrea...
l
l Forecast
:
−
− API
− Amazon Timestream
l Lambda
18
re:Invent TSDB :
https://aws.amazon.com/timestream/
19
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Amazon Machine Learning stack
A I S E R V...
l AWS-Optimized TensorFlow
− 256 GPUs
l EC2 p3dn
− GPU
l Amazon Elastic Inference
− EC2 GPU
20
l Amazon Inferentia: TPU 20...
l AWS-Optimized TensorFlow
− AWS c5, p3
TensorFlow
− AMI DLAMI
l
− 256 GPUs
ResNet50 256 GPUs scaling efficiency
65% → 90%...
l GPU
22
Model
NVIDIA
V100
Tensor
Core GPUs
GPU
Memory
NVIDIA
NVLink
vCPUs
Main
Memory
Local
Storage
Network
Bandwidth
EBS...
l GPU
− GPU
l
GPU
23
Model GPUs vCPU Mem
GPU
Mem
Storage
Dedicated
EBS
Bandwidth
Networkin
g
p3
.2xlarge
1 8 61 16 EBS-Onl...
24
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Amazon Machine Learning stack
A I S E R V...
25
[NEW!]
• SageMaker Ground Truth
• Jupyter
Notebook/Lab
• on-demand
•
• AWS Marketplace [NEW!]
• (RL) [NEW!]
[NEW!]
• Sa...
l Amazon SageMaker Ground Truth
−
l AWS Marketplace for ML & AI
− ML
l Amazon SageMaker Neo
− HW OSS
l Amazon SageMaker RL...
l
−
Web UI
− Mechanical Turk
− Active Learning
27
l
− :
− :
28
l
−
→ IoT
−
29
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Train once, run anywhere
Leadersh...
l RL
− RL
l
RL SageMaker
−
−
30
: ( )
“AlphaGo”
l AWS DeepRacer
−
− SageMaker
− Atom , , Wi-Fi
l
l re:Invent 2019
31
Amazon.com
m(_ _)m
1. AI Services
− Personalize
−
2. ML Frameworks & Infrastructure
−
− Elastic Inference
3. ML Services
− ML
−
32
l re:Invent Web
− 1)
− 2)
l ID
33
1) https://www.portal.reinvent.awsevents.com/connect/search.ww
2) AWS re:Invent 2018 #re...
l AI/ML : 228
34
ID
AIM (Artificial Intelligence & Machine learning)
113
ANT (ANalyTics) 47
WPS (Worldwide Public Sector) ...
l AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube
https://youtu.be/ZOIkOnW640A?t=4860
− 1:21:00
l AWS re:Invent 201...
l Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent
2018
https://www.slideshare.net/AmazonWebServices/leader...
Upcoming SlideShare
Loading in …5
×
Upcoming SlideShare
What to Upload to SlideShare
Next
Download to read offline and view in fullscreen.

3

Share

Download to read offline

機械学習エンジニアを見せたAWSの再:発明とは? 〜re:Invent 2018 参加レポート〜

Download to read offline

CA Data Engineering and Data Analysis(CADEDA)#7
機械学習エンジニアを見せたAWSの再:発明とは?
〜re:Invent 2018 参加レポート〜

Related Books

Free with a 30 day trial from Scribd

See all

機械学習エンジニアを見せたAWSの再:発明とは? 〜re:Invent 2018 参加レポート〜

  1. 1. CA Data Engineering and Data Analysis (CADEDA) #7 1
  2. 2. l − − ⇔ − l : − CS − → l : 2
  3. 3. 3 re:Invent 2018 (?) AI Services ML Frameworks & Infrastructure ML Services (SageMaker)
  4. 4. re:Invent Amazon Web Services
  5. 5. 5 50,000 1,381 : AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube https://www.youtube.com/watch?v=ZOIkOnW640A
  6. 6. 655 2,100 : AWS re:Invent 2018 https://www.portal.reinvent.awsevents.com/connect/search.ww 3501
  7. 7. 7 : Campus | AWS re:Invent https://reinvent.awsevents.com/campus/ 3.2km
  8. 8. l 50,000+ − 7 l 2,100+ l 100+ 8
  9. 9. 9 re:Invent 2018 …
  10. 10. 10 Andy Jassy (CEO) AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube https://www.youtube.com/watch?v=ZOIkOnW640A • Glacier Deep Archive • FSx for Windows File Server • FSx for Lustre • Control Tower • Security Hub • Lake Formation • DynamoDB R/W Capacity on Demand • Timestream • Quantum Ledger DB • Managed Blockchain • VMware Cloud on AWS • Outposts 165
  11. 11. l Amazon Personalize l Amazon Forecast l Amazon Textract l Amazon Comprehend Medical l Amazon Translate Custom Terminology l Amazon SageMaker Ground Truth l Amazon SageMaker Neo l AWS Marketplace for Machine Learning & Artificial Intelligence l Amazon SageMaker RL l AWS DeepRacer l AWS-optimized TensorFlow l Amazon EC2 p3dn Instance l Amazon Elastic Inference l AWS Inferentia 11
  12. 12. 12 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML API ML ML
  13. 13. 13 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML API
  14. 14. l Amazon Personalize − − Amazon.com l Amazon Forecast − − Amazon.com 14 l Textract: OCR; ; l Comprehend Medical: ; l Translate Custom Terminology : Translate
  15. 15. 15 | Amazon Personalize | AWS https://aws.amazon.com/jp/personalize/ Amazon Personalize ( ) ( )
  16. 16. l l − API : Rekognition l − : 16
  17. 17. 17 Time Series Forecasting | Machine Learning | Amazon Forecast https://aws.amazon.com/forecast/ Amazon Forecast Timestream CSV API
  18. 18. l l Forecast : − − API − Amazon Timestream l Lambda 18 re:Invent TSDB : https://aws.amazon.com/timestream/
  19. 19. 19 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML
  20. 20. l AWS-Optimized TensorFlow − 256 GPUs l EC2 p3dn − GPU l Amazon Elastic Inference − EC2 GPU 20 l Amazon Inferentia: TPU 2019 ;
  21. 21. l AWS-Optimized TensorFlow − AWS c5, p3 TensorFlow − AMI DLAMI l − 256 GPUs ResNet50 256 GPUs scaling efficiency 65% → 90% 21 Anaconda TensorFlow, MXNet, Chainer, Caffe, PyTorch AMI AMI
  22. 22. l GPU 22 Model NVIDIA V100 Tensor Core GPUs GPU Memory NVIDIA NVLink vCPUs Main Memory Local Storage Network Bandwidth EBS- Optimized Bandwidth p3dn .24xlarge 8 256 GB 300 GB/s 96 768 GiB 2 x 900 GB NVMe SSD 100 Gbps 14 Gbps NVLink & NCCL + CADEDA #4 gihyo.jp , 2018. ChainerMN , CADEDA #4.
  23. 23. l GPU − GPU l GPU 23 Model GPUs vCPU Mem GPU Mem Storage Dedicated EBS Bandwidth Networkin g p3 .2xlarge 1 8 61 16 EBS-Only 1.5 Gbps Up to 10 Gigabit p3 8CPU, 61GB Mem
  24. 24. 24 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML
  25. 25. 25 [NEW!] • SageMaker Ground Truth • Jupyter Notebook/Lab • on-demand • • AWS Marketplace [NEW!] • (RL) [NEW!] [NEW!] • SageMaker Neo • scalable (API) • • Marketplace [NEW!]
  26. 26. l Amazon SageMaker Ground Truth − l AWS Marketplace for ML & AI − ML l Amazon SageMaker Neo − HW OSS l Amazon SageMaker RL (Reinforcement Learning) − − : DeepRacer 26
  27. 27. l − Web UI − Mechanical Turk − Active Learning 27
  28. 28. l − : − : 28
  29. 29. l − → IoT − 29 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Train once, run anywhere Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018 ( p.85 ) SageMaker Neo
  30. 30. l RL − RL l RL SageMaker − − 30 : ( ) “AlphaGo”
  31. 31. l AWS DeepRacer − − SageMaker − Atom , , Wi-Fi l l re:Invent 2019 31 Amazon.com m(_ _)m
  32. 32. 1. AI Services − Personalize − 2. ML Frameworks & Infrastructure − − Elastic Inference 3. ML Services − ML − 32
  33. 33. l re:Invent Web − 1) − 2) l ID 33 1) https://www.portal.reinvent.awsevents.com/connect/search.ww 2) AWS re:Invent 2018 #reinvent DevelopersIO https://dev.classmethod.jp/cloud/aws/reinvent2018-machine-learning-related- sessions-list-of-materials-ja/ AIM317-R2 AI/ML “AIM” repeat
  34. 34. l AI/ML : 228 34 ID AIM (Artificial Intelligence & Machine learning) 113 ANT (ANalyTics) 47 WPS (Worldwide Public Sector) 8 CTD 5 FSV (Financial Services) 5 ( ) Artificial Intelligence & Machine Learning repeat
  35. 35. l AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube https://youtu.be/ZOIkOnW640A?t=4860 − 1:21:00 l AWS re:Invent 2018 - Keynote with Werner Vogels – YouTube https://www.youtube.com/watch?v=femopq3JWJg − Lambda, Step Functions, API Gateway l Japan Wrap Up re:Invent2018 https://www.slideshare.net/KamedaHarunobu/japan-wrap-up-reinvent2018 − re:Invent l AWS Black Belt Online Seminar AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServicesJapan/125-aws-black-belt-online-seminar-aws-reinvent-2018 − re:Invent AWS Q&A 35
  36. 36. l Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine-learning-aim202l-aws- reinvent-2018 l AWS re:Invent 2018 #reinvent DevelopersIO https://dev.classmethod.jp/cloud/aws/reinvent2018-machine-learning-related-sessions-list-of-materials-ja/ − − AWS re:Invent 2018 36
  • syuichitsuji

    Dec. 29, 2018
  • wata909

    Dec. 29, 2018
  • Tyee

    Dec. 29, 2018

CA Data Engineering and Data Analysis(CADEDA)#7 機械学習エンジニアを見せたAWSの再:発明とは? 〜re:Invent 2018 参加レポート〜

Views

Total views

3,337

On Slideshare

0

From embeds

0

Number of embeds

2,212

Actions

Downloads

8

Shares

0

Comments

0

Likes

3

×