AWS re:Invent 2016 recap (part 2)

1. AWS re:Invent 2016 re:Cap
Julien Simon
Principal Technical Evangelist, AWS
julsimon@amazon.fr
@julsimon

2. What Are The Best Practices Of
Transformational Development?

3. Security Performance
efficiency
Cost
optimization
Reliability
Well-Architected Framework
Operational
excellence
NEW

4. Introducing
The Well-Architected Framework Course
With Broader And Deeper Content

5. A Year In Amazon CloudFormation
20 additional services
20 services updated
YAML support
Role-based stack creation
Change sets
Cross-stack references
Failure recovery
Resource schemas
Prepare

6. AWS OpsWorks For Chef Automate
Fully managed Chef server
NEW
Prepare
Generally Available Today

7. Amazon EC2 Systems Manager
Collection of AWS tools for package installation, patching,
resource configuration, and task automation
Prepare
NEW
Generally Available Today

8. AWS CodeBuild
NEW
Operate
Generally Available Today
Build service for compiling source code
and running unit tests

9. AWS X-Ray
NEW
Operate
Analyze and debug distributed applications
in production
Preview Available Today

10. fanout-00002
AWS X-RayNEW
hello-1.mbfzqxzcpe.us-east-..
hello-2.mbfzqxzcpe.us-east-..
fanout-00005
fanout-00003
throttle
DynamoDB
index
DynamoDB
fanout-00004
400 traces/min
avg - 0.30 ms
600 traces / min
avg - 0.19 ms
1000 traces /min
avg - 0.13 ms
400 traces / min
avg - 0.30 ms
1000 traces / min
avg - 0.28 ms
400 traces / min
avg - 0.30 ms
850 traces / min
avg - 0.16 ms
850 traces / min
avg - 0.17 ms
Client
Client
800 traces / min
avg - 0.19 ms
fanout-00001
560 traces / min
avg - 0.19 ms
fanout-00006

11. AWS X-RayNEW

12. AWS X-RayNEW

13. AWS Personal Health Dashboard
NEW
Respond
Personalized view of AWS service health
Generally Available Today

14. Web applications running on AWS are already protected
by Shield Standard - no action is required
Protection from volumetric and state exhaustion attacks
NEW
Respond
Generally Available Today
AWS Shield For Everyone

15. For additional protection against very
large and sophisticated attacks
AWS Shield Advanced
Respond
NEW
Generally Available Today

16. Respond
Advanced notifications
via CloudWatch
Cost protection on ELB,
CloudFront, Route 53
24/7 DDoS response
team and support
WAF included at
no additional cost
AWS Shield Advanced

17. NEW
Targeting
Targeted push notifications for mobile apps
Amazon Pinpoint
Generally Available Today

18. Understand user
behavior
Define who to
engage
Deliver
notifications
Track
campaign
results
Amazon Pinpoint

19. S3 Storage Management
S3 Data Events in CloudTrail
S3 Object Tagging
S3 Analytics - Storage Class Analysis
S3 CloudWatch Metrics
S3 Inventory
Innovations In S3
NEW

20. Integrated with:
Fully-managed data catalog and ETL service
S3, RDS, Redshift & any
JDBC-compliant data store
AWS Glue
NEW

21. Build Your
Data Catalog

22. Generate And Edit
Transformations

23. Schedule And Run
Your Jobs

24. 2. Source Data
S3 Upload
Kinesis Firehose
DynamoDB Streams
Snowball
Snowball Edge
Snowmobile
3. Lifecycle management
and cold storage
5. Data governance,
security, privacy
8. Preparing for
Analytics
9. Orchestration
and job scheduling
Analytics
Database Migration
Service
1. Ingestion
Datastore target
4. Metadata
capture
10. Capturing data
change
Athena
EMR
Elasticsearch
Redshift
AI
Machine Learning
Quicksight
RDS
DynamoDB
EFS
S3 EBS
6. Self-service discovery,
search, access
Glacier
7. Managing
data quality
EMR
Glue
The Modern Data Architecture On AWS

25. Install
batch software
Manage job
interdependencies
Manage
job queues
Schedule
jobs
Provision
server cluster
Scale server
cluster
Challenges Of Large-Scale Batch Processing

26. AWS Batch
Fully-managed batch processing at any scale
NEW
Preview Available Today

27. Dynamic provisioning
and scaling
Priority-based queues
and scheduling
Cost optimization
through EC2 Spot fleet
Fully managed
AWS Batch

28. Containers
A Spectrum Of Compute

29. High
availability
Infrastructure
management
Security Task
scheduling
Pipeline
integration
Container
management
Service
discovery
Resource
access
The Challenges Of Container Based Operations

30. Amazon ECS
Managed platform for:
Cluster Management Container Orchestration Deep AWS Integration

31. ELBContainer
Auto Scaling
CloudTrailVPCIAM CloudWatch
Metrics
Instance
Auto Scaling
CloudWatch
Logs
CloudWatch
Events
X-Ray
Deep Integration With AWS Platform

32. You can now determine scheduling policies based on:
AMI ID Availability
zone
Instance
type
Distinct
instances
Custom
Task Placement Engine
(Coming Soon)

33. Real-time notifications of current state
Container
instance events
Task
events
Event Stream

34. They need the ability to:
Create custom schedulers Integrate 3rd party schedulers Develop and test locally
Developers Want More Control

35. Introducing
NEW
A collection of open source projects for:
Container management and orchestration

36. Today we are releasing:
cluster-state-service daemon-scheduler
Blox
NEW

37. Open Source
blox.github.io

38. Serverless
AWS Lambda
A Spectrum Of Compute

39. Languages Integrations
Node.js (JavaScript)
Java (Java 8 compatible)
Python
Amazon API Gateway
AWS CodeCommit
AWS CloudFormation
AWS Config
Amazon Simple Notification Service
Amazon Simple Email Service
State Of AWS Lambda
Amazon CloudWatch
Amazon Kinesis Streams
Amazon DynamoDB
Amazon RDS
Amazon Aurora
Amazon Cognito
Amazon S3

40. VPC Support
Node 4.3
Simple Proxy
API Gateway Binary Support
Environment Variables
Serverless Application Model
NEW
New Serverless Features In 2016

41. NEW
C# In AWS Lambda

42. AWS Lambda@Edge
NEW
Preview Available Today
Run AWS Lambda functions at CloudFront locations

43. “I want to sequence
functions”
“I want to run
functions in parallel”
“I want to select
functions based on data”
“I want to retry
functions”
“I want to try/
catch/finally”
“I have code that
runs for hours”
Turning Functions Into Applications

44. Method Call Function Chaining Database Queues
Different Ways To Coordinate Functions

45. NEW
AWS Step Functions
Generally Available Today
Coordinate the components of distributed
applications using visual workflows

46. AWS Step Functions

47. Branching Steps
Select image
converter
RAW to JPEG RAW to PNGRAW to TIFF
Load in
Database
Star
t
End
Unsupported
image type
Upload RAW
file
Delete RAW
file
Star
t
End
Process photo
Resize image
Star
t
End
Extract
metadata
Facial
recognition
Load in
Database
Parallel StepsSequential Steps
AWS Step Functions

48. Virtual Machines Containers Serverless
First-Class Primitives With Deep AWS Integration

49. Transformations

50. AWS OpsWorks For Chef Automate
Amazon EC2 Systems Manager
AWS CodeBuild
AWS X-Ray
AWS Personal Health Dashboard
AWS Shield
Amazon Pinpoint
AWS Glue
AWS Batch
C# In AWS Lambda
AWS Lambda@Edge
AWS Step Functions
Elastic GPUs For EC2
Amazon Lightsail
F1 Instances
Amazon Athena
Amazon AI
Amazon Rekognition
Amazon Polly
Amazon Lex
PostgreSQL For Aurora
AWS Greengrass
AWS Snowball Edge
AWS Snowmobile
Day 1 Day 2

51. https://aws.amazon.com/fr/blogs/aws/well-architected-working-backward-to-play-it-forward/
https://aws.amazon.com/fr/opsworks/chefautomate/
https://aws.amazon.com/fr/ec2/systems-manager/
https://aws.amazon.com/fr/blogs/aws/aws-codebuild-fully-managed-build-service/
https://aws.amazon.com/fr/blogs/aws/aws-x-ray-see-inside-of-your-distributed-application/
https://aws.amazon.com/fr/blogs/aws/new-aws-personal-health-dashboard-status-you-can-relate-to/
https://aws.amazon.com/fr/blogs/aws/aws-shield-protect-your-applications-from-ddos-attacks/
https://aws.amazon.com/fr/blogs/aws/amazon-pinpoint-hit-your-targets-with-aws/
https://aws.amazon.com/fr/blogs/aws/aws-batch-run-batch-computing-jobs-on-aws/
https://aws.amazon.com/fr/blogs/aws/blox-new-open-source-scheduler-for-amazon-ec2-container-service/
https://aws.amazon.com/fr/blogs/aws/coming-soon-lambda-at-the-edge/
https://aws.amazon.com/fr/blogs/compute/announcing-c-sharp-support-for-aws-lambda/
https://aws.amazon.com/fr/blogs/aws/new-aws-step-functions-build-distributed-applications-using-visual-workflows/

52. AWS re:Invent 2016: Achieving Agility by Following Well-Architected Framework Principles (ARC203)
https://www.youtube.com/watch?v=8e2zCHx-K3M
AWS re:Invent 2016: Infrastructure Continuous Delivery Using AWS CloudFormation (DEV313)
https://www.youtube.com/watch?v=TDalsML3QqY
AWS re:Invent 2016: NEW LAUNCH! Amazon EC2 Systems Manager for Hybrid Cloud Management (WIN205)
https://www.youtube.com/watch?v=2ZqmRSIqQ6Q
AWS re:Invent 2016: NEW LAUNCH! Introduction to AWS X-Ray (DEV316)
https://www.youtube.com/watch?v=s8tB3YhZd9U
AWS re:Invent 2016: NEW LAUNCH! Transparency and control with AWS Personal Health Dashboard (ARC207)
https://www.youtube.com/watch?v=0kW2rkfQgvM
AWS re:Invent 2016: NEW LAUNCH! AWS Shield—A Managed DDoS Protection Service (SAC322)
https://www.youtube.com/watch?v=R06GDQBbtRU
AWS re:Invent 2016: NEW LAUNCH! Enable Real-Time Mobile App Engagement with Amazon Pinpoint (MBL304)
https://www.youtube.com/watch?v=eq3hKt0XxQE
AWS re:Invent 2016: NEW LAUNCH! Introduction to AWS Glue: A Fully Managed ETL Service (BDA209)
https://www.youtube.com/watch?v=4N_ktE4NFIk
AWS re:Invent 2016: NEW LAUNCH! Introducing AWS Batch: Easy and efficient batch computing (CMP323)
https://www.youtube.com/watch?v=ebwfhSS4ZkY
AWS re:Invent 2016: NEW LAUNCH! Advanced Task Scheduling with Amazon ECS and Blox (CON307)
https://www.youtube.com/watch?v=evYcLW3TLcQ
AWS re:Invent 2016: NEW LAUNCH! Bringing AWS Lambda to the Edge (CTD206)
https://www.youtube.com/watch?v=j26novaqF6M
AWS re:Invent 2016: NEW LAUNCH! Developing Serverless C# Applications (DEV207)
https://www.youtube.com/watch?v=Ymn6WGCSjE4
AWS re:Invent 2016: NEW LAUNCH! Serverless Apps with AWS Step Functions (SVR201)
https://www.youtube.com/watch?v=75MRve4nv8s

53. Thank You
Julien Simon
Principal Technical Evangelist, AWS
julsimon@amazon.fr
@julsimon