Continuous Deployment at Spreaker

•

3 likes•2,819 views

Marco Pracucci

Continuous Deployment on AWS EC2 made easy with Fabric and Zonify.

Technology

Continuous Deployment
at

Marco Pracucci

Platform for Creating
and Sharing Audio
8 people (4 developers)
2M unique listeners / month
3.5M audio tracks created
500 reqs / sec

We run 80% of our
traffic on AWS
about 60 EC2 instances and 50TB on S3

We deploy frequently
[even on friday]

51 deploys in last 30 days

How we deploy
the web [php] app
in 90 seconds

code repository

1. ssh
fab www.deploy

EC2 instances

code repository

2. checkout

fab www.deploy

EC2 instances

code repository

Checklist
- local cache warmup

3. warmup

- db schema migrations
fab www.deploy

- check consistency

EC2 instances

code repository

4. switch code
fab www.deploy
everything ok?

EC2 instances

code repository

Checklist
- iptables --dport 80 -j DROP
- ln -sfn /var/www/new /var/www/curr

4. switch code

- clear bytecode cache
fab www.deploy
- iptables --dport 80 -j ACCEPT

EC2 instances

notify team on IRC
generate report
fab www.deploy

which instances to deploy?
we do auto-scaling, they change dinamically

Split infrastructure into roles
EC2 instances

www1

api1

worker1

api2
www2

{

worker2

{

www3

{

api3

role: api

role: web

role: worker-web

Tag each instance with roles

[space separated roles for multi-role instances]

Map names and roles to DNS
https://github.com/airbnb/zonify

Creates Route 53 DNS entries
for all instances and roles

Do you remember the starting point?

Internally does

fab -R web www.deploy

few good reasons

Easy, Fast, Robust

Warning: an attacker can easier get your instances IPs
(use an unguessable DNS zone name)

Thank you
www.spreaker.com/marco
@pracucci

What's hot

Capistrano, Puppet, and Chef

David Benjamin

Spinnaker VLDB 2011

sandeep_tata

Intro to Batch Processing on AWS - DevDay Austin 2017

Amazon Web Services

Fabric: A Capistrano Alternative

Panoptic Development, Inc.

How to launch an aws ec2 instance

Andrea Cirillo

Capistrano 3 Deployment

Creston Jamison

DEPLOYING WORDPRESS BLOG USING DOCKER COMPOSE & ANSIBLE ON AWS

Ramit Surana

Kubernetes Operations (KOPS)

Jakir Patel

Basics of Ansible - Sahil Davawala

Sahil Davawala

Composer

Alessandro Minoccheri

Ruby 1.9 And Rails 3.0

ArrrrCamp

With AWS Fargate, Amazon has released a service that is a mix of container orchestration and serverless. One benefits from common container orchestration features, such as horizontal scaling, self-healing, and service discovery. Fargate fulfills also the characteristics of the serverless applications, since one does not have to administer the containers themselves and thus has a low operational effort. In addition, containers in Fargate scale automatically and are priced according to the actual resources consumption (CPU and memory). In this talk, we dive into the world of Elastic Container Service (ECS) and Fargate based on the "real world" example. At the end we talk about the future of Fargate in conjunction with Elastic Kubernetes Service (EKS).

"AWS Fargate: Containerization meets Serverless" at AWS User Group Cologne 20...

Vadym Kazulkin

Building and Scaling a Containerized Microservice - DevDay Austin 2017

Amazon Web Services

Control your deployments with Capistrano

Ramazan K

Terraform Architech

David Hsu

Kube-proxy enables access to Kubernetes services (virtual IPs backed by pods) by configuring client-side load-balancing on nodes. The first implementation relied on a userspace proxy which was not very performant. The second implementation used iptables and is still the one used in most Kubernetes clusters. Recently, the community introduced an alternative based on IPVS. This talk will start with a description of the different modes and how they work. It will then focus on the IPVS implementation, the improvements it brings, the issues we encountered and how we fixed them as well as the remaining challenges and how they could be addressed. Finally, the talk will present alternative solutions based on eBPF such as Cilium.

Evolution of kube-proxy (Brussels, Fosdem 2020)

Laurent Bernaille

[AWS KR UG 1회 세미나] AWS 배포전략 @ 정민영

AWSKRUG - AWS한국사용자모임

So here we have our brand new app, but how about its deployment, autoscale, high availability and so on? We're gonna take a journey from source code posted to GitHub to deployment in Google Cloud Platform which will be capable to take bazillion of requests. Will make our own docker image and see how it is looks like in practice. Will start our first kubernetes cluster and deploy our app. Will have a sneak peak into autoscaler and high availability

Alexandr Marchenko "Kubernetes - easy peasy"

Fwdays

Deploying a simple Rails application with AWS Elastic Beanstalk

Julien SIMON

Symfony + AWS Lambda Serverless services, like AWS Lambda, have been proven useful to solve a wide range of problems, and its use is growing rapidly. Recently, the possibility to use the PHP runtime in Lambda was added, so why not trying to use our favorite framework? How can we make the most from a serverless approach? What are pros and cons? In this session we will analyze the necessary steps to set up a Symfony4 project in Lambda and deploy it.

Symfony aws

Alessandro Minoccheri

What's hot (20)

Capistrano, Puppet, and Chef

Spinnaker VLDB 2011

Intro to Batch Processing on AWS - DevDay Austin 2017

Fabric: A Capistrano Alternative

How to launch an aws ec2 instance

Capistrano 3 Deployment

DEPLOYING WORDPRESS BLOG USING DOCKER COMPOSE & ANSIBLE ON AWS

Kubernetes Operations (KOPS)

Basics of Ansible - Sahil Davawala

Composer

Ruby 1.9 And Rails 3.0

"AWS Fargate: Containerization meets Serverless" at AWS User Group Cologne 20...

Building and Scaling a Containerized Microservice - DevDay Austin 2017

Control your deployments with Capistrano

Terraform Architech

Evolution of kube-proxy (Brussels, Fosdem 2020)

[AWS KR UG 1회 세미나] AWS 배포전략 @ 정민영

Alexandr Marchenko "Kubernetes - easy peasy"

Deploying a simple Rails application with AWS Elastic Beanstalk

Symfony aws

Similar to Continuous Deployment at Spreaker

Autoscaling OpenStack Natively with Heat, Ceilometer and LBaaS

Shixiong Shang

2016 - Easing Your Way Into Docker: Lessons From a Journey to Production

devopsdaysaustin

Anton Moldovan "Building an efficient replication system for thousands of ter...

Fwdays

How to contribute Apache CloudStack

Go Chiba

HPC in the Cloud

Guy Tel-Zur

Automating hard things may 2015

Mark Baker

Terraform

Adam Vincze

Initially delivered at LA RubyConf 2013, this presentation describes how cutting-edge technology helped to triple performance and drastically cut costs in a mobile social game. Juan Pablo Genovese, a Ruby Architect from Altoros Systems Argentina, explains how, despite the extremely tight budget, the customer managed to: - go from ~450 req/s to ~1300 req/s - reduce the number of EC2 application servers from four to one - provide fast and reliable video uploading and processing - achieve very easy scaling with automation while maintaining all the functions of the original RoR app.

Where is my scalable api?

Altoros

[Spark Summit EU 2017] Apache spark streaming + kafka 0.10 an integration story

Joan Viladrosa Riera

Spark Streaming has supported Kafka since it’s inception, but a lot has changed since those times, both in Spark and Kafka sides, to make this integration more fault-tolerant and reliable.Apache Kafka 0.10 (actually since 0.9) introduced the new Consumer API, built on top of a new group coordination protocol provided by Kafka itself. So a new Spark Streaming integration comes to the playground, with a similar design to the 0.8 Direct DStream approach. However, there are notable differences in usage, and many exciting new features. In this talk, we will cover what are the main differences between this new integration and the previous one (for Kafka 0.8), and why Direct DStreams have replaced Receivers for good. We will also see how to achieve different semantics (at least one, at most one, exactly once) with code examples. Finally, we will briefly introduce the usage of this integration in Billy Mobile to ingest and process the continuous stream of events from our AdNetwork.

Apache Spark Streaming + Kafka 0.10 with Joan Viladrosariera

Spark Summit

After a quick overview and introduction of Apache Kafka, this session cover two components which extend the core of Apache Kafka: Kafka Connect and Kafka Streams/KSQL. Kafka Connects role is to access data from the out-side-world and make it available inside Kafka by publishing it into a Kafka topic. On the other hand, Kafka Connect is also responsible to transport information from inside Kafka to the outside world, which could be a database or a file system. There are many existing connectors for different source and target systems available out-of-the-box, either provided by the community or by Confluent or other vendors. You simply configure these connectors and off you go. Kafka Streams is a light-weight component which extends Kafka with stream processing functionality. By that, Kafka can now not only reliably and scalable transport events and messages through the Kafka broker but also analyse and process these event in real-time. Interestingly Kafka Streams does not provide its own cluster infrastructure and it is also not meant to run on a Kafka cluster. The idea is to run Kafka Streams where it makes sense, which can be inside a “normal” Java application, inside a Web container or on a more modern containerized (cloud) infrastructure, such as Mesos, Kubernetes or Docker. Kafka Streams has a lot of interesting features, such as reliable state handling, queryable state and much more. KSQL is a streaming engine for Apache Kafka, providing a simple and completely interactive SQL interface for processing data in Kafka.

Kafka Connect & Kafka Streams/KSQL - the ecosystem around Kafka

Guido Schmutz

CI Provisioning with OpenStack - Gidi Samuels - OpenStack Day Israel 2016

Cloud Native Day Tel Aviv

Docker is an open-source project to easily create lightweight, portable, self-sufficient containers from any application. The same container that a developer builds and tests on a laptop can run at scale, in production, on VMs, bare metal, OpenStack clusters, public clouds and more. In this demo, I will show how to build a Apache image from a Dockerfile and deploy a PHP application which is present in an external folder using custom configuration files.

Docker - Demo on PHP Application deployment

Arun prasath

Some of the best businesses today are deploying their code dozens of times a day. How? By making heavy use of automation, smart tools, and repeatable patterns to get process out of the way and keep the workflow moving. Come to this session to learn how you can do this too, using services such as AWS OpsWorks, AWS CloudFormation, Amazon Simple Workflow Service, and other tools. We'll discuss a number of different deployment patterns, and what aspects you need to focus on when working toward deployment automation yourself.

(ARC402) Deployment Automation: From Developers' Keyboards to End Users' Scre...

Amazon Web Services

Continuous Delivery: The Next Frontier

Carlos Sanchez

Building services on AWS in China region

Roman Naumenko

Jazoon2010 - Edgar Silva - Open source SOA on Steroids

Edgar Silva

Installing tivoli system automation for high availability of db2 udb bcu on a...

Banking at Ho Chi Minh city

ContainerDays Boston 2015: "CoreOS: Building the Layers of the Scalable Clust...

DynamicInfraDays

Roy foubister (hosting high traffic sites on a tight budget)

WordCamp Cape Town

Similar to Continuous Deployment at Spreaker (20)

Autoscaling OpenStack Natively with Heat, Ceilometer and LBaaS

2016 - Easing Your Way Into Docker: Lessons From a Journey to Production

Anton Moldovan "Building an efficient replication system for thousands of ter...

How to contribute Apache CloudStack

HPC in the Cloud

Automating hard things may 2015

Terraform

Where is my scalable api?

[Spark Summit EU 2017] Apache spark streaming + kafka 0.10 an integration story

Apache Spark Streaming + Kafka 0.10 with Joan Viladrosariera

Kafka Connect & Kafka Streams/KSQL - the ecosystem around Kafka

CI Provisioning with OpenStack - Gidi Samuels - OpenStack Day Israel 2016

Docker - Demo on PHP Application deployment

(ARC402) Deployment Automation: From Developers' Keyboards to End Users' Scre...

Continuous Delivery: The Next Frontier

Building services on AWS in China region

Jazoon2010 - Edgar Silva - Open source SOA on Steroids

Installing tivoli system automation for high availability of db2 udb bcu on a...

ContainerDays Boston 2015: "CoreOS: Building the Layers of the Scalable Clust...

Roy foubister (hosting high traffic sites on a tight budget)

Recently uploaded

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Neo4j

The presentation explores the development and application of artificial intelligence (AI) from its inception to its current status in the modern world. The term "artificial intelligence" was first coined by John McCarthy in 1956 to describe efforts to develop computer programs capable of performing tasks that typically require human intelligence. This concept was first introduced at a conference held at Dartmouth College, where programs demonstrated capabilities such as playing chess, proving theorems, and interpreting texts. In the early stages, Alan Turing contributed to the field by defining intelligence as the ability of a being to respond to certain questions intelligently, proposing what is now known as the Turing Test to evaluate the presence of intelligent behavior in machines. As the decades progressed, AI evolved significantly. The 1980s focused on machine learning, teaching computers to learn from data, leading to the development of models that could improve their performance based on their experiences. The 1990s and 2000s saw further advances in algorithms and computational power, which allowed for more sophisticated data analysis techniques, including data mining. By the 2010s, the proliferation of big data and the refinement of deep learning techniques enabled AI to become mainstream. Notable milestones included the success of Google's AlphaGo and advancements in autonomous vehicles by companies like Tesla and Waymo. A major theme of the presentation is the application of generative AI, which has been used for tasks such as natural language text generation, translation, and question answering. Generative AI uses large datasets to train models that can then produce new, coherent pieces of text or other media. The presentation also discusses the ethical implications and the need for regulation in AI, highlighting issues such as privacy, bias, and the potential for misuse. These concerns have prompted calls for comprehensive regulations to ensure the safe and equitable use of AI technologies. Artificial intelligence has also played a significant role in healthcare, particularly highlighted during the COVID-19 pandemic, where it was used in drug discovery, vaccine development, and analyzing the spread of the virus. The capabilities of AI in healthcare are vast, ranging from medical diagnostics to personalized medicine, demonstrating the technology's potential to revolutionize fields beyond just technical or consumer applications. In conclusion, AI continues to be a rapidly evolving field with significant implications for various aspects of society. The development from theoretical concepts to real-world applications illustrates both the potential benefits and the challenges that come with integrating advanced technologies into everyday life. The ongoing discussion about AI ethics and regulation underscores the importance of managing these technologies responsibly to maximize their their benefits while minimizing potential harms.

Artificial Intelligence: Facts and Myths

Joaquim Jorge

[2024]Digital Global Overview Report 2024 Meltwater.pdf

hans926745

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

Finology Group – Insurtech Innovation Award 2024

The Digital Insurer

GenAI Risks & Security Meetup 01052024.pdf

lior mazor

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Scaling API-first – The story of a global engineering organization

Radu Cotescu

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

With more memory available, system performance of three Dell devices increased, which can translate to a better user experience Conclusion When your system has plenty of RAM to meet your needs, you can efficiently access the applications and data you need to finish projects and to-do lists without sacrificing time and focus. Our test results show that with more memory available, three Dell PCs delivered better performance and took less time to complete the Procyon Office Productivity benchmark. These advantages translate to users being able to complete workflows more quickly and multitask more easily. Whether you need the mobility of the Latitude 5440, the creative capabilities of the Precision 3470, or the high performance of the OptiPlex Tower Plus 7010, configuring your system with more RAM can help keep processes running smoothly, enabling you to do more without compromising performance.

Boost PC performance: How more available memory can improve productivity

Principled Technologies

Tech Trends Report 2024 Future Today Institute.pdf

hans926745

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

UK Journal

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Recently uploaded (20)

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Artificial Intelligence: Facts and Myths

[2024]Digital Global Overview Report 2024 Meltwater.pdf

Exploring the Future Potential of AI-Enabled Smartphone Processors

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Partners Life - Insurer Innovation Award 2024

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

Finology Group – Insurtech Innovation Award 2024

GenAI Risks & Security Meetup 01052024.pdf

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Scaling API-first – The story of a global engineering organization

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Boost PC performance: How more available memory can improve productivity

Tech Trends Report 2024 Future Today Institute.pdf

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

How to Troubleshoot Apps for the Modern Connected Worker

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

How to Troubleshoot Apps for the Modern Connected Worker

Continuous Deployment at Spreaker

1. Continuous Deployment at Marco Pracucci

2. Platform for Creating and Sharing Audio 8 people (4 developers) 2M unique listeners / month 3.5M audio tracks created 500 reqs / sec

3. We run 80% of our traffic on AWS about 60 EC2 instances and 50TB on S3

4. We deploy frequently [even on friday] 51 deploys in last 30 days

5. How we deploy the web [php] app in 90 seconds

6. Deploy task

7. code repository 1. ssh fab www.deploy EC2 instances

8. code repository 2. checkout fab www.deploy EC2 instances

9. code repository Checklist - local cache warmup 3. warmup - db schema migrations fab www.deploy - check consistency EC2 instances

10. code repository 4. switch code fab www.deploy everything ok? EC2 instances

11. code repository Checklist - iptables --dport 80 -j DROP - ln -sfn /var/www/new /var/www/curr 4. switch code - clear bytecode cache fab www.deploy - iptables --dport 80 -j ACCEPT EC2 instances

12. notify team on IRC generate report fab www.deploy

13. which instances to deploy? we do auto-scaling, they change dinamically

14. we exploited DNS

15. Split infrastructure into roles EC2 instances www1 api1 worker1 api2 www2 { worker2 { www3 { api3 role: api role: web role: worker-web

16. Tag each instance with roles [space separated roles for multi-role instances]

17. Map names and roles to DNS https://github.com/airbnb/zonify Creates Route 53 DNS entries for all instances and roles

18. Address a single instance

19. Address instances by role

20. Easy to integrate with fabric

21. Do you remember the starting point? Internally does fab -R web www.deploy

22. few good reasons Easy, Fast, Robust

23. few good reasons Easy, Fast, Robust Warning: an attacker can easier get your instances IPs (use an unguessable DNS zone name)

24. Thank you www.spreaker.com/marco @pracucci

Continuous Deployment at Spreaker

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Continuous Deployment at Spreaker

Similar to Continuous Deployment at Spreaker (20)

Recently uploaded

Recently uploaded (20)

Continuous Deployment at Spreaker