Paris hackers Meetup #12 - How to handle large audience
•Download as PPTX, PDF•
1 like•1,074 views
How to handle large audience ? Maxime Kurkdjian CEO of Oxalide explain how the Devops team can handle large audience with Varnish.
Recommended
Recommended
More Related Content
What's hot
What's hot (12)
Similar to Paris hackers Meetup #12 - How to handle large audience
Similar to Paris hackers Meetup #12 - How to handle large audience (20)
More from Oxalide
More from Oxalide (20)
Recently uploaded
Recently uploaded (20)
Paris hackers Meetup #12 - How to handle large audience
- 1. How to handle large audience © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com Conseil |Infogérance | Hébergement
- 2. © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com #ManagedServices #Hosting #DevOps #Agile #Opensource #Web
- 3. References Performances © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com Record of January 2015 56 000request / seconde on one customer 157Millions visits 28 millions visits 46 Millions visits 42 Millions visits 41 Millions visits
- 4. References Performances © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com 700 Mbps 250 K pps 20 K requests / second
- 5. © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com The Challenge Produce consistent quality Whatever the audience
- 6. © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com Visitors Limited ressources Efficiency $
- 7. 1. Continuous improvement 2. Caching 3. Technical zoom on Varnish Efficiency
- 8. Continuous improvement Definition of the KPI PERFORMANCE MEASUREMENT & MONITORING Business indicators WEBSITE CAPACITY KPI © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com – Maximum response time – Capacity of the website without UX degradation – Capacity of the increase load (ex : 1000 connexions in 5 minutes) – Response time on the increase load – Tracking this KPI in short and long term
- 9. Continuous improvement Detect the improvement leverages © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com Application Define references values with load tests 0 Infrastructure
- 10. Continuous improvement Some tools © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com Mais aussi • Siege • Apache Bench
- 11. © 2015 - Oxalide - Conseil | Infogérance | Hébergement - http://www.oxalide.com - 01.75.77.16.66 / http://www.twitter.com/oxalide Challenge Effiency
- 12. TOWER DEFENSE © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com
- 13. Improve response time Ressources protections APC Memcached Query Cache 10 %100 % 90 % 1st rampart 2nd rampart 3rd rampart 4th rampart Curious ContributorsReader Trolls © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com
- 14. Benefits Huge leverage Improve the response time Improve the UX Multiply your website capacity Reduce time of processing x 100 / Y © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com
- 15. © 2015 - Oxalide - Conseil | Infogérance | Hébergement - http://www.oxalide.com - 01.75.77.16.66 / http://www.twitter.com/oxalide Increase your website capacity Scalable architecture
- 16. Increase your website capacity Scalable architecture Application Front applicationFront Cache Application cache Backend Backoffice Application © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com
- 17. © 2015 - Oxalide - Conseil | Infogérance | Hébergement - http://www.oxalide.com - 01.75.77.16.66 / http://www.twitter.com/oxalide Fine tuning Oxalide Best Practices
- 18. Effiency mindset © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com
- 19. © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com
- 20. Server tuning FROM LOW TO HIGH LEVEL © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com Architecture Hardware / Firmware Kernel Varnish System
- 21. Mindset © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com Il semble que la perfection soit atteinte non quand il n'y a plus rien à ajouter, mais quand il n'y a plus rien à retrancher. Antoine de Saint Exupéry « « It seems that perfection is attained not when there is nothing more to add, but when there is nothing more to remove. antoine-st-exupery.eng.srt
- 22. Under the server : ressources protection Network Architecture © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com NoTrack / RAW VLAN / DMZ VLAN VLAN Cache Front Back Load Balancer Firewall L3/L4 Load Balancer Firewall L7
- 23. Higher level 2 Varnish levels © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com Apache Apache Level 1 High Capacity Level 2 Intelligence
- 24. Tuning BIOS © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com
- 25. Choose your hardware Low latency © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com NIC 10 GbpsHigh FrequencyLow latency
- 26. On the server Kernel Config © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com • Init congestion Window TCP (initcwnd) • Network Interface Queuing / RPS • Sysctl IP/TCP • Syn Proxy
- 27. On server application Varnish tuning © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com Boost the ressources (FD, threads, buffers) Monitoring your miss/hit rate very carefully DevOps needed ! Dominos effect (www-0x)
- 28. Continuous improvement Infrastructure KPI © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com Memory usageCPU Load Consumption bandwidth Usage of the middleware
- 29. Continuous improvement Infrastructure KPI © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com
- 30. Monitor your life bar Get ready for everything © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com Expected & Acceptable values
- 31. © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com
- 32. © 2015 - Oxalide - Conseil | Infogérance | Hébergement - 01.75.77.16.66 - http://www.oxalide.com job@oxalide.com
Editor's Notes
- Le Parisien : 46 Millions de visites 20 minutes : 42 Millions de visites L’Express : 41 Millions de visites Radio France : 28 millions de visites
- Les ressources informatiques ne sont pas infini (faisabilité de la scalabilité, durabilité financière) Efficacité ou efficicence = faire plus avec moins Soit d’adresser un trafic en croissance sans investir plus dans son infra
- This can be included in your continuous delivery process
- The right tool at the right place
- Inversion du rapport de performance (temps necessaire pour une requete vs nombre de requete par seconde)
- Microservice … mais le réseau ?
- Le bon niveau de LB L3/L4 sur le LVS, L7 sur les varnish Effet domino si le nombre de frontaux n’est pas suffisant (protection sur le LVS)
- Virtual machine ? -> NO, too many int/sec, and the first line of defense must not me mutualised thie the rest http://www.dellhpcsolutions.com/dellhpcsolutions/assets/Optimal_BIOS_HPC_Dell_12G.v1.0.pdf