Automation: The Good, The Bad and The Ugly with DevOpsGuys - AppD Summit Europe
How The Container Store uses AppDynamics in their development lifecycle
1. How The Container Store uses
AppDynamics in their development lifecycle
August Azzarello, The Container Store
Anand Akela, AppDynamics
2. August Azzarello
Software Quality Engineer
The Container Store
Our Presenters
Anand Akela
Director, Product Marketing, APM
AppDynamics
3. • The Container Store
• Challenges
• Solution
• Benefits
• APM Best Practices
• AppDynamics BizDevOps Collaboration
• Q&A
Agenda
4. • Leading retailer of storage and organization products
• Founded in 1978 – 72 stores nationwide
• FORTUNE magazine’s 100 Best Companies To Work For®
www.containerstore.com www.whatwestandfor.com
5. • APM solution used as reactive monitoring tool
• Customer impacting issues already introduced
• No insight into test environment, lack of
reporting on automated testing
Challenges
6. • Install AppDynamics into our test environments
• Build automated functional and performance
suites
• Baseline performance and functional metrics,
alert on deviations
• Build BT and alert policies in test
Solution
12. Tools used for automated testing
• Selenium (Ruby) for
Functional Testing
• Locust.io (Python) for
Performance Testing
13. • Set performance expectations before
production deployments
• Fine tune alert and BT policies prior
to production deployments
• Identify testing requirements, and
testing gaps
• Decrease performance test result
reporting from 5 hours to 20 minutes
Benefits
15. Best Practices
• Monitor everything
• If you can’t see it, you can’t monitor or test it
• Make health rules in test, promote to production
• BT Maintenance
• Test continuously
• Continuous test will help build baselines, better your ability to realize
deviations on performance and functional errors
• Performance test early in development life cycle
• The earlier you detect performance problems, the less impact they will
have on your release cycle
• Empower development & QA team members
• AppDynamics can give the ability for QA members to give more in depth
bug reports, forging strong team relationships and increasing efficiency
19. Purchase
Search Flight
Flight Status
Login
Infrastructure
Capacity
%
Business
Revenue
End User
Experience
Application
Performance
Oracle
Network
CDN
Browser(s)
Native
Mobile
App
Tomcat Service Weblogic Service .NET Service
Cassandra
ESB/MQ
Apache
JBoss Service
Enabling BizDevOps with Application Intelligence
APPLICATION INTELLIGENCE
Development
Operations
Business
20. Five Keys for BizDevOps Success
• Complete business transaction
visibility to expedite remediation of
app performance issue
• Ensure readiness for exceptional
customer experience in pre-
production
• Effectively collaborate with Dev, Ops
and Biz
• Reduce cost and risk through
automated change management
• Unlock actionable business insights
with Application Analytics