VelocityConf 2015 @San Jose

1. Part of the pipeline:
Why continuous testing is
essential
Adam Auerbach @Bugman31
Tapabrata Pal @TopoPal

2. @Bugman31 @TopoPal
Capital One
! 70 million accounts
! One of the largest Digital Banks
! ~ 20 years old

3. @Bugman31 @TopoPal
“…the winners in banking will have the capabilities of a
world-class software company.”
Rich Fairbank
Founder & CEO
Capital One

4. @Bugman31 @TopoPal
Different DNA
! Build our own software
! Build on public cloud
! MicroServices
! Open Source
! DevOpsSec and Continuous Delivery

5. @Bugman31 @TopoPal

6. @Bugman31 @TopoPal
Deliver High Quality Working Software Faster

7. @Bugman31 @TopoPal
Deliver High Quality Working Software Faster
• No security flaws
• No legal flaws
• Minimum defects
• All levels of testing done
• Code reviewed and source controlled
• Testing of application, configuration, scripts etc.
• Across LOBs, Shared Services and 3rd Parties
• Tested end-to-end
• All dependencies are satisfied
• How fast? ASAP?

8. @Bugman31 @TopoPal
http://www.netuba.org/

9. @Bugman31 @TopoPal
https://en.wikipedia.org/wiki/Oil_refinery

10. @Bugman31 @TopoPal
https://commons.wikimedia.org/wiki/File:US_Navy_060906-
N-8257O-026_Damage_Controlman_1st_Class_Petty_Officer_Derrick_Harney_assists_his_students_in_repairing_a_broken_pipeline_during_the_hands_on_patch_tr
aining_portion_of_the_Damage_Control_Wet_Trainer.jpg

11. @Bugman31 @TopoPal
Code Build
Release
Monitor
Deploy + Test Execution
App
Test
Infra
DEV INT QA PERF PROD
DEV INT
SEC
QA SEC PERF PROD
DEV INT QA SEC PERF PROD Infra
App
Flow Feedback
Automated Audit and Security Controls at every step

12. @Bugman31 @TopoPal
Backlog
Design
Sprints
Hardening

13. @Bugman31 @TopoPal
Continuous Testing
High Quality Working Software

14. @Bugman31 @TopoPal
Continuous Testing
! Static Scan
! Unit Testing
! Acceptance Test
! Performance Test
! Security Tests

15. @Bugman31 @TopoPal
Challenges
! Devices and Browsers
! Test Environments
! Test Data
! Dependencies
! What & When
! Visibility and Transparency
! People

16. @Bugman31 @TopoPal
Solution
! Devices and Browsers
- Use SaaS
- Needs a bit of engineering

17. @Bugman31 @TopoPal
Solution
! Test Environments
- On Demand, On the fly - Cloud

18. @Bugman31 @TopoPal
Solution
! Test Data
- On demand
- Freshly loaded
- Production Like

19. @Bugman31 @TopoPal
Solution
! Dependencies
- Service Virtualization

20. @Bugman31 @TopoPal
Solution
! What & When
- No good answer
- Fail fast
- Keep pipeline speed intact

21. @Bugman31 @TopoPal
Visibility: Dashboard Everything

22. @Bugman31 @TopoPal

23. @Bugman31 @TopoPal

24. @Bugman31 @TopoPal
People

25. @Bugman31 @TopoPal
Scaling Continuous Testing: DIY

26. @Bugman31 @TopoPal
Scaling Continuous Testing: Community

27. @Bugman31 @TopoPal
Scaling Engineering: Internal Conference
1 location
2 days
1,200+ attendees
28 Tech Expo Booths
52 Sessions
0 Vendor
2 locations
1 day
2,000+ attendees
54 Tech Expo Booths
146 Sessions
0 Vendor
2015 2016

28. @Bugman31 @TopoPal
Any
Question?