Snapshot Regression Testースナップショットを用いたリグレッション自動テスト
•
1 like•1,900 views
データのスナップショットを使って自動化の効率を改善した話
Recommended
Recommended
More Related Content
Similar to Snapshot Regression Testースナップショットを用いたリグレッション自動テスト
Similar to Snapshot Regression Testースナップショットを用いたリグレッション自動テスト (20)
More from Rakuten Group, Inc.
More from Rakuten Group, Inc. (20)
Recently uploaded
Recently uploaded (20)
Snapshot Regression Testースナップショットを用いたリグレッション自動テスト
- 1. Snapshot Regression Test ースナップショットを用いたリグレッション自動テスト 2020/6/30 Satoru Awasawa Travel Agile Dept. QA Section Rakuten, Inc.
- 2. 2 Agenda Introduction 自己紹介 Rakuten Travel 使ってみてください！ テスト自動化 自動テストの問題って？ じゃーこうすればどうかな？ アーキテクチャー紹介 デモ
- 3. 3 Satoru Awasawa Java Developer + System Architect 7 years in JAPAN AIRLINE system company 5 years in Rakuten Travel ‘Backend API’ Tech Manager 2 years in Rakuten Travel ‘Backend API’ QA Senior Manager 1 year before coming to QA! As of now managing both manual testing and automation testing My hobby Splatoon2(Nintendo-switch) Golf (Not virtual but real!)
- 4. 4 What’s ‘Rakuten Travel’? https://travel.rakuten.co.jp/ (2020/3/22)
- 5. 5 What’s ‘Rakuten Travel’? Domesti c Hotels Overseas hotels JAL DP ANA DP Overseas DP AIR Bus Rent-a- car https://travel.rakuten.com/ (2020/6/18) https://travel.rakuten.co.jp/ (SP) (2020/6/18)
- 6. 6 What’s ‘Rakuten Travel’? https://www.mlit.go.jp/report/press/content/001339698.pdf (国土交通省HPより) (2020/6/18) ©️いらすとや
- 7. 7 What’s the problem of automation test? SCENARIO EXPECTED VALUE TEST DATA
- 8. 8 ©️いらすとや
- 9. 9 Effort Comparison for Test Execution (1000 Test Cases) 0 83 833 1666 500 525 750 1000 0 200 400 600 800 1000 1200 1400 1600 1800 Initial 1time 10times 20times Man*Day（人日） Manual Test Automation Test
- 10. 10 with Getting the snapshot New automation test framework “SRT” https://publicdomainq.net/camera-taking-picture-0019733/
- 11. 11 New Automation Testing ‘SRT’ Manual Tester Data Req• Res• API Req• Res• APIHTTP ©️いらすとや
- 12. 12 New Automation Testing ‘SRT’ Manual Tester Data Req• Res• API Req• Res• APIHTTP Data Req• Res• Req• Res• HTTP Snapshot ©️いらすとや
- 13. 13 New Automation Testing ‘SRT’ Manual Tester Data Req• Res• API • Req • Res APIHTTP Data Req• Res• Req• Res• HTTP Snapshot Get the RQ+RS set snapshot with traceID and stacked it as regression test cases At the same time, Get the Data set snapshot. ©️いらすとや
- 14. 14 New Automation Testing ‘SRT’ Developer Data Req• Res• API Req• Res• APIHTTP Data Req• Res• Req• Res• HTTP Snapshot ©️いらすとや
- 15. 15 New Automation Testing ‘SRT’ Developer Data Req• Res• API • Req • Res APIHTTP Data Req• Res• Req• Res• HTTP Snapshot©️いらすとや
- 16. 16 New Automation Testing ‘SRT’ Developer Data Req• Res• API Req• Res• APIHTTP Data Req• Res• Req• Res• HTTP Snapshot©️いらすとや
- 17. 17 SRT Architecture (TestCase Creation) Manual Tester Capture Start Take Data Snapshot Mongo Oracle Mongo Oracle Log Analyzer Preparation Execution <API RQ/RS Data> <Test Id> <Transaction Id> Test DB <Test Specification> TestID RQ+RS DataSet App Client STG Proxy ©️いらすとや
- 18. 18 SRT Architecture (Test Execution) Developer Restore Data Snapshot Mongo Oracle Commit Test DB <Test Specification> TestID RQ+RS DataSet QA Test Executer Build/Deploy CICD©️いらすとや
- 19. 19 Demo Recordingthe scenario which is tested by manual tester Execution with updated data Execution with wrong code
- 20. 20 ©️いらすとや
- 21. 21 Effort Comparison for Test Execution (1000 Test Cases) 0 83 833 1666 500 525 750 1000 83 84 93 103 0 200 400 600 800 1000 1200 1400 1600 1800 Initial 1time 10times 20times Man*Day（人日） Manual Test Automation Test New AT 'SRT'