Submit Search
Upload
Quality Assurance of Machine Learning-based AI Systems
•
2 likes
•
712 views
Fuyuki Ishikawa
Follow
At JaSST'21 Tokyo, Mar 16 2021
Read less
Read more
Software
Report
Share
Report
Share
1 of 51
Download now
Download to read offline
Recommended
Machine learning testing survey, landscapes and horizons, the Cliff Notes
Machine learning testing survey, landscapes and horizons, the Cliff Notes
Heemeng Foo
Machine Learning
Machine Learning
Bhupender Sharma
NEUROMORPHIC COMPUTING.pdf
NEUROMORPHIC COMPUTING.pdf
CHENCHU CHANDU PRASANTH NADELLA
Application of machine learning in industrial applications
Application of machine learning in industrial applications
Anish Das
Data science presentation 2nd CI day
Data science presentation 2nd CI day
Mohammed Barakat
Machine Learning in Healthcare and Life Science
Machine Learning in Healthcare and Life Science
IDEAS - Int'l Data Engineering and Science Association
Feature Engineering
Feature Engineering
HJ van Veen
Model Evaluation in the land of Deep Learning
Model Evaluation in the land of Deep Learning
Pramit Choudhary
Recommended
Machine learning testing survey, landscapes and horizons, the Cliff Notes
Machine learning testing survey, landscapes and horizons, the Cliff Notes
Heemeng Foo
Machine Learning
Machine Learning
Bhupender Sharma
NEUROMORPHIC COMPUTING.pdf
NEUROMORPHIC COMPUTING.pdf
CHENCHU CHANDU PRASANTH NADELLA
Application of machine learning in industrial applications
Application of machine learning in industrial applications
Anish Das
Data science presentation 2nd CI day
Data science presentation 2nd CI day
Mohammed Barakat
Machine Learning in Healthcare and Life Science
Machine Learning in Healthcare and Life Science
IDEAS - Int'l Data Engineering and Science Association
Feature Engineering
Feature Engineering
HJ van Veen
Model Evaluation in the land of Deep Learning
Model Evaluation in the land of Deep Learning
Pramit Choudhary
Classification Algorithm.
Classification Algorithm.
Megha Sharma
Supervised Machine Learning Techniques
Supervised Machine Learning Techniques
Tara ram Goyal
Machine learning ppt.
Machine learning ppt.
ASHOK KUMAR
Introduction to Machine Learning
Introduction to Machine Learning
snehal_152
Machine learning
Machine learning
Dr Geetha Mohan
Improve ML Predictions using Connected Feature Extraction
Improve ML Predictions using Connected Feature Extraction
Databricks
AI in Manufacturing - John.pdf
AI in Manufacturing - John.pdf
John Chang
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Edureka!
Machine Learning Interview Questions and Answers | Machine Learning Interview...
Machine Learning Interview Questions and Answers | Machine Learning Interview...
Edureka!
Lessons learned from building practical deep learning systems
Lessons learned from building practical deep learning systems
Xavier Amatriain
Introduction to data science club
Introduction to data science club
Data Science Club
Artificial Intelligence High Technology PowerPoint Presentation Slides Comple...
Artificial Intelligence High Technology PowerPoint Presentation Slides Comple...
SlideTeam
Deep learning and Healthcare
Deep learning and Healthcare
Thomas da Silva Paula
Machine Learning presentation.
Machine Learning presentation.
butest
Quantum computing
Quantum computing
dharmsinghggu
Machine Learning
Machine Learning
Girish Khanzode
Quantum Computing: The Why and How
Quantum Computing: The Why and How
inside-BigData.com
Machine Learning Final presentation
Machine Learning Final presentation
AyanaRukasar
Machine Learning Course | Edureka
Machine Learning Course | Edureka
Edureka!
Architecture Design for Deep Neural Networks I
Architecture Design for Deep Neural Networks I
Wanjin Yu
機械学習工学の進展と課題 2021
機械学習工学の進展と課題 2021
Fuyuki Ishikawa
機械学習システムの品質に関するソフトウェア工学の動向(と安全性)
機械学習システムの品質に関するソフトウェア工学の動向(と安全性)
Fuyuki Ishikawa
More Related Content
What's hot
Classification Algorithm.
Classification Algorithm.
Megha Sharma
Supervised Machine Learning Techniques
Supervised Machine Learning Techniques
Tara ram Goyal
Machine learning ppt.
Machine learning ppt.
ASHOK KUMAR
Introduction to Machine Learning
Introduction to Machine Learning
snehal_152
Machine learning
Machine learning
Dr Geetha Mohan
Improve ML Predictions using Connected Feature Extraction
Improve ML Predictions using Connected Feature Extraction
Databricks
AI in Manufacturing - John.pdf
AI in Manufacturing - John.pdf
John Chang
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Edureka!
Machine Learning Interview Questions and Answers | Machine Learning Interview...
Machine Learning Interview Questions and Answers | Machine Learning Interview...
Edureka!
Lessons learned from building practical deep learning systems
Lessons learned from building practical deep learning systems
Xavier Amatriain
Introduction to data science club
Introduction to data science club
Data Science Club
Artificial Intelligence High Technology PowerPoint Presentation Slides Comple...
Artificial Intelligence High Technology PowerPoint Presentation Slides Comple...
SlideTeam
Deep learning and Healthcare
Deep learning and Healthcare
Thomas da Silva Paula
Machine Learning presentation.
Machine Learning presentation.
butest
Quantum computing
Quantum computing
dharmsinghggu
Machine Learning
Machine Learning
Girish Khanzode
Quantum Computing: The Why and How
Quantum Computing: The Why and How
inside-BigData.com
Machine Learning Final presentation
Machine Learning Final presentation
AyanaRukasar
Machine Learning Course | Edureka
Machine Learning Course | Edureka
Edureka!
Architecture Design for Deep Neural Networks I
Architecture Design for Deep Neural Networks I
Wanjin Yu
What's hot
(20)
Classification Algorithm.
Classification Algorithm.
Supervised Machine Learning Techniques
Supervised Machine Learning Techniques
Machine learning ppt.
Machine learning ppt.
Introduction to Machine Learning
Introduction to Machine Learning
Machine learning
Machine learning
Improve ML Predictions using Connected Feature Extraction
Improve ML Predictions using Connected Feature Extraction
AI in Manufacturing - John.pdf
AI in Manufacturing - John.pdf
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Machine Learning Interview Questions and Answers | Machine Learning Interview...
Machine Learning Interview Questions and Answers | Machine Learning Interview...
Lessons learned from building practical deep learning systems
Lessons learned from building practical deep learning systems
Introduction to data science club
Introduction to data science club
Artificial Intelligence High Technology PowerPoint Presentation Slides Comple...
Artificial Intelligence High Technology PowerPoint Presentation Slides Comple...
Deep learning and Healthcare
Deep learning and Healthcare
Machine Learning presentation.
Machine Learning presentation.
Quantum computing
Quantum computing
Machine Learning
Machine Learning
Quantum Computing: The Why and How
Quantum Computing: The Why and How
Machine Learning Final presentation
Machine Learning Final presentation
Machine Learning Course | Edureka
Machine Learning Course | Edureka
Architecture Design for Deep Neural Networks I
Architecture Design for Deep Neural Networks I
More from Fuyuki Ishikawa
機械学習工学の進展と課題 2021
機械学習工学の進展と課題 2021
Fuyuki Ishikawa
機械学習システムの品質に関するソフトウェア工学の動向(と安全性)
機械学習システムの品質に関するソフトウェア工学の動向(と安全性)
Fuyuki Ishikawa
ロバスト機械学習へのソフトウェア工学からのアプローチ
ロバスト機械学習へのソフトウェア工学からのアプローチ
Fuyuki Ishikawa
機械学習工学への誘い:SES'20チュートリアル
機械学習工学への誘い:SES'20チュートリアル
Fuyuki Ishikawa
Introduction at MLSE Int'l Symposiuim 2019
Introduction at MLSE Int'l Symposiuim 2019
Fuyuki Ishikawa
高信頼自動運転システム実現にむけて: ソフトウェア工学・機械学習の視点からの技術俯瞰
高信頼自動運転システム実現にむけて: ソフトウェア工学・機械学習の視点からの技術俯瞰
Fuyuki Ishikawa
IoT/AI時代のテスティング・検証技術の最前線
IoT/AI時代のテスティング・検証技術の最前線
Fuyuki Ishikawa
(今ちゃんと振り返る) ゴール指向要求分析 入門
(今ちゃんと振り返る) ゴール指向要求分析 入門
Fuyuki Ishikawa
品質保証における発見的・経験的アプローチの活用:ソフトウェアテスティング分野からの知見
品質保証における発見的・経験的アプローチの活用:ソフトウェアテスティング分野からの知見
Fuyuki Ishikawa
スマートなシステム、スマートなディペンダビリティ保証-次世代システムを頼れるものへ
スマートなシステム、スマートなディペンダビリティ保証-次世代システムを頼れるものへ
Fuyuki Ishikawa
機械学習応用システムの品質保証に向けて
機械学習応用システムの品質保証に向けて
Fuyuki Ishikawa
自動(運転)車システムのためのAI的自動テスト生成
自動(運転)車システムのためのAI的自動テスト生成
Fuyuki Ishikawa
AIによるテスト・デバッグ技術 イントロ&チュートリアル
AIによるテスト・デバッグ技術 イントロ&チュートリアル
Fuyuki Ishikawa
More from Fuyuki Ishikawa
(13)
機械学習工学の進展と課題 2021
機械学習工学の進展と課題 2021
機械学習システムの品質に関するソフトウェア工学の動向(と安全性)
機械学習システムの品質に関するソフトウェア工学の動向(と安全性)
ロバスト機械学習へのソフトウェア工学からのアプローチ
ロバスト機械学習へのソフトウェア工学からのアプローチ
機械学習工学への誘い:SES'20チュートリアル
機械学習工学への誘い:SES'20チュートリアル
Introduction at MLSE Int'l Symposiuim 2019
Introduction at MLSE Int'l Symposiuim 2019
高信頼自動運転システム実現にむけて: ソフトウェア工学・機械学習の視点からの技術俯瞰
高信頼自動運転システム実現にむけて: ソフトウェア工学・機械学習の視点からの技術俯瞰
IoT/AI時代のテスティング・検証技術の最前線
IoT/AI時代のテスティング・検証技術の最前線
(今ちゃんと振り返る) ゴール指向要求分析 入門
(今ちゃんと振り返る) ゴール指向要求分析 入門
品質保証における発見的・経験的アプローチの活用:ソフトウェアテスティング分野からの知見
品質保証における発見的・経験的アプローチの活用:ソフトウェアテスティング分野からの知見
スマートなシステム、スマートなディペンダビリティ保証-次世代システムを頼れるものへ
スマートなシステム、スマートなディペンダビリティ保証-次世代システムを頼れるものへ
機械学習応用システムの品質保証に向けて
機械学習応用システムの品質保証に向けて
自動(運転)車システムのためのAI的自動テスト生成
自動(運転)車システムのためのAI的自動テスト生成
AIによるテスト・デバッグ技術 イントロ&チュートリアル
AIによるテスト・デバッグ技術 イントロ&チュートリアル
Recently uploaded
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
ABDERRAOUF MEHENNI
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
MyIntelliSource, Inc.
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
bodapatigopi8531
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
ComplianceQuest1
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
anilsa9823
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Steffen Staab
Software Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
Arshad QA
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
ThousandEyes
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTV
shikhaohhpro
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
Willy Marroquin (WillyDevNET)
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.js
Andolasoft Inc
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
kellynguyen01
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
OnePlan Solutions
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
kalichargn70th171
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
Delhi Call girls
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
aagamshah0812
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
anilsa9823
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
ICS
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
panagenda
Recently uploaded
(20)
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Software Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTV
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.js
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
Quality Assurance of Machine Learning-based AI Systems
1.
2.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
3.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
4.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
5.
◼ ◼ ◼
6.
◼
7.
◼ ◼ ◼ ◼
8.
◼ ◼ ◼ ◼ ◼ ◼ ◼
9.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
10.
◼ ◼ ◼ ◼ ◼
11.
◼ ◼ ◼ ◼ ◼
12.
13.
◼ ◼ ◼ ◼ ◼ ◼ ◼
14.
◼ ◼
15.
◼ ◼
16.
◼
17.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
18.
◼ ◼ ◼ ◼ ◼ ◼
19.
0 20 40
60 80 100 Architecture Design Training Data Operation Project Management Updates Debugging Testing & Quality Evaluation / Assurance Decision Making with Customers
20.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
21.
◼ ◼ ◼ ◼ ◼
22.
◼
23.
◼ ◼ ◼ ◼ ◼ ◼
24.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
25.
◼ ◼ ◼
26.
◼ ◼ ◼ 𝑇𝑃 𝑇𝑃 +
𝐹𝑃 = 15 45 = 0.3333
27.
◼ ◼ ◼ ◼ ◼ ◼ ◼
28.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
29.
◼ ◼ ◼ ◼
30.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
31.
• • • • • • • • • • •
32.
◼ • • • • • • • •
33.
◼
34.
◼ ◼
35.
◼
36.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
37.
◼ ◼ ◼ ◼
38.
39.
40.
◼ ◼ ◼ ◼ ◼ ◼ ◼
41.
◼ ◼
42.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
43.
◼ ◼ ◼ ◼ ◼ ◼ ◼
44.
◼ ◼ ◼ ◼ ◼ ◼ ◼
45.
◼ ◼
46.
◼ ◼ ◼ ◼
47.
◼ ◼ ◼ ◼ ◼ ◼
48.
◼ ◼ ◼ ◼ ◼ ◼
49.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
50.
◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼ ◼
51.
◼ ◼ ◼ ◼ ◼
Download now