SlideShare a Scribd company logo
1 of 28
Connecting Virtual Robot to Real Robot
Happy Mini @ Girls Art Project Kensei Demura
Outline
1. Hardware
2. Software
1. Hardware
Enabling clumsy people developing home robot
hardware
VR
Goal
Starting hardware development of robot
from VR, then make it in the real space
Connection of VR and Real Robot
VR
2. CAD
4. Software Test
3. CAE
5. User Test
Real
7. Material Selection
10.Real Robot
8. Choosing
Computer/Sensor Specs
9.Manifacturing
1. Concept
6. Digital
Fabrication
1. Concept
• Happy Mini Ideathon
2. Concept Design with CAD
1st generation 2nd generation 3rd generation
3. Compare Robot Appearance in VR
4. Checking sensor location
• Able to understand the camera location needs to be upper
the head of the robot
5. Mechanical Design
6. Testing robot human interaction
• Understanding it needs a handle to grab it
Hardware Design done!
Difficulties
Digital Fabrication is not developed yet
3D Printer can’t print big streamline shape
Handmade…
Outsourcing Digital Fabrication
Difficult to find company which accepts 3D Data format
Plastic Mold
• Planning to make it from sewing
2. Software
Goal
Make the environment that robot A.I. learn and program by
themselves
Reinforcement Learning in SIGVerse
OpenAI Gym ROS & SIGVerse:
https://github.com/kendemu/gym-ros
Problem of Reinforcement Learning in
SIGVerse
• Needs generality of environment for A.I., needs many number
of room
Normal SIGVerse : Limited number of room layout
What we tried①
• Geographic 3D Map API
Lack of data in Japan, countryside U.S.
What we tried② :Building 3D Data
Useful for testing in real estate environment but needs human
hands & fixing to use it in the VR
Our Approach : Procedural Generation
A.I. builds the room layout automatically, able to make large
amount of room layout
Room Procedural Generation
Procedural Terrain Generation
Procedural City Generation

More Related Content

Similar to Connecting Virtual to Real Robot with SIGVerse Robot Simulator

Similar to Connecting Virtual to Real Robot with SIGVerse Robot Simulator (20)

The future of software is bot-powered and design-driven
The future of software is bot-powered and design-drivenThe future of software is bot-powered and design-driven
The future of software is bot-powered and design-driven
 
Virtual reality
Virtual reality Virtual reality
Virtual reality
 
Doaa-VR-lecture1.pdf
Doaa-VR-lecture1.pdfDoaa-VR-lecture1.pdf
Doaa-VR-lecture1.pdf
 
Fusing Artificial Intelligence with Augmented Reality on Android - 1 Feb. 2019
Fusing Artificial Intelligence with Augmented Reality on Android - 1 Feb. 2019Fusing Artificial Intelligence with Augmented Reality on Android - 1 Feb. 2019
Fusing Artificial Intelligence with Augmented Reality on Android - 1 Feb. 2019
 
Pieter Brinkman - My first mobile experience From mobile no no, to mobile go ...
Pieter Brinkman - My first mobile experienceFrom mobile no no, to mobile go ...Pieter Brinkman - My first mobile experienceFrom mobile no no, to mobile go ...
Pieter Brinkman - My first mobile experience From mobile no no, to mobile go ...
 
3D face creation via 2D images within blender virtual environment
3D face creation via 2D images within blender virtual environment3D face creation via 2D images within blender virtual environment
3D face creation via 2D images within blender virtual environment
 
Sixthsensetechnology032 120812015706-phpapp01
Sixthsensetechnology032 120812015706-phpapp01Sixthsensetechnology032 120812015706-phpapp01
Sixthsensetechnology032 120812015706-phpapp01
 
Sixthsensetechnology
SixthsensetechnologySixthsensetechnology
Sixthsensetechnology
 
Gaia project
Gaia projectGaia project
Gaia project
 
Mobile (App) Development with Sitecore
Mobile (App) Development with SitecoreMobile (App) Development with Sitecore
Mobile (App) Development with Sitecore
 
Storytelling using Immersive Technologies
Storytelling using Immersive TechnologiesStorytelling using Immersive Technologies
Storytelling using Immersive Technologies
 
Developing windows 8 apps
Developing windows 8 appsDeveloping windows 8 apps
Developing windows 8 apps
 
2022 COMP4010 Lecture 6: Designing AR Systems
2022 COMP4010 Lecture 6: Designing AR Systems2022 COMP4010 Lecture 6: Designing AR Systems
2022 COMP4010 Lecture 6: Designing AR Systems
 
How to create a smart Photobooth
How to create a smart PhotoboothHow to create a smart Photobooth
How to create a smart Photobooth
 
presentation1-180123jjjjjjjj150728_2.pdf
presentation1-180123jjjjjjjj150728_2.pdfpresentation1-180123jjjjjjjj150728_2.pdf
presentation1-180123jjjjjjjj150728_2.pdf
 
C. VR intrduction_lecture for introduction to VR Lecture-1.pptx
C. VR intrduction_lecture for introduction to VR Lecture-1.pptxC. VR intrduction_lecture for introduction to VR Lecture-1.pptx
C. VR intrduction_lecture for introduction to VR Lecture-1.pptx
 
Sixth sense technology1
Sixth sense technology1Sixth sense technology1
Sixth sense technology1
 
Module6rob prog mr302_mtr_ncerc
Module6rob prog mr302_mtr_ncercModule6rob prog mr302_mtr_ncerc
Module6rob prog mr302_mtr_ncerc
 
Virtual Reality & Augmented Reality
Virtual Reality & Augmented RealityVirtual Reality & Augmented Reality
Virtual Reality & Augmented Reality
 
Azure machine learning services in xamarin
Azure machine learning services in xamarinAzure machine learning services in xamarin
Azure machine learning services in xamarin
 

More from Kensei Demura

ロボカップ世界大会報告@IPAセキュリティキャンプ全国大会2016チューター成果報告
ロボカップ世界大会報告@IPAセキュリティキャンプ全国大会2016チューター成果報告ロボカップ世界大会報告@IPAセキュリティキャンプ全国大会2016チューター成果報告
ロボカップ世界大会報告@IPAセキュリティキャンプ全国大会2016チューター成果報告
Kensei Demura
 
Robots I made in Robocup
Robots I made in RobocupRobots I made in Robocup
Robots I made in Robocup
Kensei Demura
 
Robots I made in Robocup
Robots I made in RobocupRobots I made in Robocup
Robots I made in Robocup
Kensei Demura
 

More from Kensei Demura (20)

FutureKreateロボットシミュレータ
FutureKreateロボットシミュレータFutureKreateロボットシミュレータ
FutureKreateロボットシミュレータ
 
新型Happy Miniの発表 @ RoboCup 2017 NVIDIA 展示ブース
新型Happy Miniの発表 @ RoboCup 2017 NVIDIA 展示ブース新型Happy Miniの発表 @ RoboCup 2017 NVIDIA 展示ブース
新型Happy Miniの発表 @ RoboCup 2017 NVIDIA 展示ブース
 
ロボカップ世界大会報告@IPAセキュリティキャンプ全国大会2016チューター成果報告
ロボカップ世界大会報告@IPAセキュリティキャンプ全国大会2016チューター成果報告ロボカップ世界大会報告@IPAセキュリティキャンプ全国大会2016チューター成果報告
ロボカップ世界大会報告@IPAセキュリティキャンプ全国大会2016チューター成果報告
 
Robots I made in Robocup
Robots I made in RobocupRobots I made in Robocup
Robots I made in Robocup
 
Robots I made in Robocup
Robots I made in RobocupRobots I made in Robocup
Robots I made in Robocup
 
生活支援ロボットMini@ROS勉強会
生活支援ロボットMini@ROS勉強会生活支援ロボットMini@ROS勉強会
生活支援ロボットMini@ROS勉強会
 
7・27ランチ自己紹介2015
7・27ランチ自己紹介2015 7・27ランチ自己紹介2015
7・27ランチ自己紹介2015
 
Happy Robot Mini
Happy Robot MiniHappy Robot Mini
Happy Robot Mini
 
RoboCup@home SPL Technical league intro
RoboCup@home SPL Technical league introRoboCup@home SPL Technical league intro
RoboCup@home SPL Technical league intro
 
Dream slush
Dream slushDream slush
Dream slush
 
KANAZAWAスマホアプリコンテスト企画書
KANAZAWAスマホアプリコンテスト企画書KANAZAWAスマホアプリコンテスト企画書
KANAZAWAスマホアプリコンテスト企画書
 
Development of human support robot
Development of human support robotDevelopment of human support robot
Development of human support robot
 
賢聖プレゼンSictic2013
賢聖プレゼンSictic2013賢聖プレゼンSictic2013
賢聖プレゼンSictic2013
 
ロボカップジュニア日本大会提出論文(出村賢聖)140317
ロボカップジュニア日本大会提出論文(出村賢聖)140317ロボカップジュニア日本大会提出論文(出村賢聖)140317
ロボカップジュニア日本大会提出論文(出村賢聖)140317
 
賢聖自律型ロボットの開発2012
賢聖自律型ロボットの開発2012賢聖自律型ロボットの開発2012
賢聖自律型ロボットの開発2012
 
Kensei sictic2012
Kensei sictic2012Kensei sictic2012
Kensei sictic2012
 
RobocupJunior summercamp
RobocupJunior summercampRobocupJunior summercamp
RobocupJunior summercamp
 
ロボカップジュニア自由研究2011
ロボカップジュニア自由研究2011ロボカップジュニア自由研究2011
ロボカップジュニア自由研究2011
 
ノダチュウポスター2011
ノダチュウポスター2011ノダチュウポスター2011
ノダチュウポスター2011
 
Robot upgrade school to SICTIC2013
Robot upgrade school to SICTIC2013Robot upgrade school to SICTIC2013
Robot upgrade school to SICTIC2013
 

Recently uploaded

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Recently uploaded (20)

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 

Connecting Virtual to Real Robot with SIGVerse Robot Simulator