SlideShare a Scribd company logo
1 of 12
Download to read offline
Location, DD/MM/YYYYPresentation Title
Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system
2
• Complex intelligent IoT ecosystems is required to react to system requirements and environment changes
• ROS-based CPS is used in various IoT Domains, interoperability will bring potential benefits
• Lack of interoperability between heterogeneous platforms
• Emerging IoT standards prevent to integrate new IoT platforms
• Off-the-shell IoT devices/platforms don't support secondary development
WHY ROS EDGE NODE IS NEEDED?
Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system
3
FEATURES OF ROS EDGE NODE
fffInteroperability fffPlug & Play
fffAutomatic
Adaptation fffStandard
Compliant
It enables the communications
between ROS-based CPS and
other heterogeneous IoT systems
in an intelligent and autonomous
infrastructure
A code generator automatically
abstracts the ad-hoc ROS
functionalities provided by
different ROS-based CPSs and
speeds up the adaptor
development process
An event-driven approach automates
the software modules deployment at
BRAIN-IoT runtime in a distributed
execution environment according to
specific system requirements and user
events
It exploits the Web of Things (WoT)
Thing Description (TD) describing the
services provided by ROS-based CPSs,
making it more portable to
the production environment, not restrict
to the OSGi implementation
An adaptor integrating ROS-based CPSs with BRAIN-IoT platform
Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system
4
• L1 (Physical): a set of physical computing
resources (e.g. Linux Server, ROS-based robots).
• L2 (Fabric): a set of OSGi/Java agents and
infrastructure services providing discovery, system
provisioning and communication services.
• L3 (System): a set of inter-related software
components containing infrastructure service (e.g.
BMS, BIS) for searching, deploying other services.
• L4 (BRAIN-IoT Services): system software
modules with capabilities.
OVERVIEW OF BRAIN-IOT CONTEXT
Hardware Layer (e.g. CPSs)
Fabric Runtime (Java / OSGi)
BMS
BIS
BIS
BIS
1
2
3
BRAIN-IoT
Service
Edge Node4
BRAIN-IoT Structural layers
BMS: Behaviour Management Service
BIS: Bundle Installer Service
BRAIN-IoT
Services
Dynamically
Loaded
BRAIN-IoT Repository
UI
EventBus
ARCHITECTURE OF ROS EDGE NODE 5
Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system
1
2
1. Abstraction of ROS Functionalities
• List of clients of ROS services/publishers/subscribers
• Mapping between native messages in ROS and Java
types
2. Integration with BRAIN-IoT EventBus
• Formatting of events and ROS message in java type
• Interact with ROS through ROS service clients
6
Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system
ROS EDGE NODE IMPLEMENTATION
Code
Generator
{
"@type": "Thing",
"properties":{...},
"actions":{
"serviceClientName":{
...
"serviceName":{...},
"serviceType":{...},
"serviceRequestType":{...},
"serviceResponseType":{...},
"ClassName":{...}
},
...
}
} Physical Robot
Remote Procedure Call
System Status
Monitoring
IP
ROS Edge Node
ROS Service
Clients
Events handler
AI Algorithms
Bridging
JCodeModel Lib
DEMONSTRATION AND VALIDATION 7
Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system
Objective: A swarm of RB-1 BASE
mobile robots cooperate to move all carts from
picking area to storage area passing through an
automated door with a QR code.
• A multi-agent system is created where each robot
is controlled by a Robot Behavior service through ROS
Edge Node.
• A list of tasks is shared by the Robot Behavior services.
• Robots are aware of the door by scanning the QR code.
• Door is controlled by a Door Edge Node through HTTP
protocol.
A MULTI-AGENT ROBOTICS SYSTEM
8
Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system
DEVELOPMENT OF ROS EDGE NODE FOR RB1 BASE ROBOT
{ "title":"Robotnik RB1 Base Mobile Robot",
"@type":"Thing",
"properties":{
"availability":{
"robot:capability":"robot:AvailabilityMonitoring",
"properties":{
"Role": {"const":"Subscriber"},
"TopicType": {"const":"robot_local_control_msgs/Status"},
"MessageType": {"const":"robot_local_control_msgs.Status"},
"RosClass": {"const":"robot_local_control_msgs.Status"} },
"forms":[{
"href":"/#robotName/robot_local_control/state",} ] } } },
"actions":{
"GoTo":{
"input":{
"properties":{
"serviceType": {"const":"robot_local_control_msgs/GoToPetition"},
"serviceRequestType": {"const":"robot_local_control_msgs.GoToPetitionRequest"},
"RosClass": {"const":"GoToComponent"} } },
"output":{
"properties":{
"serviceResponseType":{"const":"robot_local_control_msgs.GoToPetitionResponse"} }},
"forms":[ {
"href":"/#robotName/robot_local_control/NavigationComponent/GoToComponent/add
", } ] } } }
Code
Generator
ROS Edge Node
for RB1 Base
Robot
9
Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system
BRAIN-IOT USER INTERFACE
10
Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system
INTERACTION BETWEEN ROBOT AND DOOR
• Interested event types are registered to be
received from the asynchronous EventBus
interface at runtime
• ROS Edge Node continuously queries the status
changes in ROS and issue response events to
notify the application services. (e.g. battery level)
• Events are filtered in distributed EventBus
11
ROS Edge Node is developed as an adaptor to ROS-based Robotics systems in BRAIN-IoT
platform allowing:
• Interoperability with other heterogeneous IoT systems through distributed EventBus.
• Fast adaptation to various ROS-based IoT devices/platforms using a Code Generator
• Standard Compliant by exploiting WoT TD, making it portable to production
environment
• Plug & Play without stopping other services at BRAIN-IoT execution
environment leveraging OSGi specification in sophisticated IoT scenarios
Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system
CONCLUSIONS
CONTACTS
This project has received funding from the European Union’s Horizon 2020 research
and innovation programme under grant agreement No 780089.
Researcher
rui.zhao@linksfoundation.com
LINKS Foundation – Leading Innovation & Knowledge for Society
CONTACTS
RUI ZHAO

More Related Content

What's hot

IoT Levels and Deployment Templates
IoT Levels and Deployment TemplatesIoT Levels and Deployment Templates
IoT Levels and Deployment TemplatesPrakash Honnur
 
Internet of Things and Quality Assurance
Internet of Things and Quality AssuranceInternet of Things and Quality Assurance
Internet of Things and Quality AssuranceKhubaib Rehman
 
Wireless access control system based on ieee 802.15.4
Wireless access control system based on ieee 802.15.4Wireless access control system based on ieee 802.15.4
Wireless access control system based on ieee 802.15.4Ecway Technologies
 
Wireless access control system based on ieee 802.15.4
Wireless access control system based on ieee 802.15.4Wireless access control system based on ieee 802.15.4
Wireless access control system based on ieee 802.15.4Ecwaytech
 
Ima an integrated monitoring architecture with sensor networks
Ima an integrated monitoring architecture with sensor networksIma an integrated monitoring architecture with sensor networks
Ima an integrated monitoring architecture with sensor networkssudhakar5472
 
IoT Home monitoring system
IoT Home monitoring system IoT Home monitoring system
IoT Home monitoring system Puneet Mishra
 
3.pillars of embedded io t and physical devices
3.pillars of embedded io t and physical devices3.pillars of embedded io t and physical devices
3.pillars of embedded io t and physical devicesRaghavendra Maggavi
 
Development and examination of fog computing based encrypted control system
Development and examination of fog computing based encrypted control systemDevelopment and examination of fog computing based encrypted control system
Development and examination of fog computing based encrypted control systemVenkat Projects
 
IoT testing and quality assurance indicthreads
IoT testing and quality assurance indicthreadsIoT testing and quality assurance indicthreads
IoT testing and quality assurance indicthreadsIndicThreads
 
Portfolio dang minhhung
Portfolio dang minhhungPortfolio dang minhhung
Portfolio dang minhhunghungdang117
 

What's hot (18)

Io t introduction
Io t introductionIo t introduction
Io t introduction
 
IoT Levels and Deployment Templates
IoT Levels and Deployment TemplatesIoT Levels and Deployment Templates
IoT Levels and Deployment Templates
 
Internet of Things and Quality Assurance
Internet of Things and Quality AssuranceInternet of Things and Quality Assurance
Internet of Things and Quality Assurance
 
Bio stamp
Bio stampBio stamp
Bio stamp
 
Wireless access control system based on ieee 802.15.4
Wireless access control system based on ieee 802.15.4Wireless access control system based on ieee 802.15.4
Wireless access control system based on ieee 802.15.4
 
Wireless access control system based on ieee 802.15.4
Wireless access control system based on ieee 802.15.4Wireless access control system based on ieee 802.15.4
Wireless access control system based on ieee 802.15.4
 
Ns2 Projects
Ns2 ProjectsNs2 Projects
Ns2 Projects
 
Lecture 5
Lecture 5Lecture 5
Lecture 5
 
Ima an integrated monitoring architecture with sensor networks
Ima an integrated monitoring architecture with sensor networksIma an integrated monitoring architecture with sensor networks
Ima an integrated monitoring architecture with sensor networks
 
IoT Home monitoring system
IoT Home monitoring system IoT Home monitoring system
IoT Home monitoring system
 
3.pillars of embedded io t and physical devices
3.pillars of embedded io t and physical devices3.pillars of embedded io t and physical devices
3.pillars of embedded io t and physical devices
 
Chapter 1 pdf
Chapter 1 pdfChapter 1 pdf
Chapter 1 pdf
 
Development and examination of fog computing based encrypted control system
Development and examination of fog computing based encrypted control systemDevelopment and examination of fog computing based encrypted control system
Development and examination of fog computing based encrypted control system
 
Iot m2m
Iot m2mIot m2m
Iot m2m
 
IoT testing and quality assurance indicthreads
IoT testing and quality assurance indicthreadsIoT testing and quality assurance indicthreads
IoT testing and quality assurance indicthreads
 
Portfolio dang minhhung
Portfolio dang minhhungPortfolio dang minhhung
Portfolio dang minhhung
 
Lecture 11
Lecture 11Lecture 11
Lecture 11
 
Serp4 iot20.ppt
Serp4 iot20.pptSerp4 iot20.ppt
Serp4 iot20.ppt
 

Similar to SAM-IoT: A Cross-Platform Communication Mechanism for ROS-Based Cyber-Physical System

Robot operating systems (ros) overview & (1)
Robot operating systems (ros) overview & (1)Robot operating systems (ros) overview & (1)
Robot operating systems (ros) overview & (1)Piyush Chand
 
Robot Operating Systems (Ros) Overview & (1)
Robot Operating Systems (Ros) Overview & (1)Robot Operating Systems (Ros) Overview & (1)
Robot Operating Systems (Ros) Overview & (1)Piyush Chand
 
IP based standards for IoT
IP based standards for IoTIP based standards for IoT
IP based standards for IoTMichael Koster
 
FIWARE Wednesday Webinars - How to Develop FIWARE NGSI Interfaces for Robots
FIWARE Wednesday Webinars - How to Develop FIWARE NGSI Interfaces for RobotsFIWARE Wednesday Webinars - How to Develop FIWARE NGSI Interfaces for Robots
FIWARE Wednesday Webinars - How to Develop FIWARE NGSI Interfaces for RobotsFIWARE
 
An ontology-based approach to improve the accessibility of ROS-based robotic ...
An ontology-based approach to improve the accessibility of ROS-based robotic ...An ontology-based approach to improve the accessibility of ROS-based robotic ...
An ontology-based approach to improve the accessibility of ROS-based robotic ...Vrije Universiteit Amsterdam
 
Bharat_Jangir_Final_Poster
Bharat_Jangir_Final_PosterBharat_Jangir_Final_Poster
Bharat_Jangir_Final_PosterBharat Jangir
 
.NET Core Today and Tomorrow
.NET Core Today and Tomorrow.NET Core Today and Tomorrow
.NET Core Today and TomorrowJon Galloway
 
What you need to know about .NET Core 3.0 and beyond
What you need to know about .NET Core 3.0 and beyondWhat you need to know about .NET Core 3.0 and beyond
What you need to know about .NET Core 3.0 and beyondJon Galloway
 
semantic web service composition for action planning
semantic web service composition for action planningsemantic web service composition for action planning
semantic web service composition for action planningShahab Mokarizadeh
 
Fast RTPS: Programming with the Default Middleware for Robotics Adopted in ROS2
Fast RTPS: Programming with the Default Middleware for Robotics Adopted in ROS2Fast RTPS: Programming with the Default Middleware for Robotics Adopted in ROS2
Fast RTPS: Programming with the Default Middleware for Robotics Adopted in ROS2Jaime Martin Losa
 
API Test Automation
API Test Automation API Test Automation
API Test Automation SQALab
 
05 rpc-case studies
05 rpc-case studies05 rpc-case studies
05 rpc-case studieshushu
 
Rpc Case Studies (Distributed computing)
Rpc Case Studies (Distributed computing)Rpc Case Studies (Distributed computing)
Rpc Case Studies (Distributed computing)Sri Prasanna
 
Programming IoT Gateways with macchina.io
Programming IoT Gateways with macchina.ioProgramming IoT Gateways with macchina.io
Programming IoT Gateways with macchina.ioGünter Obiltschnig
 
ROS Based Programming and Visualization of Quadrotor Helicopters
ROS Based Programming and Visualization of Quadrotor HelicoptersROS Based Programming and Visualization of Quadrotor Helicopters
ROS Based Programming and Visualization of Quadrotor HelicoptersAtılay Mayadağ
 
Course Notes-Unit 5.ppt
Course Notes-Unit 5.pptCourse Notes-Unit 5.ppt
Course Notes-Unit 5.pptSafaM3
 

Similar to SAM-IoT: A Cross-Platform Communication Mechanism for ROS-Based Cyber-Physical System (20)

Robot operating systems (ros) overview & (1)
Robot operating systems (ros) overview & (1)Robot operating systems (ros) overview & (1)
Robot operating systems (ros) overview & (1)
 
Robot Operating Systems (Ros) Overview & (1)
Robot Operating Systems (Ros) Overview & (1)Robot Operating Systems (Ros) Overview & (1)
Robot Operating Systems (Ros) Overview & (1)
 
IP based standards for IoT
IP based standards for IoTIP based standards for IoT
IP based standards for IoT
 
FIWARE Wednesday Webinars - How to Develop FIWARE NGSI Interfaces for Robots
FIWARE Wednesday Webinars - How to Develop FIWARE NGSI Interfaces for RobotsFIWARE Wednesday Webinars - How to Develop FIWARE NGSI Interfaces for Robots
FIWARE Wednesday Webinars - How to Develop FIWARE NGSI Interfaces for Robots
 
An ontology-based approach to improve the accessibility of ROS-based robotic ...
An ontology-based approach to improve the accessibility of ROS-based robotic ...An ontology-based approach to improve the accessibility of ROS-based robotic ...
An ontology-based approach to improve the accessibility of ROS-based robotic ...
 
Bharat_Jangir_Final_Poster
Bharat_Jangir_Final_PosterBharat_Jangir_Final_Poster
Bharat_Jangir_Final_Poster
 
6. The grid-COMPUTING OGSA and WSRF
6. The grid-COMPUTING OGSA and WSRF6. The grid-COMPUTING OGSA and WSRF
6. The grid-COMPUTING OGSA and WSRF
 
Cloud robotics
Cloud roboticsCloud robotics
Cloud robotics
 
MIDELWARE TECH
MIDELWARE TECHMIDELWARE TECH
MIDELWARE TECH
 
.NET Core Today and Tomorrow
.NET Core Today and Tomorrow.NET Core Today and Tomorrow
.NET Core Today and Tomorrow
 
What you need to know about .NET Core 3.0 and beyond
What you need to know about .NET Core 3.0 and beyondWhat you need to know about .NET Core 3.0 and beyond
What you need to know about .NET Core 3.0 and beyond
 
semantic web service composition for action planning
semantic web service composition for action planningsemantic web service composition for action planning
semantic web service composition for action planning
 
Fast RTPS: Programming with the Default Middleware for Robotics Adopted in ROS2
Fast RTPS: Programming with the Default Middleware for Robotics Adopted in ROS2Fast RTPS: Programming with the Default Middleware for Robotics Adopted in ROS2
Fast RTPS: Programming with the Default Middleware for Robotics Adopted in ROS2
 
ROS (Robot Operating System) Comparison
ROS (Robot Operating System) ComparisonROS (Robot Operating System) Comparison
ROS (Robot Operating System) Comparison
 
API Test Automation
API Test Automation API Test Automation
API Test Automation
 
05 rpc-case studies
05 rpc-case studies05 rpc-case studies
05 rpc-case studies
 
Rpc Case Studies (Distributed computing)
Rpc Case Studies (Distributed computing)Rpc Case Studies (Distributed computing)
Rpc Case Studies (Distributed computing)
 
Programming IoT Gateways with macchina.io
Programming IoT Gateways with macchina.ioProgramming IoT Gateways with macchina.io
Programming IoT Gateways with macchina.io
 
ROS Based Programming and Visualization of Quadrotor Helicopters
ROS Based Programming and Visualization of Quadrotor HelicoptersROS Based Programming and Visualization of Quadrotor Helicopters
ROS Based Programming and Visualization of Quadrotor Helicopters
 
Course Notes-Unit 5.ppt
Course Notes-Unit 5.pptCourse Notes-Unit 5.ppt
Course Notes-Unit 5.ppt
 

More from Brain IoT Project

Virtual Twins: Modeling Trends and Challenges Ahead
Virtual Twins: Modeling Trends and Challenges AheadVirtual Twins: Modeling Trends and Challenges Ahead
Virtual Twins: Modeling Trends and Challenges AheadBrain IoT Project
 
Statistical model checking bip tool
Statistical model checking bip toolStatistical model checking bip tool
Statistical model checking bip toolBrain IoT Project
 
Rigorous system design the bip framework
Rigorous system design the bip frameworkRigorous system design the bip framework
Rigorous system design the bip frameworkBrain IoT Project
 
IMB Brokerage day - EMALCSA: SICA platform and BRAIN-IoT
IMB Brokerage day -  EMALCSA: SICA platform and BRAIN-IoTIMB Brokerage day -  EMALCSA: SICA platform and BRAIN-IoT
IMB Brokerage day - EMALCSA: SICA platform and BRAIN-IoTBrain IoT Project
 
ROBOT PATH FINDER Case Study
ROBOT PATH FINDER Case StudyROBOT PATH FINDER Case Study
ROBOT PATH FINDER Case StudyBrain IoT Project
 
Overview of the WP4 of BRAIN-IoT
Overview of the WP4 of BRAIN-IoTOverview of the WP4 of BRAIN-IoT
Overview of the WP4 of BRAIN-IoTBrain IoT Project
 
Using Eclipse technologies to develop the BRAIN-IoT model-based framework for...
Using Eclipse technologies to develop the BRAIN-IoT model-based framework for...Using Eclipse technologies to develop the BRAIN-IoT model-based framework for...
Using Eclipse technologies to develop the BRAIN-IoT model-based framework for...Brain IoT Project
 
Brain-IoT Project: Security Cluster activities overview
Brain-IoT Project: Security Cluster activities overviewBrain-IoT Project: Security Cluster activities overview
Brain-IoT Project: Security Cluster activities overviewBrain IoT Project
 

More from Brain IoT Project (8)

Virtual Twins: Modeling Trends and Challenges Ahead
Virtual Twins: Modeling Trends and Challenges AheadVirtual Twins: Modeling Trends and Challenges Ahead
Virtual Twins: Modeling Trends and Challenges Ahead
 
Statistical model checking bip tool
Statistical model checking bip toolStatistical model checking bip tool
Statistical model checking bip tool
 
Rigorous system design the bip framework
Rigorous system design the bip frameworkRigorous system design the bip framework
Rigorous system design the bip framework
 
IMB Brokerage day - EMALCSA: SICA platform and BRAIN-IoT
IMB Brokerage day -  EMALCSA: SICA platform and BRAIN-IoTIMB Brokerage day -  EMALCSA: SICA platform and BRAIN-IoT
IMB Brokerage day - EMALCSA: SICA platform and BRAIN-IoT
 
ROBOT PATH FINDER Case Study
ROBOT PATH FINDER Case StudyROBOT PATH FINDER Case Study
ROBOT PATH FINDER Case Study
 
Overview of the WP4 of BRAIN-IoT
Overview of the WP4 of BRAIN-IoTOverview of the WP4 of BRAIN-IoT
Overview of the WP4 of BRAIN-IoT
 
Using Eclipse technologies to develop the BRAIN-IoT model-based framework for...
Using Eclipse technologies to develop the BRAIN-IoT model-based framework for...Using Eclipse technologies to develop the BRAIN-IoT model-based framework for...
Using Eclipse technologies to develop the BRAIN-IoT model-based framework for...
 
Brain-IoT Project: Security Cluster activities overview
Brain-IoT Project: Security Cluster activities overviewBrain-IoT Project: Security Cluster activities overview
Brain-IoT Project: Security Cluster activities overview
 

Recently uploaded

Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfhans926745
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesBoston Institute of Analytics
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilV3cube
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 

Recently uploaded (20)

Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 

SAM-IoT: A Cross-Platform Communication Mechanism for ROS-Based Cyber-Physical System

  • 2. Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system 2 • Complex intelligent IoT ecosystems is required to react to system requirements and environment changes • ROS-based CPS is used in various IoT Domains, interoperability will bring potential benefits • Lack of interoperability between heterogeneous platforms • Emerging IoT standards prevent to integrate new IoT platforms • Off-the-shell IoT devices/platforms don't support secondary development WHY ROS EDGE NODE IS NEEDED?
  • 3. Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system 3 FEATURES OF ROS EDGE NODE fffInteroperability fffPlug & Play fffAutomatic Adaptation fffStandard Compliant It enables the communications between ROS-based CPS and other heterogeneous IoT systems in an intelligent and autonomous infrastructure A code generator automatically abstracts the ad-hoc ROS functionalities provided by different ROS-based CPSs and speeds up the adaptor development process An event-driven approach automates the software modules deployment at BRAIN-IoT runtime in a distributed execution environment according to specific system requirements and user events It exploits the Web of Things (WoT) Thing Description (TD) describing the services provided by ROS-based CPSs, making it more portable to the production environment, not restrict to the OSGi implementation An adaptor integrating ROS-based CPSs with BRAIN-IoT platform
  • 4. Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system 4 • L1 (Physical): a set of physical computing resources (e.g. Linux Server, ROS-based robots). • L2 (Fabric): a set of OSGi/Java agents and infrastructure services providing discovery, system provisioning and communication services. • L3 (System): a set of inter-related software components containing infrastructure service (e.g. BMS, BIS) for searching, deploying other services. • L4 (BRAIN-IoT Services): system software modules with capabilities. OVERVIEW OF BRAIN-IOT CONTEXT Hardware Layer (e.g. CPSs) Fabric Runtime (Java / OSGi) BMS BIS BIS BIS 1 2 3 BRAIN-IoT Service Edge Node4 BRAIN-IoT Structural layers BMS: Behaviour Management Service BIS: Bundle Installer Service BRAIN-IoT Services Dynamically Loaded BRAIN-IoT Repository UI EventBus
  • 5. ARCHITECTURE OF ROS EDGE NODE 5 Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system 1 2 1. Abstraction of ROS Functionalities • List of clients of ROS services/publishers/subscribers • Mapping between native messages in ROS and Java types 2. Integration with BRAIN-IoT EventBus • Formatting of events and ROS message in java type • Interact with ROS through ROS service clients
  • 6. 6 Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system ROS EDGE NODE IMPLEMENTATION Code Generator { "@type": "Thing", "properties":{...}, "actions":{ "serviceClientName":{ ... "serviceName":{...}, "serviceType":{...}, "serviceRequestType":{...}, "serviceResponseType":{...}, "ClassName":{...} }, ... } } Physical Robot Remote Procedure Call System Status Monitoring IP ROS Edge Node ROS Service Clients Events handler AI Algorithms Bridging JCodeModel Lib
  • 7. DEMONSTRATION AND VALIDATION 7 Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system Objective: A swarm of RB-1 BASE mobile robots cooperate to move all carts from picking area to storage area passing through an automated door with a QR code. • A multi-agent system is created where each robot is controlled by a Robot Behavior service through ROS Edge Node. • A list of tasks is shared by the Robot Behavior services. • Robots are aware of the door by scanning the QR code. • Door is controlled by a Door Edge Node through HTTP protocol. A MULTI-AGENT ROBOTICS SYSTEM
  • 8. 8 Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system DEVELOPMENT OF ROS EDGE NODE FOR RB1 BASE ROBOT { "title":"Robotnik RB1 Base Mobile Robot", "@type":"Thing", "properties":{ "availability":{ "robot:capability":"robot:AvailabilityMonitoring", "properties":{ "Role": {"const":"Subscriber"}, "TopicType": {"const":"robot_local_control_msgs/Status"}, "MessageType": {"const":"robot_local_control_msgs.Status"}, "RosClass": {"const":"robot_local_control_msgs.Status"} }, "forms":[{ "href":"/#robotName/robot_local_control/state",} ] } } }, "actions":{ "GoTo":{ "input":{ "properties":{ "serviceType": {"const":"robot_local_control_msgs/GoToPetition"}, "serviceRequestType": {"const":"robot_local_control_msgs.GoToPetitionRequest"}, "RosClass": {"const":"GoToComponent"} } }, "output":{ "properties":{ "serviceResponseType":{"const":"robot_local_control_msgs.GoToPetitionResponse"} }}, "forms":[ { "href":"/#robotName/robot_local_control/NavigationComponent/GoToComponent/add ", } ] } } } Code Generator ROS Edge Node for RB1 Base Robot
  • 9. 9 Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system BRAIN-IOT USER INTERFACE
  • 10. 10 Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system INTERACTION BETWEEN ROBOT AND DOOR • Interested event types are registered to be received from the asynchronous EventBus interface at runtime • ROS Edge Node continuously queries the status changes in ROS and issue response events to notify the application services. (e.g. battery level) • Events are filtered in distributed EventBus
  • 11. 11 ROS Edge Node is developed as an adaptor to ROS-based Robotics systems in BRAIN-IoT platform allowing: • Interoperability with other heterogeneous IoT systems through distributed EventBus. • Fast adaptation to various ROS-based IoT devices/platforms using a Code Generator • Standard Compliant by exploiting WoT TD, making it portable to production environment • Plug & Play without stopping other services at BRAIN-IoT execution environment leveraging OSGi specification in sophisticated IoT scenarios Location, DD/MM/YYYYA cross platform communication mechanism for ROS-based cyber physical system CONCLUSIONS
  • 12. CONTACTS This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 780089. Researcher rui.zhao@linksfoundation.com LINKS Foundation – Leading Innovation & Knowledge for Society CONTACTS RUI ZHAO