SlideShare a Scribd company logo
1 of 15
Personalized Modeling for
Human-Robot Interaction
Ruzena Bajcsy
Electrical Engineering & Computer Sciences
University of California, Berkeley
October 23, 2015
Our Lab’s Motivation
We wish to understand the mechanics of human-robot interactions
and to design algorithms for control-sharing between humans and
autonomous systems.
Why is this problem important?
– A person is a complex kinematic/dynamic system with many
degrees of freedom and parameters which vary from person
to person
– Not all degrees of freedom are used in all activities
Human Model Classes
Musculoskeletal
Kinematic/
Dynamic
Kinematic
Agent
Interaction
Human Model Classes: Kinematic
Musculoskeletal
Kinematic/
Dynamic
Kinematic
Agent
Interaction
Goal
Model human motion using a rigid-body
kinematic model
Application
Automated Coaching/
Quantitative Outcome Measures
Contributors: Qifei Wang, Gregorij Kurillo, and Ferda Ofli
Human Model Classes: Kinematic/Dynamic
Musculoskeletal
Kinematic/
Dynamic
Kinematic
Agent
Interaction
Goal
Model human motion using a rigid-body
kinematic/dynamic model
Applications
Human-Robot
Collaborative
Manipulation
Human Dynamic
Stability Analysis
Contributors: Aaron Bestick and Victor Shia
Application: Collaborative Manipulation
Goal: Enable intelligent
control of robots
providing direct physical
assistance to humans
• Create unified model
of the human-robot
coupled mechanical
system
• Predict intent of
human operator
based on physical cues
Application: Collaborative Manipulation
Personalized Human
Mechanical Models
Coupled Human-
Robot Dynamical
Models
Optimal Robot
Control
Human
Constraints
Robot
Constraints
Task
Constraints
Human
Ergonomic
Cost
𝜏∗
= arg min
𝜏∈𝑈
𝑓 𝜃, 𝜏
𝑠. 𝑡. 𝑔 𝜃, 𝜏 ≤ 0,
ℎ 𝜃 = 0
Key Neglected Aspect: Differences in constraints and cost functions
between individual humans (e.g. age, disabilities, natural variation)
Implicit Assumption: Differences between humans not a significant
contributor to task variability
 Need personalized models
Human Model Classes: Musculoskeletal
Musculoskeletal
Kinematic/
Dynamic
Kinematic
Discrete
States
Goal
Combine a kinematic/dynamic model with a
nonlinear model of muscle characteristics to
predict biomechanical properties throughout
the human’s workspace
Application
Medical Diagnostics
Dynamic Human Musculoskeletal Modeling
• Data Acquisition
– MRI Scans
– DICOM Images with
Segmentation
– Motion Capture
– EMG Data
• Modeling
– 2D/3D Visualization
– Interactive Cleaning
– Static, Kinematic, Dynamic
Scenarios
– Physics based Dynamic
Deformation
MRI Data segmentation
Ultrasound for Muscle Observation
• External motion capture for
pose of ultrasound
• Muscle and tendon outlines
visible
Muscle
Ultrasound for Muscle Observation
• External motion capture for
pose of ultrasound
• Muscle and tendon outlines
visible
Muscle
Ultrasound for Muscle Observation
• External motion capture for
pose of ultrasound
• Muscle and tendon outlines
visible
Tendon
Ultrasound for Muscle Observation
• External motion capture for
pose of ultrasound
• Muscle and tendon outlines
visible
Tendon
Ultrasound for Muscle Observation
Conclusions
Musculoskeletal
Kinematic/
Dynamic
Kinematic
Agent
Interaction
• Robotic technology has great
utility for modeling and
predicting human physical
capabilities and limitations
• By modeling the human, we
can improve shared control
schemes for human-robot
interaction

More Related Content

What's hot

Robotic devices for upper extremity rehabilitation
Robotic devices for upper extremity rehabilitationRobotic devices for upper extremity rehabilitation
Robotic devices for upper extremity rehabilitationPhinoj K Abraham
 
Automated Wheelchair Convertible Stretcher – A Review
Automated Wheelchair Convertible Stretcher – A ReviewAutomated Wheelchair Convertible Stretcher – A Review
Automated Wheelchair Convertible Stretcher – A ReviewIRJET Journal
 
Introduction to sports biomechanics
Introduction to sports biomechanicsIntroduction to sports biomechanics
Introduction to sports biomechanicsRAJKIRAN A.K
 
Can anterior cruciate ligament injuries be mitigated?
Can anterior cruciate ligament injuries be mitigated?Can anterior cruciate ligament injuries be mitigated?
Can anterior cruciate ligament injuries be mitigated?Ella Ward
 
Brain Bonanza - 2.1. Breathing structures
Brain Bonanza - 2.1. Breathing structuresBrain Bonanza - 2.1. Breathing structures
Brain Bonanza - 2.1. Breathing structuresEric Serejski
 
Muscle force distribution for adaptive control of a humanoid robot arm with r...
Muscle force distribution for adaptive control of a humanoid robot arm with r...Muscle force distribution for adaptive control of a humanoid robot arm with r...
Muscle force distribution for adaptive control of a humanoid robot arm with r...toukaigi
 
Introduction to Biomechanics
Introduction to BiomechanicsIntroduction to Biomechanics
Introduction to BiomechanicsShatheesh Sohan
 
Automatic Stretcher Cum Wheelchair
Automatic Stretcher Cum WheelchairAutomatic Stretcher Cum Wheelchair
Automatic Stretcher Cum WheelchairIRJET Journal
 
Kinematic Modelling of FES Induced Sit-to-stand Movement in Paraplegia
Kinematic Modelling of FES Induced Sit-to-stand Movement in Paraplegia Kinematic Modelling of FES Induced Sit-to-stand Movement in Paraplegia
Kinematic Modelling of FES Induced Sit-to-stand Movement in Paraplegia IJECEIAES
 

What's hot (12)

Poster (Version 3)
Poster (Version 3)Poster (Version 3)
Poster (Version 3)
 
Robotic devices for upper extremity rehabilitation
Robotic devices for upper extremity rehabilitationRobotic devices for upper extremity rehabilitation
Robotic devices for upper extremity rehabilitation
 
Automated Wheelchair Convertible Stretcher – A Review
Automated Wheelchair Convertible Stretcher – A ReviewAutomated Wheelchair Convertible Stretcher – A Review
Automated Wheelchair Convertible Stretcher – A Review
 
EMBC Poster
EMBC PosterEMBC Poster
EMBC Poster
 
Introduction to sports biomechanics
Introduction to sports biomechanicsIntroduction to sports biomechanics
Introduction to sports biomechanics
 
Can anterior cruciate ligament injuries be mitigated?
Can anterior cruciate ligament injuries be mitigated?Can anterior cruciate ligament injuries be mitigated?
Can anterior cruciate ligament injuries be mitigated?
 
Biomechanics
BiomechanicsBiomechanics
Biomechanics
 
Brain Bonanza - 2.1. Breathing structures
Brain Bonanza - 2.1. Breathing structuresBrain Bonanza - 2.1. Breathing structures
Brain Bonanza - 2.1. Breathing structures
 
Muscle force distribution for adaptive control of a humanoid robot arm with r...
Muscle force distribution for adaptive control of a humanoid robot arm with r...Muscle force distribution for adaptive control of a humanoid robot arm with r...
Muscle force distribution for adaptive control of a humanoid robot arm with r...
 
Introduction to Biomechanics
Introduction to BiomechanicsIntroduction to Biomechanics
Introduction to Biomechanics
 
Automatic Stretcher Cum Wheelchair
Automatic Stretcher Cum WheelchairAutomatic Stretcher Cum Wheelchair
Automatic Stretcher Cum Wheelchair
 
Kinematic Modelling of FES Induced Sit-to-stand Movement in Paraplegia
Kinematic Modelling of FES Induced Sit-to-stand Movement in Paraplegia Kinematic Modelling of FES Induced Sit-to-stand Movement in Paraplegia
Kinematic Modelling of FES Induced Sit-to-stand Movement in Paraplegia
 

Viewers also liked

Составление энергетического паспорта здания. Определение класса энергетическ...
Составление энергетического паспорта здания. Определение класса энергетическ...Составление энергетического паспорта здания. Определение класса энергетическ...
Составление энергетического паспорта здания. Определение класса энергетическ...Effbuild
 
Donnie isaacs - motivating and inspiring teachers
Donnie isaacs - motivating and inspiring teachersDonnie isaacs - motivating and inspiring teachers
Donnie isaacs - motivating and inspiring teachersDonnie Isaacs
 
Trabajo de sistemas 2
Trabajo de sistemas 2Trabajo de sistemas 2
Trabajo de sistemas 2dubrin godoy
 
Convencion colectivayipsybrito
Convencion colectivayipsybritoConvencion colectivayipsybrito
Convencion colectivayipsybritoYipsy Brito
 
Kamil final
Kamil finalKamil final
Kamil finalKamil Mr
 
Herramientas web 2
Herramientas web 2Herramientas web 2
Herramientas web 2laura ortiz
 
Social Media Marketing & Copywriting | Content Development for Moche's Facebo...
Social Media Marketing & Copywriting | Content Development for Moche's Facebo...Social Media Marketing & Copywriting | Content Development for Moche's Facebo...
Social Media Marketing & Copywriting | Content Development for Moche's Facebo...Cíntia Pereira
 
CV_Ranka_Papic__srp
CV_Ranka_Papic__srpCV_Ranka_Papic__srp
CV_Ranka_Papic__srpRanka Papić
 
التقرير السنوي لمكتب جاليات الربوة 1437
التقرير السنوي لمكتب جاليات الربوة 1437التقرير السنوي لمكتب جاليات الربوة 1437
التقرير السنوي لمكتب جاليات الربوة 1437Islam House
 
GROUP DISCUSSION
GROUP DISCUSSIONGROUP DISCUSSION
GROUP DISCUSSIONRAHUL B.M
 
Infoblatt der Polizei zur Einbruchsprävention
Infoblatt der Polizei zur EinbruchspräventionInfoblatt der Polizei zur Einbruchsprävention
Infoblatt der Polizei zur EinbruchspräventionSteve Remesch
 
Carlos_Zamora_2016_Resume
Carlos_Zamora_2016_ResumeCarlos_Zamora_2016_Resume
Carlos_Zamora_2016_ResumeCarlos Zamora
 
Clearwater DFC
Clearwater DFCClearwater DFC
Clearwater DFCBeth Hood
 

Viewers also liked (20)

Ibm
IbmIbm
Ibm
 
Составление энергетического паспорта здания. Определение класса энергетическ...
Составление энергетического паспорта здания. Определение класса энергетическ...Составление энергетического паспорта здания. Определение класса энергетическ...
Составление энергетического паспорта здания. Определение класса энергетическ...
 
Donnie isaacs - motivating and inspiring teachers
Donnie isaacs - motivating and inspiring teachersDonnie isaacs - motivating and inspiring teachers
Donnie isaacs - motivating and inspiring teachers
 
Trabajo de sistemas 2
Trabajo de sistemas 2Trabajo de sistemas 2
Trabajo de sistemas 2
 
Sterlite PIMS
Sterlite PIMSSterlite PIMS
Sterlite PIMS
 
Convencion colectivayipsybrito
Convencion colectivayipsybritoConvencion colectivayipsybrito
Convencion colectivayipsybrito
 
Indo thai IPO Analysis
Indo thai IPO AnalysisIndo thai IPO Analysis
Indo thai IPO Analysis
 
Kamil final
Kamil finalKamil final
Kamil final
 
Herramientas web 2
Herramientas web 2Herramientas web 2
Herramientas web 2
 
Social Media Marketing & Copywriting | Content Development for Moche's Facebo...
Social Media Marketing & Copywriting | Content Development for Moche's Facebo...Social Media Marketing & Copywriting | Content Development for Moche's Facebo...
Social Media Marketing & Copywriting | Content Development for Moche's Facebo...
 
2013 SS wardrobe LRES
2013 SS wardrobe LRES2013 SS wardrobe LRES
2013 SS wardrobe LRES
 
Metcalf Resume
Metcalf ResumeMetcalf Resume
Metcalf Resume
 
CV_Ranka_Papic__srp
CV_Ranka_Papic__srpCV_Ranka_Papic__srp
CV_Ranka_Papic__srp
 
التقرير السنوي لمكتب جاليات الربوة 1437
التقرير السنوي لمكتب جاليات الربوة 1437التقرير السنوي لمكتب جاليات الربوة 1437
التقرير السنوي لمكتب جاليات الربوة 1437
 
GROUP DISCUSSION
GROUP DISCUSSIONGROUP DISCUSSION
GROUP DISCUSSION
 
Infoblatt der Polizei zur Einbruchsprävention
Infoblatt der Polizei zur EinbruchspräventionInfoblatt der Polizei zur Einbruchsprävention
Infoblatt der Polizei zur Einbruchsprävention
 
Carlos_Zamora_2016_Resume
Carlos_Zamora_2016_ResumeCarlos_Zamora_2016_Resume
Carlos_Zamora_2016_Resume
 
Clearwater DFC
Clearwater DFCClearwater DFC
Clearwater DFC
 
Meet the Team
Meet the TeamMeet the Team
Meet the Team
 
Tipos de nutrición
Tipos de nutriciónTipos de nutrición
Tipos de nutrición
 

Similar to Ruzena Bajcsy - Personalized Modeling for HRI

Paper id 25201433
Paper id 25201433Paper id 25201433
Paper id 25201433IJRAT
 
Applied Biomechanics – a multifaceted approach to answering human movement qu...
Applied Biomechanics – a multifaceted approach to answering human movement qu...Applied Biomechanics – a multifaceted approach to answering human movement qu...
Applied Biomechanics – a multifaceted approach to answering human movement qu...InsideScientific
 
A SURVEY ON HUMAN POSE ESTIMATION AND CLASSIFICATION
A SURVEY ON HUMAN POSE ESTIMATION AND CLASSIFICATIONA SURVEY ON HUMAN POSE ESTIMATION AND CLASSIFICATION
A SURVEY ON HUMAN POSE ESTIMATION AND CLASSIFICATIONIRJET Journal
 
BIOMETRIC AUTHORIZATION SYSTEM USING GAIT BIOMETRY
BIOMETRIC AUTHORIZATION SYSTEM USING GAIT BIOMETRYBIOMETRIC AUTHORIZATION SYSTEM USING GAIT BIOMETRY
BIOMETRIC AUTHORIZATION SYSTEM USING GAIT BIOMETRYIJCSEA Journal
 
Basic ergonomics in automotive design
Basic ergonomics in automotive designBasic ergonomics in automotive design
Basic ergonomics in automotive designVelmurugan Sivaraman
 
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”IRJET Journal
 
Study of AI Fitness Model Using Deep Learning
Study of AI Fitness Model Using Deep LearningStudy of AI Fitness Model Using Deep Learning
Study of AI Fitness Model Using Deep LearningIRJET Journal
 
2016 05 26 Robo8 inspiration day_mirad_project
2016 05 26 Robo8 inspiration day_mirad_project2016 05 26 Robo8 inspiration day_mirad_project
2016 05 26 Robo8 inspiration day_mirad_projectSirris
 
Paper review - Biomechanical modeling as a practical tool for predicting inju...
Paper review - Biomechanical modeling as a practical tool for predicting inju...Paper review - Biomechanical modeling as a practical tool for predicting inju...
Paper review - Biomechanical modeling as a practical tool for predicting inju...Hiranthi Tennakoon
 
Identification of humans using gait (synopsis)
Identification of humans using gait (synopsis)Identification of humans using gait (synopsis)
Identification of humans using gait (synopsis)Mumbai Academisc
 
Title defense- Prosthetic arm.....pptx
Title defense- Prosthetic arm.....pptxTitle defense- Prosthetic arm.....pptx
Title defense- Prosthetic arm.....pptxhaiderkhan897299
 
Development of a Virtual Reality Simulator for Robotic Brain Tumor Resection
Development of a Virtual Reality Simulator for Robotic Brain Tumor ResectionDevelopment of a Virtual Reality Simulator for Robotic Brain Tumor Resection
Development of a Virtual Reality Simulator for Robotic Brain Tumor Resectionsaulnml
 
IRJET - Biometric Traits and Applications of Fingerprint
IRJET - Biometric Traits and Applications of FingerprintIRJET - Biometric Traits and Applications of Fingerprint
IRJET - Biometric Traits and Applications of FingerprintIRJET Journal
 
#9_2-Anthropometry in Occupational Biomechanics.pdf
#9_2-Anthropometry in Occupational Biomechanics.pdf#9_2-Anthropometry in Occupational Biomechanics.pdf
#9_2-Anthropometry in Occupational Biomechanics.pdfadithya
 
ICVR2013 Workshop: Designing an effective rehabilitation simulation
ICVR2013 Workshop: Designing an effective rehabilitation simulationICVR2013 Workshop: Designing an effective rehabilitation simulation
ICVR2013 Workshop: Designing an effective rehabilitation simulationSergi Bermudez i Badia
 
Measuring and quantifying quality of movement
Measuring and quantifying quality of movementMeasuring and quantifying quality of movement
Measuring and quantifying quality of movementJustyna Ausareny
 

Similar to Ruzena Bajcsy - Personalized Modeling for HRI (20)

Paper id 25201433
Paper id 25201433Paper id 25201433
Paper id 25201433
 
Applied Biomechanics – a multifaceted approach to answering human movement qu...
Applied Biomechanics – a multifaceted approach to answering human movement qu...Applied Biomechanics – a multifaceted approach to answering human movement qu...
Applied Biomechanics – a multifaceted approach to answering human movement qu...
 
A SURVEY ON HUMAN POSE ESTIMATION AND CLASSIFICATION
A SURVEY ON HUMAN POSE ESTIMATION AND CLASSIFICATIONA SURVEY ON HUMAN POSE ESTIMATION AND CLASSIFICATION
A SURVEY ON HUMAN POSE ESTIMATION AND CLASSIFICATION
 
BIOMETRIC AUTHORIZATION SYSTEM USING GAIT BIOMETRY
BIOMETRIC AUTHORIZATION SYSTEM USING GAIT BIOMETRYBIOMETRIC AUTHORIZATION SYSTEM USING GAIT BIOMETRY
BIOMETRIC AUTHORIZATION SYSTEM USING GAIT BIOMETRY
 
Raes telangana innovation
Raes telangana innovationRaes telangana innovation
Raes telangana innovation
 
Basic ergonomics in automotive design
Basic ergonomics in automotive designBasic ergonomics in automotive design
Basic ergonomics in automotive design
 
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
 
Study of AI Fitness Model Using Deep Learning
Study of AI Fitness Model Using Deep LearningStudy of AI Fitness Model Using Deep Learning
Study of AI Fitness Model Using Deep Learning
 
2016 05 26 Robo8 inspiration day_mirad_project
2016 05 26 Robo8 inspiration day_mirad_project2016 05 26 Robo8 inspiration day_mirad_project
2016 05 26 Robo8 inspiration day_mirad_project
 
Biomekanik Slide Umum Penegnalan
Biomekanik Slide Umum PenegnalanBiomekanik Slide Umum Penegnalan
Biomekanik Slide Umum Penegnalan
 
Paper review - Biomechanical modeling as a practical tool for predicting inju...
Paper review - Biomechanical modeling as a practical tool for predicting inju...Paper review - Biomechanical modeling as a practical tool for predicting inju...
Paper review - Biomechanical modeling as a practical tool for predicting inju...
 
Identification of humans using gait (synopsis)
Identification of humans using gait (synopsis)Identification of humans using gait (synopsis)
Identification of humans using gait (synopsis)
 
Title defense- Prosthetic arm.....pptx
Title defense- Prosthetic arm.....pptxTitle defense- Prosthetic arm.....pptx
Title defense- Prosthetic arm.....pptx
 
Development of a Virtual Reality Simulator for Robotic Brain Tumor Resection
Development of a Virtual Reality Simulator for Robotic Brain Tumor ResectionDevelopment of a Virtual Reality Simulator for Robotic Brain Tumor Resection
Development of a Virtual Reality Simulator for Robotic Brain Tumor Resection
 
lecture2.ppt
lecture2.pptlecture2.ppt
lecture2.ppt
 
IRJET - Biometric Traits and Applications of Fingerprint
IRJET - Biometric Traits and Applications of FingerprintIRJET - Biometric Traits and Applications of Fingerprint
IRJET - Biometric Traits and Applications of Fingerprint
 
#9_2-Anthropometry in Occupational Biomechanics.pdf
#9_2-Anthropometry in Occupational Biomechanics.pdf#9_2-Anthropometry in Occupational Biomechanics.pdf
#9_2-Anthropometry in Occupational Biomechanics.pdf
 
ICVR2013 Workshop: Designing an effective rehabilitation simulation
ICVR2013 Workshop: Designing an effective rehabilitation simulationICVR2013 Workshop: Designing an effective rehabilitation simulation
ICVR2013 Workshop: Designing an effective rehabilitation simulation
 
Measuring and quantifying quality of movement
Measuring and quantifying quality of movementMeasuring and quantifying quality of movement
Measuring and quantifying quality of movement
 
PHYSIOLOGY Chap6
PHYSIOLOGY Chap6PHYSIOLOGY Chap6
PHYSIOLOGY Chap6
 

More from Daniel Huber

Nathan Harding - Human Exoskeletons and the Human Augmentation Space
Nathan Harding - Human Exoskeletons and the Human Augmentation SpaceNathan Harding - Human Exoskeletons and the Human Augmentation Space
Nathan Harding - Human Exoskeletons and the Human Augmentation SpaceDaniel Huber
 
Wendy Nilsen - Aging in Place
Wendy Nilsen - Aging in PlaceWendy Nilsen - Aging in Place
Wendy Nilsen - Aging in PlaceDaniel Huber
 
Seth Hutchinson - Progress Toward a Robotic Bat
Seth Hutchinson -  Progress Toward a Robotic BatSeth Hutchinson -  Progress Toward a Robotic Bat
Seth Hutchinson - Progress Toward a Robotic BatDaniel Huber
 
Henrik Christensen - Vision for Co-robot Applications
Henrik Christensen - Vision for Co-robot ApplicationsHenrik Christensen - Vision for Co-robot Applications
Henrik Christensen - Vision for Co-robot ApplicationsDaniel Huber
 
Lynne Parker - Engaging Women in Robotics
Lynne Parker - Engaging Women in RoboticsLynne Parker - Engaging Women in Robotics
Lynne Parker - Engaging Women in RoboticsDaniel Huber
 
Jeff Trinkle - An NSF perspective on the NRI
Jeff Trinkle -  An NSF perspective on the NRIJeff Trinkle -  An NSF perspective on the NRI
Jeff Trinkle - An NSF perspective on the NRIDaniel Huber
 
Rod Rimando - Opportunities for advanced robotics in nuclear cleanup
Rod Rimando  - Opportunities for advanced robotics in nuclear cleanupRod Rimando  - Opportunities for advanced robotics in nuclear cleanup
Rod Rimando - Opportunities for advanced robotics in nuclear cleanupDaniel Huber
 
Amy Hurst - The maker revolution
Amy Hurst -  The maker revolutionAmy Hurst -  The maker revolution
Amy Hurst - The maker revolutionDaniel Huber
 
Marjorie Skubic - Squaring the Life Curve
Marjorie Skubic  - Squaring the Life CurveMarjorie Skubic  - Squaring the Life Curve
Marjorie Skubic - Squaring the Life CurveDaniel Huber
 
Henrik Christensen - Vision for co-robot applications
Henrik Christensen  -  Vision for co-robot applicationsHenrik Christensen  -  Vision for co-robot applications
Henrik Christensen - Vision for co-robot applicationsDaniel Huber
 

More from Daniel Huber (10)

Nathan Harding - Human Exoskeletons and the Human Augmentation Space
Nathan Harding - Human Exoskeletons and the Human Augmentation SpaceNathan Harding - Human Exoskeletons and the Human Augmentation Space
Nathan Harding - Human Exoskeletons and the Human Augmentation Space
 
Wendy Nilsen - Aging in Place
Wendy Nilsen - Aging in PlaceWendy Nilsen - Aging in Place
Wendy Nilsen - Aging in Place
 
Seth Hutchinson - Progress Toward a Robotic Bat
Seth Hutchinson -  Progress Toward a Robotic BatSeth Hutchinson -  Progress Toward a Robotic Bat
Seth Hutchinson - Progress Toward a Robotic Bat
 
Henrik Christensen - Vision for Co-robot Applications
Henrik Christensen - Vision for Co-robot ApplicationsHenrik Christensen - Vision for Co-robot Applications
Henrik Christensen - Vision for Co-robot Applications
 
Lynne Parker - Engaging Women in Robotics
Lynne Parker - Engaging Women in RoboticsLynne Parker - Engaging Women in Robotics
Lynne Parker - Engaging Women in Robotics
 
Jeff Trinkle - An NSF perspective on the NRI
Jeff Trinkle -  An NSF perspective on the NRIJeff Trinkle -  An NSF perspective on the NRI
Jeff Trinkle - An NSF perspective on the NRI
 
Rod Rimando - Opportunities for advanced robotics in nuclear cleanup
Rod Rimando  - Opportunities for advanced robotics in nuclear cleanupRod Rimando  - Opportunities for advanced robotics in nuclear cleanup
Rod Rimando - Opportunities for advanced robotics in nuclear cleanup
 
Amy Hurst - The maker revolution
Amy Hurst -  The maker revolutionAmy Hurst -  The maker revolution
Amy Hurst - The maker revolution
 
Marjorie Skubic - Squaring the Life Curve
Marjorie Skubic  - Squaring the Life CurveMarjorie Skubic  - Squaring the Life Curve
Marjorie Skubic - Squaring the Life Curve
 
Henrik Christensen - Vision for co-robot applications
Henrik Christensen  -  Vision for co-robot applicationsHenrik Christensen  -  Vision for co-robot applications
Henrik Christensen - Vision for co-robot applications
 

Recently uploaded

Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfJemuel Francisco
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxHumphrey A Beña
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfPatidar M
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptshraddhaparab530
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operationalssuser3e220a
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Mark Reed
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxlancelewisportillo
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfVanessa Camilleri
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataBabyAnnMotar
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4MiaBumagat1
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management systemChristalin Nelson
 
Activity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationActivity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationRosabel UA
 
Textual Evidence in Reading and Writing of SHS
Textual Evidence in Reading and Writing of SHSTextual Evidence in Reading and Writing of SHS
Textual Evidence in Reading and Writing of SHSMae Pangan
 
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...JojoEDelaCruz
 

Recently uploaded (20)

Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
 
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptxYOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdf
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.ppt
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operational
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdf
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped data
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management system
 
Activity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationActivity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translation
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
Paradigm shift in nursing research by RS MEHTA
Paradigm shift in nursing research by RS MEHTAParadigm shift in nursing research by RS MEHTA
Paradigm shift in nursing research by RS MEHTA
 
Textual Evidence in Reading and Writing of SHS
Textual Evidence in Reading and Writing of SHSTextual Evidence in Reading and Writing of SHS
Textual Evidence in Reading and Writing of SHS
 
INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptxINCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
 
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
 

Ruzena Bajcsy - Personalized Modeling for HRI

  • 1. Personalized Modeling for Human-Robot Interaction Ruzena Bajcsy Electrical Engineering & Computer Sciences University of California, Berkeley October 23, 2015
  • 2. Our Lab’s Motivation We wish to understand the mechanics of human-robot interactions and to design algorithms for control-sharing between humans and autonomous systems. Why is this problem important? – A person is a complex kinematic/dynamic system with many degrees of freedom and parameters which vary from person to person – Not all degrees of freedom are used in all activities
  • 4. Human Model Classes: Kinematic Musculoskeletal Kinematic/ Dynamic Kinematic Agent Interaction Goal Model human motion using a rigid-body kinematic model Application Automated Coaching/ Quantitative Outcome Measures Contributors: Qifei Wang, Gregorij Kurillo, and Ferda Ofli
  • 5. Human Model Classes: Kinematic/Dynamic Musculoskeletal Kinematic/ Dynamic Kinematic Agent Interaction Goal Model human motion using a rigid-body kinematic/dynamic model Applications Human-Robot Collaborative Manipulation Human Dynamic Stability Analysis Contributors: Aaron Bestick and Victor Shia
  • 6. Application: Collaborative Manipulation Goal: Enable intelligent control of robots providing direct physical assistance to humans • Create unified model of the human-robot coupled mechanical system • Predict intent of human operator based on physical cues
  • 7. Application: Collaborative Manipulation Personalized Human Mechanical Models Coupled Human- Robot Dynamical Models Optimal Robot Control Human Constraints Robot Constraints Task Constraints Human Ergonomic Cost 𝜏∗ = arg min 𝜏∈𝑈 𝑓 𝜃, 𝜏 𝑠. 𝑡. 𝑔 𝜃, 𝜏 ≤ 0, ℎ 𝜃 = 0 Key Neglected Aspect: Differences in constraints and cost functions between individual humans (e.g. age, disabilities, natural variation) Implicit Assumption: Differences between humans not a significant contributor to task variability  Need personalized models
  • 8. Human Model Classes: Musculoskeletal Musculoskeletal Kinematic/ Dynamic Kinematic Discrete States Goal Combine a kinematic/dynamic model with a nonlinear model of muscle characteristics to predict biomechanical properties throughout the human’s workspace Application Medical Diagnostics
  • 9. Dynamic Human Musculoskeletal Modeling • Data Acquisition – MRI Scans – DICOM Images with Segmentation – Motion Capture – EMG Data • Modeling – 2D/3D Visualization – Interactive Cleaning – Static, Kinematic, Dynamic Scenarios – Physics based Dynamic Deformation MRI Data segmentation
  • 10. Ultrasound for Muscle Observation • External motion capture for pose of ultrasound • Muscle and tendon outlines visible Muscle
  • 11. Ultrasound for Muscle Observation • External motion capture for pose of ultrasound • Muscle and tendon outlines visible Muscle
  • 12. Ultrasound for Muscle Observation • External motion capture for pose of ultrasound • Muscle and tendon outlines visible Tendon
  • 13. Ultrasound for Muscle Observation • External motion capture for pose of ultrasound • Muscle and tendon outlines visible Tendon
  • 14. Ultrasound for Muscle Observation
  • 15. Conclusions Musculoskeletal Kinematic/ Dynamic Kinematic Agent Interaction • Robotic technology has great utility for modeling and predicting human physical capabilities and limitations • By modeling the human, we can improve shared control schemes for human-robot interaction

Editor's Notes

  1. Pictures: - Musculoskeletal – muscle modeling for design of assistive robotic devices Kinematic/Dynamic – human-robot collaborative manipulation Kinematic – Quantitative measures of physical performance for muscular dystrophy Agent Interaction – Driver modeling and prediction for autonomous cars
  2. -Applications could include manufacturing and industry
  3. Pictures: - Musculoskeletal – muscle modeling for design of assistive robotic devices Kinematic/Dynamic – human-robot collaborative manipulation Kinematic – Quantitative measures of physical performance for muscular dystrophy Agent Interaction – Driver modeling and prediction for autonomous cars