Empathic Extended Reality

•

0 likes•206 views

Joaquim Jorge

Empathic Extended Reality Exploring Physiological Data Sharing in Virtual Environments by Arindam Dey

Engineering

Empathic Extended Reality:
Exploring Physiological Data
Sharing in Virtual Environments
ARINDAM DEY
EMPATHIC EXTENDED REALITY AND PERVASIVE COMPUTING LAB
UNIVERSITY OF QUEENSLAND
A.DEY@UQ.EDU.AU

https://www.youtube.com/watch?v=t3g2IBSaYb4

Empathy
“Seeing with the Eyes of another,
Listening with the Ears of another,
and Feeling with the Heart of another …”
Alfred Adler

Empathic Computing
Understanding
Systems that can understand your feeling and emotions
Experiencing
Systems that can help you better experience the world
Sharing
Systems that help you better share your experiences with others
Sensors
Extended
Reality

“Virtual Reality is the ultimate empathy
machine …”
- Chris Milk

https://www.youtube.com/watch?v=digE62wpHOk
Project Syria – Nonny de la Peña

Empathic XR
Extended Reality Systems that can
Measure | Share | Adapt to | Manipulate
Emotion and Cognition in real time
-Physiological (ECG, EDA, EMG, Pupil)
-Neurological (EEG)
-Behavioural (Speech, Posture, Movement)

Sharing Physiological States in Collaborative VR
ACM CHI’17

Data Collected
- Raw heart-rate
- Positive and negative affect schedule (PANAS)
- Relative head orientation
Results
- Higher positive affect
- More communication between collaborators
- Observer interaction needed
Sharing Physiological States in Collaborative VR
ACM CHI’17

Multi-Sensory Heart Rate Feedback
Results
- Audio-Haptic ranked best
- More interaction needed for higher presence
Data Collected
- PANAS
- Ranking
- Raw heart-rate
OzCHI’18

Manipulating Heart Rate Feedback in VR
ACM CHI Play’18
PANAS

Multi-Sensory Heart Rate Feedback in Collaborative VR
IEEE ISMAR’18

Multi-Sensory Heart Rate Feedback in Collaborative VR
IEEE ISMAR’18
PANAS
Social
Presence

Shared and Manipulated Heartrate Feedback in VR
IEEE ISMAR’19
Active
Passive
Manipulation -20%, 0%, +20%

Shared and Manipulated Heartrate Feedback in VR
Social
Presence
IEEE ISMAR’19

Lessons Learned
Social presences increases with
- Shared awareness cues
- Higher interaction
Shared physiological feedback can
- Increase communication
- Alter emotions but not real signals
- Increase awareness but may not change action

Emotion Sensing HMDs
Looxid Emteq Neurable
HMDs equipped with neurological and physiological sensors

Cognitively Adaptive Training in VR
Looxid
Training difficulty level adjusted based on alpha activity in real time
Low level High level
IEEE VR’19

Cognitively Adaptive Training in VR
Looxid
IEEE VR’19
Alpha activity changed without significant change in task completion time

Quantifying Presence
Looxid
Self-reported Questionnaires vs. real-time Physiological and Neurological Data

Quantifying Presence with Brain Signals
Looxid
High Presence
Low Presence

Next steps: Using EEG and other physiological sensors
Looxid
• Emotionally and cognitively adapt interfaces for learning and training
• Understand how brain synchronization works in collaborative XR
• Effectively share emotional and cognitive states to create empathy in
collaborative XR

Thank You!
Looxid
Arindam Dey
Empathic Extended Reality and Pervasive Computing Lab
Co-Innovation Group | University of Queensland
http://empathicxr.org | a.dey@uq.edu.au

Similar to Empathic Extended Reality

Research Summary - Empathic Extended Reality

Dr. Arindam Dey

Emotion recognition from biometrics is relevant to a wide range of application domains, including healthcare and software development. Existing approaches usually adopt multi-electrodes sensors that could be expensive or uncomfortable to be used in real-life situations. We investigate whether we can reliably recognize high vs. low emotional valence and arousal by relying on noninvasive low-cost EEG, EMG, and GSR sensors. We report the results of an empirical study involving 19 subjects in a laboratory setting for emotion elicitation. We achieve state-of-the-art classification performance for both valence and arousal even in a cross-subject classification setting, which eliminates the need for individual training and tuning of classification models. Furthermore, we will discuss our ongoing work on the recognition of affective and cognitive states of software engineer during their daily programming tasks.

Emotion Detection Using Noninvasive Low-cost Sensors

Nicole Novielli

Linking brain systems and mental functions requires accurate descriptions of behavioral tasks and fine demarcations of brain regions. Functional Magnetic Resonance Imaging (fMRI) has contributed to the investigation of brain regions involved in a variety of cognitive processes. However, to date, no data collection has systematically addressed the functional mapping of cognitive mechanisms at a fine spatial scale. The Individual Brain Charting (IBC) project stands for a high-resolution multi-task fMRI dataset that intends to provide the objective basis toward a comprehensive functional atlas of the human brain. The data refer to a permanent cohort performing many different tasks. The large amount of task-fMRI data on the same subjects yields a precise mapping of the underlying functions, free from both inter-subject and inter-site variability. The first release of the IBC dataset consists of data acquired from thirteen participants during performance of a dozen of tasks. Raw data from this release are publicly available in the OpenNeuro repository and derived statistical maps can be found in NeuroVault. These maps reveal a successful cognitive encoding of many psychological domains in large areas of the human brain. Indeed, main findings of the original studies were replicated at higher resolution. Our results thus provide a comprehensive revision of the neural correlates underlying behavior, highlighting nonetheless the spatial variability of functional signatures between participants. In addition, this dataset supports investigations using alternative approaches to group-level analysis of task-specific studies. For instance, such rich task-wise dataset can be applied to mega-analytic encoding models towards the development of a brain-atlasing framework, by systematically mapping functional signatures associated with the cognitive components of the tasks.

Individual Brain Charting, a high-resolution fMRI dataset for cognitive mappi...

Ana Luísa Pinho

Serious Games and digital interactive technologies for Healthcare

imaginary srl

Pannese healthcare

Lucia Pannese

NeuroVR 1.5 - Open Source VR system for neuroscience and behavioral healthcare

Riva Giuseppe

Software development is an intellectual activity requiring creativity and problem-solving skills, which are known to be influenced by emotions. Developers experience a wide range of affective states during programming tasks, which may have an impact on their job performance and wellbeing. Early recognition of negative emotions, such as stress or frustration can enable just-in-time intervention for developers and team managers, in order to prevent burnout and undesired turnover. In this talk, I will provide an overview of recent research findings of sentiment analysis in software engineering (SE), address the open challenges, and provide empirically-based guidelines for safe (re)use of SE-specific tools in order to obtain meaningful results.

Keynote@QUATIC - Recognizing Developer's Emotions: Advances and Open Challenges

Nicole Novielli

Abstract—The development of Microsoft Kinect opened up the research field of computational emotions to a wide range of applications, such as learning environments, which are excellent candidates to trial computational emotions based algorithms but were never feasible for given consumer technologies. Whilst Kinect is accessible and affordable technology it comes with its’ own additional challenges such as the limited number of extracted Action Units (AUs). This paper presents a new approach that attempts at finding patterns of interaction between AUs and each other on one hand and patterns that link the related AUs to a given emotion. In doing so, this paper presents the ground work necessary to reach a model for dynamically generating personified set of rules relating AUs and emotions implicitly encoding a person individuality in expressing emotions. Index Terms – computational psychoanalysis, emotion modelling, user-centred emotion detection, sentiment analysis, Kinect, personified adaptive interfaces

Cognitive Reasoning and Inferences through Psychologically based Personalised...

Aladdin Ayesh

Hpai class 13 - perception ii - 033020

melendez321

GSR_PhobiAR_04

Daniel Podgornik Abramovici

Experimental psychology, cognitive science or, more recently, cognitive neuroscience, is the main framework to place human information processing under extensive empirical scrutiny. The last decade has seen a surge of interest in the application of psychological measurements for evaluating increasingly complex human-technology interactions. While most welcome from the psychological perspective, we propose that the use of these methodologies should not rely only on the application of sophisticated measurement tools, but also on the application of contemporary knowledge on psychological phenomena and dynamics of human information processing. In addition, we argue that the latest developments in multimodal signals and data mining techniques offer a unique opportunity to extend psychological methodologies to large scale testing grounds. Thus, the application of psychological knowledge to information retrieval research will not only be beneficial for the latter, but for the former as well, inasmuch as information retrieval provides a real field of application for its hypotheses about human information processing.

SIGIR15-NeuroIR

Telefonica Research

The importance of sensor networks and ai in supporting smart grid in the indu...

yohan2012

Empathy amplifier presentation ms4

Luis Santiago

Reality As A Knowledge Medium

fridolin.wild

Is the rising technology a threat?

Fabrizio Gramuglio

Walter Greenleaf's presentation to the Virtual Medicine 2019 Conference at Cedars-Sinai Medical Center Immersive Environments, Machine Learning, Neuroimaging, And Wearable Sensing Technology - Treating Depression, Addictions, and Facilitating Behavior Change Using A Precision Medicine Model Based on the methods used in the ENGAGE Study Walter Greenleaf, PhD Virtual Human Interaction Lab | Stanford University Precision medicine models for treating depression, managing addictions and achieving sustained behavior change are largely outside of current clinical practice. Yet, changing self-regulatory behavior is fundamental to the self-management of complex lifestyle-related chronic conditions such as depression and substance use disorder - two top contributors to the global burden of disease and disability. To optimize treatments and address these burdens, methods to facilitate behavior change and self-regulation must be better understood in relation to their neurobiological underpinnings. Treatment strategies can then be developed that leverage the recent advances in immersive environments, machine learning, and wearable sensing technology and apply them to treat depression, manage addictions, and facilitate behavior change using a precision medicine model that is personalized to the individual. This presentation will review the conceptual framework and protocol for a large multi-subject longitudinal study named Project ENGAGE. The ENGAGE study integrates neuroscience with behavioral science to better understand the self-regulation related mechanisms of behavior change for improving mood and weight outcomes among adults with comorbid depression and obesity. We collect assays of three self-regulation targets (emotion, cognition, and self-reflection) in multiple settings: neuroimaging and behavioral lab-based measures, virtual reality, and passive smartphone sampling. By connecting human neuroscience and behavioral science in this manner within the ENGAGE study, we can develop a prototype for elucidating the underlying self-regulation mechanisms of behavior change outcomes and their application in optimizing intervention strategies for multiple chronic diseases. https://www.ncbi.nlm.nih.gov/pubmed/29074231 Behav Res Ther. 2018 Feb;101:58-70. doi: 10.1016/j.brat.2017.09.012. Epub 2017 Oct 7. The ENGAGE study: Integrating neuroimaging, virtual reality and smartphone sensing to understand self-regulation for managing depression and obesity in a precision medicine model. Leanne M. Williams, Adam Pines, Andrea N. Goldstein-Piekarski, Lisa G. Rosas, Monica Kullar, Matthew D. Sacchet, Olivier Gevaert, Jeremy Bailenson, Philip W. Lavori, Paul Dagum, Brian Wandell, Carlos Correa, Walter Greenleaf, Trisha Suppes, L. Michael Perry, Joshua M. Smyth, Megan A. Lewis, Elizabeth M. Venditti, Mark Snowden, Janine M. Simmons, Jun Ma

Immersive Environments, Machine Learning, Neuroimaging, & Wearable Sensing Te...

Stanford University

Virtual Reality Technology, Machine Learning, Biosensing Converging to Transform Healthcare By Walter Greenleaf The oncoming wave of Virtual Reality and Augmented Reality technology will impact medicine, clinical care, and personal health and wellness. Although entertainment, social connection, and gaming will drive the initial adoption of VR and AR technology, the deepest and most significant impact of the next generation of VR/AR technology will be to enhance clinical care and to improve personal health and wellness. VR and AR technology will also help facilitate the shift of medicine to direct personal care. We know from decades of clinical research that VR/AR technology can provide breakthrough solutions that address the most difficult problems in healthcare - ranging from mood disorders such as Anxiety and Depression to PTSD, Addictions, Autism, Cognitive Aging, Stroke Recovery, and Physical Rehabilitation, to name just a few. VR technology can also improve clinical measurements and assessments by making them more objective and functional, and improve medical training such as surgical skill training and procedure planning by applying simulation-based learning principles. Personal health and wellness will be improved by using VR to promote healthy lifestyles and to reduce stress and anxiety. As the cost of healthcare rises, VR technology can serve as an effective telemedicine platform to reduce costs of care delivery, and improve clinical efficiency.

Virtual Reality Technology, Machine Learning, Biosensing Converging to Transf...

Stanford University

Functional specialization in human cognition: a large-scale neuroimaging init...

Ana Luísa Pinho

Citizen Science on the Move conference 25, 26 & 27 june 2012

Ronald Lenz

Human perceptual systems—for sight, sound, taste, touch, and smell (and maybe even embodied proprioception)—may offer some guidelines for how to build multimedia e-learning: immersive 3D simulations, imagery for analysis, sight-and-sound distributions of information channels, and other applications. This will offer a brief overview of human perception (with a little human cognition thrown in) and some light applications to the design of e-learning.

Building the Knowledge of Human Perception into E-Learning

Shalin Hai-Jew

Similar to Empathic Extended Reality (20)

Research Summary - Empathic Extended Reality

Emotion Detection Using Noninvasive Low-cost Sensors

Individual Brain Charting, a high-resolution fMRI dataset for cognitive mappi...

Serious Games and digital interactive technologies for Healthcare

Pannese healthcare

NeuroVR 1.5 - Open Source VR system for neuroscience and behavioral healthcare

Keynote@QUATIC - Recognizing Developer's Emotions: Advances and Open Challenges

Cognitive Reasoning and Inferences through Psychologically based Personalised...

Hpai class 13 - perception ii - 033020

GSR_PhobiAR_04

SIGIR15-NeuroIR

The importance of sensor networks and ai in supporting smart grid in the indu...

Empathy amplifier presentation ms4

Reality As A Knowledge Medium

Is the rising technology a threat?

Immersive Environments, Machine Learning, Neuroimaging, & Wearable Sensing Te...

Virtual Reality Technology, Machine Learning, Biosensing Converging to Transf...

Functional specialization in human cognition: a large-scale neuroimaging init...

Citizen Science on the Move conference 25, 26 & 27 june 2012

Building the Knowledge of Human Perception into E-Learning

More from Joaquim Jorge

The presentation explores the development and application of artificial intelligence (AI) from its inception to its current status in the modern world. The term "artificial intelligence" was first coined by John McCarthy in 1956 to describe efforts to develop computer programs capable of performing tasks that typically require human intelligence. This concept was first introduced at a conference held at Dartmouth College, where programs demonstrated capabilities such as playing chess, proving theorems, and interpreting texts. In the early stages, Alan Turing contributed to the field by defining intelligence as the ability of a being to respond to certain questions intelligently, proposing what is now known as the Turing Test to evaluate the presence of intelligent behavior in machines. As the decades progressed, AI evolved significantly. The 1980s focused on machine learning, teaching computers to learn from data, leading to the development of models that could improve their performance based on their experiences. The 1990s and 2000s saw further advances in algorithms and computational power, which allowed for more sophisticated data analysis techniques, including data mining. By the 2010s, the proliferation of big data and the refinement of deep learning techniques enabled AI to become mainstream. Notable milestones included the success of Google's AlphaGo and advancements in autonomous vehicles by companies like Tesla and Waymo. A major theme of the presentation is the application of generative AI, which has been used for tasks such as natural language text generation, translation, and question answering. Generative AI uses large datasets to train models that can then produce new, coherent pieces of text or other media. The presentation also discusses the ethical implications and the need for regulation in AI, highlighting issues such as privacy, bias, and the potential for misuse. These concerns have prompted calls for comprehensive regulations to ensure the safe and equitable use of AI technologies. Artificial intelligence has also played a significant role in healthcare, particularly highlighted during the COVID-19 pandemic, where it was used in drug discovery, vaccine development, and analyzing the spread of the virus. The capabilities of AI in healthcare are vast, ranging from medical diagnostics to personalized medicine, demonstrating the technology's potential to revolutionize fields beyond just technical or consumer applications. In conclusion, AI continues to be a rapidly evolving field with significant implications for various aspects of society. The development from theoretical concepts to real-world applications illustrates both the potential benefits and the challenges that come with integrating advanced technologies into everyday life. The ongoing discussion about AI ethics and regulation underscores the importance of managing these technologies responsibly to maximize their their benefits while minimizing potential harms.

Artificial Intelligence: Facts and Myths

Joaquim Jorge

Recent advances in VR and AR technology have enabled interactive graphics applications to support healthcare professionals in training, diagnosis, planning, and treatment. This field has progressed enough to warrant a course that can inspire new ideas within the graphics community. Medical images create virtual human anatomy models, allowing for natural interaction and visualization in healthcare scenarios. VR and AR are conceptually different and suited for different types of problems. VR is immersive and suitable for learning anatomy, surgical skills, and analyzing 3D medical data. AR, on the other hand, overlays helpful information onto the physical environment, making it useful for tasks such as communication with patients and training assistants. However, several challenges, such as nonstandard equipment and disorientation, still limit the widespread use of these technologies. This course covers current advances and challenges in this area, including integrating AI techniques. About the Speaker: Joaquim Jorge holds the UNESCO Chair of Artificial Intelligence & Extended Reality at the University of Lisboa, Portugal. He joined Eurographics in 1986 and ACM/SIGGRAPH in 1989. He is Editor-in-Chief of the Computers and Graphics Journal, Eurographics Fellow, ACM Distinguished Member, and member of IEEE Computer Society Board of Governors. He organized 50+ conferences, including Eurographics 2016 (IPC CO-Chair), IEEE VR 2020/21/22 as co-(papers)chair, and ACM IUI 2012 (IPC co-chair). He served on 210+ program committees and (co)authored over 360 peer-reviewed publications and five books. His research interests include graphics, virtual reality, and advanced HCI techniques applied to health technologies. Websites: https://en.wikipedia.org/wiki/Joaquim_Jorge_(computer_scientist) Google Scholar: https://scholar.google.com/citations?user=RgiMdpAAAAAJ&hl=en D.S. Lopes, D. Medeiros, S.F. Paulo, P.B. Borges, V. Nunes, V. Mascarenhas, M. Veiga, J.A. Jorge, Interaction Techniques for Immersive CT Colonography: A Professional Assessment, In: Frangi A., Schnabel J., Davatzikos C., Alberola-López C., Fichtinger G. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2018. MICCAI 2018. Lecture Notes in Computer Science, vol 11071, Pages 629–637, Springer, Cham, 2018. DOI: 10.1007/978-3-030-00934-2_70 M. Sousa, D. Mendes, S. Paulo, N. Matela, J. Jorge, D.S. Lopes, VRRRRoom: Virtual Reality for radiologists in the reading room, Proceedings of the 35th Annual ACM Conference on Human Factors in Computing Systems (CHI 2017), New York: ACM Press, 2017. DOI: 10.1145/3025453.3025566 D.S. Lopes, P.F. Parreira, S.F. Paulo, V. Nunes, P.A. Rego, M.C. Neves, P.S. Rodrigues, J.A. Jorge, On the utility of 3D hand cursors to explore medical volume datasets with a touchless interface, Journal of Biomedical Informatics, 72, Pages 140–149, 2017. DOI: 10.1016/j.jbi.2017.07.009

Matera Summer School AI&XR 2023.pdf

Joaquim Jorge

Invited paper from the Computers & Graphics Journal Presented at the SMI 2023 Conference in Genoa, Italy on July 4th 2023. Abstract: Highly complex and dense models of 3D objects have recently become indispensable in digital industries. Mesh decimation then plays a crucial role in the production pipeline to efficiently get visually convincing yet compact expressions of complex meshes. However, the current pipeline typically does not allow artists control the decimation process, just a simplification rate. Thus a preferred approach in production settings splits the process into a first pass of saliency detection highlighting areas of greater detail, and allowing artists to iterate until satisfied before simplifying the model. We propose a novel, efficient multi-scale method to compute mesh saliency at coarse and finer scales, based on fast mesh entropy of local surface measurements. Unlike previous approaches, we ensure a robust and straightforward calculation of mesh saliency even for densely tessellated models with millions of polygons. Moreover, we introduce a new adaptive subsampling and interpolation algorithm for saliency estimation. Our implementation achieves speedups of up to three orders of magnitude over prior approaches. Experimental results showcase its resilience to problem scenarios that efficiently scales up to process multi-million vertex meshes. Our evaluation with artists in the entertainment industry also demonstrates its applicability to real use-case scenarios. Authors: Rafael Kuffner dos Anjos, Leeds, UK Richard Andrew Roberts and Benjamin Allen, VUW, NZ, Joaquim Jorge, INESC-ID, U Lisboa, PT Ken Anjyo, OLM, JP

Presentation at SMI 2023

Joaquim Jorge

Public speaking is often referred to as a soft skill. However, your career, your job opportunities, promotion, and tenure (for professors) are intrinsically tied to being able to speak in public and persuade others of your ideas. Being able to "sell" your work, opinions, ideas, and points of view can be as important as being good at Math, Coding, and doing good science. Many tend to ignore this (at their peril). This talk will present ways to make your ideas, thoughts, and theses look appealing, engaging and engaging to others. While I am using PowerPoint, these practices and techniques will work equally well if you have PDF slides, Keynote presentations, or even (gasp!) Prezi... I will also cover slide preparation techniques, practical multimedia advice, and delivery how-tos (and not-tos). Bio: Joaquim Jorge heads the Graphics and Interaction Research Line at INESC-ID and is a Full Professor of Computer Science at Instituto Superior Técnico (IST), the School of Engineering of the University of Lisboa, Portugal, and is Editor-in-Chief of the Computers and Graphics Journal. He received Ph.D. and MSc degrees in Computer Science from Rensselaer Polytechnic Institute, Troy, NY, in 1995 and a BSEE from IST in 1984. An organizer of 50+ scientific conferences, Jorge has preferred over 42 invited talks and public presentations. He is a Distinguished Speaker and Member of the Association for Computing Machinery (ACM) and a Distinguished Visitor of the Institute of Electrical and Electronics Engineers (IEEE). He received the IFIP Silver Core in 2014 and is a Fellow of the Eurographics Association.

How to Craft and Deliver Winning Presentations

Joaquim Jorge

Virtual and Augmented Reality in Health Care & Rehabilitation

Joaquim Jorge

The growing interest of Augmented Reality (AR) together with the renaissance of Virtual Reality (VR) has opened new approaches and techniques on how professionals interact with medical imagery, plan, train and perform surgeries and also help people with special needs in Rehabilitation tasks. Indeed, many medical specialties already rely on 2D and 3D image data for diagnosis, surgical planning, surgical navigation, medical education or patient-clinician communication. However, the vast majority of current medical interfaces and interaction techniques continue unchanged, while the most innovative solutions have not unleashed the full potential of VR and AR. This is probably because extending conventional workstations to accommodate VR and AR interaction paradigms is not free of challenges. Notably, VR and AR-based workstations, besides having to render complex anatomical data in interactive frame rates, must promote proper anatomical insight, boost visual memory through seamless visual collaboration between professionals, free interaction from being seated at a desk (e.g., using mouse and keyboard) to adopt non-stationary postures and freely walk within a workspace, and must also support a fluid exchange of image data and 3D models as this fosters interesting discussions to solve clinical cases. Moreover, VR and AR-based techniques must also be designed according to good human-computer interaction principles since it is well known that medical professionals can be resistant to changes in their workflow. In this course, we will survey recent approaches to healthcare, including diagnosis, surgical training, planning, and followup as well as AR/MR/VR tools for patient rehabilitation. We discuss challenges, techniques, and principles in applying Extended Reality in these contexts and outline opportunities for future research. References: https://dl.acm.org/citation.cfm?id=3359418 This course was also presented in Toronto in two additional talks.

Siggraph asia 2019 Course slides

Joaquim Jorge

Siggraph asia 2019 panel pesentation ian hall

Joaquim Jorge

Morie frontiers nov2019

Joaquim Jorge

Embodiment cognition

Joaquim Jorge

Debevec vrai-s-asia2019

Joaquim Jorge

Glassner Puppies and Dragons vr+ai workshop

Joaquim Jorge

Siggraph Asia 2019 VR & AI workshop-wiles-handout

Joaquim Jorge

Augmented Reality and Artificial Intelligence: Friends with Benefits?

Joaquim Jorge

Empathic Computing

Joaquim Jorge

Augmented Reality and Artificial Intelligence: Friends with Benefits?

Joaquim Jorge

3D reconstruction from anatomical slices allows anatomists to reconstruct real structures by tracing organs from a lengthy series of cryosections. Notwithstanding, conventional interfaces rely on isolated single-user experiences using mouse-based input for tracing. In this work, we present Anatomy Studio, a collaborative mixed-reality approach, combined with tablets and styli, to assist anatomists by easing manual image segmentation and exploration tasks. We contribute novel interaction techniques intended to promote spatial understanding and expedite manual segmentation. By using mid-air interactions and interactive surfaces, anatomists can easily access any cryosection and edit contours, while following other user's contributions. A user study including experienced anatomists and medical professionals, conducted in real working sessions, demonstrates that Anatomy Studio is appropriate and useful for 3D reconstruction. Results indicate that our approach encourages closely-coupled collaborations and group discussion. We also discuss the implications of our work and provide domain insights.

Anatomy Studio: a Tool for Virtual Dissection Through Augmented 3D Reconstruc...

Joaquim Jorge

top 10 ways to get your paper rejected at Computers and Graphics Journal

Joaquim Jorge

VROOOM: Reading room conditions such as illumination, ambient light, human factors, and display luminance, play an important role in how radiologists analyze and interpret images. Indeed, serious diagnostic errors can appear when studying images through everyday monitors, namely whenever professionals are ill-positioned with respect to the display or visualize images under improper light and luminance conditions. In this work, we show that virtual reality head-mounted displays can assist radiodiagnostics by considerably diminishing the effects of unsuitable ambient conditions. Our approach combines virtual reality displays with interactive surfaces to support professional radiologists in analyzing medical images and formulating diagnostics. We evaluated our prototype with senior radiologists and radiology residents, and results indicate that our approach constitutes a viable, flexible, portable and cost-efficient option to traditional radiology reading rooms. ICOLONIC: CT Colonography (CTC) is considered the leading imaging technique for colorectal cancer (CRC) screening. However, conventional CTC systems rely on clumsy 2D input devices and stationary displays that make it hard to perceive the colon structure in 3D. To visualize such anatomically complex data, the immersion and freedom of movement afforded by Virtual Reality (VR) systems bear the promise to assist clinicians to improve 3D reading, hence, enabling more expedite diagnoses. To this end, we propose iCOLONIC, a set of interaction techniques using VR to perform CTC reading. iCOLONIC combines immersive Fly-Through navigation with positional tracking, multi-scale representations and mini-maps to guide radiologists and surgeons while navigating throughout the colon. Contrary to stationary VR solutions, iCOLONIC allows users to freely walk within a workspace to analyze both local and global 3D features.

Virtual Reality for Health Applications - siggraph asia 2018

Joaquim Jorge

ACM Europe October 2016

Joaquim Jorge

Work on interactive tabletops and surfaces has focused mostly on two-dimensional issues, such as multi-finger gestures and tangible interaction. Interesting as it is, however this picture is missing several dimensions. I will describe work on 2D and 3D semi-immersive environments and present novel on-and-above-the-surface techniques based on bi-manual models to take advantage of the continuous interaction space for creating and editing 3D models in stereoscopic environments. I will also discuss means to allow for more expressive interactions, including novel uses of sound and combining hand and finger tracking in the space above the table with multitouch gestures on its surface continuously. These combinations can provide alternative design environments and allow novel interaction modalities.

Touching More than 3 Dimensions Research Into Novel Interfaces – three dimen...

Joaquim Jorge

More from Joaquim Jorge (20)

Artificial Intelligence: Facts and Myths

Matera Summer School AI&XR 2023.pdf

Presentation at SMI 2023

How to Craft and Deliver Winning Presentations

Virtual and Augmented Reality in Health Care & Rehabilitation

Siggraph asia 2019 Course slides

Siggraph asia 2019 panel pesentation ian hall

Morie frontiers nov2019

Embodiment cognition

Debevec vrai-s-asia2019

Glassner Puppies and Dragons vr+ai workshop

Siggraph Asia 2019 VR & AI workshop-wiles-handout

Augmented Reality and Artificial Intelligence: Friends with Benefits?

Empathic Computing

Augmented Reality and Artificial Intelligence: Friends with Benefits?

Anatomy Studio: a Tool for Virtual Dissection Through Augmented 3D Reconstruc...

top 10 ways to get your paper rejected at Computers and Graphics Journal

Virtual Reality for Health Applications - siggraph asia 2018

ACM Europe October 2016

Touching More than 3 Dimensions Research Into Novel Interfaces – three dimen...

Recently uploaded

Java Programming :Event Handling(Types of Events)

simmis5

KubeKraft presentation @CloudNativeHooghly

sanyuktamishra911

VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking Escorts Service Available Whatsapp SABANA ☎️ : [+91-7001035870] Escorts Service are always ready to make their clients happy. Their exotic looks and sexy personalities are sure to turn heads. You can enjoy with them, including massages and erotic encounters. Our area Escorts are young and sexy, so you can expect to have an exotic time with them. They are trained to satiate your naughty nerves and they can handle anything that you want. They are also intelligent, so they know how to make you feel comfortable and relaxed Independent Escorts Service They know all the sex positions and can satisfy you in any way that you desire. They can even give you erotic massages to help you relax before your session. This is essential, because a man who is stressed won’t be receptive to the pleasures of sex. They also know how to play with your sexy organs, so you’ll have plenty of foreplay and cuddling. P252024SS SERVICE ✅ ❣️ ⭐➡️HOT & SEXY MODELS // COLLEGE GIRLS HOUSE WIFE RUSSIAN , AIR HOSTES ,VIP MODELS . AVAILABLE FOR COMPLETE ENJOYMENT WITH HIGH PROFILE INDIAN MODEL AVAILABLE HOTEL & HOME ★ SAFE AND SECURE HIGH CLASS SERVICE AFFORDABLE RATE ★ SATISFACTION,UNLIMITED ENJOYMENT. ★ All Meetings are confidential and no information is provided to any one at any cost. ★ EXCLUSIVE PROFILes Are Safe and Consensual with Most Limits Respected ★ Service Available In: - HOME & HOTEL Star Hotel Service .In Call & Out call SeRvIcEs : ★ A-Level (star escort) ★ Strip-tease ★ BBBJ (Bareback Blowjob)Receive advanced sexual techniques in different mode make their life more pleasurable. ★ Spending time in hotel rooms ★ BJ (Blowjob Without a Condom) ★ Completion (Oral to completion) ★ Covered (Covered blowjob Without condom ★ANAL SERVICES.

VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking

dharasingh5698

UNIT-IFLUID PROPERTIES & FLOW CHARACTERISTICS

rknatarajan

GAS POWER CYCLES Cycles: Otto, Diesel, Dual, Brayton - Calculation of mean effective pressure - Air standard efficiency - Comparison of cycles INTERNAL COMBUSTION ENGINES Classification - Components and their function - valve timing diagram and port timing diagram - actual and theoretical p-v diagram of two stroke and four stroke engines – carburettor - diesel pump and injector system - battery and magneto ignition system - principles of combustion and detonation in CI engines - lubrication and cooling systems - performance parameters and calculations.

Thermal Engineering Unit - I & II . ppt

DineshKumar4165

AKTU Computer Networks notes --- Unit 3.pdf

ankushspencer015

Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Sex Service At Affordable Rate Booking Contact Details WhatsApp Chat: +91-6297143586 pune Escort Service includes providing maximum physical satisfaction to their clients as well as engaging conversation that keeps your time enjoyable and entertaining. Plus they look fabulously elegant; making an impressionable. Independent Escorts pune understands the value of confidentiality and discretion - they will go the extra mile to meet your needs. Simply contact them via text messaging or through their online profiles; they'd be more than delighted to accommodate any request or arrange a romantic date or fun-filled night together. We provide - 01-may-2024(v.n)

Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...

Call Girls in Nagpur High Profile

Structural Analysis and Design of Foundations: A Comprehensive Handbook for Students and Professionals. Unlock the potential of foundation design with Dr. Costas Sachpazis’s enlightening handbook, a meticulously crafted guide poised to become an indispensable resource for both budding and seasoned civil engineers. This comprehensive manual illuminates the theoretical and practical aspects of structural analysis and design across various types of foundations and retaining walls. Within these pages, Dr. Sachpazis distills complex engineering principles into digestible, step-by-step processes, enhanced by detailed diagrams, case studies, and real-world examples that bridge the gap between academic study and professional application. From soil mechanics and load calculations to innovative design techniques and sustainability considerations, this book covers a vast landscape of structural engineering. Key Features: • In-Depth Analysis and Design: Explore thorough explanations of both shallow and deep foundation designs, supported by case studies that demonstrate their practical implementations. • Practical Guides: Benefit from detailed guides on site investigation, bearing capacity calculations, and settlement analysis, ensuring designs are both robust and reliable. • Innovative Techniques: Discover the latest advancements in foundation technology and retaining wall design, preparing you for future trends in civil engineering. • Educational Tools: Utilize this handbook as an educational tool, perfect for both classroom learning and professional development. Whether you're a student eager to learn the fundamentals or a professional seeking to deepen your expertise, Dr. Sachpazis’s handbook is designed to support and inspire excellence in the field of structural engineering. Embrace this opportunity to enhance your skills and contribute to building safer, more efficient structures.

Structural Analysis and Design of Foundations: A Comprehensive Handbook for S...

Dr.Costas Sachpazis

UNIT-II FMM-Flow Through Circular Conduits

rknatarajan

VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to 25K High Profile Escorts In Pune Booking Now open +91- 8005736733 Why you Choose Us- +91- 8005736733 HOT⇄ 8005736733 Mr ashu ji Call Mr ashu Ji +91- 8005736733 (V030524]N) 𝐇𝐨𝐭𝐞𝐥 𝐑𝐨𝐨𝐦𝐬 𝐈𝐧𝐜𝐥𝐮𝐝𝐢𝐧𝐠 𝐑𝐚𝐭𝐞 𝐒𝐡𝐨𝐭𝐬/𝐇𝐨𝐮𝐫𝐲🆓 .█▬█⓿▀█▀ 𝐈𝐍𝐃𝐄𝐏𝐄𝐍𝐃𝐄𝐍𝐓 𝐆𝐈𝐑𝐋 𝐕𝐈𝐏 𝐄𝐒𝐂𝐎𝐑𝐓 Hello Guys ! High Profiles young Beauties and Good Looking standard Profiles Available , Enquire Now if you are interested in Hifi Service and want to get connect with someone who can understand your needs. Service offers you the most beautiful High Profile sexy independent female Escorts in genuine ✔✔✔ To enjoy with hot and sexy girls ✔✔✔ ★providing:- • Models • vip Models • Russian Models • Foreigner Models • TV Actress and Celebrities • Receptionist • Air Hostess • Call Center Working Girls/Women • Hi-Tech Co. Girls/Women • Housewife

VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...

SUHANI PANDEY

NFPA 5000 2024 standard .

DerechoLaboralIndivi

The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss This Chance Of Getting Into My Sexy Boobs? Booking Contact Details WhatsApp Chat: +91-8250192130 pune Escort Service includes providing maximum physical satisfaction to their clients as well as engaging conversation that keeps your time enjoyable and entertaining. Plus they look fabulously elegant; making an impressionable. Independent Escorts pune understands the value of confidentiality and discretion - they will go the extra mile to meet your needs. Simply contact them via text messaging or through their online profiles; they'd be more than delighted to accommodate any request or arrange a romantic date or fun-filled night together. We provide - 30-april-2024(v.n)

The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...

ranjana rawat

Increased aeration of the soil; Stabilized soil structure; Higher and more diversified crop production; Better workability of the land; Earlier planting dates; Reduction of peak discharges by an increased temporary storage of water in the soil decomposition of organic matter; soil subsidence; reduced irrigation efficiency; increased risk of drought. excessive leaching of valuable nutrients from the soil; downstream environmental damage by salty or otherwise polluted drainage water; the presence of ditches, canals, and structures impending accessibility and interfering with other infrastructural elements of the land.

chapter 5.pptx: drainage and irrigation engineering

mulugeta48

Data security is rapidly gaining importance as the volume of data companies collect, analyze and monetize grows exponentially. New data processing tools and platforms are emerging at an increasing rate, as are the ways in which an organization consumes data. In this presentation Mukund Sarma and Feni Chawla talk about the unique technical and cultural challenges of running a data security program and share some practical solutions that have worked well at our company. These slides were presented at the BSides Seattle 2024 conference.

BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx

fenichawla

African Journal of Biological Sciences is an International peer-reviewed, Open Access journal that publishes original research articles as well as review articles in all areas of Biological Sciences. It operates a fully open access publishing model which allows open global access to its published content. This model is supported through Article Processing Charges. For more information on Article Processing charges click here. Its scope embraces Animal Sciences, Biochemistry, Bioinformatics, Biotechnology, Botany, Cell Biology, Developmental Biology, Ecology, Environmental Sciences, Ethno Medicine, Food Science, Freshwater Biology, Genetics, Immunology, Marine Biology, Microbiology, Molecular Biology, Physiology, Plant Sciences, Structural Biology,Toxicology,Zoology etc. It is essential that authors prepare their manuscripts according to established specifications. Failure to follow them may result in papers being delayed or rejected. Therefore, contributors are strongly encouraged to read the author guidelines carefully before preparing a manuscript for submission. The manuscripts should be checked carefully for grammatical, punctuation errors. All papers are subjected to peer review. All articles published in this journal represent the opinion of the authors and not reflect the official policy of the Journal of African Journal of Biological Sciences

Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...

Christo Ananth

Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Booking Booking Now open +91- 7737669865 Why you Choose Us- +91- 7737669865 HOT⇄ 7737669865 Mr ashu ji Call Mr ashu Ji +91- 7737669865 (V020524]N) 𝐇𝐨𝐭𝐞𝐥 𝐑𝐨𝐨𝐦𝐬 𝐈𝐧𝐜𝐥𝐮𝐝𝐢𝐧𝐠 𝐑𝐚𝐭𝐞 𝐒𝐡𝐨𝐭𝐬/𝐇𝐨𝐮𝐫𝐲🆓 .█▬█⓿▀█▀ 𝐈𝐍𝐃𝐄𝐏𝐄𝐍𝐃𝐄𝐍𝐓 𝐆𝐈𝐑𝐋 𝐕𝐈𝐏 𝐄𝐒𝐂𝐎𝐑𝐓 Hello Guys ! High Profiles young Beauties and Good Looking standard Profiles Available , Enquire Now if you are interested in Hifi Service and want to get connect with someone who can understand your needs. Service offers you the most beautiful High Profile sexy independent female Escorts in genuine ✔✔✔ To enjoy with hot and sexy girls ✔✔✔ ★providing:- • Models • vip Models • Russian Models

Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...

roncy bisnoi

Double rodded leveling 1 pdf activity 01

KreezheaRecto

Intze Overhead Water Tank Design by Working Stress - IS Method.pdf

Suman Jyoti

The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Chance Of Getting Into My Sexy Boobs? Booking Contact Details WhatsApp Chat: +91-8250192130 pune Escort Service includes providing maximum physical satisfaction to their clients as well as engaging conversation that keeps your time enjoyable and entertaining. Plus they look fabulously elegant; making an impressionable. Independent Escorts pune understands the value of confidentiality and discretion - they will go the extra mile to meet your needs. Simply contact them via text messaging or through their online profiles; they'd be more than delighted to accommodate any request or arrange a romantic date or fun-filled night together. We provide - 30-april-2024(v.n)

The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...

ranjana rawat

Generative AI or GenAI technology based PPT

bhaskargani46

Recently uploaded (20)

Java Programming :Event Handling(Types of Events)

KubeKraft presentation @CloudNativeHooghly

VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking

UNIT-IFLUID PROPERTIES & FLOW CHARACTERISTICS

Thermal Engineering Unit - I & II . ppt

AKTU Computer Networks notes --- Unit 3.pdf

Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...

Structural Analysis and Design of Foundations: A Comprehensive Handbook for S...

UNIT-II FMM-Flow Through Circular Conduits

VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...

NFPA 5000 2024 standard .

The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...

chapter 5.pptx: drainage and irrigation engineering

BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx

Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...

Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...

Double rodded leveling 1 pdf activity 01

Intze Overhead Water Tank Design by Working Stress - IS Method.pdf

The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...

Generative AI or GenAI technology based PPT

Empathic Extended Reality

1. Empathic Extended Reality: Exploring Physiological Data Sharing in Virtual Environments ARINDAM DEY EMPATHIC EXTENDED REALITY AND PERVASIVE COMPUTING LAB UNIVERSITY OF QUEENSLAND A.DEY@UQ.EDU.AU

3. https://www.youtube.com/watch?v=t3g2IBSaYb4

6. Empathy “Seeing with the Eyes of another, Listening with the Ears of another, and Feeling with the Heart of another …” Alfred Adler

7. Empathic Computing Understanding Systems that can understand your feeling and emotions Experiencing Systems that can help you better experience the world Sharing Systems that help you better share your experiences with others Sensors Extended Reality

8. “Virtual Reality is the ultimate empathy machine …” - Chris Milk

9. https://www.youtube.com/watch?v=digE62wpHOk Project Syria – Nonny de la Peña

10. Empathic XR Extended Reality Systems that can Measure | Share | Adapt to | Manipulate Emotion and Cognition in real time -Physiological (ECG, EDA, EMG, Pupil) -Neurological (EEG) -Behavioural (Speech, Posture, Movement)

11. Sharing Physiological States in Collaborative VR ACM CHI’17

12.

13. Data Collected - Raw heart-rate - Positive and negative affect schedule (PANAS) - Relative head orientation Results - Higher positive affect - More communication between collaborators - Observer interaction needed Sharing Physiological States in Collaborative VR ACM CHI’17

14. Multi-Sensory Heart Rate Feedback

15. Multi-Sensory Heart Rate Feedback Results - Audio-Haptic ranked best - More interaction needed for higher presence Data Collected - PANAS - Ranking - Raw heart-rate OzCHI’18

16. Manipulating Heart Rate Feedback in VR ACM CHI Play’18 PANAS

17. Multi-Sensory Heart Rate Feedback in Collaborative VR IEEE ISMAR’18

18. Multi-Sensory Heart Rate Feedback in Collaborative VR IEEE ISMAR’18 PANAS Social Presence

19. Shared and Manipulated Heartrate Feedback in VR IEEE ISMAR’19 Active Passive Manipulation -20%, 0%, +20%

20. Shared and Manipulated Heartrate Feedback in VR Social Presence IEEE ISMAR’19

21. Lessons Learned Social presences increases with - Shared awareness cues - Higher interaction Shared physiological feedback can - Increase communication - Alter emotions but not real signals - Increase awareness but may not change action

22. Brain Signals and VR

23. Emotion Sensing HMDs Looxid Emteq Neurable HMDs equipped with neurological and physiological sensors

24. Cognitively Adaptive Training in VR Looxid Training difficulty level adjusted based on alpha activity in real time Low level High level IEEE VR’19

25. Cognitively Adaptive Training in VR Looxid IEEE VR’19 Alpha activity changed without significant change in task completion time

26. Quantifying Presence Looxid Self-reported Questionnaires vs. real-time Physiological and Neurological Data

27. Quantifying Presence with Brain Signals Looxid High Presence Low Presence

28. Quantifying Presence with Brain Signals Looxid High Presence Low Presence

29. Next steps: Using EEG and other physiological sensors Looxid • Emotionally and cognitively adapt interfaces for learning and training • Understand how brain synchronization works in collaborative XR • Effectively share emotional and cognitive states to create empathy in collaborative XR

30. Thank You! Looxid Arindam Dey Empathic Extended Reality and Pervasive Computing Lab Co-Innovation Group | University of Queensland http://empathicxr.org | a.dey@uq.edu.au

Empathic Extended Reality

Recommended

Recommended

More Related Content

Similar to Empathic Extended Reality

Similar to Empathic Extended Reality (20)

More from Joaquim Jorge

More from Joaquim Jorge (20)

Recently uploaded

Recently uploaded (20)

Empathic Extended Reality