Overview of alternative approaches to modeling emotions in user models and cognitive-affective agent architectures.

1. Depth of Feelings: Alternatives for Modeling Affect in User Models & Cognitive Architectures Eva Hudlicka Psychometrix Associates Blacksburg, US [email_address] psychometrixassociates.com TSD 2006 Masarykova Universita, Brno, Czech Republic September 15, 2006

2. “ Diseases of the Mind”* Are emotions….. *Immanuel Kant

4. Emotions in “Human” Interaction “ too little…”

5. Emotions in Human Interaction “ too much..”

6. Or Is There a Middle Ground?

8. Emotions in HCI: State-of-the-art KISMET - Cynthia Breazeal, MIT Media Lab

9. Emotions in HCI: State-of-the-art Agent Max - Becker-Asano et al.

10. Requirements for Affective HCI Affective User Model / Cognitive-Affective Architecture Emotion Sensing & Recognition “ Emotion” Expression OR? GRETA, Fiorella de Rosis, U. Bari

16. Simple Fear “Signature”: Large, Approaching Object Increased heart-rate; Attacked? Crushed? Flee? Freeze? Feeling of fear Cognitive Subjective

17. A Taxonomy of Affective Factors Traits Affective Factors NOT ALL TRAITS are affective! Attitudes, Preferences… Affective States Emotions Moods Negative Positive Traits States “ Big 5” … Basic Anger Joy Fear … Complex Shame Guilt Pride …

18. Core Processes of Emotions Effects of Emotions (on cognition & behavior) Generation of Emotions (via cognitive appraisal) Cognitive-Affective Architecture Stimuli Situations Expectations Goals Cognitive Appraisal Emotions

19. Emotion Generation via Appraisal Stimuli Appraisal Dimensions Recalled Perceived Imagined Appraisal Process Emotions Existing emotions, moods, traits Goals (desires, values, standards) Beliefs, Expectations

23. “ Thank God! Those blasted crickets have finally stopped!”

29. A Taxonomy of Affective Factors States Affective States Emotions Moods Basic Complex Negative Positive Anger Joy Fear Shame Guilt Pride Traits Traits Affective Factors “ Big 5” …

34. Example #1: OCC Appraisal Model

35. Valenced Reactions Event-based emotions Attribution emotions Attraction emotions Event Related Appraised wrt goals “ Does this promote world peace?” Acts-by-Agents Related Appraised wrt standards “ Was it appropriate for John to rob the bank?” Object Related Appraised wrt attitudes “ Is this appealing to me?”

36. Valenced Reactions Event-based emotions happy for, pity, gloating.. joy,distress hope, fear gratitude, anger desirability (pleased / displeased) desirability for other (deserving, liking) likelihood praiseworthiness (approve / disapprove) appealingness (like / dislike) degree of autonomy, expectation deviation familiarity Attribution emotions Attraction emotions Fortunes-of-self emotions Fortunes-of-others emotions Prospect-based emotions Well-being emotions pride, shame, reproach love,hate

37. Valenced Reactions Event-based emotions Attribution emotions Attraction emotions Fortunes-of-self emotions Fortunes-of-others emotions happy for, pity, gloating.. distress Prospect-based emotions Well-being emotions anger reproach love,hate Desirability = low fear Praiseworthiness = low degree of autonomy = high expectation deviation = high

39. Example #2: Scherer‘s “Component Process Model”

40. Coping potential Norms Relevance Appraisal variables Novelty Valence Goal relevance Certainty Urgency Goal congruence Agency Stimuli Implications Coping Norms Emotion

41. STIMULI Novelty Valence Goal relevance Outcome probability Urgency Goal congruence Agency Coping potential Norms high high v. high low other low low high FEAR

43. Results of the Appraisal Process: Emotion ‘Specification’ fear .90 probability, importance of affected goals 2 minutes (exp. decay) { aggressive dog | owner} “ aggressive dog approaching” negative { dog | negligent owner | self } low { safety of self | safety of dog | delay } Other appraisal variables….: Type: Descriptive detail: Intensity: Variables affecting intensity: Cause: Direction: Coping potential: Duration: Valence: Goals affected:

45. Bayesian Belief Networks (MAMID, Hudlicka)

46. Complex Causal Interpretation (EMA, Gratch & Marsella)

47. Emotion Effects on Cognition Cognitive-Affective Architecture Stimuli Situations Expectations Goals Affect Appraiser Emotions

51. Emotions As Parameters (MAMID, Hudlicka) Traits Extraversion Stability Conscientiousness Aggressiveness STATES / TRAITS Processing Structural Module Parameters Construct parameters Architecture topology Long-term memory speed, capacity Cue selection & delay …. Data flow among modules Content & structure Affective States Anxiety Anger Sadness Joy ARCHITECTURE PARAMETERS COGNITIVE ARCHITECTURE Attention Action Selection Situation Assessment Goal Manager Expectation Generator Affect Appraiser

52. Modeling Threat Bias Processing Parameters Construct parms. - Cue selection - Interpretive biases ... Process Threat cues Process Threatening interpretations Traits Low Stability TRAITS / STATES COGNITIVE ARCHITECTURE PARAMETERS COGNITIVE ARCHITECTURE Attention Action Selection Situation Assessment Goal Manager Expectation Generator Affect Appraiser Emotions Higher Anxiety / Fear Predisposes towards Preferential processing of Threatening stimuli Threat constructs Rated more highly

54. Distinct Individual Profiles & Behavior “ Normal” “Anxious” Attention Perception / Situation Assessment Expectation Generation Affect Appraisal Goal Selection Action Selection Hostile large crowd Hostile large crowd Objective near Unit capability high Limited # of high-threat & self cues Movement blocked Danger to unit low Danger to unit and self high Perceptual threat & self bias Anxiety: Normal Anxiety: High Rapid-onset of high anxiety Danger from crowd unlikely Danger to unit and self high Career success threatened Threat and self oriented expectations Non-lethal crowd control Reduce anxiety Defend unit Threat and self focus goals Stop Stop; Lethal crowd control Non-lethal crowd control Report info Request help Request info Anxiety regulating behavior

62. MAMID Cognitive-Affective Architecture Action Selection Cues: State of the world ( “growling dog”, “approaching”) Situations: Perceived state ( “aggressive dog” ) Expectations: Expected state (“dog will attack”, “bite wound”) Goals: Desired state (“protect self”) Actions: to accomplish goals (“climb tree”) Affective state & emotions: Negative valence High anxiety Low happiness Cues Actions Attention Situation Assessment Expectation Generator Affect Appraiser Goal Manager

63. “ The Triune” Generic Architectures (Sloman; Leventhal & Scherer; Ortony et al.; Arbib & Fellous..) Reactive Routine Reflective hardwired, fixed Well-learned behavior Awareness Compare alternatives - detect deviations Simple ‘what if’ Symbolic processing Approach / Avoid Simple drives Complex mental models Self representations & self-awareness Explicit predictions, causality… Meta-cognition Proto-affect Good/bad Primitive Emotions Good/bad Now/later Full fledged emotions -Basic -Complex flexible

72. Depth of Feelings: Alternatives for Modeling Affect in User Models & Cognitive Architectures Eva Hudlicka Psychometrix Associates Blacksburg, US [email_address] psychometrixassociates.com TSD 2006 Masarykova Universita, Brno, Czech Republic September 15, 2006