Emotion-Oriented Systems

Catherine Pelachaud is Director of Research at CNRS in the laboratory LTCI, TELECOM ParisTech. Her research interest includes embodied conversational agent, nonverbal communicative and emotional communication, multimodal expressive behaviors and human-machine interaction. She has been and is still involved in several European projects related to multimodal communication, to believable embodied conversational agents, emotion and social behaviors. She was the secretary of the Humaine association from 2007 to 2009. Since 2009 she has been part of its executive committee. She has also been on the organizing and program committees of the ACII conferences.

• Preface xiiiPART 1: FOUNDATIONS 1Chapter 1. Contemporary Theories and Concepts in the Psychology of Emotions 3Géraldine COPPIN and David SANDER1.1. Introduction 31.2. Emergence of a scientific approach to emotions 41.3. Basic emotions theories 71.4. Bi-dimensional theories of emotion 111.5. Appraisal theories of emotions 141.6. Conclusion 191.7. Glossary 201.8. Bibliography 21Chapter 2. Emotion and the Brain 33Andy CHRISTEN and Didier GRANDJEAN2.1. Introduction 332.2. The major role of affective neuroscience in understanding emotions 352.3. The historical and conceptual legacy of early conceptions of emotions and the brain 402.4. Initial neuro-anatomical emotion theories 412.5. Structures in the brain and their functions in emotional processes 442.6. The prefrontal cortex 532.7. The anterior cingulate cortex 582.8. The role of the insula in disgust 582.9. Temporal dynamic of brain processes in emotional genesis 592.10. Functional connectivity 602.11. Conclusion 632.12. Bibliography 64PART 2: NON-VERBAL BEHAVIOR 77Chapter 3. Emotional Corpora: from Acquisition to Modeling 79Laurence DEVILLERS and Jean-Claude MARTIN3.1. Introduction 793.2. Building corpora: “acted”, “induced” and real-life emotions 813.3. Current emotional corpora 863.4. Coding schemes 863.5. Complex emotions in spontaneous data 933.6. Applications for corpora 973.7. Conclusion 1003.8. Bibliography 101Chapter 4. Visual Emotion Recognition: Status and Key Issues 107Alice CAPLIER4.1. Introduction 1074.2. What is a facial expression? 1094.3. Overview of facial expression recognition methods 1124.4. Spontaneous facial expressions 1184.5. Expression intensity 1244.6. Dynamic analysis 1264.7. Multimodality 1284.8. Conclusion 1314.9. Bibliography 132Chapter 5. Recognition of Acoustic Emotion 139Chloé CLAVEL and Gaël RICHARD5.1. Introduction 1395.2. Principles of automatic emotion-recognition systems 1405.3. Acoustic descriptors 1415.4. Automatic emotion classification 1515.5. Performance and assessment 1575.6. Conclusion 1615.7. Bibliography 163Chapter 6. Modeling Facial Expressions of Emotions 169Sylwia Julia HYNIEWSKA, Rados³aw NIEWIADOMSKI and Catherine PELACHAUD6.1. Expressive conversational agents 1696.2. Expressions and their emotional states 1706.3. Computational models for facial expressions of emotions 1746.4. Conclusion 1836.5. Acknowledgements 1846.6. Bibliography 184Chapter 7. Emotion Perception and Recognition 191Ioana VASILESCU7.1. Introduction 1917.2. Perception in vocal communication of emotion 1937.3. Experimental paradigms and emotion-oriented automatic systems 1947.4. Conclusion 2087.5. Bibliography 209PART 3: FUNCTIONS 215Chapter 8. The Role of Emotions in Human−Machine Interaction 217Valérie MAFFIOLO and Magalie OCHS8.1. Introduction 2178.2. Interactive information and assistance systems 2198.3. Video games 2278.4. Intelligent tutoring systems (ITS)2358.5. Discussion and research perspectives 2378.6. Bibliography 238Chapter 9. Music and Emotions 247Donald GLOWINSKI and Antonio CAMURRI9.1. The growing importance of music in society 2479.2. Recognizing emotions and structural characteristics in music 2499.3. Rules for modeling musical expression of emotions 2519.4. Towards a continuous measure of emotional reactions to music 2529.5. Multimodality in musical experience 2539.6. Multimodal emotional synthesis in a musical context 2609.7. The social active listening paradigm: the collective aspect of emotion 2629.8. Conclusion and perspectives 2639.9. Bibliography 263Chapter 10. Literary Feelings in Interactive Fiction 271Marc CAVAZZA and David PIZZI10.1. Introduction: emotions and feelings 27110.2. French novels and the representation of feelings 27310.3. Madame Bovary: plot and scenes 27510.4. Interactive fiction and emotional planning 28010.5. Linguistic interaction and emotions 28410.6. Emma Bovary’s virtuality 29010.7. Conclusion 29410.8. Bibliography 295Chapter 11. The Design of Emotions: How the Digital is Making Us More Emotional 299Annie GENTÈS11.1. Representing, interpreting and evoking emotions 29911.2. Emotion, mimicry and technical devices 30111.3. Devices as an alternate source of emotion: photography 30111.4. Art and computers: formal beginnings 30311.5. The human behind the mechanics and the mechanics behind the human 30511.6. Mirror interaction as an emotional vehicle 30711.7. Trompe l’oeil versus explicit expression 30911.8. Three-dimensional universes: an empathetic experience 31111.9. Empathy and identifying emotions 31511.10. Making human−machine interaction and dialog effective 31711.11. Conclusion: “revenge of the emotions”31811.12. Bibliography 318List of Authors 321Index 325