Content area
Full Text
Lang Resources & Evaluation (2012) 46:117130 DOI 10.1007/s10579-011-9163-y
REPORT
Federica Cavicchio Massimo Poesio
Published online: 25 September 2011 Springer Science+Business Media B.V. 2011
Abstract The Rovereto Emotion and Cooperation Corpus (RECC) is a new resource collected to investigate the relationship between cooperation and emotions in an interactive setting. Previous attempts at collecting corpora to study emotions have shown that this data are often quite difcult to classify and analyse, and coding schemes to analyse emotions are often found not to be reliable. We collected a corpus of task-oriented (MapTask-style) dialogues in Italian, in which the segments of emotional interest are identied using psycho-physiological indexes (Heart Rate and Galvanic Skin Conductance) which are highly reliable. We then annotated these segments in accordance with novel multimodal annotation schemes for cooperation (in terms of effort) and facial expressions (an indicator of emotional state). High agreement was obtained among coders on all the features. The RECC corpus is to our knowledge the rst resource with psycho-physiological data aligned with verbal and nonverbal behaviour data.
Keywords Cooperation Emotions Multimodal Dialogue Annotation
1 Introduction
The interpretation of emotional subjective experience has raised a great interest in the last decade. Scientists have come to realize that emotions are important predictors of (non) cooperation. Researchers showed that when respondents were treated unfairly, they felt not just anger, but sadness, irritation, and contempt
F. Cavicchio (&) M. Poesio
Center for Mind/Brain Sciences, University of Trento, Rovereto, Italy e-mail: [email protected]
M. Poesio
CSEE, Language and Computation Group, University of Essex, Essex, UK
The Rovereto Emotion and Cooperation Corpus: a new resource to investigate cooperation and emotions
123
118 F. Cavicchio, M. Poesio
(Sanfey et al. 2003; Xiao and Houser 2005). Those emotions are reected in facial expressions. Many studies claimed that cooperators can be identied by honest and non falsiable signals, allowing for mutual selection among cooperators (Dawkins 1976; Frank 1988; Hamilton 1964; Trivers 1971). It has been proposed that the display of spontaneous positive emotion, also known as Duchenne smiles,1 can serve as a relatively honest signal of positive subjective experience (Ekman and Friesen 1982; Frank and Ekman 1993). The ndings suggested that cooperative individuals display higher levels of positive emotions than non cooperators.
These ndings have had a signicant impact on HumanComputer Interaction...