image2
image3
image4
image5
image6
image7
image1

Continuous body emotion recognition system during theater performances

Senecal, S. and Cuel, L. and Aristidou, A. and Magnenat-Thalmann, N.


Abstract: Understanding emotional human behavior in its multimodal and continuous aspect is necessary for studying human machine interaction and creating constituent social agents. As a first step, we propose a system for continuous emotional behavior recognition expressed by people during communication based on their gesture and their whole body dynamical motion. The features used to classify the motion are inspired by the Laban Movement Analysis entities and are mapped onto the well-known Russell Circumplex Model . We choose a specific case study that corresponds to an ideal case of multimodal behavior that emphasizes the body motion expression: theater performance. Using a trained neural network and annotated data, our system is able to describe the motion behavior as trajectories on the Russell Circumplex Model diagram during theater performances over time. This work contributes to the understanding of human behavior and expression and is a first step through a complete continuous emotion recognition system whose next step will be adding facial expressions.

Keywords: emotion recognition, Laban Movement Analysis, behavior, motion capture, animation, interaction, nonverbal communication


DOI: 10.1002/cav.1714
Link: http://dx.doi.org/10.1002/cav.1714
@article{625,
  author = {Senecal, S. and Cuel, L. and Aristidou, A. and Magnenat-Thalmann, N.},
  title = {Continuous body emotion recognition system during theater performances},
  journal = {Computer Animation and Virtual Worlds},
  volume = {27},
  number = {3-4},
  issn = {1546-427X},
  url = {http://dx.doi.org/10.1002/cav.1714},
  doi = {10.1002/cav.1714},
  pages = {311--320},
  keywords = {emotion recognition, Laban Movement Analysis, behavior, motion capture, animation, interaction, nonverbal communication},
  year = {2016},
  project = {itn-dch},
  topic = {Personality and Emotion Simulation}
}