Human Emotional State Assessment Based on a Video Portrayal

1327

Abstract

The article is devoted to the results of approbation of the Geneva Emotion Recognition Test (GERT), a Swiss method for assessing dynamic emotional states, on Russian sample. Identification accuracy and the categorical fields’ structure of emotional expressions of a “living” face are analysed. Similarities and differences in the perception of affective groups of dynamic emotions in the Russian and Swiss samples are considered. A number of patterns of recognition of multi-modal expressions with changes in valence and arousal of emotions are described. Differences in the perception of dynamics and statics of emotional expressions are revealed. GERT method confirmed it’s high potential for solving a wide range of academic and applied problems.

General Information

Keywords: GERT, human face, multimodal dynamic expressions, emotion recognition, categorical expression field, cross-cultural comparison, dynamics and statics in the perception of emotions

Journal rubric: Psychology of States

Article type: scientific article

DOI: https://doi.org/10.17759/exppsy.2020130401

Funding. The work was supported by the RNF, project No. 18-18-00350 “Perception in the structure of nonverbal communication”.

Acknowledgements. The authors are grateful for permission to use GERT and assistance scientists from Swiss Center for Affective Sciences, University of Geneva — K.R. Scherer, K. Schlegel, D. Grandjean, M. Coven and their colleagues.

For citation: Barabanschikov V.A., Suvorova E.V. Human Emotional State Assessment Based on a Video Portrayal. Eksperimental'naâ psihologiâ = Experimental Psychology (Russia), 2020. Vol. 13, no. 4, pp. 4–24. DOI: 10.17759/exppsy.2020130401. (In Russ., аbstr. in Engl.)

References

  1. Barabanschikov V.A. Dinamika vospriyatiya vyrazhenii litsa. [The dynamics of the perception of facial expressions] Moscow: Publ. Kogito-Tsentr. 2016. 380 p. (In Russ.).
  2. Barabanschikov V.A., Zhegallo A.V., Korol’kova O.A. Pertseptivnaya kategorizatsiya vyrazhenii litsa. [Perceptual categorization of facial expressions] Moscow: Publ. Kogito-Tsentr, 2016. 376 p. (In Russ.).
  3. Barabanschikov V.A., Korol’kova O.A., Lobodinskaya E.A. Raspoznavanie emotsii v usloviyakh stupenchatoi stroboskopicheskoi ekspozitsii vyrazhenii litsa. Eksperimental’naya psikhologiya. Vol. 11 (4). 2018. pp. 50—69. doi:10.17759/exppsy.2018110405 (In Russ.).
  4. Barabanschikov V.A., Suvorova E.V. Metodika Gert: Otsenka Vospriyatiya Dinamicheskikh Emotsional’nykh Ekspressii [GERT: perception process of dynamic facial emotional expressions] Ekopsikhologicheskie issledovaniya — 6: ekologiya detstva i psikhologiya ustoichivogo razvitiya. 2020. pp. 103—107 (In Russ.).
  5. Bänziger T., Scherer K.R. Introducing the Geneva Multimodal Emotion Portrayal (GEMEP) corpus. In K.R. Scherer, T. Bänziger, E.B. Roesch (Eds.), Blueprint for affective computing: A sourcebook. Publ. Oxford, England: Oxford university Press. 2010. pp. 271—294. doi:10.1037/a0025827
  6. Bänziger T., Mortillaro M., Scherer K.R. Introducing the Geneva Multimodal expression corpus for experimental research on emotion perception. Emotion, Vol. 12, 2012. pp. 1161—1179. doi:10.1037/a0025827.
  7. Bänziger T., Patel S., Scherer K.R. The role of perceived voice and speech characteristics in vocal emotion communication. Journal of Nonverbal Behavior, Vol. 38 (1), 2014. pp. 31—52. doi:10.1007/s10919-013- 0165-x
  8. Barrett L.F., Russell J.A. The structure of current affect: Controversies and emerging consensus. Current Directions in Psychological Science, Vol. 8 (1), 1999. pp. 10—14. doi.org/10.1111/1467-8721.00003
  9. Dael N., Mortillaro M., Scherer KR. Emotion expression in body action and posture. Emotion, Vol. 12 (5), 2012. pp. 1085—1101. doi:10.1037/a0025737
  10. Dael N., Goudbeek M., Scherer K.R. Perceived gesture dynamics in nonverbal expression of emotion. Perception, Vol. 42 (6), 2013. pp. 642—657. doi:10.1068/p7364
  11. Ekman P. Basic emotions. In Dalgleish T., Power M. (Eds.), Handbook of Cognition and Emotion. NY.: Wiley. 1999. pp. 301—320.
  12. Ekman P., Friesen W. Unmasking the face. N.Y.: Prentice-Hall, 1975. 232 p.
  13. Goudbeek M., & Scherer K.R. Beyond arousal: Valence and potency/control in the vocal expression of emotion. Journal of the Acoustical Society of America, Vol. 128 (3). 2010. pp. 1332—1336. doi:10.1121/1.3466853
  14. Izard C.E. Emotions, personality, and psychotherapy. The psychology of emotions. NY.: Plenum Press. 1991. 451 p.
  15. Krumhuber E.G., Scherer K.R. Affect bursts: Dynamic patterns of facial expressions. Emotion, Vol. 11 (4), 2011. pp. 825—841. doi:10.1037/a0023856
  16. Mehu, M., Mortillaro, M., Bänziger, T., Scherer. K.R. Reliable facial muscle activation enhances recognizability and credibility of emotional expression. Emotion, Vol. 12 (4), 2012. pp. 701—715. doi:10.1037/a0026717
  17. Mehu M., Scherer, K.R. Emotion categories and dimensions in the facial communication of affect: An integrated approach. Emotion, Vol. 15 (6), 2015. pp. 798—811. doi:10.1037/a0039416
  18. Mortillaro M., Mehu M., Scherer K.R. Subtly different positive emotions can be distinguished by their facial expressions. Social Psychological & Personality Science, Vol. 2 (3). 2011. pp. 262—271. doi:10.1177/1948550610389080
  19. Patel S., Scherer K.R., Björkner,E., Sundberg J. Mapping emotions into acoustic space: the role of voice production. Biological Psychology, Vol. 87 (1). 2011. pp. 93—98. doi:10.1016/j.biopsycho.2011.02.010
  20. Russell J.A. Pancultural aspects of the human conceptual organization of emotions. Journal of Personality and Social Psychology, Vol. 45 (6), 1983. pp. 1281—1288. doi:10.1037/0022-3514.45.6.1281
  21. Scherer K.R. Analyzing Emotion Blends, In Fischer A. (ed.) Proceedings of the 10th Conference of the International Society for Research on Emotions, 1998. pp. 142—148. doi:10.1177/0539018404047701
  22. Scherer K.R. Ways to Study the Nature and Frequency of Our Daily Emotions: Reply to the Commentaries on «Emotions in Everyday Life» Social Science Information 2004, Vol. 43. pp. 667—689. doi:10.1177/0539018404047713
  23. Scherer K.R. and Ceschi G. Studying Affective Communication in the Airport: The Case of Lost Baggage Claims, Personality and Social Psychology Bulletin, Vol. 26 (3), 2000. pp. 327—339. doi:10.1177/0539018405058216
  24. Schlegel K., Grandjean D., Scherer K.R. Emotion recognition: Unidimensional ability or a set of modality- and emotion-specific skills? Personality and Individual Differences, Vol. 53 (1), 2012, pp. 16—21, doi:10.1016/j.paid.2012.01.026.
  25. Schlegel K., Grandjean D., Scherer K.R. Introducing the Geneva Emotion Recognition Test: An example of Rasch-based test development. Psychological Assessment, Vol. 26 (2), 2014. pp. 666—672. doi:10.1037/ a0025827
  26. Schlegel K., Scherer K.R. The nomological network of emotion knowledge and emotion understanding in adults: evidence from two new performance-based tests. Cognition and Emotion, 2017, Vol. 32. pp. 1514— 1530. doi:10.1080/02699931.2017.1414687.
  27. Scherer K.R. What are emotions? And how can they be measured. Social Science Information, Vol. 44, 2005. pp. 695—729. doi:10.1177/0539018405058216

Information About the Authors

Vladimir A. Barabanschikov, Doctor of Psychology, Professor, Director, Institute of Experimental Psychology, Moscow State University of Psychology and Education, Dean of the Faculty of Psychology, Moscow Institute of Psychoanalysis, Moscow, Russia, ORCID: https://orcid.org/0000-0002-5084-0513, e-mail: vladimir.barabanschikov@gmail.com

Ekaterina V. Suvorova, Research Associate, Institute of Experimental Psychology, Moscow State University of Psychology & Education, PhD Student, Moscow Institute of Psychoanalysis, Moscow, Russia, ORCID: https://orcid.org/0000-0001-8834-2037, e-mail: esresearch@yandex.ru

Metrics

Views

Total: 1723
Previous month: 115
Current month: 21

Downloads

Total: 1327
Previous month: 13
Current month: 2