Recognition of facial expressions during step-function stroboscopic presentation

639

Abstract

We studied the perception of human facial emotional expressions during step-function stroboscopic presentation of changing mimics. Consecutive stages of each of the six basic facial expressions were pre sented to the participants: neutral face (300 ms) — expression of medium intensity (10—40 ms) — intense expression (30—120 ms) — expression of medium intensity (10—40 ms) — neutral face (100 ms). Alternative forced choice task was used to categorize the facial expressions. The results were compared to previous studies (Barabanschikov, Korolkova, Lobodinskaya, 2015; 2016), conducted using the same paradigm but with boxcar-function change of the expression: neutral face — intense expression — neutral face. We found that the dynamics of facial expression recognition, as well as errors and recognition time are almost identical in conditions of boxcar- and step-function presentation. One factor influencing the recognition rate is the proportion of presentation time of static (neutral) and changing (facial expression) aspects of the stimulus. In suboptimal conditions of facial expression perception (minimal presentation time of 10+30+10 ms and reduced intensity of expressions) we revealed stroboscopic sensibilization — a previously described phenomenon of enhanced recognition rate of low-attractive expressions (disgust, sadness, fear and anger), which has been previously found in conditions of boxcar-function presentation of expressions. We confirmed the similarity of influence of real and apparent motion on the recognition of basic facial emotional expressions.

General Information

Keywords: apparent motion, expression recognition, face stroboscopic exposition, stroboscopic sensibilization of emotional facial expression

Journal rubric: Psychology of Perception

Article type: scientific article

DOI: https://doi.org/10.17759/exppsy.2018110405

Funding. The study was supported by Russian Science Foundation, project No 18-18-00350 “Perception in the structure of nonverbal communication”.

For citation: Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. Recognition of facial expressions during step-function stroboscopic presentation. Eksperimental'naâ psihologiâ = Experimental Psychology (Russia), 2018. Vol. 11, no. 4, pp. 50–69. DOI: 10.17759/exppsy.2018110405. (In Russ., аbstr. in Engl.)

References

  1. Ambadar Z., Schooler J.W., Cohn J.F. Deciphering the Enigmatic Face: The Importance of Facial Dynamics in Interpreting Subtle Facial Expressions. Psychological Science, 2005, vol. 16, no. 5, pp. 403—410. doi: 10.1111/j.0956-7976.2005.01548.x
  2. Barabanschikov V.A. Dynamics of facial expressions perception. Moscow, Kogito-Tsentr, 2016. (In Russ.).
  3. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. Otsenka emotsional’nykh ekspressii razlichnoi stepeni chetkosti [Evaluation of emotional expressions of varying degrees of clarity]. In A.L. Zhuravlev, V.A. Koltsova (eds.), Fundamental’nye I prikladnye issledovaniia sovremennoi psikhologii: rezul’taty I perspektivy razvitiia [ Fundamental and applied research of modern psychology: results and development prospects]. Moscow, IPRAS Publ., 2017. pp. 417—422. (In Russ.).
  4. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. Vliianie kazhushchegosia dvizheniia rasfokusirovannogo izobrazheniia litsa na raspoznavanie bazovykh emotsii [The influence of the apparent movement of the defocused face image on the recognition of basic emotions]. In N.B. Karabushchenko, N.L. Sungurova (eds.), Aktual’nye problemy psikhologii I pedagogiki v sovremennom mire: sbornik trudov uchastnikov III Mezhdunarodnoi nauchno-prakticheskoi konferentsii [ Actual problems of psychology and pedagogy in the modern world: a collection of works of participants of the III International Scientific and Practical Conference]. Moscow, RUDN Publ., 2017. pp. 50—58. (In Russ.).
  5. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. Vliianie mikropauzy na raspoznavanie bazovykh ekspressii pri stroboskopicheskoi ekspozitsii litsa [The role of brief ISI in perception of facial emotional expressions during stroboscopic exposition]. In K.I. Ananyeva, V.A. Barabanschikov, A.A. Demidov (eds.), Litso cheloveka v prostranstve obshcheniia [Human face in the communicational space]. Moscow, Cogito-Center Publ., 2016. pp. 339—353. (In Russ.).
  6. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. Vospriyatie emotsional’nykh ekspressii litsa pri ego maskirovke I kazhushchemsya dvizhenii [Perception of facial expressions during masking and apparent motion]. Eksperimental’naya psikhologiya [Experimental Psychology (Russia)], 2015, vol. 8, no. 1, pp. 7—27. (In Russ.; abstr. in Engl.).
  7. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. Zavisimost’ vospriiatiia litsevykh ekspressii ot prostranstvenno-vremennoi struktury ekspozitsii [The dependence of the perception of facial expressions on the spatial-temporal structure of the exposure]. In V.A. Barabanschikov (ed.), Kognitivnye mekhanizmy neverbal’noi kommunikatsii [Cognitive mechanisms of non-verbal communication]. Moscow, Cogito-Center Publ., 2016. pp. 48—101. (In Russ.).
  8. Bates D., Mächler M., Bolker B., Walker S. Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software, 2015, vol. 67, no. 1, pp. 1—48. doi: 10.18637/jss.v067.i01
  9. Cosker D., Krumhuber E., Hilton A. Perception of linear and nonlinear motion properties using a FACS validated 3D facial model. Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization — APGV ’10. N.Y., ACM Press, 2010. pp. 101—108. doi: 10.1145/1836248.1836268
  10. Cunningham D.W., Wallraven C. Dynamic information for the recognition of conversational expressions. Journal of Vision, 2009, vol. 9, no. 13, pp. 1—17. doi: 10.1167/9.13.7
  11. Hill H.C.H., Troje N.F., Johnston A. Range- and domain-specific exaggeration of facial speech. Journal of vision, 2005, vol. 5, no. 10, pp. 793—807. doi: 10.1167/5.10.4
  12. Langner O., Dotsch R., Bijlstra G., Wigboldus D.H.J., Hawk S.T., Knippenberg A. van. Presentation and validation of the Radboud Faces Database. Cognition & Emotion, 2010, vol. 24, no. 8, pp. 1377—1388. doi: 10.1080/02699930903485076
  13. Leonard C.M., Voeller K.K.S., Kuldau J.M. When’s a Smile a Smile? Or how to Detect a Message by Digitizing the Signal. Psychological Science, 1991, vol. 2, no. 3, pp. 166—172. doi: 10.1111/j.1467-9280.1991. tb00125.x
  14. Recio G., Sommer W., Schacht A. Electrophysiological correlates of perceiving and evaluating static and dynamic facial emotional expressions. Brain Research, 2011, vol. 1376, no. 2, pp. 66—75. doi: 10.1016/j. brainres.2010.12.041
  15. Sato W., Yoshikawa S. The dynamic aspects of emotional facial expressions. Cognition & Emotion, 2004, vol. 18, no. 5, pp. 701—710. doi: 10.1080/02699930341000176
  16. Wallraven C., Breidt M., Cunningham D.W., Bülthoff H.H. Evaluating the perceptual realism of animated facial expressions. ACM Transactionson Applied Perception, 2008, vol. 4, no. 4, pp. 1—20. doi: 10.1145/1278760.1278764

Information About the Authors

Vladimir A. Barabanschikov, Doctor of Psychology, Professor, Director, Institute of Experimental Psychology, Moscow State University of Psychology and Education, Dean of the Faculty of Psychology, Moscow Institute of Psychoanalysis, Moscow, Russia, ORCID: https://orcid.org/0000-0002-5084-0513, e-mail: vladimir.barabanschikov@gmail.com

Olga A. Korolkova, PhD in Psychology, professor, Leading Research Associate, Institute of Experimental Psychology, Moscow State University of Psychology & Education, Moscow, Russia, ORCID: https://orcid.org/0000-0003-4814-7266, e-mail: olga.kurakova@gmail.com

Elena A. Lobodinskaya, PhD in Psychology, Research Associate, Institute of Experimental Psychology, Moscow State University of Psychology & Education, Lecturer, Moscow Institute of Psychoanalysis, Moscow, Russia, ORCID: https://orcid.org/0000-0002-6827-744X, e-mail: elena.lobodinskaya@gmail.com

Metrics

Views

Total: 2044
Previous month: 12
Current month: 13

Downloads

Total: 639
Previous month: 4
Current month: 4