Relationship of Mimic and Affective Characteristics in Verbal Comparison of Faces

The results of the analysis of verbalizations obtained in the situation of verbal comparison of images of emotional expressions from the VEPEL database are presented. It has been shown that specific information about expression is quantitatively presented in the verbal comparison data. The analysis of verbalizations, performed using the tools of the perceived quality paradigm, made it possible to differentiate the features of expressions, presenting them in two types of verbal portraits: affective and mimic. Comparison of these two types of verbal portraits allows to interpret affective judgments in mimic terms, and vice versa. The verbal features included in mimic verbal portraits were compared with descriptions of mimic characteristics of basic expressions according to P. Ekman. It is shown that many of the features identified in the situation of verbal comparison coincide with the descriptions proposed by P. Ekman, who, however, enumerated them without indicating their relative value.

1. Aleksandrov Yu.I., Nosulenko V.N., Savickaya T.Yu. Verbal'naya ocenka emocional'nyh i nejtral'nyh izobrazhenij [Verbal evaluation of emotional and neutral images]. Voprosy psychologii = Questions of psychology, 2020. Vol. 66(6), pp. 117—130. (In Russ.).
2. Barabanshchikov V.A., ZHegalo A.V., Korol'kova O.A. Perceptivnaya kategorizaciya vyrazhenij lica [Perceptual categorization of facial expressions]. Moscow: Cogito-Center, 2016. 374 (In Russ.).
3. Bogdanova I.V., Nosulenko V.N. Sovremennyye tendentsii primeneniya smeshannykh metodov v psikhologicheskikh issledovaniyakh [Modern trends in the use of mixed methods in psychological research]. Poznanie i perezhivanie = Cognition and Experience, 2021. Vol. 2(3), pp. 6—20. DOI:10.51217/cogexp_2021_02_03_01 (In Russ., abstr. in Engl.).
4. Bogdanova I.V., Nosulenko V.N. Informativnost' verbal'nykh dannykh v zadache sokhraneniya i peredachi kognitivnogo opyta [Informational content of verbal data in the task of preserving and transmitting cognitive experience]. Eksperimental’naya psikhologiya = Experimental Psychology, 2019. Vol. 12(4), pp. 12—26. DOI:10.17759/exppsy.2019120402 (In Russ., abstr. in Engl.).
5. Bruner J. Psikhologiya poznaniya [Psychology of Cognition]. Moscow: Progress, 1977. (In Russ.).
6. Zhinkin N. Rech' kak provodnik informatsii. [Speech as a conductor of information]. Moscow: Nauka, 1982. (In Russ.).
7. Kurakova O.A. Sozdanie novoj bazy fotoizobrazhenij estestvennyh perekhodov mezhdu bazovymi emocional'nymi ekspressiyami lica [Creating a new database of photographic images of natural transitions between basic emotional expressions of the face]. Lico cheloveka kak sredstvo obshcheniya: Mezhdisciplinarnyj podhod = Human face as a means of communication: An interdisciplinary approach. Moscow: Cogito-Center, IP RAN, 2012. Pp. 287—309. (In Russ.).
8. Lomov B.F. Osobennosti poznavatel’nyh processov v uslovijah obshhenija [Cognitive processes in the conditions of communication]. Psikhologicheskii zhurnal = Psychological Review, Vol. 1(5), pp. 26—42. (In Russ.).
9. Lomov B.F. Metodologicheskie i teoreticheskie problemi psihologii [Methodological and theoretical problems of psychology]. Moscow: Nauka, 1984. (In Russ.).
10. Nosulenko V.N. Psikhofizika vospriyatiya estestvennoi sredy. Diss. dokt. psikhol. nauk. [Psychophysics of the Perception of the Natural Environment. Dr. Sci. (Psychology) diss.]. Moscow: IP RAN, 2004. 323 p. (In Russ.).
11. Nosulenko V.N. Psikhofizika vospriyatiya estestvennoi sredy. Problema vosprinimaemogo kachestva [Psychophysics of the Perception of the Natural Environment. The Perceived Quality Problem]. Moscow: IP RAN, 2007. 400 p. (In Russ.).
12. Nosulenko V.N. Vosprinimayemoye kachestvo vo vzaimodeystvii cheloveka s mirom [Perceived quality in human interaction with the world]. In Psikhologiya vospriyatiya segodnya: paradigmy, teorii, empirika [Psikhologiya vospriyatiya segodnya: paradigmy, teorii, empirika]. Moscow: Akropol, 2019. Pp. 141—151. (In Russ.).
13. Nosulenko V.N. Voprosy integracii kachestvennyh i kolichestvennyh metodov v psihologicheskom issledovanii [Integration Issues of Qualitative and Quantitative Methods in Psychological Research]. Eksperimental'naya psihologiya =Experimental Psychology, 2021. Vol. 14(3), pp. 4— DOI:10.17759/exppsy.2021140301 (In Russ., abstr. in Engl.).
14. Nosulenko V.N., Parizet E., Samoylenko E.S. Sotsiokul'turnyye osobennosti verbal'noy kommunikatsii znachimykh priznakov akusticheskogo sobytiya [Sociocultural Features of Verbal Communication of Significant Signs of an Acoustic Event]. In Tekhnologii sokhraneniya i vosproizvedeniya kognitivnogo opyta [Technologies for preserving and reproducing cognitive experience]. Moscow: IPRAS, 2016. Pp. 369—381. (In Russ.).
15. Nosulenko V.N., Samoylenko E.S. “Poznanie i obshhenie”: sistemnaja issledovatel’skaja paradigma ["Cognition and communication": a systemic research paradigm]. Psikhologicheskii zhurnal = Psychological Journal, 2012. Vol. 33, no. 4, pp. 5—16. (In Russ.).
16. Nosulenko V.N., Samoylenko E.S. Kategorizaciya i sravnenie v psihologicheskih issledovaniyah [Categorization and comparison in psychological research]. Razrabotka ponyatij v sovremennoj psihologii = Development of concepts in modern psychology / Eds. A.L. ZHuravlev, E.A. Sergienk, G.A. Vilenskaya. Мoscow: Izd-vo “Institut psihologii RAN”, 2019. Pp. 84—115. (In Russ.).
17. Nosulenko V.N., Samoylenko E.S. Recognition of complex sounds by their verbal portraits [Recognition of complex sounds by their verbal portraits]. Psikhologicheskii zhurnal = Psychological Journal, 2020.Vol. 41, no. 5, pp. 25—37.DOI:10.31857/S020595920011078-1 (In Russ.).
18. Samoylenko E.S. Problemy sravnenija v psihologicheskom issledovanii [Problems of comparison in psychological research]. Moscow: Izd-vo “Institut psihologii RAN”, 2010. (In Russ.).
19. Samoylenko E.S., Melkumyan T.A. Individual'nye razlichiya v processah sravneniya izobrazhenij chelovecheskih glaz, pred"yavlennyh v razlichnyh kontekstah [Individual differences in the processes of comparing images of human eyes presented in different contexts]. Lico cheloveka v nauke, iskusstve i praktike = The human face in science, art and practice / Eds. Anan'eva K.I., Barabanshchikov V.A., Demidov A.A. Мoscow: Izd-vo «Cogito-Center», 2015. Pp. 243—252. (In Russ.).
20. Samoylenko E.S., Nosulenko V.N., Melkumyan T.A. Rol' verbal'no vyrazhennogo sravneniya ob’ektov v sub’ektivnoj ocenke stepeni ih skhodstva [The role of verbally expressed comparison of objects in the subjective assessment of the degree of their similarity]. Eksperimental'naya psihologiya = Experimental Psychology, 2010. Vol. 3(3), pp. 93—109. (In Russ., abstr. in Engl.).
21. Samoylenko E.S., Nosulenko V.N., Starikova I.V. Fenomen sravneniya v processe referentnogo obshcheniya [The phenomenon of comparison in the process of reference communication]. Eksperimental'naya psihologiya =Experimental Psychology, 2012. Vol. 5(2), pp. 39—62. (In Russ., abstr. in Engl.).
22. Ekman P. Emotions revealed: Recognizing faces and feelings to improve communication and emotional life. New York: Times Books, Henry Holt and Co,
23. Ekman P. Basic Emotions. Handbook of Cognition and Emotion. John Wiley & Sons, 1999. DOI:10.1002/0470013494.ch3
24. Ekman P., Cordaro D. What is meant by calling emotions basic. Emotion Review, 2011. Vol. 3, no. 4, pp. 364—370.
25. Etcoff N.L., Magee J.J. Categorical perception of facial expressions. Cognition, 1992. Vol. 44, no. 3, 227—240.
26. Fussell S.R., Krauss R.M. Coordination of knowledge in communication: Effects of speakers’ assumptions about what others know. Journal of Personality and Social Psychology, Vol. 62, no. 3, pp. 378—391.
27. Kuppens P., Tuerlinckx F., Russell J.A., Barrett, L.F. The Relation between Valence and Arousal in Subjective Experience. Psychological Bulletin, 2013. Vol. 139, no. 4, 917—940.
28. Leavitt H.J., Mueller R.A. Some effects of feedback on communication. Human Relations, 1951. No. 4, 401—410.
29. Liberman A.M., Harris K.S., Hoffman H.S., Griffith B.G. The discrimination of speech sounds within and across phoneme boundaries. Journal of Experimental Psychology, 1957. Vol. 54, no. 5, pp. 358—368.
30. Nosulenko V., Samoylenko E. Approche systémique de l’analyse des verbalisations dans le cadre de l’étude des processus perceptifs et cognitifs. Social Science Information, Vol. 36, no. 2, pp. 223—261. DOI :10.1177/053901897036002002
31. Samoylenko E., McAdams S., Nosulenko V. Systematic analysis of verbalizations produced in comparing musical timbres. International Journal of Psychology, 1996. 31(6), pp. 255—278.
32. Samoylenko E., Melkumyan T.A. Comparison of visual objects in different contexts of their presentation. The Fifth International Conference on Cognitive Science, 2012. Vol. 1. Kaliningrad, Russia. Pp. 148—149.
33. Strauss A., Corbin J. Basics of Qualitative Research. Techniques and Procedures for Developing Grounded Theory. 2nd ed. Thousand Oaks, CA: Sage, 1998.
34. Thomas D.R. A general inductive approach for analyzing qualitative evaluation data. American Journal of Evaluation, Vol. 12, no. 2, pp. 237—246. DOI:10.1177/1098214005283748