Perception of psychological peculiarities of a person by his facial expression and voice

The article is devoted to the study of the role of complex interaction of different sources of information about a person in the formation of coherent, «polymodal» representation of his/her psychological features, namely the role of expression of his/her face and voice. Conducted general theoretical analysis not only showed a variety of interdisciplinary areas of research of perception of human face and voice, but also confirmed the relevance of studying of the problem of the interaction of perception of another person's voice and perception of his facial expression in the process of formation of a first impression about him. Author’s stimulus material, which is a collection of images of persons and recordings of the voices of men and women, was designed for the implementation of the empirical research. The study confirmed the hypothesis that a simple summation of the sources of information (visual and auditory) about the other person cannot provide the improvement of the adequacy of interpersonal perception. Moreover, the adequacy of perception of psychological features is directly related to the mode of presentation and to the specific source of information (facial expression/voice).

1. Barabanschikov V. A. Vospriiatie vyrazhenii litsa [Perception of facial expressions]. Moscow, Institut psikhologii RAN Publ., 2009.
2. Barabanschikov V. A., Nosulenko V. N. Sistemnost'. Vospriiatie. Obshchenie [Systems. Perception. Communication]. Moscow, Institut psikhologii RAN Publ., 2004.
3. Barabanschikov V. A., Demidov A. A. Mikrodinamika otsenki individual'no-psikhologicheskikh osobennostei cheloveka po vyrazheniiu ego litsa [Microdynamics assess of individual psychological characteristics by face expression]. Eksperimental'naia psikhologiia, 2009, no. 4, pp. 40–50.
4. Demidov A. A. Otsenka individual'no-psikhologicheskikh osobennostei cheloveka po vyrazheniiu ego litsa v razlichnykh situatsiiakh vospriiatiia [Evaluation of individual psychological characteristics of a person by his face expression in different situations]. Diss. ... kand. psikhol. nauk. Moscow, Institut psikhologii RAN Publ., 2009.
5. Demidov A. A., Anan'eva K. I. Mikrodinamika mezhlichnostnogo vospriiatiia [Microdynamics of interpersonal perception]. Sovremennaia eksperimental'naia psikhologiia [Modern experimental psychology] (ed. V. A. Barabanschikov). Moscow, Institut psikhologii RAN Publ., 2011, pp. 393–415.
6. Labunskaia V. A. Ekspressiia cheloveka: obshchenie i mezhlichnostnoe poznanie. [Expression of a man:communication and interpersonal cognition]. Rostov-na-Donu, Feniks Publ., 1999.
7. Morozov V. P. Iskusstvo i nauka obshcheniia: neverbal'naia kommunikatsiia [The art and science of communication: nonverbal communication]. Moscow, Institut psikhologii RAN Publ., 1998.
8. Abitbol J., Abitbol P., Abitbol B. Sex hormones and the female voice. Journal of Voice, 1999, no. 13.
9. Bänziger, T., Grandjean D., Scherer K. R. Emotion recognition from expressions in face, voice, and body. The Multimodal Emotion Recognition Test (MERT). Emotion, 2009, vol. 9, no. 5, pp. 691–704.
10. Berry D. Vocal attractiveness and vocal babyishness: effects on stranger, self and friend impressions. Journal of Nonverbal Behavior, 1990, no. 14, pp. 141–153.
11. Berry D. S. Accuracy in social perception: contributions of facial and vocal information. Journal of personality and social psychology, 1991, vol. 61, no. 2, pp. 298–307.
12. Bruce V., Young A. In the eye of beholder. The science of face perception. N.Y., Oxford University Press, 2000.
13. Caruso S., Roccasalva L., Sapienza G., Zappala M., Nuciforo G., Biondi S. Laryngeal cytological aspects in women with surgically induced menopause who were treated with transdermal estrogen replacement therapy. Fertility and Sterility, 2000, no. 74, pp. 1073–1079.
14. Collins S. A., Missing C. Vocal and visual attractiveness are related in women. Animal Behaviour, 2003, vol.65, pp. 997–1007.
15. Evans S., Neave N., Wakelin D. Relationships between vocal characteristics and body size and shape in human males: An evolutionary explanation for a deep male voice. Biological Psychology, 2006, vol. 72, pp. 160-163.
16. Feinberg D. R., DeBrune L. M., Jones B. C., Little A. C. Correlated preferences for men’s facial and vocal masculinity. Evolution and Human Behavior, 2008, no. 29, pp. 233–241.
17. Feinberg D. R., Jones B. C., DeBruine L. M., Law-Smith M. J., Cornwell R. E., Hiller S. G., et al. Maintenance of vocal sexual dimorphism: Adaptive selection against androgyny. 18th Human Behavior and Evolution Society (HBES) Conference. Philadelphia, PA, USA, 2006.
18. Feinberg D. R., Jones B. C., DeBruine L. M., Moore F. R., Law-Smith M. J., Cornwell R. E., Tiddeman B.P., Boothroyd L. G., Perrett D. I. The voice and face of woman: One ornament that signals quality? Evolution and Human Behavior, 2005, no. 26, pp. 398–408.
19. Fitch W. T. Morphology and development of human vocal tract: a study using magnetic resonance imaging. Journal of the Acoustical Society of America, 1999, no. 106, pp. 1511–1522.
20. Freeman J. B., Ambady N. When two become one: Temporally dynamic integration of the face and voice. Journal of experimental social psychology, 2011, no. 47, pp. 259–263.
21. Hughes S. M., Dispenza F. & Gallup G. G. Rating of voice attractiveness predict sexual behavior and body configuration. Evolution and Human Behavior, 2004, no. 25, pp. 295–304.
22. Hughes S. M., Harrison M. A., Gallup G. G. Jr. The sound of symmetry. Voice as a marker of development instability. Evolution and Human Behavior, 2002, no. 23, pp. 173–180.
23. Kamachi M., Hill H., Lander K. & Vatikiotis-Bateson E. “Putting the face to the voice”: matching identity across modality. Current Biology, 2003, vol. 13, September, pp. 1709–1714.
24. Knight, B., Johnston, A. The role of movement in face recognition. Visual Cognition, 1997, no. 4, pp. 265–273. Krauss R.M., Freyberg R., Morsella E. Inferring speakers’ physical attributes from their voices. Journal of experimental social psychology, 2002, no. 38, pp. 618–625.
25. Lander K., Christie F., Bruce V. The role of movement in the recognition of famous faces. Memory andCognition, 1999, no. 27, pp. 974–985.
26. McGurk H., MacDonald J. Hearing Lips and Seeing Voices. Nature, 1976, vol. 264 (5588), pp. 746–748. Munhall K. G., Vatikiotis-Bateson E. The moving face during speech communication. Hearing by eye: Pt.2. The psychology of speechreading and audiovisual speech (eds. R. Campbell, B. Dodd, D. Burnham). London, Taylor & Francis, Psychology Press, 1998, pp. 123–139.
27. Scherer K. R. What are emotions? And how can they be measured? Social Science Information, 2005, vol. 44, no. 4, pp. 693–727.
28. Penton-Voak I. S., Chen J. Y. High salivary testosterone is linked to masculine male facial appearance in humans. Evolution and Human Behavior, 2004, no. 25, pp. 229–241.
29. Pittam J., Scherer K. R. Vocal expression and communication of emotion. The handbook of emotions (eds. M. Lewis, J. Haviland), 1993, pp. 185–198.
30. Puts D. A., Gaulin S. J. C., Verdonili K. Dominance and the evolution of sexual dimorphism in human voice pitch. Evolution and Human Behavior, 2006, no. 27, pp. 283–296.
31. Scherer K. R., Scherer U., Hall J. A., Rosenthal R. Differential attribution of personality based on multi-channel presentation of verbal and nonverbal cues. Psychological Research, 1977, no. 39, pp. 221–247.
32. Scherer K. R. Vocal measurement of emotion. Emotion: Theory, research, and experience. Part 4. The measurement of emotion (eds. R. Plutchik, H. Kellerman), 1989, pp. 233–260.
33. Thornhill R., Gangestad S. W. Facial attractiveness. Trends in Cognitive Science, 1999, vol. 3, no. 12, pp. 452–460.
34. Thornhill R., Grammer K. The body and face of woman: One ornament that signals quality? Evolution and Human Behavior, 1999, vol. 20, no. 2, pp. 105–120.
35. Zuckerman M., Driver R. What sounds beautiful is good: the vocal attractiveness stereotype. Journal of Nonverbal Behavior, 1989, no. 13, pp. 67–82.