Russian Psychological Issues PsyJournals.ru
OPEN ACCESS JOURNALS
JournalsTopicsAuthorsEditor's Choice For AuthorsAbout PsyJournals.ruContact Us
Experimental Psychology (Russia) - №1 / 2021
Web of Science СС

  Previous issue (2020. Vol. 13, no. 4)

CrossRef

Experimental Psychology (Russia)

Publisher: Moscow State University of Psychology and Education

ISSN (printed version): 2072-7593

ISSN (online): 2311-7036

DOI: https://doi.org/10.17759/exppsy

License: CC BY-NC 4.0

Started in 2008

Published quarterly

Free of fees
Open Access Journal

 

Deepfake in Face Perception Research 93

|

Barabanschikov V.A.
Doctor of Psychology, Professor, Corresponding Member of Russian Academy of Education, Director, Institute of Experimental Psychology, Moscow State University of Psychology & Education, Moscow, Russia
ORCID: https://orcid.org/0000-0002-5084-0513
e-mail: vladimir.barabanschikov@gmail.com

Marinova M.M.
Assistant Director of the Institute of Experimental Psychology, Moscow Institute of Psychoanalysis, Moscow, Russia
ORCID: https://orcid.org/0000-0002-8862-4007
e-mail: marinovamm@yandex.ru

Abstract
A state-of-the-art method of collaging images with face replacement Deepfake is described, which is a product of artificial intelligence (AI) and neural network technologies that can be used to create high-quality realistic videos with a fake or replaced face without obvious traces of manipulation. Based on the DeepFaceLab (DFL) application, the process of creating video images of an “impossible face” is described step by step. The results of the experiments of studying the perception patterns of the moving “impossible face” and their differences in statics and dynamics are presented. The stimuli were two DFL-generated models of virtual sitters with impossible faces: a video image of a chimerical face, in which the right and left sides belong to different people, and a Tatchered face with the eyes and mouth areas rotated by 180°. It was shown that the phenomena of perception of the “impossible face”, registered earlier under static conditions (integrity of perception of the split image, distraction and inversion effect), are preserved and acquire a new content when dynamic models are exposed. In contrast to the collaged images, the original faces in statics and motion, regardless of egocentric orientation, are evaluated positively at the level of high values. Under all tested conditions the gender of the virtual sitter is determined adequately, the perceived age is overestimated. Estimates of the virtual sitter’s emotions from his video images are differentiated into basic (stable) and additional (changing) states, the ratio of which depends on the content of a particular episode. Deepfake image synthesis technology significantly expands the possibilities of psychological research of interpersonal perception. The use of digital technologies simplifies the creation of “impossible face” stimulus models necessary for in-depth study of representations of the human inner world, and creates a need for new experimental-psychological procedures corresponding to a higher level of ecological and social validity.

Keywords: IT-Deepfake, DeepFaceLab, interpersonal perception, video facial imaging, impossible face, virtual sitter, dynamic and static facial expressions, chimeric face, tethered face, perceptual integrity, dynamic distractor, inversion effect, facial attractiveness, basic emotional expressions

DOI: https://doi.org/10.17759/exppsy.2021000001

For Reference

Funding

The research was performed within the framework of the state order of the Ministry of Education of the Russian Federation №730000Ф.99.1.БВ09АА00006.

References
  1. Barabanschikov V.A. Ehkspressii litsa i ikh vospriyatie. M.: Institut psikhologii RAN, 2012. (In Russ.).
  2. Barabanschikov V.A. (otv. red.) Kognitivnye mekhanizmy neverbal’noi kommunikatsii. M.: Kogito- Tsentr, 2017. (In Russ.).
  3. Barabanschikov V.A., Korol’kova O.A. Vospriyatie ehkspressii «Zhivogo» litsa // Ehksperimental’naya psikhologiya. 2020. T. 13. N. 3. P. 55—73. http://doi.org/10.17759/exppsy.2020130305 (In Russ.).
  4. Barabanschikov V.A., Marinova M.M. Vosprinimaemye kachestva i otsenka ehkspressii podvizhnogo khimericheskogo litsa. Litso cheloveka v kontekstakh prirody, tekhnologii i kul’tury / Otv. red. K.I. Anan’eva, V.A. Barabanshchikov, A.A. Demidov. M.: Moskovskii institut psikhoanaliza, Kogito-Tsentr, 2020. (In Russ.). (V pechati).
  5. Barabanschikov V.A., Marinova M.M. Vospriyatie videoizobrazhenii khimericheskogo litsa // Poznanie i perezhivanie. 2020. T. 1. № 1. P. 85—105. (In Russ.).
  6. Barabanschikov V.A., Marinova M.M., Abramov A.D. Virtual’naya lichnost’ tehtcherizirovannogo litsa v statike i dinamike // Pod red. V.A. Barabanshchikova, V.V. Selivanova Ehksperimental’naya psikhologiya v sotsial’nykh praktikakh: materialy konferentsii. M.: Universum, 2020. P. 7—16. (In Russ.).
  7. Barabanschikov V.A., Marinova M.M., Abramov A.D. Illyuziya Margaret Tehtcher na podvizhnom litse / Sbornik materialov ezhegodnoi konferentsii po kognitivnoi nauke, posvyashchennoi pamyati Dzh.S. Brunera, «Psikhologiya poznaniya: nizkourovnevye i vysokourovnevye protsessY», 2021 god, g. Yaroslavl’. (In Russ.). (V pechati).
  8. DeepFaceLab: instrument dlya generatsii dipfeikov // https://neurohive.io/ URL: https://neurohive.io/ru/ frameworki/deepfacelab-instrument-dlya-generacii-dipfejkov/ (data obrashcheniya: 30.11.2020). (In Russ.).
  9. Chawla R. Deepfakes: How a pervert shook the world. // International Journal of Advance Research and Development. 2019. Vol. 4, N. 6, P. 4—8.
  10. Demuthova S., Démuth A. Handedness and the Preference of the Visual Field in Face Perception. // European Scientific Journal. 2018. http://doi.org/10.19044/esj.2018.c3p8.
  11. Dole M., Méary D., Pascalis O. Modifications of Visual Field Asymmetries for Face Categorization in Early Deaf Adults: A Study With Chimeric Faces. Front. Psychol. 2017.Vol. 8, P. 30. http://doi. org/10.3389/fpsyg.2017.00030
  12. Maras M., Alexandrou A. Determining Authenticity of Video Evidence in the Age of Artificial Intelligence and in the Wake of Deepfake Videos. // International Journal of Evidence and Proof. 2018.Vol. 23. P. 255— 262. http://doi.org/10.1177/1365712718807226.
  13. Perov I., Gao D., Chervoniy N., Liu K., et al. // DeepFaceLab: A simple, flexible and extensible face swapping framework. 2020. https://arxiv.org/ URL: https://arxiv.org/pdf/2005.05535.pdf (дата обращения: 13.10.2020).
  14. Stephanie S.A. H. Blom, Henk Aarts & Gün R. Semin. Lateralization of facial emotion processing and facial mimicry. // Laterality. 2020. Vol. 25 N. 3, P. 259—274 http://doi.org/10.1080/1357650X.2019.1657127
  15. Thompson P. Margaret Thatcher: A new illusion // Perception. 1980. Vol. 9, P. 483—484. https://doi. org/10.1068/p090483
  16. Weibert K., Müller V., Sänger J. Familiarity abolishes right-hemispheric bias in face perception. // Journal of Vision. 2017. Vol. 17. N. 10, P. 998. http://doi.org/10.1167/17.10.998
  17. Westerlund M. The Emergence of Deepfake Technology: A Review // Technology Innovation Management Review. 2019.Vol. 9, N. 11, P. 39—52. http://doi.org/10.22215/timreview/12
  18. Williams L.R., Grealy M.A., Kelly S.W., Henderson I., Butler S.H. Perceptual bias, more than age, impacts on eye movements during face processing. Acta Psychol (Amst). Publisher. 2016. Vol. 164, P. 127—135. http://doi.org/10.1016/j.actpsy.2015.12.012
 
About PsyJournals.ru

© 2007–2021 Portal of Russian Psychological Publications. All rights reserved

PsyJournals.ru in Russian

Publisher: Moscow State University of Psychology and Education

Catalogue of academic journals in psychology & education MSUPE

Creative Commons License Open Access Repository     Webometrics Ranking of Repositories

RSS Psyjournals at facebook Psyjournals at Twitter Psyjournals at Youtube ??????.???????