Emotional perception of multimodal and multivalent audiovisual stimuli

 
Audio is AI-generated
73

Abstract

Context and relevance. The article analyzes the characteristics of the emotional state of individuals who are exposed to external audiovisual stimuli. Objective. In particular, the peculiarities of the formation of subjective emotional images that arise as a result of the interaction of multimodal (sound, image) and multivalent (positive, negative valence) affective audiovisual stimuli from the international databases IAPS and IADS are studied. Methods and materials. Cognitive displays of affective stimuli were assessed using the standardized Self-Assessment Manikin (SAM) method of self-diagnosis of emotional reactions on three scales: valence, arousal and dominance. The results obtained are analyzed from the point of view of the theory of information images/representations. Conclusions. As a result, new patterns of influence of various combinations of multimodal and multivalent audiovisual stimuli on their initial individual emotional perception were identified.

General Information

Keywords: emotional perception, information images, audiovisual stimulus, IAPS, IADS, SAM

Journal rubric: Psychology of Perception

Article type: scientific article

DOI: https://doi.org/10.17759/exppsy.2025180202

Funding. The reported study was funded by Russian Science Foundation, project number 22-18-20075.

Received 10.04.2024

Accepted

Published

For citation: Petukhov, A.Yu., Polevaya, S.A., Loskot, I.V., Morozov, N.S., Krasnitskiy, N.V. (2025). Emotional perception of multimodal and multivalent audiovisual stimuli. Experimental Psychology (Russia), 18(2), 34–49. (In Russ.). https://doi.org/10.17759/exppsy.2025180202

© Petukhov A.Yu., Polevaya S.A., Loskot I.V., Morozov N.S., Krasnitskiy N.V., 2025

License: CC BY-NC 4.0

References

  1. Васанов, А.Ю., Марченко, О.П., Севостьянова, М.С. (2013). Подбор культурноспецифичных эмоционально окрашенных фотоизображений для экспериментальных исследований. Экспериментальная психология, 6(4), 105—114.
    Vasanov, A.Yu., Marchenko, O.P., Sevostyanova, M.S. (2013). Selection of culturally specific emotionally colored photographic images for experimental research. Experimental Psychology (Russia), 6(4), 105—114. (In Russ.).
  2. Павлов, С.В., Рева, Н.В., Локтев, К.В., Коренек, В.В., Афтанас, Л.Ю. (2015). Влияние практики медитации на сердечно-сосудистый ответ при восприятии и когнитивной переоценке эмоциогенных стимулов эмоций. Рос. физиол. журн. им. И.М. Сеченова, 101(3), 360—373.
    Pavlov, S.V., Reva, N.V., Loktev, K.V., Korenek, V.V., Aftanas, L.Yu. (2015). The influence of meditation practice on the cardiovascular response in perception and cognitive reassessment of emotionogenic stimuli of emotions. I.M. Sechenov Russian Journal of Physiology, 101(3), 360—373. (In Russ.).
  3. Полевая, С.А., Петухов, А.Ю. (2022). Измерение когнитивного потенциала на основе выполнения задач различного уровня сложности. Известия высших учебных заведений. Прикладная нелинейная динамика, 30(3), 311—321.
    Polevaya, S.A., Petukhov, A.Yu. (2022). Measuring cognitive potential based on the performance of tasks of varying levels of complexity. News of higher educational institutions. Applied nonlinear dynamics, 30(3), 311—321. (In Russ.).
  4. Lang, P.J., Bradley, M.M., Cuthbert, B.N. (1999). International affective picture system (IAPS): Instruction manual and affective ratings. Technical Report A-4. Gainesville, FL: The Center for Research in Psychophysiology, University of Florida.
  5. Lang, P.J., Bradley, M.M., Cuthbert, B.N. (2008). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-8. University of Florida, Gainesville, FL. Pp. 1—14.
  6. Petukhov, A.Yu., Polevaya, S.A. (2017). Modeling of cognitive brain activity through the Information Images Theory in terms of the bilingual Stroop test. International Journal of Biomathematics, 10(6), 1750092 (16 pages). https://doi.org/10.1142/S1793524517500929
  7. Petukhov, A.Yu., Petukhov, Yu.V. (2022). Model of cognitive activity of the human brain based on the mathematical apparatus of self-oscillating quantum mechanics. Mathematics, 10(22), 4215. https://doi.org/10.3390/math10224215
  8. Petukhov, A.Yu., Polevaya, S.A., Polevaya, A.V. (2022). Experimental Diagnostics of the Emotional State of Individuals Using External Stimuli and a Model of Neurocognitive Brain Activity. Diagnostics, 12, 125. https://doi.org/10.3390/diagnostics12010125
  9. Stevenson, R.A., James, T.W. (2008). Affective auditory stimuli: Characterization of the International Affective Digitized Sounds (IADS) by discrete emotional categories. Behavior Research Methods, 40, 315—321. https://doi.org/10.3758/BRM.40.1.315

Information About the Authors

Alexandr Y. Petukhov, Candidate of Science (Policy), Associate Professor, Director of Science, NEIMARK University, National Research Lobachevsky State University of Nizhny Novgorod, Nizhniy Novgorod, Russian Federation, ORCID: https://orcid.org/0000-0002-7412-5397, e-mail: lectorr@yandex.ru

Sofia A. Polevaya, Doctor of Biology, Professor, Head of the Department of Psychophysiology, National Research Lobachevsky State University of Nizhny Novgorod, NEIMARK University, Nizhniy Novgorod, Russian Federation, ORCID: https://orcid.org/0000-0002-3896-787X, e-mail: s453383@mail.ru

Ivan V. Loskot, Researcher, Postgraduate Student, National Research Lobachevsky State University of Nizhny Novgorod, NEIMARK University, Nizhniy Novgorod, Russian Federation, ORCID: https://orcid.org/0000-0002-4571-1637, e-mail: ivan@loskot.ru

Nikita S. Morozov, Candidate of Science (Engineering), Associate Professor, Senior Researcher, National Research Lobachevsky State University of Nizhny Novgorod, NEIMARK University, Nizhniy Novgorod, Russian Federation, ORCID: https://orcid.org/0009-0009-7293-5730, e-mail: nsmorozov@rf.unn.ru

Nikolay V. Krasnitskiy, Postgraduate Student, Lobachevsky State University of Nizhny Novgorod, NEIMARK University, Nizhniy Novgorod, Russian Federation, ORCID: https://orcid.org/0009-0000-0625-0535, e-mail: nvkrasnitskiy@gmail.com

Metrics

 Web Views

Whole time: 197
Previous month: 49
Current month: 5

 PDF Downloads

Whole time: 73
Previous month: 12
Current month: 9

 Total

Whole time: 270
Previous month: 61
Current month: 14