Emotional perception of multimodal and multivalent audiovisual stimuli

Context and relevance. The article analyzes the characteristics of the emotional state of individuals who are exposed to external audiovisual stimuli. Objective. In particular, the peculiarities of the formation of subjective emotional images that arise as a result of the interaction of multimodal (sound, image) and multivalent (positive, negative valence) affective audiovisual stimuli from the international databases IAPS and IADS are studied. Methods and materials. Cognitive displays of affective stimuli were assessed using the standardized Self-Assessment Manikin (SAM) method of self-diagnosis of emotional reactions on three scales: valence, arousal and dominance. The results obtained are analyzed from the point of view of the theory of information images/representations. Conclusions. As a result, new patterns of influence of various combinations of multimodal and multivalent audiovisual stimuli on their initial individual emotional perception were identified.

1. Васанов, А.Ю., Марченко, О.П., Севостьянова, М.С. (2013). Подбор культурноспецифичных эмоционально окрашенных фотоизображений для экспериментальных исследований. Экспериментальная психология, 6(4), 105—114.
   Vasanov, A.Yu., Marchenko, O.P., Sevostyanova, M.S. (2013). Selection of culturally specific emotionally colored photographic images for experimental research. Experimental Psychology (Russia), 6(4), 105—114. (In Russ.).
2. Павлов, С.В., Рева, Н.В., Локтев, К.В., Коренек, В.В., Афтанас, Л.Ю. (2015). Влияние практики медитации на сердечно-сосудистый ответ при восприятии и когнитивной переоценке эмоциогенных стимулов эмоций. Рос. физиол. журн. им. И.М. Сеченова, 101(3), 360—373.
   Pavlov, S.V., Reva, N.V., Loktev, K.V., Korenek, V.V., Aftanas, L.Yu. (2015). The influence of meditation practice on the cardiovascular response in perception and cognitive reassessment of emotionogenic stimuli of emotions. I.M. Sechenov Russian Journal of Physiology, 101(3), 360—373. (In Russ.).
3. Полевая, С.А., Петухов, А.Ю. (2022). Измерение когнитивного потенциала на основе выполнения задач различного уровня сложности. Известия высших учебных заведений. Прикладная нелинейная динамика, 30(3), 311—321.
   Polevaya, S.A., Petukhov, A.Yu. (2022). Measuring cognitive potential based on the performance of tasks of varying levels of complexity. News of higher educational institutions. Applied nonlinear dynamics, 30(3), 311—321. (In Russ.).
4. Lang, P.J., Bradley, M.M., Cuthbert, B.N. (1999). International affective picture system (IAPS): Instruction manual and affective ratings. Technical Report A-4. Gainesville, FL: The Center for Research in Psychophysiology, University of Florida.
5. Lang, P.J., Bradley, M.M., Cuthbert, B.N. (2008). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-8. University of Florida, Gainesville, FL. Pp. 1—14.
6. Petukhov, A.Yu., Polevaya, S.A. (2017). Modeling of cognitive brain activity through the Information Images Theory in terms of the bilingual Stroop test. International Journal of Biomathematics, 10(6), 1750092 (16 pages). https://doi.org/10.1142/S1793524517500929
7. Petukhov, A.Yu., Petukhov, Yu.V. (2022). Model of cognitive activity of the human brain based on the mathematical apparatus of self-oscillating quantum mechanics. Mathematics, 10(22), 4215. https://doi.org/10.3390/math10224215
8. Petukhov, A.Yu., Polevaya, S.A., Polevaya, A.V. (2022). Experimental Diagnostics of the Emotional State of Individuals Using External Stimuli and a Model of Neurocognitive Brain Activity. Diagnostics, 12, 125. https://doi.org/10.3390/diagnostics12010125
9. Stevenson, R.A., James, T.W. (2008). Affective auditory stimuli: Characterization of the International Affective Digitized Sounds (IADS) by discrete emotional categories. Behavior Research Methods, 40, 315—321. https://doi.org/10.3758/BRM.40.1.315