Cyberpsychological Approach to the Analysis of Multisensory Integration

The paper relates to the branch of cyberpsychology associated with risk factors during immersion in a virtual environment. Specialists in the development and operation of virtual reality systems know that immersion into this environment may be accompanied by symptoms similar to the “motion sickness” of transport vehicle passengers (ships, aircraft, cars). In the paper, these conditions are referred to as a cybersickness (or, cyberdisease). The three leading theories, proposed as an explanation of the causes of cybersickness, are discussed: the theory of sensory conflict, the theory of postural instability (the inability to maintain equilibrium), and the evolutionary (aka toxin) theory. A frequent occurrence of symptoms of cybersickness is a conflict between visual signals and signals from the vestibular system. It is shown that such conflicts can be stimulated in the framework of a specially organized experiment (e.g., the illusion of out-of-body experience) using virtual reality systems. When competing signals (visual, auditory, kinesthetic, tactile, etc.) reach the brain, the data gained with the use of virtual reality systems give a chance to hypothetically determine the localization of the specific area in the brain that ensures the integration of multisensory stimuli.

1. Averbukh N.V. Psikhologicheskie aspekty fenomena prisutstviya v virtual’noi srede [Psychological aspects of presence in virtual environment]. Voprosy Psikhologii, 2010, no. 5, pp. 105—113.
2. Belinskaya E.P. Psikhologiya Internet-kommunikatsii [Psychology of communication via the Internet]. Moscow; Voronezh: MPSU; Modek, 2013. 188 p.
3. Velichkovskii B.B., Gusev A.N., Vinogradova V.F., et al. Kognitivnyi kontrol’ i chuvstvo prisutstviya v virtual’nykh sredakh [Cognitive control and presence in virtual environments]. Eksperimental’naya psikhologiya [Experimental Psychology], 2016. Vol. 9 (1), pp. 5—20. doi:10.17759/exppsy.2016090102. (In Russ., abstr. in Engl.).
4. Voiskunskii A.E. Sotsial’naya pertseptsiya v sotsial’nykh setyakh [Social perception in social networks]. Vestnik Moskovskogo universiteta. Seriya 14. Psikhologiya [Moscow University Psychology Bulletin], 2014, no. 2, pp. 90—104.
5. Voiskunskii A.E. Povedenie v kiberprostranstve: psikhologicheskie printsipy [Behavior in cyberspace: psychological principles]. Chelovek [The Human Being], 2016, no. 1, pp. 36—49.
6. Voiskunskii A.E. Raspredelennost’ sodeistviya v informatsionnom obshchestve [Dispersed cooperation in information society]. Gosudarstvo i grazhdane v elektronnoi srede. Vypusk 1. Trudy XX Mezhdunarodnoi ob”edinennoi konferentsii “Internet i sovremennoe obshchestvo” (g. Sankt-Peterburg, 21—23 iyunya 2017 g.) [Government and Citizens in E-Environments. Issue 1. Proceedings of the International Integrated Conference “The Internet and Modern Society”]. Saint Petersburg: Universitet ITMO, 2017, pp. 308—314.
7. Voiskunskii A.E., Ignat’ev M.B. Perspektivy razvitiya setevogo intellekta [Perspective of development of the network intelligence]. In Slavin B.B. (ed.). Rozhdenie kollektivnogo razuma: O novykh zakonakh setevogo sotsiuma i setevoi ekonomiki i ob ikh vliyanii na povedenie cheloveka [The Birth of Collective Intelligence: On New Laws of Network Society and Its Influence on Human Behavior]. Moscow: LENAND, 2013, pp. 263—283.
8. Voiskunskii A.E., Men’shikova G.Ya. O primenenii sistem virtual’noi real’nosti v psikhologii [On the use of VR systems in psychology]. Vestnik Moskovskogo universiteta. Seriya 14. Psikhologiya [Moscow University Psychology Bulletin], 2008, no. 1, pp. 22—36.
9. Gazzaley A., Rosen L.D. Rasseyannyi um. Kak nashemu drevnemu mozgu vyzhit’ v mire noveishikh tsifrovykh tekhnologii [The Distracted Mind: Ancient Brains in a High-Tech World]. Moscow: Eksmo, 2019. 416 p. (In Russ.).
10. Kovalev A.I., Men’shikova G.Ya., Klimova O.A., et al.. Soderzhanie professional’noi deyatel’nosti kak faktor uspeshnosti primeneniya tekhnologii virtual’noi real’nosti [The meaning of professional work as a factor of positive use of VR technologies]. Eksperimental’naya psikhologiya [Experimental Psychology], 2015. Vol. 8 (2), pp. 45— 59. doi:10.17759/exppsy.2015080205. (In Russ., abstr. in Engl.).
11. Lanier J. Na zare novoi ery: Avtobiografiya “ottsa” virtual’noi real’nosti [Dawn of the new everything. Encounters with reality and virtual reality.]. Moscow: Eksmo. 2019. 496 p. (In Russ.).
12. Leont’ev A.N. Problemy razvitiya psikhiki [Issues of the Development of Psyche]. Moscow: MSU Publ., 1972. 575 p.
13. Men’shikova G.Ya., Savel’eva O.A., Kovyazina M.S. Otsenka uspeshnosti vosproizvedeniya egotsentricheskikh i allotsentricheskikh prostranstvennykh reprezentatsii pri ispol’zovanii sistem virtual’noi real’nosti [Assessment of the success of reproduction of egocentric and allocentric space representations when VR systems are used]. Natsional’nyi psikhologicheskii zhurnal [National Psychological Journal], 2018, no. 2 (30), pp. 113—122. doi:10.11621/npj.2018.0212
14. Perepelkina O.S., Arina G.A., Nikolaeva V.V. Telesnye illyuzii: fenomenologiya, mekhanizmy, eksperimental’nye modeli [Elektronnyi resurs] [Body illusions: phenomenology, mechanisms, experimental models]. Psikhologicheskie issledovaniya [Psychological Studies], 2014. Vol. 7 (38). Available at: http://psystudy.ru/index.php/ num/2014v7n38/1068-perepelkina38.html (Accessed 18.05.2019).
15. Selivanov V.V., Selivanova L.N. Virtual’naya real’nost’ kak metod i sredstvo obucheniya [VR as a method and means of education]. Obrazovatel’nye tekhnologii i obshchestvo [Educational Technologies and Society], 2014. Vol. 17 (3), pp. 378—391.
16. Selivanov V.V., Selivanova L.N. Vliyanie raboty v virtual’noi real’nosti na poznavatel’nye protsessy i lichnostnye osobennosti sub”ekta [The influence of the work with VR on human cognitive processes]. Psikhologiya kognitivnykh protsessov [The Psychology of Cognitive Processes], 2017, no. 3, pp. 64—76.
17. Smyslova O.V., Voiskunskii A.E. Kiberzabolevanie v sistemakh virtual’noi real’nosti: fenomenologiya i metody izmereniya [Cybersickness in the VR systems use: phenomenology and methods of measurement]. Psikhologicheskii Zhurnal, 2019. Vol. 40 (4), pp. 85—94.
18. Soldatova G.U., Rasskazova E.I., Nestik T.A. Tsifrovoe pokolenie Rossii: kompetentnost’ i bezopasnost’ [Digital Generation in Russia: Competence and Safety]. Moscow: Smysl, 2017. 375 p.
19. Spitzer M. Antimozg: tsifrovye tekhnologii i mozg [Digital Dementia: What We and Our Children are Doing to our Minds]. Moscow: AST, 2014. 288 p. (In Russ.).
20. Brechet L., Grivaz P., Gauthier B., et al. Common recruitment of angular gyrus in episodic autobiographical memory and bodily self-consciousness [Elektronnyi resurs]. Frontiers in Behavioral Neuroscience, 2018. Vol. 12. Available at: https://www. frontiersin.org/articles/10.3389/fnbeh.2018.00270/full (Accessed 19.05.2019). doi:10.3389/fnbeh.2018.00270
21. Ersson H.H. The experimental induction of out-of-body experiences. Science, 2007. Vol. 317 (5841), p. 1048. doi:10.1126/science.1142175
22. Haans A., IJsselsteijn W. Mediated social touch: A review of current research and future directions. Virtual Reality, 2006. Vol. 9 (2—3), pp. 149—159. doi:10.1007/ s10055-005-0014-2
23. Limanowski J. What can body ownership illusion tell us about minimal phenomenal selfhood? [Elektronnyi resurs]. Frontiers in Human Neuroscience, 2014. Vol. 8. Available at: https://www.frontiersin.org/articles/10.3389/fnhum.2014.00946/full (Accessed 15.05.2019). doi:10.3389/fnhum.2014.00946
24. Petkova V.I., Ehrsson H.H. If I Were You: Perceptual Illusion of Body Swapping [Elektronnyi resurs]. PLoS ONE, 2008. Vol. 3 (12). Available at: https://journals. plos.org/plosone/article?id=10.1371/journal.pone.0003832 (Accessed 19.05.2019). doi:10.1371/journal.pone.0003832
25. Smith A.M., Messier C. Voluntary out-of-body experience: an fMRI study [Elektronnyi resurs]. Frontiers in Human Neuroscience, 2014. Vol. 8. Available at: https://www.frontiersin.org/articles/10.3389/fnhum.2014.00070/full (Accessed 18.05.2019). doi:10.3389/fnhum.2014.00070