Eyetracking technology usage in cognitive experience preservation and transferring task

569

Abstract

The article discusses the possibility of using eyetracking technology when solving the problem of preserving and transmitting cognitive experience. Video recording of the process for which this task is being solved may contain key elements, the control and management of dynamic properties of which are essential components of cognitive experience. In the example with the “invisible gorilla”, intentionally incorrectly instruction leads to the fact that the essential characteristics of the system are not detected by the observers. Registration of eye movements of an expert, who transmits cognitive experience, performed in addition to the procedure of cooperative debriefing, makes it possible to identify such key elements and their dynamic patterns. In the future, based on the analysis performed, it is possible to create training programs for cognitive experience transfer systems.

General Information

Keywords: cognitive experience, communication, object tracking, eyetracking, cooperative debriefing

Journal rubric: Research Methods

Article type: scientific article

DOI: https://doi.org/10.17759/exppsy.2018110412

Funding. The study was carried out within the framework of the state project of the Ministry of Education and Science of the Russian Federation, project 25.3471.2017/PC “Identification of significant components of the cognitive experience of a specialist to their capturing and transfer”.

For citation: Zhegallo A.V. Eyetracking technology usage in cognitive experience preservation and transferring task. Eksperimental'naâ psihologiâ = Experimental Psychology (Russia), 2018. Vol. 11, no. 4, pp. 135–141. DOI: 10.17759/exppsy.2018110412. (In Russ., аbstr. in Engl.)

References

  1. Barabanshchikov V.A. Ekspressii lica i ih vospriatie [Facial expressions and their perception]. Moscow, Institut psikhologii RAN. Publ., 2012 (In Russ.).
  2. Barabanshchikov V.A., Zhegallo A.V., Okulomotornaia aktivnost’ pri vospriatii dinamiceskih i staticeskih vyrazenij lica [Oculomotor activity in the perception of dynamic and static facial expressions]. Eksperimental’naya psihologiya [Experimental Psychology], 2018. Vol. 11, no. 1, pp. 5—34. (In Russ., аbstr. in Engl.).
  3. Cox M., Nuevo-Chiquero J., Saragih J.M., Lucey S. CSIRO Face Analysis SDK. 10th IEEE International Conference on Automatic Face and Gesture Recognition. Shangai. China, 2013.
  4. Hayes T.R., Henderson J.M. Scan patterns during real-world scene viewing predict individual differences in cognitive capacity. Journal of Vision. 2017. Vol. 17, No 5, pp. 1—17.
  5. Henderson J.M., Hayes T.R. Meaning guides attention in real-world scene images: Evidence from eye movements and meaning maps. Journal of Vision. 2018. Vol. 18, No 6, pp. 1—18.
  6. Janku P., Koplik K., Dulik T., Szabo I. Comparison of tracking algorithms implemented in OpenCV. MATEC Web Conf, 2016. Vol. 76; 20th International Conference on Circuits, Systems, Communications and Computers (CSCC 2016); Article Number 04031.
  7. Lahlou S., Nosulenko V., Samoylenko E. Numériser le travail. Théories, méthodes, expérimentations. Paris: Lavoisier, 2012. 328 p.
  8. Le Bellu S., Lahlou S., Nosulenko V., Samoylenko E. Studying activity in manual work: A framework for analysis and training. Le Travail Humain. 2016. Vol. 79, N1, pp. 7—29.
  9. Lobodinskaya E.A., Nosulenko V.N. Verbal’nye dannye v kolichestvennoj otsenke sposobov predyavlenia visual’nykh ob’ektov [Verbal data in a quantitative assessment of ways of presenting visual objects]. Eksperimental’naya psihologiya [Experimental Psychology], 2018. Vol. 11, no. 4, pp. 39—49. (In Russ., аbstr. in Engl.).
  10. Nosulenko V.N., Samoylenko E.S. Polipozitcionnoe nabludenie [Poly-positional observation]. In: V. Nosulenko (Ed.) Tekhnologii sokhraneniya I vosproizvedeniya kognitivnogo opyta [Technologies of capturing and reproduction of cognitive experience]. Moscow, Institut psikhologii RAN Publ., 2016a. P. 261—278. (In Russ.).
  11. Ognev A.S., Lihacheva E.V., Melnikova D.V. Perspektivy ispol’zovania mnogopoliarnyh semanticheskih differencialov v ajtrekinge [Prospects for the use of multipolar semantic differentials in aytreking]. Uspehi sovremennogo estestvoznania [Successes of modern science], 2015, No 1 (pt 5). pp. 858—862. (In Russ.).
  12. Podladchikova L.N., Shaposhnikov D.G., Tikidgji-Hamburyan A.V., Koltunova T.I., Tikidgji- Hamburyan R.A., Gusakova V.I., Golovan A.V. Model-Based Approach to Study of Mechanisms of Complex Image Viewing. Optical Memory and Neural Networks (Information Optics), 2009, Vol. 18, No. 2, pp. 114—121.
  13. Simons D.J., Chabris C.F. Gorillas in our midst: sustained inattentional blindness for dynamic events. Perception. 1999. V. 28. pp. 1059—1074.
  14. Smith T., Mital P. Attentional synchrony and the influence of viewing task on gaze behavior in static and dynamic scenes. Journal of Vision. 2013. V. 13. No 8. pp. 1—24.
  15. Streitz N., Prante Th., Röcker C., Alphen D. van, Stenzel R., Magerkurth C., Lahlou S., Nosulenko V., Jegou F., Sonder F., Plewe D. Smart Artefacts as Affordances for Awareness in Distributed Teams. N. Streitz, A. Kameas, I. Mavrommati (Eds.) The Disappearing Computer. Springer, Heidelberg. Lecture Notes in Computer Science, 2007, Vol. 4500. pp. 3—29.
  16. Unema P., Pannasch S., Joos M., Velichkovsky B. Time cource of information processing during scene perception: The relationship between saccade amplitude and fixation duration. Visual Cognition, 2005, Vol. 12. pp. 473—494.
  17. Yarbus A.L. Rol’ dvizhenij glaz v protsesse zreniya [The role of eye movements in the process of vision]. Moscow, “Nauka” publ. 1965. (In Russ.).
  18. Zhegallo A.V. Raspoznavanie perifericeski eksponiruemyh emocional’nyh ekspressij [Recognition of peripherally exposed emotional expressions]. Eksperimental’naya psihologiya [Experimental Psychology], 2018. Vol. 11, no. 2, pp. 16—33. (In Russ., аbstr. in Engl.).

Information About the Authors

Alexander V. Zhegallo, PhD in Psychology, Senior Researcher at the Laboratory of Systems Research of the Psyche, Institute of Psychology of the Russian Academy of Sciences, Researcher at the Center for Experimental Psychology of MSUPE, Moscow, Russia, ORCID: https://orcid.org/0000-0002-5307-0083, e-mail: zhegalloav@ipran.ru

Metrics

Views

Total: 1399
Previous month: 14
Current month: 4

Downloads

Total: 569
Previous month: 4
Current month: 8