Eye Tracking Study of Visual Attention of Children with Hearing Impairments in a Learning Situation

Potential mechanisms underlying atypical joint attention that impede effective learning are analyzed using the example of the consequences of hearing impairment. A sample of preschool children with hearing impairment after cochlear implantation (sensorineural hearing loss, ICD-10 class H90) was studied. For the study, an experimental situation was created that would allow tracing the learning difficulties in children with hearing impairments associated with the skills of joint attention. In the course of completing a training task jointly with an adult in children with hearing impairment, eye movements were recorded with a portable tracker in the form of Pupil Headset glasses. In the course of the study, it was possible to identify and visualize markers of oculomotor activity that impede their effective learning: distribution of visual attention over a wide area of the visual field, not in a focused mode; in the trajectory of eye movements and the position of fixations, there is a preference for non-social signals, non-target objects, difficulties in switching attention from one object to another. The main manifestation of joint attention deficit in preschoolers with hearing impairment is a decrease in the volume and time of stable maintenance of synchronicity of perception in the learning process. The parameters of oculomotor activity can serve as an indicator of the ability of a child with a hearing impairment to maintain attention to the sample form and a diagnostic indicator of the possible number of errors in the learning process. Such indicators are the duration and number of fixations. The role of multimodal means of maintaining visual attention to the sample in the process of teaching children with hearing impairment is shown. It was revealed that the attention of a child with hearing impairment to the face of an adult is part of the joint attention to the object, which improves the effectiveness of learning and is associated with a longer visual attention to the object (teaching pattern).

1. Baron-Cohen S., Richler J., Bisarya D., Gurunathan N., Wheelwright S. The systemising quotient (SQ): An investigation of adults with Asperger syndrome or high-functioning autism, and normal sex differences. Philosophical Transactions of the Royal Society of London, Series B. 2003. Vol. 358. № 1430. 361—374.
2. Chen C.-h., Castellos I., Yu C. Effects of children’s hearing loss on the synchrony between parents’ object naming and children’s attention. Infant Behavior and Development. 2019. 57, e101322. DOI:10.1016/j.infbeh.2019.04.004
3. Chen C.-h., Castellos I., Yu C. What leads to coordinated attention in parent-toddler interactions? Children's hearing status matters. Development Sience. 2020. 23, no. 3, e12919. DOI:10.1111/desc.12919
4. Chen C.-h., Houston D. M., Yu C. Parent-Child Joint Behaviors in Novel Object Play Create High-Quality Data for Word Learning. Child Development. 2021. Vol. 92, 5, pp. 1889—1905. DOI:10.1111/cdev.13620
5. Dunn J., Brophy M. Communication, relationships, and individual differences in children's understanding of mind. In J.W. Astington & J.A. Baird (Eds.). Why language matters for theory of mind. New York, NY: Oxford University Press, 2005. Pp. 50—69.
6. Hobson R.P. What puts the jointness in joint attention? / Joint attention: Communication and other minds. (Ed.). J. Oxford: Oxford University Press, 2005. Рp. 185—204.
7. Monroy C., Houston D., Yu C. Joint Action in Deaf and Hearing Toddlers: A Mobile Eye-Tracking Study. Proceedings of the Annual Meeting of the Cognitive Science Society, Vol. 43, pp. 2794—2800. URL: https://escholarship.org/uc/item/77z4h6rx
8. Mundy P.A. Review of Joint Attention and Social-Cognitive Brain Systems in Typical Development and Autism Spectrum Disorder. European Journal of Neuroscience. 2017. 47, pp. 1—18.
9. Peterson C.C. Telling the story of theory of mind: Deaf and hearing children’s narrativesand mental state understanding. Slaughter British Journal of Developmental Psychology. 2006. 24, pp. 151—179.
10. Shvarts A., Abrahamson D. Dual-eye-tracking Vygotsky: A microgenetic account of a teaching/learning collaboration in an embodied-interaction technological tutorial for mathematics. Learning, Culture and Social Interaction. 2019. Vol. 22, pp. 100316. DOI:10.1016/j.lcsi.2019.05.003.
11. Townsend J., Courchesne E., Egaas B. Slowed orienting of covert visual-spatial attention in autism: Specific deficits associated with cerebellar and parietal abnormality. Development and Psychopathology. 1996. 8, no. 3, pp. 563—584.
12. Vuilleumier P. Perceived gaze direction in faces and spatial attention: A study in patients with parietal damage and unilateral neglect. Neuropsychologia. 2002. 40, pp. 1013—1026.
13. Wainwright J.A., Bryson S.E. Visual-spatial orienting in autism. Autism Development Disord. 1996. 26, pp. 423—438.
14. Williams J. Self-other relations in social development and autism: Multiple roles for mirror neurons and other brain bases. Autism Researc 2008. Vol. 1, pp. 73—90.
15. Yu C., Smith L.B. Hand—Eye Coordination Predicts Joint Attention. Child Development. 2017. 88, no. 6, pp. 2060—2078.