Flight crew diagnostic using aviation simulator training data

This paper describes a new concept of flight crew assessment based on flight simulators training result. It is based on representation of pilot gaze movement with the aid of continuous-time Markov processes with discrete states. Considered are both the procedure of model parameters identification provided with goodness-of-fit tests in use and the classifier-building technique, which makes it possible to estimate degree of correspondence between the observed gaze motion distribution under study and reference distributions identified for different diagnosed groups. The final assessing criterion is formed on the basis of integrated diagnostic parameters, which are determined by the parameters of the identified models. The article provides a description of the experiment, illustrations, and results of studies aimed at assessing the reliability of the developed models and criteria, as well as conclusions about the applicability of the approach, its advantages and disadvantages.

1. Barabanshchikov V.A. Vospriyatie individual’no-psikhologicheskikh osobennostei cheloveka po izobra- zheniyu tselogo i chastichno otkrytogo litsa [Perception of person’s psychological characteristics by the image of a partially or full open face]. Eksperimental’naya psikhologiya [Experimental Psychology (Russia)], 2008, vol. 1, no. 1, pp. 62–83 (In Russ.; abstr. in Engl.).
2. Barabanshchikov V.A. Okulomotornye struktury vospriyatiya [Oculomotor structures of perception]. Mos- cow, IP RAN, 1997. 384 p. (In Russ.).
3. Barabanshchikov V.A., Zhegallo A.V. Registratsiya i analiz napravlennosti vzora cheloveka [Registration and analysis of the human gaze direction]. Moscow, IP RAN, 2013. 316 p. (In Russ.).
4. Beregovoi G.T., Zavalova N.D., Lomov B.F., Ponomarenko V.A. Eksperimental’no-psikhologicheskie issledo- vaniya v aviatsii i kosmonavtike [Experimentally-psychological research in aviation and cosmonautics]. Mos- cow, Nauka, 1978. 303 p. (In Russ.).
5. Kim Dzh.O., M’yuller Ch. U., Klekka U. R.. Faktornyi, diskriminantnyi i klasternyi analiz [Factorial, dis- criminant and cluster analysis]. Moscow, Finansy i statistika, 1989. 215 p. (In Russ.).
6. Kramer G. Matematicheskie metody statistiki [Mathematical methods of statistics]. Moscow, Mir, 1976. 648 p. (In  Russ.).
7. Kuravskiy L.S., Yur’ev G.A. Veroyatnostnyi metod fil’tratsii artefaktov pri adaptivnom testirovanii [The probabilistic method of artifacts filtration in adaptive testing]. Eksperimental’naya psikhologiya [Experimen- tal Psychology (Russia)], 2012, vol. 5, no. 1, pp. 119–131 (In Russ.; abstr. in Engl.).
8. Kuravskiy L.S., Baranov S.N., Kornienko P.A. Obuchaemye mnogofaktornye seti Markova i ikh prim- enenie dlya issledovaniya psikhologicheskikh kharakteristik [Trained multivariate Markov networks and their application to the study of psychological characteristics]. Neirokomp’yutery: razrabotka i primenenie [Neurocomputers: development and application (Russia)], 2015a, no. 12, pp. 65–76 (In Russ.; abstr. in Engl.).
9. Kuravskiy L.S., Margolis A.A., Yur’ev G.A. Printsipy programmnoi realizatsii psikhologicheskogo tre- nazhera [The principles of psychological simulators software implementation]. Psikhologicheskaya nauka  i obrazovanie [Psychological Science and Education (Russia)], 2008, no. 5, pp. 182–188 (In Russ.; abstr. in  Engl.).
10. Kuravskiy L.S., Margolis A.A., Yur’ev G.A., Marmalyuk P.A. Kontseptsiya sistemy podderzhki prinyatiya reshenii dlya psikhologicheskogo testirovaniya [The concept of a decision support system for psychological testing]. Psikhologicheskaya nauka i obrazovanie [Psychological Science and Education (Russia)], 2012, no. 1, pp. 56–65. (In Russ.; abstr. in Engl.).
11. Kuravskiy L.S., Marmalyuk P.A., Alkhimov V.I., Yur’ev G.A. Matematicheskie osnovy novogo podkhoda k postroeniyu protsedur testirovaniya [Mathematical foundations of a new approach to the testing proce- dures construction]. Eksperimental’naya psikhologiya [Experimental Psychology (Russia)], 2012, vol. 5, no. 4, pp. 75–98 (In Russ.; abstr. in Engl.).
12. Kuravskiy L.S., Marmalyuk P.A., Barabanshchikov V.A., Bezrukikh M.M., Demidov A.A.,  Ivanov  V.V., Yur’ev G.A. Obuchaemye struktury kak osnova programmnogo obespecheniya dlya diagnostiki na- vykov i kompetentsii [Trained structures as a basis of software for diagnostic of skills and competencies]. Neirokomp’yutery: razrabotka i primenenie [Neurocomputers: development and application (Russia)], 2013, no. 5, pp. 46–60(In Russ.; abstr. in Engl.).
13. Kuravskiy L.S., Marmalyuk P.A., Yur’ev G.A., Baranov S.N., Poleshchuk G.N., Smirnov A.A., Shishov A.N. Diagnostika letnogo sostava po rezul’tatam raboty na aviatsionnykh trenazherakh [Diagnosis of flight crews on the results of operation at the flight simulator]. Neirokomp’yutery: razrabotka i primenenie [Neuro- computers: development and application (Russia)], no. 10, pp. 14–23. (In Russ.; abstr. in Engl.).
14. Kuravskiy L.S., Ushakov D.V., Marmalyuk P.A., Panfilova A.S. Issledovanie faktornykh vliyanii na raz- vitie psikhologicheskikh kharakteristik s primeneniem novogo podkhoda k otsenke adekvatnosti modelei nablyudeniyam [A study of factor influences on the psychological characteristics evolution with the new approach to assessing the model adequacy]. Informatsionnye tekhnologii [Information Technology (Russia)], 2011, no. 11, pp. 67–77 (In Russ.; abstr. in Engl.).
15. Kuravskiy L.S., Yur’ev G.A. Adaptivnoe testirovanie kak markovskii protsess: modeli i ikh identifikatsiya [Adaptivnoe testing as a Markov process: models and their identification]. Neirokomp’yutery: razrabotka i primenenie [Neurocomputers: development and application (Russia)], 2011, no. 2, pp. 21–29 (In Russ.; abstr. in  Engl.).
16. Kuravskiy L.S., Yur’ev G.A. Ispol’zovanie markovskikh modelei pri obrabotke rezul’tatov testirovaniya [Using a Markov models in the test results processing]. Voprosy psikhologii [Questions of psychology (Rus- sia)], 2011, no. 2, pp. 112–120 (In Russ.; abstr. in Engl.).
17. Leont’ev A.N. Kategoriya deyatel’nosti v sovremennoi psikhologii [The category of activity in modern psychology]. Voprosy psikhologii [Questions of psychology (Russia)], 1979, no. 3, pp. 11–15 (In Russ.; abstr. in  Engl.).
18. Lomov B.F. O sistemnom podkhode v psikhologii [On a systematic approach in psychology]. Voprosy psikhologii [Questions of psychology (Russia)], 1975, no. 2, pp. 31–45 (In Russ.; abstr. in Engl.).
19. Louli D., Maksvell A. Faktornyi analiz kak statisticheskii metod [Factor analysis as the statistical method]. Moscow, Mir, 1967. 144 p. (In Russ.).
20. Markovskie modeli v zadachakh diagnostiki i prognozirovaniya [Markov models in problems of diagnosis and prognosis]. Ed. L.S. Kuravskiy. Moscow, RUSAVIA, 2013. 172 p. (In Russ.).
21. Rukovodstvo po letnoi ekspluatatsii vertoleta Mi-8MTV [Flight Manual operation Mi-8 MTV]. Ministerstvo transporta RF. Moscow, 1994 (In Russ.).
22. Oboznov A.A. Psikhicheskaya regulyatsiya operatorskoi deyatel’nosti (v osobykh usloviyakh rabochei sredy) [Mental regulation of operator activity (in the special conditions of the working environment)]. Moscow, IP RAN, 2003. 184 p. (In Russ.).
23. Kuravsky L.S., Malykh S.B. Application of Markov models for analysis of development of psychological characteristics. Australian Journal of Educational & Developmental Psychology, 2004, vol. 2, pp. 29–40.
24. Kuravsky L. S., Malykh S.B. On the application of queuing theory to analysis of twin data. Twin Research, 2000, vol. 3, pp. 92–98.
25. Kuravsky L.S., Baranov S.N. The concept of multifactor Markov networks and its application to fore- casting and diagnostics of technical systems. In Proc. Condition Monitoring 2005, Cambridge, United King- dom, July 2005, pp. 111–117.
26. Kuravsky L.S., Marmalyuk P.A., Baranov S.N., Yuryev G.A. Monitoring of flight crew condition using oculomotor activity measurements. In Proc. 12th International Conference on Condition Monitoring & Ma- chinery Failure Prevention Technologies, Oxford, UK, 2015a, pp. 8.
27. Kuravsky L. S., Marmalyuk P. A., Yuryev G. A., Dumin P. N. A Numerical Technique for the Identifica- tion of Discrete-State Continuous-Time Markov Models. Applied Mathematical Sciences, 2015b, vol. 9, no. 8, pp. 379–391. doi: https://doi.org/10.12988/ams.2015.410882.
28. Kuravsky L. S., Marmalyuk P. A., Yuryev G. A., Dumin P. N., Panfilova A. S. Probabilistic Modeling of a Testing Procedure. Applied Mathematical Sciences, 2015c, vol. 9, no. 82, pp. 4053–4066. doi: http://dx.doi. org/10.12988/ams.2015.53234.
29. Kuravsky L. S., Marmalyuk P. A., Baranov S. N., Alkhimov V. I., Yuryev G. A., Artyukhina S.V. A New Technique for Testing Professional Skills and Competencies and Examples of its Practical Applications. Applied Mathematical Sciences, 2015d, vol. 9, no. 21, pp. 1003–1026. doi: https://doi.org/10.12988/ ams.2015.411899.
30. Kuravsky L. S., Marmalyuk P. A., Yuryev G. A., Belyaeva O. B., Prokopieva O. Yu. Mathematical Foun- dations of Flight Crew Diagnostics Based on Videooculography Data. Applied Mathematical Sciences, 2016, vol. 10, no. 30, pp. 1449–1466. doi: https://doi.org/10.12988/ams.2015.411899.