Principles of Developing a Software and Hardware Complex for Crew Intelligent Support and Training Level Assessment

Presented is a new approach to aircraft crew intelligent support, which is based on comparing flight fragments (maneuvers) under study with the relevant patterns contained in the database and representing the system “empirical intelligence”. Principal components of this approach are four new metrics for comparing flight fragments, viz.: the Euclidean metric in the space of wavelet coefficients; the likelihood metric of eigenvalue trajectories for transformations of activity parameters; the Kohonen metric in the space of wavelet coefficients; the likelihood metric for comparing gaze trajectories. Features of the presented approach are: the presence of an “intelligent component” that is contained in empirical data and can be flexibly changed as they accumulate; the use of integral comparisons of the flight fragments under study and video oculography data with relevant patterns of various types and performance quality from a specialized database, with transferring characteristics of the nearest pattern from this specialized database to the fragment under study; applying a complex combination of the methods for stochastic processes analysis and multivariate statistical techniques.

1. Aircraft trajectory clustering techniques using circular statistics. Yellowstone Conference Center, Big Sky, Montana, 2016. IEEE.
2. Bastani V., Marcenaro L., Regazzoni C. Unsupervised trajectory pattern classification using hi- erarchical Dirichlet Process Mixture hidden Markov model // 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP) / IEEE. 2014. Pp. 1–6.
3. Eerland W.J., Box S. Trajectory Clustering, Modelling and Selection with the focus on Airspace Protection // AIAA Infotech@ Aerospace. AIAA, 2016. Pp. 1–14.
4. Enriquez M. Identifying temporally persistent flows in the terminal airspace via spectral clus- tering // Tenth USA/Europe Air Traffic Management Research and Development Seminar (ATM2013) / Federal Aviation Administration (FAA) and EUROCONTROL. Chicago, IL, USA: 2013. June 10–13.
5. Enriquez M., Kurcz C. A Simple and Robust Flow Detection Algorithm Based on Spectral Clus- tering // International Conference on Research in Air Transportation (ICRAT) / Federal Aviation Administration (FAA) and EUROCONTROL. – Berkeley, CA, USA: 2012. May 22–25.
6. Faure C., Bardet J.M., Olteanu M., Lacaille J. Using Self-Organizing Maps for Clustering and Labelling Aircraft Engine Data Phases. In: WSOM (2017): 96–103.
7. Gaffney S., Smyth P. Joint probabilistic curve clustering and alignment // In Advances in Neural Information Processing Systems. Vol. 17. Cambridge, MA: MIT Press, 2005. Pp. 473–480.
8. Gaffney S., Smyth P. Trajectory clustering with mixtures of regression models // Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining. 1999. Pp. 63–72.
9. Gariel M., Srivastava A., Feron E. Trajectory clustering and an application to airspace monitoring // IEEE Transactions on Intelligent Transportation Systems. 2011. Vol. 12, no. 4. Pp. 1511–1524.
10. Grevtsov N. Synthesis of control algorithms for aircraft trajectories in time optimal climb and descent // Journal of Computer and Systems Sciences International. 2008. Vol. 47, no. 1. Pp. 129–138.
11. Kuravsky L.S. and Yuryev G.A. A novel approach for recognizing abnormal activities of op- erators of complex technical systems: three non-standard metrics for comparing performance patterns, International Journal of Advanced Research in Engineering and Technology (IJARET), 11(4), 2020, pp. 119–136. http://www.iaeme.com/IJARET/issues.asp?JType=IJARET&V- Type=11&IType=4
12. Kuravsky L.S., Yuryev G.A. Detecting Abnormal Activities of Operators of Complex Technical Systems and their Causes Basing on Wavelet Representations, International Journal of Civil En- gineering and Technology (IJCIET) 10(2), 2019, pp. 724–742. http://www.iaeme.com/IJCIET/ issues.asp?JType=IJCIET&VType=10&IType=2
13. Kuravsky L.S., Yuryev G.A., Zlatomrezhev V.I. New approaches for assessing the activities of operators of complex technical systems. Eksperimental’naya psikhologiya = Experimental psy- chology (Russia), 2019, vol. 12, no. 4, pp. 27–49. doi:10.17759/exppsy.2019120403.
14. Kuravsky L.S., Yuryev G.A., Zlatomrezhev V.I., Yuryeva N.E. Assessing the Aircraft Crew Ac- tions with the Aid of a Human Factor Risk Model. Eksperimental’naya psikhologiya = Experi- mental Psychology (Russia), 2020. Vol. 13, no. 2, pp. 153–181. DOI: https://doi.org/10.17759/ exppsy.2020130211.
15. Laxhammar R., Falkman G. Online learning and sequential anomaly detection in trajecto- ries // IEEE Transactions on Pattern Analysis and Machine Intelligence. 2014. Vol. 36, no. 6. Pp. 1158–1173.
16. Li Z., et al. Incremental clustering for trajectories // Database Systems for Advanced Applica- tions. Lecture Notes in Computer Science. 2010. Vol. 5982. Pp. 32–46.
17. Liu H., Li J. Unsupervised multi-target trajectory detection, learning and analysis in complicat- ed environments // 2012 21st International Conference on Pattern Recognition (ICPR) / IEEE. 2012. Pp. 3716–3720.
18. Rintoul M., Wilson A. Trajectory analysis via a geometric feature space approach // Statistical Analysis and Data Mining: The ASA Data Science Journal. 2015.
19. Wei J., et al. Design and Evaluation of a Dynamic Sectorization Algorithm for Terminal Air- space // Journal of Guidance, Control, and Dynamics. 2014. Vol. 37, no. 5. Pp. 1539–1555.
20. Wilson A., Rintoul M., Valicka C. Exploratory Trajectory Clustering with Distance Geometry // International Conference on Augmented Cognition /Springer. 2016. Pp. 263–274.
21. Research report “Development of mathematical models and methods for assessing the level of crew training based on the analysis of flight parameters received during flight exercises and video oculography data”, GosNIIAS, Moscow, 2020.