Analysis the Possibilities of the Computerized Adaptive Approach to the Problems of Psychological Diagnostics and Training

The article discusses the advantages and prospects for the implementation of an adaptive approach in the tasks of computerized ability testing, standardization of diagnostic methods and development of simulators for teaching professional skills in the zone of proximal development (development of "soft skills" and "hard skills"). The results of the analysis of the reliability of tests using an adaptive approach and comparison of the obtained results with the classical paper and computer form of ability diagnostics are presented. An assessment of the effectiveness and advantages of this approach to determining the level of complexity of test items using the method of convolution of applied Markov models into quantum representations is presented. The effectiveness of the method on small samples has been proved.

1. Anastazi A., Urbina S. Psikhologicheskoe testirovanie [Psychological testing]. 7-e izd. SPb.: Piter, 2005. 688 p. (In Russ.).
2. Brazhnikova A.N. Ob ispol'zovanii imitatsionnoi igry v izuchenii kursa «Psikhologiya nravstvennosti professionala» [On Using Imitation Games in the Course «Psychology of Professional’s Morality»]. Izvestiya RGPU im. A.I. Gertsena, 2011. No. 129. URL: https://cyberleninka.ru/article/n/ob-ispolzovanii-imitatsionnoy-igry-v-izuchenii-kursa-psihologiya-nravstvennosti-professionala (Accessed 13.02.2023). (In Russ.).
3. Butovskaya A.A. Povyshenie kachestva obrazovatel''nogo protsessa SPO s premeniem algoritmov adaptatsii [Improving the quality of the educational process of secondary vocational education with the use of adaptation algorithms]. Krasnoyarsk: Sibirskii federal'nyi universitet = Siberian Federal University, 2016. (In Russ.).
4. Volkova T.I., Mal'tsev D.V., Gilev A.Yu. Metodika i tekhnologiya organizatsii adaptivnogo komp'yuternogo testirovaniya [Methods and Tecnology for Computer Adaptive Testing]. Uspehi sovremennoj nauki i obrazovanija, 2016. Vol. 1, no. 11, pp. 89—90. (In Russ.).
5. Kim V.S. Testirovanie uchebnykh dostizhenii. Monografiya [Testing of educational achievements. Monograph]. Ussuriisk: Izdatel'stvo UGPI =Ussuriysk: UGPI Publishing House, 2007. 214 p. URL: http://www.uspi.ru/static/kim_testing_monograph/ (Accessed 02.03.2023). (In Russ.).
6. Kolyada M.G., Bugaeva T.I., Miklashevich N.V. Adaptivnoe testirovanie s vozmozhnostyami iskusstvennogo intellekta [Adaptive Testing Based on Artificial Intelligence Capabilities]. MOO «Akademiya informatizatsii obrazovaniya» = IPO "Academy of Informatization of Education". Orel: Izd. OGU im. I.S. Turgeneva, 2020. pp. 265—273. (In Russ.).
7. Korsini R., Auerbakh A. Psikhologicheskaya entsiklopediya [Psychological Encyclopeia]. SPb: «Piter», 2006. P. 1876. (In Russ.).
8. Krasnoshchechenko I.P. Delovaya igra «Modelirovanie professional'noi deyatel'nosti psikhologa» v sisteme psikhologo-pedagogicheskogo soprovozhdeniya adaptatsii studentov-psikhologov [Business game "Modeling the professional activity of a psychologist" in the system of psychological and pedagogical support for the adaptation of psychology students]. Aktual'nye problemy teoreticheskoi i prikladnoi psikhologii / Materialy Vserossiiskoi nauchno-prakticheskoi konferentsii = Actual problems of theoretical and applied psychology / Proceedings of the All-Russian Scientific and Practical Conference. Yaroslavl', 2012. pp. 270—272. (In Russ.).
9. Krechetov I.A., Dorofeeva M.Yu., Degtyarev A.V. Raskryvaem potentsial adaptivnogo obucheniya: ot razrabotki do vnedreniya [Implementing the Adaptive Learning Techniques]. Materialy Mezhd. Konferentsii = Materials of the International Conference «eLearning Stakeholders and Re-searchers Summit 2018». M: Izd. dom HSE, 2018. Pp. 76—85. URL: https://estars.hse.ru/mirror/pubs/share/229213957 (Accessed 10.02.2023). (In Russ.).
10. Kuravskii L.S., Artemenkov S.L., Yur'ev G.A., Grigorenko E.L. A new approach to computerized adaptive testing. Eksperimental'naya psikhologiya = Experimental Psychology, 2017. Vol. 10, no. 3, pp. 33—45. (In Russ.).
11. Kuravskii L.S., Margolis A.A., Marmalyuk P.A., Panfilova A.S., Yur'ev G.A. Matematicheskie aspekty kontseptsii adaptivnogo trenazhera [Mathematical aspects of the adaptive simulator concept]. Psikhologicheskaya nauka i obrazovanie = Psychological Science and Education, 2016. Vol. 21, no. 2, pp. 84—95. (In Russ.).
12. Kuravskii L.S., Margolis A.A., Yur'ev G.A., Pominov D.A. Kontseptsiya samoobuchayushchegosya adaptivnogo trenazhera [The Concept of a Self-Learning Adaptive Trainer]. Neirokomp'yutery: razrabotka i primenenie = Neurocomputers: Development, Application, 2018. No. 3, pp. 29—37. (In Russ.).
13. Kuravskii L.S., Pominov D.A., Yur'ev G.A., Yur'eva N.E., Safronova M.A., Kulanin E.D., Antipova S.N. The Concept of an Adaptive Trainer and Assessing Its Effectiveness in a Mathematical Application. Modelirovanie i analiz dannykh = Modelling and Data Analysis, 2021. Vol. 11, no. 4, pp. 5—20. DOI:10.17759/mda.2021110401 (In Russ.).
14. Kuravskii L.S., Yur'ev G.A., Yur'eva N.E., Isakov S.S. Adaptivnaya tekhnologiya psikhologicheskoi diagnostiki na osnove markovskikh i kvantovykh predstavlenii protsessa vypolneniya zadanii [Adaptive Technology of Psychological Diagnostics Based on the Markovian and Quantum Representations of the Task Performing Process]. Modelirovanie i analiz dannykh = Modelling and Data Analysis, 2022. Vol. 12, no. 4. (In Russ.).
15. Kuravskii L.S., Yur'eva N.E., Yur'ev G.A., Ermakov S.S., Isakov S.S., Levonovich N.I., Nesimova A.O., Nikolaev I.A. Razrabotka informatsionnoi sistemy dlya psikhologicheskoi diagnostiki s ispol'zovaniem elementov iskusstvennogo intellekta [Development of an information system for psychological diagnostics using elements of artificial intelligence].Gosudarstvennoe zadanie Ministerstva prosveshcheniya Rossiiskoi Federatsii = State publication of the Ministry of Education of the Russian Federation, № 073-00110-22-06, 12.12.2022. (In Russ.).
16. Likhtenval'd E.K. Model' generatsii adaptivnykh testov po urovnyu ikh slozhnosti [Model of Generation of Adaptive Tests by Level of Their Complexity]. Vestnik KGPU im. V.P. Astaf'eva = Bulletin of the KSPU V.P. Astafieva, 2012. No. 2. URL: https://cyberleninka.ru/article/n/model-generatsii-adaptivnyh-testov-po-urovnyu-ih-slozhnosti (Accessed 10.02.2023). (In Russ.).
17. Osipov G.V. Rossiiskaya sotsiologicheskaya entsiklopediya [Russian sociological encyclopedia]. М: Izdatel'skaya gruppa NORMA—INFRA M = Publishing group NORMA-INFRA M, 1998. 672 p. (In Russ.).
18. Otrokov D.A., Veksler V.A. Adaptivnoe testirovanie, kak vid ob"ektivnogo kontrolya znanii, umenii i navykov obuchaemykh i odnogo iz sposobov povysheniya kachestva obrazovaniya [Adaptive testing as a type of objective control of knowledge, skills and abilities of students and one of the ways to improve the quality of education]. Pedagogicheskie nauki[Pedagogical Sciences], NovaInfo.Ru, 2018. No. 94. pp. 170—174 (In Russ.).
19. Perevezentseva E.S., Ushakov D.V., Panfilova A.S. Veb-realizatsiya adaptivnogo matrichnogo testa intellekta Bertlinga—Khollinga [Web-based implementation of the Bertling-Holling Adaptive Matrix Intelligence Test]. Eksperimental'naya psikhologiya v Rossii: traditsii i perspektivy = Experimental Psychology in Russia: Traditions and Perspectives, 2010. URL: https://psyjournals.ru/nonserialpublications/exp_collection/contents/33325 (Accessed 14.02.2023). (In Russ.).
20. Sergeev V.V. Adaptivnoe testirovanie v sistemakh distantsionnogo obucheniya [Adaptive testing in distance learning systems]. Nauchnoe izdanie MGTU im. N.E. Baumana «Nauka i obrazovanie» = Scientific edition of MGTU n. N.E. Baumana "Nauka i obrazovanie", 2007. No. 4. URL: http://engineering-science.ru/doc/65577.html (Accessed10.02.2023). (In Russ.).
21. Federyakin D.A. Vremya otveta v komp'yuternom adaptivnom testirovanii [Item Response Times in Computerized Adaptive Testing]. Informatizatsiya obrazovaniya i metodika elektronnogo obucheniya: tsifrovye tekhnologii v obrazovanii: Materialy IV Mezhdunarodnoi nauchnoi konferentsii = Informatization of education and e-learning methodology: digital technologies in education: Proceedings of the IV International Scientific Conference. Krasnoyarsk, 06—09 oct., 2020. Vol. 2, ch. 2.Sibirskii federal'nyi universitet, Krasnojarsk. 2020. pp. 249—255. URL: https://publications.hse.ru/chapters/412400421 (Accessed 10.02.2023). (In Russ.).
22. Chumakova E.V., Korneev D.G., Gasparian M.S. Razrabotka metoda adaptivnogo testirovaniya na osnove neirotekhnologii [Development of Adaptive Testing Method Based on Neurotechnologies]. Zhurnal «Otkrytoe obrazovanie» = Open Education Journal, 2022. Vol. 26, no. 2, pp. 4—13. DOI:10.21686/1818-4243-2022-2-4-13 (In Russ.).
23. Shtroo V.A. Metody aktivnogo sotsial'no-psikhologicheskogo obucheniya [Methods of active socio-psychological education)]. Uchebno-metodicheskoe posobie dlya studentov 4 kursa d/o i 5 kursa v/o fakul'teta filosofii i psikhologii (otdeleniya psikhologii): Educational and methodological manual for 4th-year students of pre-school education and 5-year high school students of the Faculty of Philosophy and Psychology (Department of Psychology). Voronezh, 2003. 55 p. (In Russ.).
24. Barocas S., Selbst A.D. Big data’s disparate impact. California Law Review, 2016. Vol. 104, pp. 671.
25. Collares C.F., Cecilio-Fernandes D. When I say ... computerized adaptive testing. Medical Education, 2019. Vol.53(2), pp. 115—116.
26. Gaffney S. Authoring adaptive soft skill simulations, [thesis]. Trinity College (Dublin, Ireland) — School of Computer Science & Statistics, 2013. 420 p.
27. Jafri S.S.M. Computerized adaptive testing using neural networks. Computer Science, 2007. 134 p. Available at: https://www.researchgate.net/publication/228720628_Computerized_adaptive_ testing_using_neural_networks (Accessed 30.09.2022).
28. Kuravsky L.S. Modeling Dynamical Behavior of Stochastic Systems: Spectral Analysis of Qubit Representations vs the Mutual Markovian Model Likelihood Estimations. Lobachevskii J. Math., 2021. No. 42(10), pp. 2364—2376.
29. Kuravsky L.S. Simplification of Solving Diagnostics Problems by Convolution of Applied Markovian Models into the Quantum Representations. Lobachevskii J. Math., 2022. No. 43(7), pp. 1669—1682.
30. Kyllonen P.C., et al. Implementing Soft skills training in gift. Design Recommendations for Intelligent Tutoring Systems: Vol. 9. Competency-Based Scenario Design, 2022. Pp. 49.
31. Martin A.J., Lazendic G. Computer-adaptive testing: Implications for students’ achievement, motivation, engagement, and subjective test experience. Journal of Educational Psychology, 2018. Vol. 110(1), pp. 27—45.
32. Matayoshi J., Cosyn E., Uzun H. Using recurrent neural networks to build a stopping algorithm for an adaptive assessment. In: International conference on artificial intelligence in education, Springer, Cham. 2019. Pp. 179—184.
33. Mujtaba D.F., Mahapatra N.R. Artificial Intelligence in Computerized Adaptive Testing. International Conference on Computational Science and Computational Intelligence (CSCI). Las Vegas, NV, USA, 2020. Pp. 649—654. doi:10.1109/CSCI51800.2020.00116
34. Nelson P.M., Van Norman E.R., Klingbeil D.A. & Parker D.C. Progress monitoring with computer adaptive assessments: The impact of data collection schedule on growth estimates. Psychology in the Schools, 2017. Vol. 54(5), pp. 463—471.
35. Pan Y., Sinharay S., Livne O. & Wollack J.A. A machine learning approach for detecting item compromise and preknowledge in computerized adaptive testing. Psychological Test and Assessment Modeling, 2022. Vol. 64(4), pp. 385—424.
36. Rice N., Pêgo J.M., Collares C.F., Kisielewska J., Gale T. The development and implementation of a computer adaptive progress test across European countries. Computers and Education: Artificial Intelligence, 2022. Vol. 3, pp. 11.
37. Riza L.S., Nurjanah N.S., Wihardi Y. The development of computer adaptive test and item response theory with 4 parameters based the logistics model. Journal of Physics: Conference Series, 2019. Vol. 1280, no. 3, pp. 6.
38. Shapiro E.S., Dennis M.S.,Fu Q. Comparing computer adaptive and curriculum-based measures of math in progress monitoring. School Psychology Quarterly, 2015. Vol. 30(4), pp. 470—487.
39. Veldkamp B.P., Sluijter C. Theoretical and Practical Advances in Computer-Based Educational Measurement. Methodology of Educational Measurement and Assessment. Springer International Publishing: Cham, Switzerland, 2019. Pp. 271–289.
40. Walz K., Braun E.A. Competency Level Model for Communication Skills. Higher Education Forum. Research Institute for Higher Education, Hiroshima University. 1-2-2 Kagamiyama, Higashi-hiroshima, Hiroshima City, Japan, 2022. Vol. 19, pp. 45—69.
41. Yang A., Flanagan B., Ogata H. Adaptive formative assessment system based on computerized adaptive testing and the learning memory cycle for personalized learning. Computers and Education: Artificial Intelligence, 2022. Vol. 3, pp. 10.
42. Zhuang Y., Liu Q., Huang Z., Li Z., Shen S., Ma H. Fully Adaptive Framework: Neural Computerized Adaptive Testing for Online Education. The Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI-22). February 22–March 1, 2022, held virtually. Vol. 36, no. 4, pp. 4734—4742.