A new approach to computerized adaptive testing

Kuravsky L.S.; Artemenkov S.L.; Yuryev G.A.; Grigorenko E.L.

doi:10.17759/exppsy.2017100303

Experimental Psychology (Russia) - №1 / 2022 | Перейти к описанию

Web of Science СС

Previous issue (2021. Vol. 14, no. 4)

Included in Web of Science СС (ESCI)

Experimental Psychology (Russia)

Publisher: Moscow State University of Psychology and Education

ISSN (printed version): 2072-7593

ISSN (online): 2311-7036

DOI: https://doi.org/10.17759/exppsy

License: CC BY-NC 4.0

Published since 2008

Published quarterly

Free of fees
Open Access Journal

RU In Russian

Experimental Psychology (Russia)
2017. Vol. 10, no. 3, 33–45
doi:10.17759/exppsy.2017100303
ISSN: 2072-7593 / 2311-7036 (online)

A new approach to computerized adaptive testing ¹⁰⁹⁷

Kuravsky L.S.
Doctor of Engineering, Dean of the Computer Science Faculty, Moscow State University of Psychology and Education, Moscow, Russia
ORCID: https://orcid.org/0000-0002-3375-8446
e-mail: l.s.kuravsky@gmail.com

Artemenkov S.L.
PhD in Engineering, Professor of the Department of Applied Informatics and Multimedia Technologies, Head of the Center of Information Technologies for Psychological Research of the Faculty of Information Technologies, Moscow State University of Psychology and Education, Moscow, Russia
ORCID: https://orcid.org/0000-0002-1619-2209
e-mail: slart@inbox.ru

Yuryev G.A.
PhD in Physics and Matematics, Associate Professor, Head of Scientifi c Laboratory, Moscow State University of Psychology and Education, Moscow, Russia
ORCID: https://orcid.org/0000-0002-2960-6562
e-mail: g.a.yuryev@gmail.com

Grigorenko E.L.
Doctor of Psychology, Leading Scientist, Moscow State University of Psychology and Education, Moscow, Russia
ORCID: https://orcid.org/0000-0001-9646-4181
e-mail: elena.grigorenko@times.uh.edu

PDF (ENG)

PDF (RUS)

A new approach to computerized adaptive testing is presented on the basis of discrete-state discrete-time Markov processes. This approach is based on an extension of the G. Rasch model used in the Item Response Theory (IRT) and has decisive advantages over the adaptive IRT testing. This approach has a number of competitive advantages: takes into account all the observed history of performing test items that includes the distribution of successful and unsuccessful item solutions; incorporates time spent on performing test items; forecasts results in the future behavior of the subjects; allows for self-learning and changing subject abilities during a testing procedure; contains easily available model identification procedure based on simply accessible observation data. Markov processes and the adaptive transitions between the items remain hidden for the subjects who have access to the items only and do not know all the intrinsic mathematical details of a testing procedure. The developed model of adaptive testing is easily generalized for the case of polytomous items and multidimensional items and model structures.

Keywords: Markov processes, adaptive testing, IRT, computerized adaptive testing

Column: Research Methods

DOI: https://doi.org/10.17759/exppsy.2017100303

For Reference

Kuravsky L.S., Artemenkov S.L., Yuryev G.A., Grigorenko E.L. A new approach to computerized adaptive testing. Eksperimental'naâ psihologiâ = Experimental Psychology (Russia), 2017. Vol. 10, no. 3, pp. 33–45. doi:10.17759/exppsy.2017100303.

Testing procedures are increasingly used in many contemporary applications requiring assessment of people or machine’s behavior. According to conventional models of testing based on classical test theory for measuring the examinee’s level in a specific skill or ability as preciselyas possible these procedures usually should implement a big number of items that makes testing difficult to use.

Burden R.L., Faires J.D. Numerical Analysis. Brooks Cole, 2011. 895 p.
Kohonen T. Self-Organizing Maps. Springer, 2001. 501 p.
Kuravsky L. S., Marmalyuk P. A., Yuryev G. A., Dumin P. N. A Numerical Technique for the Identification of Discrete-State Continuous-Time Markov Models. Applied Mathematical Sciences, 2015, vol. 9, no. 8, pp. 379–391. URL: https://doi.org/10.12988/ams. 2015.410882.
Kuravsky L.S., Margolis A.A., Marmalyuk P.A., Panfilova A.S., Yuryev G.A., Dumin P.N. A Probabilistic Model of Adaptive Training. Applied Mathematical Sciences, 2016, vol. 10, no. 48, pp. 2369—2380. http:// dx.doi.org/10.12988/ams.2016.65168.
Kuravsky L.S., Margolis A.A., Marmalyuk P.A., Yuryev G.A., Dumin P.N. Trained Markov Models to Optimize the Order of Tasks in Psychological Testing. Neirokomp'yutery: Razrabotka, Primenenie [Neurocomputers: Development, Application], 2013, no. 4, pp. 28–38 (In Rus.).
Kuravsky L.S., Marmalyuk P.A., Baranov S.N., Alkhimov V.I., Yuryev G.A., Artyukhina S.V. A New Technique for Testing Professional Skills and Competencies and Examples of its Practical Applications. Applied Mathematical Sciences, 2015, vol. 9, no. 21, pp. 1003—1026. https://doi.org/10.12988/ ams.2015.411899.
Kuravsky L.S., Yuryev G.A. Primenenie markovskikh modeley dlya testirovania resultatov [Applying Markov Models to Processing Testing Results]. Voprosy Psychologii, 2011, no. 2, pp. 112—121, (In Rus.).
Thompson N.A., Weiss D.J. A framework for the development of computerized adaptive tests. Practical Assessment. Research & Evaluation, 2011, vol. 16, no. 1, pp. 1—9.
Torre J. de la, Patz R.J. Making the Most of What We Have: A Practical Application of Multidimensional Item Response Theory in Test Scoring. Journal of Educational and Behavioral Statistics, 2005, vol. 30, no. 3, pp. 295—311. doi:10.3102/10769986030003295.
Wilkinson J.H. The Algebraic Eigenvalue Problem. Oxford, Clarendon Press, 1988, 662 p.