Psychometry of Latent Characteristics: Tools, Problems of Rank Information Processing, Solutions

The paper examines the problems of correctness and adequacy of the use of psychometric tools in psychosocial research and applications. The main attention is paid to the problem of correct processing of rank information, which is non-numeric information that does not allow the use of classical mathematical operations, starting with the addition operation. The approach of forming the results of processing expert, ranked information in the scale of relations based on the Analytic Hierarchy Process (AHP), which includes a measurement apparatus and decision-making algorithms, is presented. An example is given that simulates the situation of an expert council and demonstrates unacceptable contradictions that arise with the "numerical" approach to processing rank information. The algorithms of the AHP normative approach are presented, which allow obtaining numerical, personalized assessments of psychosocial characteristics. The basic concepts of the Rasch Measurement (RM) for comparing the capabilities of AHP and RM in psychosocial applications are described. Some critical remarks about the methods of psychometry are considered. It is shown that the origins of the criticisms are associated with a superficial understanding of the basic concepts of psychometric measurements and the scope of their applications, as well as with elementary errors when using the apparatus of psychometric instruments.

1. Avanesov V.S. Metricheskaja sistema Georga Rasha – Rasch Measurement (RM) [The metric system of Georg Rasch-Rasch Measurement (RM)]. Pedagogicheskie izmerenija [Educational measurements], 2010, no. 2, pp. 57–80. Available at: https://cyberleninka.ru/article/n/metricheskaya-sistema-georga-rasha-rasch-measurement-rm. (In Russ.).
2. Andreichikov A.V., Andreichikova O.N. Nauka i iskusstvo prinyatiya reshenii. Kn. 2: Prinyatie reshenii v usloviyakh neopredelennosti: ot metoda analiza ierarkhii do nechetkikh modelei. Uchebnik [The science and art of decision-making. Book 2: Decision-making in conditions of uncertainty: from the analytic hierarchy process to fuzzy models]. Moscow: Publ. LENAND, 2021. 800 p. (In Russ.).
3. Assanovich M.A. Sravnitel'naja ocenka porogovyh kriteriev vyrazhennosti depressii, razrabotannyh na osnove klassicheskoj teorii testov i modeli Rasha [Comparative Evaluation of Cut-Off Criteria of Depression Severity Developed on the Basis of Classical Test Theory and Rasch Model]. Vestnik JuUrGU. Serija «Psihologija» [Bulletin of the South Ural State University. Ser. Psychology], 2017. Vol. 10, no. 1, pp. 26–34. DOI:10.14529/psy170103 (In Russ.).
4. Assanovich M.V., Karpiuk V.A. Psihometricheskie svojstva i diagnosticheskie kriterii shkaly ocenki negativnyh simptomov (SANS – Scale for the assessment of negative symptoms) pri shizofrenii [Psychometric properties and diagnostic criteria of Scale for the assessment of negative symptoms (SANS) in schizophrenia]. Obozrenie psihiatrii i medicinskoj psihologii imeni V.M. Behtereva [V.M. Bekhterev review of psychiatry and medical psychology], 2021. Vol. 55, no. 1, pp. 33–41. DOI:10.31363/2313-7053-2021-1-33-41 (In Russ.).
5. Bruk B.N., Burkov V.N. Metody ekspertnykh otsenok v zadachakh uporyadocheniya ob"ektov [Methods of expert assessments in the problems of object ordering]. Izvestiya AN SSSR. Tekhnicheskaya kibernetika [News of the USSR Academy of Sciences. Technical cybernetics], 1972, no. 3, pp. 29–39. (In Russ.).
6. Zolotareva A.A. Psihometricheskie svojstva russkojazychnoj versii Shkaly vosprinimaemogo stressa (versii PSS-4, 10, 14) [Psychometric Properties of the Russian Version of the Perceived Stress Scale (PSS-4, 10, 14)]. Klinicheskaja i special'naja psihologija [Clinical Psychology and Special Education], 2023. Vol. 12, no. 1, pp. 18–42. DOI:10.17759/cpse.2023120102 (In Russ.).
7. Kukshina A.A., Kotelnikova A.V., Rassulova M.A., Dajlidovich V.S. Issledovanie psihometricheskih svojstv «Gospital'noj shkaly trevogi i depressii» (HADS), rekomendovannoj dlja vrachej obshhesomaticheskoj praktiki, na vyborke pacientov s narusheniem dvigatel'nyh funkcij [Investigation of the Psychometric Properties of the Hospital Anxiety and Depression Scale (HADS) Recommended for General Medical Practitioners, on a Sample of Patients with Impaired Motor Functions]. Klinicheskaja i special'naja psihologija [Clinical Psychology and Special Education], 2023. Vol. 12, no 2, pp. 1–24. DOI:10.17759/cpse.2023120201 (In Russ.).
8. Matematicheskie metody v psihologii [Mathematical methods in psychology]. Kupcov M.I., Filipova E.E., Slobodskaya I.N., Pavlova S.A., Koryachko A.V., Zharkikh A.A. Moscow: Publ. Goryachaya liniya–Telekom, 2017. 156 p. (In Russ.).
9. Malinetzky G.G., Podlazov A.V. EGJe kak katalizator krizisa Rossijskogo obrazovanija [USE as a Catalyst for the Crisis of Russian Education]. Vestnik MGU. Serija 20: Pedagogicheskoe obrazovanie [Bulletin of the Moscow State University. Series 20: Pedagogical education], 2011, no. 3, pp. 18–59. Available at: https://cyberleninka.ru/article/n/ege-kak-katalizator-krizisa-rossiyskogo-obrazovaniya (In Russ.).
10. Mitikhin V.G. K voprosu reshenija mnogokriterial'nyh zadach na osnove metoda analiza ierarhij [On the issue of multi-criteria decision problems based on the Analytic Hierarchy Process]. Cloud of Science [Cloud of Science], 2015. Vol. 2, no. 4, pp. 519–529. Available at: http://cloudofscience.ru (In Russ.).
11. Mitikhin V.G., Alieva L.M., Enikolopov S.N. Primenenie metoda analiza ierarhij dlja obrabotki dannyh issledovanija telesnogo obraza «Ja» u bol'nyh psihicheskimi rasstrojstvami [An analytic hierarchy process of body image in mental disorders]. Psihiatrija [Psychiatry], 2015, no. 1(65), pp. 29–32. DOI:10.30629/2618-6667-2015-65-29-32 (In Russ.).
12. Mitikhin V.G., Solokhina T.A., Kuzminova M.V., Tiumenkova G.V., Limankin O.V., Babin S.M. Jeffektivnost' psihosocial'noj reabilitacii: innovacionnyj metod ocenki [Effectiveness of psychosocial rehabilitation: innovative method of results assessment ]. Psihiatrija [Psychiatry], 2022. Vol. 20, no. 2, pp. 51–59. DOI:10.30629/2618-6667-2022-20-2-51-59 (In Russ.).
13. Nogin V.D. Uproshchennyi variant metoda analiza ierarkhii na osnove nelineinoi svertki kriteriev [A simplified version of the analytic hierarchy process based on nonlinear criteria convolution]. Zhurnal vychislitel'noi matematiki i matematicheskoi fiziki [Computational Mathematics and Mathematical Physics], 2004. Vol. 44, no. 7, pp. 1261–1270. (In Russ.).
14. Orlov A.I. Prikladnaya statistika [Applied statistics]. Moscow: Publ. Ehkzamen [Exam], 2006. 656 p. (In Russ.).
15. Saaty T.L. Prinyatie reshenii pri zavisimostyakh i obratnykh svyazyakh: Analiticheskie seti / Per. s angl. [Decision making with dependence and feedback: The Analytic Network Process]. Moscow: Publ. LKI, 2008. 360 p. (In Russ.).
16. Solodova E.A. Novye modeli v sisteme obrazovaniya. Sinergeticheskii podkhod [New models in the education system. A synergistic approach]. Moscow: Publ. URSS, 2016. 344 p. (In Russ.).
17. Tyumeneva Y.A. Chto dajut chisla dlja izmerenija v psihologii? Obzor kritiki v adres netestiruemyh dopushhenij psihometriki i vozmozhnye al'ternativy «izmeritel'noj» psihologii [What do numbers provide for measurement in psychology? A Review of Critiques of the untested assumptions of psychometrics and possible alternatives to "measurement" in psychology]. Psikhologicheskie Issledovaniya [Psychological research], 2022. Vol. 15, no. 84, pp. 1–30. DOI:10.54359/ps.v15i84.1198 (In Russ.).
18. Khaitun S.D. Kolichestvennyi analiz sotsial'nykh yavlenii. Problemy i perspektivy [Quantitative analysis of social phenomena. Problems and prospects]. Moscow: Publ. LIBROKOM, 2014. 280 p. (In Russ.).
19. Shalaginova K.S., Dekina E.V., Klochneva D.A. Jeskapizm i videoigrovaja addikcija u podrostkov [Escapism and Video Game Addiction in Adolescents]. Psikhologo-pedagogicheskie issledovaniya = Psychological-Educational Studies, 2023. Vol. 15, no. 4, pp. 97–110. DOI:10.17759/psyedu.2023150406 (In Russ.).
20. Bech P. Clinical psychometrics. Chichester, West Sussex: Wiley-Blackwell, 2012. 216 p.
21. Bond T.G., Fox C.M. Applying the Rasch Model: Fundamental Measurement in the Human Sciences. N.Y.: LEA, 2015. 406 p. DOI:10.4324/9781315814698
22. Kim S., Kim H., Suh H.S. Priorities in the Prevention Strategies for Medication Error Using the Analytical Hierarchy Process Method. Healthcare, 2022. Vol. 10, no. 3, pp. 512–523. DOI:10.3390/healthcare10030512
23. Kopylov A.T., Stepanov A.A., Butkova T.V., Malsagova K.A., Zakharova N.V., Kostyuk G.P., Elmuratov A.U., Kaysheva A.L. Consolidation of metabolomic, proteomic, and GWAS data in connective model of schizophrenia. Scientific Reports, 2023. Vol. 13, no. 1, pp. 21–39. DOI:10.1038/s41598-023-29117-7
24. Michell J. Measurement in psychology: Critical history of a methodological concept. Journal of Applied Measurement, 1999. Vol. 2, no. 1, pp. 96–100.
25. Pfanzagl J. Theory of measurement. In cooperation with Baumann V. and Huber H. 2nd revised edition. Wurzburg–Wien: Physica-Verlag, 1971. 235 p.
26. Rasch G. Studies in mathematical psychology: I. Probabilistic models for some intelligence and attainment tests. Danmarks Paedagogiske Institut, 1960. 184 p.
27. Rasch G. Probabilistic Models for Some Intelligence and Attainment Tests. With a Foreword and Afteword by B.D. Wright. Chicago & London, 1980. 199 p.
28. Saaty T.L. The Analytic Hierarchy Process. New York: McGraw Hill, 1980. 287 p.
29. Saaty T.L. On the Measurement of Intangibles. A Principal Eigenvector Approach to Relative Measurement Derived from Paired Comparisons. Notices of the American Mathematical Society, 2013. Vol. 60, no. 2, pp. 192–208. DOI:10.1090/noti944
30. Schmidt K., Aumann I., Hollander I., Damm K., Graf J.-M. Applying the Analytic Hierarchy Process in healthcare research: A systematic literature review and evaluation of reporting. BMC Medical Informatics and Decision Making, 2015. Vol. 15, no. 1, pp. 112–139. DOI:10.1186/s12911-015-0234-7
31. Uher J. Psychometrics is not measurement: Unraveling a fundamental misconception in quantitative psychology and the complex network of its underlying fallacies. Journal of Theoretical and Philosophical Psychology, 2020. Vol. 41, no. 1, pp. 58–84. DOI:10.1037/teo0000176