Two Psychologies: Specifics of Research Models

A pressing problem in psychology is the quality of the application of mathematical methods in the practice of psychological research, which was one of the reasons for the emergence of a replication crisis. Also, recently many publications have appeared criticizing mathematical statistics in psychological research within the framework of critical psychology. In our opinion, the following factors play a key role in this problem: 1) the contradiction between the requirement for comprehensive research and the multiplicity of hypothesis testing; 2) the ability to put forward or adjust post-hoc hypotheses; 3) the training of psychologists in the field of mathematical statistics is significantly dependent on the exponential growth in the number of methods for the study of which limited time is given. Consequently, it is necessary to form lists of mathematical methods that are preferable in certain areas from the point of view of statistical practice, the origins of which lie in general methodological principles. The paper examines the problems of the methodology of applying mathematical methods in psychological articles from the point of view of the frequency and dynamics of their use, the dependence of the level of citations and other phenomena on them. It also examines a sample of articles in eight leading APA journals over the past 110 years that use the most current mathematical methods in psychology — 24,657 publications. The sample was obtained using queries to the Psyc- ARTICLES database. Using machine learning methods and automatic data processing, the raw results of search queries were corrected and validated. The work carried out on standardization and validation of data of this kind is the first example of work of this nature carried out in psychology. Based on the validated results obtained using structural equation modeling, two main factors in the use of mathematical methods were identified. Several alternative models are considered and compared.

Abbott, M. L. (2016). Using statistics in the social and health sciences with SPSS and excel. Hoboken, John Wiley & Sons.

Auguie, B. (2022). gridExtra: Miscellaneous Functions for “Grid” Graphics, R package version 2.3. R Foundation for Statistical Computing. Vienna. Available at: https://cran.r-project.org/web/packages/gridExtra/gridExtra.pdf (assessed: 13.07.2024). Beebe, L. (2010). PsycINFO’s growth. PsycINFO News, 29, 3–7.

Beller, S., Bender, A. (2017). Theory, the final frontier? A corpus-based analysis of the role of theory in psychological articles. Frontiers in Psychology, 8, 951.

Burnham, J. F. (2006). Scopus database: A review. Biomedical digital libraries, 3 (1), 1–8.

Card, N. A. (2015). Applied meta-analysis for social science research. New York, Guilford Publications.

Collier, J. E. (2020). Applied structural equation modeling using AMOS: Basic to advanced techniques. London, Routledge.

Cosgrove, L., Wheeler, E. E., Kosterina, E. (2015). Quantitative methods. Handbook of Critical Psychology (pp. 15–23). London, Routledge.

Cronbach, L. J. (1957). The two disciplines of scientific psychology. American psychologist, 12 (11), 671.

Danziger, K. (1994). Does the history of psychology have a future? Theory & Psychology, 4 (4), 467–484.

Dinno, A., Dinno, M. A. (2017). Package ‘dunn. test’. CRAN Repos, 10, 1–7.

Dunn, O. J. (1964). Multiple comparisons using rank sums. Technometrics, 6 (3), 241–252.

Ermolaev-Tomin, O. Yu. (2018). Mathematical methods in psychology: textbook for high education, in 2 pts. Pt. 1. 5th ed., rev. and suppl. Moscow, Iurait Publ. (In Russian)

Evans, R. B., Sexton, V. S. E., Cadwallader, T. C. (eds) (1992). The American Psychological Association: A historical perspective. Washington, American Psychological Association. https://doi.org/10.1037/10111-000

Flis, I., van Eck, N. J. (2018). Framing psychology as a discipline (1950–1999): A large-scale term co-occurrence analysis of scientific literature in psychology. History of Psychology, 21 (4), 334.

Gorbunov, I. A., Morozova, S. V. (2020). Diagnostics of the use of mathematical and statistical methods in psychological research based on text data from resumes using nonlinear algorithms. In: Anan’evskie chteniya — 2020. Psikhologiia sluzhebnoi deiatel’nosti: dostizheniia i perspektivy razvitiia (v chest’ 75-letiia Pobedy v Velikoi Otechestvennoi voine 1941–1945 gg.) (pp. 527–528). St. Petersburg, Skifiiaprint Publ. (In Russian)

Gorbunov, I. A., Morozova, S. V. (2021). Diagnostics of the use of mathematical and statistical methods in psychology: Nonlinear algorithms for analyzing article abstracts. In: Kognitivnaia nauka v Moskve: novye issledovaniia (pp. 496–501). Moscow, BukiVedi Publ. (In Russian)

Greenwell, B. (2018). pdp: Partial Dependence Plots. R package version 0.7.0. Available at: https://cran.rproject.org/web/packages/pdp/pdp.pdf (assessed: 13.07.2024).

Gurnsey, R. (2017). Statistics for research in psychology: A modern approach using estimation. Thousand Oaks, Sage Publications.

Holland, B. S., Copenhaver, M. D. (1988). Improved Bonferroni-type multiple testing procedures. Psychological Bulletin, 104 (1), 145.

Howell, D. C. (2014). Fundamental Statistics for the Behavioral Sciences. 8th international ed. Melbourne, Cengage Learning.

Kassambara, A., Kassambara, M. A. Package ‘ggpubr’. 2020. Available at: cran.microsoft.com (accessed: 23.07.2022).

Lee, M. D., Wagenmakers, E. J. (2014). Bayesian cognitive modeling: A practical course. Cambridge, Cambridge University Press.

Len’kov, S. L., Rubcova, N. E. (2023). Statistical methods in psychology: Manual and practicum for high schools. Moscow, Iurait Publ. (In Russian)

Leppink, J. (2019). Statistical methods for experimental research in education and psychology (pp. 69–76). Cham, Springer.

Mastickij, S. (2022). Visualizing data using ggplot2. Moscow, Litres Publ. (In Russian)

Mayers, A. (2013). Introduction to statistics and SPSS in psychology. London, Pearson.

McGrath, R. E. (2011). Quantitative models in psychology. Washington, American Psychological Association.

Melas, V., Shpilev, P. (2022). Planning and Analysis for Regression Models. Moscow, Litres Publ. (In Russian)

Morozova, S. (2016). Human sciences: History of the disciplines. Laboratorium: Zhurnal sotsial’nyh issledovanii, 2, 160–164. (In Russian)

Morozova, S. V. (2018). Threats of isolation of Russian psychology in the future. Psikhologicheskii zhurnal, 39 (3), 129–133. https://doi.org/10.7868/S0205959218030121 (In Russian)

Nasledov, A. D. (2004). Mathematical methods of psychological research: Analysis and interpretation of data: notebook. St. Petersburg, Rech’ Publ. (In Russian)

Nolan, S. A., Heinzen, T. E. (2011). Statistics for the behavioral sciences. New York, Macmillan. Ogle, D. H. (2018). Introductory fisheries analyses with R. London, Chapman and Hall/CRC.

Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, 349 (6251), aac4716–aac4716. https://doi.org/10.1126/science.aac4716

Piotrowski, C., Perdue, B. (2003). The PsycARTICLES database: Attributes and limitations. Perceptual and Motor Skills, 97 (3), 993–994.

Popov, A. M. (2016). Application of Welch’s test in one-way analysis of variance. Problemy sovremennoj nauki i obrazovaniia, 7 (49), 59–62. (In Russian)

Popov, A. M., Sotnikov, V. N. (2015). Economic and mathematical methods and models. Moscow, Iurait Publ. Publication Manual of the American Psychological Association. 1st ed. (1972). Washington, American Psychological Association.

Publication Manual of the American Psychological Association. 2nd ed. (1981) Washington, American Psychological Association.

Publication Manual of the American Psychological Association. 3rd ed. (1983). Washington, American Psychological Association.

Publication Manual of the American Psychological Association. 4th ed. (2003). Washington, American Psychological Association.

Publication Manual of the American Psychological Association. 5th ed. (2010). Washington, American Psychological Association.

Publication Manual of the American Psychological Association. 6th ed. (2019). Washington, American Psychological Association.

Quirk, T. J. (2020). Excel 2019 for Educational and Psychological Statistics. Cham, Springer International Publishing.

R Core Team (2013). R foundation for statistical computing. Vienna. 

Revelle, W. (2021). How to use the psych package for mediation/moderation/regression analysis. Available at: https://personality-project.org/r/tutorials/HowTo/mediation.pdf (assessed: 13.07.2024).

Romanko, V. K. (2000). Course on probability theory and mathematical statistics for psychologists. Moscow, MGPPI Publ. (In Russian)

Shelekhova, L. V. (2015). Mathematical methods in psychology and pedagogy: In diagrams and tables. 2nd ed., rev. St. Petersburg, Lan’ Publ. (In Russian)

Shingala, M. C., Rajyaguru, A. (2015). Comparison of post hoc tests for unequal variance. International Journal of New Technologies in Science and Engineering, 2 (5), 22–33.

Sick, L. (2009). Record structure for APA databases. Washington, APA Association.

Smith, J. A., Harre, R., Van Langenhove, L. (eds) (1995). Rethinking psychology. Vol. 3. Thousand Oaks, Sage. https://doi.org/10.4135/9781446221792

Vysokov, I. (2023). Mathematical methods in psychology: Manual and practicum for high schools. 3rd ed., rev. and suppl. Moscow, Iurait Publ. (In Russian)

Wilcox, R. (2017). Modern statistics for the social and behavioral sciences: A practical introduction. London, CRC press.

Xodabande, I., Xodabande, N. (2020). Academic vocabulary in psychology research articles: A corpus-based study. MEXTESOL Journal, 44 (3), 1–21.

Yanagida, T., Yanagida, M. T. (2020). Package ‘misty’. Available at: https://cran.r-project.org/web/packages/misty/misty.pdf