Reproducibility of Psychological Experiments as a Problem of Post-Nonclassical Science

A fundamental project on reproducibility carried out in the USA by Brian Nosek in 2015 (the Reproducibility Project) revealed a serious methodological problem in psychology: the issue of replication of psycho- logical experiments. Reproducibility has been traditionally perceived as one of the basic principles of the scientific method. However, methodological analysis of the modern post-nonclassical stage in the development of science suggests that this might be a bit too uncompromising as applied to psychology. It seems that the very criteria of scientific research need to be reconsidered with regard to the specifics of post-nonclassical science, and, as the authors put it, as a result, reproducibility might lose its key status or even be excluded at all. The reviewed problem and the proposed ways of coping with it are of high importance to research and practice in psychology as they define the strategies for organizing, conducting and evaluating experimental research.

1. Allakhverdov V.M. Metodologicheskoe puteshestvie po okeanu bessoznatel’nogo k tainstvennomu ostrovu soznani- ya [Methodological journey across the ocean of the uncon- scious to the mysterious island of consciousness]. Saint Peters- burg: Publ. Rech’, 2003. 368 p.
2. Vachkov I.V. Metodika prepodavaniya psikhologii [Teach- ing Psychology Methods]. Moscow: Publ. Os’-89, 2008. 208 p.
3. Vygotskii L.S. Sobranie sochinenii v 6-ti tomakh. T. 1. [Collected Works in 6 vol. Vol. 1]. Moscow: Publ. Pedagogika, 1982. 488 p.
4. Il’in V.V. Filosofiya nauki [Philosophy of Science]. Moscow: Publ. Mosk. un-ta, 2003. 380 p.
5. Kalinina G.N. Dinamika obraza nauchnoi ratsional’nosti v prizme izmenenii v osnovaniyakh postneklassicheskoi nauki [Dy- namic of scientific rationality image through the prism of changes in postnonclassical science foundations]. Izvestiya Tul’skogo gosu- darstvennogo universiteta. Gumanitarnye nauki [News of the Tula State University. Humanitarian sciences]. 2011. no. 1. pp. 22—30.
6. Kuznetsov D. Ne povtoryaetsya takoe nikogda [Elek- tronnyi resurs] [This does not repeat ever]. N+1 [N+1]. 8 senty- abrya 2015. URL: https:.nplus1.ru/material/2015/09/08/psy- crisis (Accessed 01.03.2016).
7. Lubovskii D.V. Vvedenie v metodologicheskie osnovy psikhologii [Introduction to the Psychology Methodological Foundations]. Moscow — Voronezh: Publ. MPSI, 2007. 224 p.
8. Mendelevich V.D. Problema diagnostiki psikh- icheskikh i povedencheskikh rasstroistv v epokhu postmod- ernizma [The diagnosis problem of mental and behavioral dis- orders in postmodernism era]. Eksperimental’naya psikhologiya [Experimental Psychology]. 2015. Vol. 8. no. 3. pp. 82—90. doi:10.17759/exppsy.2015080308. (In Russ., abstr. in Engl.).
9. Stepin V.S. Teoreticheskoe znanie: Struktura, istoriches- kaya evolyutsiya [Theoretical Knowledge: Structure, Historical Evolution]. Moscow: Publ. Progress-Traditsiya, 2000. 744 p.
10. Ushkova E.N.  Transformatsiya  etalona  nauchnosti v psikhologii [Transformation of the Scientific Psychology Standard]. Vestnik russkoi khristianskoi gumanitarnoi akademii [Journal of the Russian Christian Humanitarian Academy]. 2011. no 2. Vol. 12. pp. 256—266.
11. Tsaplin V. Nenauka [Non-science]. “Polden’. XXI vek” [«Noon. XXI Century»]. 2008. no. 5. pp. 157—168.
12. Yurevich A.V. Psikhologiya i metodologiya [Psychol- ogy and Methodology]. Moscow: Publ. “Institut psikhologii RAN”, 2005. 312 p.
13. Yanchuk V.A. Metodologiya, teoriya i metod v sovre- mennoi sotsial’noi psikhologii i personologii: integrativno- eklekticheskii podkhod [Methodology, theory and methods of modern social psychology and personology: integrative and eclectic approach]. Minsk: Publ. Bestprint, 2000. 416 p.
14. Nosek B. and oth. Estimating the reproducibility of psycho- logical science [Elektronnyi resurs]. Science. 28 Aug 2015: Vol. 349, Issue 6251, pp. doi: 10.1126/science.aac4716 (Accessed 01.03.2016).