Difficulties with Replication and Vulnerability of Refutation: the Case of “Ego Depletion Effect” 76
Doctor of Psychology, Head of International Laboratory of Positive Psychology of Personality and Motivation, National Research University Higher School of Economics, Moscow, Russia
The aim of the paper is highlighting problems associated with attempts to replicate well-known psychological experiments on the example of the effect of depletion of self-regulation resource, or “ego depletion” (Roy Baumeister). The publication of this effect in 1998 was followed by a long and rich history of its checking in varied modifications, attempts to investigate its neurophysiological basis, metaanalyses which provided incoherent results and alternative explanations. The discussions around this effect became especially active in the last five years, when several attempts were published to replicate the effect by joint efforts of a number of independent laboratories; the results were again contradictory. The limitations of the possibility of exact replications are shown on the example of these attempts. The replications, the results of which fail to reproduce the results of the initial study are not to be viewed without reservations as the proofs of invalidation of the initial study, even if they are performed methodologically faultlessly. At the same time, their value consists in the opportunities of considering additional conditions which were initially left without proper consideration, as well as in the emerging alternative explanations.
The study was funded by Russian Science Foundation (RSCF), project number 16-18- 10439 “Systems Dynamic Analysis of Activity Regulation”.
The author is grateful to Prof. Roy Baumeister for the provision of relevant materials and to Dr. Evgeny Osin for valuable comments which allowed to improve the text of the paper.
Levin K. Dinamicheskaya psikhologiya: izbrannyye trudy
[Dynamic psychology: selected works] / pod red. D.A. Leontiev. M.: Smysl, 2001.
572 p. (In Russ.).
Leontiev D.A. Teoriya i issledovaniya samoregulyatsii Roya
Baumeistera [Roy Baumeister’s theory and research of self-regulation].
Voprosy psikhologii, 2019. № 6. P. 35—45. (In Russ.).
André N, Audiffren M., Baumeister R.F. An Integrative
Model of Effortful Control. Frontiers in Systems Neuroscience. 2019. V.
13. P. 79. doi: 10.3389/fnsys.2019.00079
Baumeister R. Do Effect Sizes in Psychology Laboratory
experiments mean anything in reality? Psychology: Journal of the Higher
School of Economics. 2020. V. 17. № 4. P. 803—811.
Baumeister R.F., Bratslavsky E., Muraven M., Tice D.M. Ego
depletion: Is the active self a limited resource? Journal of Personality and
Social Psychology. 1998. V. 74. № 5. P. 1252—1265. doi: 10.1037/0022-
Baumeister R., Tierney J. Willpower: Rediscovering the
Greatest Human Strength. London: Penguin, 2011. 291 p.
Baumeister R.F., Vohs K.D. Misguided effort with elusive
implications. Perspectives on Psychological Science, 2016. V. 11. №4. P.
574—575. doi: 10.1177/1745691616652878.
Baumeister R.F., Vonasch A.J., Sjåstad H. The long reach
of self-control. Surrounding Self-Control / ed. by A. Mele. New York: Oxford
University Press, 2020. P. 17—46.
Baumeister R.F., Wright B.R.E., Carreon D. Self-control
“in the wild”: Experience sampling study of trait and state self-regulation.
Self & Identity. 2019. V. 18. P. 494—528. Doi:
Carter E. C., Kofer L. M., Forster D. E., McCulloch M. E.
A series of meta-analytic tests of the depletion effect: Self-control does not
seem to rely on a limited resource. Journal of Experimental Psychology:
General. 2015. V. 144. P. 796—815. doi: 10.1037/xge0000083.
Dang J. Commentary: A multilab preregistered replication
of the ego-depletion effect. Frontiers in Psychology. 2016. V. 7. P.
1155. doi: 10.3389/fpsyg.2016.01155
Dang J. An updated meta-analysis of the ego depletion
effect. Psychological Research. 2018. V. 82. № 654—651. doi:
Dang J., Barker P., Baumert A. a.o. A Multilab Replication
of the Ego Depletion Effect. Social Psychological and Personality
Science. 2020. P. 1—11. DOI: 10.1177/1948550619887702
Dang J., Hagger M.S. Time to set a new research agenda for
ego depletion and self-control. Social Psychology. 2019. V.50 № 5—6. P.
277—281. doi: 10.1027/1864-9335/a000399
Dang J., Liu Y., Liu X., Mao L. The ego could be depleted,
providing initial exertion is depleting: A preregistered experiment of the ego
depletion effect. Social Psychology. 2017. V.48. №4. P. 242—245. doi:
Gailliot M.T., Baumeister R.F. The Physiology of
willpower: Linking Blood Glucose to Self-Control. Personality and Social
Psychology Review. 2007. V.11. P. 303—327. doi:
Hagger M.S., Chatzisarantis N.L.D., Alberts H., Anggono C.
……Zwienenberg M. A multilab preregistered replication of the ego-depletion of
regulatory control in healthy volunteers. Perspectives on Psychological
Science. 2016. V. 11. № 4. P. 546—573. doi: 10.1177/1745691616 652873
Hagger M.S., Wood C., Stiff C., Chatzisarantis N.L.D. Ego
Depletion and the Strengths Model of Self- Control: A Meta-Analysis.
Psychological Bulletin. 2010. V.136. P. 495—525. DOI:
Job V., Dweck K., Walton G. Ego Depletion — Is It All in
Your Head? Implicit Theories about Willpower Affect Self-Regulation.
Psychological Science. 2010. V.21. № 11. P. 1686—1693. doi:
Sjåstsad H., Baumeister R.F. The Future and the Will:
Planning requires self-control, and ego depletion leads to planning aversion.
Journal of Experimental Social Psychology. 2018. V. 76. P. 127—141. doi:
Vos K.D., Schmeichel B.J., Funder D.C. A pre-registered
depletion replication project: The paradigmatic replication approach. Presented
to the SPSP, Atlanta, GA, February 28, 2018.