Difficulties with Replication and Vulnerability of Refutation: the Case of “Ego Depletion Effect”

The aim of the paper is highlighting problems associated with attempts to replicate well-known psychological experiments on the example of the effect of depletion of self-regulation resource, or “ego depletion” (Roy Baumeister). The publication of this effect in 1998 was followed by a long and rich history of its checking in varied modifications, attempts to investigate its neurophysiological basis, metaanalyses which provided incoherent results and alternative explanations. The discussions around this effect became especially active in the last five years, when several attempts were published to replicate the effect by joint efforts of a number of independent laboratories; the results were again contradictory. The limitations of the possibility of exact replications are shown on the example of these attempts. The replications, the results of which fail to reproduce the results of the initial study are not to be viewed without reservations as the proofs of invalidation of the initial study, even if they are performed methodologically faultlessly. At the same time, their value consists in the opportunities of considering additional conditions which were initially left without proper consideration, as well as in the emerging alternative explanations.

1. Levin K. Dinamicheskaya psikhologiya: izbrannyye trudy [Dynamic psychology: selected works] / pod red. D.A. Leontiev. M.: Smysl, 2001. 572 p. (In Russ.).
2. Leontiev D.A. Teoriya i issledovaniya samoregulyatsii Roya Baumeistera [Roy Baumeister’s theory and research of self-regulation]. Voprosy psikhologii, 2019. № 6. P. 35—45. (In Russ.).
3. André N, Audiffren M., Baumeister R.F. An Integrative Model of Effortful Control. Frontiers in Systems Neuroscience. 2019. V. 13. P. 79. doi: 10.3389/fnsys.2019.00079
4. Baumeister R. Do Effect Sizes in Psychology Laboratory experiments mean anything in reality? Psychology: Journal of the Higher School of Economics. 2020. V. 17. № 4. P. 803—811.
5. Baumeister R.F., Bratslavsky E., Muraven M., Tice D.M. Ego depletion: Is the active self a limited resource? Journal of Personality and Social Psychology. 1998. V. 74. № 5. P. 1252—1265. doi: 10.1037/0022- 3514.74.5.1252
6. Baumeister R., Tierney J. Willpower: Rediscovering the Greatest Human Strength. London: Penguin, 2011. 291 p.
7. Baumeister R.F., Vohs K.D. Misguided effort with elusive implications. Perspectives on Psychological Science, 2016. V. 11. №4. P. 574—575. doi: 10.1177/1745691616652878.
8. Baumeister R.F., Vonasch A.J., Sjåstad H. The long reach of self-control. Surrounding Self-Control / ed. by A. Mele. New York: Oxford University Press, 2020. P. 17—46.
9. Baumeister R.F., Wright B.R.E., Carreon D. Self-control “in the wild”: Experience sampling study of trait and state self-regulation. Self & Identity. 2019. V. 18. P. 494—528. Doi: 10.10180/15298868.2018.1478324
10. Carter E. C., Kofer L. M., Forster D. E., McCulloch M. E. A series of meta-analytic tests of the depletion effect: Self-control does not seem to rely on a limited resource. Journal of Experimental Psychology: General. 2015. V. 144. P. 796—815. doi: 10.1037/xge0000083.
11. Dang J. Commentary: A multilab preregistered replication of the ego-depletion effect. Frontiers in Psychology. 2016. V. 7. P. 1155. doi: 10.3389/fpsyg.2016.01155
12. Dang J. An updated meta-analysis of the ego depletion effect. Psychological Research. 2018. V. 82. № 654—651. doi: 10.1007/s00426-017-0862-x
13. Dang J., Barker P., Baumert A. a.o. A Multilab Replication of the Ego Depletion Effect. Social Psychological and Personality Science. 2020. P. 1—11. DOI: 10.1177/1948550619887702
14. Dang J., Hagger M.S. Time to set a new research agenda for ego depletion and self-control. Social Psychology. 2019. V.50 № 5—6. P. 277—281. doi: 10.1027/1864-9335/a000399
15. Dang J., Liu Y., Liu X., Mao L. The ego could be depleted, providing initial exertion is depleting: A preregistered experiment of the ego depletion effect. Social Psychology. 2017. V.48. №4. P. 242—245. doi: 10.1027/1864-9335/a000308
16. Gailliot M.T., Baumeister R.F. The Physiology of willpower: Linking Blood Glucose to Self-Control. Personality and Social Psychology Review. 2007. V.11. P. 303—327. doi: 10.1177/1088868307303030
17. Hagger M.S., Chatzisarantis N.L.D., Alberts H., Anggono C. ……Zwienenberg M. A multilab preregistered replication of the ego-depletion of regulatory control in healthy volunteers. Perspectives on Psychological Science. 2016. V. 11. № 4. P. 546—573. doi: 10.1177/1745691616 652873
18. Hagger M.S., Wood C., Stiff C., Chatzisarantis N.L.D. Ego Depletion and the Strengths Model of Self- Control: A Meta-Analysis. Psychological Bulletin. 2010. V.136. P. 495—525. DOI: 10.1037/a0019486
19. Job V., Dweck K., Walton G. Ego Depletion — Is It All in Your Head? Implicit Theories about Willpower Affect Self-Regulation. Psychological Science. 2010. V.21. № 11. P. 1686—1693. doi: 10.1177/0956797610384745
20. Sjåstsad H., Baumeister R.F. The Future and the Will: Planning requires self-control, and ego depletion leads to planning aversion. Journal of Experimental Social Psychology. 2018. V. 76. P. 127—141. doi: 10.1016/j. jesp.2018.01.005
21. Vos K.D., Schmeichel B.J., Funder D.C. A pre-registered depletion replication project: The paradigmatic replication approach. Presented to the SPSP, Atlanta, GA, February 28, 2018.