Difficulties with Replication and Vulnerability of Refutation: the Case of “Ego Depletion Effect”

365

Abstract

The aim of the paper is highlighting problems associated with attempts to replicate well-known psychological experiments on the example of the effect of depletion of self-regulation resource, or “ego depletion” (Roy Baumeister). The publication of this effect in 1998 was followed by a long and rich history of its checking in varied modifications, attempts to investigate its neurophysiological basis, metaanalyses which provided incoherent results and alternative explanations. The discussions around this effect became especially active in the last five years, when several attempts were published to replicate the effect by joint efforts of a number of independent laboratories; the results were again contradictory. The limitations of the possibility of exact replications are shown on the example of these attempts. The replications, the results of which fail to reproduce the results of the initial study are not to be viewed without reservations as the proofs of invalidation of the initial study, even if they are performed methodologically faultlessly. At the same time, their value consists in the opportunities of considering additional conditions which were initially left without proper consideration, as well as in the emerging alternative explanations.

General Information

Keywords: self-regulation, ego depletion, replication, metaanalysis

Journal rubric: Methodology of Psychological Research

Article type: scientific article

DOI: https://doi.org/10.17759/exppsy.2020130414

Funding. The study was funded by Russian Science Foundation (RSCF), project number 16-18- 10439 “Systems Dynamic Analysis of Activity Regulation”.

Acknowledgements. The author is grateful to Prof. Roy Baumeister for the provision of relevant materials and to Dr. Evgeny Osin for valuable comments which allowed to improve the text of the paper.

For citation: Leontiev D.A. Difficulties with Replication and Vulnerability of Refutation: the Case of “Ego Depletion Effect”. Eksperimental'naâ psihologiâ = Experimental Psychology (Russia), 2020. Vol. 13, no. 4, pp. 192–204. DOI: 10.17759/exppsy.2020130414. (In Russ., аbstr. in Engl.)

References

  1. Levin K. Dinamicheskaya psikhologiya: izbrannyye trudy [Dynamic psychology: selected works] / pod red. D.A. Leontiev. M.: Smysl, 2001. 572 p. (In Russ.).
  2. Leontiev D.A. Teoriya i issledovaniya samoregulyatsii Roya Baumeistera [Roy Baumeister’s theory and research of self-regulation]. Voprosy psikhologii, 2019. № 6. P. 35—45. (In Russ.).
  3. André N, Audiffren M., Baumeister R.F. An Integrative Model of Effortful Control. Frontiers in Systems Neuroscience. 2019. V. 13. P. 79. doi: 10.3389/fnsys.2019.00079
  4. Baumeister R. Do Effect Sizes in Psychology Laboratory experiments mean anything in reality? Psychology: Journal of the Higher School of Economics. 2020. V. 17. № 4. P. 803—811.
  5. Baumeister R.F., Bratslavsky E., Muraven M., Tice D.M. Ego depletion: Is the active self a limited resource? Journal of Personality and Social Psychology. 1998. V. 74. № 5. P. 1252—1265. doi: 10.1037/0022- 3514.74.5.1252
  6. Baumeister R., Tierney J. Willpower: Rediscovering the Greatest Human Strength. London: Penguin, 2011. 291 p.
  7. Baumeister R.F., Vohs K.D. Misguided effort with elusive implications. Perspectives on Psychological Science, 2016. V. 11. №4. P. 574—575. doi: 10.1177/1745691616652878.
  8. Baumeister R.F., Vonasch A.J., Sjåstad H. The long reach of self-control. Surrounding Self-Control / ed. by A. Mele. New York: Oxford University Press, 2020. P. 17—46.
  9. Baumeister R.F., Wright B.R.E., Carreon D. Self-control “in the wild”: Experience sampling study of trait and state self-regulation. Self & Identity. 2019. V. 18. P. 494—528. Doi: 10.10180/15298868.2018.1478324
  10. Carter E. C., Kofer L. M., Forster D. E., McCulloch M. E. A series of meta-analytic tests of the depletion effect: Self-control does not seem to rely on a limited resource. Journal of Experimental Psychology: General. 2015. V. 144. P. 796—815. doi: 10.1037/xge0000083.
  11. Dang J. Commentary: A multilab preregistered replication of the ego-depletion effect. Frontiers in Psychology. 2016. V. 7. P. 1155. doi: 10.3389/fpsyg.2016.01155
  12. Dang J. An updated meta-analysis of the ego depletion effect. Psychological Research. 2018. V. 82. № 654—651. doi: 10.1007/s00426-017-0862-x
  13. Dang J., Barker P., Baumert A. a.o. A Multilab Replication of the Ego Depletion Effect. Social Psychological and Personality Science. 2020. P. 1—11. DOI: 10.1177/1948550619887702
  14. Dang J., Hagger M.S. Time to set a new research agenda for ego depletion and self-control. Social Psychology. 2019. V.50 № 5—6. P. 277—281. doi: 10.1027/1864-9335/a000399
  15. Dang J., Liu Y., Liu X., Mao L. The ego could be depleted, providing initial exertion is depleting: A preregistered experiment of the ego depletion effect. Social Psychology. 2017. V.48. №4. P. 242—245. doi: 10.1027/1864-9335/a000308
  16. Gailliot M.T., Baumeister R.F. The Physiology of willpower: Linking Blood Glucose to Self-Control. Personality and Social Psychology Review. 2007. V.11. P. 303—327. doi: 10.1177/1088868307303030
  17. Hagger M.S., Chatzisarantis N.L.D., Alberts H., Anggono C. ……Zwienenberg M. A multilab preregistered replication of the ego-depletion of regulatory control in healthy volunteers. Perspectives on Psychological Science. 2016. V. 11. № 4. P. 546—573. doi: 10.1177/1745691616 652873
  18. Hagger M.S., Wood C., Stiff C., Chatzisarantis N.L.D. Ego Depletion and the Strengths Model of Self- Control: A Meta-Analysis. Psychological Bulletin. 2010. V.136. P. 495—525. DOI: 10.1037/a0019486
  19. Job V., Dweck K., Walton G. Ego Depletion — Is It All in Your Head? Implicit Theories about Willpower Affect Self-Regulation. Psychological Science. 2010. V.21. № 11. P. 1686—1693. doi: 10.1177/0956797610384745
  20. Sjåstsad H., Baumeister R.F. The Future and the Will: Planning requires self-control, and ego depletion leads to planning aversion. Journal of Experimental Social Psychology. 2018. V. 76. P. 127—141. doi: 10.1016/j. jesp.2018.01.005
  21. Vos K.D., Schmeichel B.J., Funder D.C. A pre-registered depletion replication project: The paradigmatic replication approach. Presented to the SPSP, Atlanta, GA, February 28, 2018.

Information About the Authors

Dmitriy A. Leontiev, Doctor of Psychology, Leading Research Fellow, The Laboratory for Comparative Research in Quality of Life, National Research Tomsk State University, Head of International Laboratory of Positive Psychology of Personality and Motivation; Professor of Faculty of Social Sciences, School of Psychology, HSE University, Moscow, Tomsk, Russia, ORCID: https://orcid.org/0000-0003-2252-9805, e-mail: dmleont@gmail.com

Metrics

Views

Total: 652
Previous month: 9
Current month: 13

Downloads

Total: 365
Previous month: 0
Current month: 7