Easy as pie. How not to treat statistics

 
Audio is AI-generated
660

Abstract

The article discusses the methodological difficulties associated with the spread of statistical methods of data processing in psychological works. In particular, there is a simplification of the understanding of statistics by researchers, which increasingly leads to the adoption of the hypothesis of the presence of the effect, in a situation where it is not. There is a brief review of publications and examples where this issue is the subject of critical analysis. Presented a research which showed that in the repetition of experiments published in reputable journals, the significance accepted in the scientific community was observed only in 39% of the works — this effect was called the “publication shift”. The article discusses ways to solve this problem, in particular, meta-analysis, through which it is possible to confirm the results of a series of experiments relating to one problem — subject to the availability of information about the design and openness of raw data. An understanding of the probabilistic nature of statistical results must be mandatory for the evaluation of studies

General Information

Keywords: meta-analysis, statistical methods, significance level, publication shift

Journal rubric: Discussions and Disputations

OpenAlex citations: 1

OpenAlex trends: Cognitive and psychological constructs research, Sensory Analysis and Statistical Methods, Decision-Making and Behavioral Economics

Information about the work in OpenAlex

Number of citations: 1

Topics

Cognitive and psychological constructs research

This cluster of papers revolves around the application of laddering theory, means-end chain analysis, and personal construct psychology in understanding consumer cognition, decision-making processes, and value hierarchies. It explores qualitative research methods to uncover cognitive conflicts, psychological constructs, and the influence of personal values on consumer behavior in various domains such as food product design, brand choice, and online interactions. The cluster also delves into the use of laddering techniques in marketing research, psychotherapy, and understanding cognitive structures in different contexts.

Number of works: 17094  |  Total number of citations: 367146

Topic detailsв OpenAlex

Sensory Analysis and Statistical Methods

This cluster of papers focuses on sensory analysis in food science research, exploring topics such as consumer perception, emotional response to food, product characterization, and the influence of cultural diversity on food preferences. The papers cover various methods including multivariate analysis, preference mapping, temporal dominance of sensations, and cross-cultural studies.

Number of works: 44254  |  Total number of citations: 714583

Topic detailsв OpenAlex

Decision-Making and Behavioral Economics

This cluster of papers explores the intersection of psychology and economics, focusing on behavioral economics and decision making. It covers topics such as risk aversion, time discounting, heuristic decision making, the influence of emotion on choices, cognitive reflection, prospect theory, nudging, and the anchoring effect.

Number of works: 65148  |  Total number of citations: 2062678

Topic detailsв OpenAlex

Work details in OpenAlex

Article type: scientific article

DOI: https://doi.org/10.17759/sps.2018090320

Published

For citation: Krichevec, A.N. (2018). Easy as pie. How not to treat statistics. Social Psychology and Society, 9(3), 208–212. (In Russ.). https://doi.org/10.17759/sps.2018090320

© Krichevec A.N., 2018

License: CC BY-NC 4.0

References

  1. Korneev A.A., Rasskazova E.I., Krichevec A.N., Kojfman A.YA. Kritika metodologii proverki nulevoj gipotezy: ogranicheniya i vozmozhnye puti vyhoda. CHast’ I. [Elektronnyi resurs] [Criticism of the methodology for testing the null hypothesis: limitations and possible ways out. Part I.]. Psihologicheskie issledovaniya [Psychological research], 2016. Vol. 9, no. 45, 1. URL: http://psystudy.ru/index.php/num/2016v9n45/1231-korneev45. html (Accessed 16.06.2018).
  2. Korneev A.A., Rasskazova E.I., Krichevec A.N., Kojfman A.YA. Kritika metodologii proverki nulevoj gipotezy: ogranicheniya i vozmozhnye puti vyhoda. CHast’ II. [Criticism of the methodology for testing the null hypothesis: limitations and possible ways out. Part II.]. Psihologicheskie issledovaniya [Psychological research], 2016. Vol. 9, no. 47, 6. URL: http:// psystudy.ru/index.php/num/2016v9n47/1282-korneev47.html (Accessed 16.06.2018).
  3. Nuzzo R. Statistical errors. Nature, 2014. Vol. 506, no. 13, pp. 150—152. doi:10.1038/506150a
  4. Open Science Collaboration. Estimating the reproducibility of psychological science. Science, 2015. Vol. 349, ISSUE 6251 aac4716-1. doi: 10.1126/science.aac4716
  5. Wasserstein R.L. Lazar N.A. The ASA’s statement on p-values: context, process, and purpose. The American Statistician, 2016. doi: 10.1080/00031305.2016.1154108

Information About the Authors

Anatoly N. Krichevec, Doctor of Philosophy, Candidate of Science (Physics and Matematics), Professor, Department of Methodology of Psychology, Faculty of Psychology, Moscow State University. M. V. Lomonosov, Moscow, Russian Federation, ORCID: https://orcid.org/0000-0002-4064-3858, e-mail: ankrich@mail.ru

Metrics

 Web Views

Whole time: 1717
Previous month: 8
Current month: 19

 PDF Downloads

Whole time: 660
Previous month: 5
Current month: 8

 Total

Whole time: 2377
Previous month: 13
Current month: 27