Review of mouse-tracker technology in psychological research

 
Audio is AI-generated
1

Abstract

Objective. The review is focused on analysis of the paradigm of tracking computer mouse movements in the situation of alternative choice. This paradigm allows to detect deviations of the mouse trajectory from the movement towards the selected response, which can be interpreted as the presence of an internal conflict between responses. This approach allows us to trace the dynamics of choice hidden inside the reaction time, to detect the presence of a conflict of answers even in the situation of choosing the expected answer, as well as to identify the factors influencing the strengthening or weakening of this conflict. Results. The article presents examples of implementation of the mouse-tracking paradigm in solving various psychological problems, such as studies of social cognition, action control, studies of economic decision-making, memory, judgment bias, self-control, and describes standard experimental procedures, indicators, and software for laboratory, online testing, and mouse trajectory data processing.

General Information

Keywords: mouse movements tracking, mouse-tracker, cognitive processes’ dynamics, motor reactions

Journal rubric: Tools

Article type: scientific article

DOI: https://doi.org/10.17759/exppsy.2025180414

Funding. The research was supported by the State Assignment, No. 0138-2025-0002.

Received 16.12.2023

Revised 11.04.2025

Accepted

Published

For citation: Sidorchuk, A.R., Korovkin, S.Y. (2025). Review of mouse-tracker technology in psychological research. Experimental Psychology (Russia), 18(4), 228–241. (In Russ.). https://doi.org/10.17759/exppsy.2025180414

© Sidorchuk A.R., Korovkin S.Y., 2025

License: CC BY-NC 4.0

References

  1. Логинов, Н.И., Спиридонов, В.Ф., Мезенцев, О.А. (2017). Движения в структуре решения инсайтных задач (на материале задачи 9 точек). Вестник Российского университета дружбы народов. Серия: Психология и педагогика, 14(2), 201—212. 
    Loginov, N.I., Spiridonov, V.F., Mezentsev, O.A. (2017). Movements within the framework of insight problem solving (based on the 9-point problem). Bulletin of the Peoples’ Friendship University of Russia. Series: Psychology and Pedagogy, 14(2), 201—212. (In Russ.).
  2. Calluso, C., Committeri, G., Pezzulo, G., Lepora, N., Tosoni, A. (2015). Analysis of hand kinematics reveals inter-individual differences in intertemporal decision dynamics. Experimental brain research, 233, 3597—3611. https://doi.org/10.1007/s00221-015-4427-1
  3. Dale, R., Kehoe, C., Spivey, M.J. (2007). Graded motor responses in the time course of categorizing atypical exemplars. Memory & Cognition, 35, 15—28. https://doi.org/10.3758/BF03195938
  4. Dshemuchadse, M., Scherbaum, S., Goschke, T. (2013). How decisions emerge: action dynamics in intertemporal decision making. Journal of Experimental Psychology: General, 142(1), 93—100. https://doi.org/10.1037/a0028499
  5. Finkbeiner, M., Song, J.-H., Nakayama, K., Caramazza, A. (2008). Engaging the motor system with masked orthographic primes: A kinematic analysis. Visual cognition, 16(1), 11—22. https://doi.org/10.1080/13506280701203838
  6. Fischer, M.H., Hartmann, M. (2014). Pushing forward in embodied cognition: may we mouse the mathematical mind? Frontiers in psychology, 5. https://doi.org/3389/fpsyg.2014.01315
  7. Freeman, J.B. (2018). Doing psychological science by hand. Current directions in psychological science, 27(5), 315—323. https://doi.org/10.1177/0963721417746793
  8. Freeman, J.B., Ambady, N. (2009). Motions of the hand expose the partial and parallel activation of stereotypes. Psychological science, 20(10), 1183—1188. https://doi.org/10.1111/j.1467-9280.2009.02422.x
  9. Freeman, J.B., Ambady, N. (2010). MouseTracker: Software for studying real-time mental processing using a computer mouse-tracking method. Behavior research methods, 42(1), 226—241. https://doi.org/10.3758/BRM.42.1.226
  10. Freeman, J.B., Dale, R., Farmer, T.A. (2011). Hand in motion reveals mind in motion. Frontiers in psychology, 2, 59. https://doi.org/3389/fpsyg.2011.00059
  11. Freeman, J.B., Ambady, N., Rule, N.O., Johnson, K.L. (2008). Will a category cue attract you? Motor output reveals dynamic competition across person construal. Journal of Experimental Psychology: General, 137(4), 673—690. https://doi.org/1037/a0013875
  12. Goodale, M.A., Pelisson, D., Prablanc, C. (1986). Large adjustments in visually guided reaching do not depend on vision of the hand or perception of target displacement. Nature, 320(6064), 748—750. https://doi.org/10.1038/320748a0
  13. Gold, J.I., Shadlen, M.N. (2001). Neural computations that underlie decisions about sensory stimuli. Trends in cognitive sciences, 5(1), 10—16. https://doi.org/10.1016/s1364-6613(00)01567-9
  14. Huette, S., McMurray, B. (2010). Continuous dynamics of color categorization. Psychonomic Bulletin & Review, 17, 348—354. https://doi.org/10.3758/PBR.17.3.348
  15. Kieslich, P.J. (2018). Advancing mouse-tracking research: new solutions for study design, implementation and analysis. Dissertation for the degree Doctor of Social Sciences.
  16. Kieslich, P.J., Henninger, F. (2017). Mousetrap: An integrated, open-source mouse-tracking package. Behavior research methods, 49, 1652—1667. https://doi.org/10.3758/s13428-017-0900-z
  17. Kieslich, P.J., Hilbig, B.E. (2014). Cognitive conflict in social dilemmas: An analysis of response dynamics. Judgment and Decision making, 9(6), 510—522. https://doi.org/10.1017/S1930297500006392
  18. Koop, G.J., Criss, A.H. (2016). The response dynamics of recognition memory: Sensitivity and bias. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42(5), 671—685. https://doi.org/10.1037/xlm0000202
  19. Koop, G.J., Johnson, J.G. (2011). Response dynamics: A new window on the decision process. Judgment and Decision making, 6(8), 750—758. https://doi.org/10.1017/S1930297500004186
  20. Liberman, N., Trope, Y. (2008). The psychology of transcending the here and now. Science, 322, 1201—1205. https://doi.org/10.1126/science.1161958
  21. Mathôt, S., Schreij, D., Theeuwes, J. (2012). OpenSesame: An open-source, graphical experiment builder for the social sciences. Behavior research methods, 44, 314—324. https://doi.org/10.3758/s13428-011-0168-7
  22. Scherbaum, S., Kieslich, P.J. (2018). Stuck at the starting line: How the starting procedure influences mouse-tracking data. Behavior Research Methods, 50, 2097—2110. https://doi.org/10.3758/s13428-017-0977-4
  23. Scherbaum, S., Dshemuchadse, M., Fischer, R., Goschke, T. (2010). How decisions evolve: The temporal dynamics of action selection. Cognition, 115(3), 407—416. https://doi.org/10.1016/j.cognition.2010.02.004
  24. Song, J.-H., Nakayama, K. (2009). Hidden cognitive states revealed in choice reaching tasks. Trends in cognitive sciences, 13(8), 360—366. https://doi.org/10.1016/j.tics.2009.04.009
  25. Song, J.-H., Nakayama, K. (2008). Numeric comparison in a visually-guided manual reaching task. Cognition, 106(2), 994—1003. https://doi.org/10.1016/j.cognition.2007.03.014
  26. Spivey, M.J., Dale, R. (2006). Continuous dynamics in real-time cognition. Current Directions in Psychological Science, 15(5), 207—211. https://doi.org/10.1111/j.1467-8721.2006.00437.x
  27. Spivey, M.J., Grosjean, M., Knoblich, G. (2005). Continuous attraction toward phonological competitors. Proceedings of the National Academy of Sciences, 102(29), 10393—10398. https://doi.org/10.1073/pnas.0503903102
  28. Stillman, P.E., Medvedev, D., Ferguson, M.J. (2017). Resisting temptation: Tracking how self-control conflicts are successfully resolved in real time. Psychological science, 28(9), 1240—1258. https://doi.org/10.1177/0956797617705386
  29. Stillman, P.E., Shen, X., Ferguson, M.J. (2018). How mouse-tracking can advance social cognitive theory. Trends in cognitive sciences, 22(6), 531—543. https://doi.org/10.1016/j.tics.2018.03.012
  30. Sullivan, N., Hutcherson, C., Harris, A., Rangel, A. (2015). Dietary self-control is related to the speed with which attributes of healthfulness and tastiness are processed. Psychological science, 26(2), 122—134. https://doi.org/10.1177/0956797614559543
  31. Szaszi, B., Palfi, B., Szollosi, A., Kieslich, P.J., Aczel, B. (2018). Thinking dynamics and individual differences: Mouse-tracking analysis of the denominator neglect task. Judgment and Decision Making, 13(1), 23—32. https://doi.org/10.1017/S1930297500008792
  32. Travers, E., Rolison, J.J., Feeney, A. (2016). The time course of conflict on the Cognitive Reflection Test. Cognition, 150, 109—118. https://doi.org/10.1016/j.cognition.2016.01.015
  33. Van der Wel, R.P., Eder, J.R., Mitchel, A.D., Walsh, M.M., Rosenbaum, D.A. (2009). Trajectories emerging from discrete versus continuous processing models in phonological competitor tasks: a commentary on Spivey, Grosjean, and Knoblich (2005). Journal of Experimental Psychology: Human Perception and Performance, 35(2), 588—594. https://doi.org/10.1037/0096-1523.35.2.588
  34. Wulff, D.U., Haslbeck, J.M.B., Kieslich, P.J., Henninger, F., Schulte-Mecklenbeck, M. (2019). Mouse-tracking: Detecting types in movement trajectories. Routledge.
  35. Wulff, D.U., Kieslich, P.J., Henninger, F., Haslbeck, J.M.B., Schulte-Mecklenbeck, M. (2021). Movement tracking of cognitive processes: A tutorial using mousetrap. PsyArXiv. https://doi.org/10.31234/osf.io/v685r

Information About the Authors

Alexandra R. Sidorchuk, Researcher of the Laboratory for Cognitive Research, Yaroslavl State University, Yaroslavl, Yaroslavl, Russian Federation, ORCID: https://orcid.org/0009-0009-8556-0851, e-mail: alexandrasidor4uk@gmail.com

Sergey Y. Korovkin, Doctor of Psychology, Professor of Department of General Psychology, P. G. Demidov Yaroslavl State University, Head of the Laboratory of Psychology and Psychophysiology of Creativity, Institute of Psychology of Russian Academy of Sciences, Yaroslavl, Russian Federation, ORCID: https://orcid.org/0000-0001-7890-4366, e-mail: korovkin_su@list.ru

Contribution of the authors

Alexandra R. Sidorchuk — ideas; annotation, writing and design of the manuscript; planning of the research; design a script for research; conducting the experiment; data collection.

Sergei Yu. Korovkin — ideas; planning of the research, application of statistical, mathematical and other methods for data analysis; data analysis; visualization of research results.

Both authors participated in the discussion of the results and approved the final text of the manuscript.

Conflict of interest

The authors declare no conflict of interest.

Metrics

 Web Views

Whole time: 2
Previous month: 0
Current month: 2

 PDF Downloads

Whole time: 1
Previous month: 0
Current month: 1

 Total

Whole time: 3
Previous month: 0
Current month: 3