Adaptation and providing validity evidence for the Satisfaction with School Subscale and Satisfaction with Friends Subscale of Multidimensional Students’ Life Satisfaction Scale

1207

Abstract

The paper describes both the process and the results of adaptation and providing validity evidence for the Russian version of two subscales (Satisfaction with School and Satisfaction with Friends) of Multidimensional Students’ Life Satisfaction Scale (sample of third-grade pupils, N = 1729). Thisquestionnaireisoneofthemostsignificantscalesin the history of studying subjective well-being in primary schoolworldwide, although it has not been adapted in Russia yet. Adaptation has been carried according to the International Test Commission Guidelines for Translating and Adapting Test. ValiditywasinterpretedaccordingtotheDutch Committee on Testing (COTAN)practice. Psychometric analysis included applying of Classical Test Theory, Confirmatory Factor Analysis and Item Response Theory methods. It revealed high psychometric quality of the adapted subscales after deletion of the very three items the other studies suggest as problematic.

General Information

Keywords: Multidimensional Students’ Life Satisfaction Scale, Item Response Theory, Adaptation for Russian language, Validity evidence, primary school

Journal rubric: General Psychology

Article type: scientific article

DOI: https://doi.org/10.17759/jmfp.2018070306

For citation: Kanonire T.N., Uglanova I.L., Federiakin D.A. Adaptation and providing validity evidence for the Satisfaction with School Subscale and Satisfaction with Friends Subscale of Multidimensional Students’ Life Satisfaction Scale [Elektronnyi resurs]. Sovremennaia zarubezhnaia psikhologiia = Journal of Modern Foreign Psychology, 2018. Vol. 7, no. 3, pp. 64–74. DOI: 10.17759/jmfp.2018070306. (In Russ., аbstr. in Engl.)

References

  1. Osin E.N. Izmerenie pozitivnykh i negativnykh emotsii: razrabotka russkoyazychnogo analoga metodiki PANAS [Elektronnyi resurs] [Measurement of positive and negative emotions: development of the Russian-language analogue of the PANAS method ]. Psikhologiya. Zhurnal Vysshei shkoly ekonomiki [Psychology. Journal of Higher School of Economics], 2012, vol. 9, no. 4, pp. 91–110. Available at: https://cyberleninka.ru/article/v/izmerenie-pozitivnyh-i-negativnyh-emotsiy-razrabotka-russkoyazychnogo-analoga-metodiki-panas (Accessed 02.09.2018). (In Russ.; Abstr. in Engl.).
  2. Osin E.N., Leont'ev D.A. Aprobatsiya russkoyazychnykh versii dvukh shkal ekspress otsenki sub"ektivnogo blagopoluchiya [Testing of the Russian versions of the two scales express assessment of subjective well-being]. Materialy III Vserossiiskogo sotsiologicheskogo kongressa (g. Moskva, 21–24 oktyabrya 2008) [Materials of the III All-Russian Sociological Congress (Moscow, October 21–24, 2008)]. Moscow: Institut sotsiologii RAN, 2008. (In Russ.).
  3. Osin E.N., Rasskazova E.I. Kratkaya versiya testa zhiznestoikosti: psikhometricheskie kharakteristiki i primenenie v organizatsionnom kontekste [Short version of the test of resilience: psychometric characteristics and application in an organizational context]. Vestnik Moskovskogo universiteta. Seriya 14. Psikhologiya [Moscow University Herald. Series 14. Psychology.], 2013, no. 2, pp. 147–165. Available at: http://msupsyj.ru/pdf/vestnik_2013_2/vestnik_2013-2_147-165.Pdf (Accessed 02.09.2018). (In Russ.).
  4. Andersen E.B. The rating scale model. In Handbook of modern item response theory W.J. van der Linden, R.K. Hambleton (eds.). NY: Springer, 1997. P. 67–84. doi:10.1007/978-1-4757-2691-6_4
  5. Andrews F.M., Withey S.B. Social indicators of well-being: America’s perception of life quality. New York: Plenum Press, 1976. 476 p.
  6. Borgers N., de Leeuw E., Hox J. Children as respondents in survey research: Cognitive development and response quality. Bulletin of Sociological Methodology, 2000, vol. 66, no. 1, pp. 60–75. doi:10.1177/075910630006600106
  7. Bradburn N.M. The structure of psychological well-being. Chicago: Aldine, 1969. 332 p.
  8. Bradley K.D., Cunningham J.D., Gilman R. Measuring adolescent life satisfaction: A psychometric investigation of the Multidimensional Students’ Life Satisfaction Scale (MSLSS). Journal of Happiness Studies, 2014, vol. 15, no. 6, pp. 1333–1345. doi:10.1007/s10902-013-9478-z
  9. Brown T.A. Confirmatory Factor Analysis for Applied Research: First Edition. NY: Guilford, 2008. 462 p.
  10. Gilman R. et al. Cross-national adolescent multidimensional life satisfaction reports: Analyses of mean scores and response style differences. Journal of Youth and Adolescence, 2008, vol. 37, no. 2, pp. 142–154. doi:10.1007/s10964-007-9172-8
  11. Diener E. Subjective well-being. Psychological Bulletin, 1984, vol. 95, no. 3, pp. 542–575. doi:10.1037/0033-2909.95.3.542
  12. Fenouillet F. et al. French validation of the Multidimensional Students' Life Satisfaction Scale. Canadian Journal of Behavioural Science, 2015, vol. 47, no. 1, pp. 83–90. doi:10.1037/a0037624
  13. Huebner E.S. et al. Further Validation of the Multidimensional Students' Life Satisfaction Scale. Journal of Psychological Assessment, 1998, vol. 16, no. 2, pp. 118–134. doi:10.1177/073428299801600202
  14. Pavot W.G. et al. Further validation of the Satisfaction with Life Scale: Evidence for the cross-method convergence of well-being measures. Journal of Personality Assessment, 1991, vol. 57, no. 1, pp. 149–161. doi:10.1207/s15327752jpa5701_17
  15. Huebner E.S. Preliminary development and validation of a multidimensional life satisfaction scale for children. Psychological Assessment, 1994, vol. 6, no. 2, pp. 149–158. doi:10.1037/1040-3590.6.2.149
  16. Huebner E.S., Gilman R., Laughlin J.E. A multimethod investigation of the multidimensionality of children's well-being reports: Discriminant validity of life satisfaction and self-esteem. Social Indicators Research, 1999, vol. 46, no. 1, pp. 1–22. doi:10.1023/A:1006821510832
  17. Huebner E.S., Zullig K.J., Saha R. Factor structure and reliability of an abbreviated version of the Multidimensional Students’ Life Satisfaction Scale. Child Indicators Research, 2012, vol. 5, no. 4, pp. 651–657. doi:10.1007/s12187-012-9140-z
  18. International Test Commission. ITC Guidelines for Translating and Adapting Tests (Second Edition). International Journal of Testing, 2018, vol. 18, no. 2, pp. 101–134. doi:10.1080/15305058.2017.1398166
  19. Irmak S., Kuruüzüm A. Turkish validity examination of the multidimensional students’ life satisfaction scale. Social Indicators Research, 2009, vol. 92, no. 1, pp. 13–23. doi:10.1007/s11205-008-9284-x
  20. Jovanovic V., Zuljevic D. Psychometric evaluation of the serbian version of the Multidimensional Students’ Life Satisfaction Scale. Social Indicators Research, 2013, vol. 110, no. 1, pp. 55–69. doi:10.1007/s11205-011-9916-4
  21. Linacre J.M. Optimizing Rating Scale Category Effectiveness. Journal of Applied Measurement, 2002, vol. 3, no. 1, pp. 85–106. Available at: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.424.2811&rep=rep1&type=pdf (Accessed 02.09.2018).
  22. Rhemtulla M., Brosseau-Liard P.É., Savalei V. When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological methods, 2012, vol. 17, no. 3, pp. 354–373. doi:10.1037/a0029315
  23. Sawatzky R. et al. Sample heterogeneity and the measurement structure of the Multidimensional Students’ Life Satisfaction Scale. Social Indicators Research, 2009, vol. 94, no. 2, pp. 273–296. doi:10.1007/s11205-008-9423-4
  24. Tavakol M., Dennick R. Making sense of Cronbach's alpha. International journal of medical education, 2011, no. 2, pp. 53–55. doi:10.5116/ijme.4dfb.8dfd
  25. ten Berge J.M.F., Zegers F.E. A series of lower bounds to the reliability of a test. Psychometrika, 1978, vol. 43, no. 4, pp. 575–579.
  26. Evers A. et al. The Dutch review process for evaluating the quality of psychological tests: History, procedure, and results. International Journal of Testing, 2010, vol. 10, no. 4, pp. 295–317. doi:10.1080/15305058.2010.518325
  27. Diener E. et al. The Satisfaction with Life Scale. Journal of Personality Assessment, 1985, vol. 49, no. 1, pp. 71–75. doi:10.1207/s15327752jpa4901_13
  28. Van Sonderen E., Sanderman R., Coyne J.C. Ineffectiveness of reverse wording of questionnaire items: Let’s learn from cows in the rain. PLoS One, 2013, vol. 8, no. 9. doi:10.1371/journal.pone.0068967
  29. Veronese G., Pepe A. Cross-cultural adaptation, psychometric proprieties and factor structure of the Multidimensional Student Life Satisfaction Scale (MSLSS): A study with Palestinian children living in refugee camps. Current Psychology, 2018, pp. 1–10. doi:10.1007/s12144-018-9891-x
  30. Watson D., Clark L.A., Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of personality and social psychology, 1988, vol. 54, no. 6, pp. 1063–1070. doi:10.1037/0022-3514.54.6.1063
  31. Wolfe E.W., Dobria L. Applications of the Multi-Faceted Rasch Model. In Best Practices in Quantitative Methods J.W. Osborne (ed.). LA: Sage, 2008. P. 71–85.
  32. Wright B.D. Reliability and separation. Rasch measurement transactions, 1996, vol. 9, no. 4, pp. 472.
  33. Wright B.D., Linacre J.M. Reasonable mean-square fit values. Rasch Measurement Transactions, 1994, vol. 8, pp. 370–371.

Information About the Authors

Tatiana N. Kanonire, Doctor of Psychology, Assistant Professor, in Institute of Education, National Research University Higher School of Economics, Moscow, Russia, ORCID: https://orcid.org/0000-0001-5606-8379, e-mail: tkanonir@hse.ru

Irina L. Uglanova, Junior Research Fellow, Centre for Psychometrics and Measurements in Education, National Research University Higher School of Economics, Moscow, Russia, ORCID: https://orcid.org/0000-0001-9117-5997, e-mail: iuglanova@hse.ru

Denis A. Federiakin, Post-Graduate Student, Research Intern in the Centre for Monitoring the Quality in Education, Institute of Education, National Research University «Higher School of Economics», Moscow, Russia, e-mail: dafederiakin@hse.ru

Metrics

Views

Total: 2119
Previous month: 13
Current month: 16

Downloads

Total: 1207
Previous month: 24
Current month: 21