Measuring Intercultural Competence in Teachers: Development and Evaluation of Situational Judgment Test

385

Abstract

The article describes the development and testing of the SJT-ICC situational judgment test designed to measure intercultural competence of a teacher in the form of behavioral preferences in the professional field of interaction with students and their parents. This approach makes it possible to assess behavioral aspects of intercultural competence in a particular professional area more effectively than survey methods. The SJT-ICC consists of 18 cases from pedagogical practice and four possible behavioral options for the teachers, from which the subject must choose the most appropriate one. These situations were prepared on the basis of qualitative research in the format of in-depth interviews centered around difficult, critical situations that a teacher encounters when working with children and par¬ents from other cultures (n=53). The assessment of the intercultural competence of the answer options was made on the basis of an expert survey of 23 special-ists.1367 teachers took part in the research to validate and check the consisten¬cy of the SJT-ICC. The outcome of the categorical principal component analysis (CatPCA) was a one-scale structure of the SJT-ICC which was confirmed by the confirmatory factor analysis. The relationship between the results of the SJT-ICC and the scales used for validation is predictable: intercultural competence is associated with indicators of professional success of a teacher working with students of other cultures. It is concluded that the SJT-ICC can be effectively used to assess the prerequisites for intercultural success among Russian teachers.

General Information

Keywords: intercultural competence, teacher, situational judgment test, cross-cultural communication, immigrants

Journal rubric: Educational Psychology

Article type: scientific article

DOI: https://doi.org/10.17759/pse.2021260603

Funding. The reported study was supported by the MSUPE project «Measuring intercultural compe¬tence in teachers».

Received: 29.10.2021

Accepted:

For citation: Khukhlaev O.E., Pavlova O.S., Khakimov E.R., Khukhlaeva O.V., Аlexandrova E.A., Krivtsova A.S., Leybman I.Y., Usybyan S.A. Measuring Intercultural Competence in Teachers: Development and Evaluation of Situational Judgment Test. Psikhologicheskaya nauka i obrazovanie = Psychological Science and Education, 2021. Vol. 26, no. 6, pp. 46–57. DOI: 10.17759/pse.2021260603. (In Russ., аbstr. in Engl.)

References

  1. Anastazi A., Urbina S.Psikhologicheskoe testirovanie [Psychological testing].In A.A.Alekseev (transl.and ed.).St.Petersburg.: Piter Publ., 2001.688 p.(In Russ.).
  2. Grigor’ev D.S.Diskriminatsiya migrantov v sotsioekonomicheskoi sfere: rol’ mezhgruppovykh ustanovok prinimayushchego naseleniya [Discrimination against migrants in the socioeconomic sphere: the role of intergroup attitudes of the host population]. Sotsial’naya psikhologiya i obshchestvo = Social psychology and society, 2017.Vol.8, no.3, pp.63—84.DOI:10.17759/ sps.2017080306 (In Russ.; abstr.in Engl.).
  3. Grigor’ev D.S., Batkhina A.A., Dubrov D.I.Assimilyatsionizm, mul’tikul’turalizm, etnicheskii dal’tonizm i polikul’turalizm v rossiiskom kontekste [Assimilationism, multiculturalism, ethnic color blindness and polyculturalism in the Russian context].Kul’turno-istoricheskaya psikhologiya = Cultural-historical psychology, 2018.Vol.14, no.2, pp.53—65.DOI:10.17759/chp.2018140206 (In Russ.; abstr.in Engl.).
  4. Larin N.A.Fenomen emotsional’nogo vygoraniya pri mezhkul’turnom vzaimodeistvii [The phenomenon of emotional burnout in intercultural interaction].Psikhologiya i Psikhotekhnika = Psychology and Psychotechnics, 2017, no.3, pp.1—9.Available at: https://nbpublish.com/library_read_article.php?id=23962 (Accessed 13.09.2020).(In Russ.; abstr.in Engl.).
  5. Lichutina E.I.Test situativnykh suzhdenii kak metod diagnostiki reshenii professional’nykh problem [Situational judgment test as a method for diagnosing solutions to professional problems].Ekonomika i menedzhment innovatsionnykh tekhnologii = Economics and management of innovative technologies, 2017, no.1.Available at: http://ekonomika.snauka.ru/2017/01/13784 (Accessed 13.09.2020).(In Russ.; abstr.in Engl.).
  6. Lengle A.Ekzistentsial’nyi analiz sindroma emotsional’nogo vygoraniya [Burnout from an existential analysis perspective].Voprosy psikhologii = Psychology issues, 2008, no.2, pp.3—16.(In Russ.).
  7. Rossiiskie pedagogi v zerkale mezhdunarodnogo sravnitel’nogo issledovaniya pedagogicheskogo korpusa [Russian teachers in the mirror of the international comparative research of the pedagogical corps] (TALIS 2013).In E.Lenskoi, M.Pinskoi (eds.); Nats.issled.un-t «Vysshaya shkola ekonomiki», In-t obrazovaniya.Sovremennaya analitika obrazovaniya.Vyp.1.Moscow: Izd.dom Vysshei shkoly ekonomiki, 2015.36 p.(In Russ.).
  8. Khukhlaev O.E., Tkachenko N.V.Otnoshenie rossiiskikh uchitelei k kul’turnomu raznoobraziyu v trudnykh pedagogicheskikh situatsiyakh: opyt kachestvennogo analiza [The Attitude of Russian Teachers to Cultural Diversity in Difficult Pedagogical Situations: An Experience of Qualitative Analysis].Izvestiya Saratovskogo universiteta.Novaya seriya.Akmeologiya obrazovaniya.Psikhologiya razvitiya [Saratov University Bulletin.New series.Acmeology of education.Developmental psychology], 2021 (v pechati).(In Russ.; abstr.in Engl.).
  9. Khukhlaev O.E., Gritsenko V.V., Pavlova O.S.i dr.Kompleksnaya model’ mezhkul’turnoi kompetentnosti: teoreticheskoe obosnovanie [Comprehensive model of intercultural competence: theoretical substantiation].Vestnik Rossiiskogo universiteta druzhby narodov. Seriya: Psikhologiya i pedagogika = Bulletin of the Peoples’ Friendship University of Russia. Series: Psychology and Pedagogy, 2020.Vol.17, no.1, pp. 13—28.DOI:10.22363/2313-1683-2020-17-1-13-28
  10. Bartel-Radic A., Giannelloni J.L.A Renewed Perspective on the Measurement of Cross-Cultural Competence: An Approach Through Personality Traits and Cross-Cultural Knowledge.European Management Journal, 2017.Vol.35, no.5, pp.632— 644.DOI:10.1016/j.emj.2017.02.003
  11. Bennett J.M., Bennett M.J. Developing intercultural sensitivity: An integrative approach to global and domestic diversity.In D.Landis, J.Bennett & M. Bennett (Eds.).Handbook of intercultural training. 3rd ed.Thousand Oaks: Sage, 2004, pp.147—165.
  12. Bledow R., Frese M. A situational judgment test of personal initiative and its relationship to performance.Personnel Psychology, 2009, no.62, pp.229—258.
  13. Comrey A. A first course on factor analysis. London, UK: Academic Press, 1973.429 р.
  14. Examining psychometric properties, measurement invariance, and construct validity of a short version of the Test to Measure Intercultural Competence (TMIC-S) in Germany and Brazil.Schnabel D.B.L.[et al.].International Journal of Intercultural Relations, 2015.Vol.49, pp.137—155.
  15. Hammer M.R., Bennett M.J. The Intercultural Development Inventory (IDI) manual.Portland, OR, Intercultural Communication Institute, 1999.174 р.
  16. Hernandez F., Kose B.W. The Developmental Model of Intercultural Sensitivity: A Tool for Understanding Principals’ Cultural Competence. Education and Urban Society, 2012, no.4(44), pp.512—530.
  17. Hu L., Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 1999, no.6(1), pp.1—55.DOI:10.1080/10705519909540118
  18. Leung K., Ang S., Tan M.L. Intercultural Competence. Annual Review of Organizational Psychology & Organizational Behavior, 2014.Vol.1, pp.489—519.
  19. 19. Linting M., van der Kooij A. Nonlinear Principal Components Analysis with CATPCA: A Tutorial.Journal of Personality Assessment, 2012.Vol.94, no.1, pp. 12—25.DOI:10.1080/00223891.2011.627965
  20. McAllister G., Irvine J.J. Cross Cultural Competency and Multicultural Teacher Education.Review of Educational Research, 2000.Vol.70, no.1, pp.3—24.
  21. Rissanen I., Kuusisto E., Kuusisto A. Developing teachers’ intercultural sensitivity: Case study on a pilot course in Finnish teacher education. Teaching and Teacher Education, 2016, no.59, pp.446—456.DOI:10.1016/j.tate.2016.07.018
  22. Rosenthal L., Levy S.R. The relation between polyculturalism and intergroup attitudes among racially and ethnically diverse adults. Cultural Diversity and Ethnic Minority Psychology, 2012.Vol.18, pp.1—16.
  23. Schwarzer R., Jerusalem M. Generalized Self- Efficacy scale. Measures in health psychology: A user’s portfolio. Ed. J.Weinman, S.Wright & M.Johnston.UK: NFER-NELSON, 2015, pp.35—37.
  24. Tatar M., Horenczyk G. Diversity-related burnout among teachers.Teaching and Teacher Education, 2003, no.19, pp.397—408.
  25. Tatar M., Ben-Uri I., Horenczyk G. Assimilation attitudes predict lower immigration-related self-efficacy among Israeli immigrant teachers. European Journal of Psychology of Education, 2011, no.26, pp.247—255.
  26. Weekley J.A., Ployhart R.E. Situational Judgment Test: theory, measurement and application (ed.).International Situational Judgment Tests Filip Lievens, 2006, pp.279—300.
  27. Whaley A.L., Davis K.E. Cultural competence and evidence-based practice in mental health services: a complementary perspective. American Psychologist, 2007, no.62, pp.563—574.

Information About the Authors

Oleg E. Khukhlaev, PhD in Psychology, Assistant Professor, Jewish Museum and Tolerance Center, Acre, Israel, ORCID: https://orcid.org/0000-0002-4620-9534, e-mail: huhlaevoe@mgppu.ru

Olga S. Pavlova, PhD in Education, Associate Professor, Head of the Department of Cross-cultural Psychology and Multicultural Education, Moscow State University of Psychology and Education, Moscow, Russia, ORCID: https://orcid.org/0000-0001-9702-1550, e-mail: os_pavlova@mail.ru

E. R. Khakimov, PhD in Education, Head, Education and Cultural Center Sippola, Sippola, Finland, ORCID: https://orcid.org/0000-0001-5745-815X, e-mail: eduard.khakimov@yahoo.com

Olga V. Khukhlaeva, Doctor of Education, associate professor, professor of the Chair of Ethnopsychology and Psychological Problems in Multicultural Education, Moscow State University of Psychology & Education, Moscow, Russia, ORCID: https://orcid.org/0000-0002-8782-7742, e-mail: ovc54@yandex.ru

Elena A. Аlexandrova, PhD in Culture, associate professor at the chair of etnopsychology and psychological problems of multicultural education, Moscow State University of Psychology and Education, Moscow, Russia, ORCID: https://orcid.org/0000-0002-6675-6965, e-mail: aleksandrovaae@gmail.com

Anna S. Krivtsova, PhD in Psychology, Associate Professor, Chair of Cross-Cultural Psychology and Psychological Problems in Multicultural Education, Moscow State University of Psychology & Education, Moscow, Russia, ORCID: https://orcid.org/0000-0002-3297-8500, e-mail: edmond21@yandex.ru

Irina Y. Leybman, PhD in Psychology, Associate Professor, Chair of Cross-Cultural Psychology and Psychological Problems in Multicultural Education, Moscow State University of Psychology & Education, Moscow, Russia, ORCID: https://orcid.org/0000-0002-0851-5186, e-mail: irina.leybman@gmail.com

Shushanik A. Usybyan, UMR Specialist of the International Relations Department of MSPPU, Moscow State University of Psychology & Education, Post-Graduate Student of the Moscow State Psychological and Pedagogical University (MSPPU), Moscow, Russia, ORCID: https://orcid.org/0000-0003-4427-6677, e-mail: usubyansha@mgppu.ru

Metrics

Views

Total: 976
Previous month: 16
Current month: 17

Downloads

Total: 385
Previous month: 7
Current month: 7