Psychometric Properties of the Russian Version of the Perceived Stress Scale (PSS-4, 10, 14)

This study was aimed to adapt and analyze the psychometric properties of the Perceived Stress Scale (PSS) in its full (PSS-14) and two short versions (PSS-10, PSS-4). Psychometric analysis of the Russian versions of the PSS was performed on a sample of 558 Russian-speaking respondents, including 278 men and 280 women aged 18 to 78 (M=48.10; SD=13.91). The participants completed the Russian versions of the PSS and Depression, Anxiety, and Stress Scale-21 (DASS-21). The factor validity of the PSS was assessed by exploratory and confirmatory factor analyses, which indicated a two-factor structure, including distress factor (direct-item scale) and coping factor (reverse-item scale). Perceived stress scores correlated positively on all versions of the PSS with psychological distress scores on the DASS-21. The internal reliability of the adapted scales was revealed by α-Cronbach’s coefficients, whose values were α=0.841 for PSS-14, α=0.831 for PSS-10, and α=0.703 for PSS-4. The known-groups validity was confirmed by the fact that women scored higher on perceived stress on the PSS-14, PSS-10, and PSS-4. In conclusion, the PSS-10 is preferred for research tasks and the PSS-4 can be used in time-limited testing conditions.

1. Ababkov V.A., Barisnikov K., Vorontzova-Wenger O.V. et al. Validizatsiya russkoyazychnoi versii oprosnika «Shkala vosprinimaemogo stressa-10» [Validation of the Russian version of the questionnaire «Scale of Perceived Stress-10»]. Vestnik Sankt-Peterburgskogo universiteta. Psikhologiya = Vestnik of Saint Petersburg University. Psychology, 2016, no. 2, pp. 6–15. DOI: 10.21638/11701/spbu16.2016.202 (In Russ., abstr. in Engl.).
2. Zolotareva A.A. Psikhometricheskaya otsenka russkoyazychnoi versii shkaly depressii, trevogi i stressa (DASS-21) [Psychometric examination of the Russian version of the Depression, Anxiety, and Stress Scales-21] // Psikhologicheskii zhurnal = Psychological Journal, 2021, vol. 42, no. 5, pp. 80–88. DOI: 10.31857/S020595920017077-0 (In Russ., abstr. in Engl.).
3. Zolotareva A.A. Sistematicheskii obzor psikhometricheskikh svoistv shkaly depressii, trevogi i stressa (DASS-21). [Systematic review of the psychometric properties of the Depression Anxiety and Stress Scale-21 (DASS-21)]. Obozrenie psikhiatrii i meditsinskoi psikhologii imeni V.M.Bekhtereva = V.M. Bekhterev Review of Psychiatry and Medical Psychology, 2020, no. 2, pp. 26–37. DOI: 10.31363/2313-7053-2020-2-26-37
4. Anwer S., Manzar M.D., Alghadir A.H. et al. Psychometric analysis of the Perceived Stress Scale among healthy university students. Neuropsychiatric Disease and Treatment, 2020, vol. 16, pp. 2389–2396. DOI: 10.2147/NDT.S268582
5. Behr D. Assessing the use of back translation: The shortcomings of back translation as a quality testing method. International Journal of Social Research Methodology, 2017, vol. 20, no. 6, pp. 573–584. DOI: 10.1080/13645579.2016.1252188
6. Boluarte-Carbajal A., Navarro-Flores A., Villarreal-Zegarra D. Explanatory model of perceived stress in the general population: A cross-sectional study in Peru during the COVID-19 context. Frontiers in Psychology, 2021, vol. 12, article 673945. DOI: 10.3389/fpsyg.2021.673945
7. Byrne B.M. Structural equation modeling with EQS and EQS/Windows. Thousand Oaks, CA: Sage Publications, 1994. 304 p.
8. Chaaya M., Osman H., Naassan G. et al. Validation of the Arabic version of the Cohen perceived stress scale (PSS-10) among pregnant and postpartum women. BMC Psychiatry, 2010, vol. 10, article 111. DOI: 10.1186/1471-244X-10-111
9. Cohen J. Statistical power analysis for the behavioral sciences (2nd). Hillside, NJ: Lawrence Erlbaum Associates, 1988. 568 p.
10. Cohen S., Kamarck T., Mermelstein R. A global measure of perceived stress. Journal of Health and Social Behavior, 1983, vol. 24, no. 4, pp. 385–396. URL: https://webs.wofford.edu/steinmetzkr/teaching/Psy150/Lecture%20PDFs/PSS.pdf (Accessed: 22.03.2023).
11. Cohen S. Perceived stress in a probability sample of the United States. In S. Spacapan, S. Oskamp (eds.), The Social Psychology of Health. Sage Publications, Inc., 1988. Pp. 31–67.

12. Dao-Tran T., Anderson D., Seib C. The Vietnamese version of the Perceived Stress Scale (PSS-10): Translation equivalence and psychometric properties among older women. BMC Psychiatry, 2017, vol. 17, no. 1, article 53. DOI: 10.1186/s12888-017-1221-6

13. Eklund M., Bäckström M., Tuvesson H. Psychometric properties and factor structure of the Swedish version of the Perceived Stress Scale. Nordic Journal of Psychiatry, 2014, vol. 68, no. 7, pp. 494–499. DOI: 10.3109/08039488.2013.877072
14. Fan X., Thompson B., Wang L. Effects of sample size, estimation method, and model specification on structural equation modeling fit indexes. Structural Equation Modeling, 1999, vol. 6, no. 1, pp. 56–83. DOI: 10.1080/10705519909540119
15. Figalová N., Charvát M. The perceived stress scale: Reliability and validity study in the Czech Republic. Československá Psychologie, 2021, vol. 65, no. 1, pp. 46–59. DOI: 10.51561/cspsych.65.1.46
16. George D., Mallery P. SPSS for Windows step by step: A simple guide and reference 17.0 Update (10th). Pearson, Boston, 2010.

17. González-Ramírez M.T., Rodríguez-Ayán M.N., Hernández R.L. The perceived stress scale (PSS): Normative data and factor structure for a large-scale sample in Mexico. Spanish Journal of Psychology, 2013, vol. 16, e47. DOI: 10.1017/sjp.2013.35

18. Herbell K., Breitenstein S.M., Ault S. et al. Prevalence and correlates of anxiety, depression, perceived stress, and post-traumatic stress symptoms in parents with adolescents in residential treatment. Residential Treatment for Children and Youth, 2022, vol. 39, no. 3, pp. 312–330. DOI: 10.1080/0886571X.2022.2038338
19. Huang F., Wang H., Wang Z. et al. Psychometric properties of the perceived stress scale in a community sample of Chinese. BMC Psychiatry, 2020, vol. 20, article 130. DOI: 10.1186/s12888-020-02520-4
20. Hou Y., Yan S., Zhang L. et al. Perceived stress and life satisfaction among elderly migrants in China: A moderated mediation model. Frontiers in Psychology, 2022, vol. 13, article 978499. DOI: 10.3389/fpsyg.2022.978499
21. Jiang J.M., Seng E.K., Zimmerman M.E. et al. Evaluation of the reliability, validity, and predictive validity of the subscales of the Perceived Stress Scale in older adults. Journal of Alzheimer’s Disease, 2017, vol. 59, no. 3, pp. 987–996. DOI: 10.3233/JAD-170289
22. Jovanovic V., Gavrilov-Jerkovic V. More than a (negative) feeling: Validity of the perceived stress scale in Serbian clinical and non-clinical samples. Psihologija, 2015, vol. 48, no. 1, pp. 5–18. DOI: 10.2298/PSI1501005J
23. Juárez-García A., Merino-Soto C., Brito-Ortiz J.F. et al. Is it the perceived stress scale (PSS) undimimensional and invariant? A Bifactor analysis in Mexican adults. Current Psychology, 2021. DOI: 10.1007/s12144-021-02067-x (In Press).
24. Katsarou A., Panagiotakos D., Zafeiropoulou A. et al. Validation of a Greek version of PSS-14; a global measure of perceived stress. Central European Journal of Public Health, 2012, vol. 20, no. 2, pp. 104–109. DOI: 10.21101/cejph.a3698
25. Kim H.J. Reliability and validity of the 4-item version of the Korean perceived stress scale. Research in Nursing and Health, 2016, vol. 39, no. 6, pp. 472–479. DOI: 10.1002/nur.21745
26. Klein E.M., Brähler E., Dreier M. et al. The German version of the perceived stress scale – psychometric characteristics in a representative German community sample. BMC Psychiatry, 2016, vol. 16, article 159. DOI: 10.1186/s12888-016-0875-9
27. Lee B., Jeong H.I. Construct validity of the perceived stress scale (PSS-10) in a sample of early childhood teacher candidates. Psychiatry and Clinical Psychopharmacology, 2019, vol. 29, no. 2, pp. 1–7. DOI: 10.1080/24750573.2019.1565693
28. Lee E.H. Review of the psychometric evidence of the Perceived Stress Scale. Asian Nursing Research, 2012, vol. 6, no. 4, pp. 121–127. DOI: 10.1016/j.anr.2012.08.004
29. Lee E.H., Chung B.Y., Suh C.H. et al. Korean versions of the Perceived Stress Scale (PSS-14, 10 and 4): Psychometric evaluation in patients with chronic disease. Scandinavian Journal of Caring Sciences, 2015, vol. 29, no. 1, pp. 183–192. DOI: 10.1111/scs.12131
30. Lesage F.X., Berjot S., Deschamps F. Psychometric properties of the French versions of the Perceived Stress Scale. International Journal of Occupational Medicine and Environmental Health, 2012, vol. 25, no. 2, pp. 178–184. DOI: 10.2478/S13382-012-0024-8
31. Lindholdt L., Labriola M., Andersen J.H. et al. Perceived stress among adolescents as a marker for future mental disorders: A prospective cohort study. Scandinavian Journal of Public Health, 2022, vol. 50, no. 3, pp. 412–417. DOI: 10.1177/1403494821993719
32. Liu B., Qiao K., Lu Y. The relationship between perceived stress, state-trait anxiety, and sleep quality among university graduates in China during the COVID-19 pandemic. Frontiers in Psychology, 2021, vol. 12, article 664780. DOI: 10.3389/fpsyg.2021.664780
33. Liu X., Zhao Y., Li J. et al. Factor structure of the 10-item Perceived Stress Scale and measurement invariance across genders among Chinese adolescents. Frontiers in Psychology, 2020, vol. 11, article 537. DOI: 10.3389/fpsyg.2020.00537
34. Loubir D.B., Serhier Z., Battas O. et al. Evaluation of psychometric properties of the Arabic version of PSS stress measuring scale in the Moroccan population. SAGE Open, 2014, vol. 4, no. 4, pp. 1–6. DOI: 10.1177/2158244014564353
35. Lovibond P.F., Lovibond S.H. The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behaviour Research and Therapy, 1995, vol. 33, no. 3, pp. 335–343. DOI: 10.1016/0005-7967(94)00075-u
36. Marcoulides K.M., Yuan K.H. New ways to evaluate goodness of fit: A note on using equivalence testing to assess structural equation models. Structural Equation Modeling, 2017, vol. 24 (1), pp. 148–153. DOI: 1080/10705511.2016.1225260
37. Marsh H.W., Hau K.T., Wen Z. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 2004, vol. 11, no. 3, pp. 320–341. DOI: 10.1207/s15328007sem1103_2
38. Michaelides M.P., Christodoulou A., Kkeli N. et al. Factorial structure of the perceived stress scale and implications for scoring. European Review of Applied Psychology, 2016, vol. 66, no. 6, pp. 309–316. DOI: 1016/j.erap.2016.07.002
39. Mimura C., Griffiths P. A Japanese version of the Perceived Stress Scale: Cross-cultural translation and equivalence assessment. BMC Psychiatry, 2008, vol. 8, article 85. DOI: 10.1186/1471-244X-8-85
40. Miranda A.R., Scotta A.V., Méndez A.L. et al. Public sector workers’ mental health in Argentina: Comparative psychometrics of the Perceived Stress Scale. Journal of Preventive Medicine and Public Health, 2020, vol. 53, no. 6, pp. 429–438. DOI: 10.3961/jpmph.20.229
41. Mitchell A.M., Crane P.A., Kim Y. Perceived stress in survivors of suicide: Psychometric properties of the perceived stress scale. Research in Nursing and Health, 2008, vol. 31, no. 6, pp. 576–585. DOI: 10.1002/nur.20284
42. Mondo M., Sechi C., Cabras C. Psychometric evaluation of three versions of the Italian Perceived Stress Scale. Current Psychology, 2021, vol. 40, pp. 1884–1892. DOI: 10.1007/s12144-019-0132-8
43. Moreira M.F., Gamboa O.L., Oliveira M.A.P. Association between severity of pain, perceived stress and vagally-mediated heart rate variability in women with endometriosis. Women Health, 2021, vol. 61, no. 10, pp. 937–946. DOI: 10.1080/03630242.2021.1993423
44. Netemeyer R.G., Bearden W.O., Sharma S. Scaling procedures: Issues and applications. London: Sage, 2003. 206 p.
45. Nunnally J.C., Bernstein I.H. Psychometric theory (3rd). McGraw-Hill Inc., 1994. 752 p.
46. Prior A., Vestergaard M., Larsen K.K. et al. Association between perceived stress, multimorbidity and primary care health services: A Danish population-based cohort study. BMJ Open, 2018, vol. 8, e018323. DOI: 10.1136/bmjopen-2017-018323
47. Reis R.S., Hino A.A., Anez C.R. Perceived stress scale: Reliability and validity study in Brazil. Journal of Health Psychology, 2010, vol. 15, no. 1, pp. 107–114. DOI: 10.1177/1359105309346343
48. Ribeiro Santiago P.H., Nielsen T., Smithers L.G. et al. Measuring stress in Australia: Validation of the perceived stress scale (PSS-14) in a national sample. Health and Quality of Life Outcomes, 2020, vol. 18, article 100. DOI: 10.1186/s12955-020-01343-x
49. Ruisoto P., López-Guerra V.M., Paladines M.B. et al. Psychometric properties of the three versions of the Perceived Stress Scale in Ecuador. Physiology and Behavior, 2020, vol. 224, article 113045. DOI: 10.1016/j.physbeh.2020.113045
50. Schneider E.E., Schönfelder S., Domke-Wolf M. et al. Measuring stress in clinical and nonclinical subjects using a German adaptation of the Perceived Stress Scale. International Journal of Clinical and Health Psychology, 2020, vol. 20, no. 2, pp. 173–181. DOI: 10.1016/j.ijchp.2020.03.004
51. Seo E.J., Ahn J.A., Hayman L.L. et al. The association between perceived stress and quality of life in university students: The parallel mediating role of depressive symptoms and health-promoting behavior. Asian Nursing Research, 2018, vol. 12, no. 3, pp. 190–196. DOI: 10.1016/j.anr.2018.08.001
52. She Z., Li D., Zhang W. et al. Three versions of the Perceived Stress Scale: Psychometric evaluation in a nationally representative sample of Chinese adults during the COVID-19 pandemic. International Journal of Environmental Research and Public Health, 2021, vol. 18, no.16, article 8312. DOI: 10.3390/ijerph18168312
53. Sipowicz K., Pietras T., Podlecka M. et al. The association between depression and perceived stress among parents of autistic and non-autistic children – the role of loneliness. International Journal of Environmental Research and Public Health, 2022, vol. 19, no. 5, article 3019. DOI: 10.3390/ijerph19053019
54. Soria-Reyes L.M., Cerezo M.V., Alarcón R. et al. Psychometric properties of the perceived stress scale (pss-10) with breast cancer patients. Stress and Health, 2023, vol. 39, no. 1, pp. 115–124. DOI: 10.1002/smi.3170
55. Tavakol M., Dennick R. Making sense of Cronbach’s alpha. International Journal of Medical Education, 2011, vol. 2, pp. 53–55. DOI: 10.5116/ijme.4dfb.8dfd
56. Weaver K.R., Melkus G.D.E., Fletcher J. et al. Perceived stress, its physiological correlates, and quality of life in patients with irritable bowel syndrome. Biological Research for Nursing, 2018, vol. 20, no. 3, pp. 312–320. DOI: 10.1177/1099800418756733
57. Wiegner L., Hange D., Björkelund C. et al. Prevalence of perceived stress and associations to symptoms of exhaustion, depression and anxiety in a working age population seeking primary care – an observational study. BMC Family Practice, 2015, v 16, article 38. DOI: 10.1186/s12875-015-0252-7
58. Wongpakaran N., Wongpakaran T. The Thai version of the PSS-10: An investigation of its psychometric properties. BioPsychoSocial Medicine, 2010, vol. 4, article 6. DOI: 10.1186/1751-0759-4-6
59. World Medical Association. World Medical Association Declaration of Helsinki. Ethical principles for medical research involving human subjects. JAMA, 2013, vol. 310, no. 20, pp. 2191–2194. DOI: 10.1001/jama.2013.281053
60. Yin H., Cheng X., Liang Y. et al. High perceived stress may shorten activated partial thromboplastin time and lead to worse clinical outcomes in patients with coronary heart disease. Frontiers in Cardiovascular Medicine, 2021, vol. 8, article 769857. DOI: 10.3389/fcvm.2021.769857