Psychological Problems of Adolescents in Real and Virtual Environments: Questionnaire Standardization

The need to create a questionnaire to study the psychological problems of adolescents in real and virtual environments arose since previously created and available methods in this sphere did not consider the influence of the virtual environment as a factor of socialization. The article reveals the continuity in the development of methodological tools for the study of psychological problems of adolescents and shows the novelty of the new questionnaire. The questionnaire was created and standardized during five consecutive stages (collection of primary empirical material, procedures of linguistic and frequency analysis, assessment of reliability, validity, double factorization, determination of age norms). 566 teenagers aged 13-17 years took part in standardization. The result of this work is a new psychodiagnostic tool that allows to determine the degree of adolescents’ concern with psychological problems, both in real life and in connection with their immersion in the Internet environment.

Introduction

An individual’s psychological problems, including those of adolescents, are conditioned not only by the individual’s own development situation and environment, but also by the socio-economic conditions in which the individual lives—in other words, by the microsystem, the mesosystem and the macrosystem, as described by U. Bronfenbrenner. That is why any study of psychological problems which does not take into account the environment and its changes will either lack objectivity or fail to be informative. This assumption is based on the results of a 20-year-long study of psychological problems in adolescents—during this entire period, the research tools have been constantly improved and adapted to keep pace with Russia’s socio-economic reality. Digitalization profoundly transforms people’s lives and brings not only increased comfort, but also psychological problems. That is why the available tools used to study psychological problems in adolescents needed to be adapted to take into account the new conditions of socialization.

Our questionnaire is a modification of I. Seiffge-Krenke’s Adolescents’ Psychological Problems Questionnaire which was developed and standardized in 1984 [34]. When both Germany and Russia entered a period of socio-economic crises, the questionnaire was adapted having regard to the new conditions—specifically, to the new stressors [3; 32]. Psychologists in Russia started to use the questionnaire in 1993 to identify both the content and degree of adolescents’ concerns in the conditions of socio-economic crises followed by stabilization and economic growth (1993–2005) [10]. The years preceding 2010–12 were another period marked by major changes which increased the tension in people’s lives: terrorism, drug abuse, aftermath of the economic crisis, etc. These changes necessitated an update of empirical data about adolescents’ psychological problems and called for a new version of the questionnaire to be developed and standardized [14]. The new questionnaire was used in multiple studies and proven to be valid and reliable [2; 5; 6; 11].

Digitalization has made its own contribution to the process of socialization of people belonging to different age groups, but academic literature shows that it is adolescents who are most affected by it [4; 9; 17; 21; 28], and this fact needs to be factored in when studying psychological problems. Psychological studies focusing on the internet and technology—i.e., studies on computer addiction, the impact of technology on psychological boundaries, and involvement and self-representation on the internet—are paying increasing attention to the awareness of various aspects of one’s self, including psychological problems, in real and virtual environments [12; 16; 30; 35].

We examined the available methods of psychological assessment and carried out a theoretical analysis of different up-to-date approaches used to operationalize the concepts “psychological problem” and “immersion in the internet environment” [13; 15]. This revealed a need for another modification of the original questionnaire in order to study psychological problems in real and virtual environments within the emotional-reflexive approach.   

We define a “psychological problem” within the said approach as the “presence of—1) a contradiction which is realized by an individual in the context of his/her current life situation; 2) an emotional response to that contradiction as a factor which makes life more difficult; and 3) the willingness (or need) to resolve the contradiction in order to improve the course of one’s life” [13].

Measurement methods and questionnaire development stages

We developed and standardized Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire in compliance with the applicable requirements and using standard procedures to test the validity, reliability and factorial structure of the questionnaire [36].

The following statistical methods were used to test the psychometric properties of the questionnaire: descriptive statistics, the Kolmogorov–Smirnov test to compare the forms of distributions, the reliability index (Cronbach’s a, the Guttman split-half coefficient), correlation analysis (Spearman’s ρ), factor analysis (principal component analysis, Varimax rotation with Kaiser normalization) and confirmatory factor analysis.

Our questionnaire sought to have regard to the current changes in adolescents’ environment and was developed in five stages from February to November 2021.    

The first stage involved collection of empirical data on psychological problems faced by adolescents in the internet environment. The empirical data were collected using focus groups interviews with 132 adolescents. The work of the focus groups was based on the standardized Adolescents’ Psychological Problems Questionnaire [14] which included questions corresponding to various problem areas which we identified and described earlier: school, leisure, relationships with parents and peers, self-image, health, future, and situation in society [11; 14]. However, in the present study we paid primary attention to the interrelations between the problems which the respondents encounter in various areas of life when using the internet or influenced by the internet environment. The processing and linguistic analysis of the data obtained in focus groups allowed us to make a list of such problems. The list was structured by the areas mentioned above and, after an expert examination of the problems voiced by the respondents, contained 91 items.

The second stage involved a sample of 292 adolescents aged 11–17 who were surveyed (both online and offline) in order to statistically confirm the relevance and commonality of internet-related psychological problems. The second stage also involved frequency analysis of the data. The most frequent psychological problems (28 survey items) turned out to be mainly connected to two factors—personal safety on the internet and the lack of self-sufficiency (dependence on the internet).  

The third stage aimed to ascertain whether internet-related problems constitute a separate area of concern for adolescents or supplement the problem areas described earlier. To that end, we complemented the previous version of the Adolescents’ Psychological Problems Questionnaire, which consisted of 93 items, with the 28 items selected during the frequency analysis. The resulting list (121 items) corresponded to various problems experienced by adolescents both in real and in virtual environments. We surveyed 299 adolescents aged 13–17 who assessed the intensity of experiencing each problem on a scale of 1 to 5.  

We carried out a factor analysis on the data obtained from the sample (299 respondents) using the principal component analysis with Varimax rotation. As a result, we identified six factors which explain 44.5% of the variance.  

Table 1

Results of primary factor analysis—explained variance 

The factor analysis confirmed that internet-related problems constitute a separate group (factor 5) in the structure of adolescents’ concerns—this group includes 17 out of 28 questions which focused on this topic in the initial list. At the same time, internet-related problems affect various areas of adolescents’ life: communication, self-awareness, emotional well-being, etc. The examples are: “If I don’t have the internet, I’m afraid to miss some of the events which are important for my friends and me”, “I’m afraid that my life will be joyless if the internet disappears”, “Without the internet, I feel as if my hands are tied”. This confirms the change in adolescents’ life reality [21; 24] and mutual penetration of their real and virtual environments—the facts that have been also described by other scholars [8].

The factor analysis produced one more important result. It revealed the transformation of problem areas. In addition to the internet, new areas emerged: problems related to personal safety both in real and virtual environments and problems related to identity formation. The former correlates with the data of G.U. Soldatova and E.I. Rasskazova [19], while the latter embraces two previously separate areas of problems related to the future and to oneself.

The obtained empirical data revealed a need for the modification of Adolescents’ Psychological Problems Questionnaire that would embrace a new structure of problem areas relevant for adolescents. The modification includes six scales. Each scale contains 10 statements with the highest factor weights.

Sixty new questions were used during the fourth stage to survey additional 340 adolescents aged 13–17. Then, at stage five we confirmed the structure and standardized the new questionnaire through a confirmatory factor analysis on the total sample of 566 adolescents aged 13–17. The sample included 306 females and 260 males with a median age of 14.9 (Table 2).

Table 2

Sample’s age and gender distribution

 Results and discussion

The scales are highly reliable. The internal consistency calculated with Cronbach’s alpha coefficient varies between 0.84 and 0.90. The Guttman split-half coefficient varies between 0.80 and 0.89 suggesting a high reality of the scales. The only exception here is the scale “Problems related to internet immersion”, where the coefficient value is 0.76, which is close to high (Table 3).

Table 3

Reliability index: Cronbach’s alpha and Guttman split-half coefficient (N=566)

The scales and the total score were tested for normality using the Kolmogorov–Smirnov test. It showed that scales 2, 6 and the integral indicator of concern about problems are normally distributed, while scales 1, 3, 4, 5 are asymmetrical. This might be due to different degrees of commonality or variance of problems facing adolescents. 

As is seen in Table 4, all the scales of the new tool are significantly correlated (p≤0.01). The lowest correlation (r=0.18 to 0.28) is observed between the scale “public and personal safety” and the other scales. This might indicate that social processes influence problematic experiences indirectly. The scales “communication and peers” and “immersion in the internet” as well as “communication and peers” and “identity formation” have the highest correlation with r=0.58 and r=0.57, respectively. This indicates a major role of communication with peers in identity formation during adolescence and a significant contribution of the internet as a means of communication in this process. Overall, the identified scales are not independent. Each of the scales contributes to the assessment of total concern of the sample of adolescents about their problems.

Table 4

Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire: Correlation of scales (Spearman's ρ)

** indicates significant correlation at 0.01 level.

The identified correlations between the scales became the basis for the development of a structural model of the new Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire. It was used to conduct a confirmatory factor analysis of the empirical data (Table 5).

Table 5

Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire: Results of confirmatory factor analysis

Basic statistical indices obtained with the confirmatory factor analysis satisfy the requirements. This allows us to state that the obtained empirical data confirm the proposed model that includes 6 factors with 10 questions each. Specifically, CMIN/DF is higher than 5.00; TLI, CFI, IFI, NFI are higher than the critical value of 0.9; RMSEA is close to the critical value of 0.051.

Descriptive statistics in Table 6 shows that the biggest reason for concern is public and personal safety (scale 1). Here, we see certain continuity with the scale “Problems related to the development of society” from the previous version of the questionnaire. Apart from common social and environmental threats, this scale includes internet-related issues of privacy, fraud, etc. Apparently, adolescents see the internet not only as an awareness-raising tool that keeps them informed about current global issues—they also relate to these issues personally. Rooted in social processes, this problem area is difficult to control and regulate.

The second major area of problems are those related to school. Among them are reduced motivation for learning, insufficiently equal and dialogue-based relationships with teachers, rejection of school rules and school environment. The item “Other (please specify)” features statements about boring classes, packed timetables and, on the other hand, the necessity for additional training with private teachers. Other studies also provide evidence for the relevance of school-related problems for adolescents who write about school in a critical and contradictory manner [23]. Digitalization in education creates new problems for educators and, to no lesser degree, for students [7; 25]. Yet, the studies focusing on digitalization-related problematic experiences of students are almost non-existent.

Problems related to identity formation come third. Obtaining one’s identity is one of the key tasks facing adolescents. The supporting evidence is E. Erikson’s developmental theory and its fifth stage identity vs. role confusion as a turning point in human development. Similarly, R. Havighurst highlights the importance of self-identification as regards universal values, communication, a struggle to understand the meaning of life and one's place in the world. Identity is about where an adolescent sees him/herself in lifetime and whether he/she perceives life as a continuous journey and realizes the continuity of the past, present and future. Identity formation is associated with a range of problems related to making personal choices as regards moral values, career, responding to challenges, and self-identification across different areas of life. Today, adolescents make an extensive use of the internet with experimental purposes, including trying themselves in different roles. This is a way to solve age-related tasks that concern the development of self-awareness and the Self-concept. Importantly, the level of Self-concept correlates with risky behavior on social networks and internet addiction [16].

Interestingly, the problems related to the immersion in the internet cause more concern than experiences related to real-life interactions with parents or peers. This leads us to suppose a transformation in socialization tools as they are shifting towards a virtual environment. According to D.P. Tkachenko, the proliferation of information technology encourages the emergence of a new social reality that transforms development and socialization patterns [22]. Mastering information technology is also part of socialization as it goes along with the acquisition of cultural rules and values and the new picture of reality. Digitalization entails a range of psychological problems in adolescents. Among them are stress induced by information, internet addiction, ineffective time management, etc. On the one hand, the internet is a source of useful supporting content that helps adolescents in problem-solving. On the other hand, it offers tools and stimuli for aggressive and self-destructing behavior [18; 26; 35]. At the same time, destructive and self-destructive outcomes of problematic experiences are often down to destructive relationships with peers, including online (cyber aggression, cyberbullying). This is aggravated by a lack of parental support and difficulties in family relationships [20; 29; 31]. A range of studies claimed the necessity of designing a valid diagnostic tool to investigate the roots of psychological problems facing adolescents in this regard, e.g., the Cyber-Aggression Typology Questionnaire (CATQ) developed by K.C. Runions and adapted by S.S. Antipina for Russian researchers focusing on adolescent cyber aggression. The questionnaire is based on the analysis of motivational goals and ability for behavioral self-control depending on the four types of aggressive online behavior [1; 33]. D. Graf et al. designed the Face-to-Face Aggression Typology Questionnaire (FATQ). The research team analyzed the driving forces behind aggressive behavior and compared how these forces manifest in samples of adolescents with problem behavior in real-life and digital settings [27].

Table 6

Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire: Descriptive statistics

You can find the form of the Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire and the keys in the Appendix.

The Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire can be used for the following research purposes:

• to investigate psychological problems of adolescents with different socialization backgrounds, i.e., education, family, place of residence, socio-economic environment, etc.;
• to identify specific behavior of adolescents caused by their psychological problems;
• to diagnose the mental state of adolescents with pronounced individual characteristics of mental development (giftedness, developmental delay, advanced developmental milestones, etc.).

The Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire can find the following practical application:

• to assess the level of concern about problems in a specific aspect of an adolescent’s life followed by targeted psychological support;
• to identify the relationship between the level of concern about problems and intensity of the internet immersion;
• to identify risk groups prone to identity loss, etc.
• to substantiate the need for the implementation of social and psychological support of adolescents in a specific educational institution, city’s district, region, etc.

Further, the Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire may find an application in research focusing on psychological problems of other social groups, e.g., university or vocational school students. It may also be subjected to criterion validity tests using the A.M. Prikhozhan’s Personal Anxiety Scale and test-retest reliability tools.

Another promising avenue of future research is the investigation of psychological problems facing adolescents from other parts of Russia and beyond. It is also reasonable to explore the possibilities and ways of coping with psychological problems related to the immersion in the internet.

The identified areas of high concern about problems may become the focus of an in-depth study of grounds for the concern and subsequent qualitative analysis.

Conclusions

1. The Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire was developed and tested in five consecutive stages from initial collection of empirical data from adolescents to primary and secondary factorization of its scales.
2. The application of a set of psychometric and statistical tools determined the final structure of the Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire.

The questionnaire includes six scales and an average score of overall concern about problems:

• Problems related to public and personal safety;
• Problems related to identity formation;
• Problems related to communication and peers;
• Problems related to the relationships with parents;
• Problems related to the immersion in the internet;
• Problems related to school.

Each scale contains a list of 10 real-life situations that can cause psychological problems (Appendix).

3. The questionnaire was statistically tested on a sample of adolescents aged 13, 14, 15, 16, 17. All the statistical methods were used on an age- and gender-balanced sample of 566 school students from Saint Petersburg and the Leningrad Region, Russia.
4. The questionnaire has sufficient psychometric characteristics: high reliability of individual scales and the internal consistency of all the scales throughout the questionnaire as well as convergent validity confirmed on the basis of correlations with the indicators of the scales of Adolescents’ Psychological Problems Questionnaire. The Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire can find an application in scientific research and practical psychodiagnostics on Russian-speaking samples.

Appendix

Adolescents’ Psychological Problems in Real and Virtual Environments Questionnaire

Guidelines. The questionnaire offers some situations that your peers or you personally may experience as problems. Use the scale below to say how much you agree or disagree with each of the statements.

1—strongly disagree

2—somewhat disagree

3—neither agree nor disagree

4—somewhat agree

5—strongly agree

Keys:

Scale 1. Problems related to public and personal safety: items 1-10

Scale 2. Problems related to identity formation: items 11-20

Scale 3. Problems related to communication and peers: items 21-30

Scale 4. Problems related to the relationships with parents: items 31-40

Scale 5. Problems related to the immersion in the internet: items 41-50

Scale 6. Problems related to school: items 51-60

 The calculation includes an average score for every scale and an average score of overall concern about problems.

A 1 to 5 rating scale is used to measure the magnitude of concern about problems.

Quantitative methods are used to determine the average concern about problems for each scale and for the psychodiagnostic tool as a whole.

1. Antipina S.S. Oprosnik «Tipologiya kiberagressii»: struktura i pervichnye psikhometricheskie kharakteristiki [Cyber-Aggression Typology Questionnaire: Structure and Primary Psychometric Characteristics]. Vestnik Kemerovskogo gosudarstvennogo universiteta [Bulletin of Kemerovo State University], 2021. Vol. 23, no. 1, pp. 113—122. DOI:10.21603/2078-8975-2021-23-1-113-122. (In Russ.).
2. Belobrykina O.A., Limonchenko R.A. Osobennosti perezhivaniya psikhologicheskikh problem deviantnymi podrostkami [Features of experiencing psychological problems in deviant
   adolescents]. Natsional'nyi psikhologicheskii zhurnal [National Psychological Journal], 2017. Vol. 28, no. 4, pp. 129—138. DOI:10.11621/npj.2017.0413. (In Russ.).
3. Zhiznennye problemy i sposoby ikh razresheniya shkol'nikami 12-18 let. [Life problems and ways to solve them by schoolchildren 12-18 years old]. Sankt-Peterburg, Potsdam, 2000. 130 p. (In Russ.)
   4. Issledovanie tsifrovoi sotsializatsii raznykh pokolenii: podrostki i roditeli (2018-2020 g.g.) [Elektronnyi resurs] [Intergenerational Digital Socialization Study: Adolescents and Parents (2018-2020)]. URL: http://www.fid.su/projects/research/digital-socialization-in-adolescents (Accessed: 28.11.2021). (In Russ.).
4. Kalashnikova M. B., Petrova E. A. Problemnaya ozabochennost' sovremennykh podrostkov: riski i resursy [The problem concerns of modern teenagers: risks and resources]. Nauchno-pedagogicheskoe obozrenie. Pedagogical Review [Scientific and pedagogical review], 2017. Vol.18, no. 4, pp. 166—174. DOI:10. 23951/2307-6127-2017-4-166-174. (In Russ.).
5. Miklyaeva A.V., Khoroshikh V.V., Volkova E.N. Sub"ektivnye faktory psikhologicheskogo blagopoluchiya odarennykh podrostkov: teoreticheskaya model' [Subjective factors of gifted adolescents’ psychological well-being: A theoretical model]. Science for Education Today, 2019. Vol. 9, no. 4, pp. 36—55. DOI:10.15293/2658-6762.1904.03. (In Russ.).
6. Panov V. I., Borisenko N. A., Mironova K. V., Shishkova S. V. Povedenie podrostkov v tsifrovoi obrazovatel'noi srede: k opredeleniyu ponyatii i postanovke problemy [Behavior of adolescents in the digital educational environment: Definition of concepts and formulation of the problem]. Izvestiya Saratovskogo universiteta. Novaya seriya. Seriya: Akmeologiya obrazovaniya. Psikhologiya razvitiya [Izvestiya of Saratov University. New Series. Series: Educational Acmeology. Developmental Psychology], 2021. Vol. 10, no. 3(39), pp. 188—196. DOI: 10.18500/2304-9790-2021-10-3-188-196. (In Russ.).
7. Panov V.I., Patrakov E.V. Interferentsiya tsifrovoi i dotsifrovoi sred kak predmet psikhologicheskogo issledovaniya [Interference of digital and pre-digital environments as a subject of psychological research]. Gertsenovskie chteniya: psikhologicheskie issledovaniya v obrazovanii [Herzen's Readings: Psychological Research in Education], 2020. Vol. 3, pp. 531—541. DOI:10.33910/herzenpsyconf-2020-3-56. (In Russ.).
8. Poretskova G.Yu., Poretskov M.E., Basis L.B. Tsifrovaya sreda i uchashchiesya: real'nost' i osnovnye problemy [Digital environment and students: reality and main problems]. Doshkol'noe i shkol'noe obrazovanie v Rossii i za rubezhom: vektory razvitiya: kollektivnaya monografiya. [Preschool and school education in Russia and abroad: vectors of development: Collective monograph.]. Ul'yanovsk, 2021, pp. 42—52. (In Russ.).
9. Psikhicheskoe razvitie cheloveka i sotsial'nye vliyaniya: kollektivnaya monografiya [Human mental development and social influences: a collective monograph] Regush L.A. (eds.). Saint-Petersburg: Publ. RGPU im. A. I. Gercena, 2010. 291 p. (In Russ.).
10. Psikhologicheskie problemy rossiiskikh podrostkov (1993-2013): Monografiya [Psychological problems of Russian teenagers (1993-2013): Monograph] Regush L.A. (eds.). Sankt-Peterburg: ELVI-PRINT, 2017. 298 p. (In Russ.).
11. Rasskazova E.I., Emelin V.A., Tkhostov A.Sh. Diagnostika psikhologicheskikh posledstvii vliyaniya informatsionnykh tekhnologii na cheloveka: ucheb.-metod. posobie dlya studentov psikhologicheskikh spetsial'nostei. [Diagnostics of the psychological consequences of the influence of information technologies on a person: textbook-method]. Moscow: Akropol', 2015. 115 p. (In Russ.).
    13. Regush L. A., Alekseeva E. V., Veretina O. R., Orlova A. V., Pezhemskaya Yu. S. Operatsionalizatsiya ponyatiya «psikhologicheskaya problema» v otechestvennykh i zarubezhnykh issledovaniyakh [Operationalization of the concept “psychological problem” in Russian and International research]. Izvestiya Rossiiskogo gosudarstvennogo pedagogicheskogo universiteta imeni A. I. Gertsena [Izvestia: Herzen University Journal of Humanities & Sciences]. Sankt-Peterburg, 2020, no. 197, pp. 7—17. DOI:10.33910/1992-6464-2020-197-7-17. (In Russ.).
12. Regush L.A., Alekseeva E.V., Orlova A.V., Pezhemskaya Yu.S. Psikhologicheskie problemy podrostkov: standartizirovannaya metodika: nauchno-metodicheskie materialy [Psychological problems of adolescents: standardized methodology: scientific and methodological materials]. Sankt-Peterburg. Publ. RGPU A.I. Gercena, 2012. 34 p. (In Russ.).
13. Regush L. A., Orlova A. V., Alekseeva E. V., Veretina O. R., Pezhemskaya Yu. S., Laktionova E. B. Fenomen pogruzhennosti v internet-sredu: opredelenie i diagnostika [Phenomenon of the Internet immersion: definition and measurement]. Sibirskii psikhologicheskii zhurnal [Siberian journal of psychology], 2021, no. 81, pp. 107—125. DOI:10.17223/17267081/81/5. (In Russ.).
14. Rubtsova O.V., Poskakalova T.A., Shiryaeva E.I. Osobennosti povedeniya v virtual'noi srede podrostkov s raznym urovnem sformirovannosti «obraza Ya» [Features of On-Line Behavior in Adolescents with Different Levels of Self-Concept Clarity]. Psikhologicheskaya nauka i obrazovanie = Psychological Science and Education, 2021. Vol. 26, no. 4, pp. 20—33. DOI:10.17759/pse.2021260402. (In Russ.).
15. Sil'chenko D.V., Shumskii V.B. Psikhologicheskoe blagopoluchie pol'zovatelei sotsial'nykh setei s raznym urovnem vovlechennosti [Psychological well-being of social networks users with different level of involvement]. Psikhologicheskie issledovaniya = Psychological research, 2021. Vol. 14, no. 79, p. 4. URL: http://psystudy.ru (Accessed: 28.11.2021). (In Russ.).
16. Soldatova G.U., Ilyukhina S.N. Autodestruktivnyi onlain-kontent: osobennosti otsenki i reagirovaniya podrostkov i molodezhi [Self-Destructive Online Content: Features of Attitude and Response of Adolescents and Youth]. Konsul'tativnaya psikhologiya i psikhoterapiya = Counseling Psychology and Psychotherapy, 2021. Vol. 29, no. 1, pp. 66—91. DOI:10.17759/cpp.2021290105. (In Russ.).
17. Soldatova G.U., Rasskazova E.I. Itogi tsifrovoi transformatsii: ot onlain-real'nosti k smeshannoi real'nosti [Digital Transition Outcomes: From Online Reality to Mixed Reality]. Kul'turno-istoricheskaya psikhologiya = Cultural-Historical Psychology, 2020. Vol. 16, no. 4, pp. 87—97. DOI:10.17759/chp.2020160409. (In Russ.).
18. Soldatova G.U., Yarmina A.N. Kiberbulling: osobennosti, rolevaya struktura, detsko-roditel'skie otnosheniya i strategii sovladaniya [Cyberbullying:features, role structure, parent-child relationships and coping strategies]. Natsional'nyi psikhologicheskii zhurnal [National Psychological Journal], 2019. Vol. 3, no. 35, pp. 17—31. DOI:10.11621/npj.2019.0303. (In Russ.).
19. Sorokina A.B. Internet v zhizni sovremennykh detei i podrostkov: problema i resurs [Elektronnyi resurs] [Internet in the lives of children and adolescents: problems and resources]. Sovremennaya zarubezhnaya psikhologiya = Journal of Modern Foreign Psychology, 2015. Vol. 4, no. 1, pp. 45—64. URL: http:// psyjournals.ru/jmfp/2015/n1/76176.shtml (Accessed: 22.08.2021). (In Russ.).
20. Tkachenko D. P. Psikhologicheskie osobennosti sotsializatsii podrostkov v sovremennom tranzitivnom obshchestve. Avtoref diss. kand. psikhol. nauk. [Psychological features of the socialization of adolescents in a modern transitional society. Ph. D. (Psychology) Thesis]. Moscow, 2020, 30 p. (In Russ.).
21. Tolstykh N.N., Ter-Avanesova N.V., Chernyak N.A. Sotsial'nye predstavleniya o shkole i uchenii v raznykh gruppakh uchastnikov obrazovatel'nogo protsessa [Social Representations About School and Learning in Different Groups of Participants of the Educational Process]. Psikhologicheskaya nauka i obrazovanie = Psychological Science and Education, 2019. Vol. 24, no. 6, pp. 5—15. DOI:10.17759/pse.2019240601. (In Russ.).
22. Khlomov K.D. Podrostok na perekrestke zhiznennykh dorog: sotsializatsiya, analiz faktorov izmeneniya sredy razvitiya [Teenager at the life crossroads: socialization, analysis of the factors of developmental environment change]. Psikhologicheskaya nauka i obrazovanie = Psychological Science and Education, 2014. Vol. 6, no. 1, pp. 2—10. DOI:10.17759/psyedu.2014060102. (In Russ.).
    25. Tsifrovaya gumanitaristika i tekhnologii v obrazovanii [Digital Humanities and Technology in Education] Sorokova M.G. (eds.). Sb. materialov Vtoroi Vserossiiskoi nauchno-prakticheskoi konferentsii s mezhdunarodnym uchastiem [Collection of Articles of the Seсond All-Russian Scientific and Practical Conference with International Participation]. Moscow: Publ. FGBOU VO MGPPU, 2020. 464 p. (In Russ.).
23. Fluck J. Why do students bully? An analysis of motives behind violence in schools. Youth & Society, 2014. Vol. 49(5), pp. 567—587. DOI:10.1177 / 0044118X14547876
24. Graf D, Yanagida T, Maschler A, Spiel C. A tool for investigating the differential functions of aggressive behavior in the face-to-face and cyber context: Extending the Cyber-Aggression Typology Questionnaire. Aggressive Behavior, 2020. Vol. 46(5), pp. 1—11. DOI:10.1002 / ab.21894
25. Green, K.H., van de Groep, S., Sweijen, S.W. et al. Mood and emotional reactivity of adolescents during the COVID-19 pandemic: short-term and long-term effects and the impact of social and socioeconomic stressors. Sci Rep, 2021. Vol. 11, p. 11563. DOI:10.1038/s41598-021-90851-x
26. Holzer J, Korlat S, Haider C, Mayerhofer M, Pelikan E, Schober B, et al. Adolescent well-being and learning in times of COVID-19 — A multi-country study of basic psychological need satisfaction, learning behavior, and the mediating roles of positive emotion and intrinsic motivation. PLoS ONE, 2021. Vol. 16(5): e0251352. DOI: 10.1371/journal.pone.0251352
27. Khodakovskaia O.V., Bogdanovskaya I.M., Koroleva N.N., Alekhin A.N., Lugovaya V.F. Problematic internet usage and the meaning-based regulation of activity among adolescents. Communications in Computer and Information Science. 2018. Vol. 859, pp. 227—238. DOI:10.1007/978-3-030-02846-6_18
28. Núñez-Regueiro, F., Núñez-Regueiro, S. Identifying Salient Stressors of Adolescence: A Systematic Review and Content Analysis. J Youth Adolescence, 2021. Vol. 50, pp. 2533—2556. DOI:10.1007/s10964-021-01492-2
29. Núñez-Regueiro, F., Archambault, I., Bressoux, P., & Nurra, C. Measuring stressors among children and adolescents: a scoping review 1956—2020. Adolescent Res Rev. 2021. DOI:10.1007/s40894-021-00168-z.
30. Runions K. C., Bak M., Shaw T. Disentangling functions of online aggression: The cyber-aggression typology questionnaire (CATQ). Aggressive behavior, 2017. Vol. 43(1), pp. 74—84. DOI: 10.1002/ab.21663
31. Seiffge-Krenke I. Problembewältigung im Jugendalter: Ergebnisse von Studien an normalen und besonders belasteten Jugendlichen // Kächele, H., Steffens, W. (eds) Bewältigung und Abwehr. Springer, Berlin, Heidelberg. 1988. Р. 175—187. DOI: 10.1007/978-3-642-83594-0_8
32. Yang, Cc., Pham, T., Ariati, J. et al. Digital Social Multitasking (DSMT), Friendship Quality, and Basic Psychological Needs Satisfaction Among Adolescents: Perceptions as Mediators. J Youth Adolescence, 2021. Vol. 50, pp. 2456—2471. DOI:10.1007/s10964-021-01442-y
33. Ziegler M. Psychological Test Adaptation and Development — How Papers Are Structured and Why. Published Online: June 25, 2020. DOI:10.1027/2698-1866/a000002