Prevalence of Burnout Syndrome and other psychiatric disorders among health professionals during the COVID-19 pandemic: A systematic review and meta-analysis protocol

Abstract

Introduction

Studies carried out during previous pandemics revealed an increase in the prevalence of Burnout Syndrome and other psychiatric disorders among health professionals. A high prevalence of psychiatric disorders is also observed in some health categories, during the COVID-19 pandemic.

Objective

This systematic review/meta-analysis study aims to assess the prevalence of Burnout Syndrome and other psychiatric disorders (depression, anxiety, stress, and insomnia) among health care professionals and other support professionals during the COVID-19 pandemic.

Inclusion criteria

Observational studies published from December 2019, without language restrictions in which the prevalence of Burnout Syndrome and other psychiatric disorders among health professionals during the COVID-19 pandemic will be assessed.

Methods

PubMed, Web of Science, Embase, CINAHAL, PsycINFO, LILACS, SCOPUS, and The Cochrane Library will be searched for eligible studies. Two reviewers will independently screen and select studies, assess methodological quality, and extract data. A meta-analysis will be performed, if possible, and the Grading of Recommendations Assessment Development and Evaluation (GRADE).

Ethics and disclosure

This study will use secondary data. Thus, there is no need for submission to the ethics committee. The results of this systematic review will be published in a journal after a peer-review process.

Trial registration

Systematic review registration number: CRD42020212036.

About the Authors:

Kleyton Santos de Medeiros

Roles Conceptualization, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

Affiliations Health Sciences Postgraduate Program, Federal University of Rio Grande do Norte (UFRN), Natal, Rio Grande do Norte, Brazil, Instituto de Ensino, Pesquisa e Inovação, Liga Contra o Câncer, Natal, Rio Grande do Norte, Brazil

Letícia Maniçoba Ferreira de Paiva

Roles Conceptualization, Writing – original draft

Affiliation: Department of Nursing, Centro Universitário do Rio Grande do Norte, Natal, Rio Grande do Norte, Brazil

Luíza Thomé de Araújo Macêdo

Roles Conceptualization, Writing – original draft

Affiliation: Department of Nursing, Centro Universitário do Rio Grande do Norte, Natal, Rio Grande do Norte, Brazil

Wederson Farias de Souza

Roles Conceptualization, Writing – original draft

Affiliation: Department of Nursing, Centro Universitário do Rio Grande do Norte, Natal, Rio Grande do Norte, Brazil

Luís Antônio Soares da Silva

Roles Conceptualization, Writing – original draft

Affiliation: Department of Nursing, Centro Universitário do Rio Grande do Norte, Natal, Rio Grande do Norte, Brazil

Ayane Cristine Alves Sarmento

Roles Conceptualization, Project administration, Validation, Writing – original draft, Writing – review & editing

Affiliation: Health Sciences Postgraduate Program, Federal University of Rio Grande do Norte (UFRN), Natal, Rio Grande do Norte, Brazil

Ana Paula Ferreira Costa

Roles Writing – review & editing

Affiliation: Health Sciences Postgraduate Program, Federal University of Rio Grande do Norte (UFRN), Natal, Rio Grande do Norte, Brazil

Cijara Leonice Freitas

Roles Conceptualization, Writing – original draft

Affiliation: Health Sciences Postgraduate Program, Federal University of Rio Grande do Norte (UFRN), Natal, Rio Grande do Norte, Brazil

Ana Katherine Gonçalves

Roles Conceptualization, Project administration, Supervision, Validation, Writing – review & editing

* E-mail: [email protected]

Affiliations Health Sciences Postgraduate Program, Federal University of Rio Grande do Norte (UFRN), Natal, Rio Grande do Norte, Brazil, Department of obstetrics and Gynecology, Federal University of Rio Grande do Norte (UFRN), Natal, Rio Grande do Norte, Brazil

ORCID logo https://orcid.org/0000-0002-8351-5119

Introduction

The coronavirus disease (COVID-19) has been affecting every country in the world drastically [1–4]. According to the World Health Organization (WHO, 2020), more than 198,032,883 cases of COVID-19 were detected and around 4,220,504 deaths occurred worldwide [5]. In view of this context, high levels of anxiety, stress, depression, and Burnout Syndrome are already observed in the general population, inclusive health professionals and support professionals who care for patients with COVID-19.

Both health professionals directly involved in the diagnosis, treatment, and care of patients with COVID-19, as support professionals, that work together with these professionals and health institutions are at high risk of developing psychological distress and other mental health symptoms. This is because they work under extreme pressure, are exposed to high levels of stress, work prolonged shifts, have excessive workload, sometimes work without training, and often do not receive appropriate personal protective equipment. Moreover, they face unprecedented situations, such as allocating scarce resources to equally needy patients, providing assistance with restricted or inadequate resources, and a lack of specific drugs [6, 7]. These conditions can trigger feelings of loneliness and helplessness, or a series of emotional states, such as stress, irritability, physical and mental fatigue, and despair. Work overload and symptoms related to stress make health professionals especially vulnerable to psychological suffering, which puts them at increased risk for developing psychiatric disorders [8, 9].

Throughout history, it has been observed that during a health crisis, health teams tend to mobilize more actively, causing them to forget about the risk transmissibility of the infection. For example, during the severe acute respiratory syndrome (SARS) outbreak in 2003, 18% to 57% of health professionals presented serious emotional problems and psychiatric symptoms during and after the event [10]. In 2015, during Middle East respiratory syndrome, depression and stress were observed among health professionals. Frontline professionals were demonstrated to be at a higher risk of developing post-traumatic stress disorder (PTSD). There are also studies that show increased levels of stress, depression, anxiety, and PTSD among professionals even after some time had transpired since the end of the outbreak [11, 12].

Some studies performed in order to explore the psychiatric repercussions in health professionals during the COVID-19 pandemic presented significant results. Elbay et al. (2020) reports that according to data collected in China during the COVID-19 pandemic, health professionals had a high prevalence of depression, being reported by 50% of the professionals interviewed [13]. Zhang et al. (2020) also demonstrate that health workers, including doctors, showed a higher prevalence of insomnia, anxiety, depression, somatization, and obsessive-compulsive symptoms [14]. In another study conducted by Lai et al. (2020), a large number of participants presented symptoms of depression, anxiety, insomnia, and distress [15]. Finally, Song et al. (2020), found prevalence rates of depressive symptoms of 25.2% among 14,825 doctors and nurses in 31 provinces of mainland China [16].

However, we have not identified a comprehensive systematic review, about the psychiatric disorders, beyond the depression, such as Burnout Syndrome, anxiety, stress, and insomnia presented in health professionals during a pandemic. For this reason, this systematic review/meta-analysis study aims to assess the prevalence of Burnout Syndrome and other psychiatric disorders (depression, anxiety, stress, and insomnia) among health care professionals and other support professionals during the COVID-19 pandemic.

Review questions

What is the prevalence of Burnout Syndrome and other psychiatric disorders, such as depression, anxiety, stress, and insomnia, among health care professionals and other support professionals during the COVID-19 pandemic worldwide?

Materials and methods

Protocol and registration

This protocol is registered with the International Prospective Register of Systematic Reviews (PROSPERO) under the CRD number CRD42020212036.

The proposed systematic review and meta-analysis conforms to the Meta-analysis of Observational Studies in Epidemiology [17] and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA-P) [18] guidelines.

Inclusion criteria

This systematic review protocol will include the following studies:

Participants

* Studies on health professionals (doctors, nurses, physiotherapists, pharmacists, nutritionists, paramedics, technicians, and allied health occupations) and development of Burnout Syndrome and other psychiatric disorders (depression, anxiety, stress, and insomnia) during the COVID-19 pandemic;

* Studies published from December 2019 until July 2022.

Exposure

* Health professionals and allied health occupations involved in combating COVID-19.

Outcome

* The outcome of interest is the prevalence of Burnout Syndrome and other psychiatric disorders (depression, anxiety, stress, and insomnia) among health professionals during the COVID-19 pandemic, which will be evaluated by primary studies from the scales: Patient Health Questionnaire-9 (PHQ-9) [19, 20]; Depression Anxiety Stress Scales (DASS-21) [21, 22], Self-Rating Depression Scale (SDS) [23, 24], Beck Depression Inventory (BDI) [25, 26], Insomnia Severity Index (ISI) [14], Revised Symptom Checklist (SCL-90-R) [14] and Patient Health Questionnaire-4 (PHQ-4) [14], Generalized anxiety disorder 2-item (GAD-2) [27], Stanford Sleepiness Scale [28] and other scales that can be found in the articles to be selected.

Types of studies

Only specific human observational study designs will be included such as: longitudinal cohort studies (prospective and retrospective), cross-sectional studies, and case-control studies. Case series and case reports will be excluded due to their low level of scientific evidence. Randomized controlled trials and quasi-experiments will also be excluded because this review does not examine the role of any intervention related to depression. There will be no language restrictions when selecting studies.

Exclusion criteria

1. Case reports, case studies, letters to the editor, fact sheets, conference abstracts and review articles.

2. Studies with children and adolescents <18 years.

3. Studies with the general population, except healthcare professionals.

Information sources

A search will be conducted in the following databases: PubMed, Web of Science, Embase, Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO, Latin American and Caribbean Literature in Health Sciences (LILACS), SCOPUS, and The Cochrane Library, will be searched for articles dated between December 2019 and July 2022. The reference lists will be screened. The search strategy will be to use the medical subject headings (MeSH) and terms that have been included in Table 1. The literature screening will be performed by four reviewers.

[Figure omitted. See PDF.]

Table 1. Medline search strategy.

https://doi.org/10.1371/journal.pone.0260410.t001

Search

The terms of the MeSH will be: ((Health Professions OR Health Occupation OR Nurses OR Physicians OR Doctor OR Physiotherapist OR Nutritionists OR pharmacists OR paramedics OR Technicians OR Allied Health Personnel OR Allied Health Occupations) AND (Mental disorder OR Depressive Disorder OR Syndrome Depressive OR Depression OR anxiety OR Acute Stress Disorders OR Burnout Syndrome OR insomnia disorder OR insomnia) AND (COVID-19 OR SARS-Cov-2)) (Table 1).

Study selection

Five authors, KSM, LMFP, WFS, LTAM and LASS will independently select the articles, using titles and abstracts. Duplicate studies will be excluded. The same authors will review the text to determine if the studies meet the inclusion criteria. A sixth reviewer, AKG, will resolve the discrepancies. The selection of studies will be summarized in a PRISMA flow diagram (Fig 1).

[Figure omitted. See PDF.]

Fig 1. Flow diagram of the search for eligible studies on the prevalence of Burnout Syndrome and depression, anxiety, stress, and insomnia among health professionals during the COVID-19 pandemic: CENTRAL, Cochrane central register of controlled trials.

https://doi.org/10.1371/journal.pone.0260410.g001

Data collection process

A standardized data extraction form will be developed and tested. Data from each included study will be extracted independently by three reviewers (ACAS, APFC and CLF), and any subsequent discrepancies will be resolved through discussion with a fourth reviewer (AKG). The data extracted will include information on authors, year of publication, study location (country and continent), type of study, main objectives, population, depression, anxiety and stress assessment (PHQ-9, DASS-21, SDS, BDI and others scales) [19–26], risk factors, protective factors, use of medications, biological variables, treatment, and patient outcomes. Furthermore, participant characteristics (e.g., mean age, gender), and results for the prevalence will be collected.

The study authors will be contacted in case of missing data and/or to resolve any uncertainties. In addition, any additional information will be recorded. All data entries will be checked twice. If we find a set of articles with similar characteristics based on the information in the data extraction table, we will perform a meta-analysis using a random-effects model. If there is data that is not clear in some articles, the corresponding author will be contacted for possible clarification.

Assessment of methodological quality

The methodological quality of each included study will be assessed by two reviewers (KSM and APFC) independently. They will do so using a widely-recognized standardized critical appraisal instrument from the Joanna Briggs Institute for the following study types: cross-sectional [29]. Study authors will be contacted in the event of insufficient details to confidently assess the methodological quality.

The risks of bias of observational (cohort and case-control) studies will be assessed by two reviewers (KSM and ACAS) independently using Newcastle–Ottawa Scale tool. The quality of each cohort study was judged on three broad categories—namely, selection of the study population, comparability of groups and ascertainment of either the exposure or outcome of interest [30].

The tool evaluates biases from confounding factors, selection of participants into the studies, missing data, and measurement of outcomes. Any unresolved disagreements will be resolved through discussion and/or consensus with a third reviewer (AKG). Study authors will be contacted in the event of insufficient details to confidently assess the risk of bias.

Assessing certainty in the findings

The quality of evidence for all outcomes will be assessed using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach [31]. The quality of the evidence will be assessed based on the risk of bias, indirectness, inconsistency, imprecision, and publication bias.

Synthesis of results

We will use the Review Manager statistical software V.5.2.3 to analyze the data. Some degree of heterogeneity is expected across the studies; therefore, a random-effects model for meta-analysis will be applied. Effect sizes will be expressed as risk ratios, odds ratios, or prevalence ratios (for dichotomous data) and weighted (or standardized) mean differences (for continuous data) and their 95% confidence intervals (CI) will be calculated. Cohort estimates will be presented as risk ratios or prevalence ratios with 95% CI, and case-control estimates will be presented as odds ratios with 95% CI. The degree of statistical heterogeneity will be assessed using standard I2 squared statistics. Where statistical pooling is not possible and/or there is substantial heterogeneity, we will provide a narrative synthesis of the study findings. Sensitivity analyses will be performed to explore the impact of the quality of the included studies. Publication bias will be assessed if more than 10 studies were included using a funnel plot. To assess funnel plot asymmetry, Egger’s test (for continuous outcomes) will be performed.

Discussion

Health professionals that work at the frontline of combating COVID-19, and the support professionals that work together with these professionals and health institutions are at high risk of developing psychological distress and other mental health symptoms [30, 31]. Several factors can cause psychological distress in these professionals, once during situations of a pandemic, the psychological needs of these professionals are neglected [32].

According to Zhang et al. (2020), during the COVID-19 pandemic, the professional’s health had a higher prevalence of insomnia, anxiety, depression, somatization, and obsessive-compulsive symptoms on the account. Dealing with psychological distress and the risk of allostatic overload [14]. Lai et al. (2020) also showed that a considerable proportion of participants related symptoms of depression, anxiety, insomnia, and distress to the contacted individuals in their study. Nurses, women, frontline health care workers, and those working in Wuhan, China, reported more severe degrees of mental health distress [15]. In addition, Song et al. (2020) found that medical and nursing staff workers in Hubei province were associated with a higher risk of depressive symptoms, while those working in the Hubei province but residing in another province had a lower risk of depressive symptoms and PTSD. All the studies pointed out the importance of implementing psychological interventions to promote mental health among these professionals [16].

One cross-sectional study conducted in India among healthcare workers directly involved in screening, diagnosing, and treating COVID-19 patients and suspects, the prevalence of health professionals with high-level stress was 3.7%, while the prevalence rates of professionals with depressive symptoms requiring treatment and anxiety symptoms requiring further evaluation were 11.4% and 17.7%, respectively. Women had approximately twice the increased odds of developing high-level moderator stress, depressive symptoms requiring treatment, and anxiety symptoms requiring further evaluation [33]. In Brazil, a survey conducted using social media and administrative emails to Brazilian active healthcare professionals during the COVID-19 outbreak showed that new insomnia symptoms or previous insomnia worsening occurred in 41.4% of the professionals. Prevalent anxiety and burnout during the pandemic were observed in 44.2% and 21% of participants, respectively. Multivariate analyses showed that females, weight change, prevalent anxiety, new-onset burnout, and family income reduction >30% were independently associated with new-onset or worsening of previous insomnia [34].

The countries with the highest number of COVID-19 cases and deaths were the USA, Brazil, and India, where working conditions differ from those in China. Additionally, socio-cultural differences and socioeconomic disparities may be related to the development of depression among health professionals [35]. Another factor to consider is geographic location, which was also a risk factor in Italy’s study that compared stress and anxiety between healthcare workers and the general population [36]. A study capable of identifying countries with a higher number of health professionals with depression will promote adoption of strategies to prevent and treat the disease, thereby allowing these professionals to not have to leave their work activities.

The previous systematic reviews presented some weaknesses that justify the realization of new studies. For example, Pappa et al (2020) [37] sought studies until April 2020, after which there was a peak in the pandemic in several other countries, which may have increased the prevalence of depression. Further, the latter did not focus solely on assessing the prevalence of depression and mainly included studies with professionals from China, with no data from other countries with a higher number of cases. Already, Li et al (2021) [38], did not evaluate results for insomnia and burnout. Thus, a systematic review that evaluates the real prevalence of psychiatric disorders, such as Burnout Syndrome, depression, anxiety, stress, and insomnia, among health professionals and support professionals is essential for preventive and therapeutic measures focused on specific groups based.

Among the study’s limitations, the possibility of high heterogeneity between studies stands out, the different scales and cutoff points for the assessment of outcomes. Furthermore, different population samples in different regions of the planet in which working conditions, access to personal protective equipment, and the professional’s technical capacity may vary, resulting in a greater or lesser prevalence of outcomes.

Supporting information

S1 Checklist. Preferred Reporting Items for Systematic review and Meta-Analysis Protocols (PRISMA-P checklist).

https://doi.org/10.1371/journal.pone.0260410.s001

(DOCX)

Acknowledgments

The authors acknowledge the assistance provided by the Graduate Program in Health Sciences of the Federal University of Rio Grande do Norte (UFRN) in the undertaking of literary research.

Citation: Medeiros KSd, Ferreira de Paiva LM, Macêdo LTdA, Farias de Souza W, Soares da Silva LA, Sarmento ACA, et al. (2021) Prevalence of Burnout Syndrome and other psychiatric disorders among health professionals during the COVID-19 pandemic: A systematic review and meta-analysis protocol. PLoS ONE 16(12): e0260410. https://doi.org/10.1371/journal.pone.0260410

References

1. Huang JZ, Han MF, Luo TD, Ren AK, Zhou XP. [Mental health survey of medical staff in a tertiary infectious disease hospital for COVID-19]. Zhonghua Lao Dong Wei Sheng Zhi Ye Bing Za Zhi. 2020 Mar 20;38(3):192–195. Chinese. pmid:32131151

2. Zhi Ye Bing Za Zhi 2020; 38:E001. Kang L, Ma S, Chen M, et al. Impact on mental health and perceptions of psychological care among medical and nursing staff in Wuhan during the 2019 novel coronavirus disease outbreak: A cross-sectional study. Brain Behav Immun. 2020 Jul;87:11–17. pmid:32240764

3. Huang X, Wei F, Hu L, Wen L, Chen K. Epidemiology and Clinical Characteristics of COVID-19. Arch Iran Med. 2020 Apr 1;23(4):268–271. pmid:32271601

4. Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020 Feb 15;395(10223):497–506. pmid:31986264

5. Souza CDF, Paiva JPS, Leal TC, Silva LFD, Santos LG. Spatiotemporal evolution of case fatality rates of COVID-19 in Brazil, 2020. J Bras Pneumol. 2020 Jun 17;46(4):e20200208. pmid:32578681

6. Neto MLR, Almeida HG, Esmeraldo JD, et al. When health professionals look death in the eye: the mental health of professionals who deal daily with the 2019 coronavirus outbreak. Psychiatry Res. 2020 Jun;288:112972. pmid:32302817

7. Anmella G, Fico G, Roca-Lecumberri A, et al. Unravelling potential severe psychiatric repercussions on healthcare professionals during the COVID-19 crisis. J Affect Disord. 2020 Aug 1;273:422–424. pmid:32425275

8. Wilder-Smith A, Freedman DO. Isolation, quarantine, social distancing and community containment: pivotal role for old-style public health measures in the novel coronavirus (2019-nCoV) outbreak. J Travel Med. 2020 Mar 13;27(2):taaa020. pmid:32052841

9. Shigemura J, Ursano RJ, Morganstein JC, Kurosawa M, Benedek DM. Public responses to the novel 2019 coronavirus (2019-nCoV) in Japan: Mental health consequences and target populations. Psychiatry Clin Neurosci. 2020 Apr;74(4):281–282. pmid:32034840

10. Lee SM, Kang WS, Cho AR, Kim T, Park JK. Psychological impact of the 2015 MERS outbreak on hospital workers and quarantined hemodialysis patients. Compr Psychiatry. 2018 Nov;87:123–127. pmid:30343247

11. Li Z, Ge J, Yang M, Feng J, Qiao M, Jiang R, et al. Vicarious traumatization in the general public, members, and non-members of medical teams aiding in COVID-19 control. Brain Behav Immun. 2020 Aug;88:916–919. pmid:32169498

12. Ornell F, Schuch JB, Sordi AO, Kessler FHP. "Pandemic fear" and COVID-19: mental health burden and strategies. Braz J Psychiatry. 2020;42(3):232–235. pmid:32267343

13. Elbay RY, Kurtullmus A, Arpacioglu S and Karadere E. Depression, anxiety, stress levels of physicians and associated factors in Covid-19 pandemics. Psychiatry Res. 2020 May 27;290:113130. pmid:32497969

14. Zhang W, Wang K, Yin L, Zhao W, Xue Q, Peng M, et al. Mental health and psychosocial problems of medical health workers during the COVID-19 epidemic in China. Psychother. Psycho som. 2020;1–9. pmid:32272480

15. Lai J, Ma S, Wang Y, et al. Factors Associated with Mental Health Outcomes Among Health Care Workers Exposed to Coronavirus Disease 2019. JAMA Netw Open. 2020 Mar 2;3(3):e203976. pmid:32202646

16. Song X, Fu W, Liu X, et al. Mental health status of medical staff in emergency departments during the Coronavirus disease 2019 epidemic in China. Brain Behav Immun. 2020 Jun 5;S0889–1591(20)30962-4. pmid:32512134

17. Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of Observational Studies in Epidemiology: A Proposal for Reporting. Meta-analysis of Observational studies in epidemiology (MOOSE) group. JAMA. 2000;283(15):2008–2012. pmid:10789670

18. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1. pmid:25554246

19. Levis B, Benedetti A, Thombs B D. Accuracy of Patient Health Questionnaire-9 (PHQ-9) for screening to detect major depression: individual participant data meta-analysis. BMJ. 2019; 365: l1476. pmid:30967483

20. Mitchell A J, Yadegarfar M, Gill J, Stubbs B. Case finding and screening clinical utility of the Patient Health Questionnaire (PHQ-9 and PHQ-2) for depression in primary care: a diagnostic meta-analysis of 40 studies. BJPsych Open. 2016;2:127–38. pmid:27703765

21. Wang K, Shi HS, Geng FL, Zou LQ, Tan SP, Wang Y, et al. Cross-cultural validation of the Depression Anxiety Stress Scale-21 in China. Psychol Assess. 2016 May;28(5):e88–e100. pmid:26619091

22. Henry JD, Crawford JR. The short-form version of the Depression Anxiety Stress Scales (DASS-21): construct validity and normative data in a large non-clinical sample. Br J Clin Psychol. 2005 Jun;44(Pt 2):227–39. pmid:16004657

23. Jokelainen J, Timonen M, Keinänen-Kiukaanniemi S, Härkönen P, Jurvelin H, Suija K. Validation of the Zung self-rating depression scale (SDS) in older adults. Scandinavian Journal of Primary Health Care. 2019;1–5. pmid:30784344

24. Schrag A, Barone P, Brown RG, Leentjens AF, McDonald WM, Starkstein S, et al. Depression rating scales in Parkinson’s disease: critique and recommendations. Mov Disord. 2007 Jun 15;22(8):1077–92. pmid:17394234

25. Svanborg P, Åsberg M. A comparison between the Beck Depression Inventory (BDI) and the self-rating version of the Montgomery Åsberg Depression Rating Scale (MADRS). Journal of Affective Disorders. 2001;64(2–3):203–216. pmid:11313087

26. Lee K, Kim D, Cho Y. Exploratory Factor Analysis of the Beck Anxiety Inventory and the Beck Depression Inventory-II in a Psychiatric Outpatient Population. Journal of Korean Medical Science. 2018;33(16). pmid:29651821

27. Wilson W, Raj JP, Rao S, Ghiya M, Nedungalaparambil NM, Mundra H, et al. Prevalence and Predictors of Stress, anxiety, and Depression among Healthcare Workers Managing COVID-19 Pandemic in India: A Nationwide Observational Study. Indian J Psychol Med. 2020 Jul 6;42(4):353–358. pmid:33398224

28. Drager LF, Pachito DV, Moreno CRC, Tavares AR, Conway SG, Assis M, et al. Insomnia episodes, new-onset pharmacological treatments and other sleep disturbances during the COVID-19 pandemic: a nationwide cross-sectional study in Brazilian health care professionals. J Clin Sleep Med. 2021 Jul 27. pmid:34314346

29. Peters M, Godfrey C, McInerney P, Soares C, Khalil H, Parker D. The Joanna Briggs Institute reviewers’ manual 2015: methodology for JBI scoping reviews. 2015.

30. Peterson J, et al. The Newcastle-Ottawa scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. Ottawa: Ottawa Hospital Research Institute; 2011.

31. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al; GRADE Working Group. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008 Apr 26;336(7650):924–6. pmid:18436948

32. Shen X, Zou X, Zhong L, Yang J, Li L. Psychological stress of ICU nurses in the time of COVID-19. Crit Care 2020 May 6;24 (1):200. pmid:32375848

33. Zhu J, Sun L, Zhang L, et al. Prevalence and Influencing Factors of Anxiety and Depression Symptoms in the First-Line Medical Staff Fighting Against COVID-19 in Gansu. Front Psychiatry, 2020 Apr 29;11:386. pmid:32411034

34. Choi E P H, Hui B P H, Wan E Y F W. Depression and Anxiety in Hong Kong during COVID-19. Int J Environ Res Public Health. 2020 May 25;17(10):3740. pmid:32466251

35. Ornell F, Halpern SC, Kessler FHP, Narvaez JCM. The impact of the COVID-19 pandemic on the mental health of healthcare professionals. Cad Saude Publica. 2020 Apr 30;36(4):e00063520. pmid:32374807

36. Simione L, Gnagnarella C. Differences Between Health Workers and General Population in Risk Perception, Behaviors, and Psychological Distress Related to COVID-19 Spread in Italy. Front Psychol. 2020;11:2166. Published 2020 Sep 4. pmid:33013555

37. Pappa S, Ntella V, Giannakas T, Giannakoulis VG, Papoutsi E, Katsaounou P. Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: A systematic review and meta-analysis. Brain Behav Immun. 2020 Aug;88:901–907. pmid:32437915

38. Li Y, Scherer N, Felix L, Kuper H. Prevalence of depression, anxiety and post-traumatic stress disorder in health care workers during the COVID-19 pandemic: A systematic review and meta-analysis. PLoS One. 2021 Mar 10;16(3):e0246454. pmid:33690641