The ethical, social, and cultural dimensions of screening for mental health in children and adolescents of the developing world

Abstract

Despite their burden and high prevalence, mental health disorders of children and adolescents remain neglected in many parts of the world. In developing countries, where half of the population is younger than 18 years old, one of every five children and adolescents is estimated to suffer from a mental health disorder. It is then essential to detect these conditions through screening in a timely and accurate manner. But such screening is fraught with considerable ethical, social, and cultural challenges. This study systematically identifies, for the first time, these challenges, along with potential solutions to address them. We report on the results of an international multi- and inter-disciplinary three-round Delphi survey completed by 135 mental health experts from 37 countries. We asked these experts to identify and rank the main ethical, social, and cultural challenges of screening for child and adolescent mental health problems in developing nations, and to propose solutions for each challenge. Thirty-nine significant challenges emerged around eight themes, along with 32 potential solutions organized into seven themes. There was a high degree of consensus among the experts, but a few interesting disagreements arose between members of the panel from high-income countries and those from low- and middle-income nations. The panelists overwhelmingly supported mental health screening for children and adolescents. They recommended ensuring local acceptance and support for screening prior to program initiation, along with careful and comprehensive protection of human rights; integrating screening procedures into primary care; designing and implementing culturally appropriate screening tools, programs, and follow-up; securing long-term funding; expanding capacity building; and task-shifting screening to local non-specialists. These recommendations can serve as a guide for policy and decision-making, resource allocation, and international cooperation. They also offer a novel approach to reduce the burden of these disorders by encouraging their timely and context-sensitive prevention and management.

About the Authors:

Fabio Salamanca-Buentello

Roles Conceptualization, Data curation, Investigation, Methodology, Project administration, Visualization, Writing – original draft

* E-mail: [email protected]

Current address: Bridgepoint Collaboratory for Research and Innovation, Lunenfeld – Tanenbaum Research Institute, Sinai Health System, Toronto, Ontario, Canada

Affiliation: Institute of Medical Science, University of Toronto, Toronto, Ontario, Canada

ORCID logo http://orcid.org/0000-0002-3666-7785

Mary V. Seeman

Roles Conceptualization, Supervision, Writing – review & editing

Affiliation: Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada

Abdallah S. Daar

Roles Conceptualization, Methodology, Supervision, Writing – review & editing

Affiliations Departments of Clinical Public Health and Surgery, University of Toronto, Toronto, Ontario, Canada, Stellenbosch Institute for Advanced Study, Stellenbosch, Western Cape, South Africa

Ross E. G. Upshur

Roles Conceptualization, Methodology, Project administration, Supervision, Writing – review & editing

Affiliations Division of Clinical Public Health, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada, Bridgepoint Collaboratory for Research and Innovation, Lunenfeld - Tanenbaum Research Institute, Sinai Health System, Toronto, Ontario, Canada

Introduction

Children and adolescents (C&A) constitute one-third of the world’s population and half of the population of low- and middle-income countries (LMICs). The vast majority (about 90%) live in the developing world [1]. One-fifth of C&A in LMICs suffers from at least one mental, neurologic, or substance abuse disorder (MNSD), the leading causes of disability worldwide [2–4]. MNSDs represent 13% of the global burden of disease, surpassing both cardiovascular disease and cancer [2,5–7]. They are the major contributor to disease burden in the 15–24 age group and are probably the most neglected aspect of health care [3,8–10]. These disorders account for almost one-third of disability-adjusted life-years (DALYs) lost during the first three decades of life [2,5] and most begin during childhood, adolescence, and early adulthood [4,8,11,12]. In fact, half of MNSDs first appear before age 14, and 75% before age 24, persisting into adulthood and negatively affecting future health and quality of life [2].

Mental health resources for C&A in LMICs are scarce, inadequate, unequally distributed, and inefficiently used, with effective and culturally relevant treatment rarely available [13]. Mental health services in LMICs are 50 times less accessible than they are in high-income countries (HICs) and they tend to be fragmented and very costly. They are poorly integrated into primary health care services and are typically provided at the tertiary level in urban understaffed and crowded institutions [6,14–16].

Nine of ten C&A with MNSDs in LMICs lack adequate care [17,18]. Ninety percent of global mental health resources are limited to the industrialized world, even though over 80% of the world’s population lives in LMICs [19]. This situation is likely to worsen in the coming years, especially in LMICs, due to lack of resources and to the geographic distribution of birth rate growth [18]. Half of the world’s population has access to fewer than one psychiatrist for every 200,000 individuals [17,20,21]. There are, in fact, 748 times fewer psychiatrists in LMICs than in HICs [22]. The "treatment gap" between the demand and the availability of adequate mental health care in LMICs is one of the most pressing ethical issues in these countries [17,23].

C&A mental health care infrastructure is limited by factors such as geography, culture, lack of cost-effectiveness research, and poor intersectoral collaboration [8,21,24,25]. Public expenditure on C&A mental health is negligible in LMICs; most available funds are assigned to the provision of direct clinical services, particularly inpatient care in specialist institutions [7,8,14,17]. This is one of the main reasons MNSDs tend to go undetected and untreated in the developing world. To make matters worse, existing health systems are plagued by poor governance, incompetent leadership, corruption, lack of resources, and undertrained and overworked mental health care workers [11,13,24].

Screening for MNSDs in developing world youth is justified by the large and growing vulnerable population of C&A in LMICs, the high prevalence of untreated or badly treated MNSDs in this cohort [26], the unjust stigmatization and cruel treatment of individuals suffering from these disorders [27–29], and the existence and availability of promising treatments for MNSDs [30,31]. Screening procedures are overwhelmingly recognized as some of the most cost-effective preventive population-wide public health strategies for reducing societal burden and costs related to disease and disability [32–35]. In fact, one of the Grand Challenges in Global Mental Health [20] recommends screening C&A for MNSDs, adapting such screening for local contexts, and incorporating it into primary health care as a part of a core package of services.

Screening enables early identification of at-risk C&A who require urgent attention, intervention, or in-depth assessment. It also leads to timely treatment and reduces the emotional and financial costs of delaying therapeutic procedures or of treating late stages of MNSDs [8,20]. Local screening in LMICs reduces the need for C&A and their families to attend specialized institutions in urban centres just to detect at-risk individuals. This is particularly relevant in contexts in which fragile health systems are overwhelmed with patients in advanced stages of disease [11,12,24,30]. Moreover, screening carried out by non-specialists decreases the total workload of highly trained professionals by enabling them to focus on diagnostic and treatment issues [16].

Screening, however, is laden with ethical, social, and cultural quandaries. When carried out in C&A, it must contend with ethical issues particular to this age group [36,37]. More importantly, most screening instruments and rating scales have been developed in the industrialized world, heavily influenced by the dominant Western biomedical model of mental health that assumes a universal set of causes, diagnostic categories, and treatments [19,38–41]. But this assumption stands on precarious ground, as nosological categories in mental health are based on loose amalgamations of signs and symptoms agreed upon by a consensus of mostly Western mental health professionals [38,42]. The prevailing Western model of MNSDs often collides with the local ways in which these disorders are perceived, understood, and traditionally addressed in LMICs [38,40,41,43,44]. Furthermore, screening, when done without an adequate ethical, social, and cultural framework, may lead to increased stigmatization, discrimination, marginalization, coercive treatment, and exclusion [13,37,45,46].

Screening for MNSDs in C&A living in the developing world is necessary because of the high prevalence and current lack of early detection of these disorders, which leads to a high rate of untreated cases. Given the scant attention to the many context-sensitive issues related to screening; the Western hegemony in the design and validation of screening instruments; the shortage of trained mental health care workers to conduct screening in LMICs; and the unavailability of adequate treatment for at-risk C&A in developing countries, we decided to conduct a three-round international multi- and inter-disciplinary Delphi survey to identify and rank the most pressing ethical, social, and cultural challenges in screening for MNSDs in developing world C&A, and the most suitable solutions to these challenges.

Methods

We carried out a three-round Delphi survey from October 2013 to December 2014. The Delphi is a structured and systematized consensus-building procedure that uses iterative feedback to collect and distill knowledge from an interdisciplinary panel of experts who remain anonymous to each other [47–50]. This flexible and versatile method has been employed extensively to predict the impact and direction of long-range trends in several fields and to assist in decision-making when designing policies and allocating resources [51,52]. Its main features are anonymity, iteration, controlled feedback, and statistical aggregation of group responses [48]. Heterogeneous groups of experts independently provide responses to focused questions but share decisions through facilitators that collect, organize, summarize, and analyze the responses through formal, systematized mechanisms [49,53]. The systematic nature of the Delphi strengthens the quality, efficiency, and long-term accuracy and validity of panelists’ predictions and judgements [52,54]. The Delphi also avoids challenges and biases inherent to face-to-face meetings and allows group processes when members cannot be physically in the same place.

Based on our experience [20,55–59] and on the existing literature [49,52], we decided that three Delphi rounds using email messages for recruitment, direction, reminders, and for responding to queries, would be sufficient to elicit response stability from our panelists. To ensure a systematic and meaningful synthesis of responses, we drafted, piloted, redrafted, and refined the questions asked of the panelists in every round. We communicated in English with most panelists, and, where needed, in their native languages (mainly Spanish, French, and Portuguese). Periodic email reminders were sent to the experts throughout each round to increase the response rate. We initially pilot tested the questionnaires sent to the experts in each round with a small group of trusted colleagues who fulfilled the inclusion and non-inclusion criteria described earlier, and who would not be incorporated into our panel.

Panel selection and recruitment

To select our panelists, we sent an email invitation to 490 adult experts from 65 countries who had demonstrated accomplishments and leadership based upon academic, scientific, and professional background and achievements, as evidenced by indexed, high-impact publications, decision-making responsibilities at a local and global levels, or extensive field experience in developing countries. Several of these experts had participated in previous Delphi studies used to identify the Grand Challenges in Non-Communicable Diseases [55] and the Grand Challenges in Global Mental Health [20]. The inclusion criteria for panelist selection are shown in Table 1. We ensured the representativeness of the panel and addressed selection biases by standardizing the expert selection process, using purposive and criterion sampling, and balancing the panel with respect to sex, geographic distribution, and specialty areas. We deliberately included individuals with widely different backgrounds and perspectives in diverse scientific, research, clinical, policy, and advocacy fields with a stake in global C&A mental health. We considered including C&A suffering from MNSDs and their caregivers but decided against it due to the considerable ethical challenges of identifying such a group and the difficulty in obtaining a representative sample.

[Figure omitted. See PDF.]

Table 1. Inclusion criteria for the selection of the panelists.

https://doi.org/10.1371/journal.pone.0237853.t001

Panelists were assigned to one of three categories according to their country of origin and their place of work, using the World Bank classification of countries (https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups), which is based on gross national income per capita: low-and-middle income country, high-income country, or mixed (if the academic and professional activities of a panelist were spread over a wide range of countries).

Delphi rounds and data collection and analysis

For Round I, we asked each of the 490 invited experts to identify the three to five foremost ethical, social, or cultural challenges to screening for MNSDs in LMIC C&A, along with three to five potential solutions to address these challenges. In the invitation email, we defined C&A as individuals 19 years old or younger, and screening as a population-wide public health strategy that detects diseases in asymptomatic individuals as early as possible, enabling timely interventions.

Upon receipt, we combined, collated, and analyzed the answers from the experts and organized the challenges and the solutions into two taxonomies subdivided by theme. The systematic line-by-line reading of each response led to the identification of key concepts that became the seeds for the final categories and themes sent back to the panelists for Round II. We used the concepts and themes obtained from previous answers to anchor those that emerged from subsequent responses. As the analysis advanced, an emphasis on and reiteration of certain issues above others became evident; these elements coalesced into frameworks that later gave rise to the final categories and themes. After several manual iterations of this analysis, the final categories and themes emerged. We attempted to make the challenges and solutions independent and mutually exclusive, and relatively exhaustive.

After Round I, we generated a taxonomy of 89 challenges, organized into nine themes, and 93 solutions, arranged into seven themes, for a total of 182 categories. For Round II, this taxonomy was presented to the 165 experts from 40 countries who had completed Round I. Round II was carried out using FluidSurveys.com, now owned by SurveyMonkey.com. We now asked each panelist to select what he or she considered the five most relevant categories for each theme. We then calculated the frequency with which each challenge and solution had been chosen. For Round III, we used the four top categories in each theme, along with those challenges and solutions selected by 50% or more of the respondents. Decisions about numbers and cut-offs were made by discussion and consensus among the authors.

In the email-based Round III, we asked the 135 remaining experts from 37 countries who had completed Round II to do the following three activities: review the final lists of categories, which were grouped into themes and ordered according to the frequency with which they had been selected; re-rank or reject items, if they so wished; and justify their decisions. We compiled the panelists’ comments, linking them to their sex and type of country.

To calculate the final rankings, we assigned scores to categories the following way: for each panelist’s response, the highest ranked category in each section received n points, where n = number of categories in the section; the second-ranked category received n-1 points, and so forth. Rejection of a category was translated into a score of “0” (zero). The sum total resulted in the final rankings. We also determined the rejection rate for each category.

Visual representation of the results

Using the scores for each category, we elaborated heat maps, two-dimensional, colour-shaded graphical representations of a data matrix (the scores from Round III) displayed as a rectangular tiling in which each tile or cell is shaded on a colour scale to represent the value of the corresponding element of the data matrix. Hierarchical clustering on the rows and columns of the matrix results in cells with similar values being placed together, thus generating coherent patterns of colour that provide a logical and synoptic view of our results. This allows for immediate visual assessments and comparisons of the distribution of values. Heat maps provide a logical, coherent, and synoptic view of the results and enable immediate visual assessments and comparisons of the distribution of values without confusing the viewer [60]. We illustrate the structure and logic behind our design of the heat maps in Fig 1.

[Figure omitted. See PDF.]

Fig 1. Explanation of the structure of the heat maps and of the correlation between the colour scale and the rankings provided by the panelists.

This figure illustrates the general configuration of a heat map, using as an example a theme with seven categories, organized from left to right starting with the category ranked first (the first column), then second, then third, and so on. Values are arranged in decreasing order within each column. Columns and rows are arranged to place similar values together; clusters (blocks of a single colour) show consensus among panelists. Larger values are represented by darker tones and smaller values by lighter tones. Red indicates rejection of a category.

https://doi.org/10.1371/journal.pone.0237853.g001

In the heat maps, the value of a score correlates with the intensity of the colouring of a particular cell. Each row corresponds to the rankings provided by one single panelist; consequently, there are 135 rows. Each column contains the rankings provided by all of the panelists for one specific category. The rows are arranged, first according to type of country, then by sex, and finally, according to the category ranked first (the first column), then second, then third, and so on, with the values arranged in decreasing order within each column. The columns are organized in descending order from left to right according to the final rankings resulting from the sum of the scores for each category. Columns and rows are thus arranged to place similar values together, with clusters showing consensus among panelists.

Colour shows the rank that each panelist gave to each of the categories in a theme. Larger values are represented by darker tones of blue. Red indicates rejection of a category. The sex of the panelists and the type of country to which they were assigned are shown in columns to the right of the rankings. The type of country is indicated by tones of grey, responses from female panelists are shown in light salmon, and those from male panelists are shown in pale green. We chose three colour schemes developed by Brewer et al. (http://colorbrewer2.org) that, according to principles delineated by Tufte [61,62], best conveyed differences and correlations among the data.

The protocol of this study was approved by the Health Sciences Research Ethics Board of the University of Toronto Office of Research Ethics (Protocol Reference # 28918). The only incentive to the panelists was the promise of copies of all relevant publications and the assurance that their names would be included in the list of participants who completed all three Delphi rounds.

Results

Of the 490 experts from 65 countries initially invited to participate, 165 (34%) from 42 countries provided responses to Round I. More than four-fifths of the experts who finished Round I also completed Round II. All 135 experts from 37 countries who completed Round II also finished Round III (Table 2). The members of the final panel appear in the Supporting Information in S1 Table, while the number of experts who completed the Delphi by country is shown in S2 Table.

[Figure omitted. See PDF.]

Table 2. Distribution of the experts in each Delphi round, by sex and type of country according to World Bank classification of nations.

https://doi.org/10.1371/journal.pone.0237853.t002

The composition of the panel did not vary significantly across the Delphi rounds in terms of sex, geography, type of country, or expertise. We compared the distribution by sex, country, and field of work of the 165 experts who completed Round I to that of the 325 individuals who were invited and chose not to participate in our study. The distribution by sex and country for this Round is noted in Table 2, and the comparison between the numbers and percentages of respondents and non-respondents to Round I appears in S3 Table (found in the Supporting Information). With the exception of the first two categories, it is clear that the proportion of responders / non-responders is quite similar. The higher percentage of responders in these two top categories is not unexpected, as experts who specialize in mental health of vulnerable populations, global mental health, public health, epidemiology, or health economics, would be more likely to show interest in the topic of our study, and to feel sufficiently knowledgeable to respond to the questions.

Challenges and solutions

After Round I, we organized the proposed 89 challenges into nine themes, and the 93 potential solutions into seven themes. By the final Round, the panelists had selected and ranked 39 challenges, grouped into eight themes, and 32 potential solutions to these challenges, arranged into seven themes. These challenges and solutions are shown in Table 3. Given that the theme “Public and community engagement” only had five challenges, and that, in Round II, panelists were asked to choose exactly five categories for each theme, we decided to combine these five challenges with those of the theme “Education, training, and capacity building”, thereby reducing the number of separate challenge-related themes from nine to eight.

[Figure omitted. See PDF.]

Table 3. Comparison and correspondence between the final challenges and their potential solutions.

https://doi.org/10.1371/journal.pone.0237853.t003

As mentioned in the Methods section, we created 15 heat maps to facilitate the visualization of the results of our Delphi. We show here the heat map corresponding to the top ranked challenges of the first theme, “Inadequate design and validation of the screening tools” (Fig 2). The other 14 heat maps can be found in S1 Fig of the Supporting Information, with S1a–S1g Fig showing the heatmaps for the challenges, and S1h–S1n Fig showing those for the solutions. In all the heat maps, large blocks of the same colour indicate consensus regarding the ranking of a category. The numbers representing the scores given by the panelists to each challenge or solution do not appear in each cell, as the colours and their intensity convey the same information.

[Figure omitted. See PDF.]

Fig 2. Heat map with the distribution of the final rankings of challenges theme I: Inadequate design and validation of the screening tools identified by the panelists by sex and type of country according to the World Bank classification.

The rows are arranged, first according to type of country (HIC, L / H, LMIC), then by sex (F, M), and, finally, according to the category ranked first (the first column), then second, then third, and so on, with the values arranged in decreasing order within each column. The columns are organized in descending order from left to right according to the final rankings resulting from the sum of the scores for each category; the numbers at the top of each column correspond to these totals. Columns are therefore arranged to place similar values together; clusters (blocks of a single colour) show consensus among panelists. Larger values are represented by darker tones. Red indicates rejection of a category. The sex of the panelists and the type of country to which they were assigned are shown in columns to the right of the rankings. The type of country is indicated by tones of grey, responses from female panelists are shown in light salmon, and those from male panelists in pale green. In contrast to Fig 1, which explains the design of the heat maps, in this illustration the numerical values of the scores are not included because the tone of the colour clearly conveys this information.

https://doi.org/10.1371/journal.pone.0237853.g002

Fig 3 shows the correspondence between challenges and solutions. All challenges could potentially be addressed by at least 2 solutions, and all solutions could potentially address at least 3 challenges. Challenges were addressed by 2 to 17 solutions, and solutions could potentially address 3 to 21 challenges.

[Figure omitted. See PDF.]

Fig 3. Correlation between the final challenges and solutions.

The challenges are organized by theme along the vertical axis and are indicated by C-I to C-VIII, with Arabic numerals corresponding to the challenges within each theme, by rank. Similarly, the solutions appear organized by theme along the horizontal axis and are indicated by S-I to S-VII, with Arabic numerals corresponding to solutions within each theme, by rank. In this rectangular binary matrix, a black cell indicates that a particular solution can meet a specific challenge. Large vertical blocks of black cells show that a solution is relevant to several challenges, while large horizontal blocks represent challenges that can be addressed by several potential solutions.

https://doi.org/10.1371/journal.pone.0237853.g003

Engagement with the topic of our study was evidenced by comments provided by the panelists regarding the themes, the categories, and their rankings. The themes that received the highest number of comments were mental health care infrastructure; inadequate design, validation, application and interpretation of screening tools; fear and lack of trust; and human dignity, human rights, privacy, autonomy, consent, and confidentiality. Interestingly, LMIC panelists provided more comments than those from HICs, which could indicate a greater investment with the subject matter.

The low rates of rejection of the categories strengthen the final consensus. Even the most rejected category was eliminated by less than 10% of the panelists. In the heat maps, the rejection of all the categories in a given theme appears as a single horizontal red line. Only 5 panelists, all from the developing world, made across-the-board rejections, another indication of strong feelings about the topic of our study.

Discussion

Ours is the first systematic identification and prioritization of ethical, social, and cultural issues pertaining to screening for MNSDs in developing world C&A. Our results echo several of the proposals of the Grand Challenges in Global Mental Health [20], in particular the need to adapt screening to local contexts, and its incorporation into primary health care.

Design and validation of screening tools

The panel recognized the challenges involved in the epidemiological justification, logistics, long-term perspective, and cost-effectiveness of initiating screening programs with instruments appropriate to local needs. The experts agreed that all tools used must be valid, reliable, accurate, and locally acceptable in order to enhance their benefits and reduce their potential harms; this view agrees with the literature [63,64]. Panelists emphasized the need for adequate post-screening referral and follow-up of C&A found to be at-risk [34,35,65]. Our panel noted that the validity and reliability of screening tools depend on the soundness of the nosological taxonomies on which they are based [66]. However, some experts believed that screening should be less about capturing an ideal disease construct and more about uncovering distress that can be addressed by effective care.

Too often, screening tool development is biased by external agendas irrelevant to the task at hand [23,37,67]. Also, the requirements for permissions and payment of instrument licensing fees are unrecognized challenges for LMICs.

The experts warned that instruments that yield false negatives could lead to lack of adequate treatment, while those that yield false positives could lead to unjustified medicalization and cruel stigmatization of those erroneously found to be at risk [66,68–70]. Other challenges mentioned by our panel were language difficulties, the misleading capture of transitory rather than long-lasting states of mind, the expected reluctance to report symptoms deemed to be embarrassing, and the possibility of inaccurate interpretation of screening results, considerations that have been alluded to in previous literature [71–73], but have been emphasized more strongly by our panelists.

Our results challenge the premise that it is possible to design a universally applicable screening tool that can be used for C&A across the world. Thomas Achenbach and his group have developed screening instruments that have been used in 44 societies on five continents and have been translated into 85 languages [74–78]. These tools are based on a classification of societies using an omnicultural mean from which a local set of norms can be developed. In Achenbach’s group experience, cultural differences do not result in significant discrepancies when using these instruments. This research group believes that empirically-based assessments with standardized tools and procedures offer a cost-effective way to identify problems in C&A of different cultural backgrounds [74]. Our results, in agreement with those of others [72,79,80], contradict the idea that “universal” screening instruments can be used in contexts very different from those in which they were designed. Our panelists stress the point that current screening tools that have been developed and validated in HICs under Western paradigms are liable to miss local indicators of disease, may mislabel and pathologize normal or culturally acceptable behavioural variations, or may ignore psycho-socio-cultural differences within and among geographic regions.

Adaptation and translation of screening tools

In line with the concern regarding the use of “universal” screening tools, the panel shared with others [38,40,41,81] an acute awareness of the Westernization of currently used screening instruments. Our experts recommended that all instruments used in LMICs be context-sensitive, evidence-based, age-appropriate, easy to administer, reliable, affordable, and cost-effective [20,65,68,82]. They pointed out that several such instruments are currently used in the developing world [63,83–87]. At the same time, it was not lost on the panelists that adequate resources and technical expertise to design locally appropriate questionnaires may not always be available. Thus, in some instances, appropriately adapting and translating well-validated standardized questionnaires could be the practical and cost-effective solution [16,88–90]. This is especially so because standard methods and guidelines have been developed to increase concordance between the adapted and translated instruments and their originals [66,82,91,92].

Application of screening tools

The panel considered the accessibility and acceptability of locations in which screening might best be conducted, along with the timing of the application of the instruments. While screening in schools is favoured by many [93–95], the experts drew attention towards the needs of marginalized C&A, who may not attend educational institutions. Screening that includes interviewing multiple key informants [96–98] was recommended. Panelists praised the use of vignettes, pictorial representation, and socially- and culturally-sensitive electronic screening tools and post-screening interventions previously shown to be effective in LMICs [99–105].

Integration of screening into primary health care

Our experts agreed that screening for mental health, along with follow-up of at-risk C&A in LMICs, needs to be incorporated into community-based primary health care. This view coincides with a major recommendation of the Grand Challenges in Global Mental Health [20,106]. Integrating C&A mental health programs such as screening into primary health care has been shown to be effective, accessible, affordable, and family-friendly [24,71,107–113]. Such integration ensures that C&A with MNSDs are treated as all other medical patients, thus minimizing stigmatization [17]. Our panelists considered that successful screening of C&A in primary care could lead to a surge in demand for mental health treatment in contexts where specialists are scarce or non-existent. However, this issue may subside once primary health care workers gain experience in the care of at-risk individuals [107,109,110].

Need for post-screening follow-up

In line with canonical screening practices [35,114,115], most panelists agreed that screening should only be carried out where post-screening follow-up is available. They considered it would be unethical to burden C&A and their families with positive screening results in the absence of access to effective treatment. In our experts’ view, a culturally-sensitive national mental health strategic plan that provides adequate long-term funding, administrative and logistic support, and supervision of screening endeavours and treatment facilities must be in place before instituting screening. Our experts also advocated for a mental health subsystem focused specifically on C&A with a functioning system of referrals and contra referrals, adequate insurance coverage, support for families, communities, and teachers, and political backing. These prerequisites have been brought up in the literature [11,17,24,116,117]. Demanding such provisions before the start of screening was the issue that generated the greatest discrepancy among the panelists. In their comments, dissenting experts, mostly coming from LMICs, stated that such requirements could easily become an excuse for inaction. In their view, the burden of C&A MNSDs and the existence of effective interventions (even when not locally available) justified screening. They argued that the identification of large numbers of individuals needing mental health care constitutes a powerful source of pressure on governments, charitable organizations, pharmaceutical companies, private donors, and global institutions to build new needed resources.

Scaling-up of existing screening programs

Our panel noted that, while successful and cost-effective screening initiatives do exist in LMICs, most need to be scaled-up. The literature indicates that achieving this goal requires a long-term vision, flexibility, and political support [7,11,118,119]. The sustainability of scaling-up initiatives depends on sufficient and stable funding from many quarters: national health budgets, the local private sector, and global foundations and financial institutions [79,120]. Panelists were confident that, in the long term, the costs of providing care to at-risk C&A would be offset by a reduction in the burden of disease due to screening and early treatment.

International collaborations

The panel strongly endorsed long-term, sustainable South-South and North-South collaborations aligned with local health-care needs. Such partnerships help prioritize C&A mental health issues in LMICs, provide mentorship, mobilize political will, and shape policy development. Existing successful collaborations [121–125] and international consortia [79] are available to provide leadership. Our findings can result in the formation of more such collaborations, for instance the creation of an online repository of locally developed and validated screening tools and of ongoing results of LMIC screening programs.

Ethical and human rights issues

The panel recommended a human rights framework for screening. Our experts defined ethical screening as embodying respect for the dignity of all screened C&A. They noted that requirements for free, uncoerced, and informed consent and assent needed to be based on participants’ maturity, age of autonomy, and legal competence. The conflict between Western interpretations of individuality and autonomy, and the reliance on collective decision-making common in some LMICs elicited their attention. Communal approaches to privacy, autonomy, and confidentiality, and marked gender inequalities, may lead to decision-making that marginalizes the opinions of C&A (particularly girls) regarding their mental health care.

Fundamentally, however, screening needs to ensure privacy and confidentiality, allow information sharing with caregivers, and guarantee regulation of access, storage, protection, and destruction of screening data to prevent information misuse [13,17,23,36,37,45,126–130]. The panelists noted the importance of attitude and demeanor on the part of Western advisors of screening programs in LMICs, particularly the avoidance of what could be interpreted as condescension, disapproval, or arrogance. They also pointed out, as has been done by others, that screening must focus on the needs of the C&A and not on the personal, academic, or professional interests of the screeners [37,79].

Fear and lack of trust

Myths and misconceptions about MNSDs can arouse suspicion and resentment towards screeners, screening programs, health administrators, and Westerners, thus discouraging participation [17,23,37]. As most developing countries endured the experience of colonization, the rejection against Western cultural concepts and constructs of mental health is understandable [38,41,44]. Screening tools have been developed for and validated overwhelmingly in adult populations in industrialized countries. Caucasian populations, cultures, and societies have been considered normative, with the “culture-specific” label reserved for those of non-Western origin. Some panelists wondered whether the legacy of colonialism in LMICs could have forever sabotaged the participation of foreigners from HICs in the screening programs.

The panel noted that C&A may be reluctant to participate in screening, especially if they feel coerced by adults. In turn, adults may fear that the screening will induce socially unacceptable behaviours in their children or that those at-risk will be taken from them. Conversely, they may expect to be provided with educational or financial support if they have a child at risk, becoming disappointed when this proves untrue. Screening may be perceived as overly intrusive. Informants may fear appearing indiscreet or vulnerable, not knowing what information to disclose and what to keep within the family. Assurances of confidentiality need to be guaranteed by trusted elders.

Education, training, and capacity-building

Our panel consensus, in line with WHO recommendations [22,131–133], advocates for the design and implementation in LMICs of socially- and culturally-sensitive education and capacity-building strategies that include training, support, and supervision for all screening staff [16,20,24,134–136]. These strategies encompass “task shifting” and devolving responsibilities, when appropriate, to non-specialists or lay individuals [137–139]. They also include community-based care, clear referral pathways, and compensation / recognition commensurate with the importance of the work [16,24,134]. The panelists noted that C&A mental health care providers in LMICs are currently overworked, overwhelmed, and underpaid, and most feel unsupported. LMICs can benefit from South-South and North-South collaborative capacity-building efforts [8,11,24], especially those that encourage “brain recirculation”, harnessing the talents of the diaspora of mental health care workers from LMICs now living and working in HICs [16,20,134].

Public and community engagement

The experts stressed that baseline local acceptance and support for screening in target populations was required before the roll-out of any screening program. Incorporating relevant stakeholders at all stages of the program builds trust, integrates system-level considerations with community-level needs, and helps address social and cultural divergences and misunderstandings [20,140]. Periodic, culturally sensitive, and empowering public and community engagement strategies implemented in parallel with screening initiatives considerably strengthen support for the screening programs. Even though these strategies may unrealistically raise expectations, on the positive side, they raise awareness about C&A MNSDs, provide information, address concerns, increase a sense of ownership of the programs, and decrease stigmatization [141,142]. Existing manuals such as the one developed by the Child Mental Health Awareness Task Force [143], serve as potential guides to such initiatives.

General considerations on the panelist consensus

Three general patterns common to the 15 heat maps of this study (Fig 2 and S1 Fig in the Supporting Information) emerge from our findings: categories ranked first or second show greater consensus than lower ranked ones; the patterns of consensus (or disagreement) tend to remain constant regardless of the type of country; and male respondents from both HICs and LMICs tend to disagree more among themselves than female respondents, especially with regard to solutions.

Future avenues of development

Our findings suggest the following specific courses of action in accordance with the global mental health literature [18,120,142,144–147]. Research is needed on local social and cultural issues that affect the screening programs, their integration into primary health care, and their scaling-up. The discovery of biomarkers of neuropsychiatric illness will, in time, make screening more accurate and the nosological taxonomy of MNSDs perhaps less culture-bound. Insurance coverage for mental health screening and subsequent treatment and follow-up is an urgent necessity everywhere. The sharing of experiential knowledge among LMICs will streamline and speed the design and implementation of screening programs. In the next few years, technological advances in artificial intelligence will facilitate analysis of increasingly large amounts of screening data. We propose that sections on C&A mental health screening be included in the guidelines of relevant professional societies. Importantly, our results underscore the need for policies, laws, and regulations that support screening programs and that align with United Nations human rights instruments and standards [17,130,132,148–151]. This requires securing political commitment, actively involving relevant stakeholders (including “champions”, local high-profile individuals), and taking advantage of “policy windows” [133,152–155]. Screening initiatives need to ensure that at-risk C&A receive the same legal protection as individuals suffering from other health conditions. In our view, informed by the findings of this study, the severe burden of C&A MNSDs justifies embedding screening as a bedrock program in WHO action plans [131] and including it among the Sustainable Development Goals. WHO core packages such as the Mental Health Gap Action Programme (mhGAP) [156] can help involve non-specialists in screening programs, integrate screening into primary health care, and guide the scaling-up of screening initiatives [150]. WHO documents [157] are available to guide the development of policies and norms governing screening programs in LMICs. The WHO can also catalyze the inclusion of screening initiatives in international collaborations by providing incentives and support. It is well placed to help overcome political barriers, share successful screening experiences, and guide program and post-screening monitoring [6,79].

Strengths and potential limitations of the study

The Delphi method and the multi- and inter-disciplinary global panel of experts we recruited gives credence to the validity, reliability, and accuracy of our results, as does the panel’s relative stability over three rounds. Panel diversity was a strength. The sex ratio was almost equal, and throughout the three rounds, more than half of the experts were from LMICs. The drop-out rate mirrored that of other Delphi studies [48,158]. The high response rate in Rounds II and III reinforces the validity of the solutions proposed. As with all Delphi surveys, a different panel might have arrived at somewhat different results. Our findings reflect the opinions of a particular group of individuals at a specific point in time. However, the generalizability of our results is strengthened by the expertise and representativeness of our panelists and the concordance of many of their views with published literature. While our study took place in 2014, circumstances regarding mental health have changed little in the developing world, so we consider that our findings continue to be relevant. Panelist attrition might have influenced the results, but the final panel closely mirrored the original group of invitees. In terms of the configuration of our Delphi panel, it could be argued that some LMIC experts belong to local elites and are unaware, perhaps, of all the needs of disadvantaged C&A with MNSDs in their countries. We have no evidence that this is the case. While we could have included in the Delphi panel C&A suffering from MNSDs as well as their parents or caregivers, we would have faced considerable ethical challenges related to consent and assent. Absent or unreliable internet access could have limited the participation of some experts. Still, we did manage to exchange emails with panelists from some LMICs with relatively poor internet service. Non-native English speakers, especially in LMICs, may have excluded themselves. However, while communications with the panel were largely in English, we also managed to correspond with some LMIC panelists in their native languages. The challenges and solutions identified by the panel could hypothetically differ as applied to specific MNSDs, but this possibility was not mentioned by any of the panelists. Shared risk factors, overlapping symptoms, and co-morbidity have favoured grouping diverse MNSDs together [159] despite acknowledged brain differences among them [160,161] and variation in genetic risks [162].

Conclusions

Rigorously selected expert panelists were asked to identify challenges and solutions to ethical, social, and cultural issues related to screening for MNSDs in C&A of the developing world. Specific solutions proposed by the panel include the incorporation of screening into primary health care, the implementation of education and capacity-building strategies, and the design of optimal policy frameworks. Our results provide an evidence-based foundation for policy- and decision-making, priority-setting, resource allocation, and international cooperation in C&A mental health. At the same time, we highlight some interesting disagreements between experts from LMICs and HICs on the use of Western versus locally developed screening tools, on the roll out of screening programs in the absence of accessible treatment, and on the question of the relationship of screening to the stigma that attaches to mental health. These important issues await further exploration. We hope that our results can contribute to improve the mental health and quality of life of the vast number of vulnerable children and adolescents in the developing world.

Supporting information

[Figure omitted. See PDF.]

S1 Table. Final list of panelists.

https://doi.org/10.1371/journal.pone.0237853.s001

(DOCX)

S2 Table. Number of panelists who completed all rounds of the Delphi, by country.

https://doi.org/10.1371/journal.pone.0237853.s002

(DOCX)

S3 Table. Number and percentage of respondents and non-respondents to Delphi round I, by field of expertise.

https://doi.org/10.1371/journal.pone.0237853.s003

(DOCX)

S1 Fig. A-N. Heat maps for challenges themes II-VIII and solutions themes I-VII.

https://doi.org/10.1371/journal.pone.0237853.s004

(DOCX)

Acknowledgments

We are very grateful to the members of the Delphi panel for their participation and expertise. We also thank Prof. Halla Thorsteinsdóttir and Prof. Howard Mount for their support and encouragement, and for their useful comments and suggestions. This paper originates from Fabio Salamanca-Buentello’s doctoral dissertation at the University of Toronto Institute of Medical Science.

Citation: Salamanca-Buentello F, Seeman MV, Daar AS, Upshur REG (2020) The ethical, social, and cultural dimensions of screening for mental health in children and adolescents of the developing world. PLoS ONE 15(8): e0237853. https://doi.org/10.1371/journal.pone.0237853

References

1. United Nations Population Fund. State of World Population 2014. New York; 2014.

2. Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, et al. Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. Lancet. 2013;382: 1575–86. pmid:23993280

3. Kieling C, Graeff-Martins AS, Hamoda H, Rohde LA. Child and adolescent mental health. In: Patel V, Minas H, Cohen A, Prince MJ, editors. Global mental health: Principles and practice. Oxford: Oxford University Press; 2014. pp. 335–53.

4. Kieling C, Rohde LA. Going global: epidemiology of child and adolescent psychopathology. J Am Acad Child Adolesc Psychiatry. 2012;51: 1236–7. pmid:23200280

5. Vigo D, Thornicroft G, Atun R. Estimating the true global burden of mental illness. The Lancet Psychiatry. 2016;3: 171–8. pmid:26851330

6. Collins PY, Saxena S. Action on mental health needs global cooperation. Nature. 2016;532: 25–7. pmid:27078549

7. Patel V, Chisholm D, Parikh R, Charlson FJ, Degenhardt L, Dua T, et al. Addressing the burden of mental, neurological, and substance use disorders: key messages from Disease Control Priorities, 3rd edition. Lancet. 2016;6736: 1672–85.

8. Kieling C, Baker-Henningham H, Belfer M, Conti G, Ertem I, Omigbodun O, et al. Child and adolescent mental health worldwide: Evidence for action. Lancet. 2011;378: 1515–25. pmid:22008427

9. Kessler RC, Alonso J, Chatterji S, He Y. The epidemiology and impact of mental disorders. In: Patel V, Minas H, Cohen A, Prince MJ, editors. Global mental health: Principles and practice. Oxford: Oxford University Press; 2014. pp. 82–101.

10. World Health Organization. Mental Health Atlas 2011. Geneva: World Health Organization; 2011.

11. Patel V, Flisher AJ, Nikapota A, Malhotra S. Promoting child and adolescent mental health in low and middle income countries. J Child Psychol Psychiatry Allied Discip. 2008;49: 313–34. pmid:18093112

12. Patel V, Flisher AJ, Hetrick S, McGorry P. Mental health of young people: a global public-health challenge. Lancet. 2007;369: 1302–13. pmid:17434406

13. Hanlon C, Tesfaye M, Wondimagegn D, Shibre T. Ethical and professional challenges in mental health care in low- and middle-income countries. Int Rev Psychiatry. 2010;22: 245–51. pmid:20528653

14. World Health Organization. Atlas of child and adolescent mental health resources. Geneva: World Health Organization; 2005.

15. Morris J, Belfer M, Daniels A, Flisher A, Villé L, Lora A, et al. Treated prevalence of and mental health services received by children and adolescents in 42 low-and-middle-income countries. J Child Psychol Psychiatry Allied Discip. 2011;52: 1239–46. pmid:21554305

16. Kakuma R, Minas H, van Ginneken N, Dal Poz MR, Desiraju K, Morris JE, et al. Human resources for mental health care: current situation and strategies for action. Lancet. 2011;378: 1654–63. pmid:22008420

17. Ngui EM, Khasakhala L, Ndetei D, Roberts LW. Mental disorders, health inequalities and ethics: A global perspective. Int Rev Psychiatry. 2010;22: 235–44. pmid:20528652

18. Baingana F, al’Absi M, Becker AE, Pringle B. Global research challenges and opportunities for mental health and substance-use disorders. Nature. 2015;527: S172–S177. pmid:26580324

19. White R. The globalisation of mental illness. Psychologist. 2013;26: 182–5.

20. Collins PY, Patel V, Joestl SS, March D, Insel TR, Daar AS, et al. Grand challenges in global mental health. Nature. 2011;475: 27–30. pmid:21734685

21. World Health Organization. Mental Health Atlas 2014. Geneva: World Health Organization; 2015.

22. World Health Organization. Atlas: Psychiatric education and training across the world. Geneva: World Health Organization; 2005.

23. Sondheimer A, Rey JM. Ethics and international child and adolescent psychiatry. In: Rey JM, editor. IACAPAP e-Textbook of Child and Adolescent Mental Health. Geneva: International Association for Child and Adolescent Psychiatry and Allied Professions; 2015. http://iacapap.org/iacapap-textbook-of-child-and-adolescent-mental-health

24. Omigbodun O. Developing child mental health services in resource-poor countries. Int Rev Psychiatry. 2008;20: 225–35. pmid:18569175

25. Lund C, Stansfeld S, De Silva M. Social determinants of mental health. In: Patel V, Minas H, Cohen A, Prince MJ, editors. Global mental health: Principles and practice. Oxford: Oxford University Press; 2014. pp. 116–36.

26. Polanczyk GV, Salum GA, Sugaya LS, Caye A, Rohde LA. Annual research review: A meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J Child Psychol Psychiatry Allied Discip. 2015;56: 345–65. pmid:25649325

27. Abuhammad S, Dalky H. Ethical Implications of Mental Health Stigma: Primary Health Care Providers’ Perspectives. Glob J Health Sci. 2019;11: 165–74.

28. Seeman N, Tang S, Brown AD, Ing A. World survey of mental illness stigma. J Affect Disord. 2016;190: 115–21. pmid:26496017

29. Minas H, Diatri H. Pasung: Physical restraint and confinement of the mentally ill in the community. Int J Ment Health Syst. 2008;2: 8–12. pmid:18554420

30. Klasen H, Crombag AC. What works where? A systematic review of child and adolescent mental health interventions for low and middle income countries. Soc Psychiatry Psychiatr Epidemiol. 2013;48: 595–611. pmid:22961287

31. Lee BFS, Heimer H, Giedd N, Lein ES, Šestan N, Weinberger DR, et al. Adolescent mental health—Opportunity and obligation. Science. 2014;346: 547–9.

32. Wilson JM, Jungner YG. Principles and practice of mass screening for disease. Geneva: World Health Organization; 1968.

33. Stiffler MC, Dever B V. Chapter 2: History of Screening Practices, Mental Health Assessment, and Classification in the USA. In: Stiffler M, Dever B, editors. Mental Health Screening at School: Instrumentation, Implementation, and Critical Issues. Switzerland: Springer International Publishing; 2015. pp. 5–26.

34. Verhulst FC, van der Ende J. Using rating scales in a clinical context. 5th ed. In: Rutter M, Bishop DVM, Pine DS, Scott S, Stevenson J, Taylor E, et al., editors. Rutter’s Child and Adolescent Psychiatry. 5th ed. Oxford: Blackwell Publishing Limited; 2008. pp. 289–98.

35. Verhulst FC, van der Ende J. Assessment Scales in Child and Adolescent Psychiatry. Abingdon: Informa UK; 2006.

36. Koocher GP. Ethical challenges in mental health services to children and families. J Clin Psychol. 2008;64: 601–12. pmid:18384118

37. Sondheimer A, Jensen P. Ethics and child and adolescent psychiatry. 4th ed. In: Bloch S, Green SA, editors. Psychiatric ethics. 4th ed. Oxford: Oxford University Press; 2009. pp. 385–407.

38. Clark J. Medicalization of global health 2: The medicalization of global mental health. Glob Health Action. 2014;7: 24000. pmid:24848660

39. Kirmayer LJ. Beyond the “new cross-cultural psychiatry”: cultural biology, discursive psychology and the ironies of globalization. Transcult Psychiatry. 2006;43: 126–44.

40. Summerfield D. “Global mental health” is an oxymoron and medical imperialism. Br Med J. 2013;346: f3509–f3510.

41. Kirmayer LJ, Swartz L. Culture and global mental health. In: Patel V, Minas H, Cohen A, Prince MJ, editors. Global mental health: Principles and practice. Oxford: Oxford University Press; 2014. pp. 41–62.

42. Rutter M, Pickles A. Annual Research Review: Threats to the validity of child psychiatry and psychology. J Child Psychol Psychiatry. 2016;47: 398–416. pmid:26385019

43. Aggarwal NK. Cultural formulations in child and adolescent psychiatry. J Am Acad Child Adolesc Psychiatry. 2010;49: 306–9. pmid:20410723

44. Bughra D. Culture matters for psychological care. SciDevNet. 2016. http://www.scidev.net/global/health/opinion/culture-matters-psychological-care-refugees.html

45. Mehta N, Thornicroft G. Stigma, discrimination, and promoting human rights. In: Patel V, Minas H, Cohen A, Prince MJ, editors. Global mental health: Principles and practice. Oxford: Oxford University Press; 2014. pp. 401–24.

46. Khalil A, Gondal F, Imran N, Azeem MW. Self-Stigmatization in children receiving mental health treatment in Lahore, Pakistan. Asian J Psychiatr. 2020;47: 101839. pmid:31665697

47. Linstone HA, Turoff M. Delphi: A brief look backward and forward. Technol Forecast Soc Change. 2011;78: 1712–9.

48. Linstone HA, Turoff M. The Delphi Method. Techniques and applications. 2002. https://web.njit.edu/~turoff/pubs/delphibook/index.html

49. Rowe G, Wright G. The Delphi technique as a forecasting tool: issues and analysis. Int J Forecast. 1999;15: 353–75.

50. Rowe G, Wright G. The Delphi technique: Past, present, and future prospects—Introduction to the special issue. Technol Forecast Soc Change. 2011;78: 1487–90.

51. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32: 1008–15. pmid:11095242

52. Hasson F, Keeney S. Enhancing rigour in the Delphi technique research. Technol Forecast Soc Change. 2011;78: 1695–704.

53. Jorm AF. Using the Delphi expert consensus method in mental health research. Aust New Zeal J Psychiatry. 2015;49: 887–97. pmid:26296368

54. Parenté R, Anderson-Parenté J. A case study of long-term Delphi accuracy. Technol Forecast Soc Change. 2011;78: 1705–11.

55. Daar AS, Singer PA, Persad DL, Pramming SK, Matthews DR, Beaglehole R, et al. Grand challenges in chronic non-communicable diseases. Nature. 2007;450: 494–6. pmid:18033288

56. Greenwood HL, Singer PA, Downey GP, Martin DK, Thorsteinsdóttir H, Daar AS. Regenerative medicine and the developing world. PLoS Med. 2006;3: e381. pmid:16968130

57. Salamanca-Buentello F, Persad DL, Court EB, Martin DK, Daar AS, Singer PA. Nanotechnology and the developing world. PLoS Med. 2005;2: e97. pmid:15807631

58. Daar AS, Thorsteinsdóttir H, Martin DK, Smith AC, Nast S, Singer PA. Top ten biotechnologies for improving health in developing countries. 2002;32: 229–32.

59. Daar A, Chang T, Salomon A, Singer PA. Grand challenges for humanitarian aid. Nature. 2018;559: 169–73.

60. Wilkinson L, Friendly M. The History of the Cluster Heat Map. Am Stat. 2009;63: 179–84.

61. Tufte ER. The Visual display of quantitative information. 2d ed. Cheshire, Connecticut: Graphics Press LLC; 2001.

62. Tufte ER. Beautiful evidence. Cheshire, Connecticut: Graphics Press LLC; 2006.

63. Ali G-C, Ryan G, De Silva MJ. Validated screening tools for common mental disorders in low and middle income countries: A systematic review. PLoS One. 2016;11: e0156939. pmid:27310297

64. Stewart LA, Lee L-C. Screening for autism spectrum disorder in low- and middle-income countries: A systematic review. Autism. 2017;21: 527–39. pmid:28183195

65. Deighton J, Croudace T, Fonagy P, Brown J, Patalay P, Wolpert M. Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: a review of child self-report measures. Child Adolesc Psychiatry Ment Health. 2014;8: 14–27. pmid:24834111

66. Michel C, Schultze-Lutter F, Schimmelmann BG. Screening instruments in child and adolescent psychiatry: general and methodological considerations. Eur Child Adolesc Psychiatry. 2014;23: 725–7. pmid:25164263

67. Belfer ML. Setting Priorities: The Status of Child Mental Health Care Around the World. Psychiatric Times. 2004. http://www.psychiatrictimes.com/articles/setting-priorities-status-child-mental-health-care-around-world

68. Ozonoff S. Editorial: Early detection of mental health and neurodevelopmental disorders: the ethical challenges of a field in its infancy. J Child Psychol Psychiatry. 2015;56: 933–5. pmid:26257104

69. Rutter M. Child and adolescent psychiatry: past scientific achievements and challenges for the future. Eur Child Adolesc Psychiatry. 2010;19: 689–703. pmid:20458511

70. Shidhaye R, Kermode M. Stigma and discrimination as a barrier to mental health service utilization in India. Int Health. 2013;5: 6–8. pmid:24029838

71. The American Academy of Pediatrics Task Force on Mental Health. Appendix S4: The Case for Routine Mental Health Screening. Pediatrics. 2010;125: S133–S139.

72. Goodman A, Heiervang E, Fleitlich-Bilyk B, Alyahri A, Patel V, Mullick MSI, et al. Cross-national differences in questionnaires do not necessarily reflect comparable differences in disorder prevalence. Soc Psychiatry Psychiatr Epidemiol. 2012;47: 1321–31. pmid:22033632

73. van Ommeren M, Sharma B, Thapa S, Makaju R, Prasain D, Bhattarai R, et al. Preparing Instruments for Transcultural Research: Use of the Translation Monitoring Form with Nepali-Speaking Bhutanese Refugees. Transcult Psychiatry. 1999;36: 285–301.

74. Achenbach TM. Multicultural evidence-based assessment of child and adolescent psychopathology. Transcult Psychiatry. 2010;47: 707–26. 47/5/707 pmid:21088101

75. Verhulst FC, Achenbach TM, van der Ende J, Erol N, Lambert MC, Leung PWL, et al. Comparisons of problems reported by youths from seven countries. Am J Psychiatry. 2003;160: 1479–85. pmid:12900311

76. Rescorla LA, Achenbach TM, Ivanova MY, Dumenci L, Almqvist F, Bilenberg N, et al. Epidemiological comparisons of problems and positive qualities reported by adolescents in 24 countries. J Consult Clin Psychol. 2007;75: 351–8. pmid:17469893

77. Rescorla LA, Achenbach T, Ivanova MY, Dumenci L, Almqvist F, Bilenberg N, et al. Behavioral and emotional problems reported by parents of children ages 6 to 16 in 31 societies. J Emot Behav Disord. 2007;15: 130–42.

78. Rescorla LA, Achenbach TM, Ginzburg S, Ivanova M, Dumenci L, Almqvist F, et al. Consistency of Teacher-Reported problems for students in 21 countries. School Psych Rev. 2007;36: 91–110.

79. Hamoda HM, Belfer ML. Challenges in international collaboration in child and adolescent psychiatry. J Child Adolesc Ment Heal. 2010;22: 83–9. pmid:25859766

80. Bird HR. Epidemiology of childhood disorders in a cross-cultural context. J Child Psychol Psychiatry Allied Discip. 1996;37: 35–49. pmid:8655657

81. Jones D. Psychology. A WEIRD view of human nature skews psychologists’ studies. Science. 2010;328: 1627.

82. International Test Commission. The ITC Guidelines for Translating and Adapting Tests (Second edition). 2017. https://www.intestcom.org/files/guideline_test_adaptation_2ed.pdf

83. Denckla CA, Ndetei DM, Mutiso VN, Musyimi CW, Musau AM, Nandoya ES, et al. Psychometric properties of the Ndetei–Othieno–Kathuku (NOK) Scale: A mental health assessment tool for an African setting. J Child Adolesc Ment Heal. 2017;29: 1–11.

84. Ndetei D, Othieno C, Mutiso V, Ongecha F, Kokonya D, Omar A, et al. Psychometric properties of an African symptoms check list scale: the Ndetei-Othieno-Kathuku scale. East Afr Med J. 2006;83: 280–7. pmid:16866223

85. Ndetei DM, Mutiso V, Musyimi C, Mokaya AG, Anderson KK, McKenzie K, et al. The prevalence of mental disorders among upper primary school children in Kenya. Soc Psychiatry Psychiatr Epidemiol. 2016;51: 63–71. pmid:26577918

86. Betancourt TS, Bass J, Borisova I, Neugebauer R, Speelman L, Onyango G, et al. Assessing local instrument reliability and validity: A field-based example from northern Uganda. Soc Psychiatry Psychiatr Epidemiol. 2009;44: 685–92. pmid:19165403

87. Rasmussen A, Eustache E, Raviola G, Kaiser B, Grelotti DJ, Belkin GS. Development and validation of a Haitian Creole screening instrument for depression. Transcult Psychiatry. 2015;52: 33–57. pmid:25080426

88. Flaherty JA, Gaviria FM, Pathak D, Mitchell T, Wintrob R, Richman JA, et al. Developing instruments for cross-cultural psychiatric research. J Nerv Ment Dis. 1988;176: 257–63. pmid:3367140

89. van Ommeren M. Validity issues in transcultural epidemiology. British Journal of Psychiatry. 2003182: 376–8.

90. van Widenfelt BM, Treffers PDA, De Beurs E, Siebelink BM, Koudijs E. Translation and cross-cultural adaptation of assessment instruments used in psychological research with children and families. Clin Child Fam Psychol Rev. 2005;8: 135–47. pmid:15981582

91. Soto S, Linas K, Jacobstein D, Biel M, Migdal T, Anthony BJ. A review of cultural adaptations of screening tools for autism spectrum disorders. Autism. 2015;19: 646–61. pmid:25008216

92. Prince M. Cross-cultural research methods and practice. In: Patel V, Minas H, Cohen A, Prince M, editors. Global mental health: Principles and practice. Oxford: Oxford University Press; 2014. pp. 63–81.

93. Murphy JM, Abel MR, Hoover S, Jellinek M, Fazel M. Scope, scale, and dose of the world’s largest school-based mental health programs. Harv Rev Psychiatry. 2017;25: 218–28.

94. Humphrey N, Wigelsworth M. Making the case for universal school-based mental health screening. Emot Behav Difficulties. 2016;21: 22–42.

95. Mangal A, Thakur A, Nimavat K, Dabar D, Yadav S. Screening for common mental health problems and their determinants among school-going adolescent girls in Gujarat, India. J Fam Med Prim Care. 2020;9: 264–70.

96. Stanger C, Lewis M. Agreement Among Parents, Teachers, and Children on Internalizing and Externalizing Behavior Problems. J Clin Child Psychol. 1993;22: 107–16.

97. Wolraich ML, Lambert EW, Bickman L, Simmons T, Doffing MA, Worley KA. Assessing the impact of parent and teacher agreement on diagnosing attention-deficit hyperactivity disorder. J Dev Behav Pediatr. 2004;25: 41–7. pmid:14767355

98. Brown JD, Wissow LS, Gadomski A, Zachary C, Bartlett E, Horn I. Parent and teacher mental health ratings of children using primary-care services: interrater agreement and implications for mental health screening. Ambul Pediatr. 2006;6: 347–51. pmid:17116609

99. Jakobsen M, Meyer DeMott MA, Heir T. Validity of screening for psychiatric disorders in unaccompanied minor asylum seekers: Use of computer-based assessment. Transcult Psychiatry. 2017;54: 611–25. pmid:28820354

100. Musyimi CW, Mutiso VN, Haji ZR, Nandoya ES, Ndetei DM. Mobile Based mhGAP-IG Depression Screening in Kenya. Community Mental Health Journal. 2016: 1–8. pmid:27900652

101. Domínguez R. Desarrollan app para identificar a niños con autismo. Agencia Informativa Conacyt. 2016. http://www.conacytprensa.mx/index.php/tecnologia/tic/6652-entrevista-jovenes-mexicanos-desarrollan-apps-para-identificar-a-ninos-con-tea-aplicaciones-apps-tecnologia-autismo-investigacion

102. ALLILLANCHU. Proyecto de integración de la salud mental en servicios de atención primaria. Lima; 2016. http://www.cronicas-upch.pe/allillanchu-salud-mental/

103. Hahn EA, Choi SW, Griffith JW, Yost KJ, Baker DW. Health literacy assessment using talking touchscreen technology (Health LiTT): A new item response theory-based measure of health literacy. J Health Commun. 2011;16: 150–62. pmid:21951249

104. Farrington C, Aristidou A, Ruggeri K. mHealth and global mental health: still waiting for the mH2 wedding? Global Health. 2014;10: 17–24. pmid:24670011

105. Perera H, Jeewandara KC, Seneviratne S, Guruge C. Culturally adapted pictorial screening tool for autism spectrum disorder: A new approach. World J Clin Pediatr. 2017;6: 45–51. pmid:28224095

106. Collins PY, Insel TR, Chockalingam A, Daar A, Maddox YT. Grand Challenges in Global Mental Health: Integration in Research, Policy, and Practice. PLOS Med. 2013;10: 1–6.

107. World Health Organization, World Organization of Family Doctors. Integrating Mental Health Into Primary Care: A Global Perspective. Geneva: World Health Organization and World Organization of Family Doctors; 2008. https://books.google.com/books?hl=en&lr=&id=vdMayQOW4kkC&pgis=1

108. Foy JM, Kelleher KJ, Laraque D. Enhancing pediatric mental health care: strategies for preparing a primary care practice. Pediatrics. 2010;125: S87–S108. pmid:20519566

109. Ani C, Garralda E. Developing primary mental healthcare for children and adolescents. Curr Opin Psychiatry. 2005;18: 440–4. http://dx.doi.org/10.1097/01.yco.0000172065.86272.c7 pmid:16639139

110. Patel V, Belkin GS, Chockalingam A, Cooper J, Saxena S, Unützer J. Grand Challenges: Integrating Mental Health Services into Priority Health Care Platforms. PLoS Med. 2013;10: e1001448. pmid:23737736

111. Ventevogel P. Integration of mental health into primary healthcare in low-income countries: Avoiding medicalization. Int Rev Psychiatry. 2014;26: 669–79. pmid:25553784

112. Chibanda D, Bowers T, Verhey R, Rusakaniko S, Abas M, Weiss HA, et al. The Friendship Bench programme: a cluster randomised controlled trial of a brief psychological intervention for common mental disorders delivered by lay health workers in Zimbabwe. Int J Ment Health Syst. 2015;9: 21–7. pmid:27408619

113. The Partners in Health / Zanmi Lasante project. http://www.pih.org/country/haiti

114. Salmi LR, Coureau G, Bailhache M, Mathoulin-Pélissier S. To Screen or Not to Screen: Reconciling Individual and Population Perspectives on Screening. Mayo Clin Proc. 2016;91: 1594–605. pmid:27814837

115. International Society for Autism Research. Lost in translation: Scientifically valid and contextually appropriate use of screening and diagnostic tools. Summary report of the 2013 Meeting. San Sebastián: International Society for Autism Research Special Interest Group on Global Knowledge Translation for Research on Early Identification and Intervention in Autism; 2013.

116. Prince M, Rahman A, Mayston R, Weobong B. Mental health and the global health and development agendas. In: Patel V, Minas H, Cohen A, Prince M, editors. Global mental health: Principles and practice. Oxford; 2014. pp. 102–15.

117. Chisholm D, Saxena S. Cost effectiveness of strategies to combat neuropsychiatric conditions in sub-Saharan Africa and South East Asia: mathematical modelling study. Br Med J. 2012;344: e609. pmid:22389339

118. Simmons R, Fajans P, Ghiron L. Scaling up health service innovations: A framework for action. Simmons R, Fajans P, Ghiron L, editors. Scaling up Health Service Delivery: From Pilot Innovations to Policies and Programmes. Geneva: World Health Organization; 2007. p. 1–30.

119. Meffert SM, Neylan TC, Chambers DA, Verdeli H. Novel implementation research designs for scaling up global mental health care: Overcoming translational challenges to address the world’s leading cause of disability. Int J Ment Health Syst. 2016;10: 1–6.

120. Collins PY, Tomlinson M, Kakuma R, Awuba J, Minas H. Research priorities, capacity, and networks in global mental health. In: Patel V, Minas H, Cohen A, Prince MJ, editors. Global mental health: Principles and practice. Oxford: Oxford University Press; 2014. pp. 425–49.

121. Programme for Improving Mental Health Care (PRIME). http://www.prime.uct.ac.za/

122. BasicNeeds. www.basicneeds.org

123. Mental Health Innovation Network (MHIN). http://www.mhinnovation.net/

124. Toronto Addis Ababa Psychiatry Program. http://taaac.com/programs/psychiatry/

125. Global Clinical Practice Network (GCPN). http://www.globalclinicalpractice.net/

126. International Association for Child and Adolescent Psychiatry and Allied Professions. Ethics in Child and Adolescent Mental Health. Geneva; 2006.

127. Lamichhane J. Get pragmatic to tackle mental health stigma. SciDevNet. 2016. http://www.scidev.net/global/health/opinion/pragmatic-tackle-mental-health-stigma.html

128. Koelch M, Fegert JM. Ethics in child and adolescent psychiatric care: An international perspective. Int Rev Psychiatry. 2010;22: 258–66. pmid:20528655

129. Thornicroft G, Mehta N, Clement S, Evans-Lacko S, Doherty M, Rose D, et al. Evidence for effective interventions to reduce mental-health-related stigma and discrimination. Lancet. 2016;387: 1123–32. pmid:26410341

130. United Nations Human Rights Council. United Nations Human Rights Council: Resolution on mental health and human rights. 2016.

131. World Health Organization. Mental health action plan 2013–2020. Geneva: World Health Organization; 2013.

132. World Health Organization. Sixty-Fifth World Health Assembly: Resolutions and decisions. Geneva: World Health Organization; 2012.

133. World Health Organization. Mental health policy and service guidance package. Module 9: Human resources and training in mental health. Geneva: World Health Organization; 2005.

134. Kakuma R, Minas H, Dal Poz MR. Strategies for strengthening human resources for mental health. In: Patel V, Minas H, Cohen A, Prince MJ, editors. Global mental health: Principles and practice. Oxford; 2014. pp. 193–223.

135. Fricchione GL, Borba CPC, Alem A, Shibre T, Carney JR, Henderson DC. Capacity building in global mental health: Professional training. Harv Rev Psychiatry. 2012;20: 47–57. pmid:22335182

136. Thornicroft G, Cooper S, Van Bortel T, Kakuma R, Lund C. Capacity building in global mental health research. Harv Rev Psychiatry. 2012;20: 13–24. pmid:22335179

137. Joshi R, Alim M, Kengne AP, Jan S, Maulik PK, Peiris D, et al. Task shifting for non-communicable disease management in low and middle income countries—A systematic review. PLoS One. 2014;9.

138. World Health Organization. Task shifting: Rational redistribution of tasks among health workforce teams. Global recommendations and guidelines. Geneva: World Health Organization; 2008.

139. Musyimi CW, Mutiso V, Ndetei DM, Henderson DC, Bunders J. Mental Health Outcomes of Psychosocial Intervention Among Traditional Health Practitioner Depressed Patients in Kenya. Cult Med Psychiatry. 2017;41: 453–65. pmid:28251478

140. Getanda EM, Vostanis P, O’Reilly M. Exploring the challenges of meeting child mental health needs through community engagement in Kenya. Child Adolesc Ment Health. 2017;22: 201–8. pmid:32680411

141. Berndtson K, Daid T, Tracy CS, Bhan A, Cohen ERM, Upshur REG, et al. Grand challenges in global health: ethical, social, and cultural issues based on key informant perspectives. PLoS Med. 2007;4: e268. pmid:17850176

142. Sharan P, Gallo C, Gureje O, Lamberte E, Mari JJ, Mazzotti G, et al. Mental health research priorities in low- and middle-income countries of Africa, Asia, Latin America and the Caribbean. Br J Psychiatry. 2009;195: 354–63. pmid:19794206

143. Hoven CW, Doan T, Musa GJ, Jaliashvili T, Duarte CS, Ovuga E, et al. Worldwide child and adolescent mental health begins with awareness: a preliminary assessment in nine countries. Int Rev Psychiatry. 2008;20: 261–70. pmid:18569178

144. Sharan P, Levav I, Olifson S, De Francisco A, Saxena S. Research Capacity for Mental Health in Low- and Middle-Income Countries: Results of a Mapping Project. Geneva: World Health Organization and Global Forum for Health Research; 2007.

145. Tomlinson M, Rudan I, Saxena S, Swartz L, Tsaid AC, Patel V. Setting priorities for global mental health research. Bull World Health Organ. 2009;87: 438–46. pmid:19565122

146. Davidson LL, Grigorenko EL, Boivin MJ, Rapa E, Stein A. A focus on adolescence to reduce neurological, mental health and substance-use disability. Nature. 2015;527: S161–S166. pmid:26580322

147. Patel V, Rahman A. Editorial commentary: An agenda for global child mental health. Child Adolesc Ment Health. 2015;20: 3–4. pmid:32680324

148. United Nations General Assembly. Convention on the Rights of the Child. 1989. http://www.ohchr.org/en/professionalinterest/pages/crc.aspx

149. United Nations General Assembly. Convention on the Rights of Persons with Disabilities and Optional Protocol. 2006.

150. Lund C, Caldas de Almeida JM, Whiteford H, Mahoney J. Mental health policy development and implementation. In: Patel V, Minas H, Cohen A, Prince MJ, editors. Global mental health: Principles and practice. Oxford: Oxford University Press; 2014. pp. 279–96.

151. United Nations General Assembly. International Covenant on Economic, Social and Cultural Rights. 2012. http://www2.ohchr.org/english/law/cescr.htm

152. World Health Organization. Child and Adolescent Mental Health Policies and Plans. Geneva: World Health Organization; 2005.

153. World Health Organization. Monitoring and evaluation of mental health policies and plans. Geneva: World Health Organization; 2007.

154. Guldbrandsson K, Fossum B. An exploration of the theoretical concepts policy windows and policy entrepreneurs at the Swedish public health arena. Health Promot Int. 2009;24: 434–44. pmid:19819897

155. Caldas de Almeida JM, Minas H, Cayetano C. Generating political commitment for mental health system development. In: Patel V, Minas H, Cohen A, Prince MJ, editors. Global mental health: Principles and practice. Oxford; 2014. pp. 450–68.

156. Mental Health Gap Action Programme (mhGAP). http://www.who.int/mental_health/mhgap/en/

157. Mental Health Policy and Service Guidance Package. http://www.who.int/mental_health/policy/essentialpackage1/en/

158. Day J, Bobeva M. A Generic Toolkit for the Successful Management of Delphi Studies. Electron J Bus Res Methodol. 2005;3: 103–16.

159. White PD, Rickards H, Zeman AZJ. Time to end the distinction between mental and neurological illnesses. BMJ. 2012;344: 13–5. pmid:22628005

160. David AS, Nicholson T. Are neurological and psychiatric disorders different? Br J Psychiatry. 2015;207: 373–4. pmid:26527662

161. Crossley NA, Scott J, Ellison-Wright I, Mechelli A. Neuroimaging distinction between neurological and psychiatric disorders. Br J Psychiatry. 2015;207: 429–34. pmid:26045351

162. Anttila V, Bulik-Sullivan B, Finucane HK, Walters RK, Bras J, Duncan L, et al. Analysis of shared heritability in common disorders of the brain. Science. 2018;360: eaap8757. pmid:29930110