Validation of a Portuguese version of the Oral Health Impact Profile adapted to people with mild intellectual disabilities (OHIP-14-MID-PT)

Abstract

Background

The purpose of this study is to develop a Portuguese version of the Oral Health Impact Profile (OHIP-14) and validate it for people with mild intellectual disability (OHIP-14-MID-PT).

Methods

The Portuguese version of the questionnaire was drawn up from the original English version, following internationally defined guidelines. Interviews were conducted with 240 individuals living in (or attending) institutions of the central region of Portugal that are affiliated with Humanitas (Portuguese Federation for Intellectual Disability) to measure oral health related quality of life (OHRQoL). The interview also included a sociodemographic and oral health questionnaire followed by an intraoral examination. Two types of reliability were analyzed: test-retest (ICC) and internal consistency (Cronbach´s α, inter-item and item-total correlations). Convergent and divergent validities were also assessed, and a confirmatory factor analysis was performed using the maximum likelihood method.

Results

The OHIP-14-MID-PT presented high reliability (ICC = 0.999; Cronbach's α = 0.922). The inter-item correlation coefficient ranged from 0.277 to 0.749, and the item-total correlation coefficient varied between 0.529 and 0.718. Lower OHIP-14-MID-PT total scores were significantly associated with: a self-perception of better oral health status (r = -0.545, p<0,001) and reduced need for dental treatment (U = 2366.5, p<0,001), more natural teeth (χ2 = 29.74, p<0,001) and better results in the clinical oral health index (COHI) (χ 2 = 18.50, p<0,001); the results support the convergent and divergent validities of the questionnaire.

Conclusions

OHIP-14-MID-PT has proved to be a consistent, valid and reliable instrument with good psychometric properties to determine the impact of oral health on quality of life in adults with mild intellectual disabilities in Portugal.

About the Authors:

Patrícia Couto

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft

* E-mail: [email protected] (PC); [email protected] (RAM)

Affiliation: Faculty of Health Sciences, Beira Interior University, Covilhã, Portugal

ORCID logo http://orcid.org/0000-0002-0512-9757

Paulo Almeida Pereira

Roles Conceptualization, Formal analysis, Investigation, Methodology, Software, Writing – review & editing

Affiliation: Department of Economics, Management and Social Sciences, Portuguese Catholic University, Viseu, Portugal

ORCID logo http://orcid.org/0000-0002-3941-8274

Manuel Nunes

Roles Conceptualization, Formal analysis, Investigation, Methodology, Supervision, Validation, Writing – review & editing

Affiliation: Faculty of Health Sciences, Beira Interior University, Covilhã, Portugal

Rui Amaral Mendes

Roles Conceptualization, Formal analysis, Investigation, Methodology, Supervision, Validation, Writing – review & editing

* E-mail: [email protected] (PC); [email protected] (RAM)

Affiliation: Department of Oral and Maxillofacial Medicine and Diagnostic Sciences, School of Dental Medicine, Case Western Reserve University, Cleveland, OH, United States of America

ORCID logo http://orcid.org/0000-0001-7628-8598

Introduction

There are several definitions of intellectual disability. In this study, we opted to use the American Association on Intellectual and Developmental Disabilities (AAIDD) definition, which is the one most widely used in the literature. In the definition, intellectual disability is characterized by "significant limitations both in intellectual functioning (reasoning, learning, problem solving) and in adaptive behavior, which covers a range of everyday social and practical skills. This disability originates before the age of 18" [1].

People with intellectual disability are known to be more prone to develop oral health problems [2]. Studies indicate that individuals with intellectual disability have poorer oral hygiene [3,4], worse signs of gingival disease [2,5] and a higher prevalence of untreated dental caries [2,5–7] compared with the general population [3,8].

Oral diseases impact the functional, psychological and social dimensions of the aspects of daily routines and impair quality of life [9,10]. Furthermore, the oral health impact on overall health, nutrition and wellbeing is greater among people with special needs than in the general population, given their poorer access to oral health care [10,11].

A wide variety of quality of life evaluation tools have been developed as a result of the growing concern about the impact of oral health on an individual’s quality of life [12]. However, the studies of these tools rarely have included persons with intellectual and developmental disabilities or neurocognitive disorders [13]. One of the most widely used instruments is the Oral Health Impact Profile (OHIP) [14]. The original version, the OHIP-49, consists of 49 items representing seven domains: functional limitation, physical pain, psychological discomfort, physical disability, psychological disability, social disability and handicap.

However, several challenges led to the need to create a shortened version of the OHIP-49, including greater respondent burden and increased administrative and data management costs, resulting in low response rates when compared to shorter versions [15]. These problems led to shortened versions. One developed by Slade [16] in 1997 and a later one developed by Locker and Allen [17] in 2002. Both versions of the OHIP-14 have good psychometric properties, and have been translated and validated in different languages and populations in several countries [15,18–20]. No Portuguese version of the OHIP-14 questionnaire has been developed and validated for populations with mild intellectual disabilities.

The objective of our overall study was to 1) develop and validate a Portuguese-language version of the 14-items questionnaire of the "Oral Health Impact Profile" created by Slade and 2) to subsequently assess oral health and its impact on the quality of life of people with mild intellectual disabilities. The current paper explores and discusses the methodologies that supported the first objective, therefore providing health professionals with a suitable instrument.

Methods

The development of a Portuguese version of the OHIP-14-MID-PT adapted to people with mild intellectual disabilities included a cross-cultural adaptation and the subsequent exploration of the psychometric properties of the scale.

Cross-cultural adaptation of the OHIP

To develop the Portuguese version of the OHIP-14 questionnaire, the procedures for translation and adaptation of epidemiological instruments with a focus on cross-cultural and conceptual significance, previously described in the literature, were used [21,22]. The translation process of the English version was carried out by two independent Native Portuguese speaking bilingual translators. Two separate versions were obtained, that were merged by consensus. This version was translated back to English by two independent Native English speaking bilingual translators. A discussion group reviewed the original translations and the back translations looking for consensus and discrepancies. To overcome the lack of a suitable measure of reading ease for Portuguese, an expert in modern language and communication acted as a consultant. The version obtained was evaluated by the psychologists and technical directors of all participating institutions.

The pre-final version was then subjected to a pretest, to evaluate its content, formulation, sequence and average duration of application. The participants consisted of a convenience sample of 20 individuals with mild intellectual disabilities randomly selected from one of the institutions participating in the study. After each answer, the participant was asked the probe question ‘What do you mean?’ and was encouraged to expand his understanding of the item in an open-ended manner. This ensured that the final item was understood as having a meaning equivalent to that of the source item. No suggestions for changes were made.

Sample selection and study design

All of the 13 institutions affiliated with Humanitas (Portuguese Federation for Intellectual Disability) in the central region of the country participated. Potential participants were 556 individuals with mild intellectual disabilities living in (or attending) these institutions.

Inclusion criteria were a minimum age of 18 years, having a medical report and psychological assessment attesting the condition of mild intellectual disability and authorizing participation in the study through informed consent. The sample size was calculated for a margin of error of 5%, obtaining the minimum number of 228 individuals. To avoid possible sampling biases, a significantly higher margin (288 individuals) was set to obtain the minimum sampling value. Of the 288 subjects, 240 met the inclusion criteria and were validated to reach the pre-established error estimate. Thus, a sample of 240 individuals were interviewed and clinically examined. The fifth version of the Diagnostic and Statistical Manual (DSM-5) [23], and the International Classification of Diseases (ICD-10) [24] were used to match the defining criteria of mild intellectual disability.

The data collection instruments used included sociodemographic and oral health questionnaires, the OHIP-14-MID-PT questionnaire and clinical examination guided by the Clinical Oral Health Index (COHI), the Clinical Oral Care Needs Index (COCNI) and the Clinical Oral Prevention Index (COPI) [25]. See S1 and S2 Files.

Questionnaire administration and clinical examinations were carried out by a single trained researcher. When an individual did not respond or answered a question as “don’t know”, the response was treated as a missing value and handled by item-wise deletion in the analyses.

The questionnaires were administered in the form of an interview, which allowed their application to individuals with characteristics that could affect completion, while overcoming potential illiteracy constrains. See S3 File.

In carrying out the interviews, the following methodology was used, as suggested by WHO [26]: presentation of an introduction to the study, in which the objectives and purposes of the research were explained; the questions were placed exactly as they appear in the questionnaire and in the same sequence; a neutral attitude was maintained in order not to influence the answers. Whenever the respondent showed signs of fatigue or nervousness, the interview was immediately stopped and continued later.

For the clinical exams, the examiner was calibrated. Intra-examiner reliability was verified by paired comparisons of consistency between two evaluations for 20 participants regarding the criteria and registration codes established in the COHI, COCNI, and COPI indices.

Written informed consent was obtained in the presence of care providers. The ability to provide written informed consent was determined by the clinicians of each institution or by the information available in the clinical records. Participation was confidential, voluntary and uncompensated.

This study was approved by the Ethics Committee of the Faculty of Health Sciences of the University of Beira Interior and the Ethics Committee of APPACDM—Viseu; APPACDM -Coimbra; APPACDM—Figueira da Foz; and APPACDM Vila Nova de Poiares and Arcil- Lousã. The entire study was carried out in accordance with the principles of the Helsinki Declaration (version 2013).

OHIP-14-MID-PT

This questionnaire consists of 14 questions distributed in 7 dimensions of oral impact: functional limitation, physical pain, psychological discomfort, physical disability, psychological disability, social disability and handicap.

Each question is evaluated on a Likert scale of 5 points (never = 0, hardly ever = 1, occasionally = 2, fairly often = 3 and very often = 4). The "don’t know" option is also present. The questions relate to how often individuals have experienced each problem in the last 12 months.

Analysis plan

Reliability.

Two types of reliability were assessed: test-retest and internal consistency. Test-retest reliability was determined by calculating the intraclass correlation coefficient (ICC) according to the method of Shrout and Fleiss [27], using the results of a second administration of the OHIP-14-MID-PT on 20 participants, two weeks after the initial administration. The ICC was calculated for the entire scale and for each of its seven dimensions. The confidence intervals were set at 95% according to the Bland and Altman method [28]. The values defined for ICC analysis were weak <0.40, moderate 0.41–0.60, good 0.61–0.80 and excellent> 0.80 [29].

Cronbach's α was used to measure the internal consistency [30]. The impact on the α value, removing items from the OHIP-14 (α if item deleted) was evaluated, as well as the inter-item and item-total correlations.

Validity: Convergent validity and divergent validity.

Convergent validity was assessed by identifying associations between the variables "self-perception of need for dental treatment" and "self-perception of oral health status" from the oral health questionnaire and the OHIP-14-MID-PT total score. It was then assumed that self-perception of good oral health and no need for treatment would be associated with inferior results in the OHIP-14-MID-PT total score.

For the divergent validity we compared the OHIP scores with the oral health variable—number of natural teeth—and with COHI results. It was therefore assumed that high OHIP-14-MID-PT scores would be associated with a high number of missing teeth and one or more oral problems with an important to severe health impact (COHI-2 on clinical examination).

Construct validity: Confirmatory factor analysis.

Confirmatory factor analysis (CFA) was performed using the maximum likelihood method to verify if there was convergent validity among all dimensions as well as to verify the existence of significant relationships between them. To measure the quality of the adjustment, the reference values recommended by Maroco [31] and Arbuckle [32] were used.

Results

Reliability

The intraclass correlation coefficient (ICC) presented a value of ICC = 0.999 with a 95% confidence interval of 0.996–0.999, thus attaining a very high reliability [33]. The mean of the variation obtained in the two measurements for the OHIP-14-MID-PT was 0.20 ± 0.89. The ICCs of the seven dimensions of the OHIP ranged from 0.98 to 1.

There was no significant difference between the results of the two administrations (F1,19 = 1.000, p = 0.330).

Cronbach's α was 0.922. We also verified that the internal consistency was appropriate, given the homogeneity of values of the inter-item correlations matrix; no negative inter-item correlation was found, with results ranging from 0.277 (between ohip 3 and ohip 2) to 0.749 (between ohip 13 and ohip 12). The item-total correlation coefficients varied between 0.529 and 0.718, with the minimum correlation value being 0.529, which was well above 0.20 (the recommended minimum value to include an item on a scale) [19,34].

The removal of one item at a time resulted in lower α values, compared to the original values obtained, supporting the inclusion of all the items.

Convergent validity

In the OHIP-14-MID-PT global scale, there were statistically significant differences (U = 2366.5, p<0.001) among those who felt they need some type of dental treatment (M = 11.89, SD = 11.50) and those who did not feel they needed treatment (M = 5.37; SD = 7.66). Therefore, OHIP values are higher for those who felt they needed dental treatment; see Table 1.

[Figure omitted. See PDF.]

Table 1. Portuguese language validation of OHIP-14-MID-PT.

https://doi.org/10.1371/journal.pone.0198840.t001

There was also a moderate negative correlation (r = -0.545, p<0.001) between the OHIP-14-MID-PT total score and the responses to question 9, “How would you describe the condition of your teeth and gums?”, which meant that individuals who presented lower OHIP results had a positive self-perception of the state of their teeth and gums and vice versa.

In addition, there were positive correlations between all dimensions scores of the OHIP-14-MID-PT scale with question 9 (p<0,001), between low correlation for dimension “1. Functional limitation” (r = -0.360) and moderate correlation for dimension “5. Psychological disability” (r = -0.551).

Divergent validity

There were statistically significant differences in the total score (χ2 = 29.74, p<0.001) among respondents with 20 or more teeth (M = 7.34, SD = 8.90), those with 10–19 teeth (M = 14.20, SD = 12.31) and those with 1–9 teeth (M = 17.10, SD = 12.17). Those with no teeth have an average value of self-perceived quality of life identical to those who have 20 or more teeth, possibly resulting from prosthetic rehabilitation; see Table 2.

[Figure omitted. See PDF.]

Table 2. Portuguese language validation of OHIP-14-MID-PT.

https://doi.org/10.1371/journal.pone.0198840.t002

There were statistically significant differences in scores among those with COHI level 2 (M = 12.61, SD = 11.63) and those with COHI level 0 or level 1 (M = 7.04, SD = 8.99) (χ2 = 18.50, p<0.001). Thus, individuals identified with code 2 in the COHI index, that is, with one or more oral problems with an important to severe health impact, present higher values ​​in the OHIP-14-MID-PT compared to those who do not present oral problems or have oral problems with a low to moderate health impact (codes 0 and 1 in the COHI index); see Table 3.

[Figure omitted. See PDF.]

Table 3. Portuguese language validation of OHIP-14-MID-PT.

https://doi.org/10.1371/journal.pone.0198840.t003

Construct validity: Confirmatory factor analysis

There was a convergent validity for all dimensions, since factor saturations were high (the lowest value was 0.620 for item OHIP 9 in the psychological disability dimension) and factor saturations were all significant (p <0.001). All dimensions also presented significant relationships (p <0.001) between themselves.

In our study, the measures indicated an acceptable adjustment of the proposed model to the data collected if we consider the chi-square (χ2/d.f = 2.796), a recommended adjustment considering CFI = 0.943, a good adjustment considering the NFI = 0.916, and a mediocre adjustment considering RMSEA = 0.087. Therefore, we can conclude that the model presented overall good adjustment indices [31].

Based on the results, we can conclude that the confirmatory factor analysis supports the use of the OHIP-14-MID-PT scale's seven dimensions.

Discussion

This study aimed to create and evaluate the Portuguese version of the OHIP-14, in terms of validity and reliability, for use among adult population with mild intellectual disabilities. To this effect, the original English version of the OHIP-14 was translated using the forward-backward technique, pre-tested in a convenience sample and then applied to a group of the Portuguese population with mild intellectual disabilities in order to test its reliability and validity. In fact, most versions of the OHIP-14, as in our case, are based on the translation and linguistic adaptation of the original English version [15–17].

For the psychometric properties, the total ICC for the instrument under study was 0.999, which is considered excellent [27]; these results are higher than those observed in other versions [16,35–37]. To evaluate the test-retest reliability, we fixed the time interval between the two administrations of the questionnaire at two weeks, the usual time in similar situations and one that is commonly considered sufficient to avoid the influence of previous results and sufficiently short to avoid clinical changes [20,35,37].

The OHIP-14-MID-PT revealed a Cronbach α coefficient higher than the values considered standard, presenting an internal consistency superior to the original version (α = 0.88) and exceeding the minimum recommended value of 0.7. Our Cronbach α values are still similar to those found in other translated versions [18,19,35].

The adjustment of each item in the scale was investigated by removing that item and evaluating the change of Cronbach's α value in the scale. It was evident that the omission of any of the 14 items did not increase the value of Cronbach's α.

The considerable internal consistency of the instrument was also supported by the findings regarding inter-item and item-total correlations.

In fact, all the inter-item correlations were positive, and none was high enough forany item to be redundant. Regarding the item-total correlation, all the items under study revealed an adequate discriminating capacity (≥0.529), which prevents the elimination of any of the OHIP-14-MID-PT items. Similar results have been observed in others translated versions of the OHIP-14 [38].

The validity of the scale was supported by the statistically significant association found between questions aiming to subjectively evaluate individuals’ oral health status and OHIP-14-MID-PT scores. This provided evidence for the instrument’s construct validity, since it was shown that the higher the OHIP-14-MID-PT total scores, the poorer the perceived oral health status and greater the treatment needs. Other studies have found similar associations [19,38–40]. The validity was also confirmed by the scales’ ability to discriminate between groups with different oral health status, which was objectively assessed by clinical measures. It was found that the more frequent the presence of one or more problems with important to severe impact on health and tooth loss, the greater the impact on individuals’ OHRQoL. Other studies also present superior results in the OHIP questionnaire, associated with worse results in clinical examination [15,41,42] and tooth loss [43–45].

Regarding the sample size, this sample consisted of 240 individuals. Other validation studies of the OHIP-14 questionnaire present similar or even lower samples [19,46,47].

Taking into account the specificity of the sample, which included some people with illiteracy, the questionnaire was conducted in the form of an interview. This principle has been applied in several studies [12,14,17,48]. The psychometric properties of the Portuguese version of the OHIP when applied using self-administered questionnaires may have different results than those reported in this study.

Thus, the Portuguese version adapted from OHIP-14 was adequate, with good validity and reliability and with satisfactory psychometric properties, making this questionnaire a useful tool to evaluate and measure the oral quality of life of Portuguese adults with mild intellectual disability.

Limitations

Subjecting the methodology used in the present study to critical analysis, we emphasize that the investigation is limited to people with mild intellectual disabilities. We also note that cross-cultural adaptation in a context of mild intellectual disability makes it difficult to fully understand and address the homogeneity of the concept of oral health for people in this particular group of patients. Additionally, responsiveness of the OHIP-14-MID-PT were not conducted, because this will require a longitudinal study. In this way, further research is necessary to evaluate the responsiveness of the questionnaire to clinical changes after a medical intervention. We also suggest a need for more comprehensive research to explore the epidemiology of oral health-related quality of life in people with mild intellectual disability.

Regarding the difficulties encountered, we emphasize: the lack of “gold standard” studies in Portugal that allow comparisons with other instruments to assess the quality of life in this population; and the difficulty of comparing results, given the methodological differences between the different investigations (variability in sample sizes, non-randomization of the sample, different variables to assess validity, populations with distinct characteristics, and different data collection instruments).

Supporting information

[Figure omitted. See PDF.]

S1 File. COHI, COCNI and COPI Indexes.

https://doi.org/10.1371/journal.pone.0198840.s001

(PDF)

S2 File. Survey questions and OHIP-14-MID-PT.

https://doi.org/10.1371/journal.pone.0198840.s002

(PDF)

S3 File. Interview schedule.

https://doi.org/10.1371/journal.pone.0198840.s003

(PDF)

Citation: Couto P, Pereira PA, Nunes M, Mendes RA (2018) Validation of a Portuguese version of the Oral Health Impact Profile adapted to people with mild intellectual disabilities (OHIP-14-MID-PT). PLoS ONE 13(6): e0198840. https://doi.org/10.1371/journal.pone.0198840

References

1. AAIDD. 2018 [cited 24 April 2018]. Washington, D.C. Available from: http://www.webcitation.org/6zdDAIdiP.

2. Fernandez Rojas C, Wichrowska-Rymarek K, Pavlic A, Vinereanu A, Fabjanska K, Kaschke I et al. Oral health needs of athletes with intellectual disability in Eastern Europe: Poland, Romania and Slovenia. Int Dent J. 2016;66(2): 113–9. pmid:26601920

3. Petrovic BB, Peric TO, Markovic DLJ, Bajkin BB, Petrovic D, Blagojevic DB, et al. Unmet oral health needs among persons with intellectual disability. Res Dev Disabil. 2016;59: 370–7. pmid:27697655

4. Diab HA, Salameh Z, Hamadeh GN, Younes G, Ayoub F. Oral Health Status of Institutionalized Individuals with Intellectual Disabilities in Lebanon. J Oral Maxillofac Res. 2017;8(1): 1–10.

5. Trihandini I, Wiradidjaja Adiwoso A, Erri Astoeti T, Marks L. Oral health condition and treatment needs among young athletes with intellectual disabilities in Indonesia. Int J Paediatr Dent. 2013;23(6): 408–14. pmid:23163957

6. Fernandez C, Declerck D, Dedecker M, Marks L. Treatment needs and impact of oral health screening of athletes with intellectual disability in Belgium. BMC Oral Health. 2015;15(1): 1–9.

7. Fernandez C, Descamps I, Fabjanska K, Kaschke I, Marks L. Treatment needs and predictive capacity of explanatory variables of oral disease in young athletes with an intellectual disability in Europe and Eurasia. Eur J Paediatr Dent. 2016;17(1): 9–16. pmid:26949233

8. Zhou N, Wong HM, Wen YF, Mcgrath C. Oral health status of children and adolescents with intellectual disabilities: a systematic review and meta-analysis. Dev Med Child Neurol. 2017;59(10): 1019–26. pmid:28627071

9. Pradhan A. Oral health impact on quality of life among adults with disabilities: Carer perceptions. Aust Dent J. 2013;58(4): 526–30. pmid:24320912

10. Pradhan A, Keuskamp D, Brennan D. Oral health-related quality of life improves in employees with disabilities following a workplace dental intervention. Eval Program Plann. 2016;59: 1–6. pmid:27497877

11. Oliveira JS, Prado Júnior RR, de Sousa Lima KR, de Oliveira Amaral H, Moita Neto JM, Mendes RF. Intellectual disability and impact on oral health: a paired study. Spec Care Dentist. 2013;33(6): 262–8. pmid:24164223

12. Wong MC, Lo EC, McMillan AS. Validation of a Chinese version of the Oral Health Impact Profile (OHIP). Community Dent Oral Epidemiol. 2002;30(6): 423–30. pmid:12453113

13. Chang J, Patton LL, Kim HY. Impact of dental treatment under general anesthesia on the oral health-related quality of life of adolescents and adults with special needs. Eur J Oral Sci. 2014;122(6): 363–71. pmid:25292335

14. Slade GD, Spencer AJ. Development and evaluation of the Oral Health Impact Profile. Community Dent Health. 1994;11(1): 3–11. pmid:8193981

15. León S, Bravo-Cavicchioli D, Correa-Beltrán G, Giacaman RA. Validation of the Spanish version of the Oral Health Impact Profile (OHIP-14Sp) in elderly Chileans. BMC Oral Health. 2014;14: 95. pmid:25091189

16. Slade GD. Derivation and validation of a short-form oral health impact profile. Community Dent Oral Epidemiol. 1997;25(4): 284–90. pmid:9332805

17. Locker D, Allen PF. Developing short-form measures of oral health-related quality of Life. J Public Health Dent. 2002;62(1): 13–20. pmid:14700084

18. Pugaca J, Urtane I, Pirttiniemi P, Rogovska I. Validation of a Latvian and a Russian version of the Oral Health Impact Profile for use among adults. Stomatologija. 2014;16(3): 83–86. pmid:25471991

19. Papagiannopoulou V, Oulis CJ, Papaioannou W, Antonogeorgos G, Yfantopoulos J. Validation of a Greek version of the oral health impact profile (OHIP-14) for use among adults. Health Qual Life Outcomes. 2012;10(1): 7.

20. Yamazaki M, Inukai M, Baba K, John MT. Japanese version of the Oral Health Impact Profile (OHIP-J). J Oral Rehabil. 2007;34(3): 159–68. pmid:17302943

21. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24): 3186–91.

22. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12): 1417–32. pmid:8263569

23. Associação Brasileira de Psiquiatria. Manual Diagnóstico e Estatístico de Transtornos Mentais. Porto Alegre: Artmed; 2014.

24. World Health Organization. The ICD-10 Classification of Mental and Behavioural Disorders. Geneva: WHO;1993.

25. Hennequin M, Moysan V, Jourdan D, Dorin M, Nicolas E. Inequalities in oral health for children with disabilities: a French national survey in special schools. PLoS One. 2008; 3(6): e2564. pmid:18575600

26. World Health Organization. Oral health surveys: basic methods - 5th edition. [cited 2017 Jul 18]. Available from:http://www.who.int/oral_health/publications/9789241548649/en/

27. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2): 420–8. pmid:18839484

28. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476): 307–10. pmid:2868172

29. Bartko JJ. The intraclass correlation coefficient as a measure of reability. Psychol Rep. 1966;19(1): 3–11. pmid:5942109

30. Eisinga R, Grotenhuis Mt, Pelzer B. The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown?. Int J Public Health. 2013; 58(4): 637–42. pmid:23089674

31. Maroco J. Análise de equações estruturais–Fundamentos teóricos, software e aplicações. Pêro Pinheiro: Report Number; 2010.

32. Arbuckle J. AMOS 17 User’s guide. Chicago, IL: SPSS; 2008.

33. McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods. 1996;1(1): 30–46.

34. Streiner D, Norman G. Health Measurement Scales: A Practical Guide to their Development and Use. 4th ed. Oxford: University Press; 2008.

35. Castrejón-Pérez RC,Borges-Yáñez SA. Derivation of the short form of the Oral Health Impact Profile in Spanish (OHIP-EE-14). Gerodontology. 2012;29(2): 155–8. pmid:22486591

36. He SL, Wang JH. Validation of the chinese version of the oral health impact profile for TMDs (OHIP- TMDs-C). Med Oral Patol Oral Cir Bucal. 2015; 20(2): 161–6.

37. John MT, Miglioretti DL, LeResche L, Koepsell TD, Hujoel P, Micheelis W. German short forms of the Oral Health Impact Profile. Community Dent Oral Epidemiol. 2006; 34(4): 277–88. pmid:16856948

38. Rimal J, Shrestha A. Validation of Nepalese Oral Health Impact Profile14 and Assessment of Its Impact in Patients with Oral Submucous Fibrosis in Nepal. J Nepal Health Res Counc. 2015;13(29):43–9. pmid:26411712

39. Ekanayake L, Perera I. Validation of a Sinhalese translation of the Oral Health Impact Profile-14 for use with older adults. Gerodontology. 2003;20(2):95–9. pmid:14697020

40. Corridore D, Campus G, Guerra F, Ripari F, Sale S, Ottolenghi L. Validation of the Italian version of the Oral Health Impact Profile-14 (IOHIP-14). Ann Stomatol (Roma). 2014;4(3–4):239–43.

41. Montero-Martín J, Bravo-Pérez M, Albaladejo-Martínez A, Hernández-Martín LA, Rosel-Gallardo EM. Validation the Oral Health Impact Profile (OHIP-14sp) for adults in Spain. Med Oral Patol Oral Cir Bucal. 2009;14(1): 44–50.

42. Skośkiewicz-Malinowska K, Kaczmarek U, Ziętek M, Malicka B. Validation of the Polish version of the oral health impact profile-14. Adv Clin Exp Med. 2015; 24(1):129–37. pmid:25923097

43. Fernandes MJ, Ruta DA, Ogden GR, Pitts NB, Ogston SA. Assessing oral health-related quality of life in general dental practice in Scotland: validation of the OHIP-14. Community Dent Oral Epidemiol. 2006;34(1):53–62. pmid:16423032

44. Khalifa N, Allen PF, Abu-bakr NH, Abdel-Rahman ME. Psychometric properties and performance of the Oral Health Impact Profile (OHIP-14s-ar) among Sudanese adults. J Oral Sci. 2013;55(2):123–32. pmid:23748451

45. Silva ME, Villaça EL, Magalhães CS, Ferreira EF. Impact of tooth loss in quality of life. Cien Saude Colet. 2010;15(3):841–50. pmid:20464197

46. John MT, Patrick DL, Slade GD. The German version of the Oral Health Impact Profile- translation and psychometric properties. Eur J Oral Sci. 2002;110(6): 425–33. pmid:12507215

47. Slade GD, Spencer AJ, Locker D, Hunt RJ, Strauss RP, Beck JD. Variations in the social impact of oral conditions among older adults in South Australia, Ontario, and North Carolina. J Dent Res. 1996;75(7): 1439–50. pmid:8876595

48. Robinson PG, Gibson B, Khan FA, Birnbaum W. A comparison of OHIP 14 and OIDP as interviews and questionnaires. Community Dent Health. 2001;18(3): 144–9. pmid:11580089