Reliability and Validity of the Geriatric Depression Scale in Italian Subjects with Parkinson’s Disease

Abstract

Introduction. The Geriatric Depression Scale (GDS) is commonly used to assess depressive symptoms, but its psychometric properties have never been examined in Italian people with Parkinson’s disease (PD). The aim of this study was to study the reliability and validity of the Italian version of the GDS in a sample of PD patients. Methods. The GDS was administered to 74 patients with PD in order to study its internal consistency, test-retest reliability, construct, and discriminant validity. Results. The internal consistency of GDS was excellent (α = 0.903), as well as the test-retest reliability (ICC = 0.941 [95% CI: 0.886–0.970]). GDS showed a strong correlation with instruments related to the depression (ρ = 0.880) in PD (ρ = 0.712) and a weak correlation with generic measurement instruments (−0.320 < ρ <−0.217). An area under the curve of 0.892 (95% CI 0.809–0.975) indicated a moderate capability to discriminate depressed patients to nondepressed patient, with a cutoff value between 15 and 16 points that predicts depression (sensitivity = 87%; specificity = 82%). Conclusion. The GDS is a reliable and valid tool in a sample of Italian PD subjects; this scale can be used in clinical and research contexts.

This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

1. Introduction

Parkinson disease (PD) is characterized by motor and nonmotor symptoms. Bradykinesia, tremor at rest, and rigidity are the cardinal motor manifestations of PD [1]. Nonmotor symptoms include gastrointestinal dysfunctions, sleep disorders, cognitive disorders, and neuropsychiatric disturbances. Depression has been found to be more frequent in PD patients than in age-matched healthy controls or in patients with other chronic medical conditions [2, 3]. For example, major depression may be found in up to 20% of PD patients [4]. To measure the level of depression, it is crucial that clinicians and researchers have access to reliable and valid instruments. A recent systematic review about depression tools in PD patients recommended the use of the Hamilton Depression Inventory as a rating scale, which takes into consideration the judgment of the clinician or the caregiver, and the Geriatric Depression Scale (GDS), that considers the patient’s point of view, for the screening and measurement of the degree of perceived depression in patients with PD [5].

The GDS [6], composed by 30 items, was developed to evaluate the level of depressive symptoms over the past week. It was transculturally adapted in several languages [7–9], and it has proven to be reliable and valid in subjects with dementia [10–13], stroke [14–17], rheumatoid arthritis [18], and psychiatric disorders [19, 20]. In PD, several studies showed that GDS has good psychometric properties, a high internal consistency (Cronbach’s alpha = 0.92) [21], an excellent test-retest reliability (intraclass correlation coefficient = 0.89 [95% CI 0.83–0.93]), and a minimal detectable change of 5.4 points [22]. Taking into account the validity, the GDS showed good correlations with the Beck Depression Inventory ($r_{\text{s}}=0.62,\hspace{0.17em}\hspace{0.17em}p<0.05$) and with mood related items of the Unified Parkinson’s Disease Rating Scale ($r_{\text{s}}=0.38,\hspace{0.17em}\hspace{0.17em}p<0.05$) [23], and moderate correlations with the 17-item Hamilton Depression Rating Scale ($r=0.54,\hspace{0.17em}\hspace{0.17em}p<0.001$) [24]. Recently, the GDS was used in an Italian sample of geriatric patients, and this study confirmed the good psychometric properties of GDS [25]. As the measurement properties of an instrument are affected by the disease investigated and by the contextual factors, for a reliable and valid use of the instrument in Italian subjects, the GDS should be validated also in the target population to which the questionnaire will be administered. No study has assessed the psychometric properties of GDS in Italian patients with PD. Therefore, the aim of this study is to assess the reliability and the validity of the GDS in a sample of Italian PD patients, using the Classical Theory Test.

2. Methods

2.1. Subjects

Seventy-four (older than 18 years) patients with clinically diagnosed PD were consecutively recruited through a convenience sample in the Rehabilitation Unit of San Giovanni Battista Hospital, Polyclinic Italia, and in the Department of Neurosciences, Sapienza University of Rome. Patients with cognitive impairment (Mini-Mental State Examination score <23 points) and problems with reading and understanding the Italian language were excluded. All subjects gave their informed consent [26, 27] to participate in the study, and the research was conducted according to the principles of Declaration of Helsinki.

2.2. Outcome Measures

2.2.1. Geriatric Depression Scale

This scale assesses the depressive symptoms [6]. The version used in this study was composed by 30 items that investigated different aspects of the depression over the last week. Each item is rated by a dichotomous score (yes = 1; no = 0), and some items (Item numbers 1, 5, 7, 9, 15, 19, 21, 27, 29, and 30) presented a reverse score (yes = 0; no = 1). The total score is given adding the item scores, and it ranged from 0 (no depression) to 30 (maximum depression) points. The Italian version used in this study demonstrated to be reliable and valid [25].

2.2.2. Hospital Anxiety and Depression Scale

This scale measures the level of depression and anxiety [28]. It is composed by 14 items divided in two subscales: 7 items investigate depressive symptoms, and the other 7 measure anxious symptoms. Subjects respond to each item on four-level ordinal score (0 = no symptoms; 3 = maximum symptoms); therefore, the total scores may vary between 0 and 21 points for each subscale. The Italian version of the scale was used in this study [29].

2.2.3. Parkinson Disease Questionnaire

This questionnaire assesses the impact of parkinsonian symptoms in the life of these patients in the past month [30]. It contains 39 items that examine 8 domains through separately scored subscales: mobility (10 items), activities of daily living (6 items), emotional well-being (6 items), stigma (4 items), social support (3 items), cognition (4 items), communication (4 items), and bodily discomfort (3 items). A 5-point level score is attributed to each item (0 = never; 1 = occasionally/rarely; 2 = sometimes; 3 = often; 4 = always). A total score ranging from 0 (indicating best health status) to 100 (indicating worst health status) was calculated by summing the score of each item, both for the 8 subscores and for the total score. The Italian version used in this study was recently evaluated [31] and revealed good psychometric properties.

2.2.4. Short Form 36-Health Survey Questionnaire (SF-36)

This is a 36-item questionnaire measuring the patient’s health status in the past four weeks [32]. The total score ranges from 0 to 100 with higher scores indicating a better condition. The Italian version is considered to be a valid and reliable tool [33].

2.2.5. Barthel Index

This well-known test measures the disability on the ADLs [34]. It is composed of 10 items including feeding, bathing, grooming, dressing, bowel and bladder control, toilet use, transfers (bed to chair and back), mobility, and stairs climbing. Three ordinal level scores are attributed to each item (0, 5, or 10; 15 points for items regarding transfers and mobility) to assess whether the patient can perform the various activities independently, with assistance or whether they are totally dependent from others. The total score is generated summing each score, and it varies from 0 (total dependence) to 100 (total independence). The Italian version was administered in this study [35, 36].

2.3. Procedures

Four clinicians (three occupational therapists and one physical therapist) screened all patients for their recruitment. Once enrolled, these clinicians collected demographic and clinical variables and administered the outcome measure to all patients. In order to study the test-retest reliability, the GDS was readministered after seven days. To assess the discriminant validity, a physician diagnosed the depression in this sample. According to DSM-5, patients were diagnosed with depression if they had at least five depressive symptoms including “depressed mood” and “loss of interest or pleasure” for at least two weeks [37].

2.4. Statistical Analysis

Descriptive statistics was used to analyze the sample characteristics; in particular, mean ± standard deviation (SD), median with 25th and 75th percentiles, and frequency with percentage were calculated for intervallic, ordinal, and categorical data, respectively.

The reliability of GDS was assessed in terms of internal consistency and test-retest reliability. Internal consistency was determined calculating Cronbach’s alpha [38]: for values closer to 1, the internal consistency is higher. Alpha was considered excellent if >0.9, good if >0.8, and acceptable if >0.7 [39]. Test-retest reliability was calculated by the intraclass correlation coefficient (ICC) with a 95% confident interval (CI). ICC values greater than 0.75 are a minimum requirement to use the instrument in group measurements [40]; ICC values greater than 0.90 are considered essential for the use of the instrument in individual measurements [41].

The construct validity of the GDS was studied calculating the Pearson correlation coefficient (ρ) when comparing the GDS with the other administered instruments. The following ranges were considered in order to interpret the results: ρ > 0.70 = strong correlation, 0.50 < ρ < 0.70 = moderate correlation, and e ρ < 0.50 = weak correlation [42].

In order to study the discriminant validity, the receiving operating characteristic (ROC) curve was created, and the area under the curve (AUC) was calculated. The closer the AUC value is to 1.0, the greater the instrument’s ability to distinguish depressed and nondepressed patients. An AUC higher than 0.75 confers to the tool a moderate discriminative validity; while an excellent one is demonstrated by a value ≥0.90.

For all statistical analyses, the α value was set at 0.05, and SPSS statistical software program, version 18.0 for Windows (SPSS Inc., Chicago, IL, USA), was used.

3. Results

3.1. Sample Characteristics

Seventy-four patients (44 males; 30 females) with PD were included in this study. The demographic and clinical characteristics of the patients studied are reported in Table 1.

Table 1

Main demographic and clinical characteristics of the sample ($N=74$).

Variables	Values
Age (years) a	66.9 ± 9.7
Gender b
(i) Male	44 (59.5%)
(ii) Female	30 (40.5%)
Depression b
(i) Presence	23 (31.1%)
(ii) Absence	51 (68.9%)
Medications prescribed to depressed subjects (N=23) b
(i) Antidepressant	11 (47.8%)
(ii) Anxiolytic	10 (43.5%)
(iii) No medications	2 (8.7%)
Educational level b
(i) Primary	9 (12.2%)
(ii) Secondary	17 (23%)
(iii) High school	33 (44.6%)
(iv) Degree	13 (17.6%)
(v) Not reported	3 (4.1%)
Employment b
(i) Employed	13 (17.6%)
(ii) Not employed	4 (5.4%)
(iii) Retired	57 (77%)
Marital status b
(i) Married	56 (75.6%)
(ii) Unmarried	17 (23%)
(iii) Not reported	1 (1.4%)
Time since PD diagnosis (years)a	7.8 ± 5.6
Hoehn and Yahr stagec	3 (2; 3)
Setting b
(i) Department	20 (27%)
(ii) Ambulatory	53 (71.6%)
(iii) Day-hospital	1 (1.4%)
MMSE scorec	29 (27.25; 30)
HADS-A scorec	7 (4; 10)
HADS-D scorec	7 (4; 10)
HADS total scorec	15 (10; 20)
GDS total scorec	13 (6; 19)
PDQ-39 subscale score c
(i) Mobility	17.5 (7.5; 25.75)
(ii) Activities of daily living	10 (4; 15.75)
(iii) Emotional well-being	9 (5; 14)
(iv) Stigma	4 (2; 8)
(v) Social support	1 (0; 3.75)
(vi) Cognition	5 (2; 8)
(vii) Communication	3 (1.25; 6)
(viii) Bodily discomfort	4 (2; 7)
PDQ-39 total score c	59 (31.25; 76)
SF-36c	95 (86.25; 102)
Barthel Indexc	85 (75; 95)

Data are expressed as ^amean ± standard deviation, ^bfrequency with percentage, or ^cmedian with 25th and 75th percentiles. MMSE: Mini-Mental State Examination; HADS-A: Hospital Anxiety and Depression Scale of Anxiety; HADS-D: Hospital Anxiety and Depression Scale of Depression; GDS: Geriatric Depression Scale; PDQ-39: Parkinson’s Disease Questionnaire; SF-36: Short Form 36-Health Survey Questionnaire.

3.2. Internal Consistency

The internal consistency for the total GDS score was excellent (α = 0.903).

3.3. Test-Retest Reliability

Test-retest reliability was assessed in a subsample of 35 patients. Excellent reliability was observed for the GDS total score (ICC = 0.941 [95% CI: 0.886–0.970]).

3.4. Validity

Pearson’s correlation coefficient values are reported in Table 2. Taking into account the comparisons between GDS and the other instrument related to depression (HADS) and PD (PDQ-39), Pearson coefficient ranged between 0.712 and 0.880, indicating a strong correlation. On the other hand, regarding the comparisons between GDS and generic measurement instrument (Barthel Index and SF-36), the correlation coefficient varied from −0.320 to −0.217, showing a weak correlation.

Table 2

Pearson’s correlation coefficient for each comparison.

	HADS-A	HADS-D	Total HADS	PDQ	SF-36	Barthel Index
GDS	0.799${}^{\ast }$	0.800${}^{\ast }$	0.880${}^{\ast }$	0.712${}^{\ast }$	−0.320${}^{\ast \ast }$	−0.217

${}^{\ast }p<0.01$ ; ${}^{\ast \ast }p\le 0.5$. HADS-A: Hospital Anxiety and Depression Scale of Anxiety; HADS-D: Hospital Anxiety and Depression Scale of Depression; GDS: Geriatric Depression Scale; PDQ-39: Parkinson’s Disease Questionnaire; SF-36: Short Form 36-Health Survey Questionnaire.

Regarding the discriminant validity, the AUC showed a value of 0.892 (95% CI 0.809–0.975), indicating a moderate capability to discriminate depressed patients to nondepressed patient. The score with the best sensibility and specificity that predicts depression is between 15 and 16 (sensitivity = 87%; specificity = 82%) (Figure 1).

[figure omitted; refer to PDF]

4. Discussion

The use of a reliable and valid instrument is essential in clinical practice and when measuring specific outcomes [43]. Several questionnaires are available to measure depression in patients with PD [5]. The psychometric properties of GDS have been extensively studied in different pathologies and in different settings. To our knowledge, however, no study assessed the psychometric properties of GDS in Italian patients with PD. Studying the measurement properties in the context in which the instrument will be administered is crucial because these properties can be influenced by various contextual, social, and environmental factors [44]. The results of our study show that GDS is a reliable and valid instrument in Italian patients with PD.

The internal consistency assessed by calculating Cronbach’s alpha (equal to 0.903) was excellent. The results obtained in the PD patients we studied are similar to those obtained in patients with different clinical conditions. For example, Cronbach’s alpha was found to be 0.876 in a study on 294 geriatric patients [45] and 0.90 in 888 depressed and nondepressed elderly subjects [46].

We demonstrated an excellent test-retest reliability of the questionnaire (ICC = 0.941). The results obtained in our sample of PD patients are similar to those found in a cohort of 75 Chinese subjects with PD (ICC = 0.89 [95% CI 0.83–0.93]) [22].

The construct validity was investigated through the correlations between the GDS and other validated questionnaires. In particular, a strong construct validity was obtained through correlations with HADS (both with anxiety and depression) and PDQ-39. On the other hand, a weak correlation was found when the GDS was compared with the Barthel Index and the SF-36. The strong correlations between GDS and HADS can be explained because these two scales intend to measure the same variable, that is, the depression; these results are in line with previous studies that obtained similar correlations with questionnaires related to depression—Beck Depression Inventory ($r_{\text{s}}=0.62,\hspace{0.17em}\hspace{0.17em}p<0.05$) [23] and Hamilton Depression Rating Scale at 17 items ($r=0.54,\hspace{0.17em}\hspace{0.17em}p<0.001$) [24]. Conversely, the low correlation found with SF-36 and Barthel Index may be explained because both the Barthel Index and the SF-36 are generic instruments.

Finally, the discriminating validity was studied through the ROC curve in order to identify the best sensitivity and specificity of the cutoff value that can distinguish depressed and nondepressed patients. The cutoff value of 15–16 points showed a sensitivity of 87% and a specificity of 82%. Comparing our results with those obtained in other studies is not easy considering the different patient populations and the different settings; for example, the study by McDonald et al. showed a cutoff value of 9–10 points [24] and the study by Ertan et al. [7] a cutoff value of 13–14.

This study presents limitations that need to be taken into account. The design of the study did not allow the assessment of some fundamental psychometric properties such as content validity and responsiveness.

In conclusion, this study shows that GDS can be used in clinical practice as a valid measurement instrument in order to quantify depression in patients with PD.

Consent

Informed consent was obtained from all individual participants included in the study.

Disclosure

All authors have no commercial associations or disclosures that may pose or create a conflict of interest with the information presented within this manuscript.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

References

[1] R. B. Postuma, D. Berg, M. Stern, "MDS clinical diagnostic criteria for Parkinson’s disease," Movement Disorders, vol. 30 no. 12, pp. 1591-1601, DOI: 10.1002/mds.26424, 2015.

[2] D. Aarsland, M. G. Kramberger, "Neuropsychiatric symptoms in Parkinson’s disease," Journal of Parkinson’s Disease, vol. 5 no. 3, pp. 659-667, DOI: 10.3233/jpd-150604, 2015.

[3] A. H. V. Schapira, K. R. Chaudhuri, P. Jenner, "Non-motor features of Parkinson disease," Nature Reviews Neuroscience, vol. 18 no. 7, pp. 435-450, DOI: 10.1038/nrn.2017.62, 2017.

[4] J. S. Reijnders, U. Ehrt, W. E. Weber, D. Aarsland, A. F. Leentjens, "A systematic review of prevalence studies of depression in Parkinson’s disease," Movement Disorders, vol. 23 no. 2, pp. 183-189, DOI: 10.1002/mds.21803, 2008.

[5] E. Torbey, N. A. Pachana, N. N. Dissanayaka, "Depression rating scales in Parkinson’s disease: a critical review updating recent literature," Journal of Affective Disorders, vol. 184, pp. 216-224, DOI: 10.1016/j.jad.2015.05.059, 2015.

[6] J. A. Yesavage, T. L. Brink, T. L. Rose, "Development and validation of a geriatric depression screening scale: a preliminary report," Journal of Psychiatric Research, vol. 17 no. 1, pp. 37-49, DOI: 10.1016/0022-3956(82)90033-4, 1982.

[7] T. Ertan, E. Eker, "Reliability, validity, and factor structure of the geriatric depression scale in Turkish elderly: are there different factor structures for different cultures?," International Psychogeriatrics, vol. 12 no. 2, pp. 163-172, DOI: 10.1017/s1041610200006293, 2000.

[8] J. Martínez de la Iglesia, M. C. Onís Vilches, R. Dueñas Herrero, C. Aguado Taberné, C. Albert Colomer, M. C. Arias Blanco, "Abbreviating the brief. Approach to ultra-short versions of the Yesavage questionnaire for the diagnosis of depression," Atención Primaria, vol. 35 no. 1, pp. 14-21, DOI: 10.1157/13071040, 2005.

[9] G. G. Gottfries, S. Noltorp, N. Nørgaard, "Experience with a Swedish version of the Geriatric Depression Scale in primary care centres," International Journal of Geriatric Psychiatry, vol. 12 no. 10, pp. 1029-1034, DOI: 10.1002/(sici)1099-1166(199710)12:10<1029::aid-gps683>3.3.co;2-4, 1997.

[10] W. N. Havins, P. J. Massman, R. Doody, "Factor structure of the Geriatric Depression Scale and relationships with cognition and function in Alzheimer’s disease," Dementia and Geriatric Cognitive Disorders, vol. 34 no. 5-6, pp. 360-372, DOI: 10.1159/000345787, 2012.

[11] R. Lucas-Carrasco, "Spanish version of the Geriatric Depression Scale: reliability and validity in persons with mild-moderate dementia," International Psychogeriatrics, vol. 24 no. 8, pp. 1284-1290, DOI: 10.1017/S1041610212000336, 2012.

[12] H. W. Lach, Y. P. Chang, D. Edwards, "Can older adults with dementia accurately report depression using brief forms? reliability and validity of the Geriatric Depression Scale," Journal of Gerontological Nursing, vol. 36 no. 5, pp. 30-37, DOI: 10.3928/00989134-20100303-01, 2010.

[13] H. Debruyne, M. Van Buggenhout, N. Le Bastard, "Is the geriatric depression scale a reliable screening tool for depressive symptoms in elderly patients with cognitive impairment?," International Journal of Geriatric Psychiatry, vol. 24 no. 6, pp. 556-562, DOI: 10.1002/gps.2154, 2009.

[14] E. Y. Sivrioglu, K. Sivrioglu, T. Ertan, "Reliability and validity of the Geriatric Depression Scale in detection of poststroke minor depression," Journal of Clinical and Experimental Neuropsychology, vol. 31 no. 8, pp. 999-1006, DOI: 10.1080/13803390902776878, 2009.

[15] J. S. Cinamon, L. Finch, S. Miller, J. Higgins, N. Mayo, "Preliminary evidence for the development of a stroke specific geriatric depression scale," International Journal of Geriatric Psychiatry, vol. 26 no. 2, pp. 188-198, DOI: 10.1002/gps.2513, 2011.

[16] W. K. Tang, S. S. Chan, H. F. Chiu, "Can the Geriatric Depression Scale detect poststroke depression in Chinese elderly?," Journal of Affective Disorders, vol. 81 no. 2, pp. 153-156, DOI: 10.1016/s0165-0327(03)00163-0, 2004.

[17] J. Chau, C. R. Martin, D. R. Thompson, A. M. Chang, J. Woo, "Factor structure of the Chinese version of the Geriatric Depression Scale," Psychology, Health and Medicine, vol. 11 no. 1, pp. 48-59, DOI: 10.1080/13548500500093688, 2006.

[18] K. L. Smarr, A. L. Keefer, "Measures of depression and depressive symptoms: Beck Depression Inventory-II (BDI-II), Center for Epidemiologic Studies Depression Scale (CES-D), Geriatric Depression Scale (GDS), Hospital Anxiety and Depression Scale (HADS), and Patient Health Questionnaire-9 (PHQ-9)," Arthritis Care and Research, vol. 63 no. 11, pp. S454-S466, DOI: 10.1002/acr.20556, 2011.

[19] A. C. Chan, "Clinical validation of the Geriatric Depression Scale (GDS): Chinese version," Journal of Aging and Health, vol. 8 no. 2, pp. 238-253, DOI: 10.1177/089826439600800205, 1996.

[20] J. N. Bae, M. J. Cho, "Development of the Korean version of the Geriatric Depression Scale and its short form among elderly psychiatric patients," Journal of Psychosomatic Research, vol. 57 no. 3, pp. 297-305, DOI: 10.1016/j.jpsychores.2004.01.004, 2004.

[21] F. S. Ertan, T. Ertan, G. Kiziltan, H. Uyguçgil, "Reliability and validity of the Geriatric Depression Scale in depression in Parkinson’s disease," Journal of Neurology, Neurosurgery and Psychiatry, vol. 76 no. 10, pp. 1445-1447, DOI: 10.1136/jnnp.2004.057984, 2005.

[22] S. L. Huang, C. L. Hsieh, R. M. Wu, W. S. Lu, "Test-retest reliability and minimal detectable change of the Beck Depression Inventory and the Taiwan Geriatric Depression Scale in patients with Parkinson’s disease," PLoS One, vol. 12 no. 9,DOI: 10.1371/journal.pone.0184823, 2017.

[23] V. Tumas, G. G. Rodrigues, T. L. Farias, J. A. Crippa, "The accuracy of diagnosis of major depression in patients with Parkinson’s disease: a comparative study among the UPDRS, the geriatric depression scale and the Beck depression inventory," Arquivos de Neuro-Psiquiatria, vol. 66 no. 2A, pp. 152-156, DOI: 10.1590/s0004-282x2008000200002, 2008.

[24] W. M. McDonald, P. E. Holtzheimer, M. Haber, J. L. Vitek, K. McWhorter, M. Delong, "Validity of the 30-item geriatric depression scale in patients with Parkinson’s disease," Movement Disorders, vol. 21 no. 10, pp. 1618-1622, DOI: 10.1002/mds.21023, 2006.

[25] G. Galeoto, J. Sansoni, M. Scuccimarri, "A psychometric properties evaluation of the Italian version of the Geriatric Depression Scale," Depression Research and Treatment, vol. 2018,DOI: 10.1155/2018/1797536, 2018.

[26] G. Galeoto, R. De Santis, A. Marcolini, A. Cinelli, R. Cecchi, "The informed consent in occupational therapy: proposal of forms," Giornale Italiano di Medicina del Lavoro ed Ergonomia, vol. 38 no. 2, pp. 107-115, 2016.

[27] G. Galeoto, R. Mollica, O. Astorino, R. Cecchi, "Informed consent in physiotherapy: proposal of a form," Giornale Italiano di Medicina del Lavoro Ergonomia, vol. 37 no. 4, pp. 245-254, 2014.

[28] A. S. Zigmond, R. P. Snaith, "The hospital anxiety and depression scale," Acta Psychiatrica Scandinavica, vol. 67 no. 6, pp. 361-370, DOI: 10.1111/j.1600-0447.1983.tb09716.x, 1983.

[29] F. Mondolo, M. Jahanshahi, A. Granà, E. Biasutti, E. Cacciatori, P. Di Benedetto, "The validity of the hospital anxiety and depression scale and the geriatric depression scale in Parkinson’s disease," Behavioural Neurology, vol. 17 no. 2, pp. 109-115, DOI: 10.1155/2006/136945, 2006.

[30] C. Jenkinson, R. Fitzpatrick, V. Peto, R Greenhall, N. Hyman, "The Parkinson’s disease questionnaire (PDQ-39): development and validation of a Parkinson’s disease summary index score," Age and Ageing, vol. 26 no. 5, pp. 353-357, DOI: 10.1093/ageing/26.5.353, 1997.

[31] G. Galeoto, F. Colalelli, P. Massai, "Quality of life in Parkinson’s disease: Italian validation of the Parkisnon’s disease questionnaire (PDQ-39-IT)," Neurological Sciences, . In press

[32] J. E. Ware, C. D. Sherbourne, "The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection," Medical Care, vol. 30 no. 6, pp. 473-483, 1992.

[33] G. Apolone, P. Mosconi, "The Italian SF-36 Health Survey: translation, validation and norming," Journal of Clinical Epidemiology, vol. 51 no. 11, pp. 1025-1036, DOI: 10.1016/s0895-4356(98)00094-8, 1998.

[34] F. I. Mahoney, D. W. Barthel, "Functional evaluation: the Barthel index," Maryland State Medical Journal, vol. 14, pp. 61-65, 1965.

[35] G. Galeoto, A. Lauta, A. Palumbo, "The Barthel index: Italian translation, adaptation and validation," International Journal of Neurology and Neurotherapy, vol. 2 no. 2,DOI: 10.23937/2378-3001/2/1/1028, 2015.

[36] S. F. Castiglia, G. Galeoto, A. Lauta, "The culturally adapted Italian version of the Barthel Index (IcaBI): assessment of structural validity, inter-rater reliability and responsiveness to clinically relevant improvements in patients admitted to inpatient rehabilitation centers," Functional Neurology, vol. 32 no. 4,DOI: 10.11138/fneur/2017.32.4.221, 2017.

[37] F. Edition, Diagnostic and Statistical Manual of Mental Disorders, 2013.

[38] J. M. Bland, D. G. Altman, "Cronbach’s alpha," BMJ, vol. 314 no. 7080,DOI: 10.1136/bmj.314.7080.572, 1997.

[39] D. George, P. Mallery, SPSS for Windows Step by Step: A Simple Guide and Reference, 11.0 Update, 2003.

[40] M. W. Post, "What to do with “moderate” reliability and validity coefficients?," Archives of Physical Medicine and Rehabilitation, vol. 97 no. 7, pp. 1051-1052, DOI: 10.1016/j.apmr.2016.04.001, 2016.

[41] L. G. Portney, M. P. Watkins, Foundations of Clinical Research: Applications to Practice, vol. 2, 2000.

[42] B. Munro, Statistical Methods for Health Care Research, 2000.

[43] A. A. Küçükdeveci, A. Tennant, G. Grimby, F. Franchignoni, "Strategies for assessment and outcome measurement in physical and rehabilitation medicine: an educational review," Journal of Rehabilitation Medicine, vol. 43 no. 8, pp. 661-672, DOI: 10.2340/16501977-0844, 2011.

[44] D. L. Streiner, G. R. Norman, Health Measurement Scales: A Practical Guide to Their Development and Use, 2008.

[45] K. B. Adams, H. C. Matto, S. Sanders, "Confirmatory factor analysis of the geriatric depression scale," Gerontologist, vol. 44 no. 6, pp. 818-826, DOI: 10.1093/geront/44.6.818, 2004.

[46] J. Y. Kim, J. H. Park, J. J. Lee, "Standardization of the Korean version of the geriatric depression scale: reliability, validity, and factor structure," Psychiatry Investigation, vol. 5 no. 4,DOI: 10.4306/pi.2008.5.4.232, 2008.