Validation of Catquest-9SF Questionnaire in a Chinese Cataract Population

Abstract

Purpose

To develop and validate a Chinese version of the Catquest-9SF questionnaire in a cataract population.

Methods

The Catquest-9SF Questionnaire was translated and back translated into Chinese. Preoperative patients were recruited at a tertiary eye hospital and their demographic information and visual acuity were documented. Psychometric properties of the Catquest-9SF, including ordered thresholds, the ability to distinguish between different strata of person ability, absence of misfitting items, unidimentionality, differential item functioning (DIF) and construct validity were tested, using Rasch analysis.

Results

A total of 102 patients (100% response rate) were enrolled. The participants'mean age was 70.2 year (SD = 12.1) and 46.9% were female. Rasch analysis showed that this version of the questionnaire had ordered response thresholds and was free of DIF. The items fit a single overall construct and unidimensional by principal components analysis of the residuals. Patients with visual impairment had significantly poorer Rasch scores on the Catquest-9SF (mean change, -2.5, p = 0.035, compared with non-visually impaired patients).

Conclusion

The Chinese version of Catquest-9SF is a valid and reliable questionnaire for assessing the visual disability outcomes of Chinese patients with cataract, and it may be recommended for routine clinical use.

About the Authors:

Xianchai Lin

Affiliation: State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China

Mingge Li

Affiliation: State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China

Mei Wang

Affiliation: Department of Ophthalmology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China

Yajing Zuo

Affiliation: State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China

Siping Zhu

Affiliation: State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China

Yongxin Zheng

Affiliation: State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China

Xiaofeng Lin

Affiliation: Shantou Central Hospital, Shantou, China

Minbin Yu

* E-mail: [email protected]

Affiliation: State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China

Ecosse L. Lamoureux

Affiliations Singapore Eye Research Institute, Singapore National Eye Centre, Singapore, Singapore, Duke-National University of Singapore Graduate Medical School, Singapore, Singapore, Centre for Eye Research Australia, University of Melbourne, Melbourne, Australia

Introduction

Cataract is the leading cause of visual impairment and blindness; and is one of the most costly eye problems in today's economies. [1] Cataract surgery is a highly cost-effective medical procedure that results in improvement of visual acuity and vision-related quality of life. [2] While most patients can restore their best possible distant visual acuity through phacoemulsification cataract surgery and intraocular lens implantation, the recent advancements in lens designs (e.g., multifocal lens) and surgical technologies (e.g., femtosecond laser-assisted cataract surgery) have the potential to achieve better refractive outcome and more predictable quality of vision. [3] These new technologies highlight a need to identify indicators of both preoperative and postoperative visual function in order for ophthalmologists to determine whether a new intervention is worth the cost. [4] Additionally, accurate assessment of visual functioning is important for cataract patients to make an informed surgical decision and have a realistic expectation about the treatment [5].

A large number of vision-related functional questionnaires (e.g., NEI-visual functioning questionnaire 25 (NEI-VFQ 25), [6]; [7] visual function 14 (VF-14), [8]–[10] and activities of daily vision scale for cataract surgery (ADVS)) [11]–[13] have been previously developed, but these questionnaires showed suboptimal targeting and may need additional items to facilitate measurement. More recently, the Catquest questionnaire was developed to assess patients' perceived difficulties in daily life as a result of cataract. [14]–[17] The original Catquest questionnaire contains 12 items and is based on the presence of indicators in four areas: frequency of performing activities (7 items), driving (1 item), questions about difficulties in general and satisfaction with vision (2 items) and cataract symptoms (2 items). However, previous studies showed that the Catquest questionnaire was not unidimensional and the symptoms and frequency of performing activities items did not form valid subscales. [14]–[17] Therefore, its short form, the Catquest-9SF questionnaire, was developed to address these issues. [18], [19] Modern psychometric analyses confirmed the validity and reliability of Catquest-9SF questionnaire and showed that it was highly responsive to surgical treatment and the score was moderately associated with visual acuity [18], [19].

The Catquest-9SF questionnaire was originally developed in Swedish and the translation has only been cross-culturally validated in an English-speaking population in Australia. [17] China is home to the world's largest number of cataract patients, [20] but a Chinese version of the Catquest-9SF questionnaire has not yet been validated. To assess patients' perceived visual functioning in a new country, the questionnaire must be translated and validated using rigorous psychometric methods. The goal of this study was to translate and validate the Chinese version of the Catquest-9SF questionnaire in a Chinese cataract population.

Methods

Study population

One hundred and two patients awaiting cataract operation were recruited from Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China between June 2013 and November 2013. The patients underwent a comprehensive ophthalmic examination that included best-corrected visual acuity, biomicroscopy, intraocular pressure, and funduscopy. All patients completed the Catquest-9SF questionnaire and an additional questionnaire for information about patients' past medical history, demographic characteristics, health literacy, and educational level. The study was approved by the Institutional Review Board of Zhongshan Ophthalmic Center and adhered to the tenets of the Declaration of Helsinki. The survey was explained in details that it was voluntary and would not influence care, and thus informed consent was not obtained.

Catquest-9SF questionnaire

The Catquest-9SF questionnaire consists of 7 questions for performing daily-life activities and 2 global questions about difficulties in general and satisfaction with vision. For each question, the response options are as follows: 1 =  very great difficulty; 2 =  great difficulty; 3 =  some difficulty; 4 =  no difficulty. Lower scores generally indicate better visual functions. The instruction information and the response formats presented in the current study represent a Chinese translation.

Development of Catquest-9SF questionnaire

The development of Catquest-9SF questionnaire involved the following steps:

1. Two translators independently carried out the translation of the questionnaire (from English to Chinese). They also made specific comments to highlight challenging phrases and uncertainties.

2. Reconciliation of the Chinese translations was made by a senior ophthalmologist to provide the first draft of Catquest-9SF questionnaire.

3. A third translator (who had no knowledge of the original English version of the Catquest-9SF) translated the drafted Catquest-9SF questionnaire into English. The back-translated Catquest-9SF was compared with the original English version to identify discrepancies so that revision can be made to make sure that the translation reflected the same item content as the original one. This step resulted in a revised version of the Chinese translation of the Catquest-9SF questionnaire.

4. The Chinese version of the questionnaire was tested on two ophthalmologists and 4 persons with cataract randomly selected from the outpatient clinics to collect information about any difficulties in completing the questionnaire and to determine if the purpose or meaning of each question can be accurately understood. After minor revision, the final version of the questionnaire was established (available upon request).

Rasch analysis

Rasch analysis is a psychometric method that places both item difficulty (item measure; i.e., how difficult the item is) and person ability (person measure; i.e., the extent to which person possesses the trait being tested) on the same scale, measured in log of the odds (logits) units. [21] In Rasch modeling, the probability of correctly answering a particular item is modeled as a logistic function of the difference between the person and item parameter. The model can be mathematically described as follows: Probability  = 1/(1+Exp(-(ability-difficulty))). When the person's ability “matches” the item difficulty, he or she has a 50% chance to answer the item correctly. [22] Rasch analysis gives information on both persons and items, and it provides insight into the psychometric properties of the scale. It determines how well items (a) fit the latent trait (e.g., vision function) being measured, (b) discriminate between respondents, and (c) target person ability. [23] In the current study, Rasch analysis was used to validate the Chinese version of the Catquest-9SF questionnaire based on the Andrich rating scale model (joint maximum likelihood estimation) using WINSTEPS software (version 3.63.2, Chicago, IL). [24] Several indicators were used to assess the validity of the questionnaire. These included: (1) person separation index (PSI). PSI provides an estimate of the discriminating ability of the items between strata of person ability. A PSI of 2.0 and a person reliability (PR) score of 0.8 may be considered sufficient for discrimination of at least 3 strata of persons' level of the trait being measured. (2) Person-item map. The map shows person measures ranked by their ability level and item difficulties ranked by difficulty. It provides a way to visualize how well the items target the ability of the sample. Ideally, the mean person measure should be approximately 0 logits. A difference between the mean person and item measure of more than 1.0 logits generally indicates significant mistargeting. (3) “infit” mean square (MNSQ). This is used to indicate the ability of a scale to measure a single latent trait. A MNSQ value between 0.7 and 1.3 were considered acceptable for unidimensionality. Items outside this range can be removed from the scale to improve fit. (4) Principal component analysis (PCA) of the residuals. PCA is used in combination with Rasch fit statistics to test the unidimensionality of the measured trait. The PCA transforms correlated items into principal components whereby the variance explained by the measures for the empiric calculation should be comparable with that of the model (>50%). An unexplained variance in the first contrast of the residuals <3.0 eigenvalue units suggests the nonexistence of a secondary trait captured by the instrument. (5) Differential item functioning (DIF). This measure is used to indicate if different groups (stratified by age, sex, or educational level) have systematically different responses despite having equal levels of trait being measured. A DIF value >1.0 logits is considered significant, and thus the interpretation of the results should be stratified by groups [25]–[28].

Results

Sociodemographic and clinical characteristics of the study population

A total of 102 people (100% response rate) participated in the study (Table 1). Overall, the participants' mean age was 70.2 year (SD = 12.1) and 46.9% were female. Using best-corrected data in the better-seeing eye, 70 (68.6%) of the patients had visual impairment.

[Figure omitted. See PDF.]

Table 1. Characteristics of the participants.

https://doi.org/10.1371/journal.pone.0103860.t001

Threshold order and person separation

The category probability curves showed that there was no evidence of disordered thresholds (Figure 1). The PSI and PR values were 2.94 and 0.90, respectively, suggesting good discriminant ability of the questionnaire.

[Figure omitted. See PDF.]

Figure 1. Category probability curves for the global “difficulties in your daily life” item, which illustrates ordered threshold.

https://doi.org/10.1371/journal.pone.0103860.g001

Unidimensionality

The ‘infit’ MNSQ values for the items were between 0.7 and 1.3 (Table 2), showing acceptable fit to the model expectation. The PCA of the residuals explained 63.0% of the raw variance, suggesting that there was no evidence of multidimensionality in the scale. The unexplained variance in 1st contrast was 1.9 eigenvalue units, and thus there was no evidence of another latent trait captured by the scale.

[Figure omitted. See PDF.]

Table 2. Item infit statistics and item difficulty rating (logits).

https://doi.org/10.1371/journal.pone.0103860.t002

Person-item map

Both the person and item scores were rescaled and are shown on the person-item map (Figure 2). Persons with the highest level of ability are located at the top of the diagram while those with the lowest level are at the bottom. On the right side of the dash line are the items, and items that are easier to perform further down the scale. There was an adequate spread of items across the range of person ability, although most of the items were located at the low end of the scale. Also, the difference in item and person mean was 1.61 logits. These results suggested that the items were generally too easy to perform for this population.

[Figure omitted. See PDF.]

Figure 2. Person-item map of the Chinese version of the Catquest-9SF.

https://doi.org/10.1371/journal.pone.0103860.g002

Differential item functioning (DIF)

One of the requirements of Rasch model is that the scale should function consistently across different subgroups (e.g., age, sex and education level). In other words, the subgroups should respond in the same way to the items. Notable DIF was seen for item 8 - difficulty seeing text on TV (i.e., people aged 60 years and over were generally more able to carry out this task than those younger than 60 years by 1.25 logits), and item 3 - difficulty reading newspaper (i.e., people with an university-level education were more able to read newspaper than those with no formal or primary education). Nevertheless, the majority of items functioned similarly for participants at the same level of ability (Table 3).

[Figure omitted. See PDF.]

Table 3. Differential item functioning (DIF) by age, sex, and education level.

https://doi.org/10.1371/journal.pone.0103860.t003

Criterion validity and reliability

We assessed the questionnaire's criterion validity by examining its ability to discriminate subgroups with different levels of visual acuity. Persons with worse visual functioning score were significantly associated with presence of visual impairment (mean change, −2.5, p = 0.035, compared with non-visually impaired patients). Cronhach α of the items ranged from 0.86–0.88 (Table 4).

[Figure omitted. See PDF.]

Table 4. Internal consistency of the Catquest-9SF items.

https://doi.org/10.1371/journal.pone.0103860.t004

Discussion

Our results show that the Chinese Catquest-9SF is a unidimensional, reliable and valid questionnaire that is useful for assessing visual functioning in Chinese patients with cataract. Our Rasch model confirmed the findings from previous studies in Sweden and Australia that the Catquest-9SF scale has ordered thresholds and slight mistargeting, and was free of any large DIF. Nevertheless, there is a need to advocate the application of this questionnaire, which is not commonly used in clinical practice, presumably due to the fact that many clinicians still consider it as a research-tool, rather than a means to identify patients with impaired visual function.

One of the advantages of the Catquest-9SF questionnaire is that it is not lengthy compared with other visual functioning questionnaires (e.g., ADVS and VF-14). [8]–[13] With 9 items, it is relatively easy and time effective to administer and receive responses from the participants. By contrast, the original Catquest questionnaire has 12 items that include disability (7 items), global assessments (2 items), symptoms (2 items), and driving (1 item). The original Catquest questionnaire was found to be multidimensional for the Swedish cataract patients. [14]–[17] The removal of the symptom and driving items improved fit, and thus leading to the development of Catquest-9SF questionnaire [18], [19].

The person-item map shows the distribution of participants' ability and item difficulty attributes. Although there was a fairly even spread of items about the ability continuum, the Catquest-9SF items showed slight mistargeting, with some participants possessing greater abilities than required by the most difficult item. These results suggested that the Catquest-9SF items were too easy for the visual abilities of the participants. Further studies are needed to assess if the inclusion of additional items can result in better targeting of items for the visual abilities of the participants. Similar to findings in the Australian cohort, item 2 (“satisfaction with one's present vision”) was found to be the most difficult question, whereas item 9 (“hobbies”) was the easiest one [17].

There was no large DIF for the majority of the items in the current study. Nevertheless, item 8 (“seeing text on TV”) showed significant DIF across different age and gender groups. One possible explanation is that the frequency of performing this activity may be different among different subgroups. It is possible that this activity is more commonly performed among older people and among females in China, and thus older people and women may be more likely to experience the difficulty than young persons and men. In addition, item 3 (“reading newspaper”) showed significant DIF was for subgroups with different education levels. This is explicable on the ground that people with no formal or with primary education are far less likely to read newspaper than those with a University diploma. These items were retained in the questionnaire, given that the DIF was not substantial.

The strengths of this study include the use of Chinese patients with cataract with a useful age distribution, reasonable representation of both sexes, and the use of modern psychometric theory to validate the scale. Nevertheless, this study has a few limitations. First, we did not assess the responsiveness of the questionnaires (e.g., change in visual functions after cataract surgery). Second, all patients were enrolled from a single hospital. They may not be fully representative of the general population in China. All were hospitalized and waiting for cataract surgery, and may suggest that that the majority of them (87%) were not satisfied with their present vision. Third, while we believe that this version of the Catquest-9SF questionnaire could be used without further adaptation in most of the Chinese-speaking regions (e.g. Singapore, Taiwan, etc.), a cultural adaptation of the questionnaire may still be needed outside of China.

In conclusion, we found that the Chinese version of the Catquest-9SF questionnaire is valid and reliable, and is linguistically and culturally suitable for use among Chinese speaking patients in China. The Chinese version of the Catquest-9SF is easy to understand and quick to complete, and will serve as an important tool to assess vision function for patients with cataract in Chinese-speaking communities.

Author Contributions

Conceived and designed the experiments: Xianchai Lin MY EL. Performed the experiments: Xianchai Lin ML MW Y. Zuo Y. Zheng SZ Xiaofeng Lin. Analyzed the data: Xianchai Lin ML MW. Contributed reagents/materials/analysis tools: Xianchai Lin ML MW EL. Contributed to the writing of the manuscript: Xianchai Lin MY EL.

Citation: Lin X, Li M, Wang M, Zuo Y, Zhu S, Zheng Y, et al. (2014) Validation of Catquest-9SF Questionnaire in a Chinese Cataract Population. PLoS ONE 9(8): e103860. https://doi.org/10.1371/journal.pone.0103860

References

1. Asbell PA, Dualan I, Mindel J, Brocks D, Ahmad M, et al. (2005) Age-related cataract. Lancet 365: 599–609.

2. Johnson GJ (2000) Improving outcome of cataract surgery in developing countries. Lancet 355: 158–159.

3. He L, Sheehy K, Culbertson W (2011) Femtosecond laser-assisted cataract surgery. Curr Opin Ophthalmol 22: 43–52.

4. Lohr K, Zebrack B (2009) Using patient-reported outcomes in clinical practice: challenges and opportunities. Qual Life Res 8: 99–107.

5. Swanson MW (2012) Medical decision-making capacity and cataract surgery. Optom Vis Sci 89: e23–26.

6. Pesudovs K, Gothwal VK, Wright T, Lamoureux EL (2010) Remediating serious flaws in the National Eye Institute Visual Function Questionnaire. J Cataract Refract Surg 36: 718–732.

7. Revicki DA, Rentz AM, Harnam N, Thomas VS, Lanzetta P (2010) Reliability and validity of the National Eye Institute Visual Function Questionnaire-25 in patients with age-related macular degeneration. Invest Ophthalmol Vis Sci 51: 712–717.

8. Chiang PP, Fenwick E, Marella M, Finger R, Lamoureux E (2011) Validation and reliability of the VF-14 questionnaire in a German population. Invest Ophthalmol Vis Sci 52: 8919–8926.

9. Gothwal VK, Wright TA, Lamoureux EL, Pesudovs K (2010) Measuring outcomes of cataract surgery using the Visual Function Index-14. J Cataract Refract Surg 36: 1181–1188.

10. Steinberg EP, Tielsch JM, Schein OD, Javitt JC, Sharkey P, et al. (1994) The VF-14. An index of functional impairment in patients with cataract. Arch Ophthalmol 112: 630–638.

11. Gothwal VK, Wright TA, Lamoureux EL, Pesudovs K (2010) Activities of Daily Vision Scale: what do the subscales measure? Invest Ophthalmol Vis Sci 51: 694–700.

12. Mangione CM, Phillips RS, Seddon JM, Lawrence MG, Cook EF, et al. (1992) Development of the ‘Activities of Daily Vision Scale.’A measure of visual functional status. Med Care 30: 1111–1126.

13. Pesudovs K, Garamendi E, Keeves JP, Elliott DB (2003) The Activities of Daily Vision Scale for cataract surgery outcomes: re-evaluating validity with Rasch analysis. Invest Ophthalmol Vis Sci 44: 2892–2899.

14. Lundström M, Roos P, Jensen S, Fregell G (1997) Catquest questionnaire for use in cataract surgery care: description, validity, and reliability. J Cataract Refract Surg 23: 1226–1236.

15. Lundström M, Stenevi U, Thorburn W, Roos P (1998) Catquest questionnaire for use in cataract surgery care: assessment of surgical outcomes. J Cataract Refract Surg 24: 968–974.

16. Lundström M, Brege KG, Floren I, Stenevi U, Thorburn W (2000) Impaired visual function after cataract surgery assessed using the Catquest questionnaire. J Cataract Refract Surg 26: 101–108.

17. Gothwal VK, Wright TA, Lamoureux EL, Lundström M, Pesudovs K (2009) Catquest questionnaire: re-validation in an Australian cataract population. Clin Experiment Ophthalmol 37: 785–794.

18. Lundstrom M, Behndig A, Kugelberg M, Montan P, Stenevi U, et al. (2011) The outcome of cataract surgery measured with the Catquest-9SF. Acta Ophthalmol 89: 718–723.

19. Lundström M, Pesudovs K (2009) Catquest-9SF patient outcomes questionnaire: nine-item short-form Rasch-scaled revision of the Catquest questionnaire. J Cataract Refract Surg 35: 504–513.

20. Wong TY, Zheng Y, Jonas JB, Flaxman SR, Keeffe J, et al. (2014) Prevalence and causes of vision loss in East Asia: 1990–2010. Br J Ophthalmol 98: 599–604.

21. Lamoureux EL, Pesudovs K (2011) Vision-specific quality of life research: a need to improve the quality. Am J Ophtalmol 151: 195–197.e2.

22. Smith RM, Miao CY (1994) Assessing unidimensionality for Rasch measurement. In: Wilson M, ed.Assessing Unidimensionality for Rasch Measurement. Norwood, NJ: Ablex Publishing Co 316–327.

23. Smith EV Jr (2002) Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas 3: 205–231.

24. Linacre JM (2005) A User's Guide to WINSTEPS. Chicago, IL: Winsteps.com.

25. Holland PW, Wainer H (1993) Differential item functioning. In: Holland PW, Weiner H, eds.Differential Item Functioning. Hillsdale, NJ: Lawrence Erlbaum.

26. Lamoureux EL, Pallant JF, Pesudovs K, Hassell JB, Keeffe JE (2006) The Impact of Vision Impairment Questionnaire: an evaluation of its measurement properties using Rasch analysis. Invest Ophthalmol Vis Sci 47: 4732–4741.

27. Lamoureux EL, Pallant JF, Pesudovs K, Rees G, Hassell JB, et al. (2007) The effectiveness of low-vision rehabilitation on participation in daily living and quality of life. Invest Ophthalmol Vis Sci 48: 1476–1482.

28. Lamoureux EL, Pallant JF, Pesudovs K, Rees G, Hassell JB, et al. (2007) The Impact of Vision Impairment Questionnaire: an assessment of its domain structure using confirmatory factor analysis and Rasch analysis. Invest Ophthalmol Vis Sci 48: 1001–1006.