CG, YW and YJ are joint first authors.
WHAT IS ALREADY KNOWN ON THIS TOPIC
AI has shown great potential in screening eye diseases. However, the effectiveness of AI systems in screening multiple retinal abnormalities in primary healthcare settings remains unclear.
WHAT THIS STUDY ADDS
This study demonstrates the feasibility of Airdoc retinal AI system for multiple retinal disease detection in real-world scenarios of primary healthcare settings. Moreover, it reminds us that more attention should be paid to fundus diseases in the community.
HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY
The AI-assisted fundus disease screening system in primary healthcare settings could reduce regional medical resource inequalities, improve earlier detection of fundus diseases and reduce the disease burden caused by vision loss.
Introduction
As China’s population ages and lifestyle evolves, vision impairment and blindness remain significant public health concerns. In China, from 1990 to 2019, regardless of population growth, the number of people with moderate vision impairment increased by 113.51% (87.22% due to population ageing and 26.29% contributed by age-specific prevalence), severe vision impairment increased by 126.97% (116.06% attributable to population ageing and 10.91% due to age-specific prevalence) and blindness increased by 44.18% (99.22% pertained to population ageing and −55.04% contributed by age-specific prevalence) according to the Global Burden of Diseases, Injuries and Risk Factors Study 2019.1 Uncorrected refractive error, cataracts and fundus diseases, including age-related macular degeneration (AMD), glaucomatous optic neuropathy (GON) and diabetic retinopathy (DR), are the leading causes of vision impairment in China.1
Compared with refractive error and cataracts, the diagnosis and management of fundus diseases are more complex and often accompanied by poor prognosis. Early screening and referral can effectively reduce the visual loss caused by DR,2 and combined screening for AMD and DR is highly cost-effective in both rural and urban China.3 However, there is a shortage of ophthalmologists in China. According to the International Council of Ophthalmology, China had 36 342 ophthalmologists in 2015, which equates to 26.4 ophthalmologists per million people.4 The scarcity of medical resources is more serious in grassroots and remote areas. Consequently, patients with fundus diseases may not receive timely treatment in primary healthcare settings due to a deficiency of ophthalmologists and equipment.
A growing number of studies have demonstrated that artificial intelligence (AI) has great potential for diagnosing eye diseases,5 indicating that AI might relieve the burden on primary healthcare settings. However, most AI systems trained in tertiary hospitals have not been tested with large samples in primary healthcare settings, so there may be variations in disease type and condition between the real and training populations. Our group worked on AI-based fundus disease screening in community hospitals and demonstrated high sensitivity and specificity for detecting DR.6 7 Recently, a deep-learning system, the Comprehensive AI Retinal Expert (CARE, Beijing Airdoc Technology, Beijing, China), depicted satisfactory performance in identifying multiple retinal abnormalities in a national real-world evidence study, including tertiary and community hospitals.8 Moreover, CARE has proven safe and reliable for detecting DR in Chinese community healthcare centres.9
This study employed an upgraded deep learning system based on CARE, Airdoc retinal AI system (ARAS, Beijing Airdoc Technology). Compared with CARE, ARAS applied a multitask classification network: a general subtask, macular subtask and optic-disc subtask, which could capture macula and optic disc abnormalities more accurately. However, the effectiveness of ARAS in screening multiple retinal abnormalities in primary healthcare settings remains unclear. To remedy this, three primary healthcare settings in Shanghai (a high-income area) and three in Xinjiang (a low-income area) were included to evaluate the performance of ARAS in detecting multiple fundus diseases. The performance of ARAS was described based on its accuracy, sensitivity, specificity, and positive and negative predictive values. Furthermore, we investigated the spectrum of fundus disease in primary healthcare settings of different economic levels based on the results of ARAS.
Materials and methods
Study design
The overall study design is displayed in online supplemental file 1. All fundus images were anonymised before analysis. All procedures were conducted following the Declaration of Helsinki, and informed consent was obtained from all the participants.
Study participants
This study was conducted in six primary healthcare settings (or hospitals at a similar level): Linfen Community Health Service Centre, Pengpu New Village Community Health Service Centre, Pengpu Town Community Health Service Centre in Jing'an District of Shanghai, Bachu County People’s Hospital, Bachu County Traditional Chinese Medicine Hospital, and Selibuya Town Centre Health Centre in Kashgar, Xinjiang. Consecutive patients who visited primary healthcare institutions for eye discomfort were included between November 2020 and August 2022.
Algorithm construction of ARAS
CARE developed an algorithm based on Inception-ResNet-V2.8 ARAS is an updated version of CARE. As shown in online supplemental file 1, the overall architecture of ARAS consists of two AI submodules: a detection model for the macula and optic disc region (Yolo-V3) and a multitask learning model for retinal disease classification (EfficientNet-B3).10 First, Yolo-V311 was used to localise the macula and optic disc of each image. The initially detected bounding boxes of the macula and optic disc were extended by one-fourth of the width and height to cover the neighbouring regions, and then generated the macula and optic disc regions. Second, the multitask classification network took EfficientNet-B312 as the backbone with three subtasks, the general subtask for all 14 retinal abnormalities, the macula subtask for macular abnormalities (eg, macular holes (MH), macular oedema (ME), and central serous chorioretinopathy (CSC)), and the optic disc subtask for optic disc abnormalities (eg, GON). After detection, each subtask used the corresponding feature map region of the fundus image as the input. The general subtask, macular subtask and optic-disc subtask took the total fundus region, macula region and optic disc region as input, respectively. For each task, the corresponding feature map region located by the detection model was fed into a multilayer perceptron block with sigmoid as the activation function of the last layer and the loss function was cross-entropy. Third, during inference, each subtask outputs a status as either healthy or abnormal with some retinal diseases. If none of the three subtasks of the multitask classification model reported abnormalities, one eye was diagnosed as healthy; otherwise, one eye was diagnosed as the union of the abnormalities of the three subtasks. The development and validation of ARAS are detailed in online supplemental tables S1 and S2. The attention heatmaps of the 14 fundus abnormalities are displayed in online supplemental figures S3–S16.
Study procedures
Colour fundus photographs with 45°–50° fields of view centred on the midpoint of the fovea and optic disc were prospectively taken for both eyes under a natural pupil size. One image was taken for each eye of each participant. Manufacturers and camera models used in this study are listed in online supplemental table S3. All fundus photographs were anonymised and uploaded to the AI system. ARAS was used to identify normal fundus and 14 fundus abnormalities in each image/eye: referable DR, referable hypertensive retinopathy, GON, pathological myopia (PM), retinal vein occlusion (RVO), retinal detachment (RD), MH, ME, CSC, epiretinal membranes (ERM), retinitis pigmentosa (RP), retinal drusen ≥65 µm, macular neovascularisation and geographic atrophy.8 Unidentifiable images of each eye were excluded from further analysis, such as blurred and defocused images due to severe cataracts or keratitis. Ultimately, the fundus abnormalities of each participant were the union of the abnormalities in both eyes. Reference standards were generated by randomly assigning each image to two retinal specialists (5–10 years of postcertification experience in a tertiary hospital). Only after both retinal experts agreed that the image labelling was finalised; otherwise, a third expert (>10 years of postcertification experience in a tertiary hospital) make the final decision. The definitions or basis for judgement of the 14 retinal abnormalities as a reference for the graders are consistent with a previous study.8 The expert graded each image/eye for a normal fundus and all 14 abnormalities. All retinal abnormalities were labelled if several lesions were found in the same image/eye.
Statistical analysis
All statistical analyses were performed in R V.4.1.2. Median (IQR) and frequency (percentage) were reported to describe continuous and categorical variables, respectively. Medians and proportions were compared using the Wilcoxon rank-sum test (or Kruskal-Wallis rank-sum test, if appropriate) and Pearson’s χ2 test (or Fisher’s exact test, if appropriate), respectively. The analyses stratified by age and gender were visualized using “ggplot2” package and fitted using generalized linear models. The performance of ARAS was analysed at the eye level (one image was taken for each eye) based on its accuracy, sensitivity, specificity and positive and negative predictive values with a 95% CI. Notably, a p<0.05 was considered statistically significant.
Results
Performance of ARAS in screening
From November 2020 to August 2022, 5069 participants (2725 from Shanghai and 2344 from Xinjiang) were enrolled in six primary healthcare settings. Moreover, 1149 images/eyes (806 from Shanghai and 343 from Xinjiang) were excluded from further analysis for unidentifiable. Finally, 4795 participants (2528 from Shanghai and 2267 from Xinjiang) were included. More details are shown in figure 1.
Figure 1. Fundus conditions of 4795 participants in Shanghai and Xinjiang primary healthcare settings.
ARAS accurately identified the accuracy of the normal fundus (0.76 (95% CI 0.74 to 0.77)), referable DR (0.93 (95% CI 0.92 to 0.94)), referable hypertensive retinopathy (1.00 (95% CI 1.00 to 1.00)), GON (0.93 (95% CI 0.92 to 0.94)), PM (0.93 (95% CI 0.92 to 0.93)), RVO (0.99 (95% CI 0.99 to 1.00)), RD (1.00 (95% CI 1.00 to 1.00)), MH (1.00 (95% CI 0.99 to 1.00)), ME (0.97 (95% CI 0.96 to 0.97)), CSC (1.00 (95% CI 1.00 to 1.00)), ERM (0.94 (95% CI 0.93 to 0.95)), RP (1.00 (95% CI 1.00 to 1.00)), retinal drusen (0.93 (95% CI 0.92 to 0.94)), macular neovascularisation (0.98 (95% CI 0.98 to 0.99)) and geographic atrophy (1.00 (95% CI 0.99 to 1.00)). The sensitivity, specificity, and positive and negative predictive values of the ARAS to detect normal fundus and 14 common retinal abnormalities are illustrated in table 1.
Table 1ARAS performance for detecting normal fundus and retinal abnormalities
Accuracy | Sensitivity | Specificity | Positive predictive value | Negative predictive value | |
Normal fundus | 0.76 (0.74, 0.77) | 0.57 (0.55, 0.59) | 0.99 (0.98, 0.99) | 0.99 (0.98, 0.99) | 0.65 (0.63, 0.67) |
Referable diabetic retinopathy | 0.93 (0.92, 0.94) | 0.87 (0.82, 0.91) | 0.93 (0.92, 0.94) | 0.51 (0.46, 0.56) | 0.99 (0.98, 0.99) |
Referable hypertensive retinopathy | 1.00 (1.00, 1.00) | 0.75 (0.19, 0.99) | 1.00 (1.00, 1.00) | 0.33 (0.07, 0.70) | 1.00 (1.00, 1.00) |
Glaucomatous optic neuropathy | 0.93 (0.92, 0.94) | 0.95 (0.93, 0.97) | 0.92 (0.91, 0.93) | 0.65 (0.62, 0.69) | 0.99 (0.99, 1.00) |
Pathological myopia | 0.93 (0.92, 0.93) | 0.85 (0.81, 0.87) | 0.94 (0.93, 0.95) | 0.74 (0.70, 0.77) | 0.97 (0.96, 0.97) |
Retinal vein occlusion | 0.99 (0.99, 1.00) | 0.79 (0.67, 0.89) | 1.00 (0.99, 1.00) | 0.82 (0.70, 0.91) | 1.00 (0.99, 1.00) |
Retinal detachment | 1.00 (1.00, 1.00) | 0.00 (0.00, 0.71) | 1.00 (1.00, 1.00) | / | 1.00 (1.00, 1.00) |
Macular holes | 1.00 (0.99, 1.00) | 0.75 (0.35, 0.97) | 1.00 (0.99, 1.00) | 0.38 (0.15, 0.65) | 1.00 (1.00, 1.00) |
Macular oedema | 0.97 (0.96, 0.97) | 0.92 (0.88, 0.96) | 0.97 (0.96, 0.97) | 0.62 (0.56, 0.67) | 1.00 (0.99, 1.00) |
Central serous chorioretinopathy | 1.00 (1.00, 1.00) | 1.00 (0.03, 1.00) | 1.00 (1.00, 1.00) | 0.14 (0.00, 0.58) | 1.00 (1.00, 1.00) |
Epiretinal membranes | 0.94 (0.93, 0.95) | 0.96 (0.92, 0.99) | 0.94 (0.93, 0.95) | 0.41 (0.36, 0.47) | 1.00 (1.00, 1.00) |
Retinitis pigmentosa | 1.00 (1.00, 1.00) | 0.91 (0.59, 1.00) | 1.00 (1.00, 1.00) | 0.56 (0.31, 0.78) | 1.00 (1.00, 1.00) |
Retinal drusen | 0.93 (0.92, 0.94) | 0.71 (0.64, 0.78) | 0.94 (0.93, 0.95) | 0.38 (0.32, 0.43) | 0.98 (0.98, 0.99) |
Macular neovascularisation | 0.98 (0.98, 0.99) | 0.62 (0.38, 0.82) | 0.99 (0.98, 0.99) | 0.21 (0.12, 0.33) | 1.00 (1.00, 1.00) |
Geographic atrophy | 1.00 (0.99, 1.00) | 0.20 (0.03, 0.56) | 1.00 (1.00, 1.00) | 0.40 (0.05, 0.85) | 1.00 (1.00, 1.00) |
ARAS, airdoc retinal artificial intelligence system.
The spectrum of retinal diseases in Shanghai and Xinjiang primary healthcare settings
Among the 4795 included individuals (2528 from Shanghai and 2267 from Xinjiang), the median age was 57.0 (IQR 39.0–66.0) years, 3175 participants (66.2%) were female, and 515 participants (10.7%) were identified as having normal fundus. There was no significant difference in the incidence of referable DR, referable hypertensive retinopathy, MH, CSC,or geographic atrophy between Shanghai and Xinjiang. The demographic characteristics and fundus conditions of 4795 participants are detailed in table 2 and figure 1. The demographic characteristics and fundus conditions of the Shanghai and Xinjiang participants are detailed in online supplemental tables S4 and S5, figures 17 and 18, respectively. The percentage of normal fundus in Shanghai and Xinjiang was 2.5% and 20.0%, respectively. The proportion of GON, PM, ERM, retinal drusen and macular neovascularisation was significantly higher in Shanghai than in Xinjiang. The percentages of RVO, ME and RP in Xinjiang were significantly higher than in Shanghai.
Table 2Demographic characteristics and fundus conditions of 4795 participants in Chinese primary healthcare settings
Variable | Total (n=4795) | Shanghai (n=2528) | Xinjiang (n=2267) | P value |
Age (years) | 57 (39.0, 66.0) | 64 (55.0, 70.0) | 44 (32.0, 56.0) | <0.001* |
Gender | <0.001* | |||
Female | 3175 (66.2) | 1874 (74.1) | 1301 (57.4) | |
Male | 1620 (33.8) | 654 (25.9) | 966 (42.6) | |
Normal fundus | 515 (10.7) | 62 (2.5) | 453 (20.0) | <0.001* |
Referable diabetic retinopathy | 386 (8.1) | 211 (8.3) | 175 (7.7) | 0.426 |
Referable hypertensive retinopathy | 8 (0.2) | 3 (0.1) | 5 (0.2) | 0.488 |
Glaucomatous optic neuropathy | 572 (11.9) | 394 (15.6) | 178 (7.9) | <0.001* |
Pathological myopia | 496 (10.3) | 471 (18.6) | 25 (1.1) | <0.001* |
Retinal vein occlusion | 57 (1.2) | 14 (0.6) | 43 (1.9) | <0.001* |
Retinal detachment | 0 (0) | 0 (0) | 0 (0) | / |
Macular holes | 17 (0.4) | 12 (0.5) | 5 (0.2) | 0.139 |
Macular oedema | 237 (4.9) | 79 (3.1) | 158 (7.0) | <0.001* |
Central serous chorioretinopathy | 7 (0.1) | 6 (0.2) | 1 (0.0) | 0.129 |
Epiretinal membranes | 318 (6.6) | 242 (9.6) | 76 (3.4) | <0.001* |
Retinitis pigmentosa | 16 (0.3) | 2 (0.1) | 14 (0.6) | 0.001* |
Retinal drusen | 293 (6.1) | 266 (10.5) | 27 (1.2) | <0.001* |
Macular neovascularisation | 64 (1.3) | 55 (2.2) | 9 (0.4) | <0.001* |
Geographic atrophy | 5 (0.1) | 5 (0.2) | 0 (0) | 0.064 |
Data are presented as median (IQR) or n (%).
*Statistically significant.
Due to the significant differences in age and gender between Shanghai and Xinjiang participants, we further stratified the analysis by age and gender. Among diseases requiring regular follow-up, the proportion of retinal drusen and PM in Shanghai was significantly higher than in Xinjiang for males and females of all ages (figure 2). Among diseases requiring referral, the percentages of referable DR, RVO and ME in middle-aged and elderly people in Xinjiang were significantly higher than those in Shanghai, while the proportion of GON in males in Shanghai was the highest at all ages (figure 3).
Figure 2. Fundus conditions requiring regular follow-up in Shanghai and Xinjiang primary healthcare settings stratified by age and gender.
Figure 3. Fundus diseases requiring referral in Shanghai and Xinjiang primary healthcare settings stratified by age and gender.
Discussion
In this study, we initially evaluated the efficacy of ARAS for screening multiple retinal abnormalities in primary healthcare settings. The accuracy, specificity and negative predictive value of ARAS for detecting normal fundus and 14 abnormalities were all high, while it revealed a low sensitivity when it comes to detecting normal fundus, RD, macular neovascularisation and geographic atrophy. Moreover, the positive predictive value for screening 14 abnormalities was unsatisfactory compared with that of the normal fundus. Although ARAS performed satisfactorily in identifying multiple retinal diseases during the initial development and validation (online supplemental tables S1 and S2), it is not surprising given that the strict control of image quality and photographic conditions is hard to be fully met in real-world scenarios. The poor quality of images owing to the small pupils, ocular media opacities, camera-related technical issues and operator-dependent factors could affect the performance of the AI screening system.13 Additionally, Lin et al reported satisfactory sensitivity and specificity for identifying multiple retinal abnormalities of CARE in a national real-world study.8 Unlike in the present study, participants with fundus diseases in the study by Lin et al were mainly from tertiary hospitals (85.0% of participants in the internal validation set and 75.3% in the external test set).8 Meanwhile, the low proportion of fundus diseases in primary healthcare visits might have led to the low positive predictive value and low sensitivity in our study. For example, only eight patients had referable hypertensive retinopathy (0.17%), seven had CSC (0.15%) and five had geographic atrophy (0.10%). In summary, ARAS is an effective screening tool for multiple retinal abnormalities; however, its algorithm and workflow still require further improvement for better performance in real-world applications in primary healthcare settings.
AI systems have been widely studied for fundus diseases, including screening, diagnosis and prognosis assessment, using fundus photographs14 and optical coherence tomography angiography images.15 In addition to AMD,16 GON,17 DR18 and major blinding fundus diseases, Srisuriyajan et al developed an AI system with high sensitivity and specificity in screening cytomegalovirus retinitis, which is a great threat to the vision of HIV-positive patients.19 Moreover, AI revealed high performances in predicting postoperative visual prognosis after ERM20 and MH surgeries.21 Furthermore, as an accessible extension of the brain and the only window for observing small vessels in vivo,22 the retina can detect Alzheimer’s disease23 and cardiovascular diseases24 in addition to fundus diseases. However, significant gaps exist between developing and applying AI systems in clinical practice,25 and only a few reports have validated AI systems in real-world scenarios. Font et al demonstrated the high diagnostic accuracy of an AI system for holistic maculopathy screening, including DR, AMD, GON and nevus, in a routine occupational health check-up context.26 Hao et al reported that AI-assisted screening for DR in rural areas of Midwest China was highly consistent with ophthalmologist diagnoses.27 In our study, we conducted a multicentre, cross-sectional study to assess the efficacy of AI-assisted screening for normal fundus and 14 retinal abnormalities in primary healthcare settings in high-income (Shanghai) and low-income (Xinjiang) areas of China.
With the ageing population and evolving lifestyle in China, vision impairment and blindness remain important public health concerns, particularly in rural and remote areas. Based on AI-assisted screening, we preliminarily analysed the spectrum of retinal diseases in primary healthcare settings in Shanghai and Xinjiang. The percentage of normal fundus in Shanghai and Xinjiang was 2.5% and 20.0%, respectively. The proportion of retinal drusen and PM in Shanghai was significantly higher than in Xinjiang among males and females of all ages. Furthermore, the proportion of GON in males in Shanghai was the highest at all ages. At the same time, the percentages of referable DR, RVO and ME in middle-aged and elderly people in Xinjiang were significantly higher than those in Shanghai. There may be several reasons for the difference in the spectrum of fundus diseases in primary healthcare settings between Shanghai and Xinjiang. On the one hand, the participants from Xinjiang were younger than those from Shanghai (44.0 years vs 64.0 years). In addition, compared with Shanghai, the Kashgar region in Xinjiang has a higher altitude (1289.5 m vs 2.19 m), greater ultraviolet light exposure and a drier climate, which are significant risk factors for ocular surface diseases.28 These might explain the higher proportion of normal fundus in primary healthcare visits in Xinjiang. On the other hand, the per capita GDP of Shanghai in 2021 is RMB173 630, while that of Xinjiang is RMB61 725 (National Bureau of Statistics of China, https://data.stats.gov.cn/). Shanghai has abundant medical resources, and patients with serious fundus diseases, such as DR, RVO and ME, are more likely to seek consultation at a tertiary hospital rather than primary healthcare, which might cause a deviation in the results. To our knowledge, there are few studies on the prevalence of multiple fundus diseases in Shanghai and Xinjiang communities. A community-based cross-sectional study depicted that the incidence of DR in suburban Shanghai was approximately 6.3%,29 lower than 8.3% in this study, which may have resulted from the participants included in our study being patients attending primary healthcare settings, while Ma et al study was based on a community population.
As far as we know, this is the first study to investigate the spectrum of fundus diseases using an AI system of actual real-world scenarios in primary healthcare settings. Compared with conventional ophthalmologist screening, AI-based screening is more cost-effective.30 In addition, AI-assisted early screening can effectively alleviate the strain on the healthcare system and enhance eye care in primary healthcare settings: referrals will be made for patients who require additional evaluation or treatment, while others will continue to receive follow-up care in primary healthcare settings. In addition, AI system’s prompt and accurate diagnoses can improve patient compliance. Moreover, ARAS also demonstrated promise in screening cardiovascular diseases and Alzheimer’s diseases based on fundus photographs in primary healthcare settings. Furthermore, this study selected two representative regions, Shanghai (a high-income area) and Xinjiang (a low-income area), to screen for fundus diseases and provided a theoretical basis and practical experience for nationwide screening in both developed and developing countries. In the future, an epidemiological study on the prevalence of multiple retinal diseases in the whole country is anticipated to comprehensively analyse the condition of fundus disease and further provide data for national healthcare policies.
However, this study has several limitations. First, the demographic characteristics of participants were incomplete. Second, some participants with only one identifiable fundus image were included in the analysis of the disease spectrum, which might have biased the results. Third, it is possible that the prevalence of fundus diseases was overestimated owing to the higher negative predictive values of the AI system and lower positive predictive values. Thus, caution should be exercised when interpreting the current findings.
In conclusion, this multicentre and cross-sectional study demonstrated the feasibility of ARAS for multiple retinal disease detection in real-world scenarios in primary healthcare settings. Moreover, it reminds us that more attention should be paid to fundus diseases in the community in both developed and remote areas. The AI-assisted fundus disease screening system in primary healthcare settings could reduce regional medical resource inequalities and improve earlier detection of fundus diseases, thereby reducing the disease burden caused by vision loss. However, the ARAS algorithm requires additional development for enhanced performance, and well-designed population-based studies across the country are warranted to further assess its performance.
Data availability statement
Data are available on reasonable request.
Ethics statements
Patient consent for publication
Not applicable.
Ethics approval
This study was approved by the Ethics Committee of Shibei Hospital of Jing’an District, Shanghai, China (approval number: YL-201805258-05). Participants gave informed consent to participate in the study before taking part.
Contributors CG, YuW and YJ: writing the manuscript, analysing the results and interpreting the data. FX, SW, RL, WY, NA, YiW, YL, XL, TW and LD: data collection. YC, BW and YZ: data processing. WBW: conception and design of the work. QQ, ZZ, DL and JC: idea, conception and design of the work, interpretation of the data, critical revision of the manuscript, and study supervision.
Funding This work was supported by the project of Shanghai Municipal Commission of Health and Family Planning (grant number: 202140224), Shanghai Municipal Health and Family Planning Commission (grant number: 20164Y0180), Shanghai Jing'an District Health Research (grant number: 2016QN06 and 2022MS11) and Shanghai Medical Key Special Construction Project (grant number: none).
Disclaimer The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
1 Xu T, Wang B, Liu H, et al. Prevalence and causes of vision loss in china from 1990 to 2019: findings from the global burden of disease study 2019. Lancet Public Health 2020; 5: e682–91. doi:10.1016/S2468-2667(20)30254-1
2 Wong TY, Sun J, Kawasaki R, et al. Guidelines on diabetic eye care: the international council of ophthalmology recommendations for screening, follow-up, referral, and treatment based on resource settings. Ophthalmology 2018; 125: 1608–22. doi:10.1016/j.ophtha.2018.04.007
3 Li R, Yang Z, Zhang Y, et al. Cost-effectiveness and cost-utility of traditional and telemedicine combined population-based age-related macular degeneration and diabetic retinopathy screening in rural and urban china. Lancet Reg Health West Pac 2022; 23: 100435. doi:10.1016/j.lanwpc.2022.100435
4 Resnikoff S, Lansingh VC, Washburn L, et al. Estimated number of ophthalmologists worldwide (international Council of ophthalmology update): will we meet the needs? Br J Ophthalmol 2020; 104: 588–92. doi:10.1136/bjophthalmol-2019-314336
5 Benet D, Pellicer-Valero OJ. Artificial intelligence: the unstoppable revolution in ophthalmology. Surv Ophthalmol 2022; 67: 252–70. doi:10.1016/j.survophthal.2021.03.003
6 Liu R, Li Q, Xu F, et al. Application of artificial intelligence-based dual-modality analysis combining fundus photography and optical coherence tomography in diabetic retinopathy screening in a community hospital. Biomed Eng Online 2022; 21: 47. doi:10.1186/s12938-022-01018-2
7 He J, Cao T, Xu F, et al. Artificial intelligence-based screening for diabetic retinopathy at community hospital. Eye (Lond) 2020; 34: 572–6. doi:10.1038/s41433-019-0562-4
8 Lin D, Xiong J, Liu C, et al. Application of comprehensive artificial intelligence retinal expert (care) system: a national real-world evidence study. Lancet Digit Health 2021; 3: e486–95. doi:10.1016/S2589-7500(21)00086-8
9 Dong X, Du S, Zheng W, et al. Evaluation of an artificial intelligence system for the detection of diabetic retinopathy in chinese community healthcare centers. Front Med (Lausanne) 2022; 9: 883462. doi:10.3389/fmed.2022.883462
10 Dong L, He W, Zhang R, et al. Artificial intelligence for screening of multiple retinal and optic nerve diseases. JAMA Netw Open 2022; 5: e229960. doi:10.1001/jamanetworkopen.2022.9960
11 Redmon J, Farhadi A. YOLOv3: an incremental improvement[J]. 2018: arXiv:1804.02767. doi:10.48550/arXiv.1804.02767
12 Tan M, Le Q. EfficientNet: rethinking model scaling for convolutional neural networks[C]. Proceedings of the 36th International Conference on Machine Learning; 2019: 6105–14
13 Ruamviboonsuk P, Tiwari R, Sayres R, et al. Real-time diabetic retinopathy screening by deep learning in a multisite national screening programme: a prospective interventional cohort study. Lancet Digit Health 2022; 4: e235–44. doi:10.1016/S2589-7500(22)00017-6
14 Li B, Chen H, Zhang B, et al. Development and evaluation of a deep learning model for the detection of multiple fundus diseases based on colour fundus photography. Br J Ophthalmol 2022; 106: 1079–86.
15 Yang D, Sun Z, Shi J, et al. A multitask deep-learning system for assessment of diabetic macular ischemia on optical coherence tomography angiography images. Retina 2022; 42: 184–94.
16 Paul SK, Pan I, Sobol WM. A systematic review of deep learning applications for optical coherence tomography in age-related macular degeneration. Retina 2022; 42: 1417–24. doi:10.1097/IAE.0000000000003535
17 Xiong J, Li F, Song D, et al. Multimodal machine learning using visual fields and peripapillary circular OCT scans in detection of glaucomatous optic neuropathy. Ophthalmology 2022; 129: 171–80. doi:10.1016/j.ophtha.2021.07.032
18 Grauslund J. Diabetic retinopathy screening in the emerging era of artificial intelligence. Diabetologia 2022; 65: 1415–23. doi:10.1007/s00125-022-05727-0
19 Srisuriyajan P, Cheewaruangroj N, Polpinit P, et al. Cytomegalovirus retinitis screening using machine learning technology. Retina 2022; 42: 1709–15. doi:10.1097/IAE.0000000000003506
20 Crincoli E, Savastano MC, Savastano A, et al. New artificial intelligence analysis for prediction of long-term visual improvement after epiretinal membrane surgery. Retina 2023; 43: 173–81. doi:10.1097/IAE.0000000000003646
21 Lachance A, Godbout M, Antaki F, et al. Predicting visual improvement after macular hole surgery: a combined model using deep learning and clinical features. Transl Vis Sci Technol 2022; 11: 6. doi:10.1167/tvst.11.4.6
22 London A, Benhar I, Schwartz M. The retina as a window to the brain-from eye research to CNS disorders. Nat Rev Neurol 2013; 9: 44–53. doi:10.1038/nrneurol.2012.227
23 Cheung CY, Ran AR, Wang S, et al. A deep learning model for detection of alzheimer’s disease based on retinal photographs: A retrospective, multicentre case-control study. Lancet Digit Health 2022; 4: e806–15. doi:10.1016/S2589-7500(22)00169-8
24 Wong DYL, Lam MC, Ran A, et al. Artificial intelligence in retinal imaging for cardiovascular disease prediction: current trends and future directions. Curr Opin Ophthalmol 2022; 33: 440–6. doi:10.1097/ICU.0000000000000886
25 González-Gonzalo C, Thee EF, Klaver CCW, et al. Trustworthy AI: closing the gap between development and integration of AI systems in ophthalmic practice. Prog Retin Eye Res 2022; 90: 101034. doi:10.1016/j.preteyeres.2021.101034
26 Font O, Torrents-Barrena J, Royo D, et al. Validation of an autonomous artificial intelligence-based diagnostic system for holistic maculopathy screening in a routine occupational health checkup context. Graefes Arch Clin Exp Ophthalmol 2022; 260: 3255–65. doi:10.1007/s00417-022-05653-2
27 Hao S, Liu C, Li N, et al. Clinical evaluation of AI-assisted screening for diabetic retinopathy in rural areas of Midwest China. PLoS One 2022; 17: e0275983. doi:10.1371/journal.pone.0275983
28 Song P, Xia W, Wang M, et al. Variations of dry eye disease prevalence by age, sex and geographic characteristics in china: a systematic review and meta-analysis. J Glob Health 2018; 8: 020503. doi:10.7189/jogh.08.020503
29 Ma Y, Wang H, Jiang J, et al. Prevalence of and risk factors for diabetic retinopathy in residents with different types of abnormal glucose metabolism with or without hypertension: a suburban community-based cross-sectional study. Front Endocrinol (Lausanne) 2022; 13: 966619. doi:10.3389/fendo.2022.966619
30 Huang X-M, Yang B-F, Zheng W-L, et al. Cost-effectiveness of artificial intelligence screening for diabetic retinopathy in rural china. BMC Health Serv Res 2022; 22: 260. doi:10.1186/s12913-022-07655-6
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2023 Author(s) (or their employer(s)) 2023. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ. http://creativecommons.org/licenses/by-nc/4.0/ This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/ . Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
Background/aims
This study evaluates the performance of the Airdoc retinal artificial intelligence system (ARAS) for detecting multiple fundus diseases in real-world scenarios in primary healthcare settings and investigates the fundus disease spectrum based on ARAS.
Methods
This real-world, multicentre, cross-sectional study was conducted in Shanghai and Xinjiang, China. Six primary healthcare settings were included in this study. Colour fundus photographs were taken and graded by ARAS and retinal specialists. The performance of ARAS is described by its accuracy, sensitivity, specificity and positive and negative predictive values. The spectrum of fundus diseases in primary healthcare settings has also been investigated.
Results
A total of 4795 participants were included. The median age was 57.0 (IQR 39.0–66.0) years, and 3175 (66.2%) participants were female. The accuracy, specificity and negative predictive value of ARAS for detecting normal fundus and 14 retinal abnormalities were high, whereas the sensitivity and positive predictive value varied in detecting different abnormalities. The proportion of retinal drusen, pathological myopia and glaucomatous optic neuropathy was significantly higher in Shanghai than in Xinjiang. Moreover, the percentages of referable diabetic retinopathy, retinal vein occlusion and macular oedema in middle-aged and elderly people in Xinjiang were significantly higher than in Shanghai.
Conclusion
This study demonstrated the dependability of ARAS for detecting multiple retinal diseases in primary healthcare settings. Implementing the AI-assisted fundus disease screening system in primary healthcare settings might be beneficial in reducing regional disparities in medical resources. However, the ARAS algorithm must be improved to achieve better performance.
Trial registration number
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details


1 Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine; National Clinical Research Center for Eye Diseases; Key Laboratory of Ocular Fundus Diseases; Engineering Center for Visual Science and Photomedicine; Engineering Center for Precise Diagnosis and Treatment of Eye Diseases, Shanghai, China
2 Department of Ophthalmology, Shibei Hospital of Jing'an District, Shanghai, China
3 Department of Ophthalmology, Bachu County Traditional Chinese Medicine Hospital of Kashgar, Xinjiang, China
4 Department of Ophthalmology, Bachu Country People's Hospital of Kashgar, Xinjiang, China
5 Department of Ophthalmology, Linfen Community Health Service Center of Jing'an District, Shanghai, China
6 Department of Ophthalmology, Pengpu New Village Community Health Service Center of Jing'an District, Shanghai, China
7 Department of Ophthalmology, Pengpu Town Community Health Service Center of Jing'an District, Shanghai, China
8 Beijing Tongren Eye Center, Key Laboratory of Intraocular Tumor Diagnosis and Treatment, Ophthalmology & Visual Sciences Key Lab, Medical Artificial Intelligence Research and Verification Key Laboratory of the Ministry of Industry and Information Technology, Capital Medical University, Beijing, China
9 Beijing Airdoc Technology Co., Ltd, Beijing, China
10 Department of Ophthalmology, Tong Ren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
11 Bachu Country People's Hospital of Kashgar, Xinjiang, China; Shanghai No. 3 Rehabilitation Hospital, Shanghai, China