The confounded crude case-fatality rates (CFR) for COVID-19 hide more than they reveal—a comparison of age-specific and age-adjusted CFRs between seven countries

Abstract

Background

Crude case-fatality rates (CFRs) for COVID-19 vary widely between countries. There are serious limitations in the CFRs when making comparisons. We examined how the age distribution of the cases is responsible for the COVID-19 CFR differences between countries.

Methods

COVID-19 cases and deaths, by ten-year age-groups, were available from the reports of seven countries. The overall and age-specific CFRs were computed for each country. The age-adjusted CFRs were computed by the direct method, using the combined number of cases in all seven countries in each age group as the standard population. A meta-analytic approach was used to obtain pooled age-specific CFRs.

Findings

The crude overall CFRs varied between 0.82% and 14.2% in the seven countries and the variation in the age-specific CFRs were much smaller. There was wide variation in the age distribution of the cases between countries. The ratio of the crude CFR for the country with the highest CFR to that with the lowest (6.28) was much lower for the age-adjusted CFRs rates (2.57).

Conclusions

The age structure of the cases explains much of differences in the crude CFRs between countries and adjusting for age substantially reduces this variation. Other factors such as the definition of cases, coding of deaths and the standard of healthcare are likely to account for much of the residual variation. It is misleading to compare the crude COVID-19 CFRs between countries and should be avoided. At the very least, age-specific and age-adjusted CFRs should be used for comparisons.

About the Authors:

Manfred S. Green

Roles Conceptualization, Data curation, Formal analysis, Methodology, Project administration, Writing – original draft

* E-mail: [email protected]

Affiliation: School of Public Health, University of Haifa, Haifa, Israel

ORCID logo https://orcid.org/0000-0002-9753-5612

Victoria Peer

Roles Data curation, Investigation, Writing – review & editing

Affiliation: School of Public Health, University of Haifa, Haifa, Israel

ORCID logo https://orcid.org/0000-0003-1291-0928

Naama Schwartz

Roles Formal analysis, Software, Writing – review & editing

Affiliation: School of Public Health, University of Haifa, Haifa, Israel

Dorit Nitzan

Roles Conceptualization, Supervision, Writing – review & editing

Affiliation: World Health Organization, European Region, Copenhagen, Denmark

Abstract

Background

Crude case-fatality rates (CFRs) for COVID-19 vary widely between countries. There are serious limitations in the CFRs when making comparisons. We examined how the age distribution of the cases is responsible for the COVID-19 CFR differences between countries.

Methods

COVID-19 cases and deaths, by ten-year age-groups, were available from the reports of seven countries. The overall and age-specific CFRs were computed for each country. The age-adjusted CFRs were computed by the direct method, using the combined number of cases in all seven countries in each age group as the standard population. A meta-analytic approach was used to obtain pooled age-specific CFRs.

Findings

The crude overall CFRs varied between 0.82% and 14.2% in the seven countries and the variation in the age-specific CFRs were much smaller. There was wide variation in the age distribution of the cases between countries. The ratio of the crude CFR for the country with the highest CFR to that with the lowest (6.28) was much lower for the age-adjusted CFRs rates (2.57).

Conclusions

The age structure of the cases explains much of differences in the crude CFRs between countries and adjusting for age substantially reduces this variation. Other factors such as the definition of cases, coding of deaths and the standard of healthcare are likely to account for much of the residual variation. It is misleading to compare the crude COVID-19 CFRs between countries and should be avoided. At the very least, age-specific and age-adjusted CFRs should be used for comparisons.

Figures

Table 2

Fig 3

Fig 4

Table 1

Fig 1

Fig 2

Table 2

Fig 3

Fig 4

Table 1

Fig 1

Fig 2

Citation: Green MS, Peer V, Schwartz N, Nitzan D (2020) The confounded crude case-fatality rates (CFR) for COVID-19 hide more than they reveal—a comparison of age-specific and age-adjusted CFRs between seven countries. PLoS ONE 15(10): e0241031. https://doi.org/10.1371/journal.pone.0241031

Editor: Francesco Di Gennaro, National Institute for Infectious Diseases Lazzaro Spallanzani-IRCCS, ITALY

Received: July 11, 2020; Accepted: October 7, 2020; Published: October 21, 2020

Copyright: © 2020 Green et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: The data underlying the results presented in the study are available from Table 1 (all raw data are included)

Funding: The authors received no funding for this study.

Competing interests: We declare no competing interests.

Background

Human infections caused by the novel coronavirus SARS-2-CoV 2019 were first identified in Wuhan in China in early December 2019. On January 30, 2020, the World Health Organization (WHO) reported the spread of the disease a Public Health Emergency of International Concern (PHEIC) [1]. On March 11, 2020, WHO declared COVID-19 as a pandemic. By October, 2020, almost all countries had been affected, and globally there were reports of more than 37 million cases and more than a million deaths. Early estimates indicated that the average proportion of deaths among the diagnosed cases, defined as the case-fatality rate (CFR), was around 2.3% [2]. However, subsequently, the reported crude COVID-19 CFRs varied widely between countries [3, 4]. The limitations of comparing crude CFRs in general, has been evaluated previously [5]. The strong positive association between the COVID-19 CFR and age has been demonstrated both in observational studies [6] and in a model-based analysis [7], particularly over the age of 40.

The interpretation of the CFR depends on the context in which it is used. In a single cohort of patients, it can indicate the severity of the disease at a single point in time. It can also be used to assess trends in the impact of changes in health care over time. In the current context of the COVID-19 pandemic, CFRs are commonly compared between countries and that may lead to speculation on differences in healthcare. For example, it may be concluded that the CFRs somehow reflect the successes and failures of the different countries in the treatment of serious cases. In general a number of factors could impact on the both the numerator and denominator of the CFR. This is especially important for the CFR for COVID-19. There could be misclassification of causes of death and there are likely to be variations in the definition of cases in the denominator. Substantial confounding by age could impact on CFR comparisons between different groups. A related concept is the infection fatality rate (IFR) which includes asymptomatic cases in the denominator, which need to be identified by screening tests. Since the IFR is rarely available for COVID-19, in this paper we consider only the CFR. In this paper, we examined the contribution of the age distribution of the cases when comparing the COVID-19 CFRs between seven countries, with widely varying CFRs.

Methods

We studied published crude and age-specific CFRs in cohorts of cases of COVID-19 in seven countries, with varying periods of follow-up. The countries chosen were based on the accessibility of the data. The first case COVID-19 in Israel was confirmed on 21 February 2020. The first case in South Korea was announced on 20 January 2020.The COVID-19 spread from Hubei Province, China, after December 2019.SARS-CoV-2 was confirmed to have reached Spain, Sweden, Italy, and Canada on end of January 2020. The data on cases and deaths by age group were available from China on February 11, 2020. For South Korea cases and deaths were updated to the end of April. For Spain, the cases and deaths were updated to mid-May 2020.The information for Israel, Italy, Canada and Sweden were updated during August 2020. The data for each country were not necessarily updated to the time of the study, and the CFR’s may have changed over time. Age-specific data on the cases and deaths by ten-year age groups (0–9, 10–19, …..80+), were available for seven countries: Italy [8], Spain [9], Sweden [10], China [11], S Korea [12], Israel (Ministry of Health, personal communication) and Canada [13]. The outcome variable was defined as the crude CFR defined as the number of deaths divided by the number of reported cases. The exposure variable was the individual country. Age-group was considered as a confounding variable. Age-adjustment was carried by the direct method, using the distribution of the combined cases of all six countries by age group as the standard population. 95% confidence intervals were computed for each age-adjusted rate using WinPepi [Version 11.65, Aug, 2016].

Ethical considerations

Open access aggregative and anonymous data were used and there was no need for ethics committee approval.

Results

The age-specific number of cases, number of deaths and the crude CFRs by country are given in Table 1. The distributions of the cases vary markedly between the countries. For example, Israel and South Korea are heavily weighted in the 20–39 age group, China has a more balanced distribution and Italy, Sweden and Canada are heavily weighted in the over 70 age groups.

[Figure omitted. See PDF.]

Table 1. Deaths/cases of COVID-19 and CFRs (%) by age group, for seven countries.

https://doi.org/10.1371/journal.pone.0241031.t001

The distributions of the cases for each country are shown in Fig 1. It is clear that distributions vary widely and are not necessarily related to the age distribution of the population of the country. For example, for South Korea, there is a relatively large number of cases in the age group 20–29, due to an outbreak affecting that age group in particular.

[Figure omitted. See PDF.]

Fig 1. Distribution of cases (%) by age for seven countries–China, Italy, S Korea, Spain, Israel, Sweden, and Canada.

https://doi.org/10.1371/journal.pone.0241031.g001

The age-specific CFRs are shown in Fig 2. While there are differences in the age-specific CFRs between countries, the trend of steeply increasing CFRs in the oldest age groups is evident. Age groups 0–9 and 10–19 were excluded from the figure, since there were almost no deaths.

[Figure omitted. See PDF.]

Fig 2. Age specific case-fatality rates (%) for seven countries–China, Italy, S Korea, Spain, Israel, Sweden, and Canada.

https://doi.org/10.1371/journal.pone.0241031.g002

The crude (%) and age-adjusted CFRs (%) are compared in Table 2. The crude CFRs varied from 0.82% for Israel to 14.20% for Italy and the ratios of the crude CFRs compared with lowest CFR, varied between 0.36 and 6.28. The age-adjusted CFRs varied between 4.20% for China to 10.80% for Italy and the ratios of the age-adjusted CFRs for each country compared with the lowest CFR adjusted varied between 1.00 and 2.57.

[Figure omitted. See PDF.]

Table 2. Crude and age standardized (95%CI) case-fatality rates (CFR,%) for COVID-19 in seven countries.

https://doi.org/10.1371/journal.pone.0241031.t002

Fig 3 shows graphically the marked reduction in the differences between the crude (%) and age-adjusted CFRs (%) for the seven countries.

[Figure omitted. See PDF.]

Fig 3. Crude (%) and age-adjusted case-fatality rates (%) by country for seven countries.

https://doi.org/10.1371/journal.pone.0241031.g003

Meta-analyses by age group

We used meta-analytic methods to obtain weighted pooled estimates of the CFR’s by age group. The results of the meta-analysis are presented in the forest plot in Fig 4, which shows the CFRs by age group and country and the pooled CFR’s for each age group (results are shown start at age 20, since there so few deaths in the age group under 20). There was considerable variation in the CFR’s by country within each age group, but the trends by age were very similar, increasing steeply after age 60. The pooled CFR’s were 0.07% in the age group 20–29, 0.17% for 30–39, 0.41% for 40–49, 1.27 for 50–59, 4.77% for 60–69, 15% for 70–79 and 26.92% for 80+. The meta-regression showed that the age groups contributed most of the differences in the CFRs (p<0.001).

[Figure omitted. See PDF.]

Fig 4. Forest plot of case-fatality rates (CFR %) by age group and country.

https://doi.org/10.1371/journal.pone.0241031.g004

Discussion

In our study, we examined crude, age-specific and age-adjusted CFRs for COVID-19 in seven countries, with widely varying crude CFRs. The trends in the age-specific CFRs were remarkably similar in the seven countries, with the CFR’s increasing steeply in those over 70. After adjusting for age, the marked differences in the crude CFRs were substantially reduced. These findings demonstrate the importance of accounting for age when comparing rates in general and CFRs in particular. The results of this study are strengthened by the use of national data or large datasets from a number of countries, with considerable differences in the extent of the pandemic in each country. It should be stressed that the age distribution of the cases was used to compute the age-adjusted CFRs and not the age distribution of the total population in each country.

In addition to the age distribution of the cases, the use of the CFR for comparisons between countries has other important limitations. Selection bias is clearly present when calculating the denominator on the basis of reported cases. As mentioned, the CFR must be distinguished from the IFR, which includes asymptomatic cases identified by deliberate or incidental screening with diagnostic tests. In addition, if only those with more severe symptoms are tested this will affect the denominator of the CFR and will depend on the testing strategy of each country. If more mild cases are identified, this is likely to reduce the CFR. there is a lag time between the reporting of the case and the death which can occur up to weeks later. In the country reports, cases and deaths are usually reported at the same time, so the cases in the denominator are usually an overestimate of the true denominator which should be the number of cases reported sometime earlier [14, 15]. This will have a more dramatic effect when the number of cases are rising rapidly. Selection bias may also affect the numerator if only deaths occurring in hospital are reported. Information bias can be present in both the numerator and denominator of the CFR. The definition of the cases may be biased due to the variability of the sensitivity and specificity of the diagnostic tests for COVID-19. Information bias in the numerator can occur when the cause of death is coded. This could be particularly problematic in elderly people with multiple co-morbidities.

The purpose of this paper is to demonstrate the dramatic effect of confounding by the age distribution of the cases when using crude overall CFRs for country comparisons. This was shown in an earlier paper when comparing six countries, and we have extended it to a comparison of seven countries with widely different CFRs. The age structures of the population of the seven countries used in this study vary markedly. The percentage of the population age 65 and over is 12% in Israel, 23% in Italy 23%, 9.3% in S Korea, 19.6% in Spain, 20% in Sweden, 11% in China and 17.6% in Canada [16]. However, the main impact of confounding by age was due to the differences in the age distribution of the cases. This was largely due to the specific circumstances of exposure. For example, most of the cases in Italy occurred in an area of a particularly old population [3]. In some countries, many of the cases were medical personnel, a large number of whom were relatively young women [17]. In South Korea, a large percentage of the cases were young women associated with a specific religious group [18]. In Germany, many of the cases were relatively young people returning from skiing holidays in Austria and Italy [19]. In Israel, the largest outbreaks occurred in the ultra-orthodox Jewish community, where the number of children per family is much higher than in the general population. Other factors affecting the age distribution of the cases, depended on the frequency of outbreaks in homes for the elderly [20].

The results of this study once again demonstrate the pitfalls of comparing unadjusted rates. The assumption that differences between countries in testing policies or standard of treatment accounted for the wide discrepancies in CFRs, is not well-founded. This does not mean that there are no differences. For example, it is possible that where the health services were overloaded, younger patients were more likely to be admitted to intensive care units with better chances of survival. Clearly, the data are incomplete and other factors affecting CFRs such as case definitions, use of different denominators, underlying health conditions and the standard of health services are likely to play important roles. In order to assess the impact of these factors, age-specific and age-adjusted CFRs must be used.

Conclusions

In addition to the selection and information biases inherent in computing CFRs, the age structure of the cases dramatically impacts on the differences in the crude CFRs between countries. Failure to account for this source of confounding markedly distorts the country comparisons. The substantial reduction in the differences in the age-adjusted CFRs suggest that differences in the standard of healthcare between these countries may not play as important a role in affecting the death rates, as some have hypothesized. Crude COVID-19 CFRs have no real use for between country comparisons and should be avoided. In general, for comparisons between groups and countries, age-adjusted CFRs can be used, but age-specific COVID-19 CFRs are generally far more meaningful.

Acknowledgments

We express our appreciation to the official institutions of all countries for the providing their data on Covid-19.

Citation: Green MS, Peer V, Schwartz N, Nitzan D (2020) The confounded crude case-fatality rates (CFR) for COVID-19 hide more than they reveal—a comparison of age-specific and age-adjusted CFRs between seven countries. PLoS ONE 15(10): e0241031. https://doi.org/10.1371/journal.pone.0241031

References

1. WHO: Available at: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/events-as-they-happen. Accessed on1 May 2020.

2. Porcheddu R, Serra C, Kelvin D, Kelvin N, Rubino S. Similarity in case fatality rates (CFR) of COVID-19/SARS-COV-2 in Italy and China. J Infect Dev Ctries 2020;14: 125–128 pmid:32146445

3. Onder G, Rezza G, Brusaferro S. Case-fatality rate and characteristics of patients dying in relation to COVID-19 in Italy. JAMA 2020 Mar 23. Online ahead of print. pmid:32203977

4. Yang S, Cao P, Du P, Wu Z, Zhuang Z, Yang L, et al. Early estimation of the case fatality rate of COVID-19 in mainland China: a data-driven analysis. Ann Transl Med. 2020;8:128. pmid:32175421

5. Lipsitch M, Donnelly CA, Fraser C, Blake IM, Cori A, Dorigatti I, et al. Potential biases in estimating absolute and relative case-fatality risks during outbreaks. PLoS Negl Trop Dis 2015;9:e0003846. eCollection 2015. pmid:26181387

6. Mahase E. Covid-19: death rate is 0.66% and increases with age, study estimates. BMJ 2020;369:m1327. pmid:32238354

7. Verity R, Okell LC, Dorigatti I, Winskill P, Whittaker C, Imai N, et al. Estimates of the severity of coronavirus disease 2019: a model-based analysis. Lancet Infect Dis 2020;20:669–677. pmid:32240634

8. Epidemia COVID-19. Aggiornamento nazionale. 6 aprile 2020. Available at: https://www.epicentro.iss.it/coronavirus/bollettino/Bollettino-sorveglianza-integrata-COVID-19_6-aprile-2020.pdf. Accessed on 25 April 2020.

9. Centro de Coordinación de Alertas y Emergencias Sanitarias. Available at: https://www.mscbs.gob.es/profesionales/saludPublica/ccayes/alertasActual/nCov-China/documentos/Actualizacion_88_COVID-19.pdf. Accessed on 1 May 2020.

10. Statista. Available at: https://www.statista.com/topics/6267/coronavirus-covid-19-in-sweden/. Accessed on 20 April 2020.

11. China CDC (Chinese Center for Disease Control and Prevention). The Epidemiological Characteristics of an Outbreak of 2019 Novel Coronavirus Diseases (COVID-19)—China, 2020. The Novel Coronavirus Pneumonia Emergency Response Epidemiology Team. CCDC Weekly;2, 2020.

12. Korea Centers for Disease Control (CDC). Available at: https://www.cdc.go.kr/board/board.es?mid = a30501000000&bid = 0031&list_no = 367045&act = view. Accessed on 20 April 2020

13. "Coronavirus disease 2019 (COVID-19): Epidemiology update". Public Health Agency of Canada. https://health-infobase.canada.ca/covid-19/epidemiological-summary-covid-19-cases.html. Accessed on August 24, 2020.

14. Baud D, Qi X, Nielsen-Saines K, Musso D, Pomar L, Favre G. Real estimates of mortality following COVID-19 infection. Lancet Infect Dis 2020;20: 773.

15. Lipsitch M. Estimating case fatality rates of COVID-19. Lancet Infect Dis 2020;20: 775.

16. World Population Ageing 2019. United Nations. Dept. of Social and Economic Affairs. https://www.un.org/en/development/desa/population/publications/pdf/ageing/WorldPopulationAgeing2019-Highlights.pdf. Accessed on July 2, 2020.

17. Kang L, Ma S, Chen M, Yang J, Wang Y, Li R, et al. Impact on mental health and perceptions of psychological care among medical and nursing staff in Wuhan during the 2019 novel coronavirus disease outbreak: A cross-sectional study. Brain Behav Immun 2020. pii: S0889-1591(20)30348-2.

18. Korean Society of Infectious Diseases; Korean Society of Pediatric Infectious Diseases; Korean Society of Epidemiology; Korean Society for Antimicrobial Therapy; Korean Society for Healthcare-associated Infection Control and Prevention; Korea Centers for Disease Control and Prevention. Report on the epidemiological features of coronavirus disease 2019 (COVID-19) outbreak in the Republic of Korea from January 19 to March 2, 2020. J Korean Med Sci. 2020;35(10):e112. pmid:32174069

19. A German Exception? Why the Country’s Coronavirus Death Rate Is Low. New York Times, Published April 4, 2020, updated April 6, 2020.

20. Available at: https://www.euronews.com/2020/04/20/coronavirus-and-the-elderly-what-s-life-inside-a-french-retirement-home-amid-covid-19-pand.