Development of a predictive model of hospitalization in primary care patients with heart failure

Abstract

Background

Heart failure (HF) is the leading cause of hospitalization in people over age 65. Predictive hospital admission models have been developed to help reduce the number of these patients.

Aim

To develop and internally validate a model to predict hospital admission in one-year for any non-programmed cause in heart failure patients receiving primary care treatment.

Design and setting

Cohort study, prospective. Patients treated in family medicine clinics.

Methods

Logistic regression analysis was used to estimate the association between the predictors and the outcome, i.e. unplanned hospitalization over a 12-month period. The predictive model was built in several steps. The initial examination included a set of 31 predictors. Bootstrapping was used for internal validation.

Results

The study included 251 patients, 64 (25.5%) of whom were admitted to hospital for some unplanned cause over the 12 months following their date of inclusion in the study. Four predictive variables of hospitalization were identified: NYHA class III-IV, OR (95% CI) 2.46 (1.23–4.91); diabetes OR (95% CI) 1.94 (1.05–3.58); COPD OR (95% CI) 3.17 (1.45–6.94); MLHFQ Emotional OR (95% CI) 1.07 (1.02–1.12). AUC 0.723; R2N 0.17; Hosmer-Lemeshow 0.815. Internal validation AUC 0.706.; R2N 0.134

Conclusion

This is a simple model to predict hospitalization over a 12-month period based on four variables: NYHA functional class, diabetes, COPD and the emotional dimension of the MLHFQ scale. It has an acceptable discriminative capacity enabling the identification of patients at risk of hospitalization.

About the Authors:

Luis García-Olmos

Roles Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

* E-mail: [email protected]

Affiliations Multiprofessional Education Unit for Family and Community Care (South-east), Madrid, Spain, Health Service Research Network for Chronic Diseases (Red de Investigación en Servicios de Salud en Enfermedades Crónicas/REDISSEC), Madrid, Spain

ORCID logo http://orcid.org/0000-0002-2621-9161

Río Aguilar

Roles Conceptualization, Investigation, Resources, Validation, Writing – review & editing

Affiliation: Cardiology Department, La Princesa University Teaching Hospital, Madrid, Spain

ORCID logo http://orcid.org/0000-0002-6731-0156

David Lora

Roles Data curation, Formal analysis, Methodology, Validation, Writing – original draft, Writing – review & editing

Affiliation: Clinical Research Unit (imas12-CIBERESP), Hospital Universitario 12 de Octubre, Madrid, Spain

ORCID logo http://orcid.org/0000-0002-3317-5689

Montse Carmona

Roles Investigation, Project administration, Supervision, Validation, Writing – review & editing

Affiliations Health Service Research Network for Chronic Diseases (Red de Investigación en Servicios de Salud en Enfermedades Crónicas/REDISSEC), Madrid, Spain, Agency for Health Technology Assessment, Carlos III Institute of Health (Instituto de Salud Carlos III/ISCIII), Madrid, Spain

ORCID logo http://orcid.org/0000-0002-4680-7745

Angel Alberquilla

Roles Conceptualization, Data curation, Formal analysis, Methodology, Resources, Validation, Writing – review & editing

Affiliations Health Service Research Network for Chronic Diseases (Red de Investigación en Servicios de Salud en Enfermedades Crónicas/REDISSEC), Madrid, Spain, Multiprofessional Education Unit for Family and Community Care (Centre), Madrid, Spain

Rebeca García-Caballero

Roles Conceptualization, Validation, Visualization, Writing – original draft, Writing – review & editing

Affiliation: Internal Medicine Department Infanta Sofía University Teaching Hospital, Madrid, Spain

Luis Sánchez-Gómez

Roles Conceptualization, Methodology, Resources, Validation, Writing – review & editing

Affiliations Health Service Research Network for Chronic Diseases (Red de Investigación en Servicios de Salud en Enfermedades Crónicas/REDISSEC), Madrid, Spain, Agency for Health Technology Assessment, Carlos III Institute of Health (Instituto de Salud Carlos III/ISCIII), Madrid, Spain

the CHIC Group

¶Membership of the CHIC Group is provided in the Acknowledgments.

Introduction

Heart failure (HF) is a chronic clinical syndrome that affects more than 2% of the population. The number of HF patients is expected to rise significantly in coming years [1]. These patients have a high mortality rate and hospitalization is frequent.

Hospital admission rates for HF patients have been consistently high in recent decades. HF is the number one cause of hospital admission for patients over 65. Care of HF patients consumes 2% of the health budget and over 70% of the expense is due to the hospital care received by these patients [2].

Predictive models to identify risk factors for hospital readmission have been developed to prevent the re-hospitalization of these patients [3–6]. These studies have become more frequent over the last 10 years and are most prevalent in the United States, some featuring data from clinical trials, others using data from administrative databases and most focusing on hospital populations, including patients who have been hospitalized for HF.

The patients included in clinical trials are different from HF patients in the community [7]. While in the community, more than 80% of HF patients fall into NYHA functional class I-II, but patients in functional class III-IV are included in clinical trials. Omissions and registration errors are frequent in studies that use administrative databases.

Different types of factors have been studied as possible causes of hospitalization: sociodemographic, clinical, psychosocial and health system. A high number of risk factors for the hospitalization have been identified [8] but results are inconsistent. Clinical variables have been the focus of most studies but in the case of hospitalization they have a low—mild explanatory capacity. The discrimination capacity, measured by the C-statistic, is in the 0.6 to 0.8 range.

Most studies use 30 days as the reference period for rehospitalization, some have a 180-day reference period and only a few seek to predict hospitalization within a year’s time. HF rehospitalization studies with short periods such as 30 days, mainly analyse the quality of hospital care received by HF patients, while studies with rehospitalization reference periods of one year assess continuity of care and the complete healthcare process.

Most studies analyse readmissions related to HF. However, in population studies, HF-related hospitalization only accounts for 16.5% of the cases; 21% are due to other cardiovascular diseases, and in more than 60% of the cases they are due to non-cardiovascular causes [9].

Considering that HF patients are complex and have a high comorbidity rate [10], an analysis of hospital admissions for all causes over a long period can help to understand the role played by comorbidity and the entire healthcare process, including continuity, in the admission rates of these patients.

The aim of this study is to develop and internally validate a predictive model for hospital admission in a year’s time for any non-programmed cause, in patients with heart failure receiving primary care.

Methods

This is part of a broader study whose methodology has been previously described [11]. This is a prospective cohort study conducted in two cities of the Community of Madrid which together have a population of 132 851. The study includes all patients over 18 diagnosed with HF, treated at the seven health centres that exist in the two municipalities.

Inclusion criteria

1) patients who meet the Framingham criteria for HF diagnosis; 2) left ventricular ejection fraction (LVEF) less than 50% or significant structural lesion and/or diastolic dysfunction; patients who met the Framingham criteria and who had an echocardiographic study performed in the six months prior to inclusion were also included, and 3) informed consent of the patient to participate in the study.

Exclusion criteria

1) institutionalized patients; 2) patients with a terminal illness other than HF; and 3) patients with a life expectancy of under 6 months.

Determinations

a) Dependent variable: Unplanned hospitalization in the 12 months following inclusion in the study; b) Predictive variables: 1) disability, measured using version 2 of the 36-item World Health Organization Disability Assessment questionnaire (WHODAS-2) [12], obtaining a global score and a score in each of the six domains covered by the questionnaire: understanding and communication (UCA), getting around (GAR), self-care (SCA), getting along with people (GAP), life activities (LAC), and participation in society (PSO); 2) quality of life, measured by the Minnesota Living with Heart Failure Questionnaire (MLHFQ), obtaining a global score and a score in each of the two domains included in the questionnaire: physical and emotional [13]; 3) In addition to the questionnaire scores, the following variables were also analysed: age, sex, marital status, living alone, work situation, educational level, NYHA functional status, left ventricular ejection fraction (LVEF), amount of time since heart failure was first diagnosed, body mass index (BMI), blood pressure, use of drugs, comorbidity and hospitalization for any unplanned reason in the year prior to inclusion.

For the purposes of the multivariate analysis, WHODAS-2 scores were recoded into two categories: mild / moderate disability v. severe / extreme disability. NYHA functional class was recoded into two categories: class I-II and class III-IV. Educational level was divided into two categories: low (compulsory education, up to age 16) and medium / high (vocational training and university studies).

The initial evaluation consisted of a consultation with the physician and another with the nurse. In the visit with the general practitioner: the GP verified whether patients had an ECHO performed in the previous six months, assessed their baseline situation, checked inclusion and exclusion criteria, Framingham criteria, NYHA functional class and drug treatment; an echocardiogram and proBNP determination were also requested, where necessary. Nursing staff assessed patients’ functional status (WHODAS-2) and quality of life (MLHFQ)

To establish predictive models based initially on 31 variables (not all included in the final model), a sample of 250 patients was considered sufficient, with an estimated hospitalization rate of 24% in the first 12 months [14,15].

Development phase of the predictive model

Logistic regression analysis was used to estimate the correlation between predictors and outcome, unplanned hospitalization in 12 months. The predictive model was built in several steps. 1) The initial examination included a set of 31 predictors (Table 1). The relationship between a predictor and admission to hospital was estimated using a crude odds ratio, area under a receiver operating characteristic (AUROC) curve and R2. 2) The full model with 31 predictors was developed using penalized maximum likelihood estimation to directly correct the model for over-optimism. It was further simplified by decreasing the number of predictors based on recommendations found in the literature [16]. Interaction analysis was performed but no significant interaction was found. 3) Discrimination of this final model was quantified via an AUROC curve. Discrimination describes the ability of the prognostic model to distinguish patients with the outcome from those without the outcome. Predictive ability was determined using Nagelkerke's R2 and the Brier score index. Nagelkerke’s R2 is the amount of variability in outcomes that is explained by the prediction model while the Brier score is a performance measurement quantifying the gap between observed and predicted outcome. Lastly, calibration was tested with the Hosmer-Lemeshow test for goodness of fit. Statistical analyses were performed using the R Regression Modeling Strategies package version 3.6–3.

[Figure omitted. See PDF.]

Table 1. Description of predictor variables.

https://doi.org/10.1371/journal.pone.0221434.t001

Internal validation phase

Internal validation was evaluated using the bootstrapping technique, simulating 1 000 samples with 251 subjects similar to the original sample. The predictive ability of the model was evaluated internally based on discrimination (AUROC curve), measures of overall performance (Nagelkerke's R2 and the Brier score index) and calibration [17]. Calibration of the model was assessed graphically and estimated with the calibration intercept and slope. In case of a perfect fit between the model and the data, the calibration intercept is equal to 0 and slope is equal to 1.

The study was approved by the Clinical Research Ethics Committee of La Princesa University Teaching Hospital, and informed consent in writing was obtained from all patients before being enrolled.

Results

The performance measures of predictive model used to establish the validity and utility were AUROC curve, Nagelkerke's R2 and the Brier score index. Robustness of performance measures of modes were evaluated using internal validation using bootstrap method.

278 patients were recruited, 27 of whom were excluded for the following reasons: 21 because after consulting the physician they left without meeting with the nurse, 1 due to CRD registration errors and 5 patients because at the time of this analysis, 12 months had not yet gone by since the date of their inclusion. The excluded patients were similar to those analysed in terms of age, sex, and NYHA functional class.

Of the 251 patients included in the study, 64 (25.5%) were admitted to hospital for some unplanned reason in the 12 months following the date of inclusion. The baseline characteristics of these patients are shown in Table 1. The mean age was 74.86 ± 9.97, 55.4% were women, 20.3% of the patients were in NYHA functional class III-IV and the mean LVEF was 58.04 ± 12.35.

Table 2 shows the results of the univariate analysis of the predictor variables included in the study. The effect is expressed in terms of OR, with its confidence intervals and explanatory participation in the occurrence of the event, expressed by the R2N and in the discriminative capacity, expressed by the AUC. NYHA functional class, diabetes, COPD, LVEF, and the variables that measure quality of life and disability are the ones found to have a statistically significant effect on hospitalization.

[Figure omitted. See PDF.]

Table 2. Univariate analysis.

https://doi.org/10.1371/journal.pone.0221434.t002

The final multivariate model is presented in Tables 3 and 4 with an evaluation of performance in the development sample and in the internal validation process. The final model consists of four variables to predict the risk of hospitalization in 12 months: being in NYHA functional class III-IV, having diabetes, having COPD and the MLHFQ (quality of life questionnaire) emotional dimension score. A combination of the variables was used to determine predicted probability according to the formula (1/(1 + exp(-1*(-2.2647 + 0.8996*(NYHA_Cat2-1) + 1.1547*COPD+ 0.0697*MLHFQ_Emotional + 0.6632*DIABETES)))). The model exhibited moderate discrimination capacity, AUC 0.723, with a Hosmer-Lemeshow test p-value of 0.815 and event variance explanatory capacity of 17%. Discrimination and calibration were maintained in the internal validation process (Table 4).

[Figure omitted. See PDF.]

Table 3. Final multivariate model.

https://doi.org/10.1371/journal.pone.0221434.t003

[Figure omitted. See PDF.]

Table 4. Performance measurements.

https://doi.org/10.1371/journal.pone.0221434.t004

Based on the model developed (Table 3) to estimate the risk of hospitalization at 12 months, an easy-to-use clinical prediction rule was constructed by assigning points to the coefficients. Thus, for a patient with NYHA III-IV, with COPD, Emotional MLHFQ score of 3, who does not have DIABETES would be assigned a total of 4 points, values obtained from Table 5 (3 for NYHA III-IV, 0 for COPD, 1 for MLHFQ_Emotional and 0 for DIABETES) and a hospital admission probability of 30.24% (Table 6). Using the formula described above, a predicted probability of 23.93% is obtained.

[Figure omitted. See PDF.]

Table 5. Assignment of scores in the final model.

https://doi.org/10.1371/journal.pone.0221434.t005

[Figure omitted. See PDF.]

Table 6. Risk associated with point totals.

https://doi.org/10.1371/journal.pone.0221434.t006

Discussion

In our cohort of 251 HF patients, 64 were admitted for unplanned causes in a period of 12 months after inclusion in the study. 20.3% were patients who are in stage III-IV of the NYHA functional classification and with a mean LVEF of 58%. We started with a model that considers socio-demographic, clinical, functional capacity and quality of life variables as predictive factors. Four variables: NYHA functional class, diabetes, COPD and the MLHFQ emotional dimension score, were included in the final model to predict risk of hospitalization; three of these variables are part of the clinical information collected on a regular basis from the medical records of HF patients and quality of life; functional capacity is necessary given the impact of HF on these health dimensions [18]. Analysis of hospitalization over a 12-month period for any unplanned cause enables us to begin to assess the quality of hospital care and also to coordinate and provide ongoing care for these patients.

A large number of HF patient hospitalizations can be avoided [19]; identifying hospitalization risk factors can help reduce that number. The model we present has an acceptable discrimination capacity. However, its explanatory capacity of hospitalization variance is low, indicating that other relevant variables have been left out of the model. In general, models developed to predict HF patient hospitalization and mortality have been less accurate in predicting hospitalization. Hospitalization is more difficult to predict because it is an event that, in addition to being determined by the patient's clinical situation, depends on the characteristics of the healthcare system and the patient's support capacity.

In our study, 39.8% of patients have diabetes. HF and diabetes share some of the same physiopathological mechanisms [20]. The association of HF and diabetes increases the risk of hospitalization and death, compared to HF patients without diabetes [21]. Recommendations and CPGs have recently been published for the treatment of HF patients and diabetes [22,23].

COPD is a common comorbidity in HF patients in our case and in other studies; 14% of patients have COPD. In our study, COPD increased the risk of hospital admission three-fold. COPD in HF patients is associated with higher comorbidity [24], increases the number family doctor visits [25], and increases the risk of hospitalization and death in these patients [26,27]. Despite the peculiarities involved in the therapeutic management of these patients, neither the ESC’s clinical practice guidelines for HF patients nor the GOLD guidelines contemplate management of this comorbidity in depth [28].

HF Patients are seriously limited in terms of their functional capacity and quality of life, which is why experts recommend including quality of life and functional capacity as endpoints in studies with HF patients [29]. In our study, 17% of patients have a severe/extreme global disability, measured with WHODAS 2; in some domains, such as ADL, severe/extreme disability reaches 40%.

Disability has been identified as a predictor of mortality and hospital admission in elderly patients [30,31], in patients with complex ailments such as HF, these types of variables have greater predictive capacity for hospitalization than comorbidity [32]. However, the effect of disability has been less studied as a risk factor for hospital admission [31]. In our case, the limitation to perform the ADLs was a predictor of hospital admission in the univariate analysis, but the effect disappeared in the multivariate analysis.

Our study demonstrates an association between the emotional dimension of MLHFQ and hospital admission. Depression is a common mental disorder in HF patients that may explain the association found [33].

The study has limitations in terms of external validity. Since patients were recruited from family medical clinics, most were clinically stabilized HF patients with preserved ejection fraction (HFpEF) and low NYHA functional class, resulting in a unique sample.

The proposed model was validated internally but should be subjected to an external validation process in order to generalize the results.

We have not included biochemical or haematological parameters, some such as blood urea nitrogen has been shown as a relevant predictor of hospitalization in HF patients and its exclusion may have reduced the explanatory power of the model developed [4]. Patients' clinical situation determined hospitalization, but the characteristics of the health system and the hospital's admission policy were also relevant factors that were not considered in this study.

In conclusion, we have developed a simple 12-month predictive hospitalization model based on four variables: NYHA functional class, diabetes, COPD and the emotional dimension of the MLHFQ scale, that has an acceptable discriminative capacity but that should be validated externally.

Supporting information

[Figure omitted. See PDF.]

S1 File. Database for statistical analysis is available as supporting file.

https://doi.org/10.1371/journal.pone.0221434.s001

(ZIP)

Acknowledgments

List of CHIC GROUP collaborators

Francisco Rodríguez Salvanés, Subdirectorate for Infrastructures and Technology Assessment, Regional Health Authority, Madrid, Spain; Sofía Garrido Elustondo, Multiprofessional Education Unit for Family and Community Care (South-east), Spain; Health Service Research Network for Chronic Diseases (Red de Investigación en Servicios de Salud en Enfermedades Crónicas/REDISSEC), Madrid, Spain; Maurice Batlle, Cardiology Department, Henares University Teaching Hospital, Coslada, Madrid, Spain; Carlos Porro, Cardiology Department, Henares University Teaching Hospital, Coslada, Madrid, Spain; Cristina Gutiérrez Humanes, El Puerto Health Centre, Coslada, Madrid, Spain; Elena Monge, Ciudad San Pablo Health Centre, Coslada, Madrid, Spain; Ana Belén López Rodríguez, Jaime Vera Health Centre, Coslada. Madrid, Spain; Luis Benito, San Fernando Health Centre, San Fernando de Henares, Madrid, Spain; Nicolás Baños, Ciudad San Pablo Health Centre, Coslada, Madrid, Spain; Amaya Simón, Los Alperchines Health Centre, San Fernando de Henares, Madrid, Spain; Miguel Ángel Martínez Álvarez, Los Alperchines Health Centre, San Fernando de Henares, Madrid, Spain; Cristina García Benito, El Puerto Health Centre, Coslada, Madrid, Spain; Mª Angeles Velilla Celma, Los Alperchines Health Centre, San Fernando de Henares, Madrid, Spain; Marisol Blesa Mayordomo, Doctor Tamames Health Centre, Coslada, Madrid, Spain; Isabel Pedraz García, Doctor Tamames Health Centre, Coslada, Madrid, Spain; David García Gutiérrez, El Puerto Health Centre, Coslada, Madrid, Spain; Ángel Serrano Vázquez, El Puerto Health Centre, Coslada, Madrid, Spain; María José Jarabo Sánchez, Doctor Tamames Health Centre, Coslada, Madrid, Spain; Esperanza Sánchez Rodríguez, Jaime Vera Health Centre, Coslada, Madrid, Spain; Pilar Aller Martín, Los Alperchines Health Centre, San Fernando de Henares, Madrid, Spain; Genoveva Delgado Pinto, El Puerto Health Centre, Coslada, Madrid, Spain; Amparo Martín Sanz, El Puerto Health Centre, Coslada, Madrid, Spain; Rosario Chantal Costero, Doctor Tamames Health Centre, Coslada, Madrid, Spain; Eva Sevillano Fuentes, Valleaguado Health Centre, Coslada, Madrid, Spain; Belén Núñez Portela, El Puerto Health Centre, Coslada, Madrid, Spain; Mercedes Oliva Recio, El Puerto Health Centre, Coslada, Madrid, Spain; Remedios Ureña Llacer, Doctor Tamames Health Centre, Coslada, Madrid, Spain.

Citation: García-Olmos L, Aguilar R, Lora D, Carmona M, Alberquilla A, García-Caballero R, et al. (2019) Development of a predictive model of hospitalization in primary care patients with heart failure. PLoS ONE 14(8): e0221434. https://doi.org/10.1371/journal.pone.0221434

References

1. Conrad N, Judge A, Trann J, Mohseni H, Hedgecott D, Pérez Crespillo A, et al. Temporal trends and patterns in heart failure incidence: a population-based study of 4 million individuals. Lancet. 2018; 391: 572–80. pmid:29174292

2. Oliva J, Jorgensen N, Rodríguez JM. Carga scioeconómica de la insuficiencia cardiaca: revisión de los estudios de coste de la enfermedad. PharmacoEconomics Spanish research articles. 2010; 7: 68–79

3. Rahimi K, Bennet D, Conrad N, Williams TM, Basu J, Dwight J, et al. Risk prediction in patients with heart failure. A systematic review. J Am Coll Cardiol HF. 2014; 2: 440–6.

4. Ouwerkerk W, Voors AA, Zwinderma AH. Factors influencing the predictive power of models for predicting mortality and / or heart failure hospitlization in patients with heart failure. J Am Coll Cardiol HF. 2014; 2: 429–36.

5. O’Connor M, Murtangh C, Shah S, Barrón Vaya Y, Bowles KH, Peng TR, et al. Patient characteristics predicting readmission among individuals hospitalized for heart failure. Med Care Res Rev. 2016; 73: 3–40. pmid:26180045

6. Mahajan SM, Heindereich P, Abbott B, Newton A, Ward D. Predictive models for identifiying risk of readmission after index hospitalization for heart failure. A systematic review. Eur J Cardiovasc Nurs. 2018; 17: 675–689. pmid:30189748

7. Gollop ND, Ford J, Macketh P, Thurlow C, Wakelin R, Fleetcorft R. Are patients in heart failure trials representative of primary care populations? A systematic review. BJGP Open. 2018; 2(1). pmid:30564701

8. Giamouzis G, Kalogeropoulus A, Georgiopolou V, Laskar S, Smith AL, Dunbar S, et al. Hospitalization epidemic in patients with heart failure: risk factors, risk prediction, knowledge gaps, and future directions. J Cardiac Fail. 2011; 17: 54–75.

9. Dunlay SM, Redfield MM, Weston SA, Therneau TM, Long KH, Shah ND, et al. Hospitalization after heart failure diagnosis. A community perspective. J Am Coll Cardiol. 2009; 54: 1695–702. pmid:19850209

10. Carmona M, Garcia Olmos L, Alberquilla A, Muñoz A, Garcia Sagredo P, Somolinos R, et al. Heart failure in family practice: a study of prevalence and co-morbidity. Fam Pract. 2011; 28: 128–33. pmid:20978242

11. García Olmos L, Rodríguez Salvanés F, Batlle Pérez M, Aguilar Torres R, Porro Fernández C, García Cabello A, et al. Development and validation of a risk stratification model for prediction of disability and hospitalisation in patient with heart failure: a study protocol. BMJ Open. 2017; 7: e014840. pmid:28600367

12. Ustun TB, Chatterji S, Kostanjsek N, Rehm J, Kennedy C, Epping-Jordan J, et al. Developing the World Health Organization Disability Assessment Schedule 2.0. Bull World Health Organ. 2010; 88: 815–23. pmid:21076562

13. Rector TS, Kubo SH, Cohn JN. Patients self-assessment for their congestive heart failure: content, reliability and validity of a new measure. The Minnesota Living with Heart Failure Questionnaire. Heart Fail. 1987; 3: 198–219.

14. Wang L. Porter B, Maynard C, Bryson C, Sun H, Lowy E, et al. Predicting risk of hospitalization or death among patients with heart failure in Veterans Health Administration. Am J Cardiol. 2012; 110: 1342–9. pmid:22819429

15. Kleinbaum DG, Kupper LL, Muller KE. Variable Reduction and Factor Analysis. Applied Regression Analysis and Other Multivariable Methods. Boston: PWS-Kent; 1988. p. 595–640.

16. Kg Moons, Donders AR Steyerberg EW, Harrell FE. Penalized maximun likelihood estimation to directily adjust diagnostic and prognostic prediction models for overoptimism: a clinical example. J Clin Epidemiol. 2004; 57: 1262–70. pmid:15617952

17. Moons KGM, Altman DG, Reitsma JB, Ioannidis JPA, Macaskill P, Steyerberg EW, et al. Transparent reporting of a multivarible prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015; 162: W1–73. pmid:25560730

18. Garcia Olmos L, Batlle M, Aguilar R, Porro C, Carmona M, Alberquilla A, et al. Disability and quality of life in heart failure patients: a cross-sectional study. Fam Pract. 2019; 1–6;

19. Van Walraven C, Bennet C, Jennings A, Austin PC, Forster AJ. Proportion of hospital readmissions deemed avoidable: a systematic review. CMAJ. 2011; 183: 391–402.

20. Packer M. Activation and inhibition of sodium-hydrogen exchanger is a mechanism that links the pathophysiology and treatment of diabetes mellitus with that of heart failure. Circulation. 2017; 136: 1548–59. pmid:29038209

21. McAllister DA, Read SH, Kerssens J, Livingstone S, McGurnahan S, Jhund P, et al. Incidence of hospitalization for heart failure and case-fatality among 3.25 million people with and without diabetes mellitus. Circulation. 2018; 138: 2774–86. pmid:29950404

22. Seferovic PM, Ptrie MC, Filippatos GS, Anker SD, Rosano G, Bauersachs J, et al. Type 2 diabetes mellitus and heart failure: a position statement from the Heart Failure Association of the European Society of Cardiology. Eur J Heart Fail. 2018; 20: 853–72. pmid:29520964

23. Connelly KA, Gilbert RE, Liu P. Treatment of diabetes in people with heart failure. Diabetes Canada Clinical Practice Guidelines Expert Committee. Can J Diabetes. 2018; 42: S196–S200. pmid:29650096

24. Kaszuba E, Odeberg H, Rastman L, Halling A. Heart failure and levels of other comorbidities in patients with chronic obstructive pulmonary disease in swedish population: a register-based study. BMC Res Notes. 2016; 9: 215. pmid:27067412

25. Hawkins NM, Jhund PS, Simpson CR, Petrie MC, McDonald MR, Dunn FG, et al. Primary care burden and treatment of patients with heart failure and chronic obstructive pulmonary disease in Scotland. Eur J Heart Fail. 201; 12: 17–24. pmid:19951962

26. De Miguel-Díez J, López de Andrés A, Hernández-Barrera V, de Miguel Yanes JM, Muñoz Rivas N, Jiménez García R. Influence of COPD on outcomes of patients hospitalized with heart failure: analysis of Spanish National Hospital Discharge Database (2001–2015). Intern J Cardiology. 2018; 269: 213–9.

27. Canepa M, Temporelli PL, Rossi A, Gonzini L, Nicolosi GL, Staszewsky L, et al. Prevalence and prognostic impact of chronic obstructive pulmonary disease in patient with chronic heart failure: data from GISSI–HF trial. Cardiology. 2017; 1336: 128–37.

28. Tavazzi L. It’s time to move from counting co-morbidities to curing them: the case of chronic heart failure–chronic obstructive pulmonary disease co-morbidity. Eur J Heart Fail. 2018; 20: 193–6. pmid:29164746

29. Butler J, Hamo CE, Udelson JE, Pitt B, Yancy C, Shah SJ, et al. Exploring new endpoints for patients with heart failure with preserved ejection fraction. Circ Heart Fail. 2016; 9: e003358. pmid:27756791

30. Cacciatore F, Abete P, Mazzella F, Furgi G, Nicolino A, Longobardi G, et al. Six-minute walking test but no ejection fraction predicts mortality in elderly patients undergoing cardiac rehabilitation following coronary artery bypass grafting. Eur J Prev Cardiol. 2010; 19: 1401–9.

31. Greysen SR, Stijacic I, Auerbach AD, Covinsky KE. Functional impairment and hospital readmission in Medicare seniors. JAMA Intern Med. 2015; 175: 559–65. pmid:25642907

32. Shih SL, Gerrard P, Goldstein R, Mix J, Ryan CM, Niewczyk P, et al. Functional status outperforms comorbidities in predicting acute care readmissions in medical complex patients. J Gen Intern Med. 2015; 30: 1688–95. pmid:25956826

33. Liguori I, Russo G, Curcio F, Sasso G, Della-Morte , Gargiulo G, et al. Depression and chronic heart failure in the elderly: an intriguing relationship. J Geriatr Cardiol. 2018; 15:451–9. pmid:30108618