The role of specialized hospital units in infection and mortality risk reduction among patients with hematological cancers

Abstract

Motivation

Patients with hematological malignancies are susceptible to life-threatening infections after chemotherapy. The current study aimed to evaluate whether management of such patients in dedicated inpatient and emergency wards could provide superior infection prevention and outcome.

Methods

We have developed an approach allowing to retrieve infection-related information from unstructured electronic medical records of a tertiary center. Data on 2,330 adults receiving 13,529 chemotherapy treatments for hematological malignancies were identified and assessed. Infection and mortality hazard rates were calculated with multivariate models. Patients were randomly divided into 80:20 training and validation cohorts. To develop patient-tailored risk-prediction models, several machine-learning methods were compared using area under the curve (AUC).

Results

Of the tested algorithms, the probit model was found to most accurately predict the evaluated hazards and was implemented in an online calculator. The infection-prediction model identified risk factors for infection based on patient characteristics, treatment and history. Observation of patients with a high predicted infection risk in general wards appeared to increase their infection hazard (p = 0.009) compared to similar patients observed in hematology units. The mortality-risk model demonstrated that for infection events starting at home, admission through hematology services was associated with a lower mortality hazard compared to admission through the general emergency department (p = 0.007). Both models show that dedicated hematological facilities and emergency services improve patient outcome post-chemotherapy. The calculated numbers needed to treat were 30.27 and 31.08 for the dedicated emergency and observation facilities, respectively. Infection hazard risks were found to be non-monotonic in time.

Conclusions

The accuracy of the proposed mortality and infection risk-prediction models was high, with the AUC of 0.74 and 0.83, respectively. Our results demonstrate that temporal assessment of patient risks is feasible. This may enable physicians to move from one-point decision-making to a continuous dynamic observation, allowing a more flexible and patient-tailored admission policy.

About the Authors:

Raïsa Carmen

Roles Formal analysis, Validation, Visualization, Writing – review & editing

Affiliation: Department of Decision Sciences and Information Management, Faculty of Business and Economics, KU Leuven, Brussels Campus, Brussel, Belgium

ORCID logo http://orcid.org/0000-0003-1025-8702

Galit B. Yom-Tov

Roles Conceptualization, Methodology, Writing – original draft, Writing – review & editing

Affiliation: Faculty of Industrial Engineering and Management, Technion, Haifa, Israel

ORCID logo http://orcid.org/0000-0003-0295-7968

Inneke Van Nieuwenhuyse

Roles Formal analysis, Investigation, Validation, Writing – review & editing

Affiliation: Faculty of Business Economics, Hasselt University, Campus Diepenbeek, Diepenbeek, Belgium

ORCID logo http://orcid.org/0000-0003-2759-3726

Bram Foubert

Roles Formal analysis, Investigation, Writing – review & editing

Affiliation: Department of Marketing and Supply Chain Management, Maastricht University, Maastricht, The Netherlands

Yishai Ofran

Roles Conceptualization, Data curation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

* E-mail: [email protected]

Affiliation: Department of Hematology and Bone Marrow Transplantation, Rambam Health Care Campus and Bruce Rappaport Faculty of Medicine, Technion, Haifa, Israel

Introduction

Patients with hematological malignancies are known to be highly susceptible to infections, since the disease and/or therapy significantly weaken their immune system, leading to considerable infection-related mortality[1,2,3]. While the past decade has witnessed significant advances in treatment strategies for hematological cancers, prevention, and adequate management of infections still pose a major challenge. In a large retrospective study of more than 41,000 cancer patients admitted due to a suspected infection, mortality rates among those who were treated for leukemia, lymphoma, and myeloma were as high as 14.3%, 8.9%, and 8.2%, respectively[4]. Although for some patients with neutropenia developing during therapy for solid tumors, ambulatory treatment was reported to be safe[5], this could not be extrapolated to high-risk patients with hematological malignancies. Presently, there are no clear guidelines for the identification of hemato-oncological patients who could be treated in the ambulatory setting during post-chemotherapy neutropenia and who should be hospitalized either in a general internal medicine ward (GW), or in a hematological facility. In reality, the shortage of dedicated beds and economical restrictions provide an incentive for minimizing hospital stay. Obviously, patients with active life-threatening infections or other similar conditions should be admitted to hospital; however, many centers are re-evaluating their current practice in an attempt to reduce the number of "non-essential" hospitalizations. Commonly, in high-risk situations (e.g., induction therapy for acute leukemia), physicians choose to keep patients in the hospital for observation after completion of chemotherapy until the recovery of white blood cell (WBC) counts to ensure that immediate measures are taken in case of infection development. However, due to limited bed availability in Hematology Wards (HW), some patients are observed in GWs, or are discharged home shortly after chemotherapy completion. At multiple medical centers, discharged patients that developed fever or other signs of infection at home, receive emergency care at the Hematology Outpatient Clinic (HOutC) during morning hours on weekdays, whereas in the afternoon, at night, and during weekends, such patients are referred to the General Emergency Department (ED).

The well-established significance of rapid diagnostic measures and urgent initiation of antibiotic therapy at early signs of sepsis[6] and neutropenia[7] emphasizes the need for an emergency system dedicated to hemato-oncological patients. While such emergency facilities, termed Acute Oncology Service (AOS), are currently being promoted[8,9,10,11,12], no large-scale analysis of potential effects of this approach has been conducted yet, and its claimed benefits are supported by descriptive or qualitative evidence only. Additional emergency resources could also relieve acute medical units from the burden of managing complicated oncology patients[13,14].

Machine learning prediction models were shown to accurately predict patient outcome in several clinical situations, such as cardiac and general surgeries[15,16], ICU admissions, initiation of dialysis [17,18], etc. The majority of described infection predicting models focused on estimating the aggregated risk. A previous trial demonstrated that an artificial intelligence-based algorithm could successfully predict the development of sepsis in patients admitted to ICU[19]. Similarly, the present study was designated to develop a dynamic model for daily infection prediction. Additionally, we aimed to evaluate the rationale of keeping patients hospitalized for observation upon completion of chemotherapy and to compare the efficacy of a GW and an HW in such situations. The study intended to compare the outcome of hemato-oncological patients admitted and treated for infection in the ED/GW to that of patients whose infection was managed in dedicated facilities (HOutC and/or HW).

While scarce studies did develop models predicting daily infection risks, they were designed for a completely different clinical setting[20,21].

To the best of our knowledge, the present study is the first to quantitatively analyze the benefits of hematological emergency services and the impact of observational policy on infection and mortality hazard in patients with hematological malignancies.

Methodology

The study was approved by the Institutional Review Board (Approval #066-14RMB), and was conducted in accordance with the Declaration of Helsinki. A waiver of patient informed consent was granted as it was a retrospective chart review study.

Study design and setting

Rambam Health Care Campus is a tertiary hospital, providing advanced treatment for a population of about 2 million people. This retrospective cohort study encompassed all hematological patients who visited Rambam between 01/2011 and 10/2015. For these patients, electronic medical records (EMR) were reviewed starting from their first visit to the hospital (even before 2011) till 10/2015. Data obtained included patient demographics, ICD-9 codes, patient flow information throughout each visit, lab results, vital signs, administered medications [antibiotics, chemotherapy (CTX) drugs (S1 Table)], and major treatments [radiation therapy (RT), hematopoietic stem cell transplantation (HSCT), etc.]. While data were anonymized, different hospital visits of the same patient could be linked, using unique patient and visit numbers. If no or more than one ICD-9 code was recorded, a hematology physician accessed full patient records to determine the cancer diagnosis relevant to each visit.

Model development

The current study included two stages. At the first stage, infection and mortality risk models for patients treated for hematological malignancies were built, taking into consideration patient clinical and laboratory parameters along with admission wards. These models identified the admission ward as a significant factor for infection and mortality risks. Of several prediction methods, we found the probit models to be the most accurate and allowing for daily evaluation of patient risk throughout the entire treatment cycle. The relative importance of an HW and a GW was estimated, using the number-needed-to-treat measurements to quantify the life-saving potential of the dedicated facilities. At the second stage, we built a prediction model for infection and mortality risks for a given patient if treated in a dedicated or general ward.

Patient population and treatment definitions

During the study period, 8,786 patients visited the Adult HW and HOutC. Out of these, 2,330 had malignant hematological diseases and received treatment at the Rambam hospital. The evaluable patients were categorized into the following four groups. The Acute Leukemia (AL) group included patients with all subcategories of acute myeloid leukemia (AML), as well as acute lymphoblastic leukemia, and aplastic anemia. The Chronic Leukemia (CL) group included patients diagnosed with chronic myeloid leukemia, chronic myelomonocytic leukemia, chronic lymphocytic leukemia, high- and low-risk myelodysplastic syndrome, and myeloproliferative neoplasms. Patients diagnosed with any kind of lymphoma were incorporated into the Lymphoma group (L), and patients with multiple myeloma or any plasma cell discrasia formed the Multiple Myeloma group (MM). Only patients diagnosed with one (or more) of these diseases were included in the study.

A treatment protocol was defined as a combination of chemotherapy drugs prescribed to treat a specific disease at a predefined schedule. Each protocol regimen was administrated at repetitive cycles, which included active treatment and observation periods. The first day when CTX or RT was administered was considered the first day of an active treatment cycle. Each active cycle continued till the last day of CTX/RT administration. The observation period started on the first day of an interval of more than four consecutive days when a patient was off therapy. Consecutive days of CTX/RT treatment or treatment days that were separated by a weekend break were considered part of the same active cycle Consecutive treatments that were separated by at least four days of observation were considered separate cycles, even if they included identical drug combinations.

Among the 15,144 treatment cycles excluded from our analysis there were 523 cycles when an infection event occurred early during active therapy. We also excluded 1,092 cycles of therapy prescribed to patients within one year from hematopoietic stem cell transplantation (HSCT), as we could not differentiate between treatments prescribed for a post-transplant relapse and pre-planned maintenance therapy. In addition, 2,346 cycles were excluded due to the lack of important information, such as WBC counts.

We identified 4492 infection events, 176 of which were excluded due to missing data. Hence, the final models included 4,316 infection events that occurred following 11,183 treatment cycles.

Patient data were randomly divided into training (80%) and validation (20%) sets.

Identification of infections in EMR

Since infections are not always accurately recorded on a daily basis, we developed an approach allowing for the identification of such events in EMRs. An infection was assumed to have occurred if at least one of the following took place: 1. a patient was admitted to hospital with an ICD-9 code indicating infection, 2. a patient had a fever higher than 38°C, or 3. a patient started antibiotic therapy that lasted for at least three consecutive days. The list of the antibiotic options is presented in S2 Table. Ciprofloxacin, fluconazole, and twice-weekly trimethoprim, commonly used for infection prophylaxis, were excluded from this list. We assumed an infection episode to last for 72 hours at least. If fever recurred or a new antibiotic was prescribed within 72 hours, we assumed these events to be related to the same infection episode. If fever higher than 38°C was documented after at least 72 hours of normal temperature, we considered this a new infection event. Application of this approach allowed for automatic identification of the events that were then verified and approved by physicians who double-checked random sample cases. Hospitalization of a patient without infection for more than 24 hours after an active treatment cycle was considered to occur merely for observation purposes.

Outcomes and statistical analysis

The primary outcome evaluated in the study was the infection rate within 30 days after the end of each cycle of treatment. Specifically, we modeled the infection hazard rate on day t after the cycle completion, that is, the probability that a patient develops an infection on day t, given that he/she has not had an infection yet. The second study outcome was the death rate within 30 days after an infection event start. The data were randomly divided into two sets: the training set included 80% of the patients and the test set included 20% of the patients. Each of the outcomes was estimated using discrete-time survival (probit) models, allowing for the inclusion of time-varying variables, such as a change in the patient location within or outside the hospital, lab results, administered drugs, and vital signs [22,23,24]. Multi-collinearity tables of the features extracted from the data appear in Tables A-C in S1 File; Tables A-C and Fig B in S2 File, confirming that candidate variables are not highly correlated. Different models were compared using gradual (step-wise) addition of variables to attain the appropriate feature selection, and to better understand risk factor importance. Some of these models are presented herein and in Tables A-C in S1 File; Tables A-C and Fig B in S2 File. The main criterion for feature/model selection was the Bayesian information criterion (BIC). The BIC was selected because it penalized the number of features included in the model and therefore provided certain protection against over-fitting.

To establish the best possible prediction application, we compared the probit model to the following statistical methods: Logistic regression (Logit), Random forest, and Regression tree. Logit and Probit models have the advantage of interpretability, as it is relatively easy to understand the influence magnitude of each risk factor included in the model. Random forest was selected since it is known as one of the best machine learning methods for structured data classification problems[25]. Model prediction accuracy was evaluated using the test data based on the AUC measurements. All statistical analyses and figures were generated using the statistical programming environment R (the general GLM function was used for the statistical models, ggplot package was used for figure preparation) or MATLAB (version 9.5.0 and the statistical toolbox version 11.4).

Results

Patient characteristics

Table 1 summarizes patient and treatment characteristics, while Fig 1 presents a flowchart of patient movements between hospital wards. Fifty five percent of all deaths recorded within the study period were infection-associated. The infection rate within 30 days upon chemotherapy completion was about 9% in the entire study population, but it was as high as 36.5% (ranging between 18.6 and 58.3% depending on the disease type) for the patients who received their treatment in the inpatient setting. The mean length of the observation period was four days. A total of 4,492 infection events occurred during the study period. About 9% of these events resulted in death, with this rate being comparable across the diseases. In 60% of patients, infection events started outside the hospital; 24% of these patients received emergency treatment in the HOutC, 67% were treated in the ED and 9% were directly admitted to the HW. Most patients in the latter group were suffering from serious conditions and were transferred from other local hospitals. The majority of patients (97%) with infection were hospitalized for anti-infection therapy, which on average lasted eight days. The choice of the inpatient facility where a specific patient was hospitalized [HW (30%) versus GW (70%)] depended on infection severity and bed availability.

[Figure omitted. See PDF.]

Table 1. Patient and treatment characteristics.

https://doi.org/10.1371/journal.pone.0211694.t001

[Figure omitted. See PDF.]

Fig 1. The study cohort flowchart.

Left-hand branch: Patient location during and following administration of each chemotherapy cycle. Right-hand branch: Patient location following the diagnosis of an infection event.

https://doi.org/10.1371/journal.pone.0211694.g001

Infection survival and hazard rate

As shown in Fig 2, panel A, infection probability was highest on the first 2 to 3 days upon chemotherapy completion. As expected, the infection hazard was higher for AL patients and for treatments lasting six to eight days, such as induction for AML. Likewise, the protocols requiring hospitalization were associated with increased infection hazards. Data on post-infection survival are presented in Fig 2, panels B-D. The post-infection survival rate appeared to be related to the patient location (home, GW, or HW) at the time of infection event onset, and the mode of hospital admission (HOutC, ED, or direct hospitalization). Surprisingly, the survival rate of patients with infection was not related to the underlying hematological disease.

[Figure omitted. See PDF.]

Fig 2. Infection hazard rate and survival after infection.

Infection hazard during the first 30 days post-chemotherapy according to: A. The underlying hematological disease. Survival during the first 21 days following infection event according to: B. The underlying hematological disease. C. The setting where the infection event was diagnosed. D. The ward where emergency care was provided.

https://doi.org/10.1371/journal.pone.0211694.g002

Model 1—Infection hazard rate after chemotherapy completion

Results for the discrete-time probit model, predicting infection hazard for each of the first 30 days after every protocol cycle are presented in Table 2. The final model included the following explanatory factors: the protocol treatment length, the underlying disease, WBC counts on the last day of chemotherapy, the cycle number, patient’s age, and location during treatment and observation period (the correlation matrix appears in Fig A in S1 File). Based on sensitivity analysis, we coded the WBC count variable as a dummy variable distinguishing between high (i.e., more than 1,000 cells/μL) and low counts (Tables D-E and Fig A in S1 File, Table D in S2 File and S1 Fig). Protocols were also categorized based on the neutropenia-induction risk; specifically, we included the dummy variable TrDrugsNew to distinguish between the protocols exclusively including newer generation non-cytotoxic drugs (e.g., bortezomib, azacitidine), on the one hand, and commonly used chemotherapies, on the other hand.

[Figure omitted. See PDF.]

Table 2. Model 1—Infection hazard rate after chemotherapy completion (training dataset).

https://doi.org/10.1371/journal.pone.0211694.t002

Of the variables incorporated in the model, the underlying hematological disease, the WBC count at the end of active treatment and the current day after treatment completion (Day and Day2) were found to significantly interact with each other. Examples of the conducted sensitivity analysis appear in Tables C-E in S1 File (for the categorization of WBC and cycle number variables).

At the feature selection stage, other models were also evaluated. Table 2 includes an additional baseline model that did not consider patient location information, and took into account only data related to patient medical history, along with both current and past treatments. Our findings showed that the location parameters were essential and significantly improved the model accuracy.

Superior infection-related results were demonstrated for the patients who stayed for observation in the HW than for those observed in the GW, where a higher infection hazard was revealed (p-value 0.009). The number needed to treat (NNT) for observation in the HW was 30.27, meaning that for every 30.27 days of observation in the HW one infection event was prevented. We compared the probit model to other statistical prediction methods, particularly to random forest, regression tree, and logit models. The ROC curves for these models are presented in Fig 3. While Probit, Logit and Random Forest exhibited similar results, the Probit appeared to be most accurate with an AUC of 0.83. Of note, the performance of the regression tree model was poor.

[Figure omitted. See PDF.]

Fig 3. ROC curves for the infection models, using out-of-sample test data.

https://doi.org/10.1371/journal.pone.0211694.g003

We have created a risk prediction tool (available at https://u0092023.shinyapps.io/InfectionHazards2/) that predicts infection development for each patient receiving any protocol treatment for any hematological malignancy.

Model 2—Infection-related mortality hazard rate

Table 3 shows results for the discrete-time probit hazard model, estimating mortality hazard during the first 30 days after an infection event onset. Feature selection and sensitivity analysis were conducted in the same manner as for Model 1. The final model considered the impact of patient location (home, GW, or HW) at the time of infection onset and on each day during hospitalization as well as the mode of hospital admission (HOutC, ED, or direct hospitalization). Additionally, patient-related variables, such as age, WBC count at the beginning of an infection event, the number of previous infection events, and the number of administered treatment cycles, were taken into account.

[Figure omitted. See PDF.]

Table 3. Model 2—Infection-related mortality hazard rate (training dataset).

https://doi.org/10.1371/journal.pone.0211694.t003

Patients presenting with infection were found to have a significantly superior survival rate if they received emergency treatment in the HOutC compared to those treated in the ED. The 21-day post-infection survival was 93.1% and 91.2%, respectively for these groups (Fig 2D). The NNT to save one life was 31.08 for the patients treated in the HOutC. Similar to model 1, this model was compared to other prediction methods. The ROC curves of several models are presented in Fig 4. Again, the probit model appeared to have the highest prediction power, with an AUC of 0.74 (results of Logit and Random Forest appear to be close). The final probit model was used to create a tool that predicts daily mortality risk based on individual patient data (available at https://u0092023.shinyapps.io/Mortality/).

[Figure omitted. See PDF.]

Fig 4. ROC curves for the mortality model, using test data (AUC values are indicated on the graph).

https://doi.org/10.1371/journal.pone.0211694.g004

Time between the infection onset and the antibiotic therapy start

To elucidate why dedicated emergency units appeared to be more effective in treating infections in hematology patients we examined the time interval between the onset of an infection episode and the beginning of antibiotic therapy. Unfortunately, the database on hospitalized patients did not contain information regarding the exact time point of the first symptoms of infection. Fever measurement is an unreliable marker in such cases, since in this high-risk population physicians may diagnose an infection event based on minor symptoms or laboratory/imaging results, even when the patient is afebrile.

Therefore, for hospitalized patients, the upper limit of the symptoms-to-treatment time lag was approximated as the period between the last routine temperature reading below 38°C and the start of the antibiotic treatment (Fig 5A). For the patients whose infection event started at home, the time lag between the first symptoms of infection and arrival in hospital is unknown. Hence, the lower limit of the symptoms-to-treatment time lag for this patient group was the ED length-of-stay (time from admission till hospitalization) (Fig 5B). Time from admission through the general ED was associated with significant delays in antibiotic administration compared to admission through the HOutC (S2 Fig).

[Figure omitted. See PDF.]

Fig 5. Estimated time lags in anti-infectious therapy initiation.

Panel A shows the HW-GW differences in the estimated time lag between first signs of infection and antibiotic initiation, based on the time period between the last normal temperature record and the start of the antibiotic treatment. Panel B shows general ED-HOutC differences in the estimated time lag between patient arrival in hospital and completion of emergency evaluation and initiation of antibiotic therapy, based on the time of patient admission.

https://doi.org/10.1371/journal.pone.0211694.g005

Discussion

Among multiple toxicities and risks associated with intensive chemotherapy for hematological malignancies, life-threatening infection events are extremely common. This justifies the definition of patients suffering from these diseases as a population at risk that requires special considerations. The present study has demonstrated that patients treated for malignant hematological conditions have a better outcome when they are managed in specialized units. This is true both of observation upon chemotherapy completion and emergency treatment if an infection event occurs after discharge from hospital. Due to the shortage of such dedicated facilities, the identification of the patients who would benefit most from management in these wards is critical.

We have chosen the probit models as they provide more accurate results in predicting the risk of rare events, such as death. Since the interpretation of the coefficients is not intuitive [26], we have developed visual tools showing predictive values for infection hazard after treatment or mortality hazard following infection, which can be accessed online. These tools may be used for daily risk prediction for any patient, based on his/her demographics, specific disease, therapy administered, and location within the hospital. This approach can also help in assessing the dynamics of risk development on each particular day of observation and treatment periods.

Our models suggest that keeping high-risk patients in the HW for post-chemotherapy observation is effective for infection prevention and that the mortality hazard following an infection event is likely to be lower if emergency therapy is given in the HOutC compared to the general ED and even the GW. We are aware of the challenge of providing an understandable rationale for algorithm predictions[27] and have looked for potential explanations for our findings. Differences in infection hazard and related mortality rates cannot be attributed to variations in infection prevention or monitoring, since all units and departments at Rambam apply the same infection therapy strategy. Notably, despite the hospital admission policy advocating referral of patients with a high infection risk (e.g., acute leukemia) to the HW, the infection hazard in the HW is lower than in the GW. In all likelihood, a more aware staff, a better nurse-to-patient ratio resulting in higher nurse availability, and a faster response to symptoms or abnormal signs, may explain the reduction in infection or mortality rates in the dedicated units. We have demonstrated that a lag in response to high fever in the GW compared to the HW does exist, as reflected by longer intervals between the last normal temperature record and antibiotic therapy initiation. Manpower shortage and lack of awareness of the fragility of hematological patients may account for inferior outcomes of such patients, if observed in the GW.

The estimated contribution of a specific ward (HW/GW) where a patient is hospitalized upon receipt of emergency treatment for infection may be biased by hospital admission policy. At Rambam, hematological patients with severe infection are more likely to be admitted to the HW and as a result, the mortality hazard among patients first hospitalized in the GW is significantly lower (p-value 0.0206). However, for patients staying in the GW on subsequent days the mortality hazard is higher than for those hospitalized in the HW (p-value 0.0505). Remarkably, the underlying hematological disease is not found to be a significant risk factor for infection-related mortality. Yet, the mortality hazard appears to be significantly higher for heavily pre-treated patients, those who had many infection events in the past, or are of older age.

The current study has analyzed data derived from a single center. While this is a limitation, the homogeneity of the institutional infection prevention and treatment scheme reduces the impact of potentially confounding factors. Obviously, centers around the world differ in their patient population and the quality of care provided by their general wards. Our approach can be readily applied to other institutions with different standards of operation and EMR systems. Using this approach, patients at a high risk of life-threatening infection who will benefit from treatment in a dedicated facility can be identified and characterized in each particular center. Hence, the current study presents an efficient tool for identification and quantification of the patients requiring observation and treatment in specialized wards.

The decision of whether a patient should stay at hospital for observation is currently made upon completion of a chemotherapy course. The most frequently used criterion is the WBC count. This reflects myopic decision making. Once a patient is discharged, he/she will only return to hospital in case of an infection event.

Since our model provides temporal evaluation of patient risks, it may enable physicians to move from myopic (one-point) to a continuous dynamic decision making policy. With our tool, physicians can compare risks at different time points, which may result in a more flexible patient management policy. Importantly, the present study has demonstrated that while in some patients the infection risk is monotone decreasing, in others, the pattern appears to be increasing-decreasing. Our proposed calculator is capable of predicting the exact time point during post-chemotherapy observation when the infection risk in patients from the former group decreases to a level allowing their discharge from hospital. For the latter group that is usually discharged immediately after chemotherapy, one can calculate the exact date when the infection risk increases to a level justifying patient hospitalization. We are currently investigating the ways to identify optimal policies that minimize the expected combined infection and mortality risks, taking into account both patient point-of-view and capacity constraints. This is a very complicated optimization problem that is beyond the scope of the current paper.

As to the specialized emergency services, to the best of our knowledge, the present study is the first to provide quantitative support for the availability of such facilities for hematological patients. This is not trivial. For example, the queuing theory suggests that a larger ED may be more flexible and efficient in providing care to severely ill patients (since they are prioritized over regular ones). On the other hand, a small ED may provide a “concierge” treatment with faster reach of the required specialist. Our hospital actually chooses a mid-way solution, i.e., providing specialized ED services in the HOutC.

Our findings may have implications for future resource distribution in hospital development programs. HW beds are known to be expensive and cheaper substitutes are required. Combining the results of the two models developed in the current study suggest that establishing specialized ED or fast-track oncological emergency services could be more efficient in infection prevention and management than expanding the available GW.

In conclusion, our model for infection risk and associated mortality prediction among hemato-oncological patients has demonstrated that post-treatment observation in a specialized unit and dedicated emergency services may significantly improve patient outcome. Differences between dedicated hematological and general facilities are institution-specific, but the proposed model could be applied to any given EMR dataset, providing a reliable support tool for resource allocation decisions.

Supporting information

[Figure omitted. See PDF.]

S1 Table. Overview of cytotoxic and non-cytotoxic anti-neoplastic drugs applied in the study population.

https://doi.org/10.1371/journal.pone.0211694.s001

(PDF)

S2 Table. List of antibiotics commonly used for prophylaxis or active infection therapy in the study population.

https://doi.org/10.1371/journal.pone.0211694.s002

(PDF)

S1 File. Infection after protocol completion: Model selection and sensitivity analysis.

Table A. Comparison of models for infection after protocol completion analysis: Probit, logit and cloglog Table B. The location as an explanatory variable in the model for infection after protocol completion analysis Table C. Cycle number in the model for infection after protocol completion analysis Table D. The model for infection after protocol completion analysis with different WBC grouping Table E. White blood cell counts (mean or last) in the model for infection after protocol completion analysis Table F. Degrees of freedom (DF) of the predictor variables for the model of infection after protocol completion analysis Fig A. Multicollinearity checks and variance inflation factors (VIFs) for the model of infection after protocol completion analysis.

https://doi.org/10.1371/journal.pone.0211694.s003

(PDF)

S2 File. Mortality after infection: Model selection and sensitivity analysis.

Table A. Comparison of models for mortality after infection analysis: Probit, logit, and cloglog Table B. The location as an explanatory variable in the model for mortality after infection analysis Table C. Cycle number in the model for mortality after infection analysis Table D. White blood cell counts in the model for mortality after infection analysis Table E. Type of infection in the model for mortality after infection analysis Table F. Time until antibiotic administration in the model of mortality after infection analysis Table G. Degrees of freedom (DF) of the predictor variables for the model of mortality after infection analysis Fig A. Time until antibiotic administration as a function of the location where the infection started and outcome (death) Fig B. Multicollinearity checks and variance inflation factors (VIFs).

https://doi.org/10.1371/journal.pone.0211694.s004

(PDF)

S1 Fig. Distribution of the WBC counts among the evaluated patients based on different factors (disease, protocol length, number of treatment cycles, hospitalization, infection occurrence, and patient age).

https://doi.org/10.1371/journal.pone.0211694.s005

(PDF)

S2 Fig. Hospitalization delay by entry gate to the hospital (ED vs. HOutC) and the hour of admission.

https://doi.org/10.1371/journal.pone.0211694.s006

(PDF)

Acknowledgments

We would like to thank the Computer Unit at the Rambam Health Care Campus − Idan Sipori, Larisa Halif, and Sarah Zafrir − for helping us to acquire the data for this research.

We would like to gratefully acknowledge the assistance of Sonia Kamenetsky in the preparation of this manuscript.

Citation: Carmen R, Yom-Tov GB, Van Nieuwenhuyse I, Foubert B, Ofran Y (2019) The role of specialized hospital units in infection and mortality risk reduction among patients with hematological cancers. PLoS ONE 14(3): e0211694. https://doi.org/10.1371/journal.pone.0211694

References

1. Cornely OA, Gachot B, Akan H, Bassetti M, Uzun O, Kibbler CC, et al. (2015) Epidemiology and outcome of fungemia in a cancer Cohort of the Infectious Diseases Group (IDG) of the European Organization for Research and Treatment of Cancer (EORTC 65031). Clin Infect Dis 61: 324–331. pmid:25870323

2. Halfdanarson TR, Hogan WJ, Madsen BE (2017) Emergencies in Hematology and Oncology. Mayo Clin Proc 92: 609–641. pmid:28385197

3. Taccone FS, Artigas AA, Sprung CL, Moreno R, Sakr Y, Vincent JL. (2009) Characteristics and outcomes of cancer patients in European ICUs. Crit Care 13: R15. pmid:19200368

4. Kuderer NM, Dale DC, Crawford J, Cosler LE, Lyman GH (2006) Mortality, morbidity, and cost associated with febrile neutropenia in adult cancer patients. Cancer 106: 2258–2266. pmid:16575919

5. Elting LS, Lu C, Escalante CP, Giordano SH, Trent JC, Cooksley C, et al. (2008) Outcomes and cost of outpatient or inpatient management of 712 patients with febrile neutropenia. J Clin Oncol 26: 606–611. pmid:18235119

6. Gaieski DF, Mikkelsen ME, Band RA, Pines JM, Massone R, Furia FF, et al. (2010) Impact of time to antibiotics on survival in patients with severe sepsis or septic shock in whom early goal-directed therapy was initiated in the emergency department. Crit Care Med 38: 1045–1053. pmid:20048677

7. Rosa RG, Goldani LZ (2014) Cohort study of the impact of time to antibiotic administration on mortality in patients with febrile neutropenia. Antimicrob Agents Chemother 58: 3799–3803. pmid:24752269

8. Bruce CM, Smith J, Price A (2017) A Study of the Incidence and Management of Admissions for Cancer-related Symptoms in a District General Hospital: the Potential Role of an Acute Oncology Service. Clin Oncol (R Coll Radiol) 29: e148–e155.

9. Navani V (2014) How has acute oncology improved care for patients? Curr Oncol 21: 147–149. pmid:24940096

10. Neville-Webbe HL, Carser JE, Wong H, Andrews J, Poulter T, Smith R, et al. (2013) The impact of a new acute oncology service in acute hospitals: experience from the Clatterbridge Cancer Centre and Merseyside and Cheshire Cancer Network. Clin Med (Lond) 13: 565–569.

11. Putt L, Jones P (2014) The role of the specialist acute oncology nurse in the new acute oncology services. Clin Oncol (R Coll Radiol) 26: 125–127.

12. Shankland K, Kirkbride P, Bourke AM, Price J, Walkington L, Danson S (2012) The acute oncologist’s role in managing patients with cancer and other comorbidities. J Comorb 2: 10–17. pmid:29090138

13. Berger J, Cooksley T, Holland M (2013) The burden of cancer on the acute medical unit. Clin Med (Lond) 13: 457–459.

14. Vandyk AD, Harrison MB, Macartney G, Ross-White A, Stacey D (2012) Emergency department visits for symptoms experienced by oncology patients: a systematic review. Support Care Cancer 20: 1589–1599. pmid:22526151

15. Allyn J, Allou N, Augustin P, Philip I, Martinet O, Belghiti M, et al. (2017) A Comparison of a Machine Learning Model with EuroSCORE II in Predicting Mortality after Elective Cardiac Surgery: A Decision Curve Analysis. PLoS One 12: e0169772. pmid:28060903

16. Kim SW, Han HS, Jung HW, Kim KI, Hwang DW, Kang SB, et al. (2014) Multidimensional frailty score for the prediction of postoperative mortality risk. JAMA Surg 149: 633–640. pmid:24804971

17. Van Poucke S, Kovacevic A, Vukicevic M (2018) Early prediction of patient mortality based on routine laboratory tests and predictive models in critically ill patients. In Data Mining. IntechOpen, https://doi.org/10.5772/intechopen.76988

18. Wick JP, Turin TC, Faris PD, MacRae JM, Weaver RG, Tonelli M, et al. (2017) A Clinical Risk Prediction Tool for 6-Month Mortality After Dialysis Initiation Among Older Adults. Am J Kidney Dis 69: 568–575. pmid:27856091

19. Nemati S, Holder A, Razmi F, Stanley MD, Clifford GD, Buchman TG (2018) An Interpretable Machine Learning Model for Accurate Prediction of Sepsis in the ICU. Crit Care Med 46: 547–553. pmid:29286945

20. Oh J, Makar M, Fusco C, McCaffrey R, Rao K, Ryan EE, et al. (2018) A Generalizable, Data-Driven Approach to Predict Daily Risk of Clostridium difficile Infection at Two Large Academic Health Centers. Infect Control Hosp Epidemiol 39: 425–433. pmid:29576042

21. Jovanovic M, Radovanovic S, Vukicevic M, Van Poucke S, Delibasic B (2016) Building interpretable predictive models for pediatric hospital readmission using Tree-Lasso logistic regression. Artif Intell Med 72: 12–21. pmid:27664505

22. Aitken CK, Agius PA, Higgs PG, Stoove MA, Bowden DS, Dietze PM (2017) The effects of needle-sharing and opioid substitution therapy on incidence of hepatitis C virus infection and reinfection in people who inject drugs. Epidemiol Infect 145: 796–801. pmid:27927256

23. Liu SH, Rositch AF, Viscidi RP, Silver MI, Burke AE, Gravitt PE (2013) Obesity and human papillomavirus infection in perimenopausal women. J Infect Dis 208: 1071–1080. pmid:23840046

24. Kang C, Huang Y, Miller CJ (2015) A discrete-time survival model with random effects for designing and analyzing repeated low-dose challenge experiments. Biostatistics 16: 295–310. pmid:25190513

25. Fernández-Delgado M, Cernadas E, Barro S, Amorim D (2014) Do we need hundreds of classifiers to solve real world classification problems?. J Mach Learn Res 15: 3133–3181.

26. DeRose LF, Salazar-Arango A, Corcuera Garcia P, Gas-Aixendri M, Rivera R (2017) Maternal union instability and childhood mortality risk in the Global South, 2010–14. Popul Stud (Camb) 71: 211–228.

27. Narayanan M, Chen E, He J, Kim B, Gershman S, Doshi-Velez F (2018) How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanation. https://arxiv.org/pdf/1802.00682.pdf. Accessed in January, 2019.