Impact of time to local recurrence on the occurrence of metastasis in breast cancer patients treated with neoadjuvant chemotherapy: A random forest survival approach

Abstract

Background

We studied the relationship between time to ipsilateral breast tumor recurrence (IBTR) and distant metastasis-free survival (DMFS) in patients with breast cancer treated by neoadjuvant chemotherapy (NAC).

Methods

Between 2002 and 2012, 1199 patients with primary breast cancer were treated with NAC. Clinical, radiological and pathological data were retrieved from medical records. Multivariate analysis was performed with the random survival forest (RSF) method, to evaluate the relationship between time to local recurrence and DMFS.

Results

Time to IBTR, local recurrence and molecular subtype were the factors most strongly associated with DMFS. In the total population, DMFS increased linearly with recurrence time, up to 50 months. For recurrences after 50 months, DMFS was similar for all times to recurrence. Considering molecular subtypes separately, the threshold was similar for the TNBC subtype (50 months), but appeared to occur later for the luminal and HER2-positive subtypes (75 months).

Conclusion

A threshold of 50 months seems to differentiate between early and late recurrences and could be used to guide the medical management of local breast tumour recurrences.

About the Authors:

Enora Laas

Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

Affiliation: Department of Surgery, Institut Curie, Paris, France

Anne-Sophie Hamy

Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

Affiliations Residual Tumour & Response to Treatment Laboratory, RT2Lab, PSL Research University, Translational Research Department, Institut Curie, Paris, France, INSERM, U932 Immunity and Cancer, Paris, France

Anne-Sophie Michel

Roles Investigation, Visualization, Writing – review & editing

Affiliation: Department of Surgery, Institut Curie, Paris, France

Nabilah Panchbhaya

Roles Data curation, Resources, Writing – review & editing

Affiliation: Department of Surgery, Institut Curie, Paris, France

Matthieu Faron

Roles Conceptualization, Formal analysis, Funding acquisition, Methodology, Validation, Visualization

Affiliation: Department of Surgery, Institut Gustave Roussy, Villejuif, France

Thanh Lam

Roles Funding acquisition, Methodology, Resources, Validation

Affiliation: Department of Gynaecology and Obstetrics, Geneva University Hospitals, Geneva, Switzerland

Sophie Carrez

Roles Investigation, Methodology, Writing – original draft

Affiliation: Department of Surgery, Institut Curie, Paris, France

Jean-Yves Pierga

Roles Supervision, Validation, Writing – review & editing

Affiliations Department of Medical Oncology, Institut Curie, Paris, France, Paris Descartes University, Paris, France

Roman Rouzier

Roles Supervision, Validation, Writing – review & editing

Affiliation: Department of Surgery, Institut Curie, Paris, France

Florence Lerebours

Roles Investigation, Methodology, Validation, Visualization

Affiliation: Department of Medical Oncology, Institut Curie, Paris, France

Jean-Guillaume Feron

Roles Supervision, Validation, Visualization, Writing – review & editing

Affiliation: Department of Surgery, Institut Curie, Paris, France

Fabien Reyal

Roles Supervision, Validation, Writing – review & editing

* E-mail: [email protected]

Affiliations Department of Surgery, Institut Curie, Paris, France, Residual Tumour & Response to Treatment Laboratory, RT2Lab, PSL Research University, Translational Research Department, Institut Curie, Paris, France, INSERM, U932 Immunity and Cancer, Paris, France

ORCID logo http://orcid.org/0000-0002-2318-3589

Introduction

Neoadjuvant chemotherapy (NAC) is currently indicated as a means of allowing breast-conserving surgery in cases of breast carcinoma with a poor prognosis [1,2]. Studies comparing chemotherapy in adjuvant and neoadjuvant settings have reported similar prognoses for overall survival. However, consistent with the higher rates of conservative surgery in patients receiving NAC, local relapses are more frequent for NAC than for adjuvant chemotherapy, reaching 22% at 10 years [3–6].

Ipsilateral breast tumour recurrence (IBTR) is an independent risk factor for both distant metastasis [7–9] and death from breast cancer [10–12]. It is unclear whether this association is causal, whether IBTR is an indicator of active disease, or both. One of the major challenges in the management of local recurrences is distinguishing true recurrences, corresponding to the regrowth of resistant cells after initial treatment, from new primary tumours. This distinction is important for treatment, because true recurrences provide evidence of uncontrolled disease requiring radical treatment, rather than the secondary conservative surgery that could be considered for a new tumour. The risk of metastasis is also probably different for these two entities and should be considered as such for decisions concerning systemic treatment.

Time-to-recurrence seems to be a relevant surrogate for distinguishing “late recurrences” potentially corresponding to new primary tumours, from “early recurrences” more likely to correspond to progression of the initial disease. Some studies of adjuvant chemotherapy have reported better outcomes for patients with “late recurrences” than for those with “early recurrences”[13–17]. However, only two studies have investigated the impact of time to local recurrence on distant metastasis-free survival in the neoadjuvant setting [9,18]. One limitation common to all these studies is that the threshold for distinguishing between early and late recurrences is chosen by the author and often defined arbitrarily as the median time to recurrence, a time point that does not necessarily separate subgroups with good and poor prognoses. The accurate classification of IBTRs as “early” or “late”recurrences is essential in the neoadjuvant setting, to improve both prognostic evaluations and therapeutic choices.

Traditional statistical techniques, such as Cox’s proportional hazards (PH) models, are generally used to identify potential risk factors. However, Cox models involve restrictive assumptions, such as a proportionality of hazards and linearity [19]. These assumptions may bias the analysis of prognosis in the long-term follow-up of breast cancer and hinder the identification of early or late markers of prognosis [20,21]. For this reason, Baulies et al. introduced a time-dependent effect into their analysis, and showed that early local recurrence, within five years, in patients treated by conservative surgery, was a prognostic factor strongly associated with the development of distant metastases [18].

However, the relationships between clinical outcome and the predictors considered are potentially complex. It may be difficult to identify interactions, particularly those involving multiple variables, such as three-way interactions. This complexity would bias the relationship between IBTR, the time to local recurrence (time to IBTR) and distant metastasis-free survival (DMFS). These difficulties can be handled automatically by machine-learning methods, such as tree-based approaches. Random survival forests (RSFs) are a non-parametric tree-based ensemble learning method that can be used to select and rank variables [19,22–25] without the limitations of Cox models. One of the key advantages of the RSF approach is the adaptive discovery of nonlinear effects and interactions. This approach uses all the available variables in the dataset to build the response predictor, without the need for explicit specification of the functional form of the covariates. Several studies have confirmed that RSF methods perform better in this context than the traditional Cox PH model [22,26,27].

We used the RSF method to study the relationship between time to IBTR, distant metastasis-free survival (DMFS) and overall survival (OS) survival in a large series of breast cancer patients treated with NAC.

Materials and methods

NEOREP (“Reponse à la chimiothérapie neoadjuvante”)(Cohort, CNIL declaration number 1547270) is a retrospective cohort follow-up study of patients treated with NAC for a unifocal invasive breast carcinoma at Institut Curie (Paris, France) between 2002 and 2012. All experiments were performed retrospectively and in accordance with the French Bioethics Law 2004–800, the French National Institute of Cancer (INCa) Ethics Charter and after approval by the Institut Curie review board and ethics committee (Comité de Pilotage of the Groupe Sein). In the French legal context, our institutional review board waived the need for written informed consent from the participants. Moreover, women were informed of the research use of their tissues and did not declare any opposition for such researches. Data were analyzed anonymously. All cases were eligible for inclusion.

Clinical, radiological and pathological data, such as patient age, menopausal status, T stage, N stage, histological tumour grade, oestrogen receptor (ER), progesterone receptor (PR) and HER2 status, and pathological response to NAC, were recorded.

The pathological diagnosis was confirmed in all patients by a core needle biopsy before treatment. Histological grade was determined as described by Elston and Ellis (1991), with a modified version of the Scarff–Bloom–Richardson grading system. Hormone receptors were analysed by immunohistochemistry. Tumours were considered to be positive for ER or PR if 10% of the carcinomatous cells displayed positive staining, as recommended by European guidelines [28]. HER2 expression status was determined according to American Society of Clinical Oncology guidelines [29]. The molecular subtype of each tumour was determined as follows: “luminal” for breast tumours positive for ER and/or PR, with no overexpression of HER2; “HER2-positive” for tumours with HER2 overexpression; and “triple-negative” for tumours displaying no staining for ER or PR and without HER2 overexpression.

Patients were treated in accordance with national guidelines. Neoadjuvant chemotherapy regimens changed over time (anthracycline-based or sequential anthracycline-taxane regimens).

Surgery was performed four to six weeks after the end of chemotherapy. Patients underwent either mastectomy or breast-conserving surgery (lumpectomy), with axillary lymph node dissection (ALND) or sentinel node dissection (SLNB). SNLB, when indicated, was performed after NAC. In case of positive node in FNA, we performed ALND. A pathologic complete response (pCR) was defined as the absence of residual invasive cancer cells in the breast and axillary lymph nodes (ypT0is/ypN0).

After surgery, adjuvant treatment was administered in accordance with Institut Curie Treatment Guidelines. Adjuvant chemotherapy was administered at physician choice, according to the pathological response to NAC and lymph node status. The adjuvant chemotherapy chosen was with 5FU-Navelbine (FUN) in most of the cases. Trastuzumab was administered to patients with overexpression of HER2 since 2005. Patients received adjuvant radiotherapy according to national guidelines. Radiation was given in case of lumpectomy or in case of radical mastectomy for patient with initial T3 or T4 tumor, for all patients with involved axillary lymph nodes and to a selection of high-risk node-negative breast cancer patients.

Endocrine therapy (tamoxifen, aromatase inhibitor, or GnRH agonists) was added to the regimen as an adjuvant treatment, for almost all hormone receptor-positive tumours. After the completion of treatment, the patients were followed up every four months for the first two years, every six months for the next three years and then annually from the fifth year onwards. Clinical examination, mammography and breast ultrasound were performed annually.

Time to IBTR was defined as the time from diagnosis to local recurrence in the previously treated breast, and was measured from the date of diagnosis to the time of the last follow-up visit or IBTR. Distant metastasis-free survival (DMFS) was defined as the time from diagnosis to distant recurrence or to the last follow-up visit, whichever occurred first. Overall survival (OS) was defined as the time from diagnosis to death or to the last follow-up visit, whichever occurred first.

Patients for whom none of these events were recorded were censored at the date of last known contact.

Statistical method

As the traditional Cox model was not the most suitable for our question, multivariate analysis was performed with the random survival forest (RSF) method, a nonparametric approach to survival analysis [19]. A set of survival trees of similar size was first built by recursive partitioning on a training set obtained from the original data set by random aggregation through bootstrap sampling (with replacement) of the data (bagging). Each tree was tested on the remaining group (the validation set). At each node of the tree, we randomly selected a subset of predictors as candidate variables for splitting, making the forest robust to correlations between predictors. In each tree, survival time and patient status were treated as response variables. Each RSF run was performed on 3000 trees, with the log-rank splitting rule and five predictors randomly selected at each split. Missing data were treated by a multiple imputation strategy. We analysed 16 clinical and histological variables: age, body mass index (BMI), menopausal status, clinical T and N stage, surgery type (lumpectomy or mastectomy), histological subtype, initial tumour size, initial tumour grade, initial Ki67 status, molecular subtype, margin status, pCR, postoperative nodal involvement (ypN stage), local recurrence and time to IBTR.

The importance of each of the model covariates was determined by internal variable ranking measures: variable importance (VIMP) and minimal depth. VIMP is the difference in validation set prediction error before and after the permutation of variables: the larger the VIMP, the more predictive the variable. A VIMP close to zero indicates that the variable makes little or no contribution to predictive accuracy, and negative values indicate that predictive accuracy is improved by omission of the variable.

Minimal depth indicates the impact of the variable on the prediction. The smaller the minimal depth, the more predictive the variable, as the variables with the smallest minimal depths split the largest samples of the population, frequently at nodes close to the root node.

VIMP and minimal depth may rank the variables differently. The variables selected had concordant values for VIMP and minimal depth, and a high predictive value.

Partial dependence plots were used to describe the adjusted predicted response to the covariate of interest, by integrating out the effects of variables other than the covariate of interest. Analyses were performed for the total population, and then for the three molecular subtypes separately.

Analyses were performed with R software version 3.2.2, with the R package "random-ForestSRC" (R Development Core Team, 2011,http://www.R-project.org/).

Results

We included 1199 patients from the NEOREP cohort: 530 (44.2%) with luminal tumours, 375 (31.3%) with triple-negative tumours and 294 (24.5%) with HER2-positive tumours. Lumpectomy was performed in 66.6% (n = 797) of the patients. Pathological complete response (pCR) was achieved in 292 patients (24.4%) (Table 1). IBTR occurred in 89 patients (7.4% which 17 were regional recurrences) and distant metastasis occurred in 214 patients (17.8%). Twenty-three patients underwent SLNB following by ALND for positive node.

[Figure omitted. See PDF.]

Table 1. Clinical, histological and follow-up characteristics of patients.

https://doi.org/10.1371/journal.pone.0208807.t001

The mean follow-up time was 59.8 months [56.5–62.1 months]. The median survival time was not reached for either lBTR time or DMFS.

Fig 1 shows the VIMP and minimal depth of the variables obtained from the RSF for predicting DMFS. We tested 22 variables, of which time to IBTR, local recurrence and molecular subtype were the most predictive of DMFS, according to both VIMP and minimal depth values. Time to IBTR was the variable associated with DMFS with the lowest VIMP rank and minimal depth value.

[Figure omitted. See PDF.]

Fig 1. Minimal depth and VIMP rankings for covariate selection.

https://doi.org/10.1371/journal.pone.0208807.g001

Fig 2 shows the adjusted effect of the variables on DMFS. Three-year DMFS increased with time to recurrence (Fig 2A), reaching a plateau at a time to IBTR of 50 months. From this time to IBTR onwards, DMFS remained constant. A threshold of 50 months to IBTR was also appropriate for differentiating between early and late recurrence groups for five-year DMFS.

[Figure omitted. See PDF.]

Fig 2.

a. Time to ipsilateral breast tumour recurrence (IBTR). b. Ipsilateral breast tumour recurrence (IBTR) and molecular subtype.

https://doi.org/10.1371/journal.pone.0208807.g002

After adjustment for other variables, three- and five-year DMFS were lower in patients experiencing local recurrence, and in patients with TNBC, for longer times to recurrence (Fig 2B). Patients free from local recurrence had a three-year DMFS of 87% and a five-year DMFS of 83%, whereas patients experiencing recurrence had a three-year DMFS of 77% and a five-year DMFS of 64%. Three-year DMFS was similar for patients with luminal tumours and patients with HER2-positive tumours (about 88%), whereas TNBC patients had a three-year DMFS of 83%. At five years, DMFS was highest for patients from HER2-positive subgroup (84%), whereas TNBC patients had the worst prognosis (DMFS: 78%).

Fig 3 shows the estimated DMFS at to the various time points in follow-up, for different times to IBTR.

[Figure omitted. See PDF.]

Fig 3. Partial dependence as a function of time estimated distant metastasis-free (DMF) survival at each follow-up time, for different times to ipsilateral breast tumour recurrence (IBTR).

https://doi.org/10.1371/journal.pone.0208807.g003

This figure shows the effects of both follow-up time and time to IBRT on survival. The axis on the left shows how DMFS decreases over time, and that on the right shows how shorter times to IBTR affect survival. Patients with time to IBTR exceeding 50 months had a DMFS greater than 80% at 60 months of follow-up.

We defined a cut-off of 50 months for differentiating between early and late recurrences. For early recurrences (i.e. occurring between 0 and 50 months after NAC), a greater time to IBTR was associated with a higher DMFS, for all follow-up times considered.

DFMS was similar for all late recurrences (defined as occurring more than 50 months after the primary tumour), regardless of follow-up time, as shown by the plateau on the figure.

We then performed the same analysis separately for the three molecular subtypes (Fig 4A and 4B).

[Figure omitted. See PDF.]

Fig 4. Partial dependence plots for time to IBTR, according to molecular subtype.

a.at three years of follow-up. b.at five years of follow-up.

https://doi.org/10.1371/journal.pone.0208807.g004

For all subtypes, three-year DMFS (Fig 4A) was lower for patients experiencing recurrence before 50 months than for those experiencing recurrence after 50 months. For five-year DMFS, the shape of the survival curve was similar to that for three-year DMFS for the TNBC subtype (cut-off at 50 months), whereas the cut-off point seemed to occur later for the luminal and the HER2-positive subtypes (after more than 75 months; Fig 4B).

Discussion

Our results, obtained with a non-parametric approach, confirmed the prognostic importance of local recurrence, time to IBTR and molecular subtype for the occurrence of metastasis after NAC in breast cancer. Local recurrence and time to IBTR were the most important of the variables analysed for predicting patient outcome. Local recurrence has long been considered a poor prognosis factor per se [7–12]. Rouzier et al. found a relative risk of 5.34 (95% CI: 3.23–8.82) for the development of distant metastasis after local relapse in 257 patients treated by NAC and conservative surgery [9]. In this study, 59.7% of patients experiencing a local recurrence had developed distant metastases at five years.

Time to recurrence has been shown to be an important prognostic factor in early breast cancer [8,9,18,30–32], with patients with late recurrence having better outcomes than those with early recurrence [15]. However, the precise definition of “early” and “late” recurrence remains a matter of debate, with the threshold generally set at between two and five years [8,13,15,17,31,33]. An accurate definition of this threshold is essential, as it can be used to distinguish between true recurrences and new primary tumours, which should be managed differently. Chemotherapy is widely used for the treatment of recurrences. All international recommendations include the use of time to recurrence to guide treatment decisions. For local management practices, radical mastectomy could be reserved for cases of true recurrence (i.e. aggressive disease), whereas new primary tumours (with a non-aggressive profile) could be treated by secondary conservative surgery.

Baulies et al. showed, with a time-dependent variable, that local recurrence in patients treated by conservative surgery within the first five years was a prognostic factor strongly associated with the development of distant metastases (HR 4.21; 95% CI 2.89–6.11; P<0.001) [18]. Other studies using a three-year threshold to distinguish between early and late recurrences found that early recurrence was associated with a higher risk of distant metastases [9,15]. Fredrikson used a ROC curve to determine the best trade-off between specificity (66%) and sensitivity (62%) for local recurrence; they identified a cut-off point for the risk of death, at 2.3 years after surgery [33]. Gosset et al. identified 34 months as the cut-off for time to IBTR minimising the p-value for the relationship between time to IBTR and DMFS. They obtained different cut-offs for tumours with different HR statuses (HR-positive: 49 months, versus HR-negative: 33 months)[14].

Estimation of the prognostic effect of a time-dependent covariate with a standard Cox model is known to be potentially unsatisfactory [20], with the cut-off or the exact shape of the relationship between DMFS and time to IBTR being difficult to determine without specific models. The limitations of all these methods include the a priori definition of the shape of the relationship. A time-dependent covariate must be specified (Ln (t), 1/t, spline, polynome etc.) and a cut-off value provides a restrictive shape for the relationship. The random forest approach is non-parametric and does not require the explicit specification of the shape of the covariate response. This makes it possible to extract the optimal relationship between DMFS and time to IBTR.

This is the first study, to our knowledge, to have used a statistical non-parametric analysis method for the evaluation of prognostic factors in patients with breast cancer treated by NAC. Several studies have confirmed of the promise of RSF relative to Cox PH models for real datasets [22,26,27], and have reported a better performance for RSF than for Cox PH models on the basis of the prediction error criterion [34]. This approach can be used to identify risk factors for poor breast cancer survival. RSF deals automatically and coherently with the limitations of traditional Cox models, such as the assumption of proportionality [35], and does not require advance knowledge of the relationship (i.e. linear or nonlinear) of a variable to time [22].

Using this approach, we identified a time to recurrence of 50 months as the better threshold for differentiating between good and poor prognosis groups. Early local recurrence probably reflects greater biological aggressiveness and/or higher resistance to treatment. This was particularly true for TNBC, which is widely recognised as having a good prognosis provided that no early recurrence occurs in the first five years after diagnosis. It is already known that recurrence patterns differ between molecular subtypes, with earlier recurrences for TNBC than for luminal tumours [36–38], but this study provides additional evidence that the late recurrence of TNBC is associated with a good prognosis. The main limitation of this study was the use of a method often considered a “black box” method, without comprehensive values (such as the hazard ratios of the Cox PH model) for interpretation. We used graphical methods to assess the predicted dependence of the response on covariates, and such interpretations may be subjective. However, graphical presentations facilitate comprehension of the interrelationship between covariates. Another point is the indication of radiotherapy. The French guidelines are, similar to many other national, regional and local guidelines, more often advising for post mastectomy radiotherapy (PMRT) compared to other more restrictive guidelines. In fact, we advice PMRT for all patients with involved axillary lymph nodes and to a selection of high-risk node-negative breast cancer patients. Our patient cohort concerns patients who had an indication for primary systemic therapy. Thereby, they had higher risk factors at diagnosis and thereby an indication for PMRT. Our study is homogenous in that all patients received primary systemic therapy and PMRT. We can thereby not compare with other patients groups but that wasn’t the intent of this study.

Our results suggest that time to IBTR should be seen as a key element for determining the patient’s prognosis. Our findings require validation in further studies, to determine whether patients with late recurrence have a similar prognosis to those with primary tumours. If this proves to be the case, then such late recurrences should be considered equivalent to a new primary tumour in terms of prognosis, for decisions concerning systemic treatments.

Conversely, patients with an early local relapse should be considered to have aggressive and resistant disease with a high risk of distant metastasis. These patients should be invited to participate in clinical trials assessing new therapeutic strategies, as initial chemotherapy failed to eradicate the tumour cells.

Acknowledgments

We thank Roche* France for financial support for the construction of the Institut Curie neoadjuvant database (NEOREP). The funding source had no role in data analysis and interpretation or in the writing of the manuscript.

AS Hamy was supported by an ITMO-INSERM-AVIESAN cancer translational research grant.

Citation: Laas E, Hamy A-S, Michel A-S, Panchbhaya N, Faron M, Lam T, et al. (2019) Impact of time to local recurrence on the occurrence of metastasis in breast cancer patients treated with neoadjuvant chemotherapy: A random forest survival approach. PLoS ONE 14(1): e0208807. https://doi.org/10.1371/journal.pone.0208807

References

1. Fisher B, Brown A, Mamounas E, Wieand S, Robidoux A, Margolese RG, et al. Effect of preoperative chemotherapy on local-regional disease in women with operable breast cancer: findings from National Surgical Adjuvant Breast and Bowel Project B-18. J Clin Oncol Off J Am Soc Clin Oncol. 1997;15: 2483–2493.

2. Mieog JSD, van der Hage JA, van de Velde CJH. Preoperative chemotherapy for women with operable breast cancer. Cochrane Database Syst Rev. 2007; CD005002. pmid:17443564

3. Mauriac L, MacGrogan G, Avril A, Durand M, Floquet A, Debled M, et al. Neoadjuvant chemotherapy for operable breast carcinoma larger than 3 cm: a unicentre randomized trial with a 124-month median follow-up. Institut Bergonié Bordeaux Groupe Sein (IBBGS). Ann Oncol Off J Eur Soc Med Oncol ESMO. 1999;10: 47–52.

4. Fisher B, Bryant J, Wolmark N, Mamounas E, Brown A, Fisher ER, et al. Effect of preoperative chemotherapy on the outcome of women with operable breast cancer. J Clin Oncol Off J Am Soc Clin Oncol. 1998;16: 2672–2685.

5. van der Hage JA, van de Velde CJ, Julien JP, Tubiana-Hulin M, Vandervelden C, Duchateau L. Preoperative chemotherapy in primary operable breast cancer: results from the European Organization for Research and Treatment of Cancer trial 10902. J Clin Oncol Off J Am Soc Clin Oncol. 2001;19: 4224–4237.

6. Mauri D, Pavlidis N, Ioannidis JPA. Neoadjuvant versus adjuvant systemic treatment in breast cancer: a meta-analysis. J Natl Cancer Inst. 2005;97: 188–194. pmid:15687361

7. Fisher B, Anderson S, Fisher ER, Redmond C, Wickerham DL, Wolmark N, et al. Significance of ipsilateral breast tumour recurrence after lumpectomy. Lancet Lond Engl. 1991;338: 327–331.

8. Haffty BG, Reiss M, Beinfield M, Fischer D, Ward B, McKhann C. Ipsilateral breast tumor recurrence as a predictor of distant disease: implications for systemic therapy at the time of local relapse. J Clin Oncol Off J Am Soc Clin Oncol. 1996;14: 52–57.

9. Rouzier R, Extra JM, Carton M, Falcou MC, Vincent-Salomon A, Fourquet A, et al. Primary chemotherapy for operable breast cancer: incidence and prognostic significance of ipsilateral breast tumor recurrence after breast-conserving surgery. J Clin Oncol Off J Am Soc Clin Oncol. 2001;19: 3828–3835.

10. Fortin A, Larochelle M, Laverdière J, Lavertu S, Tremblay D. Local failure is responsible for the decrease in survival for patients with breast cancer treated with conservative surgery and postoperative radiotherapy. J Clin Oncol Off J Am Soc Clin Oncol. 1999;17: 101–109.

11. Kurtz JM, Spitalier JM, Amalric R, Brandone H, Ayme Y, Jacquemier J, et al. The prognostic significance of late local recurrence after breast-conserving therapy. Int J Radiat Oncol Biol Phys. 1990;18: 87–93. pmid:2298639

12. Whelan T, Clark R, Roberts R, Levine M, Foster G. Ipsilateral breast tumor recurrence postlumpectomy is predictive of subsequent mortality: results from a randomized trial. Investigators of the Ontario Clinical Oncology Group. Int J Radiat Oncol Biol Phys. 1994;30: 11–16. pmid:8083103

13. Wapnir IL, Anderson SJ, Mamounas EP, Geyer CE, Jeong J-H, Tan-Chiu E, et al. Prognosis after ipsilateral breast tumor recurrence and locoregional recurrences in five National Surgical Adjuvant Breast and Bowel Project node-positive adjuvant breast cancer trials. J Clin Oncol Off J Am Soc Clin Oncol. 2006;24: 2028–2037. pmid:16648502

14. Gosset M, Hamy A-S, Mallon P, Delomenie M, Mouttet D, Pierga J-Y, et al. Prognostic Impact of Time to Ipsilateral Breast Tumor Recurrence after Breast Conserving Surgery. PloS One. 2016;11: e0159888. pmid:27494111

15. Lee JS, Kim SI, Park HS, Lee JS, Park S, Park B-W. The impact of local and regional recurrence on distant metastasis and survival in patients treated with breast conservation therapy. J Breast Cancer. 2011;14: 191–197. pmid:22031800

16. van der Sangen MJC, van de Poll-Franse LV, Roumen RMH, Rutten HJT, Coebergh JWW, Vreugdenhil G, et al. The prognosis of patients with local recurrence more than five years after breast conservation therapy for invasive breast carcinoma. Eur J Surg Oncol J Eur Soc Surg Oncol Br Assoc Surg Oncol. 2006;32: 34–38. pmid:16305821

17. Anderson SJ, Wapnir I, Dignam JJ, Fisher B, Mamounas EP, Jeong J-H, et al. Prognosis after ipsilateral breast tumor recurrence and locoregional recurrences in patients treated by breast-conserving therapy in five National Surgical Adjuvant Breast and Bowel Project protocols of node-negative breast cancer. J Clin Oncol Off J Am Soc Clin Oncol. 2009;27: 2466–2473. pmid:19349544

18. Baulies S, Belin L, Mallon P, Senechal C, Pierga J-Y, Cottu P, et al. Time-varying effect and long-term survival analysis in breast cancer patients treated with neoadjuvant chemotherapy. Br J Cancer. 2015;113: 30–36. pmid:26079300

19. Ishwaran H, Kogalur U, Blackstone E, Lauer M. Random survival forests. Ann Appl Statis. 2008;2: 841–860.

20. Savignoni A, Hajage D, Tubert-Bitter P, De Rycke Y. Effect of an event occurring over time and confounded by health status: estimation and interpretation. A study based on survival data simulations with application on breast cancer. Stat Med. 2012;31: 4444–4455. pmid:23007695

21. Bellera CA, MacGrogan G, Debled M, de Lara CT, Brouste V, Mathoulin-Pélissier S. Variables with time-varying effects and the Cox model: some statistical concepts illustrated with a prognostic factor study in breast cancer. BMC Med Res Methodol. 2010;10: 20. pmid:20233435

22. Hsich E, Gorodeski EZ, Blackstone EH, Ishwaran H, Lauer MS. Identifying important risk factors for survival in patient with systolic heart failure using random survival forests. Circ Cardiovasc Qual Outcomes. 2011;4: 39–45. pmid:21098782

23. Ghadiani MH, Peyrovi S, Mousavinasab SN, Jalalzadeh M. Delayed graft function, allograft and patient srvival in kidney transplantation. Arab J Nephrol Transplant. 2012;5: 19–24. pmid:22283862

24. Karabicak I, Aytug S, Lewis S, Shah S, Sumrani N, Hayat A, et al. Long-term kidney transplant outcome in obese patients in a predominantly African American population. Clin Transplant. 2011;25: E264–270. pmid:21332793

25. Chen X, Ishwaran H. Random forests for genomic data analysis. Genomics. 2012;99: 323–329. pmid:22546560

26. Friedel G, Fritz P, Goletz S, Kristen R, Brinkmann F, Dierkesmann R, et al. Postoperative survival of lung cancer patients: are there predictors beyond TNM? Anticancer Res. 2013;33: 1609–1619. pmid:23564805

27. Hamidi O, Poorolajal J, Farhadian M, Tapak L. Identifying Important Risk Factors for Survival in Kidney Graft Failure Patients Using Random Survival Forests. Iran J Public Health. 2016;45: 27–33. pmid:27057518

28. Balaton A, Le Doussai V, Groupe GEFPICS-FNCLCC. Recommandations pour l’évaluation immunohistochimiq ue des récepteurs hormonaux sur coupes en paraffine dans les carcinom es mammaires. Mise à jour 1999. Ann Pathol. 1999;19: 336–43.

29. Wolff AC, Hammond MEH, Schwartz JN, Hagerty KL, Allred DC, Cote RJ, et al. American Society of Clinical Oncology/College of American Pathologists guideline recommendations for human epidermal growth factor receptor 2 testing in breast cancer. Arch Pathol Lab Med. 2007;131: 18–43. pmid:19548375

30. Touboul E, Buffat L, Belkacémi Y, Lefranc JP, Uzan S, Lhuillier P, et al. Local recurrences and distant metastases after breast-conserving surgery and radiation therapy for early breast cancer. Int J Radiat Oncol Biol Phys. 1999;43: 25–38. pmid:9989511

31. Veronesi U, Marubini E, Del Vecchio M, Manzari A, Andreola S, Greco M, et al. Local recurrences and distant metastases after conservative breast cancer treatments: partly independent events. J Natl Cancer Inst. 1995;87: 19–27. pmid:7666458

32. Voogd AC, van Tienhoven G, Peterse HL, Crommelin MA, Rutgers EJ, van de Velde CJ, et al. Local recurrence after breast conservation therapy for early stage breast carcinoma: detection, treatment, and outcome in 266 patients. Dutch Study Group on Local Recurrence after Breast Conservation (BORST). Cancer. 1999;85: 437–446. pmid:10023713

33. Fredriksson I, Liljegren G, Arnesson L-G, Emdin SO, Palm-Sjövall M, Fornander T, et al. Local recurrence in the breast after conservative surgery—a study of prognosis and prognostic factors in 391 women. Eur J Cancer Oxf Engl 1990. 2002;38: 1860–1870.

34. Mogensen UB, Ishwaran H, Gerds TA. Evaluating Random Forests for Survival Analysis using Prediction Error Curves. J Stat Softw. 2012;50: 1–23. pmid:25317082

35. Datema FR, Moya A, Krause P, Bäck T, Willmes L, Langeveld T, et al. Novel head and neck cancer survival analysis approach: random survival forests versus Cox proportional hazards regression. Head Neck. 2012;34: 50–58. pmid:21322080

36. Dent R, Trudeau M, Pritchard KI, Hanna WM, Kahn HK, Sawka CA, et al. Triple-negative breast cancer: clinical features and patterns of recurrence. Clin Cancer Res Off J Am Assoc Cancer Res. 2007;13: 4429–4434. pmid:17671126

37. Park S, Koo JS, Kim MS, Park HS, Lee JS, Lee JS, et al. Characteristics and outcomes according to molecular subtypes of breast cancer as classified by a panel of four biomarkers using immunohistochemistry. Breast Edinb Scotl. 2012;21: 50–57. pmid:21865043

38. Yin W, Di G, Zhou L, Lu J, Liu G, Wu J, et al. Time-varying pattern of recurrence risk for Chinese breast cancer patients. Breast Cancer Res Treat. 2009;114: 527–535. pmid:18425576