Development of a prediction model for late urinary incontinence, hematuria, pain and voiding frequency among irradiated prostate cancer patients

Abstract

Background and purpose

Incontinence, hematuria, voiding frequency and pain during voiding are possible side effects of radiotherapy among patients treated for prostate cancer. The objective of this study was to develop multivariable NTCP models for these side effects.

Material and methods

This prospective cohort study was composed of 243 patients with localized or locally advanced prostate cancer (stage T1-3). Genito-urinary (GU) toxicity was assessed using a standardized follow-up program. The GU toxicity endpoints were scored using the Common Terminology Criteria for Adverse Events version 3.0 (CTCAE 3.0) scoring system. The full bladder and different anatomical subregions within the bladder were delineated. A least absolute shrinkage and selection operator (LASSO) logistic regression analysis was used to analyze dose volume effects on the four individual endpoints.

Results

In the univariable analysis, urinary incontinence was significantly associated with dose distributions in the trigone (V55-V75, mean). Hematuria was significantly associated with the bladder wall dose (V40-V75, mean), bladder dose (V70-V75), cardiovascular disease and anticoagulants use. Pain during urinating was associated with the dose to the trigone (V50-V75, mean) and with trans transurethral resection of the prostate (TURP). In the final multivariable model urinary incontinence was associated with the mean dose of the trigone. Hematuria was associated with bladder wall dose (V75) and cardiovascular disease, while pain during urinating was associated with trigone dose (V75) and TURP. No significant associations were found for increase in voiding frequency.

Conclusions

Radiation-induced urinary side effects are associated with dose distributions to different organs as risk. Given the dose effect relationships found, decreasing the dose to the trigone and bladder wall may reduce the incidence of incontinence, pain during voiding and hematuria, respectively.

About the Authors:

Wouter Schaake

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Software, Visualization, Writing – original draft, Writing – review & editing

* E-mail: [email protected]

Affiliations Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands, Research group Healthy Ageing, Allied Health Care and Nursing, Hanze University of Applied Sciences, Groningen, The Netherlands

ORCID logo http://orcid.org/0000-0002-4584-4798

Arjen van der Schaaf

Roles Conceptualization, Methodology, Validation

Affiliation: Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands

Lisanne V. van Dijk

Roles Formal analysis, Methodology, Resources, Software, Visualization

Affiliation: Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands

Alfons C. M. van den Bergh

Roles Data curation, Project administration, Resources, Supervision, Writing – original draft, Writing – review & editing

Affiliation: Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands

Johannes A. Langendijk

Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Resources, Supervision, Visualization, Writing – original draft, Writing – review & editing

Affiliation: Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands

Introduction

The introduction of intensity modulated radiotherapy (IMRT) and dose escalation has resulted in increased biochemical relapse free survival for localized prostate cancer [1]. Despite this increase in tumor control, adjacent organs at risk (OAR) are exposed to high doses that may lead to increased rates of radiation-induced side effects that have an impact on quality of life [2].

To achieve a reduction in side effect rates by adjusting radiotherapy planning, knowledge of the association between complication risk and dose distribution parameters is required.

Traditionally, a distinction is made between gastrointestinal (GI) and genitourinary (GU) side effects. Dose to specific substructures within and around the anorectum are associated with specific gastrointestinal side effects [3]. Previous studies on genitourinary side effects showed the dose to the bladder was associated with urinary toxicity among patients treated with external beam radiotherapy [4] [5]. Interestingly, dose to the trigone was associated with genitourinary side effects among patients treated with brachytherapy [6,7].

In the vast majority of studies on GU side effects after radiotherapy, toxicity is typically scored as a single cumulative endpoint for all GU side effects taken together, rather than a single score for incontinence, hematuria, pain and increased voiding frequency individually. Presently no multivariable models exists on dose to regions within the bladder and specific late side effects among IMRT treated prostate cancer patients. Therefore, the main objective of this study was to develop multivariable NTCP (Normal Tissue Complication Probability) models for urinary incontinence, hematuria, pain and increased voiding frequency taking into account dose distributions to the bladder as a whole, several regions within the bladder and other candidate prognostic factors.

Materials and methods

Patients

This prospective cohort study was previously described in [3] and was composed of 243 patients with prostate cancer confined to the prostatic capsule (stage T1-3). All patients were treated with radiotherapy between 2005 and 2009. The minimal follow up of patients alive was 3 years. Radiotherapy was delivered using linear accelerators with 6 MV photons by intensity modulated radiotherapy (IMRT). Patients were treated 5 times a week to a total dose of 78 Gy on the planning target volume (PTV), using 2 Gy per fraction. In the current patient cohort, no pelvic lymph nodes were irradiated as part of the treatment. Setup accuracy was verified during delivery by matching bony anatomy or implanted fiducial markers. Most patients with locally advanced prostate cancer received adjuvant hormonal treatment (Table 1). Diabetes was defined as “use of hypoglycemic drugs”, smoking was defined as “any kind of smoking history”. These patient characteristics were retrospectively assessed from detailed patient charts. For the purpose of the current analysis, only patients biochemically failure free at three years after treatment were eligible for this study.

[Figure omitted. See PDF.]

Table 1. Patient and treatment characteristics.

https://doi.org/10.1371/journal.pone.0197757.t001

Ethics statement

All patients were subjected to a prospective data registration program in which complications and treatment results in terms of local control and survival are prospectively assessed. This is done within the framework of routine clinical practice in which outcome and complications are systemically scored as part of a quality assurance program. All data obtained and used for this study has been anonymized.

The (Dutch) Medical Research Involving Human Subjects Act is not applicable to data collection as part of routine clinical practice and use of these data for scientific papers regarding the quality assurance program. Only research that is within the scope of the Medical Research Involving Human Subjects Act needs approval from an (accredited) ethics committee. Therefore, the hospital ethics committee (the Medisch Ethische Toetsingscommissie; METc) concluded that data collection by this program is regarded as part of routine patient care and granted us a waiver from needing ethical approval for the conduct of this study.

In the Netherlands a patient of course has to give his/her consent for the collection of the extra data on behalf of the quality assurance program and the use of these data for scientific papers regarding the quality assurance program. However, according to Dutch legislation, consent is free of form, and verbal consent is sufficient. Therefore, patients were asked to participate in this quality assurance program and asked for permission to use their data for the program and scientific papers regarding the program. Refusal of participation was recorded in their medical record.

Target and organ at risk delineation

Three Planning Target Volumes (PTV) were defined: the PTV46 included the prostate and vesicles, the PTV70 included the prostate and the basis of the vesicles and the PTV78 included the prostate only.

The full bladder was delineated as part of the treatment planning. Patients were instructed to urinate and drink half a liter of water one hour prior to radiotherapy. The bladder wall was created using an inner ring within the full bladder of 3.3mm [8]. The trigone was defined as the triangle-shaped structure between the transition of the ureters in the bladder wall cranially and the transition of the urethra into the bladder wall caudally [9] (Fig 1).

[Figure omitted. See PDF.]

Fig 1. Sagittal view of the bladder (red), bladderwall (purple), trigone (orange), prostate (green), anorectum (yellow).

https://doi.org/10.1371/journal.pone.0197757.g001

Endpoints

Side effects were assessed prospectively using questionnaires filled out by patients treated between 2005 and 2009. The questionnaires have been previously used in a multicenter randomized phase III trial [10] and at our institute [11]. Using these questionnaires, the different endpoints were scored according to the Common Terminology Criteria for Adverse Events version 3.0 (CTCAE 3.0) scoring system [12]. Late toxicity was assessed at six months, 12 months, 24 months and 36 months after treatment, finally resulting in a single maximum toxicity score per endpoint over the entire three years. The minimal follow up of patients alive was 3 years.

Urinary incontinence grade ≥ 2 was defined as spontaneous loss of urine and when use of pads was indicated. Hematuria grade 1 was defined as minimal bleeding when no intervention was indicated, while hematuria grade 2 was defined as bleeding requiring medical intervention. Pain or discomfort during urinating grade 1 was defined as mild pain not interfering with function, while pain grade ≥2 was defined as pain interfering with instrumental activities of daily living (ADL). Finally, voiding frequency increase was defined as an increase of >2 times normal (grade ≥2).

Statistical analysis

The candidate prognostic factors of the four endpoints in our analysis were selected based on available literature on GU-NTCP modeling [4–6] and included the mean dose for each organ at risk and the relative volumes receiving 5–70 Gy, in 5 Gy bins (V5-V70). Additionally, we included age, adjuvant hormonal treatment, and pre-treatment factors (Table 1) as candidate predictors, which were retrieved retrospectively from the patient charts.

To show the crude effect of each endpoint, a univariable logistic regression analysis was performed on every endpoint. For the development of the multivariable prediction models the least absolute shrinkage and selection operator (LASSO) method in R was used, available in the Lasso and Elastic-Net Regularized Generalized Linear Model package, version 2.0–2 [13]. This is a logistic regression analysis with a penalty for the magnitude of the regression coefficients to prevent overfitting [14]. Because of the high collinearity of the candidate predictors, the set of variables was reduced prior to the LASSO analysis; from the dose variables that had an intercorrelation > 0.80 only the most significant predictor (as measured by the p-value in univariable analysis) remained a candidate prognostic factor.

Subsequently, the variables selected by LASSO were fitted again to the data with logistic regression and internally validated through bootstrapping. This validation gives a measure of optimism of the model, which can be used to correct the coefficients of the model performance accordingly. Model performance was described using various validation measures [15] [16]. The discriminating ability of the model was described by the Area Under the receiver operating characteristic Curve (AUC). Nagelkerke’s R2 was calculated as a pseudo measure of explained variance. The gain and intercept of the model calibration were calculated, and the calibration was evaluated using a Hosmer-Lemeshow test [17]. Results with p<0.05 were considered as significant.

Finally, for each endpoint a NTCP curve was constructed based on the corrected regression coefficients from then internal validation (Eq 1).

(1)

Results

Urinary incontinence

Twenty nine out of 243 patients (12.0%) experienced grade 2 or higher urinary incontinence. The candidate predictors of urinary incontinence included dosimetric predictors of all bladder structures and pre-treatment variables diabetes, age, cardiovascular disease, abdominal surgery, adjuvant hormonal treatment and TURP. Nine patients experienced grade ≥ 2 incontinence prior to radiotherapy. As these patients already experienced the endpoint of the model before treatment, they were excluded from the multivariable model on incontinence. In the univariable analysis and the V55-V75 and mean dose of the trigone were associated with urinary incontinence (Table 2).

[Figure omitted. See PDF.]

Table 2. Univariable logistic regression analysis for urinary incontinence, hematuria and pain during voiding.

Only p-values < 0.05 are shown.

https://doi.org/10.1371/journal.pone.0197757.t002

The final multivariable analysis resulted in a model with one predictor (Fig 2), i.e. the trigone mean dose (Confidence Interval (CI) Odds Ratio (OR): 1.02–1.20), with a corrected AUC of 0.66 (CI: 0.58–0.78) and a corrected R-square of 0.10 (Table 3).

[Figure omitted. See PDF.]

Fig 2. Final logistic regression analysis for urinary incontinence, hematuria and pain/discomfort during voiding.

The left graphs represent relative volumes with corresponding NTCP risk. The right graphs represent calibration plots for internal validation. The blue points represent the Hosmer–Lemeshow groups and the dashed line represents the identity line.

https://doi.org/10.1371/journal.pone.0197757.g002

[Figure omitted. See PDF.]

Table 3. Performance and calibration measures for the multivariable model for urinary incontinence, hematuria and pain during voiding.

Apparent measures were calculated using the complete dataset on which the model was trained; the corrected measures were adjusted for optimism as calculated with a bootstrapping procedure.

https://doi.org/10.1371/journal.pone.0197757.t003

In individual cases, the risk of urinary incontinence can be estimated using formula 1, where S is defined as:

The Hosmer-Lemeshow test was not significant (chi square of 4.91.71; degrees of freedom (df) = 8; p = 0.77), indicating good agreement between expected and observed complication rates.

Hematuria

In total, 23 out of 243 (9.5%) patients experienced grade ≥ 1 hematuria, of which 3 (1%) grade 2. Because of the low number of patients with grade 2 toxicity (3), we decided to use grade ≥ 1 hematuria as primary endpoint for this analysis. The candidate predictors for hematuria included dosimetric predictors of all bladder (sub)structures and other pre-treatment variables, including diabetes, age, cardiovascular disease, abdominal surgery, adjuvant hormonal treatment, anticoagulants and TURP.

In the univariable analysis grade ≥ 1 hematuria was associated with the V40-V75 and mean dose of the bladder wall and the V70-V75 of the bladder (Table 2). In addition, significant associations were found with cardiovascular disease and anticoagulant use.

The final multivariable analysis resulted in a model with two predictors (Fig 2), including the bladder wall V75 (CI OR 1.03–1.03) and cardiovascular disease (CI 3.12–3.31), with a corrected AUC of 0.71 (CI: 0.62–0.84) and a corrected R-square of 0.10 (Table 3). In individual cases, the risk of hematuria can be estimated using formula 1, where S is defined as:

With bladder wall(V75) in relative volume % and cardiovascular disease is 1 (yes) or 0 (no).

The Hosmer-Lemeshow test had a chi square of 4.96 (df = 8, p = 0.76), indicating good agreement between expected and observed complication rates.

Pain or discomfort during voiding

A total number of 24 out of 243 patients (9.9%) experienced moderate discomfort or pain during voiding (≥ grade 2). The candidate predictors of pain or discomfort during voiding included dosimetric predictors of all bladder (sub)structures and a number of other pre-treatment variables including diabetes, age, cardiovascular disease, abdominal surgery, adjuvant hormonal treatment and TURP.

In the univariable analysis the V50-V75, mean dose of the trigone and TURP were significantly associated with increased pain or discomfort during voiding (Table 2).

The final multivariable analysis resulted in a model with two predictors (Fig 2), including TURP (CI OR 1.18–7.83) and trigone (V75) (CI OR 1.01–1.04), with a corrected AUC of 0.76 (CI: 0.67–0.86) and a corrected R-square of 0.13 (Table 3). In individual cases, the risk of pain or discomfort during voiding can be estimated using formula 1, where S is defined as:

With trigone(V75) in relative volume % and TURP is 1 (yes) or 0 (no).

The Hosmer-Lemeshow test was not significant (chi square 7.84; df 8; p = 0.48), indicating good agreement between expected and observed complication rates.

Increase in voiding frequency (night and day)

In the univariable and multivariable analysis no significant associations were found for any of the dosimetric or pre-treatment predictors with voiding frequency.

Discussion

The main objective of this study was to develop multivariable NTCP models for urinary incontinence, hematuria, pain or discomfort during voiding and increase in voiding frequency based on different subregions within the bladder. Urinary incontinence was best predicted by the trigone mean dose. Hematuria was best predicted by the bladder wall V75 and cardiovascular disease. Pain or discomfort during voiding was best predicted by the trigone V75 and cardiovascular disease. No associations were found for increase in voiding frequency.

Our data show that the dose to the trigone may have an impact on the occurrence of GU complaints, which is in line with research on patients with high-dose IMRT (86.4 Gy) [9] and with brachytherapy [6,7]. In both studies complaints were scored using the IPSS (International Prostate Symptom Score (IPSS)), resulting in a single (side effect) score for each patient. As different GU side effects have a different pathophysiology [18], relating each side effect individually to different dose parameters may be more appropriate and results in more appropriate associations between dose-volume parameters and specific side effects.

Urinary incontinence may originate in the trigone of the bladder, as the lower part contains the involuntary internal or pre-prostatic sphincter [18]. A decrease in dose to this region may likely decrease the incidence of urinary incontinence. However, the external sphincter of the bladder may also play a role in urinary incontinence as it controls the voluntary control of voiding. The external sphincter lies directly beneath the prostate and thereby receives high doses. As this structure is hard to distinguish on CT images we were not able to investigate the impact of dose to this region. The use of MRI in delineating target organs may offer better opportunities to analyze the effect of external sphincter dose-volume parameters on incontinence, as the external sphincter can be better identified with MRI [18].

External beam radiotherapy can cause hematuria [19–20], which is most likely related to the high dose areas within the bladder [21]. In the latter study the volume of the whole bladder receiving ≥ 75 Gy was the best predictor for hematuria. Although the univariable analysis of the present study showed similar results, no such relationship was found in the final multivariable model, which actually showed that the dose to the bladder wall was a better predictor of hematuria than the entire bladder dose. These results suggest that the dose to the entire bladder is a surrogate for the importance of the dose to the bladder wall. From a pathophysiological point of view, it seems evident that dose hotspots to the bladder wall are more indicative of side effects [22–23]. Anticoagulants use was significantly related to hematuria in the univariable analysis, which is in accordance with a study by Palorini [24]. In that study, cardiovascular drugs were found as risk factors for a decreased IPSS score, indicating a possible impaired healing process of radiation-induced damage in patients with microangiopathic disease. Interestingly, anticoagulants were not significant anymore in our multivariable model. This may be caused by the fact that a significant number of patients with cardiovascular disease used anticoagulants. Cardiovascular disease NTCP models performed better than NTCP models with anticoagulants, indicating the importance of taking into account cardiovascular disease in treatment of prostate cancer patients [25–26].

The question may arise what the impact is of volume and motion of the bladder on finding dose-volume relations. A study by Palorini [27] on bladder motility during treatment showed that the cranial and anterior part of the bladder exhibits large systematic variation. The caudal part of the bladder however is relatively independent of bladder filling and may therefore be a reliable predictor in optimizing prostate radiotherapy. The trigone is a relatively rigid part of the bladder, as the bladder neck is surrounded by the prostate and encompassing puboprostatic ligaments [28]. A study on prostatectomy shows that sparing of these ligaments may result in less urinary incontinence [29]. Taking these results into account, the dose to the trigone that we found to be predictive of urinary incontinence and pain, may be a surrogate for these ligaments. However, these ligaments were not visible on CT and were therefore not investigated as an organ at risk for any of the four endpoints.

Although increase in voiding frequency is reported frequently as a side effect resulting from prostate radiotherapy, we were not able to find an association between dose to different anatomical regions and increase in voiding frequency. In a recent study using a pixel-wise analysis of dose-surface maps [30], a relation was found between the dose to the posterior bladder at 5–12 mm from the base and an acute increase in voiding frequency. Therefore, future research should focus on this endpoint to confirm this dose-volume relation in order to prevent a decrease in quality of life of prostate cancer patients.

A limitation of this study was the low number of events for each endpoint. The internal validation showed that for these data the models performed relatively well and despite the low number of events the robustness in this dataset was relatively large [3] [31]. There are different ways to analyze dose-effect relationships, e.g. LASSO, bootstrapping and “simple” backward regression analysis. To check the robustness of our analysis, all of the aforementioned procedures were tested in our data and all led to more or less the same results, indicating our results were relatively independent of the type of analysis that was used and relatively independent of the low number of events. However, external validation in other datasets is warranted. We are currently working on a study to validate our data externally as was done at our institute for head and neck cancer patients [32].

Another limitation of this study is the variability of the bladder volume during treatment. Research has shown that patient motion, bladder centroid motion and bladder filling may have an impact on pretreatment imaging [33]. We recommend researchers to take this into account in future studies on prostate NTCP-modeling by using daily imaging techniques and deformable image registration.

This study shows that different anatomical subregions within the bladder are related to different side effects. Urinary incontinence and pain during voiding is related to dose to the trigone and hematuria is related to the dose in the bladder wall. This information can be used in treatment plan optimization. Additional prospective studies are needed to confirm that dose reductions to these regions result in less side effects.

Citation: Schaake W, van der Schaaf A, van Dijk LV, van den Bergh ACM, Langendijk JA (2018) Development of a prediction model for late urinary incontinence, hematuria, pain and voiding frequency among irradiated prostate cancer patients. PLoS ONE 13(7): e0197757. https://doi.org/10.1371/journal.pone.0197757

References

1. Dose Escalation for Prostate Cancer Radiotherapy: Predictors of Long-Term Biochemical Tumor Control and Distant Metastases–Free Survival Outcomes. Zelefsky MJ, Pei X, Chou JF, Schechter M, Kollmeier M, Cox B et al. 2011, European Jorunal of Urology, pp. 60(6); 1133–1139.

2. The impact of gastrointestinal and genitourinary toxicity on health related quality of life among irradiated prostate cancer patients. Schaake W, Wiegman EM, Groot de M, Laan van der HP, Schans van der CP, Bergh van den AC et al. 2014, Radiotherapy and Oncology, pp. 110; 284–290. pmid:24411226

3. Normal tissue complication probability (NTCP) models for late rectal bleeding, stool frequency and fecal incontinence after radiotherapy in prostate cancer patients. Schaake W, van der Schaaf A., van Dijk L. V. Bongaerts AH, Bergh van den AC, Langendijk JA. 2016, Radiotherapy and Oncology, pp 119(3):381–7. pmid:27157889

4. Urinary obstruction in prostate cancer patients from the Dutch trial (68 Gy vs. 78 Gy): relationships with local dose, acute effects, and baseline characteristics. Heemsbergen WD, Al-Mamgani A, Witte MG, Herk van M, Pos FJ, Lebesque JV. 2010, Int. J. Radiation Oncology Biol. Phys, pp. 78(1):19–25.

5. Dose–volume effects for normal tissues in external radiotherapy: Pelvis. Fiorino C, Valdagni R, Rancati T, Sanquineti G. 2009, Radiotherapy and Oncology, pp. 93; 153–167. pmid:19765845

6. Dose to the bladder neck is the most important predictor for acute and late toxicity after low-dose-rate prostate brachytherapy: implications for establishing new dose constraints for preatment planning. Hathout L, Folkert MR, Kollmeier MA, Yamada Y, Cohen GN, Zelefsky MJ. 2014, Int. J. Radiation Oncology Biol. Phys., pp. 90(2), 312–319.

7. Is there a relation between the radiation dose to the different sub-segments of the lower urinary tract and urinary morbidity after brachytherapy of the prostate with I-125 seeds? Steggerda MJ, Witteveen T, van den Boom F, Moone LM. 2013, Radiotherapy and Oncology, pp. 109(2): 251–255. pmid:24060176

8. Bladder wall thickness in normal adults and men with mild lower urinary tract symptoms and benign prostatic enlargement. Hakenberg OW, Linne C, Manseck A, Wirth MP. 2000, Neurourology and Urodynamics, pp. 19;585–593. pmid:11002301

9. The impact of dose to the bladder trigone on long-term urinary function after high-dose intensity-modulated radiation therapy for localized prostate cancer. Ghadjar P, Zelefsky MJ, Spratt DE, Munck af Rosenschöld P, Oh JH, Hunt M. 2015, Int J Radiat Oncol Biol Phys, pp. 88(2): 339–344.

10. Acute and late complications after radiotherapy for prostate cancer: Results of a multicenter randomized trial comparing 68 Gy to 78 Gy. Peeters STH, Heemsbergen WD, Putten van WLJ, Slot A, Tabak H, Mens JW. 2005, International Journal of Radiation Oncology, Biology and Physics, pp. 61(4); 1019–1034.

11. Grading-system-dependent volume effects for late radiation-induced rectal toxicity after curative radiotherapy for prostate cancer. Laan van der HP, Bergh van den ACM, Schilstra C, Vlasman R, Meertens H, Langendijk JA. 2008, International Journal of Radiation Oncology, Biology and Physics, pp. 70(4); 1138–1145.

12. CTCAE v3.0: development of a comprehensive grading system for the adverse effects of cancer treatment. Trotti A, Colevas AD, Setser A, Rusch V, Jaques D, Budach V. 2003, Seminars in Radiation Oncology, pp. 13(3); 176–181. pmid:12903007

13. http://www.R-project.org/.

14. Regression shrinkage and selection via the lasso. Tibshirani R. 1996, J. R. Statist. Soc. B, pp. 58; 267–288.

15. Assessing the performance of prediction models: a framework for some traditional and novel measures. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N. 2010, Epidemiology, pp. 21(1); 128–138. pmid:20010215

16. External validity of risk models: Use of benchmark values to disentangle a case-mix effect from incorrect coefficients. Vergouwe Y, Moons KG, Steyerberg EW. 2010, American Journal of Epidemiology, pp. 172(8); 971–980. pmid:20807737

17. Hosmer DW, Lemeshow S. Applied Logistic regression. l. s.: New York: John Wiley & Sons, Inc, 1989.

18. Functional anatomy of the prostate: implications for treatment planning. Mclaughlin PW, Troyer S, Berri S, Narayana V, Meirowits A, Roberson PL. 2005, Int. J. Radiation Oncology Biol. Phys pp. 63(2): 479–491.

19. Haematuria after prostate brachytherapy. Leapman MS, Hall SJ, Stone NN. Stock RG. 2013, BJU International, pp. 111: 319–324.

20. Nomograms to predict late urinary toxicity after prostate cancer radiotherapy. Mathieu R, Arango JDO, Beckendorf V, Delobel JB, Messai T, Chira C. 2014, World Journal of Urology. pp(32)3; 743–751. pmid:23990073

21. Integrated models for the prediction of late genitourinary complaints after high-dose intensity modulated radiotherapy for prostate cancer: Making informed decisions. De Langhe S, De Meerleer G, De Ruyck K, Ost P, Fonteyn V, De Neve W. 2014, Radiotherapy and Oncology, pp. 112(1): 95–99. pmid:24951017

22. Predictors for chronic urinary toxicity after the treatment of prostate cancer with addaptive three-dimensional conformal radiotherapy: dose-volume analysis of a phase II dose-escalation study. Harsiola A, Vargas C, Yan D, Brabbins D, Lockman D, Liang J. 2007, Int. J. Radiation Oncology Biol. Phys, pp. 69(4): 1100–1109.

23. A novel method for predicting late genitourinary toxicity after prostate radiation therapy and the need for age-based risk-adapted dose constraints. Ahmed AA, Egleston B, Alcantara P, Li L, Pollack A, Howitz EM. 2013, Int J Radiat Oncol Biol Phys, pp. 86(4):709–715. pmid:23664324

24. Multi-variable models of large International Prostate Symptom Score worsening at the end of therapy in prostate cancer radiotherapy. Palorini F, Rancati T, Cozzarini C, Improta I, Carillo V, Avuzzi B. 2016, Radiotherapy and Oncology. Pp118; 92–98. pmid:26777123

25. Quality of life among prostate cancer patients: a prospective longitudinal population-based study. Schaake W, de Groot M, Krijnen WP, Langendijk JA, van den Bergh AC. 2013, Radiotherapy and Oncology, pp. 108(2):299–305. pmid:23932157

26. Hematuria following stereotactic body radiation therapy (SBRT) for clinically localized prostate cancer. Gurka MK, Chen LN, Bhagat A, Moures R, Kim JS, Yung T. 2015, Radiation Oncology, pp. (10):44. pmid:25890265

27. Bladder dose-surface maps and urinary toxicity: Robustness with respect to motion in assessing local dose effects. Palorini F, Botti A, Carillo V, Gianolini S, Improta I, Iotti C. 2016, Physica Medica, 32(3): 506–11. pmid:27053449

28. The puboprostatic ligament and the male urethral suspensory mechanism: an anatomic study. Steiner MS. 1994, Urology, pp44(4):530–4. pmid:7941191

29. Puboprostatic ligament sparing improves urinary contience after radical retropubic prostatectomy. Poore RE, McCullough DL, Jarow JP. 1998, Urology, pp51(1):67–72. pmid:9457291

30. First application of a pixel-wise analysis on bladder dose-surface maps in prostate cancer radiotherapy. Palorini F, Cozzarini C, Gianolini S, Botti A, Carillo V, Iotti C. 2016, Radiotherapy and Oncology, 119(1):123–8. pmid:26993415

31. Using simulation to guard against spurious data-driven model selection: A case study for rectal toxicity data with high-collinearity and few events. Schaaf van der A, Schaake W, van den Bergh ACM et al. Int J Radiat Oncol Biol Phys;93(3):S182, 2015.

32. Development and validation of a prediction model for tube feeding dependence after curative (chemo-) radiation in head and neck cancer. Wopken K, Bijl HP, van der Schaaf A, Christianen ME, Chouvalouva O, Oosting SF. 2014, Plos One; 9(4).

33. Intrafraction bladder motion in radiation therapy estimated from pretreatment and posttreatment volumetric imaging. Foroudi F, Pham D, Bressel M, Gill S, Kron T. 2013 Int. J. Radiation Oncology Biol. Phys, pp 86(1):77–82.