Introduction
For multiple sclerosis (MS) patients with relapse on first‐line interferon‐beta (IFNβ) or glatiramer acetate (GA) therapy, switching to another immunomodulatory therapy is a potentially useful treatment strategy. There is some evidence that switching between IFNβ and GA and among different IFNβ therapies can improve patient treatment response. On the other hand, natalizumab (TYSABRI®) is also recommended for patients with relapse on IFNβ and/or GA therapy. Improvements in disability status and ambulation have been reported in single‐arm observational studies of patients who switched to natalizumab after experiencing high disease activity while on another disease‐modifying therapy (DMT), usually IFNβ/GA. In a single center retrospective analysis by Rio and colleagues, relapse rates in a IFNβ/GA treatment failure population declined significantly after switch to another IFN/GA product or switch to natalizumab, but these two switch groups were not compared. Another two‐center 24‐month observational study showed that patients who switched to natalizumab (n = 106) or IFNβ/GA (n = 161) after first‐line (IFNβ/GA) treatment failure were more likely to remain free of relapse, disability progression, and magnetic resonance imaging (MRI) disease activity than those who switched between IFNβ and GA formulations, with all treatment effects nonsignificant in year 1 but significant in year 2.
These treatment comparisons are challenging to interpret because treatment assignations are nonrandom; and bias may be introduced due to differing patient characteristics. Typically, patients switching to natalizumab would be expected to have more severe disease than patients switching between IFNβ or GA treatments, with resultant bias against natalizumab in outcome analyses. Given the limited observational evidence and lack of randomized controlled trial evidence, we examined treatment outcomes of switch to natalizumab versus switch between IFNβ and GA therapy after IFNβ/GA failure using patients (n = 869/group) matched by disease severity and demographic variables at the time of switch.
The aims of this study were to compare relapse rate, treatment persistence, and disability progression in multiple sclerosis (MS) patients who switched therapy after failure on Betaferon®, Betaseron®, Rebif®, Avonex®, Copaxone®, or Extavia® (BRACE) treatments using propensity matched samples from the MSBase Observational Registry and the TYSABRI Observational Program (TOP), two distinct real‐world cohorts with contemporaneous recruitment, according to prospectively defined protocols. We decided to apply propensity score matching, a powerful statistical technique for correcting multiple baseline covariate imbalances in nonrandomly selected cohorts. Recently, this technique was successfully used to aid comparisons of IFNβ treatment persistence and disease outcomes using observational data from the MSBase registry.
Materials and Methods
Patient sources
MSBase registry
Patients in the BRACE treatment arms of this study were sourced from the international online MSBase Registry. The MSBase Registry was established in 2004 to collect disease‐related information from consenting patients attending MS clinics. As of 4 April 2013, a total of 21,348 people with MS across 60 clinics in 26 countries were participating in MSBase. The registry's member centers, almost exclusively large academic MS centers, follow a defined minimum dataset protocol to prospectively collate outcomes data using an internet‐based, physician owned and operated system
TYSABRI observational program
Patients treated with natalizumab were sourced from TOP (Biogen Idec, Cambridge, MA). TOP is an ongoing, open‐label, multinational, multicenter, prospective, observational study conducted in clinical practice settings in Europe, Australia, Canada, and Argentina. Patients are recruited within 3 months of commencing natalizumab. Data are collected at regular clinical visits every 6 months. Data entry is web‐based. The primary endpoint is long‐term safety (incidence and type of serious adverse events). Secondary endpoints include measures of MS disease activity (including the occurrence of clinical relapses and change in EDSS score). In TOP, a clinical relapse is also defined as new or recurrent neurological symptoms, not associated with fever, lasting for ≥24 h and followed by a period of 30 days of stability or improvement. Study endpoints are assessed uniformly across sites. To assure standardized examinations and consistent definitions for the EDSS Functional System (FS) scores, participating physicians are provided a copy of the interactive Neurostatus Training DVD‐ROM, and Neurostatus certification is highly recommended. Investigators not previously certified are offered the same online certification (
Study design
Patients and subgroups
Participants in MSBase or TOP who relapsed in the 12 months prior to switching to natalizumab or a BRACE therapy and who initiated the new treatment ≤6 months after discontinuation of the prior BRACE therapy were included in this study. Treatment efficacy was initially compared between patients who switched from any BRACE therapy to natalizumab and those who switched between different BRACE therapies. Additional comparisons were performed using three subgroups of patients (based on prior BRACE treatment): (1) those with only prior IFNβ therapy exposure who switched to either natalizumab or GA; (2) those with only prior GA therapy exposure who switched to natalizumab or IFNβ; and (3) those with both prior GA and IFNβ therapy exposure who switched to natalizumab or another IFNβ therapy. Propensity score matching was performed separately for the total patient population and each subgroup (Fig. ).
Efficacy measures
The primary efficacy outcomes assessed were annualized relapse rate (ARR), time to first relapse on therapy, time to treatment discontinuation and time to confirmed disability progression. An area under the disability/time curve (AUC) analysis was conducted as a secondary, exploratory outcome. Confirmed disability progression events were defined as ≥3‐month confirmed increases of ≥0.5 points for patients with a baseline EDSS score >5.5, ≥1.0 point for those with a baseline EDSS score between 1.0 and 5.5, inclusive, and ≥1.5 points for those with a baseline EDSS score of 0. EDSS scores recorded within 30 days after the onset of a relapse were excluded. A minimum of three visits (including baseline) at which an EDSS was formally recorded were, by definition, required to be able to assess confirmed disability progression. Thus, this analysis was limited to patients with a minimum of three EDSS scores reported. As this decreased the number of matched pairs available, comparisons of the time to confirmed disability progression were not performed across treatment arms in the subgroup analyses.
As an exploratory analysis, AUC comparisons were performed from baseline through 24 months of treatment. AUC values were derived for both the natalizumab and BRACE treatment arms to estimate each patient's total study experience with respect to disability burden after switching treatment. Only propensity‐matched patients who remained on the new therapy ≥24 months after switching and who had an EDSS score recorded within ±6 months of the 24‐month postbaseline mark were included in this analysis. This limited the number of matched pairs available. Therefore, AUC measures were not compared in the subgroup analyses.
Statistical analyses
The data from both registries were combined according to a prespecified protocol. Categorical variables were summarized using frequency and percentage. Continuous variables were assessed for significant departures from normality using a Shapiro–Wilk test of skew and summarized using mean and standard deviation (SD) or standard error, or median and interquartile range (IQR) as appropriate. All baseline covariates common to and available from both registries were used to calculate propensity scores. These included gender, age, disease duration, baseline EDSS, number of DMT initiations, duration of DMT use as a proportion of disease duration, total relapses and total steroid‐treated relapses in the 12 and 24 months preceding baseline. Prior DMTs reported were Betaferon® (Bayer Pharma AG, Berlin, Germany), Betaseron® (Bayer Pharma AG, Berlin, Germany), Rebif® (Merck KGaA, Darmstadt, Germany), Avonex® (Biogen Idec Inc., Cambridge, Massachusetts), Copaxone® (Teva Pharmaceuticals, North Wales, PA, USA) or Extavia® (Novartis AG, Basel).
Propensity scores were calculated for each individual patient and represented the probability that a patient from either registry would have commenced natalizumab treatment based purely on pretreatment baseline characteristics. This propensity score was derived from a logistic regression model, in which receipt of natalizumab was the outcome variable and the pretreatment characteristics formed the explanatory variables. Patients from each treatment arm were matched, based on high similarity of propensity score, on a 1:1 basis using a 5‐to‐1 digit matching algorithm with a 0.01 calliper. Success of matching was assessed using both paired tests and analysis of standardized differences. Imbalance was defined as an absolute value of the standardized difference equal or greater than 0.20. Wilcoxon rank‐sum and chi‐square tests were used to compare unmatched baseline characteristics by treatment arm as appropriate. Wilcoxon signed‐rank and McNemar tests were used to compare baseline characteristics in the matched data for continuous variables and proportions, respectively. Standardized differences were calculated for both unmatched and matched comparisons, permitting direct comparison of different baseline characteristics with the same standardized units. Baseline for these analyses was defined as the date the patient initiated the new treatment after BRACE therapy discontinuation. Post hoc Rosenbaum sensitivity analyses across all outcomes were conducted to test the sensitivity of our propensity‐matched models to unobserved heterogeneity.
Comparative analyses of time to first relapse on treatment, time to treatment discontinuation, and time to confirmed disability progression between natalizumab and BRACE comparator groups were performed using a Cox Marginal Model, clustered for the matched pair. Hazard proportionality was assessed via analysis of scaled Schoenfeld residuals and for all models presented in this report, hazard proportionality was satisfied. A competing risks extension of the Cox time‐to‐event model was used to further assess for the influence of informative censoring on event ascertainment, for example the influence of differences in follow‐up time (censoring at last observed assessment) by treatment arm on observing relapse or discontinuation events.
In order to perform AUC analyses, for each patient all EDSS scores recorded within the 24‐month interval were plotted, and the inter‐EDSS serial disability area was calculated as the product of the difference between observed and baseline EDSS and the time elapsed between two successive EDSS assessments (Fig. ). This quantity could take positive values (for disability area recorded above baseline EDSS) or negative values (area contributed by EDSS recorded below baseline EDSS). These inter‐EDSS AUC values were then summed to produce a cumulative AUC across the 24‐month on‐treatment interval. This approach to calculating AUC presumes that EDSS change between two successive assessments is not a constant, linear change as has been assumed in comparable studies but rather an event‐based step up or down in EDSS, more consistent with the attack/relapse course of MS. As a sensitivity analysis we compared the performance of our AUC approach with that calculated using the trapezoidal rule, which presumes a steady, linear change in EDSS between assessment points. The standardized 24‐month AUC values were compared across propensity score matched treatment arms with quantile median regression using Censored Least Absolute Deviations (CLAD) to adjust for the matched pairs. A quantile regression of the median was preferred to simple linear regression of the mean because the distribution of standardized 24‐month AUC values was significantly skewed and resistant to transformation. A Cochran‐Armitage test was used to check for nonlinearity in the associations between AUC and treatment arm. Data were extracted and compiled on 4 April 2013. To test for potential ascertainment bias secondary to unequal frequency of EDSS assessment points and/or unequal time between assessments by switch therapy arm, we conducted a sensitivity analysis limiting the serial disability‐time analysis to just that subset of patients who recorded exactly five assessments (at baseline, 6, 12, 18, and 24 months). Consistent with the real‐world nature of the data, temporal assessments were not always made exactly on the 6‐month mark, thus we analysed a series of time ranges around each of the 6, 12, 18, and 24 month points – namely 1, 1.5, and 2 months. Informative censoring was minimized through application of pairwise censoring. This involved censoring both members of the propensity‐matched natalizumab‐BRACE pair at the earliest censor point recorded by either member of the pair. All analyses were undertaken using Stata version 12 (StataCorp, College Station, TX) and R (R Foundation for Statistical Computing, Vienna, Austria).
Results
Patients with relapse on any BRACE therapy who switched to another BRACE therapy or to natalizumab
Patients
Of the 3377 patients in TOP who met inclusion criteria and switched from BRACE to natalizumab and the 1147 patients in MSBase who met inclusion criteria and switched between BRACE treatments, 869 were successfully paired by propensity score. Distribution plots of propensity scores by switch arm for both the unmatched and matched sample are presented in Figure S1 for the primary any BRACE switch analysis group. As expected, baseline covariates were markedly different between treatment groups in the unmatched sample, with greater disease severity demonstrated in the patients switching to natalizumab (Table ); no significant differences were demonstrated after propensity score matching (Table ). For the propensity score matched patients, mean (SD) follow‐up from baseline was 2.24 years (2.47) in the BRACE group compared to 1.95 years (1.23) in the natalizumab group (P = 0.002). Mean (SD) time between on‐treatment assessments was 6.33 (3.91) months in the BRACE group and 6.30 (1.83) months in the natalizumab group (P = 0.753).
Prematching comparison of baseline characteristics by switch group| Variable (at baseline) | Total population | Prior therapy with IFNβ | Prior therapy with GA | Prior therapy with IFNβ and GA | ||||
| NTZ | IFNβ/GA | NTZ | GA | NTZ | IFNβ | NTZ | IFNβ | |
| n | 3377 | 1147 | 2109 | 675 | 417 | 291 | 851 | 181 |
| Female, % | 72.0 | 79.4 | 70.4 | 77.6 | 75.3 | 81.1 | 74.2 | 83.4 |
|
P‐value Standardized difference, % |
<0.001 −17.5 |
<0.001 −16.5 |
0.0681 −14.1 |
0.0084 −22.8 |
||||
| Age, median (IQR) | 37 (30, 44) | 37 (31, 45) | 37 (29, 44) | 37 (30, 44) | 38 (30, 45) | 37 (31, 45) | 37 (31, 44) | 38 (32, 45) |
|
P‐value Standardized difference, % |
0.048 −7.3 |
0.064 −8.9 |
0.8939 1.2 |
0.2146 −12.8 |
||||
| Disease duration, median (IQR) | 6.9 (3.4, 11.9) | 6.4 (3.2, 11.6) | 6.3 (3.1, 11.6) | 5.8 (2.8, 11.0) | 6.6 (2.8, 11.5) | 6.0 (3.1, 11.3) | 7.9 (4.7, 11.7) | 8.1 (5.3, 13.4) |
|
P‐value Standardized difference, % |
0.104 2.6 |
0.114 3.2 |
0.7113 3.9 |
0.0991 −12.5 |
||||
| Proportion disease duration on DMT, median (IQR) | 0.5 (0.3, 0.8) | 0.4 (0.2, 0.6) | 0.6 (0.3, 0.8) | 0.4 (0.2, 0.6) | 0.4 (0.2, 0.7) | 0.3 (0.2, 0.6) | 0.6 (0.3, 0.8) | 0.4 (0.2, 0.6) |
|
P‐value Standardized difference, % |
<0.001 45.6 |
<0.0001 47.3 |
0.1483 13.0 |
<0.0001 53.3 |
||||
| Number of DMT starts mean (SD) | 1.5 (0.8) | 1.4 (0.7) | 1.3 (0.6) | 1.4 (0.7) | 1.0 (0.3) | 1.4 (0.7) | 2.4 (0.7) | 2.2 (5.7) |
|
P‐value Standardized difference, % |
0.743 0.4 |
0.0016 −15.9 |
<0.0001 −74.1 |
0.0051 22.8 |
||||
| Number of DMT starts/disease duration, mean (SD) | 0.3 (0.5) | 0.4 (0.4) | 0.3 (0.4) | 0.4 (0.5) | 0.36 (0.66) | 0.37 (0.43) | 0.42 (0.43) | 0.35 (0.34) |
|
P‐value Standardized difference, % |
0.094 −5.3 |
0.0057 −13.6 |
0.0001 −2.3 |
0.0056 16.8 |
||||
| Baseline EDSS, median (IQR) | 3 (2, 4.5) | 2.5 (2, 4) | 3 (2, 4) | 2.5 (2, 4) | 3.5 (2, 4.5) | 2.5 (2, 4) | 3.5 (2, 4.5) | 3 (2, 4.5) |
|
P‐value Standardized difference, % |
<0.001 16.2 |
0.0001 15.6 |
0.0004 24.6 |
0.262 7.1 |
||||
| Total relapse onsets last 12 months, mean (SD) | 2.0 (1.0) | 1.6 (0.9) | 2.0 (1.0) | 1.6 (0.8) | 2.0 (1.0) | 1.7 (0.9) | 2.0 (1.1) | 1.7 (0.9) |
|
P‐value Standardized difference, % |
<0.001 38.2 |
<0.0001 43.2 |
<0.0001 28.9 |
<0.0001 35.8 |
||||
| Total steroid‐treated relapses last 12 months, mean (SD) | 1.7 (1.1) | 0.9 (0.9) | 1.7 (1.1) | 0.9 (0.9) | 1.6 (1.1) | 1.0 (0.9) | 1.7 (1.1) | 1.0 (0.9) |
|
P‐value Standardized difference, % |
<0.001 70.7 |
<0.0001 74.3 |
<0.0001 64.3 |
<0.0001 66.4 |
||||
| Total relapse onsets last 24 months, mean (SD) | 2.9 (1.5) | 2.4 (1.4) | 2.9 (1.5) | 2.3 (1.3) | 2.8 (1.4) | 2.6 (1.4) | 3.1 (1.6) | 2.5 (1.6) |
|
P‐value Standardized difference, % |
<0.001 34.5 |
<0.0001 39.1 |
0.0053 18.7 |
<0.0001 35.9 |
||||
| Total steroid‐treated relapses last 24 months, mean (SD) | 2.3 (1.5) | 1.3 (1.3) | 2.3 (1.5) | 1.3 (1.3) | 2.2 (1.5) | 1.4 (1.3) | 2.5 (1.7) | 1.5 (1.5) |
|
P‐value Standardized difference, % |
<0.001 70.1 |
<0.0001 74.3 |
<0.0001 62.9 |
<0.0001 61.0 |
NTZ, natalizumab; IFNβ, interferon‐beta; GA, glatiramer acetate; IQR, interquartile range; DMT, disease‐modifying therapy; EDSS, Expanded Disability Status Scale.
3Imbalance defined as an absolute value ≥20%.
| Variable (at baseline) | Total population | Prior therapy with IFNβ | Prior therapy with GA | Prior therapy with IFNβ and GA | ||||
| NTZ | IFNβ/GA | NTZ | GA | NTZ | IFNβ | NTZ | IFNβ | |
| n | 869 | 869 | 578 | 578 | 165 | 165 | 176 | 176 |
| Female, % | 77.2 | 78.9 | 76.5 | 76.1 | 80.0 | 78.8 | 83.0 | 83.5 |
|
P‐value Standardized difference, % |
0.412 −4.2 |
0.9455 6.6 |
0.8957 5.5 |
0.8815 15.2 |
||||
| Age, median (IQR) | 38 (31, 45) | 37 (31, 45) | 38 (31, 44) | 37 (30, 43) | 38 (30, 45) | 38 (32, 46) | 39 (32, 46) | 38 (32, 45) |
|
P‐value Standardized difference, % |
0.518 3.2 |
0.8507 3.7 |
0.8458 6.5 |
0.6841 −15.9 |
||||
| Disease duration, median (IQR) | 6.8 (3.4, 12.0) | 6.2 (3.0, 11.6) | 6.3 (3.2, 11.9) | 5.8 (2.8, 11.2) | 6.4 (3.1, 10.3) | 5.5 (2.6, 10.3) | 8.0 (4.8, 12.6) | 8.1 (5.3, 13.4) |
|
P‐value Standardized difference, % |
0.340 2.0 |
0.1739 6.4 |
0.3567 −6.9 |
0.2384 −19.2 |
||||
| Proportion disease duration on DMT, median (IQR) | 0.4 (0.2, 0.6) | 0.4 (0.2, 0.6) | 0.4 (0.2, 0.7) | 0.4 (0.2, 0.7) | 0.3 (0.1, 0.5) | 0.3 (0.1, 0.6) | 0.4 (0.2, 0.6) | 0.4 (0.2, 0.6) |
|
P‐value Standardized difference, % |
0.434 −4.1 |
0.5014 −5.0 |
0.2818 −19.1 |
0.5272 18.3 |
||||
| Number of DMT starts mean (SD) | 1.4 (0.7) | 1.4 (0.7) | 1.2 (0.6) | 1.3 (0.7) | 1.0 (0.2) | 1.2 (0.5) | 2.2 (0.5) | 2.2 (0.4) |
|
P‐value Standardized difference, % |
0.178 3.9 |
0.4431 −9.8 |
0.5637 −18.9 |
0.7179 1.3 |
||||
| Number of DMT starts/disease duration, mean (SD) | 0.4 (0.6) | 0.4 (0.4) | 0.3 (0.4) | 0.4 (0.4) | 0.3 (0.5) | 0.4 (0.5) | 0.3 (0.3) | 0.4 (0.3) |
|
P‐value Standardized difference, % |
0.533 1.1 |
0.1832 −10.6 |
0.1288 11.0 |
0.3834 19.4 |
||||
| Baseline EDSS, median (IQR) | 3 (2, 4) | 3 (2, 4) | 3 (2, 4) | 3 (2, 4) | 3 (2, 4) | 2.5 (2, 4) | 3 (2, 4) | 3 (2, 4.5) |
|
P‐value Standardized difference, % |
0.138 6.6 |
0.6519 8.5 |
0.2375 8.2 |
0.4605 −14.1 |
||||
| Total relapse onsets last 12 months, mean (SD) | 1.6 (0.7) | 1.6 (0.9) | 1.59 (0.77) | 1.61 (0.94) | 1.76 (0.85) | 1.84 (0.95) | 1.64 (0.87) | 1.69 (0.92) |
|
P‐value Standardized difference, % |
0.670 −1.9 |
0.7929 7.0 |
0.5135 −18.8 |
0.7494 −4.9 |
||||
| Total steroid‐treated relapses last 12 months, mean (SD) | 0.9 (0.8) | 1.0 (0.9) | 0.98 (0.83) | 0.97 (0.92) | 1.15 (0.87) | 1.19 (0.97) | 0.96 (0.82) | 1.00 (0.91) |
|
P‐value Standardized difference, % |
0.090 −6.2 |
0.2891 −1.5 |
0.5899 −8.4 |
0.8566 −6.2 |
||||
| Total relapse onsets last 24 months, mean (SD) | 2.4 (1.2) | 2.4 (1.3) | 2.4 (1.2) | 2.4 (1.3) | 2.6 (1.3) | 2.6 (1.4) | 2.5 (1.3) | 2.5 (1.6) |
|
P‐value Standardized difference, % |
0.407 2.3 |
0.9629 8.5 |
0.7601 −19.2 |
0.7484 15.7 |
||||
| Total steroid‐treated relapses last 24 months, mean (SD) | 1.3 (1.1) | 1.4 (1.2) | 1.4 (1.1) | 1.4 (1.3) | 1.6 (1.3) | 1.6 (1.3) | 1.5 (1.2) | 1.5 (1.5) |
|
P‐value Standardized difference, % |
0.198 −4.3 |
0.5144 −1.5 |
0.9086 −9.5 |
0.8427 −0.9 |
NTZ, natalizumab; IFNβ, interferon‐beta; GA, glatiramer acetate; IQR, interquartile range; DMT, disease‐modifying therapy; EDSS, Expanded Disability Status Scale.
5Imbalance defined as an absolute value ≥20%.
Relapse rate
During the first 12 months after treatment switch, ARR was higher in patients who switched to another BRACE therapy (mean, 0.58; SD, 0.86) than in those who switched to natalizumab (mean, 0.20; SD, 0.52) (P < 0.0001), representing a 66% relative reduction in ARR for patients who switched to natalizumab. This difference was sustained over subsequent years (Table ). Over the study period, patients who switched to natalizumab had a 54% reduction in the risk of first relapse (hazard ratio [HR], 0.46; 95% confidence interval [CI], 0.39–0.53; P < 0.001) (Fig. A). When the analysis was limited to the first 12 months after treatment switch, the risk of first on‐treatment relapse was reduced by 65% for patients who switched to natalizumab (HR, 0.35; 95% CI, 0.28–0.44; P < 0.001).
Annualized relapse rates by treatment group and postbaseline year| Total population | Prior therapy with IFNβ | Prior therapy with GA | Prior therapy with IFNβ and GA | |||||
| No. of patients | ARR, mean (SD) | No. of patients | ARR, mean (SD) | No. of patients | ARR, mean (SD) | No. of patients | ARR, mean (SD) | |
| Year 1 | ||||||||
| Natalizumab | 607 | 0.20 (0.52) | 439 | 0.16 (0.50) | 112 | 0.21 (0.47) | 125 | 0.14 (0.39) |
| BRACE | 497 | 0.58 (0.86) | 369 | 0.54 (0.86) | 113 | 0.60 (0.82) | 95 | 0.55 (0.78) |
| P‐value | <0.0001 | <0.0001 | <0.0001 | <0.0001 | ||||
| Year 2 | ||||||||
| Natalizumab | 372 | 0.18 (0.38) | 269 | 0.19 (0.50) | 63 | 0.24 (0.50) | 75 | 0.21 (0.50) |
| BRACE | 333 | 0.48 (0.59) | 257 | 0.43 (0.75) | 95 | 0.38 (0.70) | 61 | 0.48 (1.03) |
| P‐value | <0.0001 | <0.0001 | 0.1721 | 0.0475 | ||||
| Year 3 | ||||||||
| Natalizumab | 189 | 0.16 (0.28) | 143 | 0.03 (0.18) | 31 | 0.03 (0.18) | 29 | 0.07 (0.26) |
| BRACE | 219 | 0.39 (0.46) | 167 | 0.29 (0.56) | 81 | 0.10 (0.32) | 40 | 0.30 (0.65) |
| P‐value | <0.0001 | <0.0001 | 0.2533 | 0.0517 | ||||
| Year 4 | ||||||||
| Natalizumab | 59 | 0.14 (0.25) | 62 | 0.00 (0.00) | 10 | 0.10 (0.32) | 6 | 0.00 (0.00) |
| BRACE | 166 | 0.36 (0.42) | 133 | 0.21 (0.49) | 78 | 0.22 (0.47) | 27 | 0.26 (0.59) |
| P‐value | 0.0002 | 0.0009 | 0.4361 | 0.2946 |
IFNβ, interferon‐beta; GA, glatiramer acetate; ARR, annualized relapse rate.
7Patients were only included in the analysis for a given year if they were both on‐treatment and followed up through the entire the year.
Treatment persistence
For patients who switched to natalizumab there was a 60% reduction in the risk of further treatment discontinuation (HR, 0.40; 95% CI, 0.34–0.47; P < 0.001) (Fig. B). Limiting the model to the first 12 months after treatment switch increased the effect size. Patients who switched to natalizumab had a 74% reduction in the risk of treatment discontinuation (HR, 0.26; 95% CI, 0.20–0.34, P < 0.001). Despite longer mean follow‐up in the BRACE treatment arm, competing risks models for both the time to first relapse and treatment discontinuation confirmed that this difference did not significantly influence the estimated HRs. Forty‐one (4.7%) of the 869 matched patients who switched to natalizumab tested positive for anti‐JCV antibodies at least once during the follow‐up period.
Disability progression
Of the 869 propensity score matched pairs, a total of 374 patients in the BRACE arm and 514 patients in the natalizumab arm met the minimum requirement of three reported EDSS scores (including baseline) and were included in the disability progression analysis. There were no significant differences in baseline characteristics between the groups. Patients who switched to natalizumab had a 26% reduction in the risk of 3‐month confirmed disability progression (HR, 0.74; 95% CI, 0.55–0.97; P = 0.036) (Fig. C). There was no significant difference in time to confirmed disability progression when this analysis was limited to the first 12 months after treatment switch (HR, 0.86; 95% CI, 0.51–1.44; P = 0.561).
Of the 1738 propensity score matched patients in the total study population, 568 had the minimum on‐treatment follow‐up of 24 months required for inclusion in the AUC analysis. There were no significant differences in any of the baseline characteristics between the treatment groups, however, ascertainment of EDSS during the 24‐month interval was significantly more frequent in the BRACE arm compared with the natalizumab arm. Within the 24‐month AUC analysis time window, the mean (SD) number of visits with an EDSS score reported was 4.75 (1.72) in the BRACE arm and 3.67 (0.65) in the natalizumab arm (P = 0.0001).
Patients switching from BRACE to natalizumab had significantly less total disability burden, as measured by standardized 24‐month AUC values, compared to patients who switched between BRACE therapies. The mean cumulative AUC was decreased by 0.64 EDSS‐years in the natalizumab treatment arm compared to the BRACE treatment arm (natalizumab: mean [SD], −3.30 [1.65] EDSS‐years; BRACE: −2.66 [1.70] EDSS‐years; P < 0.0001). On quantile regression, median standardized 24‐month AUC was decreased by 1.54 EDSS‐years (95% CI −2.30, −0.78) (P < 0.0001) in patients who switched to natalizumab compared to those who switched to BRACE treatments. In a sensitivity analysis, AUC was measured using the trapezoidal rule; median standardized 24‐month AUC was decreased by 1.01 EDSS‐years in the natalizumab group compared to the BRACE group (P = 0.001) when this method was employed. For comparison, time to first 3‐month confirmed disability progression was also assessed over the same 24‐month time window and in the subset of patients used in the AUC analysis (including only propensity‐matched patients who remained on the new therapy ≥24 months after switching). In this group, patients who switched to natalizumab had a 45% reduction in the risk of 3‐month confirmed disability progression (HR, 0.55; 95% CI, 0.35–0.88; P = 0.012). To test this result for potential ascertainment bias secondary to unequal frequency of EDSS assessment points and/or unequal time between assessments by treatment arm, we reran this model limiting the analysis to just the subset of patients who recorded exactly five visits (at baseline, 6, 12, 18, and 24 months) within the 24‐month consideration period. Applying, successively, a 1, 1.5, and 2‐month time range buffer around each 6‐month assessment point we observed a significant decrease in median standardized 24‐month AUC of 1.68 EDSS‐years (95% CI −2.51, −0.69), 1.59 EDSS‐years (95% CI −2.47, −0.72), and 1.56 EDSS‐years (95% CI −2.35, −0.75), respectively, in the natalizumab switch arm relative to the BRACE switchers. These results are consistent with the primary analysis with only a marginal broadening of the CIs around the point estimates consistent with the loss of sample associated with each sensitivity analyses. This suggests that the results of the primary analysis are relatively resistant to any ascertainment bias conferred by the minor imbalances in 24‐month EDSS assessment frequency and time between assessments.
Subgroup analyses by prior BRACE treatment
After propensity scores were used to match patients in TOP and MSBase independently in each prior treatment subgroup, there were no significant differences in the baseline characteristics between treatment arms in any subgroup (Table ). Mean (SD) follow‐up in subgroup 1 (patients with only prior IFNβ therapy who switched to GA or natalizumab) was 2.24 (2.30) years in the GA group compared with 1.98 (1.23) years in the natalizumab group; in subgroup 2 (patients with only prior GA therapy who switched to IFNβ or natalizumab) it was 1.69 (2.01) years in the IFNβ group compared with 1.73 (1.17) years in the natalizumab group; in subgroup 3 (patients with both prior IFNβ and GA therapy who switched to another IFNβ or natalizumab) it was 1.82 (1.94) years in the IFNβ group compared with 1.79 (1.13) years in the natalizumab group.
In all subgroups, on‐treatment ARR in the first 12 months after switching treatment was lower in patients who switched to natalizumab compared to those who switched to another BRACE therapy; the relative reduction in ARR was 70% in subgroup 1, 65% in subgroup 2, and 75% in subgroup 3. ARR remained lower in the natalizumab group in subsequent years in all subgroups (Table ). Patients who switched to natalizumab also had a lower risk of first relapse and a lower risk of treatment discontinuation compared to patients who switched to another BRACE therapy in all subgroups. Figures , display the Kaplan–Meier curves of time to first relapse and treatment discontinuation for each prior treatment subgroup; relative risk reductions and rate increases associated with each treatment decision are included in the text on each figure.
Sensitivity analyses
To assess the sensitivity of our propensity matched models to potential confounding secondary to imbalance of baseline MRI metrics, we remodeled treatment arm as a predictor of first on‐treatment relapse, switch therapy discontinuation and 3‐month confirmed disability progression incorporating baseline cerebral MRI metrics, where available, as adjusting covariates in the Cox marginal model. The reduction in the rate of first on‐treatment relapse associated with natalizumab relative to BRACE observed in the matched primary analysis (HR 0.46, 95% CI 0.39–0.53, reference = BRACE) was strongly resistant to the influence of MRI lesion type and frequency with only marginal changes in the adjusted hazard ratio (aHR) point estimate and associated CI observed (aHR 0.47, 95% CI 0.35–0.62 adjusted for ≥1 T1 Gd+ lesions; aHR 0.48, 95% CI 0.37, 0.62 adjusted for ≥9 T2 hyperintense lesions and aHR 0.46, 95% CI 0.31–0.68 adjusted for all of ≥1 T1 Gd+, ≥9 T2 hyperintense, ≥1 infratentorial, ≥1 juxtacortical and ≥2 periventricular lesions). A similar preservation of the effect size estimated in the primary analysis was further observed when both the time to switch therapy discontinuation and disability progression models were extended to adjust for baseline MRI data. The MRI‐adjusted model of both the treatment discontinuation and disability progression models returned adjusted HR point estimates that differed by only 0.01 (treatment discontinuation: aHR 0.39. 95% CI 0.26–0.59 compared with a primary analysis estimate of HR 0.40, 95% CI 0.34–0.47; disability progression: aHR 0.75, 95% CI 0.54–0.98 adjusted model, HR 0.74, 95% CI 0.55–0.98 primary analysis).
Using post hoc Rosenbaum sensitivity analyses of our propensity‐matched relapse, persistence and progression models we estimated that an unobserved confounder would need to produce a minimum 3.01‐, 2.75‐, and 3.18‐fold increase in the rate of relapse, discontinuation, and progression, respectively, in order to reject the inference of a treatment effect in favor of selection effects. These represent improbably large differences in the context of the point estimates and associated CIs observed, thus we can conclude that our observation of efficacy and persistence differentials by switch treatment arm are reasonably robust to unmeasured influences.
Discussion
There are no head‐to‐head randomized clinical trials comparing efficacy outcomes between patients who switch to natalizumab or to another BRACE therapy after a BRACE treatment failure, so that this question can currently only be examined in real‐world datasets, including cohort studies such as MSBase and TOP. Using propensity score matched samples from MSBase registry and TOP observational dataset, we demonstrated that superior outcomes were achieved in patients who switched to natalizumab after an on‐treatment relapse. Compared to patients who switched between BRACE therapies, patients who switched to natalizumab had significantly reduced risks of further relapse occurrence, treatment discontinuation, and disability progression. Cumulative 24‐month total disability burden, assessed using an exploratory AUC analysis, was also significantly lower in patients who switched to natalizumab. Subgroup analyses demonstrated that similar relapse and treatment discontinuation results are observed regardless of the type of prior BRACE treatment. Whilst the relative reduction in ARR associated with natalizumab was similar across all three prior treatment subgroups (ranging from 65% to 75%), the comparative hazard of first relapse on switch therapy associated with natalizumab relative to BRACE was greatest in those patients previously exposed to both IFNβ and GA (Fig. ). This same subgroup also recorded the greatest differential in switch therapy discontinuation rates across all three subgroups (Fig. ). This suggests that there may be identifiable subsets of patients who respond differently to IFNβ and/or GA. However, regardless of the identity or sequence of prior BRACE exposure, natalizumab treatment initiation was observed to be consistently associated with an efficacy advantage relative to BRACE switches.
Smaller studies have demonstrated results broadly consistent with these findings. Lanzillo and colleagues performed an adjusted analyses of 12‐month outcomes after natalizumab or Rebif® initiation (n = 42/group, mixed pretreated and treatment‐naïve at baseline) and showed better relapse, MRI, and disability outcomes in the natalizumab group. In a prospective, observational propensity‐score adjusted but unmatched study of 267 relapsing‐remitting MS patients in two Italian centers, Prosperini et al. demonstrated that patients who escalated to natalizumab (n = 106) after first‐line treatment failure on IFNβ or GA had a significantly higher probability of remaining relapse free, disability progression free, and MRI activity free over the next 24 months after switching treatment compared to patients who switched between IFNβ and/or GA formulations (n = 161). These investigators controlled for some of the imbalance in baseline disease characteristics by deriving a propensity score of treatment assignation and adjusting for it, but a propensity matching approach such as the one detailed here has previously been demonstrated to provide superior control of confounding factors and thus superior attribution of treatment benefit compared to nonmatched multivariable regression models. This is true even when regression models are fully adjusted for all available baseline characteristics. Unlike randomized controlled trials, propensity score based approaches cannot adjust for confounder imbalance in baseline characteristics that have not been recorded. However, propensity matching as a variety of pseudo‐randomization has been demonstrated to both reduce selection bias and closely approximate the risk estimates derived from randomized trials, including in the MSBase dataset.
The AUC serial disability time plots, albeit exploratory, were attempted to capture and estimate the total burden of complex disability trajectories commonly observed for relapsing MS patients in a clinical practice setting. Compared with the more commonly used summary measures such as the time to first confirmed disability progression analysis, which we have also presented herein, an AUC analysis arguably permits better estimation of a patient's total study duration experience with respect to disability progression and thus superior attribution of any differences observed between treatment groups. Since these serial disability plots explicitly attempt to capture and quantify the total changes in a patient's on‐treatment course, the use of an AUC disability metric is proposed to be more clinically meaningful than summary measures of EDSS change. In our analyses, treatment persistence was markedly longer after switch to natalizumab then switch to IFNβ/GA. These results are consistent with an analysis of U.S. claims database which also showed that patients who switched to natalizumab demonstrated greater treatment persistence compared to those who switched to an alternative DMT.
While this study focused on treatment efficacy and persistence, these are not the only important factors for clinicians to consider when weighing these treatment options. Treatment safety, in particular the risk of natalizumab‐associated progressive multifocal leukoencephalopathy (PML), must also be assessed. Although not addressed here, evaluation of comparative natalizumab treatment benefits in clinical practice needs to be balanced with appropriate risk‐stratification for PML, including testing for JC virus antibody status, to optimize informed and personalized treatment decisions.
The strongest results of our study concern the efficacy differentials observed in time to first relapse and treatment persistence favoring natalizumab. Although a comparable advantage was further observed with regards to confirmed disability progression, this result is less robust as it applies to that subset of the larger eligible sample who recorded a minimum of three prospective EDSS assessments. Furthermore, our study only considers switches from BRACE to natalizumab and not alternate switch scenarios such as natalizumab to newer era oral disease‐modifying drugs (DMDs). Generalization of the efficacy advantages observed in this study for patients who switched to natalizumab may be limited by the characteristics of this patient population (most were recruited from large tertiary MS centers) and by the potential for treatment indication bias that may not have been adjusted for in the matched datasets. Propensity score matching was employed in this study to eliminate or reduce known or suspected confounders of treatment allocation. However, unlike true randomization, propensity matching cannot eliminate confounding secondary to imbalance of unknown or unmeasured confounders, and this remains a major limitation of this study. However, it would be expected that any residual bias would not favor the natalizumab cohort, as the known baseline variables in the unmatched populations indicated that those switching to natalizumab had much worse disease (Table S1). Whilst subgroup and sensitivity analyses consistently demonstrated comparable efficacy advantages for patients who switched to natalizumab, future analyses adjusting for an expanded set of baseline characteristics, such as lesion number and distribution on baseline cerebral MRI, would be useful to corroborate these observations.
In the absence of randomized clinical trials, propensity‐matching techniques can estimate the benefits associated with various treatment decisions in a clinical practice setting. Using a large real‐world dataset, we have shown that patients who relapse on BRACE therapies have better outcomes if they switch to natalizumab rather than switching to another BRACE therapy. This extends to relapse rates, treatment persistence and, in the largest cohort examined, rates of first disability progression events.
Acknowledgments
MSBase study group co‐investigators and contributors: From the MS‐Centrum Nijmegen, Nijmegen, The Netherlands Cees Zwanikken; from Hospital S. Joao, Porto, Portugal, Maria Edite Rio; Veszprem Megyei Csolnoky Ferenc Korhaz, Veszprem, Hungary, Imre Piroska; from Jewish General Hospital, Montreal, Canada, Fraser Moore; from Josa Andras Hospital, Nyiregyhaza, Tunde Erdelyi; The Alfred Hospital and Monash University, Melbourne, Australia, Olga Skibina; from Cliniques Universitaires Saint‐Luc, Brussels, Belgium, Vincent Van Pesch; from Ospedali Riuniti di Salerno, Salerno, Italy, Gerardo Iuliano; from Jeroen Bosch Ziekenhuis, Den Bosch, The Netherlands, Erik van Munster; from FLENI, Buenos Aires, Argentina, Marcela Fiol, Jorge Correale and Celica Ysrraelit; from Department NEUROFARBA, Section of Neurosciences, University of Florence, Florence, Italy, Maria Pia Amato; from Francicus Ziekenhuis, Roosendaal, The Netherlands, Leontien den Braber‐Moerland; from New York University Langone Medical Center, New York, USA, Joseph Herbert and Iliya Kister; from Hopital Tenon, Paris, France, Etienne Roullet; from Jahn Ferenc Teaching Hospital, Budapest, Hungary, Krisztian Kasa; from Central Clinical Emergency Military Hospital, Bucharest, Romania, Carmen‐Adella Sirbu; from the Geelong Hospital, Geelong, Australia, Cameron Shaw; from HIGA Gral. San Martin, La Plata, Argentina, Santiago Vetere; from the Westmead Hospital, Sydney, Australia, Steve Vucic; from the Clinic of Neurology Clinical Center, Skopje, Macedonia, Tatjana Petkovska‐Boskova; from the Bombay Hospital Institute of Medical Sciences, Mumbai, India, Bhim Singhal; from the Instituto de Neurociencias, Cordoba, Argentina, Elizabeth Alejandra Bacile Bacile; from the Hospital Ecoville, Brazil, Walter Oleschko Arruda; from the Center hospitalier del'Universite de Montreal, Hopital Notre‐Dame, Canada, Elaine Roger and Pierre Despault; from the Royal Melbourne Hospital, Australia, Mark Marriott, Anneke Van der Walt, John King, Jill Byron and Lisa Morgan; from Box Hill Hospital, Monash University, Australia, Jodi Haartsen; from Department of Neuroscience and Imaging, University “G. d'Annunzio”, Italy, Giovanna De Luca, Valeria Di Tommaso, Daniela Travaglini, Erika Pietrolongo, Maria di Ioia, Deborah Farina and Luca Mancinelli; from Hospital Italiano, Argentina, Juan Ignacio Rojas and Liliana Patrucco; from Ospedale di Macerata, Italy, Elisabetta Cartechini and Giorgio Giuliani; from John Hunter Hospital, Australia, David Williams and Lisa Dark; from Buenos Aires, Argentina, Aldo Savino; and from Sheba Medical Center, Tel Hashomer, Israel, Joab Chapman; from Assaf Harofeh Medical Center, Beer‐Yaakov, Israel, Shlomo Flechter; from Hospital Italiano, Buenos Aires, Argentina, Edgardo Cristiano; from Centro Internacional de Restauracion Neurologica, Havana, Cuba. Jose Antonio Cabrera‐Gomez; from INEBA, Buenos Aires, Argentina, Maria Laura Saladino; from Hospital Fernandez, Buenos Aires, Argentina, Norma Deri; from Craigavon Area Hospital, Portadown, U.K., Orla Gray; from St Vincent's Hospital, Melbourne, Australia; Mark Paine; and from Mater Dei Hospital, Malta; Norbert Vella; Samir Méchati, Eric Bianchi, Alexandru Bulla and Matthieu Corageoud. No compensation has been received for the persons who have made substantial contributions to the work but do not qualify as authors. Nolan Campbell of Biogen Idec provided editorial assistance which involved reference management, coordination of author feedback and manuscript versioning management. Patrick Campbell of Biogen Idec provided minor graphic design assistance with a subset of figures during the development of this manuscript.
Author Contributions
T. Spelman conceptualized and designed the study, conducted and interpreted the analysis and drafted, revised and approved the manuscript. H. Butzkueven conceptualized the study and drafted, revised and approved the manuscript. T. Kalincik and S. Belachew conceptualized the study and revised and approved the manuscript. A. Zhang, F. Pellegrini, H. Wiendl, L. Kappos, L. Tsvetkova, R. Hyde, F. Verheul, F. Grand‐Maison, G. Izquierdo, P. Grammond, P. Duquette, A. Lugaresi, J. Lechner‐Scott, C. Oreja‐Guevara, R. Hupperts, T. Petersen, M. Barnett, and M. Trojano contributed substantially to data acquisition, interpretation of the analysis and have revised and approved the manuscript.
Conflict of Interest
Alessandra Lugaresi is a Bayer Schering, Biogen Idec, Genzyme/Sanofi, Merck Serono Advisory Board Member. She received travel grants and honoraria from Bayer Schering, Biogen Idec, Genzyme, Merck Serono, Novartis, Sanofi and Teva and research grants from Bayer Schering, Biogen Idec, Merck Serono, Novartis, Sanofi and Teva. Prof Lugaresi has also received travel and research grants from the Associazione Italiana Sclerosi Multipla and was a Consultant of “Fondazione Cesare Serono”. Annie Zhang is an employee of Biogen Idec Inc. Celia Oreja‐Guevara reports no conflicts of interest. Fabio Pelligrini received honoraria for speaking and personal compensation for consulting services from Biogen Idec. Francois Grand' Maison received an honorarium for organizing a CME event for Biogen Idec in 2013 and received consultation fees from Biogen Idec as well as from Novartis and Genzyme in 2013 and 2014. Freek Verheul reports no conflicts of interest. Guillermo Izquierdo received consulting fees from Bayer Schering, Biogen Idec, Merck Serono, Novartis, Sanofi, and Teva. Heinz Wiendl received compensation for serving on scientific advisory boards for Bayer Healthcare, Biogen Idec, Genzyme, Merck Serono, Novartis, and Sanofi; speaker honoraria and travel support from Bayer Schering AG, Bayer Vital GmbH, Biogen Idec, CSL Behring, Fresenius Medical Care, Genzyme, GlaxoSmithKline, GW, Merck Serono, Novartis, and Sanofi; compensation as a consultant from Biogen Idec, Merck Serono, Novartis, and Sanofi; research support from Bayer Vital GmbH, Biogen Idec, Merck Serono, Novartis, Sanofi Germany, and Sanofi U.S. Helmut Butzkueven received compensation for serving on scientific advisory boards and as a consultant for Biogen Idec and Novartis; speaker honoraria from Biogen Idec Australia, Merck Serono Australia, and Novartis Australia; travel support from Biogen Idec Australia and Merck Serono Australia; research support from CASS Foundation (Australia), Merck Serono Australia, the Royal Melbourne Hospital Friends of the Neurosciences Foundation, and the University of Melbourne. Jeannette Lechner Scott reports no conflicts of interest. Larisa Tsvetkova is an employee of Biogen Idec Inc. Maria Trojano received honoraria for consultancy and/or speaking from Biogen Idec, Genzyme‐Sanofi, Merck Serono, Novartis, and Roche; research grants from Biogen Idec, Merck Serono, Novartis, and Teva. Michael Barnett has received honoraria for participation in advisory boards and travel sponsorship from Novartis, BioCSL, Genzyme and Biogen Idec. Pierre Duquette has received honoraria for organizing CME events and has obtained funding to attend meetings from Biogen Idec, EMD Serono, TEVA Neuroscience, Novartis, and Genzyme, has received funding for investigator‐initiated trials with Biogen Idec, EMD Serono and Novartis, and has received peer‐review funding from CIHR and from the MS Society of Canada. Pierre Grammond is a Novartis, Teva‐neuroscience, Biogen Idec advisory board member, consultant for Merck Serono, received payments for lectures by Merck Serono, Teva‐Neuroscience and Canadian Multiple sclerosis society, and received grants for travel from Teva‐Neuroscience and Novartis. Raymond Hupperts received honoraria as consultant on scientific advisory boards from Merck‐Serono, Biogen‐Idec, Genzyme‐Sanofi and Teva, research funding from Merck‐Serono and Biogen‐Idec, and speaker honoraria from Sanofi‐Genzyme. Robert Hyde is an employee of Biogen Idec Inc. Shibeshih Belachew is an employee of Biogen Idec Inc. Thor Petersen received funding or speaker honoraria from Biogen Idec, Merck Serono, Novartis, Bayer Schering, Sanofi‐Aventis, Roche, and Genzyme. Tim Spelman received honoraria for consultancy and funding for travel from Biogen Idec Inc. Tomas Kalincik received compensation for travel from Novartis, Biogen Idec, Sanofi Aventis, Teva and Merck Serono.
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2015. This work is published under http://creativecommons.org/licenses/by-nc-nd/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
Objective
To compare treatment efficacy and persistence in patients who switched to natalizumab versus those who switched between glatiramer acetate (
Methods
Patients included were registered in
Results
Compared to switching between
Interpretation
Using large, real‐world, propensity‐matched datasets we demonstrate that after a relapse on
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details
1 Department of Medicine and Melbourne Brain Centre at the Royal Melbourne Hospital, University of Melbourne, Melbourne, Australia
2 Biogen Idec Inc., Cambridge, Massachusetts
3 Department of Basic Medical Sciences, Neuroscience and Sense Organs, University of Bari, Bari, Italy
4 Department of Neurology, University of Münster, Münster, Germany
5 Department of Neurology, University Hospital Basel, Basel, Switzerland
6 Biogen Idec Int BV, Badhoevedorp, The Netherlands
7 Groene Hart Ziekenhuis, Gouda, The Netherlands
8 Neuro Rive‐Sud, Hôpital Charles LeMoyne, Quebec, Canada
9 Hospital Universitario Virgen Macarena, Sevilla, Spain
10 Center de réadaptation déficience physique Chaudière‐Appalache, Levis, Canada
11 Hôpital Notre Dame, Montreal, Quebec, Canada
12 MS Center, Department of Neuroscience, Imaging and Clinical Sciences, University “G. d'Annunzio”, Chieti, Italy
13 John Hunter Hospital, Newcastle, Australia
14 University Hospital San Carlos, Madrid, Spain
15 Orbis Medical Centre, Sittard‐Geleen, The Netherlands
16 Kommunehospitalet, Arhus C, Denmark
17 Brain and Mind Research Institute, Sydney, Australia
18 Department of Medicine and Melbourne Brain Centre at the Royal Melbourne Hospital, University of Melbourne, Melbourne, Australia; Department of Neurology, Eastern Health, Monash University, Box Hill, Australia




