Applying the win ratio method in clinical trials of orphan drugs: an analysis of data from the COMET trial of avalglucosidase alfa in patients with late-onset Pompe disease

Abstract

Background

Clinical trials for rare diseases often include multiple endpoints that capture the effects of treatment on different disease domains. In many rare diseases, the primary endpoint is not standardized across trials. The win ratio approach was designed to analyze multiple endpoints of interest in clinical trials and has mostly been applied in cardiovascular trials. Here, we applied the win ratio approach to data from COMET, a phase 3 trial in late-onset Pompe disease, to illustrate how this approach can be used to analyze multiple endpoints in the orphan drug context.

Methods

All possible participant pairings from both arms of COMET were compared sequentially on changes at week 49 in upright forced vital capacity (FVC) % predicted and six-minute walk test (6MWT). Each participant’s response for the two endpoints was first classified as a meaningful improvement, no meaningful change, or a meaningful decline using thresholds based on published minimal clinically important differences (FVC ± 4% predicted, 6MWT ± 39 m). Each comparison assessed whether the outcome with avalglucosidase alfa (AVA) was better than (win), worse than (loss), or equivalent to (tie) the outcome with alglucosidase alfa (ALG). If tied on FVC, 6MWT was compared. In this approach, the treatment effect is the ratio of wins to losses (“win ratio”), with ties excluded.

Results

In the 2499 possible pairings (51 receiving AVA × 49 receiving ALG), the win ratio was 2.37 (95% confidence interval [CI], 1.30–4.29, p = 0.005) when FVC was compared before 6MWT. When the order was reversed, the win ratio was 2.02 (95% CI, 1.13–3.62, p = 0.018).

Conclusion

The win ratio approach can be used in clinical trials of rare diseases to provide meaningful insight on treatment benefits from multiple endpoints and across disease domains.