Keeping phase III tuberculosis trials relevant: Adapting to a rapidly changing landscape

Abstract

Furthermore, knowledge about the epidemic itself continues to evolve with a recognition of the growing importance of the transmission of DR-TB [18,19] and increasing levels of second-line drug resistance [20]. [...]in 2017, among the 10.0 million people developing TB disease, 558,000 (5.6%) developed a form that was resistant to at least rifampicin, the most effective first-line drug, and 230,000 died of it. Key dates are also included from the case study of the STREAM trial, a trial comparing a 9- to 11-month regimen containing high-dose moxifloxacin and clofazimine with the 20- to 24-month WHO-recommended standard of care regimen for MDR-TB, which is discussed further in Box 1. https://doi.org/10.1371/journal.pmed.1002767.t001 Given the unavoidably protracted duration of phase III TB trials in the 21st century, the status of TB as a global health priority (the first ever United Nations [UN] General Assembly high-level meeting on TB was held in September, 2018), and the increasing trial costs relative to a huge shortfall in research and development funding [21], those who conduct clinical trials are obligated to design them in such a way that they will have a direct impact on policy and practice of TB treatment at the projected time of trial completion. Conclusions Just over 10 years ago, calls to action were published for innovations in drug development, capacity building for TB trials, and execution of clinical trials of treatment for DR-TB [72–74]. Since November, 2007, 538 TB clinical trials have been posted on clinicaltrials.gov; 27 (5%) of these have been for DR-TB. [...]we strongly believe that TB treatment trials today should favor innovative approaches that are able to produce high-quality evidence for high-quality, patient-centered care that can be made accessible to all 10 million new TB patients, including the half-million with DR-TB, each year.

About the Authors:

Patrick P. J. Phillips

* E-mail: [email protected]

Affiliation: School of Medicine, UCSF Center for TB, University of California San Francisco, San Francisco, California, United States of America

ORCID logo http://orcid.org/0000-0002-6336-7024

Carole D. Mitnick

Affiliation: Harvard Medical School, Boston, Massachusetts, United States of America

ORCID logo http://orcid.org/0000-0002-3455-658X

James D. Neaton

Affiliation: School of Public Health, University of Minnesota, Minneapolis, Minnesota, United States of America

Payam Nahid

Affiliation: School of Medicine, UCSF Center for TB, University of California San Francisco, San Francisco, California, United States of America

ORCID logo http://orcid.org/0000-0003-2811-1311

Christian Lienhardt

Affiliation: Unité Mixte Internationale TransVIHMI (UMI 233 IRD, U1175 INSERM, Université de Montpellier), Institut de Recherche pour le Développement Montpellier, Montpellier, France

Andrew J. Nunn

Affiliation: Medical Research Council Clinical Trials Unit at University College London, London, United Kingdom

ORCID logo http://orcid.org/0000-0002-9158-4595

Introduction

One of the first multicenter randomized trials was the British Medical Research Council (MRC) streptomycin trial [1]. From the first meeting of the special committee to “plan trials of streptomycin in tuberculosis” in September, 1946, the primary trial results from 107 participants followed for 12 months were published in the British Medical Journal two years later in October, 1948 [2]. Although treatment with a single drug was subsequently shown to be inadequate because of the generation of drug resistance [3], the results of the trial changed clinical practice [1].

It has, however, become difficult to conduct phase III clinical trials in the 21st century in any disease area in such a short time frame. Trials often require more patients to show benefit, and their initiation is often protracted because of the need for independent ethical review(s), approval by national regulatory bodies, and the training and compliance with Good Clinical Practice (GCP) that is necessary to ensure that the trial is designed and conducted to the highest standards. All of these changes have been aimed, rightly, at protecting participants and ensuring reliable results, but they have also limited the ability to conduct clinical trials to respond quickly to important public health questions, especially in the context of a rapidly evolving disease and treatment landscape. The interval from start of enrollment to first public presentation of results of recent phase III tuberculosis (TB) trials ranges from 4.6–8.4 years [4–7]. This does not include time for design, planning, and ethical and regulatory approvals prior to start of recruitment, which commonly takes at least a year, and is consistent with a systematic review of time to publication of results across other disease areas [8].

The landscape of TB treatment has evolved considerably over the last 10 years—particularly in the management of drug-resistant TB (DR-TB). Changes include the earlier diagnosis of DR-TB with widespread implementation of newer tests such as GeneXpert [9,10] and Line Probe Assays [11], a better understanding of the pharmacology and bactericidal activity of the various drugs used [12], and the introduction of new drugs (bedaquiline with accelerated approval by the United States Food and Drug Administration [FDA] in December, 2012 and delamanid with conditional approval by the European Medicines Agency [EMA] in November, 2013), as well as observational studies and clinical trials investigating various combinations of current, new, and repurposed drugs in an attempt to shorten DR-TB therapies [13–17]. These developments are reflected in evolving World Health Organization (WHO) guidance for DR-TB (see Table 1). Furthermore, knowledge about the epidemic itself continues to evolve with a recognition of the growing importance of the transmission of DR-TB [18,19] and increasing levels of second-line drug resistance [20]. Thus, in 2017, among the 10.0 million people developing TB disease, 558,000 (5.6%) developed a form that was resistant to at least rifampicin, the most effective first-line drug, and 230,000 died of it. The severity of national epidemics varies widely among countries. Estimated prevalence of rifampicin-resistant TB (RR-TB) among new TB cases ranges from 1.3% in Kenya to 38.0% in Belarus among the 30 high-TB–burden countries [20].

[Figure omitted. See PDF.]

Table 1. Summary of WHO guidelines, policies, and statements on the treatment of DR-TB.

Guidelines for the treatment of DS-TB are not included because these have remained largely unchanged in this period. Key dates are also included from the case study of the STREAM trial, a trial comparing a 9- to 11-month regimen containing high-dose moxifloxacin and clofazimine with the 20- to 24-month WHO-recommended standard of care regimen for MDR-TB, which is discussed further in Box 1.

https://doi.org/10.1371/journal.pmed.1002767.t001

Given the unavoidably protracted duration of phase III TB trials in the 21st century, the status of TB as a global health priority (the first ever United Nations [UN] General Assembly high-level meeting on TB was held in September, 2018), and the increasing trial costs relative to a huge shortfall in research and development funding [21], those who conduct clinical trials are obligated to design them in such a way that they will have a direct impact on policy and practice of TB treatment at the projected time of trial completion. In this paper, as part of a PLOS Medicine Collection on Advances in Clinical Trial Design for Development of New TB Treatments [22], we discuss how phase III TB trials could be designed with such “future-proofing” in mind.

Choice of control

It is usual for the comparator in a clinical trial to be the standard of care treatment so that the results can be interpreted in relation to current practice [23]. Furthermore, the principle of clinical equipoise provides an ethical obligation to ensure patients on the control arm receive the best available standard of care [24]. In drug-sensitive TB (DS-TB), a 6-month regimen of rifampicin and isoniazid, supplemented by pyrazinamide and ethambutol in the first 2 months, is the recognized standard of care [25]; all recent phase III trials have therefore used this regimen as the internal control. For DR-TB, WHO guidelines provide a recipe for constructing an effective regimen based on the combination of drugs from various classes, leading to variability in terms of regimen composition across patients and trial sites. The most recent guidelines go further and recommend both long and short regimens [26]. For these reasons, and in the absence of an established standard, trials have selected various approaches to the choice of control (see Table 2 for a discussion of advantages and limitations). For example, the design that adds a single new drug (or placebo) to a background regimen has shown its limitations because it provides no information on the optimal regimen within which the new drug can be used. The specific trial objectives will guide the choice of control, weighing the relative merits of internal validity and external generalizability alongside randomization in making the correct inference [27]. In any case, the implications of each approach on the trial’s statistical considerations as well as the final interpretation of the trial results need to be carefully considered from the outset.

[Figure omitted. See PDF.]

Table 2. Controls used in DR-TB trials.

https://doi.org/10.1371/journal.pmed.1002767.t002

An added complication arises when international or national guidelines change during the course of a trial, as exemplified in the STREAM trial [34,36] (see Box 1). If significant new developments arise during the course of a trial that may impact a participant’s willingness to continue, investigators have a responsibility to inform patients; this is part of the Federal Code of Regulations in the US. It may not be feasible or ethical to continue the trial without modification under such circumstances; conversely, if the evidence base for change is weak [37] and randomization among treatment arms is still possible, no change in the trial design may be warranted [38]. The investigators, usually with advice of an independent group such as the data and safety monitoring board (DSMB) or a community advisory group, should evaluate the new information and make a judgment about whether the trial protocol should be modified and how, if at all, participants should be informed. Policy makers and guideline developers can help with this by including explicit wording that further research is still needed when making recommendations that are based on low certainty in the evidence.

Box 1. A case study: The STREAM trial [34,36]

The STREAM trial was initiated to evaluate a novel 9- to 11-month regimen for the treatment of multidrug-resistant TB (MDR-TB) based on results from an observational cohort study in Bangladesh [13,16]. The primary objective of Stage 1 of this multicenter randomized trial was to determine whether a slightly modified version of this regimen (with high-dose moxifloxacin replacing gatifloxacin) was safe and at least as effective as the recommended standard of care. The first trial participant was enrolled in July, 2012, with the first results due to be published in 2019. During the trial period, the landscape changed substantially (as described in main text), and the trial had to adapt in a number of ways.

Incorporating new drugs in additional trial arms

The availability of new drugs without data on how to use them in combination regimens prompted the investigators to consider transitioning from a two-arm study (STREAM Stage 1) to a four-arm study (STREAM Stage 2), with the aim that any new arm(s) added to the trial should be shorter or simpler to take and intended to be less toxic. Through wide consultation, an injectable-sparing regimen to avoid the hearing loss associated with aminoglycoside use was selected. There was also preference for a regimen that excluded prothionamide and ethionamide because these drugs cause nausea and vomiting that compromise the tolerability of any MDR-TB regimen. The decision was therefore made to add four arms, a 9-month completely oral regimen in which kanamycin was replaced by bedaquiline and a shorter 6-month regimen in which bedaquiline replaced prothionamide and kanamycin duration was reduced to 8 weeks. The primary objective of Stage 2 was to evaluate whether the bedaquiline-containing regimens were safe with efficacy not inferior to that of the 9- to 11-month control regimen.

The first patient in Stage 2 was randomized in April, 2016. In order to ensure timely completion of the main comparison of the fully oral regimen with the 9- to 11-month injectable-containing regimen and the increasing desirability of an injection-free regimen, it was decided to terminate enrollment to the 6-month injectable-containing regimen in 2018.

Choice of control

The locally used 20- to 24-month regimen consistent with 2011 WHO guidelines [39] was selected as the control arm in Stage 1. Although results from Stage 1 were not available at the time that Stage 2 was initiated, the STREAM investigators took the unconventional step of including two control regimens: (i) the 9- to 11-month regimen studied as the intervention in Stage 1 and (ii) the locally used WHO-recommended regimen that had been the control in Stage 1. The second control was considered as a “reserve internal control.” Although it was not included in the primary objective and only 1 in 7 participants were to be allocated to this arm, it was to be used as a comparator in secondary analyses to permit interpretation of the results of the trial as compared to 2011 WHO guidelines.

In May, 2016, the revised MDR-TB treatment guidelines from WHO recommended a short regimen very similar to that being evaluated in the STREAM trial (see Table 1) for patients who met specific inclusion criteria. Subsequently, countries adopting these revised guidelines were no longer able to enroll patients to the second control arm. The protocol was therefore amended to exclude enrollment to the “reserve internal control” in these countries, thereby unfortunately reducing the value of comparisons to that regimen because of fewer participants.

Continued evolution in WHO guidance [26], and its implications for the control arm, is under consideration by the investigators.

Balancing program and regulatory objectives

The primary aim of the trial is to evaluate the efficacy and safety of new regimens for MDR-TB. The 9- to 11-month all-oral regimen in STREAM Stage 2 is the same as the 9- to 11-month control, except that kanamycin is replaced with bedaquiline. The comparison of these two regimens is therefore a randomized comparison of bedaquiline to kanamycin within a multidrug combination.

This is quite different from the add-on trial with the placebo comparison used in the pivotal phase II trial of bedaquiline [31,40] (see the first row in Table 2) because it provides evidence both of the efficacy and safety of new standardized regimens that include bedaquiline as well as of the long-term efficacy and safety of bedaquiline, albeit in comparison to kanamycin rather than placebo. With this, it has become the confirmatory phase III trial to be considered by the FDA following the accelerated approval of bedaquiline.

Noninferiority, analysis populations, and “estimands”

Noninferiority trials are designed to evaluate whether a reduction in efficacy with the intervention as compared to the control does not exceed a prespecified threshold. The prespecified difference is denoted as the noninferiority margin (see Fig 1 for an illustration of the results of a noninferiority trial). The choice of the margin in trials of TB treatment regimens continues to be a major discussion issue. In order to have confidence that the new treatment is better than no treatment, it is accepted that the margin should be no larger, and considerably smaller, than the estimate of benefit of the chosen control as compared to no treatment. This effect is, however, estimated from historical data [41], and the statistical uncertainty of the estimate should be taken into account. For example, a somewhat conservative estimate of the success rate of standard therapy in DS-TB is around 85% [42], which, compared to the estimated 30% survival from untreated TB [43], gives an estimate of an absolute treatment effect of 55%. A declaration of noninferiority with a margin of 10% would therefore give confidence that more than 80% of this effect of the control is preserved, and 90% would be preserved with a margin of 5%.

[Figure omitted. See PDF.]

Fig 1. Illustration of the results of a noninferiority trial with a 6% margin of noninferiority (represented by the shaded area to the left of 6%), data from the RIFAQUIN trial [5].

The findings for two drug regimens are illustrated by point estimates of efficacy surrounded by 90% confidence intervals from the per protocol analysis. In this example, the 6-month regimen is noninferior to control because the upper bound of the confidence interval is less than the 6% margin of noninferiority. However, the 4-month regimen is not noninferior to the control because the upper bound exceeds the margin of noninferiority.

https://doi.org/10.1371/journal.pmed.1002767.g001

Consideration of the expected benefits of the intervention shapes the final choice of margin. In TB, regimens that are shorter confer a direct benefit to patients and health systems. They are expected to result in better treatment adherence in addition to reduced patient and health system costs, although none of these can be easily measured in a clinical trial that is not close to usual practice. Anticipated reduction in toxicity is another factor that may influence the choice of margin; whether this is a consequence of the new treatment or not cannot be known until the trial has been completed. Collection of good safety data is critical to properly weigh the risks and benefits of an intervention. Combining efficacy and safety in a composite outcome or a formal risk–benefit scoring system [44] is useful to summarize this balance in a single measure. Such measures can, however, obscure differences between outcomes of varying severity. Papers summarizing the primary results of trials should, therefore, report safety and efficacy outcomes separately for others to make a judgment on the risk–benefit balance.

There has been a trend towards larger noninferiority margins in a number of recent protocols; this permits a reduction in sample size, resulting in a less expensive study and earlier completion, but leads to greater uncertainty as to the true efficacy of the regimen. Widening the margin increases the possibility that a substandard regimen could be accepted as a new gold standard, thereby increasing the risk of “biocreep,” whereby after several generations of noninferiority trials, considerably less effective regimens would become the standard of care simply because of the cumulative reduction in efficacy [45,46].

The intention-to-treat (ITT) analysis population includes all randomized participants in the groups to which they were allocated, irrespective of treatment received, loss to follow-up, or any protocol violations. In contrast, the per-protocol (PP) analysis population includes participants who achieve an adequate measure of compliance with the treatment and with the trial protocol [47]. The analysis population to be used in noninferiority trials has been the subject of recent debate since neither the ITT nor PP populations are free from bias, and reliance on either can increase the chance of falsely declaring noninferiority. In contrast to superiority trials, in which ITT is preferred because it provides “a secure foundation for statistical tests” [47], an ITT analysis can be biased towards noninferiority because of poor trial conduct diluting the treatment effect, whereas a PP analysis can also be biased in either direction when postrandomization exclusions from the analysis may be directly or indirectly related to treatment allocation.

While a PP population has been recommended for noninferiority trials in the past [45,47], its importance has been re-evaluated. FDA guidance no longer recommends PP (or as-treated) analysis [41], even though the 2010 draft guidance accommodated one. There are limitations in PP analyses, and proposed improvements include correcting for noncompliance and dependent censoring using inverse probability weighting [48]. Current guidance suggests, instead, to focus on ensuring trial quality to reduce the bias in the ITT analysis; consideration is also given to multiple imputation as a way to counter bias due to attrition [41]. The 2017 addendum (“estimands and sensitivity analysis in clinical trials” [49]) to the 1998 International Council for Harmonization of Technical Requirements for Pharmaceuticals for Human Use (ICH) E9 document (“statistical principles for clinical trials” [47]) goes beyond just specification of an analysis population by recommending the use of an estimand as a framework for aligning the target and method of estimation of a treatment effect with the objectives of the clinical trial. The estimand “defines in detail what needs to be estimated to address a specific scientific question of interest” [49] and includes four attributes: the population, the endpoint, the specification of how to account for non-endpoint intercurrent events, and the population-level summary. Practically, defining the primary estimand(s) of interest in the protocol before the trial starts promotes clarity and coherence in how a treatment effect is estimated and how it links back to the trial objective.

A further recent innovation has been the application of Bayesian methodology to the interpretation of noninferiority trials. Presentation of the results as a simple binary statement as to whether or not noninferiority has been achieved is of limited value because it gives no indication as to how close in efficacy the intervention is likely to be to the control and places undue emphasis on the often arbitrary noninferiority margin. A much more informative approach is to use a Bayesian analysis to provide the probability that the difference is less than some given percentage, say 5% [50].

Role of adaptive trial designs

An adaptive clinical trial permits changes to various trial design features after trial initiation in response to accruing data [51]. Although potential changes must be prespecified in the protocol so as not to undermine trial validity and integrity, adaptive trial designs are nevertheless useful to account for uncertainty when a trial starts or for anticipating potential landscape changes that may occur during the course of the trial. Most common are (i) the inclusion of interim analyses that permit early stopping for overwhelming efficacy or lack of benefit when evidence is sufficiently compelling with a smaller sample size than anticipated, and (ii) sample size re-estimation during recruitment using a preplanned algorithm to ensure that the final size will be adequate to answer the research question (particularly relevant when there is uncertainty in the efficacy of the control arm).

When there are many potential combination regimens that might be considered for evaluation, one might consider designs that select among multiple regimens either by stopping recruitment to poorly performing arms after fixed-interval interim analyses (an example being the multiarm multistage [MAMS] design [52,53]) or by adjusting randomization probabilities to enroll more patients in more promising arms (Bayesian adaptive randomization [35]). When the toxicity of a regimen is unknown, one might consider designs in which the eligibility criteria are widened during the trial as more safety data accrue. This can, for instance, be performed by starting to recruit patients with extensively drug-resistant TB (XDR-TB) because few treatment options are available, then expanding to multidrug-resistant TB (MDR-TB) and DS-TB if safety thresholds are reached. Adaptations can, however, introduce bias in the estimate of treatment effect or inflate the probability of a false positive result (type I error rate). For example, in a two-stage multiarm trial in which only the intervention with the highest efficacy in the first stage is taken forward to the second stage, the uncorrected estimate of efficacy for this intervention at the end of the trial will be markedly biased and higher than the true efficacy [54]. Thorough understanding of these aspects is critical for regulatory approval and consideration in establishing WHO guidelines.

Strategy trials incorporating treatment stratification

Treatment stratification, the process of splitting a patient population into a small number of groups who receive different treatments for the same disease based on a predictive biomarker, is being widely studied in other disease areas [55–57]. In TB, it has long been recognized that disease prognosis is affected by certain baseline factors such as pretreatment extent of cavitation and viable counts of TB bacteria [58]. Wallace Fox sowed the seeds of stratified medicine in 1981 [59] by noting that good prognostic factors could be used to tailor treatment duration. The first trial incorporating treatment stratification had an enrichment design (one in which eligibility criteria are restricted to or enriched for a particular subgroup of participants) that evaluated a 4-month regimen with no new drugs in patients with noncavitary disease and culture negativity at 2 months. Before recruitment finished, the trial was stopped by the safety monitoring committee because of an apparent increased risk for relapse in the 4-month arm [7]. However, the completion of several large multicenter randomized trials in DS-TB showed that a 4-month fluoroquinolone-based regimen may well be adequate for patients with noncavitary disease [60]. Subsequent analyses describing an algorithm to more precisely identify subgroups of patients with lower or higher risk of failure and relapse [61] have provided important evidence to support the evaluation of treatment stratification in TB trials. These data are only from rifampicin-containing regimens for DS-TB to date. Nevertheless, the principles are likely also relevant for DR-TB, for which reducing duration for patients who do not need it is even more important, given the high levels of toxicity of drugs and the longer duration of treatment [62].

Several trials are under development to evaluate new treatment strategies to assess different durations, drug combinations, or drug dosages according to patient risk factors [63]. These predictive biomarker validation trials are designed to “confirm” a stratification algorithm in a randomized comparison against the standard-of-care strategy of a fixed duration regimen for all patients [64]. They are distinct from more exploratory trials designed to “learn” or develop and optimize the stratification algorithm [55]. Such trials tend to be smaller or have highly adaptive designs and are also important to incorporate newer biomarkers into the stratification algorithms, often to be evaluated in a subsequent larger confirmative trial. With appropriate stratification, it is expected that it may be possible to target treatment strategies with superior efficacy to standard of care, thereby avoiding many of the pitfalls of noninferiority trials.

The need for more pragmatic trials

In general, trials can be classified as explanatory (with the objective of evaluating the benefit an intervention produces under ideal conditions, i.e., efficacy) or pragmatic (with the objective of evaluating the benefit the treatment produces in routine clinical practice, i.e., effectiveness) [65,66], although this is more of a continuum than a dichotomy [67]. Trials that are more explanatory are needed to understand the efficacy and safety of a new drug under conditions as ideal as possible. However, the context in which an explanatory trial is conducted can be so far removed from routine practice that the results cannot readily be assumed to be transferable to clinical care. This is particularly the case when there are considerable changes in the landscape, as has been seen in DR-TB. The current acceptance of bedaquiline as a safe and efficacious drug in the treatment of MDR-TB is due less to the pivotal phase II background regimen study [40], which initially led to WHO guidelines recommending bedaquiline only under certain conditions [68], than to the extensive nonrandomized data gathered outside of a trial setting [15], mostly under program conditions. These programmatic data were influential in bedaquiline becoming one of the three priority medicines in the revised 2018 WHO guidelines for DR-TB [26], albeit based on low-quality evidence [69]. This reflects the way in which, in the absence of pragmatic trials, WHO guidelines have been based almost exclusively on observational data that yield conditional recommendations based on low-quality evidence.

Pragmatic randomized trials with broader eligibility criteria, greater geographical spread, use of programmatically relevant primary endpoints, use of best available standard of care as control (see Table 2), and delivery and adherence strategies that are closer to “real-life” conditions greatly increase generalizability of the results and lead to faster and more evidence-based changes to policy and practice. Such pragmatic trials have been necessary in evaluating effective treatment strategies for HIV using previously licensed drugs (the START trial [70], for example), and they will also be needed in TB. Pragmatic trials can also be embedded within implementation programs to evaluate population-level effects of an intervention, an example being the XTEND study, which was designed to evaluate the effect of the GeneXpert MTB/RIF during implementation in South Africa [71]. Clearly, no single trial can address all relevant questions about a given therapeutic intervention at one time, and pragmatic trials will be invaluable for public health and policy decision-making purposes.

Conclusions

Just over 10 years ago, calls to action were published for innovations in drug development, capacity building for TB trials, and execution of clinical trials of treatment for DR-TB [72–74]. Since November, 2007, 538 TB clinical trials have been posted on clinicaltrials.gov; 27 (5%) of these have been for DR-TB. Between 1997 and 2007, these numbers were 127 and 4 (3%), respectively. Although the objectives and quality of these trials vary hugely, these raw numbers suggest that some progress has been made in clinical trial conduct.

The present review comes at a time when new drugs, new diagnostics, and new methods make possible real transformation in TB treatment. Today, there are 8 and 6 new compounds known to be in phase I and phase II clinical development, respectively (https://www.newtbdrugs.org/pipeline/clinical), with many more in preclinical development. The advances in clinical trial methodology that have been mentioned above alongside the promise of a variety of host-directed therapies [75] contrast starkly with the relative stagnation in treatment of DS- and DR-TB since the 1990s. The delivery of new regimens to patients demands nimbleness in an endeavor that is long and cumbersome. Trials must be designed and implemented in such a way that their relevance persists through completion. Careful choices of trial design, comparator, sample size, biomarker stratification, estimands, analysis population(s), and noninferiority margin are critical from the outset. Changes in some of these characteristics after trial initiation—through predefined adaptation and protocol amendments—must also be entertained. Continued weighing of implications for time, cost, interpretation, and impact on practice is essential; whether the trial is primarily explanatory or pragmatic is a decision based on the balance among these competing priorities for any given trial. Transparency around assumptions and factors influencing decision making is critical to interpretation by guidance developers, practitioners, and patients. Consultation with external experts, including community advisory boards, can facilitate this transparency.

In conclusion, we strongly believe that TB treatment trials today should favor innovative approaches that are able to produce high-quality evidence for high-quality, patient-centered care that can be made accessible to all 10 million new TB patients, including the half-million with DR-TB, each year.

Citation: Phillips PPJ, Mitnick CD, Neaton JD, Nahid P, Lienhardt C, Nunn AJ (2019) Keeping phase III tuberculosis trials relevant: Adapting to a rapidly changing landscape. PLoS Med 16(3): e1002767. https://doi.org/10.1371/journal.pmed.1002767

References

1. Crofton J. The MRC randomized trial of streptomycin and its legacy: a view from the clinical front line. J R Soc Med. 2006;99(10):531–4. PubMed Central PMCID: PMC1592068. pmid:17021304

2. Medical Research Council. Streptomycin treatment of pulmonary tuberculosis: A Medical Research Council investigation. Br Med J. 1948;2(4582):769–82. pmid:18890300

3. Fox W, Sutherland I, Daniels M. A five-year assessment of patients in a controlled trial of streptomycin in pulmonary tuberculosis; report to the Tuberculosis Chemotherapy Trials Committee of the Medical Research Council. Q J Med. 1954;23(91):347–66. pmid:13194851

4. Merle CS, Fielding K, Sow OB, Gninafon M, Lo MB, Mthiyane T, et al. A Four-Month Gatifloxacin-Containing Regimen for Treating Tuberculosis. N Engl J Med. 2014;371(17):1588–98. pmid:25337748.

5. Jindani A, Harrison TS, Nunn AJ, Phillips PP, Churchyard GJ, Charalambous S, et al. High-dose rifapentine with moxifloxacin for pulmonary tuberculosis. N Engl J Med. 2014;371(17):1599–608. pmid:25337749; PubMed Central PMCID: PMC4233406.

6. Gillespie SH, Crook AM, McHugh TD, Mendel CM, Meredith SK, Murray SR, et al. Four-Month Moxifloxacin-Based Regimens for Drug-Sensitive Tuberculosis. N Engl J Med. 2014;371(17):1577–87. pmid:25196020.

7. Johnson JL, Hadad DJ, Dietze R, Maciel EL, Sewali B, Gitta P, et al. Shortening treatment in adults with noncavitary tuberculosis and 2-month culture conversion. Am J Respir Crit Care Med. 2009;180(6):558–63. Epub 2009/06/23. pmid:19542476; PubMed Central PMCID: PMC2742745.

8. Hopewell S, Clarke M, Stewart L, Tierney J. Time to publication for results of clinical trials. Cochrane Database Syst Rev. 2007;(2):MR000011. pmid:17443632.

9. Dheda K, Gumbo T, Maartens G, Dooley KE, McNerney R, Murray M, et al. The epidemiology, pathogenesis, transmission, diagnosis, and management of multidrug-resistant, extensively drug-resistant, and incurable tuberculosis. Lancet Respir Med. 2017;5(4):291–360. Epub 2017/03/28. pmid:28344011.

10. Boehme CC, Nicol MP, Nabeta P, Michael JS, Gotuzzo E, Tahirli R, et al. Feasibility, diagnostic accuracy, and effectiveness of decentralised use of the Xpert MTB/RIF test for diagnosis of tuberculosis and multidrug resistance: a multicentre implementation study. Lancet. 2011;377(9776):1495–505. Epub 2011/04/22. S0140-6736(11)60438-8 [pii] pmid:21507477; PubMed Central PMCID: PMC3085933.

11. Barnard M, Albert H, Coetzee G, O'Brien R, Bosman ME. Rapid molecular screening for multidrug-resistant tuberculosis in a high-volume public health laboratory in South Africa. Am J Respir Crit Care Med. 2008;177(7):787–92. Epub 2008/01/19. pmid:18202343.

12. World Health Organization, Foundation for Innovative New Diagnostics. Technical Report on critical concentrations for drug susceptibility testing of medicines used in the treatment of drug-resistant tuberculosis. Geneva: World Health Organization; 2018 (WHO/CDS/TB/2018.5).

13. Van Deun A, Maug AKJ, Salim MAH, Das PK, Sarker MR, Daru P, et al. Short, Highly Effective, and Inexpensive Standardized Treatment of Multidrug-resistant Tuberculosis. Am J Respir Crit Care Med. 2010;182(5):684–92. pmid:20442432

14. endTB Study Group. Bedaquiline- and delamanid-containing regimens achieve excellent interim treatment response without safety concerns: endTB interim analysis 2018 [cited 2018 2 Nov]. Available from: http://www.endtb.org/sites/default/files/2018-07/endTB%20interim%20analysis%20%2813%20July%202018%29.pdf.

15. Schnippel K, Ndjeka N, Maartens G, Meintjes G, Master I, Ismail N, et al. Effect of bedaquiline on mortality in South African patients with drug-resistant tuberculosis: a retrospective cohort study. Lancet Respir Med. 2018;6(9):699–706. Epub 2018/07/14. pmid:30001994.

16. Aung KJ, Van Deun A, Declercq E, Sarker MR, Das PK, Hossain MA, et al. Successful '9-month Bangladesh regimen' for multidrug-resistant tuberculosis among over 500 consecutive patients. Int J Tuberc Lung Dis. 2014;18(10):1180–7. pmid:25216831.

17. Lienhardt C, Raviglione M, Spigelman M, Hafner R, Jaramillo E, Hoelscher M, et al. New drugs for the treatment of tuberculosis: needs, challenges, promise, and prospects for the future. J Infect Dis. 2012;205 Suppl 2:S241–9. Epub 2012/03/27. pmid:22448022.

18. Shah NS, Auld SC, Brust JC, Mathema B, Ismail N, Moodley P, et al. Transmission of Extensively Drug-Resistant Tuberculosis in South Africa. N Engl J Med. 2017;376(3):243–53. Epub 2017/01/19. pmid:28099825; PubMed Central PMCID: PMC5330208.

19. McBryde ES, Meehan MT, Doan TN, Ragonnet R, Marais BJ, Guernier V, et al. The risk of global epidemic replacement with drug-resistant Mycobacterium tuberculosis strains. Int J Infect Dis. 2017;56:14–20. Epub 2017/02/07. pmid:28163165.

20. World Health Organization. Global Tuberculosis Report 2018. Geneva: World Health Organization; 2018. Available from: https://www.who.int/tb/publications/global_report/en/. Cited 4 March 2019.

21. Treatment Action Group, Frick M. 2017 Report on Tuberculosis Research Funding Trends, 2005–2016: The Ascent Begins 2017. Available from: http://www.treatmentactiongroup.org/tbrd2017. Cited 4 March 2019.

22. Lienhardt C, Nahid P. Advances in clinical trial design for development of new TB treatments: A call for innovation. PLoS Med. 2019:16(3):e1002769.

23. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals For Human Use. Choice of control group and related issues in clinical trials (E10). 2000. Avaliable from: https://www.ich.org/products/guidelines/efficacy/efficacy-single/article/choice-of-control-group-and-related-issues-in-clinical-trials.html. Cited 4 March 2019.

24. Freedman B. Equipoise and the ethics of clinical research. N Engl J Med. 1987;317(3):141–5. Epub 1987/07/16. pmid:3600702.

25. World Health Organization. Guidelines for treatment of drug-susceptible tuberculosis and patient care (2017 update): World Health Organization; 2017. Available from: https://www.who.int/tb/publications/2017/dstb_guidance_2017/en/. Cited 4 Mch 2019.

26. World Health Organization. WHO treatment guidelines for multidrug- and rifampicin-resistant tuberculosis, 2018 update. Geneva: World Health Organization; 2018. Available from: https://www.who.int/tb/publications/2018/WHO.2018.MDR-TB.Rx.Guidelines.prefinal.text.pdf. Cited 4 March 2019

27. Senn S. Seven myths of randomisation in clinical trials. Stat Med. 2013;32(9):1439–50. Epub 2012/12/21. pmid:23255195.

28. Gler MT, Skripconoka V, Sanchez-Garavito E, Xiao H, Cabrera-Rivero JL, Vargas-Vasquez DE, et al. Delamanid for Multidrug-Resistant Pulmonary Tuberculosis. N Engl J Med. 2012;366(23):2151–60. pmid:22670901

29. von Groote-Bidlingmaier F, Patientia R, Sanchez E, Balanag V, Ticona E, Segura P, et al. Efficacy and safety of delamanid in combination with an optimised background regimen for treatment of multidrug-resistant tuberculosis: a multicentre, randomised, double-blind, placebo-controlled, parallel group phase 3 trial. Lancet Respir Med. 2019. Epub 2019 Jan 7.

30. Diacon AH, Donald PR, Pym A, Grobusch M, Patientia RF, Mahanyele R, et al. Randomized pilot trial of eight weeks of bedaquiline (TMC207) treatment for multidrug-resistant tuberculosis: long-term outcome, tolerability, and effect on emergence of drug resistance. Antimicrob Agents Chemother. 2012;56(6):3271–6. Epub 2012/03/07. pmid:22391540; PubMed Central PMCID: PMC3370813.

31. Diacon AH, Pym A, Grobusch M, Patientia R, Rustomjee R, Page-Shipp L, et al. The Diarylquinoline TMC207 for Multidrug-Resistant Tuberculosis. N Engl J Med. 2009;360(23):2397–405. pmid:19494215

32. Bouton TC, Phillips PPJ, Mitnick CD, Peloquin CA, Eisenach K, Patientia RF, et al. An optimized background regimen design to evaluate the contribution of levofloxacin to multidrug-resistant tuberculosis treatment regimens: study protocol for a randomized controlled trial. Trials. 2017;18(1):563. Epub 2017/11/28. pmid:29178937; PubMed Central PMCID: PMC5702225.

33. Cox E, Borio L, Temple R. Evaluating Ebola therapies—the case for RCTs. N Engl J Med. 2014;371(25):2350–1. pmid:25470568.

34. Nunn AJ, Rusen I, Van Deun A, Torrea G, Phillips PP, Chiang CY, et al. Evaluation of a standardized treatment regimen of anti-tuberculosis drugs for patients with multi-drug-resistant tuberculosis (STREAM): study protocol for a randomized controlled trial. Trials. 2014;15(1):353. pmid:25199531; PubMed Central PMCID: PMC4164715.

35. Cellamare M, Ventz S, Baudin E, Mitnick CD, Trippa L. A Bayesian response-adaptive trial in tuberculosis: The endTB trial. Clin Trials. 2017;14(1):17–28. pmid:27559021.

36. Moodley R, Godec TR, Stream Trial Team. Short-course treatment for multidrug-resistant tuberculosis: the STREAM trials. Eur Respir Rev. 2016;25(139):29–35. pmid:26929418.

37. Prasad V, Cifu A, Ioannidis JP. Reversals of established medical practices: evidence to abandon ship. JAMA. 2012;307(1):37–8. Epub 2012/01/05. pmid:22215160.

38. Neaton JD, Grund B, Wentworth D. How to construct an optimal interim report: What the data monitoring committee does and doesn’t need to know. Clinical Trials. 2018:1740774518764449.

39. World Health Organization. Guidelines for the programmatic management of drug-resistant tuberculosis—2011 update: World Health Organization; 2011. Available from: https://apps.who.int/iris/bitstream/handle/10665/44597/9789241501583_eng.pdf. Cited 4 March 2019

40. Diacon AH, Pym A, Grobusch MP, de los Rios JM, Gotuzzo E, Vasilyeva I, et al. Multidrug-resistant tuberculosis and culture conversion with bedaquiline. N Engl J Med. 2014;371(8):723–32. pmid:25140958.

41. U.S. Department of Health and Human Services FaDA, Center for Drug Evaluation and Research (CDER). Guidance for Industry. Non-inferiority clinical trials to establish effectiveness: U.S. Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research (CDER); 2016. Available from: https://www.fda.gov/downloads/Drugs/Guidances/UCM202140.pdf. Cited 4 March 2019.

42. Nimmo C, Lipman M, Phillips PP, McHugh T, Nunn A, Abubakar I. Shortening treatment of tuberculosis: lessons from fluoroquinolone trials. Lancet Infect Dis. 2015;15(2):141–3. pmid:25749057.

43. Tiemersma EW, van der Werf MJ, Borgdorff MW, Williams BG, Nagelkerke NJ. Natural history of tuberculosis: duration and fatality of untreated pulmonary tuberculosis in HIV negative patients: a systematic review. PLoS ONE. 2011;6(4):e17601. Epub 2011/04/13. pmid:21483732; PubMed Central PMCID: PMC3070694.

44. Miyahara S, Montepiedra G, Kim S, Evans S, Gupta A, Swindells S, et al., editors. Risk–Benefit Analyses Using Novel Methods in the A5279 Latent-TB Clinical Trial. The 49th Union World Conference on Lung Health; 2018; The Hague, The Netherlands. Available from: https://www.abstractserver.com/TheUnion2018/TheUnion2018_Abstracts_Web.pdf. Cited 4 March 2019

45. Nunn AJ, Phillips PPJ, Gillespie SH. Design issues in pivotal drug trials for drug sensitive tuberculosis (TB). Tuberculosis. 2008;88:S85–S92. pmid:18762156

46. Fleming TR. Current issues in non-inferiority trials. Stat Med. 2008;27(3):317–32. pmid:17340597.

47. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals For Human Use. Statistical Principles for Clinical Trials (E9). 1998. Available from: https://www.ich.org/products/guidelines/efficacy/efficacy-single/article/statistical-principles-for-clinical-trials.html. Cited 4 March 2019

48. Mauri L, D'Agostino RB Sr. Challenges in the Design and Interpretation of Noninferiority Trials. N Engl J Med. 2017;377(14):1357–67. Epub 2017/10/05. pmid:28976859.

49. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals For Human Use. Estimands and sensitivity analysis in clinical trials. E9(R1). 2017. Available from: https://www.ich.org/fileadmin/Public_Web_Site/ICH_Products/Guidelines/Efficacy/E9/E9-R1EWG_Step2_Guideline_2017_0616.pdf. Cited 4 March 2019.

50. Laptook AR, Shankaran S, Tyson JE, Munoz B, Bell EF, Goldberg RN, et al. Effect of Therapeutic Hypothermia Initiated After 6 Hours of Age on Death or Disability Among Newborns With Hypoxic-Ischemic Encephalopathy: A Randomized Clinical Trial. JAMA. 2017;318(16):1550–60. Epub 2017/10/27. pmid:29067428; PubMed Central PMCID: PMC5783566.

51. U.S. Department of Health and Human Services FaDA, Center for Drug Evaluation and Research (CDER). Guidance for Industry. Adaptive designs for clinical trials of drugs and biologics (Draft guidance): U.S. Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research (CDER); 2018. Available from: https://www.fda.gov/downloads/drugs/guidances/ucm201790.pdf. Cited 4 March 2019.

52. Phillips PPJ, Gillespie SH, Boeree M, Heinrich N, Aarnoutse R, McHugh T, et al. Innovative trial designs are practical solutions for improving the treatment of tuberculosis. J Infect Dis. 2012;205 Suppl 2:S250–7. Epub 2012/03/27. jis041 [pii] pmid:22448027.

53. Boeree MJ, Heinrich N, Aarnoutse R, Diacon AH, Dawson R, Rehal S, et al. High-dose rifampicin, moxifloxacin, and SQ109 for treating tuberculosis: a multi-arm, multi-stage randomised controlled trial. Lancet Infect Dis. 2017;17(1):39–49. pmid:28100438.

54. Bowden J, Glimm E. Unbiased estimation of selected treatment means in two-stage trials. Biom J. 2008;50(4):515–27. Epub 2008/07/30. pmid:18663760.

55. Mandrekar SJ, An MW, Sargent DJ. A review of phase II trial designs for initial marker validation. Contemp Clin Trials. 2013;36(2):597–604. pmid:23665336; PubMed Central PMCID: PMC3779487.

56. Polley MY, Freidlin B, Korn EL, Conley BA, Abrams JS, McShane LM. Statistical and practical considerations for clinical evaluation of predictive biomarkers. J Natl Cancer Inst. 2013;105(22):1677–83. Epub 2013/10/19. pmid:24136891; PubMed Central PMCID: PMC3888208.

57. Mandrekar SJ, Sargent DJ. Clinical trial designs for predictive biomarker validation: theoretical considerations and practical challenges. J Clin Oncol. 2009;27(24):4027–34. Epub 2009/07/15. pmid:19597023; PubMed Central PMCID: PMC2734400.

58. Aber VR, Nunn AJ. Short term chemotherapy of tuberculosis. Factors affecting relapse following short term chemotherapy. Bull Int Union Tuberc. 1978;53(4):276–80. pmid:387141

59. Fox W. Whither short-course chemotherapy? Br J Dis Chest. 1981;75(4):331–57. pmid:7030377

60. Alipanah N, Cattamanchi A, Menzies R, Hopewell PC, Chaisson RE, Nahid P. Treatment of non-cavitary pulmonary tuberculosis with shortened fluoroquinolone-based regimens: a meta-analysis. Int J Tuberc Lung Dis. 2016;20(11):1522–8. pmid:27776595.

61. Imperial MZ, Nahid P, Phillips PPJ, Davies GR, Fielding K, Hanna D, et al. A patient-level pooled analysis of treatment-shortening regimens for drug-susceptible pulmonary tuberculosis. Nat Med. 2018;24(11):1708–15. WOS:000449404200023. pmid:30397355

62. Churchyard GJ. A stratified approach to tuberculosis treatment. Nat Med. 2018;24(11):1639–41. Epub 2018/11/08. pmid:30401868.

63. Nahid P, Savic R, Phillips PPJ, editors. The CURE-TB Strategy Trial concept on stratified medicine trials in active TB. TBScience2018; 2018; The Hague, Netherlands.

64. Saad ED, Paoletti X, Burzykowski T, Buyse M. Precision medicine needs randomized clinical trials. Nat Rev Clin Oncol. 2017;14(5):317–23. pmid:28169302.

65. Ford I, Norrie J. Pragmatic Trials. N Engl J Med. 2016;375(5):454–63. Epub 2016/08/16. pmid:27518663.

66. Roland M, Torgerson DJ. What are pragmatic trials? BMJ. 1998;316(7127):285. Epub 1998/02/24. pmid:9472515; PubMed Central PMCID: PMC2665488.

67. Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147. pmid:25956159.

68. World Health Organization. The use of bedaquiline in the treatment of multidrug-resistant tuberculosis—Interim policy guidance. Geneva: World Health Organization; 2013. Available from: https://www.who.int/tb/challenges/mdr/bedaquiline/en/. Cited 4 March 2019.

69. World Health Organization. Rapid Communication: Key changes to treatment of multidrug- and rifampicin-resistant tuberculosis (MDR/RR-TB): World Health Organization; 2018. Available from: https://www.who.int/tb/publications/2018/rapid_communications_MDR/en/. Cited 4 March 2019.

70. Insight Start Study Group, Lundgren JD, Babiker AG, Gordin F, Emery S, Grund B, et al. Initiation of Antiretroviral Therapy in Early Asymptomatic HIV Infection. N Engl J Med. 2015;373(9):795–807. Epub 2015/07/21. pmid:26192873; PubMed Central PMCID: PMC4569751.

71. Churchyard GJ, Stevens WS, Mametja LD, McCarthy KM, Chihota V, Nicol MP, et al. Xpert MTB/RIF versus sputum microscopy as the initial diagnostic test for tuberculosis: a cluster-randomised trial embedded in South African roll-out of Xpert MTB/RIF. Lancet Glob Health. 2015;3(8):e450–e7. Epub 2015/07/19. pmid:26187490.

72. Schluger N, Karunakara U, Lienhardt C, Nyirenda T, Chaisson R. Building clinical trials capacity for tuberculosis drugs in high-burden countries. PLoS Med. 2007;4(11):e302. Epub 2007/11/09. pmid:17988170; PubMed Central PMCID: PMC2062480.

73. Casenghi M, Cole ST, Nathan CF. New approaches to filling the gap in tuberculosis drug discovery. PLoS Med. 2007;4(11):e293. Epub 2007/11/09. pmid:17988169; PubMed Central PMCID: PMC2062479.

74. Mitnick CD, Castro KG, Harrington M, Sacks LV, Burman W. Randomized trials to optimize treatment of multidrug-resistant tuberculosis. PLoS Med. 2007;4(11):e292. Epub 2007/11/09. pmid:17988168; PubMed Central PMCID: PMC2062482.

75. Rao M, Ippolito G, Mfinanga S, Ntoumi F, Yeboah-Manu D, Vilaplana C, et al. Improving treatment outcomes for MDR-TB—novel host-directed therapies and personalised medicine of the future. Int J Infect Dis. 2019: S1201-9712(19)30050-5. Epub 2019/01/28. pmid:30685590.