Correspondence to Dr Edward R Melnick; [email protected]
STRENGTHS AND LIMITATIONS OF THIS STUDY
This pragmatic study, refining a user-centred clinical decision support tool, will take place during routine care in emergency departments, helping ensure that the findings are generalisable to everyday practice and can be implemented effectively.
A learning healthcare system approach can systematically and rapidly generate new knowledge as part of routine care. Specific areas to improve the use and usability of the clinical decision support (CDS) can be targeted, and the CDS can be adapted to the dynamic opioid crisis and evolving best practices.
The multiphase strategy also allows for data-driven iterative refinement of the CDS interface and workflow to maximise use, fidelity and efficiency and minimise task abandonment by identifying specific improvement targets.
The refined CDS package, as with the initial EMergency department-initiated BuprenorphinE for opioid use Disorder intervention, can be disseminated nationally through the Epic electronic health record (EHR), promoting evidence-based addiction treatment at a broad scale.
Limitations of this study include potential delays due to competing health system operational priorities, which could affect the timeline and randomisation process within the EHR, and the reliance on clinical data without on-site personnel, which may overlook important contextual details.
Introduction
Background, rationale and objectives
The current opioid crisis is responsible for an alarming number of overdose deaths, with over 80 000 opioid-related fatalities in 2022 alone.1 The opioid crisis rages on despite the National Institutes of Health (NIH) adopting an ‘all-hands-on-deck’ approach to deliver solutions for its mitigation.2 The crisis has evolved for multiple reasons, including decreased opioid prescribing3–6 coinciding with increased prevalence of synthetic opioids in illicit drugs, specifically fentanyl and fentanyl analogues.7–9 In response to this crisis, emergency departments (EDs) have become critical hubs of intervention, receiving 2.88 million opioid-related visits annually.10
Buprenorphine, a partial opioid agonist, can safely reduce mortality, withdrawal, illicit drug use and craving11–14 and increase engagement in treatment15 in people who experience opioid use disorder (OUD) and has been demonstrated to be effective in the ED setting. However, adoption of this evidence-based, life-saving practice into routine care has been slow13 16–21 due to multiple barriers, including stigma, patient readiness to start treatment, access to ongoing therapy, lack of clinician knowledge and experience and poor electronic health record (EHR) integration.17 20–24 While multiple studies have demonstrated that health IT-based interventions can curtail inappropriate opioid prescribing, encouraging medication for OUD through EHR-based tools is comparatively underexplored.
The EMergency department-initiated BuprenorphinE for opioid use Disorder (EMBED) multisite, pragmatic cluster-randomised trial was conducted from 2019 to 2021 to help overcome barriers to ED initiation of buprenorphine.25 The EMBED trial evaluated the effectiveness of non-interruptive, EHR-based, clinical decision support (CDS) to facilitate patient assessment and EHR activities to implement ED initiation of buprenorphine in routine care.26–28 The EMBED CDS increased the proportion of physicians who initiated buprenorphine treatment at least once from 34.0% to 44.4% (OR 1.83, 95% CI 1.16 to 2.89, p=0.01).25 This success led to a nationally scaled, vendor-disseminated CDS tool based on EMBED.29 However, the overall intervention did not significantly increase patient-level rates of buprenorphine initiation (12.5% in the intervention arm vs 12.0% in the usual care arm; OR 1.22, 95% CI 0.61 to 2.43, p=0.58).25 The Adaptive Decision support for Addiction Treatment (ADAPT) study aims to address this by optimising multiple components of EMBED.
A follow-up qualitative analysis30 of EMBED trial clinician participants highlighted potential areas for enhancement, such as: (1) tailoring the CDS to the local environment, (2) providing audit and feedback to clinicians on buprenorphine initiation, CDS use and positive patient outcomes, (3) creating EHR workflows to prioritise patients with OUD, (4) providing written resources for patients on treatment options (including harm reduction strategies) and (5) decreasing disparities in buprenorphine prescription in non-Hispanic Black and Hispanic patients.31 32 In addition, two recent, multicomponent intervention strategies incorporating clinician feedback demonstrated increased patient rates of ED-initiated buprenorphine initiation by up to 24.5%.33 34 These findings highlight opportunities to increase the EMBED intervention’s effectiveness using a more comprehensive, multicomponent strategy. To that end, we proposed the ADAPT trial, the protocol for which is presented here.
Methods and analysis
Study design
ADAPT will be a Multiphase Optimization STrategy (MOST)35 study of CDS for the treatment of OUD in the ED focusing on buprenorphine initiation. We will apply an empirical, iterative, learning health system36 37 approach (figure 1). We will add reproducible best measurement and intervention optimisation and evaluation to rapid plan–do–study–act cycles following best practices for CDS refinement using the 10-step process of McCoy et al’s Clickbusters initiative.38–40
Figure 1. Learning Health System framework used to optimise clinical decision support (CDS) for opioid use disorder care. This iterative process integrates reproducible measurement, the Multiphase Optimization Strategy (MOST) framework and rapid improvement cycles.
The national Epic build of the EMBED CDS will be expanded from a stand-alone CDS to a multicomponent intervention including evidence-based, sustainable implementation strategies33 34 41 with iterative refinement by applying an MOST framework (figure 2).35 42–44 The MOST framework includes three phases: preparation, optimisation and evaluation. For the ADAPT trial, the optimisation phase will be conducted in two stages: (1) a randomised factorial trial focused on increasing CDS use and (2) rapid, serial randomised testing37 with iterative usability refinement to enhance interface and workflow.
Figure 2. Application of the Multiphase Optimization Strategy framework to the Adaptive Decision support for Addiction Treatment trial. CDS, clinical decision support; EMBED, EMergency department-initiated BuprenorphinE for opioid use Disorder
MOST preparation phase
In the preparation phase, the EMBED intervention will be refined into a multicomponent CDS intervention to improve ED initiation of buprenorphine in patients with OUD via increased CDS uptake, usability and equity (additional details provided in the Intervention section below). In addition, the investigative team will prepare for the trial across three distinct data needs: (1) CDS measure development, (2) phenotype refinement and (3) data coordination. Measure development will involve implementing measurement science to EHR audit logs to conceptualise, specify, test and evaluate novel, reproducible, scalable outcome measures for assessing CDS uptake and usability to implement ED initiation of buprenorphine for OUD.45–47 The existing EMBED EHR phenotype will be expanded to optimise the identification of ED patients experiencing OUD or having both opioid-specific and opioid-related visits.48 49 The data coordination team will plan for the management of trial data collection, retrieval, compliance with NIH and NIDA (National Institute on Drug Abuse) HEAL (Helping to End Addiction Long-term Initiative) regulations, and analysis.
MOST optimisation phase, stage 1: factorial trial
With no interruptive alerts in the EMBED trial, CDS was used in only 9.4% of encounters with eligible patients who met the EMBED EHR phenotype criteria. Buprenorphine was initiated in 61.7% of cases when the intervention was used.25 Therefore, the overarching objective of the optimisation phase, stage 1 is to increase CDS use (ie, patient reach and clinician adoption) as a means to increase buprenorphine initiation rates to a larger portion of ED patients with OUD. With a goal of 50% CDS use and a corresponding 30% buprenorphine initiation rate for encounter with eligible patients, starting in February 2025, we will conduct a 2×2×2 factorial trial by expanding the EMBED intervention to include sustainable implementation strategies.33 34 41 The factorial trial design allows efficient and simultaneous testing of the main effects and interaction of several intervention components on CDS use in its real-world implementation.
Stage 1 of the MOST optimisation phase will aim to evaluate three elements amenable to encounter-level randomisation, each with its own reference and comparator level in a randomised factorial trial. This 2×2×2 factorial trial with 23=8 conditions (figure 3) with component-dependent definitions of reference and comparator is easily amenable to changing or adding components at the start of the trial. We anticipate that components identified for randomisation in the MOST preparation phase will fall under the categories of (1) patient-facing materials, (2) prompts for clinicians to engage with the CDS and (3) prompts for nurses to engage with the CDS.
Figure 3. Depiction of the eight arms of the 2×2×2 factorial trial with 2 3 =8 unique combinations.
MOST optimisation phase, stage 2: rapid, randomised testing
We will aim to improve CDS usability via serial randomised testing to inform iterative refinement of the CDS interface and workflow to minimise user errors, task disruption and abandonment by identifying specific targets for improvement via applying novel CDS outcome measures in serial randomised tests.
In this stage, the EMBED CDS interface and workflow will be incrementally improved based on rapid, serial randomised testing using novel, validated EHR use metrics developed to evaluate CDS performance. These metrics will measure CDS performance details including the time to completion of the intervention, increasing the likelihood and efficiency of use and task completion. This method will allow systematic, rapid learning of what aspects of the EMBED interface and workflow work and deimplementation of what is not.37 Once an assigned intervention change or component in one randomisation group is noted to be superior to another, it will become the new standard. Of note, while the EMBED CDS interface and workflow will be optimised, the specific treatment approaches (eg, medication dosing and adjunct medications) promoted by EMBED will not change unless best practices change, so front-line staff will not have to alter their clinical practices aside from hopefully increasing the uptake of recommended practices.
MOST evaluation phase
The objective of this third phase is to compare the effectiveness of the optimised, multicomponent CDS package to the original EMBED CDS on ED initiation of buprenorphine rates in patients with OUD in a randomised trial. During this confirmatory phase, the optimised treatment package will be tested in a fully powered two-arm randomised trial comparing the efficacy of the optimised, multicomponent intervention package to the original EMBED CDS on rates of ED initiation of buprenorphine in patients with OUD. Based on the results of the optimisation phase factorial trial in conjunction with findings from the rapid, serial randomised testing, the optimised treatment package will include individual components found to increase CDS uptake and all usability and workflow improvements found to increase use and efficiency in serial randomised testing. This phase will be our trial’s final phase, expected to conclude in March 2028.
Participants
Smalley et al distinguish between direct, indirect and collateral participants in pragmatic research in which: (1) direct participants are intervened on and/or identifiable data are collected for research purposes, (2) indirect participants are not direct participants but may have their rights or welfare affected by the intervention and (3) collateral participants are members of other stakeholder communities who may be affected by the research.50 For the ADAPT trial, the investigative team will not collect identifiers for patients or clinicians and the intervention will be focused at the patient level, with patients considered direct participants and clinicians indirect participants, with process improvement (non-research, such as feedback emails) interventions directed at the clinician level, without containing identifiable information. These indirect participants will include approximately 80 attendings (67 faculty and 13 fellows), 74 residents and 55 advanced practice providers (physician associates and advanced practice registered nurses) at one academic ED, one community ED and one free-standing ED.
In the EMBED trial, patients with probable OUD were identified using a validated EHR-based algorithm to identify patients aged 18 years or older who were not pregnant and not currently receiving medication for OUD.25 51 52 For the ADAPT trial, we will expand this algorithm to include additional opioid-related visits and implement it in real time through the EHR (figure 4). Patients will be screened for eligibility using deidentified data processed securely.48 53 Additional details and phenotype validation will be reported separately.
Figure 4. Illustration of Adaptive Decision support for Addiction Treatment’s target population: patients who are ready for treatment but are not currently offered treatment. OUD, opioid use disorder.
Intervention
To improve the EMBED intervention using a more comprehensive, multicomponent strategy, the ADAPT trial intervention will include key updates to adapt the CDS for broader use, addressing potential risks such as precipitated opioid withdrawal after buprenorphine administration and enhancing the intervention with audit and feedback.34 41 54 Practitioners will retain all control of their practice and will have the option whether or not to use the intervention (ie, can opt out of use). The patient-facing material team will design and formatively evaluate educational resources that encourage patient engagement and readiness for treatment, with a focus on equitable access to OUD medication through deliberate community engagement and advisory board involvement, as demonstrated in previous successful work with personalised risk communication.55 Components amenable to patient-level randomisation (patient-facing materials and targeted prompts to nurses and clinicians based on patient characteristics) will be identified and prepared for implementation.24 41
Randomisation and allocation of intervention
The randomisation unit for each phase will be the individual ED patient encounter. Randomisation will depend on study phase. For phase 2 stage 1, the 2×2×2 factorial trial, encounters will be randomised in a 1:1:1:1:1:1:1:1 ratio to each of the eight intervention combinations. Therefore, the probability of receiving each intervention will be 0.5 and the probability of receiving a given intervention combination will be 0.125. Simple (ie, not stratified or blocked) randomisation will be implemented in Epic where the allocation sequence will be generated and concealed. To ensure equal intervention distribution, a random sequence will be generated with a computer-generated algorithm within the Epic EHR.43 Allocation will be concealed from participants using Epic by turning these options on/off in EMBED according to the assignment for an encounter. Once a participant is identified as eligible based on an automated phenotypic evaluation within Epic, they will be randomised and intervention components will be automatically turned on or off depending on their assignment. Phase 2 stage 2 will require serial randomised testing. The precise nature of the randomisation will depend on the specific component targeted for improved workflow; however, the ratio of the assignments to each individual component intervention will be 1:1 to maximise statistical efficiency (ie, power). During the evaluation phase in which the effectiveness of the optimised multicomponent CDS package will be compared with the original EMBED CDS, we will randomise 1:1 to the two interventions. As in the optimisation phase, simple (ie, not stratified or blocked) randomisation will be implemented within Epic where the allocation sequence will be generated and concealed until the participant is enrolled.
Outcomes
As an implementation study of a well-established, effective treatment strategy that has been shown to be highly efficacious in the ED setting,15 56 the overall primary outcome across phases of the ADAPT trial will be encounter-level buprenorphine initiation in the ED, defined as the proportion of eligible patients who receive buprenorphine in the ED or as a prescription at discharge, including those interested in buprenorphine treatment but not yet in a stage of withdrawal that would warrant ED buprenorphine administration who will receive instruction for after visit initiation. In the optimisation stage 1 factorial trial, we will also examine, as a primary outcome, the proportion of encounters in which the CDS is used, as the focus of this phase is increasing CDS uptake, regardless of actions taken through the CDS. During the serial, rapid randomised testing cycles of optimisation phase, stage 2, the primary outcome may vary depending on testing cycle goals. As in the EMBED trial, outcomes will be evaluated using the Reach, Effectiveness, Adoption, Implementation, and Maintenance25 57 58 framework. In all trial phases, we will examine the following secondary outcomes: (1) attending physician initiating buprenorphine in the ED for at least one eligible patient, (2) naloxone prescription on ED discharge, (3) attending physician prescribing naloxone on ED discharge, (4) patient receipt of appropriate opioid-related discharge instructions, (5) attending physician giving appropriate opioid-related discharge instructions, (6) patient referral to ongoing medication for OUD treatment and (7) attending physician placing patient referral to ongoing medication for OUD treatment.
In addition to these outcomes, in optimisation phase stage 1, while focusing on increasing CDS use in the factorial trial, we will also measure meaningful engagement with the intervention (reach to patients and adoption by clinicians) with implementation outcomes regarding both the CDS being launched from the alert and use without the alert. In the optimisation phase stage 2 serial randomised testing, we will use novel CDS measures developed in the MOST preparation phase using measurement science to conceptualise, specify, implement, test and validate reproducible, scalable outcome measures for assessing uptake and usability of CDS for ED initiation of buprenorphine for patients with OUD.41–43 Our approach will be multidisciplinary and iterative, incorporating multiple leadership, advisory and interprofessional partner codesign meetings to ensure thorough metric conceptualisation, specification and validation.
Sample size
Sample size calculations were performed using PASS V.2019 (Kaysville, Utah, USA) and will vary according to the phases of the study.
Optimisation phase, stage 1: factorial trial of multiple components for CDS uptake.
As each component is allocated to half the participants, the sample size to detect main effects in a full factorial design depends not on the number of components evaluated, but rather the smallest clinically important difference between the presence and absence of a component. Our goal is to determine whether the individual intervention components (OUD patient-facing materials, nurse prompt for Clinical Opiate Withdrawal Scale, clinician prompt for CDS) will improve CDS use by at least 10%. A sample size of 136 per group (total n=1088, across eight arms) will provide 90% power at the two-sided 0.05 significance level to detect differences of 10% (the smallest clinically important difference agreed on by the investigative team)28 between the presence and absence of each of these components. This sample size was maximised to assure at least 90% power to detect an absolute difference of 10% regardless of the proportion using the CDS in the absence of the intervention component. We did not inflate the sample size for clustering by provider, given the crossed design, where we expect variance inflation to be negligible. We will investigate whether the effect of a component is dependent on the levels of other components (ie, interactions), but our trial is not powered with the intent to detect these interactions.
Optimisation phase, stage 2: serial randomised testing for usability (user errors and efficiency).
Our goal is to rapidly identify interface and workflow solutions to reduce errors and time to completion. Given this goal, we will design these serial randomised experiments to have high power to detect large differences.37 59 We anticipate using a variety of parallel group randomised designs (such as two-arm, factorial). A two-sided 0.10 significance level will be chosen, given the benign consequences of false positive errors. While the sample size for a given serial test will depend on the relevant outcome, we expect to require between 80 and 150 encounters with CDS uptake to rapidly evaluate various solutions. These sample sizes will provide 90% power at the two-sided 0.10 significance level to detect medium-to-large standardised differences in proportions (such as errors, abandonment) of h=0.48–0.65. We did not inflate the sample size for clustering by provider, given the crossed design, where variance inflation is expected to be negligible.60
Evaluation phase: randomised trial to evaluate optimised package.
In the previous EMBED trial, ~12% of patients with OUD had buprenorphine initiated. We will conservatively assume the proportion initiating buprenorphine in the original EMBED CDS arm to be 20%. A sample size of 412 per group (Total n=824) will be required to detect an improvement of 10% (absolute increase from 20% to 30%)25 28 with 90% power at the two-sided 0.05 significance level. We did not inflate the sample size for clustering by provider given the crossed design, where we expect variance inflation is expected to be negligible.
Data collection
All clinical data will be retrieved from our institution’s Epic Clarity database. The data will include Epic User Action Log (UAL) and Access Log—audit logs hosted locally, which will be used in the CDS use measure calculation.
Data management
For the ADAPT project, the investigative team will not collect identifiers for patients or clinicians. A third-party honest broker61 with access to protected health information (PHI) as part of their health system operational digital technology role will use study codes on data documents instead of recording identifying information. They will keep a separate document that links the study code to subjects’ identifying information locked in an alternative location and restrict access to this document. Additionally, any identifiable data will be encrypted prior to collection and storage. All data documents will be securely stored in encrypted, HIPAA-compliant digital environments within locked locations. The third-party honest broker will destroy identifiable data within 6 months of study completion.
Data monitoring
As a minimal-risk implementation study of established best practices, an independent study monitor (ISM) will be used in place of a formal Data Safety Monitoring (DSM) Board. Interim monitoring will focus on adherence to the protocol, completeness of data retrieval from each ED’s EHR and uptake of the CDS intervention. A set of monitoring tables will be generated for this purpose. The ISM will report directly to the study DCC. The principal investigator (PI) will be responsible for monitoring the safety and efficacy of this trial, executing the DSM plan and complying with reporting requirements. The PI will provide a summary of the DSM report to NIDA annually as part of the progress report. The DSM report to NIDA will also include, when available, the results of any efficacy data analysis conducted.
Data analytics team and plan: advisory board
To augment and complement the investigative team’s expertise and optimise their scientific approach, the ADAPT investigators will be advised and counselled by an advisory board of national methodological experts who will meet quarterly. It will be composed of two specialists for each of the following categories: EHR use measurement, study design for pragmatic evaluation and optimisation trials in routine care, and CDS for OUD in the ED and one in health equity.
Data analytics team and plan: analysis plan
Baseline data will be reported with frequencies, percentages, means, SD, medians, and IQRs as appropriate for categorical and continuous measures. All statistical tests will be two sided, with a 0.05 significance level.
Optimisation phase, stage 1: evaluation of components in the 2×2×2 factorial design will be performed using multivariable random effects logistic regression with random effects to accommodate clustering of patients by clinician and repeated measures from the same patients.60 For this full-factorial design, the model will include main effects for each of the three components as well as all two-way and three-way interactions. The regression will also include baseline covariates: age, sex, race, ethnicity, insurance type and status, and reason for ED visit (such as overdose, withdrawal, soft tissue infection). The mixed logistic regression model will be used to estimate marginal outcome proportions to compare intervention components. Differences in proportions for the presence and absence of each component (ie, main effects) will be estimated along with 95% CIs. A p value of 0.10 will be used as a guide to flag potentially important interactions which will be explored graphically with a particular emphasis on identifying substantial synergistic effects or qualitative (ie, where the impact of 1 component changes direction depending on the presence or absence of another component) effect modification.
Optimisation phase, stagee 2: given the smaller sample sizes required, only first patient encounters will be randomised. Random effects logistic regression will be used for the analysis of serial randomised experiments for outcomes such as proportion with errors or abandonment. The models will include a fixed effect for intervention and a random effect for clinicians. Differences in proportions for the intervention will be estimated along with 95% CIs. Time-based variables (such as time to completion of CDS) will be evaluated using survival analyses. Log-rank tests will be used to compare cumulative time to event between interventions, and median completion times will be presented.
Evaluation phase: comparison of the optimised multicomponent package to the original EMBED CDS will be performed using multivariable random effects logistic regression with random effects to accommodate the clustering of patients by clinician and repeated measures from the same patients.60 The model will include the same baseline covariates from the optimisation phase, stage 2 (above) for this two-arm parallel group trial design. The mixed logistic regression model will be used to estimate marginal outcome proportions to compare intervention components. Differences in proportions for the optimised EMBED compared with the original EMBED CDS will be estimated along with a 95% CI.
Patient and public involvement
Creating and refining the novel outcome measures for optimisation phase, stage 2 of this project will involve reaching a consensus among stakeholders representing emergency medicine physicians and administrators, addiction medicine experts, nurses, clinical pharmacists, clinical informaticists and data scientists, professional organisation representatives, EHR analysts and health promotion advocates. This group will be recruited to assemble a representative group with different perspectives. Final participant selection will balance age, gender, race, ethnicity and practice settings for diverse representation with oversampling of historically marginalised groups.62–65
With the goal of equitable treatment for people experiencing moderate to severe OUD,31 32 the ADAPT project will seek community stakeholder perspectives and input from community members with lived experience with OUD as well as experience in study conceptualisation and design, CDS design and execution, and patient-facing communication. This community advisory board will inform intervention refinement by helping to identify priorities and concerns of patients with lived experience with OUD, understand social will drivers of health and identify opportunities to expand intervention reach. In particular, involving the community advisory board will help and ensure that community members can see themselves represented appropriately in patient-facing materials.
Ethics and dissemination
We will secure all required approvals and protocols for regulatory compliance and human subjects protection. The protocol has received approval from our institution’s institutional review board (protocol #2000038624) with a waiver of informed consent for collecting non-identifiable information only. Any relevant modifications in protocol will be submitted to our institution’s institutional review board as amendments. Consistent with the initial EMBED trial,25 28 we have obtained a waiver of informed consent under the common rule (45 code of federal regulations 46.116),66 67 since this research involves observation of routine care that would be altered if consent was obtained. Any patient who has opted out of research in their personal health record (Epic MyChart) will not be included in this study. Additionally, posters with information on how patients may opt out will be placed at study sites. We will also have informational meetings with nurses, residents and attending physicians describing the study, informing them of this research activity. We plan to anonymise clinical staff, reducing the only risk to staff (ie, individual identification). Paradoxically, opting out would create the greatest likelihood of identification. Therefore, instead of providing a standard opt-out for staff, we will use an embedded consent model, where all practitioners are informed that data from routine practice may be analysed in anonymised form. This approach (clear communication about the study purpose, data handling and confidentiality) will ensure that practitioners are aware of the study without requiring an explicit opt-out, which could draw attention to those who choose to opt out. Moreover, there will be no collection or analysis of identifiable health information, and there is minimal risk in implementing evidence-based best practices for OUD.
No private information for patients with OUD will be collected. Patients will instead be distinguished by a unique study identifier. It will be mandatory that the identifier that is used is not an identifiable piece of PHI and that special administrative access is required to the local EHR to use this identifier to link back to patient data. Data collected from healthcare providers will include Epic Access Log, UAL, flowsheet data, alert data and medication order data associated with ED workflow for physicians, advanced practice providers, nurses and pharmacists involved in the encounters in question. This ‘audit log’ data, including time spent on specific activities, will allow for a granular analysis of CDS use. Additional provider data may be obtained from the NPPES (National Plan and Provider Enumeration System) National Provider Identifier (NPI) Registry, publicly available for download. An honest broker will then link providers in Epic to this data set via NPI and provide a deidentified report containing provider gender, role, title/degree and number of years since NPI was issued as a proxy for clinician’s age and years since medical school graduation, binned by decade. Throughout this study, it is important to note that physicians and other healthcare providers will have access to all standard-of-care medication for OUD and other interventions they normally would and retain full autonomy to make clinical decisions, including not using the proposed intervention (ie, opt-out).
Findings from this study will be published in open-access, peer-reviewed journals, as well as publicised through additional strategies, such as dissemination to the community via channels suggested by the community advisory board and informing EHR vendors.
The authors would like to acknowledge Drs Karen Dorsey Sheares and Leora Horwitz for advising on study design.
Ethics statements
Patient consent for publication
Not applicable.
X @EM_Informatics, @DonofrioGail, @fperrwilson
Contributors MSI, GD 'O and ERM conceived of the work. ERM, MSI, JD, DM, RAT, CO, HP, MKD and JH designed the study. MSI, LB, JD, DM, GD'O, RAT and ERM were responsible for the implementation of the trial. ERM, CDH, MSI, DRL, LB and JD drafted the initial manuscript. All authors edited and approved the final version submitted for publication. As guarantor, ERM takes responsibility for all aspects of the work.
Funding This work was supported by the National Institute On Drug Abuse of the National Institutes of Health, grant number R33DA059884, and by CTSA grant number UL1 TR001863 from the National Center for Advancing Translational Science, a component of the National Institutes of Health.
Disclaimer The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Competing interests DRL is supported by the Department of Veterans Affairs, Veterans Health Administration, Office of Academic Affiliations, Office of Research and Development and has access to facilities at the VA Connecticut Healthcare System, West Haven, CT (CIN-13-407). All other authors have no competing interests to declare.
Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.
Provenance and peer review Not commissioned; peer reviewed for ethical and funding approval prior to submission.
1 Tanz LJ, Gladden RM, Dinwiddie AT, et al. Routes of Drug Use Among Drug Overdose Deaths - United States, 2020-2022. MMWR Morb Mortal Wkly Rep 2024; 73: 124–30. doi:10.15585/mmwr.mm7306a2
2 Volkow ND, Collins FS. The Role of Science in Addressing the Opioid Crisis. N Engl J Med 2017; 377: 391–4. doi:10.1056/NEJMsr1706626
3 Schieber LZ, Guy GP, Seth P, et al. Trends and Patterns of Geographic Variation in Opioid Prescribing Practices by State, United States, 2006-2017. JAMA Netw Open 2019; 2: e190665. doi:10.1001/jamanetworkopen.2019.0665
4 García MC, Heilig CM, Lee SH, et al. Opioid Prescribing Rates in Nonmetropolitan and Metropolitan Counties Among Primary Care Providers Using an Electronic Health Record System - United States, 2014-2017. MMWR Morb Mortal Wkly Rep 2019; 68: 25–30. doi:10.15585/mmwr.mm6802a1
5 Prescription opioid trends in the United States. Available: https://www.iqvia.com/en/insights/the-iqvia-institute/reports/prescription-opioid-trends-in-the-united-states [Accessed 25 Jan 2023 ].
6 US opioid dispensing rate maps. 2022. Available: https://www.cdc.gov/drugoverdose/rxrate-maps/index.html [Accessed 25 Jan 2023 ].
7 O’Donnell JK, Gladden RM, Seth P. Trends in Deaths Involving Heroin and Synthetic Opioids Excluding Methadone, and Law Enforcement Drug Product Reports, by Census Region — United States, 2006–2015. MMWR Morb Mortal Wkly Rep 2017; 66: 897–903. doi:10.15585/mmwr.mm6634a2
8 Jones CM, Einstein EB, Compton WM. Changes in Synthetic Opioid Involvement in Drug Overdose Deaths in the United States, 2010-2016. JAMA 2018; 319: 1819–21. doi:10.1001/jama.2018.2844
9 Hedegaard H, Miniño AM, Spencer MR, et al. Drug Overdose Deaths in the United States, 1999-2020. NCHS Data Brief 2021; 1–8.
10 Langabeer JR, Stotts AL, Bobrow BJ, et al. Prevalence and charges of opioid-related visits to U.S. emergency departments. Drug Alcohol Depend 2021; 221: 108568. doi:10.1016/j.drugalcdep.2021.108568
11 Sullivan LE, Fiellin DA. Narrative review: buprenorphine for opioid-dependent patients in office practice. Ann Intern Med 2008; 148: 662–70. doi:10.7326/0003-4819-148-9-200805060-00006
12 Mattick RP, Breen C, Kimber J, et al. Buprenorphine maintenance versus placebo or methadone maintenance for opioid dependence. Cochrane Database Syst Rev 2014; 2014: CD002207. doi:10.1002/14651858.CD002207.pub4
13 Larochelle MR, Bernson D, Land T, et al. Medication for Opioid Use Disorder After Nonfatal Opioid Overdose and Association With Mortality: A Cohort Study. Ann Intern Med 2018; 169: 137–45. doi:10.7326/M17-3107
14 Kakko J, Svanborg KD, Kreek MJ, et al. 1-year retention and social function after buprenorphine-assisted relapse prevention treatment for heroin dependence in Sweden: a randomised, placebo-controlled trial. Lancet 2003; 361: 662–8. doi:10.1016/S0140-6736(03)12600-1
15 D’Onofrio G, O’Connor PG, Pantalon MV, et al. Emergency department-initiated buprenorphine/naloxone treatment for opioid dependence: a randomized clinical trial. JAMA 2015; 313: 1636–44. doi:10.1001/jama.2015.3474
16 Sharma A, Kelly SM, Mitchell SG, et al. Update on Barriers to Pharmacotherapy for Opioid Use Disorders. Curr Psychiatry Rep 2017; 19: 35. doi:10.1007/s11920-017-0783-9
17 Hawk KF, D’Onofrio G, Chawarski MC, et al. Barriers and Facilitators to Clinician Readiness to Provide Emergency Department-Initiated Buprenorphine. JAMA Netw Open 2020; 3: e204561. doi:10.1001/jamanetworkopen.2020.4561
18 Schoenfeld EM, Soares WE, Schaeffer EM, et al. 'This is part of emergency medicine now': A qualitative assessment of emergency clinicians’ facilitators of and barriers to initiating buprenorphine. Acad Emerg Med 2022; 29: 28–40. doi:10.1111/acem.14369
19 Wu LT, Zhu H, Swartz MS. Treatment utilization among persons with opioid use disorder in the United States. Drug Alcohol Depend 2016; 169: 117–27. doi:10.1016/j.drugalcdep.2016.10.015
20 Lowenstein M, Kilaru A, Perrone J, et al. Barriers and facilitators for emergency department initiation of buprenorphine: A physician survey. Am J Emerg Med 2019; 37: 1787–90. doi:10.1016/j.ajem.2019.02.025
21 Loren AW. Harder to Treat Than Leukemia - Opioid Use Disorder in Survivors of Cancer. N Engl J Med 2018; 379: 2485–7. doi:10.1056/NEJMp1812850
22 Ahmed OM, Mao JA, Holt SR, et al. A scalable, automated warm handoff from the emergency department to community sites offering continued medication for opioid use disorder: Lessons learned from the EMBED trial stakeholders. J Subst Abuse Treat 2019; 102: 47–52. doi:10.1016/j.jsat.2019.05.006
23 Coupet E, D’Onofrio G, Chawarski M, et al. Emergency department patients with untreated opioid use disorder: A comparison of those seeking versus not seeking referral to substance use treatment. Drug Alcohol Depend 2021; 219: 108428. doi:10.1016/j.drugalcdep.2020.108428
24 Schoenfeld EM, Westafer LM, Beck SA, et al. 'Just give them a choice': Patients’ perspectives on starting medications for opioid use disorder in the ED. Acad Emerg Med 2022; 29: 928–43. doi:10.1111/acem.14507
25 Melnick ER, Nath B, Dziura JD, et al. User centered clinical decision support to implement initiation of buprenorphine for opioid use disorder in the emergency department: EMBED pragmatic cluster randomized controlled trial. BMJ 2022; 377: e069271. doi:10.1136/bmj-2021-069271
26 Ray JM, Ahmed OM, Solad Y, et al. Computerized Clinical Decision Support System for Emergency Department-Initiated Buprenorphine for Opioid Use Disorder: User-Centered Design. JMIR Hum Factors 2019; 6: e13121. doi:10.2196/13121
27 Melnick ER, Holland WC, Ahmed OM, et al. An integrated web application for decision support and automation of EHR workflow: a case study of current challenges to standards-based messaging and scalability from the EMBED trial. JAMIA Open 2019; 2: 434–9. doi:10.1093/jamiaopen/ooz053
28 Melnick ER, Jeffery MM, Dziura JD, et al. User-centred clinical decision support to implement emergency department-initiated buprenorphine for opioid use disorder: protocol for the pragmatic group randomised EMBED trial. BMJ Open 2019; 9: e028488. doi:10.1136/bmjopen-2018-028488
29 Initiating medication for opioid use disorder in the ed improves success with ongoing treatment. EpicShare. Available: https://www.epicshare.org/share-and-learn/yale-opioid-medication-ed [Accessed 17 Feb 2023 ].
30 Simpson MJ, Ritger C, Hoppe JA, et al. Implementation strategies to address the determinants of adoption, implementation, and maintenance of a clinical decision support tool for emergency department buprenorphine initiation: a qualitative study. Implement Sci Commun 2023; 4. doi:10.1186/s43058-023-00421-7
31 Stevens MA, Tsai J, Savitz ST, et al. Trends and Disparities in Access to Buprenorphine Treatment Following an Opioid-Related Emergency Department Visit Among an Insured Cohort, 2014-2020. JAMA Netw Open 2022; 5: e2215287. doi:10.1001/jamanetworkopen.2022.15287
32 Holland WC, Li F, Nath B, et al. Racial and ethnic disparities in emergency department-initiated buprenorphine across five health care systems. Acad Emerg Med 2023; 30: 709–20. doi:10.1111/acem.14668
33 Lowenstein M, Perrone J, Xiong RA, et al. Sustained Implementation of a Multicomponent Strategy to Increase Emergency Department-Initiated Interventions for Opioid Use Disorder. Ann Emerg Med 2022; 79: 237–48. doi:10.1016/j.annemergmed.2021.10.012
34 Butler K, Chavez T, Wakeman S, et al. Nudging Emergency Department-Initiated Addiction Treatment. J Addict Med 2022; 16: e234–9. doi:10.1097/ADM.0000000000000926
35 Collins LM, Murphy SA, Strecher V. The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. Am J Prev Med 2007; 32: S112–8. doi:10.1016/j.amepre.2007.01.022
36 Institute of Medicine, Committee on the Learning Health Care System in America. Best care at lower cost: the path to continuously learning health care in America. National Academies Press, 2013.
37 Horwitz LI, Kuznetsova M, Jones SA. Creating a Learning Health System through Rapid-Cycle, Randomized Testing. N Engl J Med 2019; 381: 1175–9. doi:10.1056/NEJMsb1900856
38 McCoy AB, Russo EM, Johnson KB, et al. Clinician collaboration to improve clinical decision support: the Clickbusters initiative. J Am Med Inform Assoc 2022; 29: 1050–9. doi:10.1093/jamia/ocac027
39 Speroff T, O’Connor GT. Study designs for PDSA quality improvement research. Qual Manag Health Care 2004; 13: 17–32. doi:10.1097/00019514-200401000-00002
40 Leis JA, Shojania KG. A primer on PDSA: executing plan-do-study-act cycles in practice, not just in name. BMJ Qual Saf 2017; 26: 572–7. doi:10.1136/bmjqs-2016-006245
41 Lowenstein M, McFadden R, Abdel-Rahman D, et al. Redesign of Opioid Use Disorder Screening and Treatment in the ED. NEJM Catal Innov Care Deliv 2022; 3. doi:10.1056/CAT.21.0297
42 Collins LM, Murphy SA, Nair VN, et al. A strategy for optimizing and evaluating behavioral interventions. Ann Behav Med 2005; 30: 65–73. doi:10.1207/s15324796abm3001_8
43 Gallis JA, Bennett GG, Steinberg DM, et al. Randomization procedures for multicomponent behavioral intervention factorial trials in the multiphase optimization strategy framework: challenges and recommendations. Transl Behav Med 2019; 9: 1047–56. doi:10.1093/tbm/iby131
44 Bennett GG, Steinberg D, Bolton J, et al. Optimizing an Obesity Treatment Using the Multiphase Optimization Strategy Framework: Protocol for a Randomized Factorial Trial. JMIR Res Protoc 2021; 10: e19506. doi:10.2196/19506
45 Adler-Milstein J, Adelman JS, Tai-Seale M, et al. EHR audit logs: A new goldmine for health services research? J Biomed Inform 2020; 101: 103343. doi:10.1016/j.jbi.2019.103343
46 Melnick ER, Sinsky CA, Krumholz HM. Implementing Measurement Science for Electronic Health Record Use. JAMA 2021; 325: 2149–50. doi:10.1001/jama.2021.5487
47 Rule A, Melnick ER, Apathy NC. Using event logs to observe interactions with electronic health records: an updated scoping review shows increasing use of vendor-derived measures. J Am Med Inform Assoc 2022; 30: 144–54. doi:10.1093/jamia/ocac177
48 Taylor RA, Fiellin D, D’Onofrio G, et al. Identifying opioid-related electronic health record phenotypes for emergency care research and surveillance: An expert consensus driven concept mapping process. Subst Abus 2022; 43: 841–7. doi:10.1080/08897077.2021.1975864
49 Emergency department-initiated buprenorphine validation network trial. Available: https://www.clinicaltrials.gov/ct2/show/ NCT04225598 [Accessed 28 Feb 2023 ].
50 Smalley JB, Merritt MW, Al-Khatib SM, et al. Ethical responsibilities toward indirect and collateral participants in pragmatic clinical trials. Clin Trials 2015; 12: 476–84. doi:10.1177/1740774515597698
51 Chartash D, Paek H, Dziura JD, et al. Identifying Opioid Use Disorder in the Emergency Department: Multi-System Electronic Health Record-Based Computable Phenotype Derivation and Validation Study. JMIR Med Inform 2019; 7: e15794. doi:10.2196/15794
52 Holland WC, Nath B, Li F, et al. Interrupted Time Series of User-centered Clinical Decision Support Implementation for Emergency Department-initiated Buprenorphine for Opioid Use Disorder. Acad Emerg Med 2020; 27: 753–63. doi:10.1111/acem.14002
53 Taylor RA, Gilson A, Schulz W, et al. Computational phenotypes for patients with opioid-related disorders presenting to the emergency department. PLoS One 2023; 18: e0291572. doi:10.1371/journal.pone.0291572
54 Foy R, Skrypak M, Alderson S, et al. Revitalising audit and feedback to improve patient care. BMJ 2020; 368: m213. doi:10.1136/bmj.m213
55 Nguemeni Tiako MJ, Shofer F, Dolan A, et al. Personalized risk communication and opioid prescribing in association with nonprescribed opioid use: A secondary analysis of a randomized controlled trial. Acad Emerg Med 2023; 30: 851–8. doi:10.1111/acem.14710
56 Rhee TG, D’Onofrio G, Fiellin DA. Trends in the Use of Buprenorphine in US Emergency Departments, 2002-2017. JAMA Netw Open 2020; 3: e2021209. doi:10.1001/jamanetworkopen.2020.21209
57 Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health 1999; 89: 1322–7. doi:10.2105/ajph.89.9.1322
58 Glasgow RE, Lichtenstein E, Marcus AC. Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health 2003; 93: 1261–7. doi:10.2105/ajph.93.8.1261
59 Etchells E, Ho M, Shojania KG. Value of small sample sizes in rapid-cycle quality improvement projects. BMJ Qual Saf 2016; 25: 202–6. doi:10.1136/bmjqs-2015-005094
60 Moyer JC, Li F, Cook AJ, et al. Evaluating analytic models for individually randomized group treatment trials with complex clustering in nested and crossed designs. Stat Med 2024; 43: 4796–818. doi:10.1002/sim.10206
61 Choi HJ, Lee MJ, Choi C-M, et al. Establishing the role of honest broker: bridging the gap between protecting personal health data and clinical research efficiency. PeerJ 2015; 3: e1506. doi:10.7717/peerj.1506
62 Tait SD, Oshima SM, Ren Y, et al. Electronic Health Record Use by Sex Among Physicians in an Academic Health Care System. JAMA Intern Med 2021; 181: 288–90. doi:10.1001/jamainternmed.2020.5036
63 Melnick ER, Dyrbye LN, Sinsky CA, et al. The Association Between Perceived Electronic Health Record Usability and Professional Burnout Among US Physicians. Mayo Clin Proc 2020; 95: 476–87. doi:10.1016/j.mayocp.2019.09.024
64 Melnick ER, Ong SY, Fong A, et al. Characterizing physician EHR use with vendor derived data: a feasibility study and cross-sectional analysis. J Am Med Inform Assoc 2021; 28: 1383–92. doi:10.1093/jamia/ocab011
65 Melnick ER, West CP, Nath B, et al. The association between perceived electronic health record usability and professional burnout among US nurses. J Am Med Inform Assoc 2021; 28: 1632–41. doi:10.1093/jamia/ocab059
66 Lantos JD, Wendler D, Septimus E, et al. Considerations in the evaluation and determination of minimal risk in pragmatic clinical trials. Clin Trials 2015; 12: 485–93. doi:10.1177/1740774515597687
67 McKinney RE, Beskow LM, Ford DE, et al. Use of altered informed consent in pragmatic clinical research. Clin Trials 2015; 12: 494–502. doi:10.1177/1740774515597688
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2025 Author(s) (or their employer(s)) 2025. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ Group. http://creativecommons.org/licenses/by-nc/4.0/ This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/ . Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
Introduction
Despite the current opioid crisis resulting in tens of thousands of deaths every year, buprenorphine, a medication that can reduce opioid-related mortality, withdrawal, drug use and craving, is still underprescribed in the emergency department (ED) for treatment of opioid use disorder (OUD). The EMergency department-initiated BuprenorphinE for opioid use Disorder (EMBED) trial introduced a clinical decision support (CDS) tool that improved the proportion of ED physicians prescribing buprenorphine but did not affect patient-level rates of buprenorphine initiation. The present trial aims to build on these findings by optimising CDS use through iterative improvements, refined interventions and clinician feedback to enhance OUD treatment initiation in EDs.
Methods and analysis
The Adaptive Decision support for Addiction Treatment (ADAPT) trial employs the Multiphase Optimization Strategy (MOST) framework to refine a multicomponent CDS tool designed to facilitate buprenorphine initiation for OUD in ED settings. Using a pragmatic, learning health system approach in three phases, the trial applies plan–do–study–act cycles for continuous CDS refinement. The CDS will be updated in the preparation phase to reflect new evidence. The optimisation phase will include a 2×2×2 factorial trial, testing the impact of various intervention components, followed by rapid, serial randomised usability testing to reduce user errors and enhance CDS workflow efficiency. In the evaluation phase, the optimised CDS package will be tested in a randomised trial to assess its effectiveness in increasing ED initiation of buprenorphine compared with the original EMBED CDS.
Ethics and dissemination
The protocol has received approval from our institution’s institutional review board (protocol #2000038624) with a waiver of informed consent for collecting non-identifiable information only. Given the minimal risk involved in implementing established best practices, an independent study monitor will oversee the study instead of a Data Safety Monitoring Board. Findings will be submitted to ClinicalTrials.gov, published in open-access, peer-reviewed journals, presented at national conferences and shared with clinicians at participating sites through email notification.
Trial registration number
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details
; Heagerty, Patrick J 10 ; Delgado, Mucio Kit 11 ; Hoppe, Jason 12 ; Melnick, Edward R 13
1 Department of Emergency Medicine, Yale University School of Medicine, New Haven, Connecticut, USA; Department of Biomedical Informatics and Data Sciences, Yale University School of Medicine, New Haven, Connecticut, USA
2 Department of Emergency Medicine, Yale University School of Medicine, New Haven, Connecticut, USA
3 Department of Biomedical Informatics and Data Sciences, Yale University School of Medicine, New Haven, Connecticut, USA; Department of Veterans Affairs, VA Connecticut Healthcare System—West Haven Campus, West Haven, Connecticut, USA
4 Department of Emergency Medicine, Yale University School of Medicine, New Haven, Connecticut, USA; Yale University School of Public Health, New Haven, Connecticut, USA
5 Department of Biomedical Informatics and Data Sciences, Yale University School of Medicine, New Haven, Connecticut, USA
6 Department of Emergency Medicine, Yale University School of Medicine, New Haven, Connecticut, USA; Yale University School of Public Health, New Haven, Connecticut, USA; Department of Internal Medicine, Yale University School of Medicine, New Haven, Connecticut, USA
7 Department of Internal Medicine, Yale University School of Medicine, New Haven, Connecticut, USA; Equity Research and Innovation Center, Yale University School of Medicine, New Haven, Connecticut, USA
8 Digital & Technology Solutions, Yale New-Haven Health, New Haven, Connecticut, USA
9 Program of Applied Translational Research, Yale University School of Medicine, New Haven, Connecticut, USA; Section of Nephrology, Department of Medicine, Yale University School of Medicine, New Haven, Connecticut, USA
10 Department of Biostatistics, University of Washington, Seattle, Washington, USA
11 Department of Emergency Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
12 Department of Emergency Medicine, University of Colorado School of Medicine, Aurora, Colorado, USA
13 Department of Emergency Medicine, Yale University School of Medicine, New Haven, Connecticut, USA; Department of Biomedical Informatics and Data Sciences, Yale University School of Medicine, New Haven, Connecticut, USA; Yale University School of Public Health, New Haven, Connecticut, USA




