The Video intervention to Inspire Treatment Adherence for Life (VITAL Start): protocol for a multisite randomized controlled trial of a brief video-based intervention to improve antiretroviral adherence and retention among HIV-infected pregnant women in Malawi

Abstract

Background

Improving maternal antiretroviral therapy (ART) retention and adherence is a critical challenge facing prevention of mother-to-child transmission (PMTCT) of HIV programs. There is an urgent need for evidence-based, cost-effective, and scalable interventions to improve maternal adherence and retention that can be feasibly implemented in overburdened health systems. Brief video-based interventions are a promising but underutilized approach to this crisis. We describe a trial protocol to evaluate the effectiveness and implementation of a standardized educational video-based intervention targeting HIV-infected pregnant women that seeks to optimize their ART retention and adherence by providing a VITAL Start (Video intervention to Inspire Treatment Adherence for Life) before committing to lifelong ART.

Methods

This study is a multisite parallel group, randomized controlled trial assessing the effectiveness of a brief facility-based video intervention to optimize retention and adherence to ART among pregnant women living with HIV in Malawi. A total of 892 pregnant women living with HIV and not yet on ART will be randomized to standard-of-care pre-ART counseling or VITAL Start. The primary outcome is a composite of retention and adherence (viral load < 1000 copies/ml) 12 months after starting ART. Secondary outcomes include assessments of behavioral adherence (self-reported adherence, pharmacy refill, and tenofovir diphosphate concentration), psychosocial impact, and resource utilization. We will also examine the implementation of VITAL Start via surveys and qualitative interviews with patients, partners, and health care workers and conduct cost-effectiveness analyses.

Discussion

This is a robust evaluation of an innovative facility-based video intervention for pregnant women living with HIV, with the potential to improve maternal and infant outcomes.

Trial registration

ClinicalTrials.gov, NCT03654898. Registered on 31 August 2018.

Background

In 2011, Malawi introduced Option B+ (B+), a policy of test-and-treat universal lifelong antiretroviral therapy (ART) for pregnant and breastfeeding women. After implementation, maternal ART uptake increased sevenfold, the proportion of pregnant women receiving ART increased from 49% in the pre-B+ era to 89% in 2016, and vertical transmission rates declined [1–6]. Recognizing these benefits, the World Health Organization endorsed B+, and the majority of high-prevalence countries are implementing B+. In part, due to the success of B+, countries have transitioned to universal treatment for all adults living with HIV infection.

Although the B+ policy resulted in significant gains in uptake of ART, suboptimal ART adherence and retention in care remain concerning. Only 59% of pregnant women initiated on ART were retained in care after 2 years, with the greatest losses occurring soon after initiating treatment [4, 7]. Of those retained, only two-thirds achieved adequate adherence [4, 8]. Drops in retention shortly after ART initiation have also been reported from other high-prevalence settings in the developing world [9–14].

Barriers to maternal retention and adherence are multifactorial. B+ was a radical paradigm shift, where individuals who felt healthy were told to start lifelong ART. While partner involvement can improve service uptake and adherence, women received little support in disclosing their status to partners [15, 16]. For the health system, rapid ART expansion occurred despite minimal increases in the health workforce. Overextended staff had to absorb a new flood of patients, resulting in poor pre-ART education, long wait times, increased health care worker (HCW) burnout, and frustrating provider-patient interactions [8, 17–20].

Several interventions to improve retention and adherence among HIV-positive pregnant and breastfeeding women have been studied [21–41]. The most effective examples are supporter interventions (by peer supporters or community health workers) and the use of short message service (SMS) technology, but these approaches require dedicated effort for only modest and temporary gains [21–32, 35, 42–46]. Other modalities include integration of prevention of mother-to-child transmission (PMTCT) services with postnatal care [47, 48], which helps to address retention further along the cascade. There is a lack of evidence describing interventions that specifically target the first encounter, which is critical in preventing the very early disengagement characteristic of B+.

There is an urgent need for interventions to improve retention and adherence that can be feasibly implemented in overburdened health systems. Brief video-based interventions are a promising but underutilized approach to this crisis. They have a strong track record in improving health knowledge, supporting partner disclosure, increasing treatment adherence, and fostering behavior change among low literacy patients [49–55]. Video interventions are scalable due to limited costs after creation [56]. Messages can be woven into engaging storylines, piloted to ensure cultural relevance, and delivered at critical teachable moments [53]. Videos can be provided in high-volume clinics to deliver standardized messages while freeing up HCW time. While video-based interventions have potential to address barriers to ART retention and adherence, they have seen limited use in Africa’s HIV pandemic.

In recognizing the critical need for evidence-based, cost-effective, and scalable interventions to improve maternal adherence and retention, our study team developed a brief video-based intervention that provides pregnant women living with HIV a VITAL Start (Video intervention to Inspire Treatment Adherence for Life) at the critical moment before committing to lifelong ART. The pilot demonstrated that the VITAL Start was very feasible to implement, highly accepted by both pregnant women and HCWs, and resulted in excellent knowledge acquisition and better short-term self-reported adherence as compared to the control [57]. In the present trial, we aim to rigorously evaluate the effect of VITAL Start compared to standard of care (SOC) on the primary composite outcome of retention and adherence in a multisite randomized controlled trial. If effective, VITAL Start offers an innovative, scalable tool to address the current crisis of maternal retention and adherence while supporting the overburdened health system in Malawi and similar settings by liberating HCW time.

Methods/design

This randomized controlled trial will evaluate the effectiveness of the VITAL Start intervention on the primary composite outcome of retention and adherence at three sites in Malawi. These methods are based on protocol version 4.0 (updated on 23 August 2018). Figure 1, Study Flowchart.

Fig. 1 [Images not available. See PDF.]

Study Flow Diagram, as per Consolidated Standards of Reporting Trials (CONSORT)

Trial setting

The trial will take place in Malawi, a landlocked country of 17 million people in sub-Saharan Africa. Malawi’s per capita gross national income is $340 USD, and it has an adult literacy rate of 62% [58, 59]. Almost all pregnant women (95%) attend an antenatal care (ANC) clinic at least once in pregnancy, and HIV status is determined in more than 90% of ANC attendees through a routine opt-out approach [3, 60]. Adult HIV prevalence in Malawi is approximately 11%, and combination ART is free for all patients with a confirmed diagnosis (defined as two serial positive results from rapid antibody-based tests on whole blood). The most commonly used first-line regimen for all patients (including pregnant women) is a once-daily fixed dose combination of efavirenz, lamivudine, and tenofovir disoproxil fumarate.

The trial will take place at three sites: two urban health facilities in the capital of Lilongwe (Area 25 and Kawale Health Centers) and one rural district hospital in the southern district of Mangochi (see Table 1). All sites are high-volume public Ministry of Health (MOH) facilities that were selected in consultation with the MOH.

Table 1. Trial site characteristics

Site	HIV prevalence at ANC (%)	HIV-positive women attending ANC per year, n (%)			Proportion retained after initiation (%)
		On ART	Not on ART	Total	6 months	12 months
Kawale Health Center	12.4a	191 (38.9)	300 (61.1)	491	68b	57b
Area 25 Health Center	11.2	303 (51.9)	281 (48.1)	584	62	58
Mangochi District Hospital	12	288 (47.8)	315 (52.2)	603	46c	53c

All data from Malawi Ministry of Health HIV Unit quantitative data reports, calendar year 2015 unless otherwise noted due to missing data ^aIncluded data from 2014 quarter 4 due to missing data in 2015 quarter 1 ^bIncluded data from 2014 quarter 3 due to missing data in 2015 quarter 1 ^cUsing data from calendar year 2016

Recruitment of participants

We will recruit 892 pregnant women living with HIV presenting to ANC clinics. Research assistants (RAs) assigned to each facility will deliver health talks to all patients attending ANC before the clinic begins, describing the trial and inviting interested patients to participate. RAs will also work with facility staff to identify eligible participants. To be eligible for trial participation, individuals must meet all of the following inclusion criteria:

1. Willing to provide informed consent

2. Currently pregnant, verified by palpation or urine pregnancy test if not palpable

3. HIV-positive, verified by two positive rapid antibody-based tests

4. Able to understand Chichewa

5. Age 18 or older. Individuals age 16–17 may participate only if they are either married or have a child

6. Not currently on ART. Individuals previously on ART but who disengaged from care prior to the index pregnancy are eligible

7. Plans to stay in the trial catchment area and receive ART and ANC services from the health facility of enrollment for at least 6 months.

Exclusion criteria include any of the following:

1. Already on ART

2. Pre-existing psychiatric comorbidity that would impair ability to provide informed consent.

Participants will be randomized in a 1:1 fashion to the SOC or VITAL Start arms. In terms of HIV/ART care received, the only difference between the arms will be the type of pre-ART counseling received.

Standard-of-care pre-ART counseling

Participants randomized to SOC will receive the SOC pre-ART initiation education from a clinic health worker using the National ART Counseling Flip Chart [61], an educational tool with pictures on one side and key message prompts on the other. Topics include the basics of ART and the importance of adherence. Complete review of the flip chart typically takes one hour. To reduce contamination, VITAL Start and SOC will be delivered in separate areas.

VITAL Start intervention pre-ART counseling

Participants in the VITAL Start arm will receive a 37-min intervention (27-min video and 10-min scripted RA-delivered individual counseling session). The video, titled Chiyembekezo (“Hope” in Chichewa), was developed through an iterative multistep process involving a team of persons living with HIV, researchers, clinicians, MOH staff, and other stakeholders. In conceptualizing the video, three behavior-determinant models were selected based on their demonstrated ability to promote behavior change in HIV/STD interventions:

1. Social cognitive theory, to address social influences

2. The theory of planned behavior, to address the cognitive aspects of how patients may conceptualize health threats and appraise barriers to or facilitators of lifelong retention and adherence to ART

3. The information-motivation-behavioral (IMB) skills model, which asserts that knowledge must be linked to both motivation and behavioral skills to overcome barriers critical to achieve adherence [57].

Development of video content was through a community participatory approach to ensure that the content was acceptable and engaging. Focus groups with people living with HIV/AIDS and local clinicians identified three key subject areas the video should target: (1) the importance of starting lifelong ART while feeling healthy; (2) management of ART side effects; (3) partner disclosure.

An advisory group of HCWs, ART providers, and MOH staff consulted at all stages of video development. Content was generated through a partnership with In Tune for Life, a nonprofit organization with expertise producing health promotion videos. The finished video depicts an urban Malawi setting with a female protagonist who is pregnant and newly diagnosed with HIV at ANC clinic. The film depicts her anxieties about her health, protecting her baby, disclosing to her husband, and remaining on ART for life. A nurse and close friend encourage her to disclose her status to her partner and remain adherent. Through their reassurances, the protagonist is empowered in her relationship with her husband and prepared to take ART for life.

Interventions for both arms (VITAL Start and SOC) occur upon trial enrollment at the ART initiation visit. Due to the one-off nature of the trial intervention, there are no criteria for discontinuing or modifying allocated interventions for a given trial participant after randomization. Participants will not be allowed to switch arms if they desire a different intervention after allocation. All other clinical care will be carried out according to MOH guidelines.

Contamination and intervention fidelity

To help ensure treatment fidelity and reduce contamination, we have adopted practices recommended by the National Institutes of Health (NIH) Behavior Change Consortium Treatment Fidelity Workgroup in five areas: trial design, training, delivery of treatment, and receipt of and enactment of treatment skills [62]. Multiple strategies were developed, tested, and revised; key strategies are listed in Table 2. In brief, we will use two fidelity checklists to monitor, measure, and ensure fidelity to the VITAL Start intervention. The two checklists are an Observer Intervention Fidelity Checklist (completed by an RA observing the VITAL Start intervention) and a Self-Administered Intervention Fidelity Checklist (completed by the RA who is administering the intervention). An overall fidelity score will be determined to assess the level of fidelity maintained based upon four key measurement criteria as outlined in Dusenbury, et al. [65]: adherence, dose, quality of delivery, and participant responsiveness. Other fidelity measures are outlined in Table 2.

Table 2. Methods to reduce contamination during all phases of the proposed research and ensure intervention fidelity

Trial design and pre-implementation

▪ Increased sample size to account for potential contamination (up to 15%)

▪ Focus group discussions and literature reviews have explored types, extent of, and measures to reduce possible contamination sources. Overall risk of contamination deemed to be very small

▪ Focus group discussions identified video recall items to measure contamination

▪ Trial staff and trial clinic training emphasizes the implications of contamination, how to avoid it, how to address questions using non-biased explanations, and the need to ensure VITAL Start and SOC are delivered in separate places

Implementation

▪ VITAL Start and SOC occur in separate locations, and intervention is delivered by trained RAs

▪ Participants will be escorted between counseling and survey locations

▪ Level and extent of patient-reported contamination is measured at follow-up visits

▪ Video is on password-protected tablet that is stored at the health facility and not available through other channels

▪ Information packs with VITAL Start materials are clearly labeled and stored separately from SOC materials

▪ Any accidental contamination by trial or health facility staff will be recorded on Unanticipated Problems Forms that are reviewed monthly at site-level meetings and supervisions

▪ Site Research Supervisor to confirm trial participants only receive assigned intervention

▪ Rationale and techniques for reducing contamination discussed at monthly site meetings with health facility and trial staff

▪ Information regarding participant’s trial arm allocation is kept in a locked drawer that can only be accessed by RA

▪ Contamination is measured quarterly as a component of checklist to measure the degree of fidelity [63]

Strategies to ensure treatment fidelity

▪ Fidelity checklists completed by RA (self-administered) and observer. Key issues discussed at quarterly staff meetings

▪ Intervention sessions audio recorded, and 10% reviewed centrally

▪ Electronic time-stamps of session start and end time and bi-monthly supervisions by trial coordinator

▪ Unannounced trial coordinator visits

▪ Plans for implementation setbacks which include two providers (RAs) per site, back-up tablets, paper forms, power banks, and back-up physical space for intervention implementation

Analysis

▪ If contamination occurs, we will perform contamination-adjusted intention-to-treat analysis [64]

▪ The degree, nature, and effects of contamination will be included in final manuscripts

Participant follow-up surveys

After enrollment, participants will attend trial visits at months 1, 3, 6, and 12 for a total of five trial visits. Participants will be provided with the equivalent of $5 USD for transport reimbursement for each trial visit. Follow-up surveys will be completed at a time and place separate from routine ART refill visits.

Measures

A full list of measures and a schedule of assessments are outlined in Table 3. See also the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist, provided as Additional file 1. The primary outcome is a composite measure of retention and viral suppression at 6 and 12 months. Participants will be considered retained in care if they are verified by clinic records as active on ART within 2 months of the last trial visit. Viral suppression will be measured as viral load < 1000 copies/mL. Retention was chosen as a primary outcome due to its strong association with adherence [81]. Viral suppression as a marker of adherence was included in the primary outcome because viral suppression is the clinical goal of ART and leads to decreased HIV-related mortality and morbidity [82].

Table 3. VITAL Start trial outcomes and schedule of measures

Schedule (month number)	0	1	3	6	12
Informed consent	x
Allocation	x
Intervention	x
Aim 1: Retention and adherence (viral load [VL] < 1000 copies/ml) at 12 months
Retention in care (data abstraction from facility records)		x	x	x	x
Viral suppression (VL < 1000 copies/ml)				x	x
Aim 1b: Behavioral adherence
Self-reported adherence [66, 67]		x	x	x	x
ART side effects		x	x	x	x
Pharmacy refill data abstraction [68]		x	x	x	x
Tenofovir diphosphate level					x
Aim 1c: Knowledge and psychosocial impact
HIV/ART knowledge and attitudes survey [69]	x		x		x
Adherence self-efficacy [70, 71]	x	x		x	x
Motivation and behavior skills assessment: LifeWindows tool [72]		x		x	x
Self-reported partner disclosure and World Health Organization intimate partner violence survey [73]	x	x		x	x
Multidimensional Scale of Perceived Social Support (MSPSS) [74] and self-reporting questionnaire [75]	x	x		x	x
Shortened Alcohol Use Disorders Identification Test [76] and Drug Use Disorders Identification Test [77]	x	x		x	x
Patient-Provider Relationship Scale [78, 79]		x			x
Aim 2: Implementation outcomes
Participant satisfaction surveys	x
Interviews with participants, partners, health care workers	x	x	x	x	x
Trial fidelity evaluations	x
Contamination assessment		x		x	x
Time-motion assessments in line with Suggested Time And Motion Procedures (STAMP) checklist [80]	x
Aim 3: Cost-effectiveness analysis. Data collected throughout trial period. Start-up: video creation, training, tablets and accessories (security cable, power bank). Recurring: tablet maintenance; personnel time and salaries

We will also examine several secondary outcomes. Adherence will be further measured by self-reported adherence, pharmacy refill data, and tenofovir diphosphate concentration at 12 months. Tenofovir diphosphate (TFV-DP) is a metabolite of tenofovir that allows estimation of average adherence over the preceding 2 weeks. Use of TFV-DP will allow detection of small, clinically significant differences in adherence between groups that may be missed by viral load testing alone [83].

To critically examine the implementation of VITAL Start, we will also examine participant satisfaction, intervention fidelity, contamination, and time-motion data. Guided by social action theory [84], we will also assess a series of behavioral, mental health, and psychosocial measures during the trial as potential mediators or modifiers of the intervention’s effect as well as potential independent factors, which may influence adherence behaviors. These include assessments of HIV knowledge, whether a patient is a new ART initiator or re-initiating ART, measures of depression, alcohol and substance use, intimate partner violence, and availability of social support. Finally, we will collect financial data alongside clinical outcomes to assess the cost-effectiveness of VITAL Start compared to SOC.

The issue of distinguishing trial retention from retention in clinical care deserves special mention in this trial, where retention in clinical services is a primary outcome, and efforts to promote trial retention may have unintended consequences. Trial staff will collect telephone numbers and/or physical address details from participants willing to provide this information. When a participant is absent for a trial visit, staff will trace her first by telephone, and will make three valid attempts (defined as speaking with the participant) or will attempt daily for a week, whichever comes first. After phone tracing, staff will attempt to visit the participant at home, and will make up to three valid attempts. Participants will be allowed to complete trial questionnaires at home during these tracing attempts if they desire and a secure location is available for the interaction. All tracing attempts will be recorded to allow analysis of tracing attempts according to trial arm and controlling for tracing attempts, if necessary.

Participants who transfer to a different facility will not be terminated from the trial unless they withdraw consent or are found to have died. This decision reflects the highly mobile nature of the trial population that we have observed in previous studies. By keeping participants enrolled, they can easily transition back into the trial if they move back to the catchment area or are willing to continue attending trial visits. If a subject is discontinued at any time after entering the trial, the trial team will try and ensure that the subject completes the Final Visit survey and procedures.

Sample size

The sample size calculation is based on a comparison of the proportions of those in the intervention versus SOC arms who reach the combined primary endpoint at 12 months after maternal ART initiation. A combination of various scenarios was considered for retention in care (50–90%), maternal viral suppression (50–90%) among those retained, and contamination rate (0–15%). A difference of 15% was selected as the smallest difference that would be of clinical significance.

For the primary analysis in all subjects, accounting for up to a 15% contamination (pilot data suggested 0%) and 5% attrition rate (based on transfer-out rates from MOH data at trial clinics in 2016) [3], and assuming a 1:1 allocation ratio to achieve 90% power to detect a minimum difference of 15% between the control and intervention groups, 796 subjects are required (398/398 per arm) at a significance level of 0.025 to account for multiple comparisons. We further increased this by 12% to 892 total (446 per arm) to account for a potential change to national guidelines to recommend dolutegravir-based regimens as first-line ART. The higher potency of dolutegravir-based regimens may allow higher rates of viral suppression at lower adherence levels, therefore improving overall viral suppression and making a difference between arms more difficult to detect.

Assignment of interventions and blinding

Participants will be randomly assigned in a 1:1 fashion stratified by clinic proportional to the number of potential eligible participants at that site. Smith’s randomization algorithm will be applied for random assignment to VITAL Start or SOC to reduce imbalance throughout the randomization process [85]. The primary trial biostatistician will generate serial random codes for each clinic and place them on a sequential list that will be maintained by the trial coordinator. Assignments will be provided to RAs in opaque sealed numbered envelopes to be opened sequentially prior to administration of the baseline survey. If a participant refuses to participate in the trial after randomization, the next subject will not replace her. The randomized participant who refused participation will be included in the intention-to-treat (ITT) analysis. Due to the nature of the intervention, RAs, clinic staff, and participants will not be blinded. Separate research staff (outcome assessors) will remain blinded and conduct the outcome assessments including follow-up surveys. They will not be informed of the participants’ group assignment. All trial investigators will also remain blinded. After data collection is complete and the database cleaned and locked, a research team member will break the randomization code to input the group allocation within the pre-existing data set and enable between-group analyses.

Strategies for ensuring fidelity to the VITAL Start intervention are described in detail in Table 2. Fidelity will be quantitatively assessed by both the RA performing the counseling and an RA observing the counseling session. Contamination may occur if participants who receive the VITAL Start intervention discuss elements of the video with participants who received standard of care (SOC). Pilot data suggested little to no risk of contamination with the contamination reduction procedures that will be used in this trial (Table 2). However, in case contamination does occur, we will assess the prevalence, magnitude, and source of contamination. Participants will complete a contamination assessment at months 1, 6, and 12, and we will account for contamination via a contamination-adjusted ITT analysis [64].

Data collection and management

All data will be collected on electronic case report forms (CRFs) by trained trial staff using electronic CRFs on tablets and will be monitored weekly via data checks by the study team. We elected to use electronic CRFs to improve both efficiency and data quality through the use of internal checks and automated skip patterns [86]. Backup paper CRFs will be maintained at all sites. The use of tablets also allows us to use an audio computer-assisted self-interview approach to assess self-reported adherence to medication, theoretically improving participants’ comfort with responding truthfully to these questions [87]. RAs will administer surveys at baseline; all follow-up surveys will be conducted by blinded outcome assessors at a location separate from the ART clinic where they receive their ART medications.

All tablets will be encrypted and password-protected and will use a secure connection to transfer data to a central server on a daily basis. A full list of data sources and schedule of assessments can be found in Table 3.

Statistical methods

The primary analysis will be conducted as ITT. If there are exceptional circumstances which could lead to excluding randomized subjects from the ITT population without the possibility of introducing bias (e.g., an ineligible patient is mistakenly enrolled), a modified ITT (mITT) analysis will be used as the primary analysis. A statistical analysis will be performed at the end of the trial; no statistical interim analysis is planned.

Baseline characteristics by arm will be displayed using descriptive statistics. The primary outcome measure (maternal ART retention and viral suppression) is a binary variable, and it will be compared by chi-square tests at 12 months, and followed by logistic regression to study the association between intervention and outcome while controlling the baseline prognostic factors of the main outcome. The main exposure variable and any factor deemed to be clinically relevant will be forced into the model regardless of the statistical significance. Secondary outcomes include components of the composite outcome, self-reported adherence, pharmacy refill data, ART knowledge and self-efficacy, motivation and behavior skills, partner disclosure, and social support, etc. For the 12 months outcome, chi-square tests and two-sample t tests will be used. For repeated measures, the generalized estimating equations (GEE) method and linear mixed models will be used to examine differences in trajectories over time between the intervention and control groups while accounting for the correlation among repeated measures from the same subject. Additionally, for time-to-event outcomes, such as time to partner disclosure, we will conduct survival analysis using the Kaplan-Meier (KM) method with log-rank test and Cox proportional hazard models including the covariates. A p value of 0.05 will be deemed statistically significant and a p value of 0.1 regarded as a statistical trend. All analyses will be performed using SAS software (SAS Institute, Inc., Cary, NC, USA).

Cost-effectiveness analysis

The MOH will be the main implementer of the VITAL Start intervention as well as SOC pre-ART counseling. Therefore, we will assess costs from the provider (MOH) perspective. We will use both micro- and macro-based approaches as appropriate to identify and quantify intervention resources [88–90]. Retrospectively, we will extract information on resources expended for video design and production from inventory and other program documents. Unit prices will be obtained from account records or from local retailers. To measure staff time devoted to pre- ART counseling, we will perform time-motion assessments in line with the Suggested Time And Motion Procedures (STAMP) [80, 91, 92]. We will sample sufficiently to account for potential sources of heterogeneity such as trial clinic and provider. The value of staff time will then be estimated as the product of their gross salary and share of time allocated to intervention/pre-ART counseling.

We will calculate the incremental cost-effectiveness ratio (ICER) for the primary outcome of economic interest. The ICER is the difference in costs between two interventions divided by the difference in their effects, and it can be interpreted as the incremental price of a unit health effect from the intervention under study, as compared to the alternative. We will conduct one-way and multiway sensitivity analyses to model cost-effectiveness under various conditions, such as lower pricing of video production, mode of delivery, tablets, and alternate health care worker (HCW) cadres to deliver the intervention. Finally, we will conduct probabilistic sensitivity analyses using bootstrapping methods to ascertain the robustness of our results to extreme assumptions/scenarios. Based on emerging literature [89, 93], we will determine cost-effectiveness by comparisons with published ICERs for other commonly implemented HIV interventions in Malawi and southern Africa, as well as with gross domestic product (GDP)-based thresholds (0.5× and 1× the Malawi per capita GDP of $487) [94].

Monitoring

Blinded data monitoring will be conducted using descriptive statistics for quality assessment purposes, such as monitoring subject accrual and compliance as well as identifying outstanding values, etc., for data quality control. The results will be displayed for follow-up measures for the combined group, and otherwise by blinded treatment groups. We will monitor for overall trends in retention weekly. All unanticipated problems and adverse events will be recorded on designated CRFs and reported to the principal investigator (PI) and appropriate regulatory bodies. All potential adverse events will be reviewed weekly by the PI, trial coordinator, and research supervisors. The data manager will review trial data weekly. A stakeholder advisory group (SAG) comprising trial site supervisors, trial site clinical staff, and community members will meet twice a year to provide input on study implementation. In addition, an external monitor will evaluate trial operations annually.

Measures to ensure intervention implementation and fidelity are detailed in Table 2.

Ethics and dissemination

This trial has been approved by the Baylor College of Medicine Institutional Review Board (IRB; protocol H-39785) and the Malawi National Health Sciences Research Committee (NHSRC; protocol 16/05/1593). If the investigators elect to make important modifications to the protocol, amendments will be submitted to both the Baylor IRB and Malawi NHSRC.

Informed consent will be obtained in writing from all participants by trial site staff using forms in Chichewa approved by both the Baylor IRB and Malawi NHSRC. A staff member fluent in Chichewa will be responsible for reviewing the form in detail and eliciting any questions before the participant signs. If the patient is unable to read, staff will read the consent form to the participant in its entirety, the participant will mark her thumbprint to indicate consent, and the process must be witnessed by a third party not involved in the trial.

Confidentiality will be prioritized and will include the following measures specific to our intervention and trial population:

1. We will use only study identification numbers for all data collection and analysis.

2. All electronic data will be secured through encryption, and paper data will be secured through locked cabinets stored in locked study offices.

3. We will ensure that all staff are trained to the highest standards of confidentiality and data security procedures through appropriate online modules provided by the Collaborative Institutional Training Initiative (CITI).

4. When conducting home visits, staff will not wear anything that shows they are from a health facility or the trial, and they will not carry information identifying the participant as having HIV, to minimize unintentional risk of disclosure.

Ancillary and post-trial care

All participants will receive free lifelong ART as per Malawi MOH guidelines. Lab results from the trial (viral load measurements and TFV-DP concentration) will be provided to participants after the final trial visit in writing, along with a brief interpretation of the results for the participant’s clinician.

We will ensure that trained psychosocial counselors will be available to support participants who screen positive for current intimate partner violence, depression, or suicidality.

Dissemination policy

Results will be reported to the MOH and local stakeholders, as well as at local and international conferences. Results will also be submitted to peer-reviewed journals. Authorship eligibility will be guided by the International Committee of Medical Journal Editors criteria [95].

Discussion

By evaluating a brief, low-cost, scalable and locally developed and culturally tailored tool to promote adherence and retention, this trial has the potential to streamline ART counseling in resource-limited settings. In contrast to many other interventions, it also has the potential to liberate precious HCW time, thereby supporting health systems in meeting the needs of their patients.

This trial utilizes multiple methods to examine adherence, including two methods of behavioral adherence (self-report and pharmacy pill count), as well as viral load and TFV-DP testing. Due to TFV-DP’s longer half-life, its concentration is a measure of average adherence over the previous 2 months, allowing estimation of the average number of doses missed per week. Use of this marker thereby allows reliable detection of clinically significant between-group differences in adherence. This trial also utilizes a combined outcome of retention and viral suppression. Further, the trial not only seeks to evaluate effectiveness, but it also aims to critically examine the implementation of a new intervention through qualitative interviews, validated questionnaires, time-motion measures, and cost-effectiveness analysis, among other methods.

As with any research design, the trial has potential limitations. In studies where a primary outcome is retention, caution is warranted in determining how participants are traced for missed trial visits, since the act of missed trial visit tracing plausibly affects clinical retention. We attempted to address this concern by outlining precisely how many tracing attempts for missed trial visits should be done, and we developed a mechanism for recording all missed trial visit tracing attempts to allow incorporation of this effect into the final analytic model as necessary.

A small pilot study suggested the VITAL Start intervention to be an acceptable, feasible approach that resulted in excellent knowledge acquisition and better short-term self-reported adherence as compared to the control. This multisite randomized controlled trial will allow rigorous evaluation of this promising approach to improve ART adherence.

Trial status

The protocol is version 4.0 dated 23 August 2018. Trial enrollment started in October 2018, and recruitment will be completed in March 2021.

Acknowledgements

We thank the Ministry of Health for their partnership in this endeavor. We are very grateful to the women living with HIV and their families, community members, and health care workers who participated in the development and piloting of the VITAL Start intervention. We appreciate the support provided by all VITAL Start team members.

Support for this trial was made possible by the Fogarty International Center of the National Institutes of Health (NIH) under award number K01 TW009644 as well the National Institute of Mental Health (NIMH; R01 MH115793).

Disclaimer

The contents of this report are the sole responsibility of the authors and do not necessarily reflect the views of the NIH or the US Government.

Authors’ contributions

MHK led the design of the trial protocol and intervention. TAT, AM, RJF, EJA, LM, XY, RS, and CM contributed to the trial protocol and all drafts of the manuscript. All authors critically reviewed, edited, and approved the final manuscript.

Authors’ information

Not applicable

Funding

MHK was supported by the Fogarty International Center of the NIH under award numbers K01 TW009644 and R01 MH115793. The sponsor of the trial is the NIMH. The funders had no role in trial design, data collection and analysis, decision to publish, or preparation of the manuscript.

Availability of data and materials

Data sets generated and/or analyzed during the current trial are available from Baylor-Malawi on reasonable request.

Ethics approval and consent to participate

This trial has been approved by the Malawi National Health Sciences Research Committee (NHSRC; protocol 16/05/1593) and the Baylor College of Medicine Institutional Review Board. National ethical approval has been confirmed from the Malawi NHSRC. In addition, local health facility level approval has been obtained. Informed consent will be obtained from all study participants. Participants will be asked to consent to use of their data should they choose to withdraw from the trial as well as permission for the research team to share relevant data with organizations, including regulatory authorities where relevant, and biological specimens.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Abbreviations

AIDS

Acquired immune deficiency syndrome

ANC

Antenatal care

ART

Antiretroviral therapy

AUDIT

Alcohol Use Disorders Identification Test

B +

Option B+

CITI

Collaborative Institutional Training Initiative

CRF

Case report form

DUDIT

Drug Use Disorders Identification Test

GDP

Gross domestic product

GEE

Generalized estimating equation(s)

HCW

Health care worker

HIV

Human immunodeficiency virus

ICER

Incremental cost-effectiveness ratio

IMB

Information-motivation-behavioral

IRB

Institutional Review Board

ITT

Intention to treat

KM

Kaplan-Meier

mITT

Modified intention to treat

MOH

Ministry of Health

MSPSS

Multidimensional Scale of Perceived Social Support

NHSRC

National Health Sciences Research Committee

NIH

National Institutes of Health

PMTCT

Prevention of mother-to-child transmission

Q&A

Question and answer

RA

Research assistant

SD

Standard deviation

SMS

Short message service

SOC

Standard of care

SRQ

Self-reporting questionnaire

STAMP

Suggested Time And Motion Procedures

STD

Sexually transmitted disease

TFV

Tenofovir

TFV-DP

Tenofovir diphosphate

USD

United States dollar

VITAL

Video intervention to Inspire Treatment Adherence for Life

VL

Viral load

Supplementary information

Supplementary information accompanies this paper at https://doi.org/10.1186/s13063-020-4131-8.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

1. Centers for Disease Control and Prevention (CDC). Impact of an innovative approach to prevent mother-to-child transmission of HIV—Malawi, July 2011–September 2012. MMWR Morb Mortal Wkly Rep; 2013; 62, 8 pp. 148-151.

2. Malawi Ministry of Health. Integrated HIV Program Report: October–December 2014; 2014; Lilongwe, Malawi Ministry Of Health: https://hiv.health.gov.mw/index.php/our-documents. Accessed 2 Apr 2019

3. Malawi Ministry of Health. Integrated HIV Program Report July–September 2016; 2016; Lilongwe, Malawi Ministry Of Health: https://hiv.health.gov.mw/index.php/our-documents. Accessed 2 Apr 2019

4. Sinunu, MA; Schouten, EJ; Wadonda-Kabondo, N; Kajawo, E; Eliya, M; Moyo, K et al. Evaluating the impact of prevention of mother-to-child transmission of HIV in Malawi through immunization clinic-based surveillance. PLOS One; 2014; 9, 6 [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/24968298][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4072708][DOI: https://dx.doi.org/10.1371/journal.pone.0100741] [COI: 1:CAS:528:DC%2BC2cXhs1eks7nK]

5. Kim, MH; Ahmed, S; Hosseinipour, MC; Giordano, TP; Chiao, EY; Yu, X et al. Implementation and operational research: the impact of option B+ on the antenatal PMTCT cascade in Lilongwe, Malawi. J Acquir Immune Defic Syndr.; 2015; 68, 5 pp. e77-e83. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25585302][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4359035][DOI: https://dx.doi.org/10.1097/QAI.0000000000000517]

6. Kim, MH; Ahmed, S; Hosseinipour, MC; Yu, X; Nguyen, C; Chimbwandira, F et al. Brief report: impact of option B+ on the infant PMTCT cascade in Lilongwe, Malawi. J Acquir Immune Defic Syndr; 2015; 70, 1 pp. 99-103. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26322670][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4537054][DOI: https://dx.doi.org/10.1097/QAI.0000000000000692]

7. Herce, ME; Mtande, T; Chimbwandira, F; Mofolo, I; Chingondole, CK; Rosenberg, NE et al. Supporting Option B+ scale up and strengthening the prevention of mother-to-child transmission cascade in central Malawi: results from a serial cross-sectional study. BMC Infect Dis; 2015; 15, 328. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26265222][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4533797][DOI: https://dx.doi.org/10.1186/s12879-015-1065-y]

8. Ahmed, S; Kim, MH; Abrams, EJ. Risks and benefits of lifelong antiretroviral treatment for pregnant and breastfeeding women: a review of the evidence for the Option B+ approach. Curr Opin HIV AIDS; 2013; 8, 5 pp. 473-488.[COI: 1:CAS:528:DC%2BC3sXht1Khur3M] [DOI: https://dx.doi.org/10.1097/COH.0b013e328363a8f2]

9. Napua, M; Pfeiffer, JT; Chale, F; Hoek, R; Manuel, J; Michel, C et al. Option B+ in Mozambique: formative research findings for the design of a facility-level clustered randomized controlled trial to improve ART retention in antenatal care. J Acquir Immune Defic Syndr; 2016; 72, Suppl 2 pp. S181-S188. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27355507][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5113244][DOI: https://dx.doi.org/10.1097/QAI.0000000000001061]

10. Puttkammer, N; Domercant, JW; Adler, M; Yuhas, K; Myrtil, M; Young, P et al. ART attrition and risk factors among Option B+ patients in Haiti: a retrospective cohort study. PLOS One; 2017; 12, 3 [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28264045][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5338795][DOI: https://dx.doi.org/10.1371/journal.pone.0173123] [COI: 1:CAS:528:DC%2BC1cXotFGh]

11. Dzangare, J; Takarinda, KC; Harries, AD; Tayler-Smith, K; Mhangara, M; Apollo, TM et al. HIV testing uptake and retention in care of HIV-infected pregnant and breastfeeding women initiated on ‘Option B+’ in rural Zimbabwe. Tropical Med Int Health; 2016; 21, 2 pp. 202-209. [DOI: https://dx.doi.org/10.1111/tmi.12637]

12. Erlwanger, AS; Joseph, J; Gotora, T; Muzunze, B; Orne-Gliemann, J; Mukungunugwa, S et al. Patterns of HIV care clinic attendance and adherence to antiretroviral therapy among pregnant and breastfeeding women living with HIV in the context of Option B+ in Zimbabwe. J Acquir Immune Defic Syndr; 2017; 75, Suppl 2 pp. S198-S206. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28498190][DOI: https://dx.doi.org/10.1097/QAI.0000000000001347]

13. Llenas-Garcia, J; Wikman-Jorgensen, P; Hobbins, M; Mussa, MA; Ehmer, J; Keiser, O et al. Retention in care of HIV-infected pregnant and lactating women starting ART under Option B+ in rural Mozambique. Tropical Med Int Health; 2016; 21, 8 pp. 1003-1012. [DOI: https://dx.doi.org/10.1111/tmi.12728]

14. Okawa, S; Chirwa, M; Ishikawa, N; Kapyata, H; Msiska, CY; Syakantu, G et al. Longitudinal adherence to antiretroviral drugs for preventing mother-to-child transmission of HIV in Zambia. BMC Pregnancy Childbirth; 2015; 15, 258. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26459335][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4603915][DOI: https://dx.doi.org/10.1186/s12884-015-0697-7] [COI: 1:CAS:528:DC%2BC28Xoslelsbw%3D]

15. Farquhar, C; Kiarie, JN; Richardson, BA; Kabura, MN; John, FN; Nduati, RW et al. Antenatal couple counseling increases uptake of interventions to prevent HIV-1 transmission. J Acquir Immune Defic Syndr; 2004; 37, 5 pp. 1620-1626. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/15577420][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3384734][DOI: https://dx.doi.org/10.1097/00126334-200412150-00016]

16. Nyondo, AL; Chimwaza, AF; Muula, AS. Exploring the relevance of male involvement in the prevention of mother to child transmission of HIV services in Blantyre. Malawi BMC Int Health Hum Rights; 2014; 14, 30. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25359447][DOI: https://dx.doi.org/10.1186/s12914-014-0030-y]

17. Tweya, H; Gugsa, S; Hosseinipour, M; Speight, C; Ng'ambi, W; Bokosi, M et al. Understanding factors, outcomes and reasons for loss to follow-up among women in Option B+ PMTCT programme in Lilongwe, Malawi. Trop Med Int Health; 2014; 19, 11 pp. 1360-1366. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25087778][DOI: https://dx.doi.org/10.1111/tmi.12369]

18. Clouse, K; Schwartz, S; Van Rie, A; Bassett, J; Yende, N; Pettifor, A. “What they wanted was to give birth; nothing else”: barriers to retention in option B+ HIV care among postpartum women in South Africa. J Acquir Immune Defic Syndr; 2014; 67, 1 pp. e12-e18. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/24977376][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6686681][DOI: https://dx.doi.org/10.1097/QAI.0000000000000263]

19. Gugsa, S; Potter, K; Tweya, H; Phiri, S; Sande, O; Sikwese, P et al. Exploring factors associated with ART adherence and retention in care under Option B+ strategy in Malawi: a qualitative study. PLOS One; 2017; 12, 6 [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28636669][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5479573][DOI: https://dx.doi.org/10.1371/journal.pone.0179838] [COI: 1:CAS:528:DC%2BC1cXkvFahtrs%3D]

20. Kim, MH; Mazenga, AC; Simon, K; Yu, X; Ahmed, S; Nyasulu, P et al. Burnout and self-reported suboptimal patient care amongst health care workers providing HIV care in Malawi. PLOS One; 2018; 13, 2 [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/29466443][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5821338][DOI: https://dx.doi.org/10.1371/journal.pone.0192983] [COI: 1:CAS:528:DC%2BC1cXit1Shur%2FK]

21. Kanters, S; Park, JJ; Chan, K; Socias, ME; Ford, N; Forrest, JI et al. Interventions to improve adherence to antiretroviral therapy: a systematic review and network meta-analysis. Lancet HIV; 2017; 4, 1 pp. e31-e40. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27863996][DOI: https://dx.doi.org/10.1016/S2352-3018(16)30206-5]

22. Ambia, J; Mandala, J. A systematic review of interventions to improve prevention of mother-to-child HIV transmission service delivery and promote retention. J Int AIDS Soc; 2016; 19, 1 20309. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27056361][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4824870][DOI: https://dx.doi.org/10.7448/IAS.19.1.20309]

23. Geldsetzer, P; Yapa, HM; Vaikath, M; Ogbuoji, O; Fox, MP; Essajee, SM et al. A systematic review of interventions to improve postpartum retention of women in PMTCT and ART care. J Int AIDS Soc; 2016; 19, 1 20679. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27118443][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4846797][DOI: https://dx.doi.org/10.7448/IAS.19.1.20679]

24. Shroufi, A; Mafara, E; Saint-Sauveur, JF; Taziwa, F; Viñoles, MC. Mother to Mother (M2M) peer support for women in Prevention of Mother to Child Transmission (PMTCT) programmes: a qualitative study. PLOS One; 2013; 8, 6[COI: 1:CAS:528:DC%2BC3sXhtVSktr%2FL] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/23755137][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3673995][DOI: https://dx.doi.org/10.1371/journal.pone.0064717]

25. Kiweewa, FM; Wabwire, D; Nakibuuka, J; Mubiru, M; Bagenda, D; Musoke, P et al. Noninferiority of a task-shifting HIV care and treatment model using peer counselors and nurses among Ugandan women initiated on ART: evidence from a randomized trial. J Acquir Immune Defic Syndr; 2013; 63, 4 pp. e125-e132.[COI: 1:CAS:528:DC%2BC3sXhtVegur3I] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/23807157][DOI: https://dx.doi.org/10.1097/QAI.0b013e3182987ce6]

26. Richter, L; Rotheram-Borus, MJ; Van Heerden, A; Stein, A; Tomlinson, M; Harwood, JM et al. Pregnant women living with HIV (WLH) supported at clinics by peer WLH: a cluster randomized controlled trial. AIDS Behav; 2014; 18, 4 pp. 706-715. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/24469222][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4109271][DOI: https://dx.doi.org/10.1007/s10461-014-0694-2]

27. Mushamiri, I; Luo, C; Iiams-Hauser, C; Ben, AY. Evaluation of the impact of a mobile health system on adherence to antenatal and postnatal care and prevention of mother-to-child transmission of HIV programs in Kenya. BMC Public Health; 2015; 15, 102. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25886279][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4328364][DOI: https://dx.doi.org/10.1186/s12889-015-1358-5]

28. Kim, MH; Ahmed, S; Buck, WC; Preidis, GA; Hosseinipour, MC; Bhalakia, A et al. The Tingathe programme: a pilot intervention using community health workers to create a continuum of care in the prevention of mother to child transmission of HIV (PMTCT) cascade of services in Malawi. J Int AIDS Soc; 2012; 15, Suppl 2 17389. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/22789644][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3499848]

29. Finocchario-Kessler, S; Gautney, BJ; Khamadi, S; Okoth, V; Goggin, K; Spinler, JK et al. If you text them, they will come: using the HIV infant tracking system to improve early infant diagnosis quality and retention in Kenya. AIDS (London, England); 2014; 28, Suppl 3 pp. S313-S321. [DOI: https://dx.doi.org/10.1097/QAD.0000000000000332]

30. Odeny, TA; Bukusi, EA; Cohen, CR; Yuhas, K; Camlin, CS; McClelland, RS. Texting improves testing: a randomized trial of two-way SMS to increase postpartum prevention of mother-to-child transmission retention and infant HIV testing. AIDS.; 2014; 28, 15 pp. 2307-2312. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25313586][DOI: https://dx.doi.org/10.1097/QAD.0000000000000409]

31. Kassaye, SG; Ong'ech, J; Sirengo, M; Kose, J; Matu, L; McOdida, P et al. Cluster-randomized controlled study of SMS text messages for prevention of mother-to-child transmission of HIV in rural Kenya. AIDS Res Treat; 2016; 2016, 1289328. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28053784][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5178353]

32. Schwartz, SR; Clouse, K; Yende, N; Van Rie, A; Bassett, J; Ratshefola, M et al. Acceptability and feasibility of a mobile phone-based case management intervention to retain mothers and infants from an Option B+ program in postpartum HIV care. Mantern Child Health J; 2015; 19, 9 pp. 2029-2037. [DOI: https://dx.doi.org/10.1007/s10995-015-1715-0]

33. Yotebieng, M; Thirumurthy, H; Moracco, KE; Kawende, B; Chalachala, JL; Wenzi, LK et al. Conditional cash transfers and uptake of and retention in prevention of mother-to-child HIV transmission care: a randomised controlled trial. Lancet HIV; 2016; 3, 2 pp. e85-e93. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26847230][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5485848][DOI: https://dx.doi.org/10.1016/S2352-3018(15)00247-7]

34. Mundell, JP; Visser, MJ; Makin, JD; Kershaw, TS; Forsyth, BWC; Jeffery, B et al. The impact of structured support groups for pregnant South African women recently diagnosed HIV positive. Women Health; 2011; 51, 6 pp. 546-565. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/21973110][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4017076][DOI: https://dx.doi.org/10.1080/03630242.2011.606356]

35. Kanters, S; Park, JJ; Chan, K; Ford, N; Forrest, J; Thorlund, K et al. Use of peers to improve adherence to antiretroviral therapy: a global network meta-analysis. J Int AIDS Soc; 2016; 19, 1 21141. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27914185][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5134746][DOI: https://dx.doi.org/10.7448/IAS.19.1.21141]

36. Rollins, NC; Essajee, SM; Bellare, N; Doherty, M; Hirnschall, GO. Improving retention in care among pregnant women and mothers living with HIV: lessons from INSPIRE and implications for future WHO guidance and monitoring. J Acquir Immune Defic Syndr; 2017; 75, Suppl 2 pp. S111-S114. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28498179][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5432092][DOI: https://dx.doi.org/10.1097/QAI.0000000000001366]

37. Pfeiffer, JT; Napua, M; Wagenaar, BH; Chale, F; Hoek, R; Micek, M et al. Stepped-wedge cluster randomized controlled trial to promote Option B+ retention in central Mozambique. J Acquir Immune Defic Syndr; 2017; 76, 3 pp. 273-280. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28777263][DOI: https://dx.doi.org/10.1097/QAI.0000000000001515] [PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7055502]

38. Mwapasa, V; Joseph, J; Tchereni, T; Jousset, A; Gunda, A. Impact of mother-infant pair clinics and short-text messaging service (SMS) reminders on retention of HIV-infected women and HIV-exposed infants in eMTCT care in Malawi: a cluster randomized trial. J Acquir Immune Defic Syndr; 2017; 75, Suppl 2 pp. S123-S131. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28498181][DOI: https://dx.doi.org/10.1097/QAI.0000000000001340]

39. Sam-Agudu, NA; Ramadhani, HO; Isah, C; Anaba, U; Erekaha, S; Fan-Osuala, C et al. The impact of structured mentor mother programs on 6-month postpartum retention and viral suppression among HIV-positive women in rural Nigeria: a prospective paired cohort study. J Acquir Immune Defic Syndr; 2017; 75, Suppl 2 pp. S173-S181. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28498187][DOI: https://dx.doi.org/10.1097/QAI.0000000000001346]

40. Osibo, B; Oronsaye, F; Alo, OD; Phillips, A; Becquet, R; Shaffer, N et al. Using small tests of change to improve PMTCT services in northern Nigeria: experiences from implementation of a continuous quality improvement and breakthrough series program. J Acquir Immune Defic Syndr; 2017; 75, Suppl 2 pp. S165-S172. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28498186][DOI: https://dx.doi.org/10.1097/QAI.0000000000001369]

41. Oyeledun, B; Phillips, A; Oronsaye, F; Alo, OD; Shaffer, N; Osibo, B et al. The effect of a continuous quality improvement intervention on retention-in-care at 6 months postpartum in a PMTCT program in northern Nigeria: results of a cluster randomized controlled study. J Acquir Immune Defic Syndr; 2017; 75, Suppl 2 pp. S156-S164. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28498185][DOI: https://dx.doi.org/10.1097/QAI.0000000000001363]

42. Phiri, S; Tweya, H; van Lettow, M; Rosenberg, NE; Trapence, C; Kapito-Tembo, A et al. Impact of facility- and community-based peer support models on maternal uptake and retention in Malawi's Option B+ HIV prevention of mother-to-child transmission program: a 3-arm cluster randomized controlled trial (PURE Malawi). J Acquir Immune Defic Syndr; 2017; 75, Suppl 2 pp. S140-S148. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28498183][DOI: https://dx.doi.org/10.1097/QAI.0000000000001357]

43. Shelley, KD; Belete, YW; Phiri, SC; Musonda, M; Kawesha, EC; Muleya, EM et al. Implementation of the community health assistant (CHA) cadre in Zambia: a process evaluation to guide future scale-up decisions. J Community Health; 2016; 41, 2 pp. 398-408. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26547550][DOI: https://dx.doi.org/10.1007/s10900-015-0110-5]

44. Condo, J; Mugeni, C; Naughton, B; Hall, K; Tuazon, MA; Omwega, A et al. Rwanda's evolving community health worker system: a qualitative assessment of client and provider perspectives. Hum Resour Health; 2014; 12, 71. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25495237][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4320528][DOI: https://dx.doi.org/10.1186/1478-4491-12-71]

45. Pallas, SW; Minhas, D; Pérez-Escamilla, R; Taylor, L; Curry, L; Bradley, EH. Community health workers in low- and middle-income countries: what do we know about scaling up and sustainability?. Am J Public Health; 2013; 103, 7 pp. e74-e82. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/23678926][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3682607][DOI: https://dx.doi.org/10.2105/AJPH.2012.301102]

46. Hosseinipour, M; Nelson, JAE; Trapence, C; Rutstein, SE; Kasende, F; Kayoyo, V et al. Viral suppression and HIV drug resistance at 6 months among women in Malawi's Option B+ program: results From the PURE Malawi study. J Acquir Immune Defic Syndr; 2017; 75, Suppl 2 pp. S149-S155. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28498184][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5431274][DOI: https://dx.doi.org/10.1097/QAI.0000000000001368]

47. Aliyu, MH; Blevins, M; Audet, CM; Kalish, M; Gebi, UI; Onwujekwe, O et al. Integrated prevention of mother-to-child HIV transmission services, antiretroviral therapy initiation, and maternal and infant retention in care in rural north-central Nigeria: a cluster-randomised controlled trial. Lancet HIV.; 2016; 3, 5 pp. e202-e211. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27126487][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4852280][DOI: https://dx.doi.org/10.1016/S2352-3018(16)00018-7]

48. Myer, L; Phillips, TK; Zerbe, A; Brittain, K; Lesosky, M; Hsiao, N-Y et al. Integration of postpartum healthcare services for HIV-infected women and their infants in South Africa: a randomised controlled trial. PLOS Med; 2018; 15, 3 [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/29601570][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5877834][DOI: https://dx.doi.org/10.1371/journal.pmed.1002547]

49. Chiasson, MA; Shaw, FS; Humberstone, M; Hirshfield, S; Hartel, D. Increased HIV disclosure three months after an online video intervention for men who have sex with men (MSM). AIDS Care; 2009; 21, 9 pp. 1081-1089. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/20024766][DOI: https://dx.doi.org/10.1080/09540120902730013]

50. Essien, EJ; Mgbere, O; Monjok, E; Ekong, E; Holstad, MM; Kalichman, SC. Effectiveness of a video-based motivational skills-building HIV risk-reduction intervention for female military personnel. Soc Sci Med; 2011; 72, 1 pp. 63-71. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/21106284][DOI: https://dx.doi.org/10.1016/j.socscimed.2010.10.012]

51. Ingersoll, KS; Farrell-Carnahan, L; Cohen-Filipic, J; Heckman, CJ; Ceperich, SD; Hettema, J et al. A pilot randomized clinical trial of two medication adherence and drug use interventions for HIV+ crack cocaine users. Drug Alcohol Depend; 2011; 116, 1–3 pp. 177-187. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/21306837][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3102141][DOI: https://dx.doi.org/10.1016/j.drugalcdep.2010.12.016]

52. O'Donnell, CR; O'Donnell, L; San Doval, A; Duran, R; Labes, K. Reductions in STD infections subsequent to an STD clinic visit. Using video-based patient education to supplement provider interactions. Sex Transm Dis; 1998; 25, 3 pp. 161-168.[COI: 1:STN:280:DyaK1c7osFKrsQ%3D%3D] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/9524995][DOI: https://dx.doi.org/10.1097/00007435-199803000-00010]

53. O'Donnell, L; San Doval, A; Duran, R; O'Donnell, CR. The effectiveness of video-based interventions in promoting condom acquisition among STD clinic patients. Sex Transm Dis; 1995; 22, 2 pp. 97-103.[COI: 1:STN:280:DyaK2MzltVOjtA%3D%3D] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/7624818][DOI: https://dx.doi.org/10.1097/00007435-199503000-00004]

54. Sobel, RM; Paasche-Orlow, MK; Waite, KR; Rittner, SS; Wilson, EA; Wolf, MS. Asthma 1-2-3: a low literacy multimedia tool to educate African American adults about asthma. J Community Health; 2009; 34, 4 pp. 321-327. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/19353250][DOI: https://dx.doi.org/10.1007/s10900-009-9153-9]

55. Tuong, W; Larsen, ER; Armstrong, AW. Videos to influence: a systematic review of effectiveness of video-based education in modifying health behaviors. J Behav Med; 2014; 37, 2 pp. 218-233. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/23188480][DOI: https://dx.doi.org/10.1007/s10865-012-9480-7]

56. Sweat, M; O'Donnell, C; O'Donnell, L. Cost-effectiveness of a brief video-based HIV intervention for African American and Latino sexually transmitted disease clinic clients. AIDS.; 2001; 15, 6 pp. 781-787.[COI: 1:STN:280:DC%2BD3M3nt1KitQ%3D%3D] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/11371693][DOI: https://dx.doi.org/10.1097/00002030-200104130-00014]

57. Kim, MH; Ahmed, S; Tembo, T; Sabelli, R; Flick, R; Yu, X et al. VITAL Start: Video-Based intervention to Inspire Treatment Adherence for Life—pilot of a novel video-based approach to HIV counseling for pregnant women living with HIV. AIDS Behav; 2019; 23, pp. 3140-3151. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/31410618][DOI: https://dx.doi.org/10.1007/s10461-019-02634-1] [PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6803103]

58. The World Bank. World Bank Online Data; 2018; https://data.worldbank.org/indicator/NY.GDP.PCAP.CD?locations=MW. Accessed 2 Apr 2019

59. United Nations Development Programme (UNDP). Human Development Report 2016: Human Development for Everyone. New York: UNDP; 2016. http://hdr.undp.org/sites/default/files/HDR2016_EN_Overview_Web.pdf. Accessed 2 Apr 2019.

60. National Statistical Office Malawi, ICF International. Malawi Demographic and Health Survey 2015–16: Key Indicators Report. Zomba; 2016. https://www.healthynewbornnetwork.org/hnn-content/uploads/Malawi-DHS-2015-2016-KIR-Final-05-27-2016.pdf. Accessed 2 Apr 2019

61. Ministry of Health: Malawi ARV Patient Education Flip Chart (2015). Lilongwe: Ministry of Health; 2019. https://www.tingathe.org/uploads/8/8/3/0/88301718/malawi_arv_patient_education_flipchart_general.pdf. Accessed 2 Apr 2019.

62. Bellg, AJ; Borrelli, B; Resnick, B; Hecht, J; Minicucci, DS; Ory, M et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol; 2004; 23, 5 pp. 443-451. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/15367063][DOI: https://dx.doi.org/10.1037/0278-6133.23.5.443]

63. Slaughter, SE; Hill, JN; Snelgrove-Clarke, E. What is the extent and quality of documentation and reporting of fidelity to implementation strategies: a scoping review. Implement Sci; 2015; 10, 129. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26345357][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4562107][DOI: https://dx.doi.org/10.1186/s13012-015-0320-3]

64. Sussman, JB; Hayward, RA. An IV for the RCT: using instrumental variables to adjust for treatment contamination in randomised controlled trials. BMJ.; 2010; 340, c2073. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/20442226][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3230230][DOI: https://dx.doi.org/10.1136/bmj.c2073]

65. Dusenbury, L; Brannigan, R; Falco, M; Hansen, WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res; 2003; 18, 2 pp. 237-256. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/12729182][DOI: https://dx.doi.org/10.1093/her/18.2.237]

66. Phillips, T; Brittain, K; Mellins, CA; Zerbe, A; Remien, RH; Abrams, EJ et al. A self-reported adherence measure to screen for elevated HIV viral load in pregnant and postpartum women on antiretroviral therapy. AIDS Behav; 2017; 21, 2 pp. 450-461. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27278548][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5145763][DOI: https://dx.doi.org/10.1007/s10461-016-1448-0]

67. Wilson, IB; Fowler, FJ, Jr; Cosenza, CA; Michaud, J; Bentkover, J; Rana, A et al. Cognitive and field testing of a new set of medication adherence self-report items for HIV care. AIDS Behav; 2014; 18, 12 pp. 2349-2358. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/24077970][DOI: https://dx.doi.org/10.1007/s10461-013-0610-1]

68. Haas, AD; Msukwa, MT; Egger, M; Tenthani, L; Tweya, H; Jahn, A et al. Adherence to antiretroviral therapy during and after pregnancy: cohort study on women receiving care in Malawi's Option B+ program. Clin Infect Dis; 2016; 63, 9 pp. 1227-1235. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27461920][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5064160]

69. Myer, L; Phillips, TK; Zerbe, A; Ronan, A; Hsiao, NY; Mellins, CA et al. Optimizing antiretroviral therapy (ART) for maternal and child health (MCH): rationale and design of the MCH-ART study. J Acquir Immune Defic Syndr; 2016; 72, Suppl 2 pp. S189-S196. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27355508][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5113242][DOI: https://dx.doi.org/10.1097/QAI.0000000000001056]

70. Chesney, MA; Ickovics, JR; Chambers, DB; Gifford, AL; Neidig, J; Zwickl, B et al. Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: the AACTG adherence instruments. Patient Care Committee & Adherence Working Group of the Outcomes Committee of the Adult AIDS Clinical Trials Group (AACTG). AIDS Care; 2000; 12, 3 pp. 255-266.[COI: 1:STN:280:DC%2BD3cvhslKgsA%3D%3D] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/10928201][DOI: https://dx.doi.org/10.1080/09540120050042891]

71. Johnson, MO; Neilands, TB; Dilworth, SE; Morin, SF; Remien, RH; Chesney, MA. The role of self-efficacy in HIV treatment adherence: validation of the HIV Treatment Adherence Self-Efficacy Scale (HIV-ASES). J Behav Med; 2007; 30, 5 pp. 359-370. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/17588200][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2423379][DOI: https://dx.doi.org/10.1007/s10865-007-9118-3]

72. LifeWindows Project Team. The LifeWindows Information Motivation Behavioral Skills ART Adherence Questionnaire (LW-IMB-AAQ); 2006; Storrs, Center for Health, Intervention, and Prevention, University of Connecticut:

73. Ellsberg, M; Heise, L. Researching violence against women: a practical guide for researchers and activists; 2005; Washington, DC, World Health Organization, PATH:

74. Stewart, RC; Umar, E; Tomenson, B; Creed, F. Validation of the Multi-dimensional Scale of Perceived Social Support (MSPSS) and the relationship between social support, intimate partner violence and antenatal depression in Malawi. BMC Psychiatry; 2014; 14, 180. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/24938124][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4074419][DOI: https://dx.doi.org/10.1186/1471-244X-14-180]

75. Stewart, RC; Kauye, F; Umar, E; Vokhiwa, M; Bunn, J; Fitzgerald, M et al. Validation of a Chichewa version of the Self-Reporting Questionnaire (SRQ) as a brief screening measure for maternal depressive disorder in Malawi, Africa. J Affect Disord; 2009; 112, 1–3 pp. 126-134. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/18504058][DOI: https://dx.doi.org/10.1016/j.jad.2008.04.001]

76. Bradley, KA; Bush, KR; Epler, AJ; Dobie, DJ; Davis, TM; Sporleder, JL et al. Two brief alcohol-screening tests from the Alcohol Use Disorders Identification Test (AUDIT): validation in a female Veterans Affairs patient population. Arch Intern Med; 2003; 163, 7 pp. 821-829. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/12695273][DOI: https://dx.doi.org/10.1001/archinte.163.7.821]

77. Voluse, AC; Gioia, CJ; Sobell, LC; Dum, M; Sobell, MB; Simco, ER. Psychometric properties of the Drug Use Disorders Identification Test (DUDIT) with substance abusers in outpatient and residential treatment. Addict Behav; 2012; 37, 1 pp. 36-41. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/21937169][DOI: https://dx.doi.org/10.1016/j.addbeh.2011.07.030]

78. Barry, OM; Bergh, AM; Makin, JD; Etsane, E; Kershaw, TS; Forsyth, BW. Development of a measure of the patient-provider relationship in antenatal care and its importance in PMTCT. AIDS Care; 2012; 24, 6 pp. 680-686. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/22103696][DOI: https://dx.doi.org/10.1080/09540121.2011.630369]

79. Webster, TR; Mantopoulos, J; Jackson, E; Cole-Lewis, H; Kidane, L; Kebede, S et al. A brief questionnaire for assessing patient healthcare experiences in low-income settings. Int J Qual Health Care; 2011; 23, 3 pp. 258-268. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/21531989][DOI: https://dx.doi.org/10.1093/intqhc/mzr019]

80. Zheng, K; Guo, MH; Hanauer, DA. Using the time and motion method to study clinical work processes and workflow: methodological inconsistencies and a call for standardized research. J Am Med Inform Assoc; 2011; 18, 5 pp. 704-710. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/21527407][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3168304][DOI: https://dx.doi.org/10.1136/amiajnl-2011-000083]

81. Munene, E; Ekman, B. Association between patient engagement in HIV care and antiretroviral therapy medication adherence: cross-sectional evidence from a regional HIV care center in Kenya. AIDS Care; 2015; 27, 3 pp. 378-386. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25298265][DOI: https://dx.doi.org/10.1080/09540121.2014.963020]

82. Nachega, JB; Uthman, OA; Anderson, J; Peltzer, K; Wampold, S; Cotton, MF et al. Adherence to antiretroviral therapy during and after pregnancy in low-income, middle-income, and high-income countries: a systematic review and meta-analysis. AIDS.; 2012; 26, 16 pp. 2039-2052. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/22951634][DOI: https://dx.doi.org/10.1097/QAD.0b013e328359590f]

83. Castillo-Mancilla, JR; Phillips, AN; Neaton, JD; Neuhaus, J; Collins, S; Mannheimer, S et al. Association of suboptimal antiretroviral therapy adherence with inflammation in virologically suppressed individuals enrolled in the SMART study. Open Forum Infect Dis; 2017; 5, 1 ofx275. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/29362724][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5772402]

84. Ewart, CK. Social action theory for a public health psychology. Am Psychol; 1991; 46, 9 pp. 931-946.[COI: 1:STN:280:DyaK38%2Fmsl2lsw%3D%3D] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/1958012][DOI: https://dx.doi.org/10.1037/0003-066X.46.9.931]

85. Smith, RL. Sequential treatment allocation using biased coin designs. J R Stat Soc Ser B Methodol; 1984; 46, 3 pp. 519-543.

86. Fleischmann, R; Decker, AM; Kraft, A; Mai, K; Schmidt, S. Mobile electronic versus paper case report forms in clinical trials: a randomized controlled trial. BMC Med Res Methodol; 2017; 17, 1 153. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/29191176][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5709849][DOI: https://dx.doi.org/10.1186/s12874-017-0429-y]

87. Gorbach, PM; Mensch, BS; Husnik, M; Coly, A; Masse, B; Makanani, B et al. Effect of computer-assisted interviewing on self-reported sexual behavior data in a microbicide clinical trial. AIDS Behav; 2013; 17, 2 pp. 790-800. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/23054034][PubMedCentral: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3550005][DOI: https://dx.doi.org/10.1007/s10461-012-0302-2]

88. Weinstein, MC; Siegel, JE; Gold, MR; Kamlet, MS; Russell, LB. Recommendations of the Panel on Cost-effectiveness in Health and Medicine. JAMA; 1996; 276, 15 pp. 1253-1258.[COI: 1:STN:280:DyaK2s%2Fgt1emtg%3D%3D] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/8849754][DOI: https://dx.doi.org/10.1001/jama.1996.03540150055031]

89. Drummond, MF; Sculpher, MJ; Claxton, K; Stoddart, GL; Torrance, GW. Methods for the economic evaluation of health care programmes; 2015; 4 Oxford, Oxford University Press:

90. Hauck, K; Smith, P; Goddard, M. The economics of priority setting for health care: a literature review; 2004; Washington, DC, The World Bank: HNP Discussion Paper

91. Lopetegui, M; Yen, PY; Lai, A; Jeffries, J; Embi, P; Payne, P. Time motion studies in healthcare: what are we talking about?. J Biomed Inform; 2014; 49, pp. 292-299. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/24607863][DOI: https://dx.doi.org/10.1016/j.jbi.2014.02.017]

92. King, TL; Kho, EK; Tiong, YH; Julaihi, SN. Comparison of effectiveness and time-efficiency between multimedia and conventional counselling on metered-dose inhaler technique education. Singap Med J; 2015; 56, 2 pp. 103-108. [DOI: https://dx.doi.org/10.11622/smedj.2015024]

93. Marseille, E; Larson, B; Kazi, DS; Kahn, JG; Rosen, S. Thresholds for the cost-effectiveness of interventions: alternative approaches. Bull World Health Organ; 2015; 93, 2 pp. 118-124. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25883405][DOI: https://dx.doi.org/10.2471/BLT.14.138206]

94. GDP per capita (current US$): The World Bank Group; 2018. http://data.worldbank.org/indicator/ny.gdp.pcap.cd. Accessed 27 Sep 2019.

95. International Committee of Medical Journal Editors (ICMJE). Defining the role of authors and contributors http://icmje.org/recommendations/browse/roles-and-responsibilities/defining-the-role-of-authors-and-contributors.html. Accessed 14 Jun 2018.