Service delivery interventions to increase uptake of voluntary medical male circumcision for HIV prevention: A systematic review

Abstract

Background

Voluntary medical male circumcision (VMMC) remains an essential component of combination HIV prevention services, particularly in priority countries in sub-Saharan Africa. As VMMC programs seek to maximize impact and efficiency, and to support World Health Organization guidance, specific uptake-enhancing strategies are critical to identify.

Methods

We systematically reviewed the literature to evaluate the impact of service delivery interventions (e.g., facility layout, service co-location, mobile outreach) on VMMC uptake among adolescent and adult men. For the main effectiveness review, we searched for publications or conference abstracts that measured VMMC uptake or uptake of HIV testing or risk reduction counselling within VMMC services. We synthesized data by coding categories and outcomes. We also reviewed studies assessing acceptability, values/preferences, costs, and feasibility.

Results

Four randomized controlled trials and five observational studies were included in the effectiveness review. Studies took place in South Africa, Tanzania, Uganda, Zambia, and Zimbabwe. They assessed a range of service delivery innovations, including community-, school-, and facility-based interventions. Overall, interventions increased VMMC uptake; some successfully improved uptake among age-specific subpopulations, but urban-rural stratification showed no clear trends. Interventions that increased adult men's uptake included mobile services (compared to static facilities), home-based testing with active referral follow-up, and facility-based HIV testing with enhanced comprehensive sexual education. Six acceptability studies suggested interventions were generally perceived to help men choose to get circumcised. Eleven cost studies suggested interventions create economies-of-scale and efficiencies. Three studies suggested such interventions were feasible, improving facility preparedness, service quality and quantity, and efficiencies.

Conclusions

Innovative changes in male-centered VMMC services can improve adult men’s and adolescent boys' VMMC uptake. Limited evidence on interventions that enhance access and acceptability show promising results, but evidence gaps persist due to inconsistent intervention definition and delivery, due in part to contextual relevance and limited age disaggregation.

About the Authors:

Kaitlyn Atkins

Contributed equally to this work with: Kaitlyn Atkins, Ping Teresa Yeh

Roles Data curation, Formal analysis, Writing – original draft, Writing – review & editing

Affiliation: Social and Behavioral Interventions Program, Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America

ORCID logo http://orcid.org/0000-0001-8302-542X

Ping Teresa Yeh

Contributed equally to this work with: Kaitlyn Atkins, Ping Teresa Yeh

Roles Data curation, Formal analysis, Resources, Writing – original draft, Writing – review & editing

Affiliation: Social and Behavioral Interventions Program, Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America

Caitlin E. Kennedy

Roles Resources, Writing – review & editing

Affiliation: Social and Behavioral Interventions Program, Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America

ORCID logo http://orcid.org/0000-0001-6820-063X

Virginia A. Fonner

Roles Resources, Writing – review & editing

Affiliation: Division of Global and Community Health, Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, South Carolina, United States of America

Michael D. Sweat

Roles Resources, Writing – review & editing

Affiliation: Division of Global and Community Health, Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, South Carolina, United States of America

Kevin R. O’Reilly

Roles Resources, Writing – review & editing

Affiliation: Division of Global and Community Health, Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, South Carolina, United States of America

Rachel Baggaley

Roles Writing – review & editing

Affiliation: Department of HIV, World Health Organization, Geneva, Switzerland

George W. Rutherford

Roles Writing – review & editing

Affiliation: Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, California, United States of America

Julia Samuelson

Roles Conceptualization, Writing – review & editing

* E-mail: [email protected]

Affiliation: Department of HIV, World Health Organization, Geneva, Switzerland

Introduction

As countries strive to control the HIV epidemic, voluntary medical male circumcision (VMMC) remains an essential component of combination HIV prevention, particularly in sub-Saharan Africa. VMMC reduces the risk of HIV acquisition by approximately 60% and also provides an opportunity to link men and boys to a range of other HIV prevention and treatment services [1–3].

VMMC for HIV prevention was introduced in sub-Saharan Africa after the 2007 recommendation by the World Health Organization (WHO) and the Joint United Nations Programme on HIV/AIDS (UNAIDS) to scale-up access to this proven intervention in priority countries where circumcision prevalence was low and HIV prevalence was high [4]. Between 2008 and 2018, over 23 million men and boys were circumcised in priority countries, averting an estimated 230,000 new HIV infections by 2017 and 1.1 million by 2030, accounting for improvements in antiretroviral therapy (ART) coverage [5]. While initial implementation focused on providing VMMC to men in the general population aged 15–49 years, VMMC uptake has been high among adolescent boys [6–9]. As governments and implementing partners respond to lack of coverage among specific subpopulations, programs have used a number of strategies to reach previously unreached populations, including older (adult) men, with VMMC.

Approaches to improve VMMC uptake often include one or a combination of diverse interventions, some of which have been implemented and adopted as good practices in VMMC programs in East and Southern Africa. Despite this, their impact has not been well-documented [10]. The impact of changes to Ministry of Health or VMMC implementing partner service delivery policies and operations (e.g. training, staffing, task-shifting) and physical location (e.g. fixed-site facilities versus mobile clinics) have not been reviewed. To fill this gap, and to provide an evidence base for upcoming WHO guidelines on VMMC, we systematically reviewed the evidence on the effect of service delivery interventions on VMMC uptake among men in East and Southern Africa. A separate review examines economic compensation or incentive-based interventions [11]. We also reviewed the acceptability, values and preferences, costs, and feasibility of service delivery interventions, providing a broader perspective on these types of interventions.

Methods

We conducted this systematic review in accordance with Preferred Reporting Items for Systematic review and Meta-Analyses (PRISMA) guidelines [12].

Topic definition

For the purposes of this review, we defined “service delivery interventions” as changes or improvements to the ways VMMC services are provided. Interventions could emphasize additional, restructured, or intensified information, education, or communication services or more structural aspects like improved provider training; changes to physical space; changes to health services structure, such as altering service location or time of day; using home- or community-based services, task-shifting, or restructuring the flow of services; or co-location of VMMC with other health services, such as hypertension or diabetes screening.

Effectiveness review inclusion criteria

The main question for our effectiveness review was: among adolescent and adult men who are potential candidates for male circumcision for HIV prevention within public health VMMC programs, do service delivery interventions lead to improved uptake of male circumcision compared to no such interventions, or a different or less intensive type of intervention? We followed the PICO question format to define our review criteria:

* Population: Uncircumcised adolescent and adult men (ages 10+) who are potential candidates for male circumcision for HIV prevention within public health VMMC programs

* Intervention: Service delivery interventions

* Comparison: No such service delivery interventions, or a different or less intensive type of service delivery intervention

* Outcomes: Primary: 1) Uptake of VMMC for HIV prevention as defined by WHO; Secondary: 2) Uptake of HIV testing within VMMC services, and 3) Uptake of safer sex and risk reduction counselling within VMMC services

In addition, to be included in the review, a study must have: 1) had a study design that presented a pre/post or multi-arm comparison by service delivery intervention exposure, 2) measured one or more of the outcomes listed above, and 3) been published in a peer-reviewed journal or conference abstract. No restrictions were placed based on type or scope of service delivery intervention, location of the intervention, or language of the publication. When information was available for the same study from both a peer-reviewed article and a conference abstract, we only used data from the peer-reviewed article.

When possible, outcomes were stratified by whether participants (men) were considered high-risk for HIV or not, since recent modeling suggests VMMC may have greater impacts among men at increased risk for HIV [13]. We defined high-risk as having any one of the three following characteristics: 1) being in the three highest HIV incidence 5-year age strata per UNAIDS country estimates, 2) having >1 sexual partner (lifetime, current, or within a specified timeframe) [14,15], and/or 3) having a recent history of a sexually transmitted infection (STI) other than HIV. Outcomes were also stratified by the following age groupings: younger adolescents aged 10–14 years, older adolescents aged 15–19 years, and adults aged ≥20 years. If data were available, we further age-stratified the adult population as well. These age categories are those used by the Decision Makers Program Planning Toolkit [7,16], which suggests tailored VMMC platforms by age; we felt that different service delivery strategies might be relevant for different age groups (e.g., school-based programs for adolescents, or extended clinic hours for working-aged men) or that we might need to consider specific risks and benefits of VMMC by age group. Finally, we employed a health equity lens by stratifying where possible by PROGRESS variables: place of residence (e.g. rural/urban); race, ethnicity, culture, and language; occupation; gender/sex; religion; education; socioeconomic status; and social capital [17].

Search strategy and screening

The search was developed in conjunction with another related review on economic compensation interventions to increase uptake of VMMC developed for the same WHO guidelines [11]. We therefore kept the search strategy broad, so as to include articles relevant to both topics.

We searched five electronic databases (PubMed, CINAHL, Sociological Abstracts, PsycINFO, and EMBASE) and four conferences (International AIDS Conference (IAC), International AIDS Society (IAS) Conference on HIV Science, Conference on Retroviruses and Opportunistic Infections (CROI), and International Conference on AIDS and STIs in Africa (ICASA)). Electronic databases were searched from January 1, 1990 through May 31, 2018. The IAC, IAS, and ICASA conference abstracts were searched for all available years (through mid-2018). For CROI, only the most recent conferences (2014–2018) were searched as past conference abstracts are inaccessible. We searched the bibliographies of all studies included in the review and of a previous related review [18]. Further, selected experts in the field–specifically, members of the WHO Guideline Development Group for Medical Male Circumcision–were asked to share additional articles not identified through other search methods. We also searched for ongoing RCTs through clinicaltrials.gov, the WHO International Clinical Trials Registry Platform, the Pan African Clinical Trial Registry, and the Australian New Zealand Clinical Trials Registry.

The following search strategy was adapted for entry into all electronic databases: (HIV [tiab] OR “human immunodeficiency virus” [tiab]) AND (circumcision [tiab] or circumcis* [tiab] or VMMC [tiab]). Only the term “circumcision” was used to search conference abstracts because all conferences searched are HIV-related and search functions are limited.

Titles, abstracts, citation information, and descriptor terms of citations identified through the search were screened in duplicate. Full-text articles were obtained of all selected abstracts, and two independent reviewers assessed all full-text articles for eligibility to determine final study selection. Differences were resolved through consensus.

Data extraction and management

Data were extracted independently in duplicate using standardized data extraction forms. Differences in data extraction were resolved through consensus and referral to a senior study team member when necessary. The following information was gathered from each included study:

* Study identification: Author(s), type of citation, year of publication

* Study description: Study objectives, location; population characteristics, main intervention description (for all study arms), description of any additional intervention components, study design, sample size, follow-up periods, loss to follow-up

* Outcomes: Analytic approach, outcome measures, comparison groups, effect measures and sizes, confidence intervals, significance levels, conclusions, limitations

For randomized controlled trials (RCTs), we assessed risk of bias using the Cochrane Collaboration’s tool [19]. We assessed methodological components of the studies and classified studies as having high or low risk of bias. For studies that were non-randomized but comparative, we assessed study rigor using the adapted Evidence Project Risk of Bias tool for intervention evaluations [20].

Data analysis

We analyzed data according to coding categories and outcomes. Given the diverse intervention approaches and different ways of reporting outcomes, we were unable to combine effect sizes in meta-analysis. The terms 'effectiveness' and 'impact' are used throughout to refer to findings from the entire included body of literature, including observational studies which do not prove causality, to match the programmatic use of the terms in the WHO data collection process for which this review was performed.

Additional reviews

In addition to the effectiveness review, we conducted additional reviews assessing acceptability, values and preferences, costs, and feasibility of service delivery interventions. These reviews added important, complementary evidence for the purpose of developing holistic WHO guidelines [21]. We used the same search strategy to identify studies for these reviews. These studies could be qualitative or quantitative in nature but must have presented primary data collection; opinion pieces, editorials, and review articles were not included. We summarized this literature qualitatively and organized it by study design, methodology, location, and population.

Acceptability review.

We included studies in the acceptability review if they presented primary data examining people’s feelings about the acceptability of the interventions included in the main effectiveness review. We focused on studies examining the perspectives of men who have used or potentially would use VMMC, but we also included studies examining the acceptability of the interventions among providers and other stakeholders (such as partners, families, and communities).

Values and preferences review.

We included studies in the values and preferences review if they presented primary data examining people’s feelings about the three PICO outcomes: 1) uptake of medical male circumcision, 2) uptake of HIV testing within VMMC services, and 3) uptake of safer sex and risk reduction counselling within VMMC services. We assessed values and preferences around population-level uptake of circumcision as an outcome, rather than feelings about circumcision itself as a procedure. We were primarily interested in studies examining the perspectives of people who have used or potentially would use VMMC, but we also included studies examining values and preferences among providers and other stakeholders (such as partners, families, communities, and policy-makers).

Costs review.

We included studies in the costs review if they presented primary data examining cost or cost-effectiveness of the service delivery interventions, or otherwise discussed resource use in relation to these interventions. We considered any measure of cost (total cost, unit cost, etc.).

Feasibility review.

We included studies in the feasibility review if they presented primary data examining issues with provision of the service delivery interventions or how they fit within health systems (training, monitoring, evaluation, etc.). This was intended to complement the effectiveness review by identifying issues related to implementation of these interventions that might be relevant for others seeking to replicate them.

Data availability

All data came from published journal articles or conference abstracts.

Results

Effectiveness review

Electronic database searching retrieved 3,940 results, and an additional 131 were identified through searching conference databases, trial registries, contacting experts in the field, and secondary searching (Fig 1). After removing duplicates, there were 2,484 unique citations. After initial screening of titles and abstracts, 249 citations remained. After two independent reviewers screened in duplicate and gained consensus, we selected 72 articles for full-text review. Of these, we included nine studies in the effectiveness review [22–30].

[Figure omitted. See PDF.]

Fig 1. Flow of information through the different phases of a systematic review.

https://doi.org/10.1371/journal.pone.0227755.g001

Of the nine included studies in the effectiveness review, four were RCTs [23,25,29,30], and five were observational studies, either cross-sectional studies with multiple groups for comparison or serial cross-sectional studies comparing before and after service delivery intervention implementation [22,24,26–28]. Studies took place in South Africa [23,28], Tanzania [22,24,26,29], Uganda [23,27], Zambia [30], and Zimbabwe [22,25]. Studies included adult men and adolescent boys aged 10 years and older [22,29], 13 years and older [27], 18 years and older [23,24,26,30], 14–20 years [25], and 10–49 years [28], though some specifically targeted adolescent male students [25,27,28] or adult men (15–49 years [22], 18 years or older [30], or 20–34 years [29]). Intervention approaches varied widely and were often multi-component, so we grouped them from a programme implementer perspective based on delivery platforms: community- (including home-)based interventions [22–24,26,29], school-based interventions [25,27,28], and facility-based interventions [30]. Table 1 presents a summary description of included studies; results for each study are presented in Table 2.

[Figure omitted. See PDF.]

Table 1. Description of included studies–effectiveness review.

https://doi.org/10.1371/journal.pone.0227755.t001

[Figure omitted. See PDF.]

Table 2. Comparative results from included studies–effectiveness review.

https://doi.org/10.1371/journal.pone.0227755.t002

Quality assessment of included studies are summarized in S1 Table. The four RCTs included in this review assessed two community-based interventions, one facility-based intervention, and one school-based intervention [23,25,29,30]. These studies had low risk of bias. Although the four RCTs were not blinded, we judged them to have low risk of performance or detection bias, as lack of blinding was unlikely to influence uptake outcomes. One RCT was found to have high risk of other bias, due to technical issues during implementation that resulted in few participants receiving in the intervention after the first randomization and subsequent re-randomization for adequate power [23]. Five non-randomized studies assessed the impact of three community-based and two school-based interventions and showed low to medium risk of bias [22,24,26–28]. Two studies did not report pre-/post-intervention data [22,24], and one did not include comparison groups [26]. Of those studies with comparison groups, none assessed differences between study groups in measured baseline variables [22,24,27,28].

Uptake of VMMC.

Results regarding VMMC uptake from community-, facility-, and school-based service delivery interventions are summarized in Table 3. All included studies reported that service delivery interventions were associated with improved VMMC uptake; however, the magnitude of effect varied.

[Figure omitted. See PDF.]

Table 3. Summary of effects.

https://doi.org/10.1371/journal.pone.0227755.t003

Evidence from two community- (including home)-based RCTs showed increased VMMC among participants in service delivery interventions [23,29]. One RCT assessing active referral follow-ups after initial home-based visits for HIV testing in rural South Africa and Uganda found that, compared to standard (written) referral, providing text message and phone call reminders to HIV-uninfected men after HIV testing increased VMMC uptake (relative risk (RR): 1.67, 95% confidence interval (CI): 1.29 to 2.14; risk difference (RD): 185 per 1,000, 95% CI: 80 to 316) [23]. Another RCT in Tanzania found increased uptake in community sites randomized to receive enhanced demand creation, female partner engagement, and increased facility privacy including through expanded outreach compared to sites receiving standard VMMC outreach, when comparing the mean number of VMMC clients per cluster per month between intervention and control (mean difference: 227, 95% CI: 33 to 420, p = 0.03) [29]. Data from the three community-based observational studies, which assessed making services more accessible through periodic VMMC campaigns, mobile services, and targeting of services to underserved areas by using geographic information systems (GIS), were not pooled, but similarly reported increased VMMC following implementation of service delivery interventions, compared to routine pre-intervention facility-based services [22,24,26]. In Zimbabwe, VMMC uptake was significantly higher during periodic outreach campaigns (64%) than during routine services (36%) (p<0.001) over a 38-month period [22]. Campaigns in Tanzania over 9 months resulted in 132,080 VMMC procedures, compared to routine facilities (11,392) or mobile services (5,408) [24]. Using GIS to target VMMC service delivery in Tanzania reached more clients in rural areas, with 48% of VMMCs performed in rural areas before GIS targeting, 88% in rural areas in the year immediately following program implementation, and 93% by three years post-intervention [26].

One facility-based RCT examining VMMC uptake at 12-month follow-up found increased likelihood of VMMC uptake among men receiving the Spear and Shield intervention, a four-session HIV/sexual risk reduction education and VMMC promotion program with specialized training for healthcare providers (RR: 1.71, 95% CI: 1.38 to 2.11; RD: 172 per 1,000, 95% CI: 92 to 269) compared to those who participated in time-matched educational sessions on tuberculosis, malaria, cholera, and water-borne disease prevention and received condoms [30].

Finally, one RCT and two observational studies reported data on VMMC uptake following school-based interventions [25,27,28] targeting both men and boys but focusing on adolescents. The RCT in Zimbabwe reported that male students involved in the "Make The Cut+" program (using a trained coach to spark discussion on VMMC, follow-up with students, and facilitate transport to the VMMC clinic) were 2.66 times more likely to be circumcised (95% CI: 1.53 to 4.62), with an absolute difference of 76 per 1,000 (95% CI: 24 to 166) [25]. Two serial cross-sectional studies showed that men and boys receiving school-based interventions (i.e. soccer-based promotion by VMMC champions who accompanied participants to VMMC and provided follow-up; schedule optimization, peer recruitment, and transportation coordination; parent and community engagement) increased VMMC uptake: in Uganda, they were 2.24 times more likely to be circumcised (95% CI: 0.94 to 5.36), an absolute difference of 128 more per 1,000 (95% CI: 6 fewer to 451 more), and in South Africa, the number of VMMC procedures per month increased from 58 pre-intervention to 308 post-intervention [27,28].

Uptake of VMMC: Stratified analyses by age and setting.

Multiple studies included adolescents and young men but did not stratify outcome data by age. Several school-based studies included older men, but participants were predominantly less than 20 years old. Exposure to a community-based demand-generation intervention was associated with greater mean number of clients aged 20–34 and a greater proportion of clients aged ≥20 over a one-month period [29]. The proportions of males from the age groups 10–14, 15–19, and 20–24 years accessing VMMC services during campaigns were significantly higher than those accessing routine services (p<0.05) [22]. In Tanzania, mobile VMMC services were found to reach older clients compared with campaigns or routine service delivery (p<0.001); 38% of mobile VMMC clients were aged 20 years or older, compared with 22% and 29% of clients in campaigns and routine services, respectively [24]. A demand-generation program with facilitated linkage to VMMC services for secondary school students was associated with greater VMMC uptake in younger age groups (14–17 years old) compared with adults (≥18 years) [25].

Three included studies took place in urban areas and six in rural settings; however, there were no clear trends in VMMC uptake by location. One study presented additional data comparing uptake before and after rollout of GIS prioritization of VMMC services; after data-driven programmatic prioritization, VMMC procedures shifted from those primarily conducted in urban settings (around 60%) before GIS to almost all in rural settings (around 90%) afterward [26].

Uptake of HIV testing and counseling within VMMC services.

Two studies in Tanzania (one RCT and one comparative cross-sectional study) measured uptake of HIV testing in VMMC services, comparing service delivery approaches [24,29]. Authors of the RCT provided additional data stratified by study arm which was not available in the original article. In both studies, participants demonstrated high acceptance of HIV testing within VMMC services, ranging from 96.5% to 99.4% uptake across arms. No meaningful difference in uptake of HIV testing was observed (Table 3). Neither study stratified uptake of HIV testing.

Uptake of safer sex and risk reduction counseling within VMMC services.

No data were found comparing exposure versus non-exposure to service delivery interventions on uptake of safer sex and risk reduction counseling within VMMC services.

Acceptability

We identified six studies examining acceptability of service delivery interventions (Table 4) [27,31–35], one of which was also included in our main effectiveness review [27] and another which was related to a study presented in the effectiveness review [31]. Studies were published between 2012 and 2018 and took place in Botswana [32,35], South Africa [34], Tanzania [33], Uganda [27], and Zimbabwe [31]. These studies captured the perspectives of (potential) users of VMMC and other stakeholders (e.g. providers, partners, families, communities) on aspects of service delivery interventions that increased the acceptability and uptake of VMMC. Three of the included studies assessed the acceptability of community-based interventions [32–34], two assessed school-based interventions [27,31], and one assessed a facility-based intervention [35].

[Figure omitted. See PDF.]

Table 4. Description of included studies–acceptability review.

https://doi.org/10.1371/journal.pone.0227755.t004

At the community level and in schools, discussions with VMMC advisers and coaches were considered particularly helpful for VMMC clients or potential clients. One study surveyed South African men during VMMC services and found that 83% of men said they would not have been circumcised had they not received the intervention of motivational interviews with a VMMC adviser [34]. Similarly, one study with primarily adolescent clients showed that discussions with VMMC advisers and coaches were considered particularly helpful for VMMC clients or potential clients [31]. In schools, information and encouragement from peers was also valued [27]. At the facility and health system levels, mobile or other services that engaged men individually and reduced logistical barriers to VMMC were highly supported [35]. Including partners with clients in educational sessions provided opportunity for discussion on other issues, such as sexual and reproductive health [34]. Despite the wide acceptability of these interventions, one study noted concomitant HIV testing as a potential barrier to VMMC uptake [32].

Values and preferences

No studies were identified for the review on end users’ and providers' values and preferences for the outcomes of interest.

Costs

Eleven studies presented cost data [14,25,36–44], three of which were related to articles included in the main effectiveness review. Studies were published between 2012 and 2018 and took place in Kenya [38,41], South Africa [39,42,43], Tanzania [44], Uganda [36,37,40], and Zimbabwe [14,25]. Descriptions of included cost studies and their outcomes are presented in Table 5. Seven of the included studies assessed community-based interventions [14,36,40–44], two assessed school-based interventions [25,39], and two assessed facility-based interventions [37,38].

[Figure omitted. See PDF.]

Table 5. Description of included studies–cost review.

https://doi.org/10.1371/journal.pone.0227755.t005

Generally, cost studies showed that service delivery interventions may create economies of scale and efficiencies when implemented widely. Though activities to enhance uptake increase total costs, linkage to VMMC services that use task-shifting/sharing providers, pre-established facilities (both fixed site VMMC clinics and other clinics temporarily repurposed for VMMC services), and integrated HIV, sexual, and reproductive health services may save costs. Five studies assessing community-based interventions compared costs between various service delivery modalities, including mobile vs fixed, outreach vs fixed, and horizontal vs diagonal [36,40–43]. These studies had mixed results. One study comparing mobile and fixed service delivery in Uganda found that mobile services had a marginal cost per VMMC of US$23 (range: US$17 to US$27) compared with US$35 (range: US$35 to US$40) for fixed-site service delivery [36]. Another study in Uganda found that mobile services were in fact more expensive than fixed-site services (US$61–72 per mobile VMMC compared with US$34 per fixed VMMC) [40].

Overall, age prioritization interventions increased demand generation costs but resulted in sufficient demand to decrease overall VMMC unit costs and lower costs per HIV infection averted [14,25,39]. For example, one study assessing the cost of demand creation strategies targeting school-going adolescents in South Africa found that expanding in-school recruitment and adding peer recruiters while reducing VMMC clinic days increased overall demand creation unit costs but reduced VMMC procedure costs, thus reducing overall VMMC unit cost through increased recruitment and clinic efficiencies [39].

Finally, one study assessed cost effectiveness of three facility-based quality improvement strategies, which increased in intensity from providing a VMMC training manual to providing a training package including a manual, handover meeting, and individualized guidance and mentoring [37]. Quality was measured in terms of compliance to VMMC quality of care indices for four domains: informed consent, history-taking, anesthesia administration, and post-operative instructions. Cost of these strategies increased as intensity increased: the most intensive method cost US$28.83 per patient with large gains in improvement; the least intensive method was found to be most cost-efficient, at US$1.13 per patient with small quality improvement gains. A moderately intensive method cost $20.77 per patient but only yielded small quality improvement gains.

Feasibility

Three studies with non-comparative designs were considered feasibility studies, all assessing facility-based interventions [45–47]. Dates of publication ranged from 2011 to 2014. Studies were from Kenya [45–47], South Africa [44], eSwatinti [46], Tanzania [45,46], and Zimbabwe [45]; two studies aggregated data from multiple countries [45,46]. These studies examined several intervention strategies, all community-based approaches to VMMC scale-up including campaigns and task-shifting/sharing. Descriptions of included feasibility studies and outcomes are presented in Table 6.

[Figure omitted. See PDF.]

Table 6. Description of included studies–feasibility review.

https://doi.org/10.1371/journal.pone.0227755.t006

Service delivery interventions were considered feasible, particularly regarding facility preparedness and health care workers. Facility preparedness and service quality improved as the number of VMMC facilities increased. Task-shifting and task-sharing enabled more facilities to offer VMMC (and also increased VMMC uptake and HIV testing), and scale-up increased both surgical and non-surgical efficiencies.

One study assessed facility preparedness and VMMC service quality in Kenya, South Africa, Tanzania, and Zimbabwe over the first year of VMMC scale-up [45]. It reported that facilities in Kenya and Zimbabwe dramatically improved service quality during scale-up, while facilities in South Africa and Tanzania maintained low scores and declined in some quality measures during scale-up.

Two studies highlighted human resource shortages as a potential barrier to the feasibility of VMMC scale-up in Kenya, Tanzania, and eSwatini; both studies reported that task-shifting and sharing were feasible strategies to mitigate these [46,47].

While these studies addressed general scale-up of VMMC, no studies were identified that assessed feasibility specifically of the interventions that sought to enhance uptake in settings where a higher level of VMMC scale-up had already occurred and more specific person-centered innovations were required.

Discussion

A recent systematic review of barriers and facilitators to VMMC identified a number of personal, community, and service-level issues that could be addressed to improve VMMC uptake through service delivery interventions [48] but did not examine effectiveness. We identified nine studies from five countries in East and Southern Africa assessing how various changes to how health services were delivered could impact VMMC uptake. Our findings indicate that service delivery changes in the community, in schools, and at the facility level can improve VMMC uptake, including among adult men. We also found that effective interventions usually included several components. Specifically, interventions that used a combination of promotional, interpersonal and motivational communications along with changes to make service delivery more accessible generally had stronger effects than those using routine service delivery approaches only. For example, successful community-based interventions included home-based information and HIV testing services with interpersonal referral and follow-up to VMMC services and intensified VMMC demand creation efforts complementing periodic outreach and mobile services. Facility-based interventions included mentoring, enhanced sexual education, and improved provider competency. School-based interventions reduced access barriers to VMMC and included coach and peer mentoring support, particularly for adolescents; parents and community were also sensitized. Other intervention approaches may also yield improvements in VMMC uptake, but high-quality comparative data were not available to fully assess their impact in this review.

While service delivery interventions generally increased VMMC uptake, overall uptake following some interventions remained low. This may reflect the time it takes for those exposed to interventions to decide to pursue VMMC and undergo the procedure. For example, a qualitative study of behavior change pathways to VMMC in Zimbabwe highlighted the dynamic nature of demand for VMMC, which involves a man’s progression through multiple stages of change over time [49]. Indeed, in our review, studies with longer follow-up periods typically reported higher uptake overall. Differences in follow-up time across the included studies (with follow-up periods ranging from one to 38 months for uptake of VMMC) posed additional challenges for comparison.

Although we grouped interventions into three categories (community- (including home-), school-, and facility-based) for this review, we found a wide range of intervention approaches within these categories. The diversity of interventions and limited replication of intervention strategies in multiple settings made it difficult to compare interventions or to assess the true effect and feasibility of interventions that appear to be promising. Four similar studies were undertaken in Tanzania; all found that providing periodic outreach campaigns increased uptake. Though VMMC programmes and implementing partners in priority countries have employed diverse service delivery interventions to achieve targets and improve VMMC coverage, we were only able to find published studies evaluating such interventions in five countries: South Africa, Tanzania, Uganda, Zambia, and Zimbabwe. This may partially reflect the challenges of creating locally relevant, people-centered service delivery approaches or the infrastructure needed to undertake research and publish peer-reviewed intervention evaluations.

The majority of interventions identified in the effectiveness review were community-based and included changes to VMMC referral approaches with enhanced follow up, intensified demand creation efforts with community-based services closer to work or home, campaigns, mobile services, and use of technology to strategically plan service delivery for hard-to-reach locations. Campaigns were more effective in increasing VMMC uptake among adolescents than adult men, who responded more to interpersonal communication-based approaches. Because VMMC uptake is generally higher among adolescents, it could be that older men feel less comfortable accessing VMMC in high-volume settings or have unique concerns that are better addressed by tailored communication. For example, a qualitative study of social and individual factors influencing VMMC decisions among adult men in Tanzania found that men often expressed shame at seeking services with younger boys [50]. This study also found that men had concerns related to the post-surgical period that may not be shared by adolescents, including concerns about required abstinence and lost income. The focus on community-based service delivery interventions over school- or facility-based interventions is similarly unsurprising, given the focus on reaching adult men with VMMC in recent years [7,9,51] and the disproportionately high uptake of VMMC among younger clients, especially adolescent boys who are likely to be in school [6,8,18,51–53].

However, we only identified five studies that focused on reaching specific age groups with VMMC. Two of these, both in Tanzania, aimed to reach adult clientele (age >20) with VMMC; these studies had somewhat mixed results but showed that periodic mobile service delivery and interpersonal motivational advisors/mentors were promising strategies for enhancing uptake among adult men. The remaining three studies with age-targeting focused on school-based interventions, which unsurprisingly yielded greater uptake among adolescents (10–19 years) compared with adult men; these approaches relied on trusted mentors and facilitated access to clinics. In addition, two studies of VMMC services in the general male population (i.e., no age-targeted services) provided age-disaggregated uptake data; consistent with the literature [6–9], both demonstrated increased uptake among younger compared with adult men. The other three studies in this review did not address age-targeting strategies.

While we found data for the effectiveness review on VMMC uptake, we found limited data on uptake of HIV testing within VMMC services, and no comparative data on uptake of safer sex and risk reduction counseling within VMMC services. HIV testing and safer sex and risk reduction counseling are considered standard parts of HIV testing services, so researchers may not have measured these components of VMMC separately. While these measures are a potential measure of service quality, this is also challenging, as individual clients may opt-out of these services, and 100% uptake on either of these measures might indicate coercive or non-optional uptake. Further, despite the lack of studies quantifying uptake of counseling during VMMC, relationships between VMMC, counseling, and risk compensation have been assessed substantially in the literature; evidence indicates that VMMC leads to little or no risk compensation in sub-Saharan Africa [54–60].

Reviews of VMMC acceptability, cost, and feasibility identified studies from seven countries and found promising results. Findings from the acceptability review suggest that service delivery approaches were generally considered acceptable and were perceived to help men choose to get circumcised. However, service delivery interventions that do not adequately consult or partner with community members were met with less acceptance.

Findings from the cost review indicate that mobile and outreach services may reduce VMMC unit cost, compared with fixed services. Further, while age prioritization interventions were shown to increase demand generation costs, they also resulted in sufficient demand to decrease overall VMMC unit costs and lower costs per HIV infection averted. While we found few studies assessing the feasibility of VMMC service delivery interventions, findings from our feasibility review suggest that task-shifting or sharing and facility preparedness play an important role in intervention success. These are important considerations for future service delivery interventions.

Strengths of this review include our attention to a range of factors relevant to policy and programmatic decision-making beyond intervention effectiveness, including values and preferences, acceptability, cost, and feasibility. We also used rigorous search, screening, data extraction, and analysis methods to identify all possible articles and conference abstracts that met our inclusion criteria. However, our search did not include grey literature or program reports, which may have provided valuable additional information. Many VMMC programs may be implementing service delivery strategies without rigorous or published evaluations. We organized our findings for the effectiveness review by study design to distinguish between the quality of evidence of RCTs compared with observational studies, but the diversity of included articles, populations, study designs, and outcomes made it difficult to synthesize results. Further, because several included articles used a combination of intervention approaches—and some of these included a control or comparison group also receiving some element of the intervention—we were limited in our ability to precisely conclude which intervention approaches were responsible for reported effects. Additional research should consider further assessing the differential impacts as well as the impact of age- or HIV risk-prioritization interventions on uptake among subgroups.

Conclusions

Findings from this systematic review indicate that changes to service delivery to increase VMMC uptake among a target population, specifically adult men or adolescent boys, can be effective, cost-efficient, and acceptable. These various intervention strategies, including interpersonal mentorship/advisor support, targeted demand-generation activities to increase awareness and intent, with improved service access by periodic VMMC campaigns, mobile VMMC service delivery, facilitated transportation, and community (and parent for adolescents) engagement seem to increase uptake of VMMC. But their full impact is unclear due to a lack of published, high-quality evaluations of such interventions. As VMMC programs continue striving to meet targets and better engage men, there is increased need to identify cost-effective and efficient strategies that are accessible and acceptable to those at highest risk and harder to reach. While further evaluations are needed, given the time to undertake such evaluations, approaches using program data should be improved to guide changes in interventions, partnering with men and communities. Given the challenges other HIV services have had reaching men in sub-Saharan Africa, the diverse and creative approaches to offering services presented in this review represent promising opportunities for VMMC and other HIV service provision.

Supporting information

[Figure omitted. See PDF.]

S1 Table. Quality assessment of included studies–effectiveness review.

https://doi.org/10.1371/journal.pone.0227755.s001

(DOCX)

S1 File. PRISMA checklist.

https://doi.org/10.1371/journal.pone.0227755.s002

(DOC)

Acknowledgments

We thank our research assistants from the Johns Hopkins Bloomberg School of Public Health (Melissa Camila Alamo, Afia Pokuaa Amoah, Belinda Jivapong, Holly Nishimura, and Leah Tanner) for their assistance screening citations and extracting data. We also thank the members of the WHO Guideline Development Group on updated recommendations on safe male circumcision for HIV prevention and related service delivery for adolescent boys and men in generalized HIV epidemics. We thank Carmen Figueroa who undertook initial scoping work that informed this study.

Citation: Atkins K, Yeh PT, Kennedy CE, Fonner VA, Sweat MD, O’Reilly KR, et al. (2020) Service delivery interventions to increase uptake of voluntary medical male circumcision for HIV prevention: A systematic review. PLoS ONE 15(1): e0227755. https://doi.org/10.1371/journal.pone.0227755

References

1. Auvert B, Taljaard D, Lagarde E, Sobngwi-Tambekou J, Sitta R, Puren A. Randomized, controlled intervention trial of male circumcision for reduction of HIV infection risk: the ANRS 1265 Trial. PLoS Med. 2005;2(2):1549–676.

2. Bailey RC, Moses S, Parker CB, Agot K, Maclean I, Krieger JN, et al. Male circumcision for HIV prevention in young men in Kisumu, Kenya: a randomised controlled trial. Lancet. 2007;369(9562):643–56. pmid:17321310

3. Gray RH, Kigozi G, Serwadda D, Makumbi F, Watya S, Nalugoda F, et al. Male circumcision for HIV prevention in men in Rakai, Uganda: a randomised trial. Lancet. 2007;369(9562):657–66. pmid:17321311

4. WHO, UNAIDS. WHO/UNAIDS technical consultation on male circumcision and HIV prevention: research implications for policy and programming–conclusions and recommendations (6–8 March 2007). Montreux, Switzerland: World Health Organization and Joint United Nations Programme on HIV/AIDS, 2007.

5. WHO. Voluntary medical male circumcision for HIV prevention: Progress brief. Geneva, Switzerland: World Health Organization, 2018.

6. Patel EU, Kaufman MR, Dam KH, Van Lith LM, Hatzold K, Marcell AV, et al. Age differences in perceptions of and motivations for voluntary medical male circumcision among adolescents in South Africa, Tanzania, and Zimbabwe. Clin Infect Dis. 2018;66(Suppl 3):S173–S82. pmid:29617775

7. Kripke K, Njeuhmeli E, Samuelson J, Schnure M, Dalal S, Farley T, et al. Assessing progress, impact, and next steps in rolling out voluntary medical male circumcision for HIV prevention in 14 priority countries in Eastern and Southern Africa through 2014. PLoS One. 2016;11(7):e0158767. pmid:27441648

8. Njeuhmeli E, Hatzold K, Gold E, Mahler H, Kripke K, Seifert-Ahanda K, et al. Lessons learned from scale-up of voluntary medical male circumcision focusing on adolescents: benefits, challenges, and potential opportunities for linkages with adolescent HIV, sexual, and reproductive health services. J Acquir Immune Defic Syndr. 2014;66(Suppl 2):S193–S9.

9. WHO, UNAIDS. Joint strategic action framework to accelerate the scale-up of voluntary medical male circumcision for HIV prevention in Eastern and Southern Africa, 2012–2016. Geneva, Switzerland: World Health Organization and Joint United Nations Programme on HIV/AIDS, 2011.

10. Toledo C, Davis SM, Thomas A, Kiggundu V, Cooney C, Watts DH. Making a pivot to maximize impact: age of clients at PEPFAR-supported voluntary medical male circumcision programs for HIV prevention, 2017. International AIDS Conference; Amsterdam, Netherlands: July 2018.

11. Kennedy CE, Yeh PT, Atkins K, Fonner VA, Sweat MD, O'Reilly K, et al. Economic incentives to increase uptake of voluntary medical male circumcision for HIV prevention: A systematic review and meta-analysis. PLoS One. [Manuscript under review].

12. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9. pmid:19622511

13. WHO. Models to inform fast tracking voluntary medical male circumcision in HIV combination prevention. Geneva, Switzerland: World Health Organization, 2017.

14. Awad SF, Sgaier SK, Ncube G, Xaba S, Mugurungi OM, Mhangara MM, et al. A Reevaluation of the voluntary medical male circumcision scale-up plan in Zimbabwe. PLoS One. 2015;10(11):e0140818. pmid:26529596

15. Awad SF, Sgaier SK, Tambatamba BC, Mohamoud YA, Lau FK, Reed JB, et al. Investigating voluntary medical male circumcision program efficiency gains through subpopulation prioritization: insights from application to Zambia. PLoS One. 2015;10(12):e0145729. pmid:26716442

16. Kripke K, Opuni M, Schnure M, Sgaier S, Castor D, Reed J, et al. Age Targeting of Voluntary Medical Male Circumcision Programs Using the Decision Makers’ Program Planning Toolkit (DMPPT) 2.0. PLoS One. 2016;11(7):e0156909. pmid:27410966

17. O'Neill J, Tabish H, Welch V, Petticrew M, Pottie K, Clarke M, et al. Applying an equity lens to interventions: using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. J Clin Epidemiol. 2014;67(1):56–64. pmid:24189091

18. Carrasco MA, Grund JM, Davis SM, Ridzon R, Mattingly M, Wilkinson J, et al. Systematic review of the effect of economic compensation and incentives on uptake of voluntary medical male circumcision among men in sub-Saharan Africa. AIDS Care. 2018;30(9):1071–82. pmid:29566546

19. Higgins JPT, Green S. Chapter 8.5 The Cochrane Collaboration's tool for assessing risk of bias. In: Higgins JPT, Altman DG, Sterne JAC, on behalf of the Cochrane Statistical Methods Group and the Cochrane Bias Methods Group, editors. Cochrane Handbook for Systematic Reviews of Interventions, Version 5-1-0 [updated March 2011]. London, England: The Cochrane Collaboration; 2011.

20. Kennedy CE, Fonner VA, Armstrong KA, Denison JA, Yeh PT, O'Reilly KR, et al. The Evidence Project risk of bias tool: assessing study rigor for both randomized and non-randomized intervention studies. Syst Rev. 2019;8(1):3. pmid:30606262

21. WHO. WHO Handbook of Guideline Development. Geneva, Switzerland: World Health Organization; 2012.

22. Ashengo TA, Hatzold K, Mahler H, Rock A, Kanagat N, Magalona S, et al. Voluntary medical male circumcision (VMMC) in Tanzania and Zimbabwe: service delivery intensity and modality and their influence on the age of clients. PLoS One. 2014;9(5):e83642. pmid:24801882

23. Barnabas RV, van Rooyen H, Tumwesigye E, Brantley J, Baeten JM, van Heerden A, et al. Uptake of antiretroviral therapy and male circumcision after community-based HIV testing and strategies for linkage to care versus standard clinic referral: a multisite, open-label, randomised controlled trial in South Africa and Uganda. Lancet HIV. 2016;3(5):e212–20. pmid:27126488

24. Hellar AM, Boyee D, Mahler H, Plotkin M, Ng'wanakilala T, Curran K, et al. Mobile VMMC teams in Tanzania see older clients and have higher followup rates. Top Antivir Med. 2015;23(e-1):502.

25. Kaufman ZA, DeCelles J, Bhauti K, Hershow RB, Weiss HA, Chaibva C, et al. A sport-based intervention to increase uptake of voluntary medical male circumcision among adolescent male students: results From the MCUTS 2 cluster-randomized trial in Bulawayo, Zimbabwe. J Acquir Immune Defic Syndr. 2016;72(Suppl 4):S292–8.

26. Mahler H, Searle S, Plotkin M, Kulindwa Y, Greenberg S, Mlanga E, et al. Covering the last kilometer: using GIS to scale-up voluntary medical male circumcision services in Iringa and Njombe regions, Tanzania. Glob Health Sci Pract. 2015;3(3):503–15. pmid:26374807

27. Miiro G, DeCelles J, Rutakumwa R, Nakiyingi-Miiro J, Muzira P, Ssembajjwe W, et al. Soccer-based promotion of voluntary medical male circumcision: A mixed-methods feasibility study with secondary students in Uganda. PLoS One. 2017;12(10):e0185929. pmid:29016651

28. Montague C, Ngcobo N, Mahlase G, Frohlich J, Pillay C, Yende-Zuma N, et al. Implementation of adolescent-friendly voluntary medical male circumcision using a school based recruitment program in rural KwaZulu-Natal, South Africa. PLoS One. 2014;9(5):e96468. pmid:24788339

29. Wambura M, Mahler H, Grund J, Larke N, Mshana G, Kuringe E, et al. Increasing voluntary medical male circumcision uptake among adult men in Tanzania. Aids. 2017;31(7):1025–34. pmid:28350578

30. Weiss SM, Zulu R, Jones DL, Redding CA, Cook R, Chitalu N. The Spear and Shield intervention to increase the availability and acceptability of voluntary medical male circumcision in Zambia: a cluster randomised controlled trial. Lancet HIV. 2015;2(5):e181–9. pmid:26120594

31. DeCelles J, Hershow RB, Kaufman ZA, Gannett KR, Kombandeya T, Chaibva C, et al. Process evaluation of a sport-based voluntary medical male circumcision demand-creation intervention in Bulawayo, Zimbabwe. J Acquir Immune Defic Syndr. 2016;72(Suppl 4):S304–S8.

32. Katisi M, Daniel M. Safe male circumcision in Botswana: tension between traditional practices and biomedical marketing. Glob Public Health. 2015;10(5–6):739–56. pmid:25866013

33. Kilima SP, Shayo EH, Msovela J, Senkoro KP, Mayala BK, Mboera LEG, et al. The potential of involving traditional practitioners in the scaling up of male circumcision in the context of HIV prevention in Tanzania. Tanzania J Health Res. 2012;14(1):48–60.

34. Marshall E, Rain-Taljaard R, Tsepe M, Monkwe C, Taljaard D, Hlatswayo F, et al. Obtaining a male circumcision prevalence rate of 80% among adults in a short time: An observational prospective intervention study in the Orange Farm township of South Africa. Med. 2017;96(4):e5328.

35. Semo BW, Wirth KE, Ntsuape C, Barnhart S, Kleinman NJ, Ramabu N, et al. Modifying the health system to maximize voluntary medical male circumcision uptake: a qualitative study in Botswana. HIV AIDS (Auckl). 2018;10:1–8.

36. Alfonso YN, Bishai D, Nantongo A, Kakembo R, Kobusinge S, Kacker S, et al. Trends in the marginal cost of male circumcision in rural Rakai Uganda. J Acquir Immune Defic Syndr. 2016;73(5):564–71. pmid:27509246

37. Broughton EI, Karamagi E, Kigonya A, Lawino A, Marquez L, Lunsford SS, et al. The cost-effectiveness of three methods of disseminating information to improve medical male circumcision in Uganda. PLoS One. 2018;13(4):e0195691. pmid:29672578

38. Galárraga O, Wamai RG, Sosa-Rubí SG, Mugo MG, Contreras-Loya D, Bautista-Arredondo S, et al. HIV prevention costs and their predictors: evidence from the ORPHEA Project in Kenya. Health Policy Plan. 2017;32(10):1407–16. pmid:29029086

39. George G, Strauss M, Asfaw E. The cost of demand creation activities and voluntary medical male circumcision targeting school-going adolescents in KwaZulu-Natal, South Africa. PLoS One. 2017;12(6):e0179854. pmid:28632768

40. Larson B, Tindikahwa A, Mwidu G, Kibuuka H, Magala F. How much does it cost to improve access to voluntary medical male circumcision among high-risk, low-income communities in Uganda? PLoS One. 2015;10(3):e0119484. pmid:25774677

41. Marseille E, Kahn JG, Beatty S, Jared M, Perchal P. Adult male circumcision in Nyanza, Kenya at scale: the cost and efficiency of alternative service delivery modes. BMC Health Serv Res. 2014;14:31. pmid:24450374

42. Soboil N, Cockburn J, Rech D, Taljaard D. A comparative analysis of two high-volume male medical circumcision (MMC) operational models with similar service delivery outcomes in different settings within Gauteng and KwaZulu-Natal provinces in South Africa: Urban Centre for HIV/AIDS Prevention Studies (CHAPS) versus rural-SACTWU Worker Health Program (SWHP). J Int AIDS Soc. 2012;15(S3):239.

43. Tchuenche M, Palmer E, Haté V, Thambinayagam A, Loykissoonlal D, Njeuhmeli E, et al. The cost of voluntary medical male circumcision in South Africa. PLoS One. 2016;11(10):e0160207. pmid:27783612

44. Torres-Rueda S, Wambura M, Weiss HA, Plotkin M, Kripke K, Chilongani J, et al. Cost and cost-effectiveness of a demand creation intervention to increase uptake of voluntary medical male circumcision in Tanzania: spending more to spend less. J Acquir Immune Defic Syndr. 2018;78(3):291–9. pmid:29557854

45. Jennings L, Bertrand J, Rech D, Harvey SA, Hatzold K, Samkange CA, et al. Quality of voluntary medical male circumcision services during scale-up: a comparative process evaluation in Kenya, South Africa, Tanzania and Zimbabwe. PLoS One. 2014;9(5):e79524. pmid:24801073

46. Curran K, Njeuhmeli E, Mirelman A, Dickson K, Adamu T, Cherutich P, et al. Voluntary medical male circumcision: strategies for meeting the human resource needs of scale-up in southern and eastern Africa. PLoS Med. 2011;8(11):e1001129. pmid:22140364

47. Herman-Roloff A, Llewellyn E, Obiero W, Agot K, Ndinya-Achola J, Muraguri N, et al. Implementing voluntary medical male circumcision for HIV prevention in Nyanza Province, Kenya: lessons learned during the first year. PLoS One. 2011;6(4):e18299. pmid:21483697

48. Carrasco MA, Wilkinson J, Kasdan B, Fleming P. Systematic review of barriers and facilitators to voluntary medical male circumcision in priority countries and programmatic implications for service uptake. Glob Public Health. 2019;14(1):91–111. pmid:29695201

49. Price JE, Phiri L, Mulenga D, Hewett PC, Topp SM, Shiliya N, et al. Behavior change pathways to voluntary medical male circumcision: narrative interviews with circumcision clients in Zambia. PLoS One. 2014;9(11):e111602. pmid:25375790

50. Plotkin M, Castor D, Mziray H, Küver J, Mpuya E, Luvanda PJ, et al. “Man, what took you so long?” Social and individual factors affecting adult attendance at voluntary medical male circumcision services in Tanzania. 2013;1(1):108–16.

51. Health Communication Capacity Collaborative (HC3). Technical considerations for demand generation for voluntary medical male circumcision in the context of the age pivot. Baltimore, Maryland: Johns Hopkins Center for Communication Programs (CCP), 2016.

52. Hatzold K, Mavhu W, Jasi P, Chatora K, Cowan FM, Taruberekera N, et al. Barriers and motivators to voluntary medical male circumcision uptake among different age groups of men in Zimbabwe: results from a mixed methods study. PLoS One. 2014;9(5):e85051. pmid:24802746

53. Haacker M, Fraser-Hurt N, Gorgens M. Effectiveness of and financial returns to voluntary medical male circumcision for HIV prevention in South Africa: an incremental cost-effectiveness analysis. PLoS Med. 2016;13(5):e1002012. pmid:27138961

54. Shi C-F, Li M, Dushoff J. Evidence that promotion of male circumcision did not lead to sexual risk compensation in prioritized Sub-Saharan countries. PLoS One. 2017;12(4):e0175928. pmid:28441458

55. Govender K, George G, Beckett S, Montague C, Frohlich J. Risk Compensation Following Medical Male Circumcision: Results from a 1-Year Prospective Cohort Study of Young School-Going Men in KwaZulu-Natal, South Africa. Int J Behav Med. 2018;25(1):123–30. pmid:28688094

56. Westercamp N, Agot K, Jaoko W, Bailey RC. Risk compensation following male circumcision: results from a two-year prospective cohort study of recently circumcised and uncircumcised men in Nyanza Province, Kenya. AIDS Behav. 2014;18(9):1764–75. pmid:25047688

57. Westercamp M, Jaoko W, Mehta S, Abuor P, Siambe P, Robert CB. Changes in male circumcision prevalence and risk compensation in the Kisumu, Kenya population 2008–2013. Journal of Acquired Immune Deficiency Syndromes and Human Retrovirology. 2017;74(2):e30.

58. L’Engle K, Lanham M, Loolpapit M, Oguma I. Understanding partial protection and HIV risk and behavior following voluntary medical male circumcision rollout in Kenya. Health Educ Res. 2013;29(1):122–30. pmid:24293524

59. Mukudu H, Dietrich J, Otwombe K, Manentsa M, Hlongwane K, Haas-Kogan M, et al. Voluntary medical male circumcision (VMMC) for prevention of heterosexual transmission of HIV and risk compensation in adult males in Soweto: Findings from a programmatic setting. PLoS One. 2019;14(3):e0213571. pmid:30845185

60. Ortblad KF, Harling G, Chimbindi N, Tanser F, Salomon JA, Bärnighausen T. Does incident circumcision lead to risk compensation? Evidence from a population cohort in KwaZulu-Natal, South Africa. JAIDS. 2019;80(3):269–75. pmid:30531298