Strategies for retention of heterosexual men in HIV care in sub-Saharan Africa: A systematic review

About the Authors:

Sylvia Kusemererwa

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

* E-mail: [email protected], [email protected]

Affiliation: Department of HIV Interventions, Medical Research Council/Uganda Virus Research Institute (MRC/UVRI) and London School of Hygiene and Tropical Medicine (LSHTM), Uganda Research Unit, Entebbe, Uganda

ORCID logo https://orcid.org/0000-0002-1390-109X

Dickens Akena

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

Affiliation: Department of Psychiatry, School of Medicine, Makerere University College of Health Sciences, Kampala, Uganda

Damalie Nakanjako

Roles Conceptualization, Formal analysis, Methodology, Supervision, Writing – original draft, Writing – review & editing

Affiliation: Department of Medicine, School of Medicine, Makerere University College of Health Sciences, Kampala, Uganda

Joanita Kigozi

Roles Conceptualization, Supervision, Writing – original draft, Writing – review & editing

Affiliation: Department for Outreaches, Infectious Diseases Institute (IDI), Makerere University College of Health Sciences, Kampala, Uganda

Regina Nanyunja

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing

Affiliation: Department of HIV Interventions, Medical Research Council/Uganda Virus Research Institute (MRC/UVRI) and London School of Hygiene and Tropical Medicine (LSHTM), Uganda Research Unit, Entebbe, Uganda

Mastula Nanfuka

Roles Conceptualization, Methodology, Writing – original draft, Writing – review & editing

Affiliation: Department of TBSpeed, Makerere University Johns Hopkins University Research Collaboration (MUJHU), Kampala, Uganda

Bennet Kizito

Roles Conceptualization, Data curation, Methodology, Writing – original draft, Writing – review & editing

Affiliation: Department of Monitoring and Evaluation, The AIDS Support Organization (TASO), Kampala, Uganda

ORCID logo https://orcid.org/0000-0001-7824-2497

Joseph Mugisha Okello

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

Affiliation: Department of HIV Interventions, Medical Research Council/Uganda Virus Research Institute (MRC/UVRI) and London School of Hygiene and Tropical Medicine (LSHTM), Uganda Research Unit, Entebbe, Uganda

Nelson Kawulukusi Sewankambo

Roles Conceptualization, Investigation, Methodology, Supervision, Writing – original draft, Writing – review & editing

Affiliation: Department of Medicine, School of Medicine, Makerere University College of Health Sciences, Kampala, Uganda

Introduction

According to the UNAIDS report 2018, mortality due to HIV/AIDS among men is higher compared to women [1]. In 2017, an estimated 300 000 [220 000–410 000] men in sub-Saharan Africa (SSA) died of acquired immune deficiency syndrome (AIDS)-related illness compared to 270 000 [190 000–390 000] women. Although women bear the highest burden of disease in SSA, more men than women living with Human immunodeficiency virus (HIV) are dying [2]. Low treatment coverage among men and poor treatment seeking behavior have been sighted as some of the reasons for the higher mortality of men with HIV compared to women [3].

Expansion of Antiretroviral Therapy (ART) programs in SSA has greatly increased the number of people accessing treatment [4]. In Uganda for example, 1.4million people were living with HIV in 2018 and 73% were on ART [5]. For adequate viral suppression to be realized, patients need to adhere to ART over their lifetime [6]. Retention in care is key to achieving the milestones that have been set up in HIV care [7]. According to the World Health Organization (WHO), retention in care can be defined from the moment of initial engagement in care, when a person with HIV is linked successfully to services, to assessment for eligibility, initiation on ART and retention in lifelong ART care [8]. However, data from high-income countries (HIC) as well as low and middle-income countries (LMIC), SSA inclusive, have shown a significant reduction in patient retention in HIV care at each step of the HIV care continuum. The continuum starts from diagnosis and linkage to care, assessment of ART readiness to acceptability, receipt of ART, adherence and retention in care, and treatment success as indicated by virologic suppression [3,9]. Attrition has been particularly documented in younger men, especially those less than 35 years) [10]. The high rates of attrition in males continue to peg down the gains made in HIV care over the years.

Several studies have been done to assess strategies that improve retention of those in HIV care [11,12]. Studies that include HIV positive men have shown improved rates of retention (>80%) using community-based strategies and reduction of clinic contact visits [13,14]. However, other studies showed a high risk of attrition among males compared to females [adjusted hazard ratio (aHR) range from 1.2–1.8] [15,16]. Interestingly, research exploring the use of mobile text to support retention documented no differences between males and females in using mobile text messages to support retention [13,17–19]. In one study, conducted in Kenya and Uganda, males were found to require more tracing to support retention [13]. Attrition along the HIV cascade could slow down the gains in mitigating the HIV epidemic in SSA [9].

Generally, the number of males accessing and being retained along the HIV care cascade is lower compared to women [20]. Male gender has been associated with poor retention in care [21]. Furthermore, there is conflicting literature about different strategies to improve retention of men in care. We conducted a systematic review to summarize any studies on strategies to improve retention of heterosexual males (≥15years of age) in HIV care in SSA. This review aimed at informing policy, research and practice on retention of HIV positive males in HIV care in SSA.

The aim of the systematic review was to identify, synthesize and appraise existing evidence of interventions aiming to improve retention of heterosexual men in HIV care in sub-Saharan Africa. The research question broken down by PICOS criteria was [22]:

1. P—population—men living with HIV in SSA

2. I—intervention—interventions that aimed to improve retention among men living with HIV in SSA

3. O—outcome—Studies that documented retention proportion/rate, attrition rate/proportion, relative risk, hazard ratios, odds ratios or retention strategies

4. S—study design—Randomized controlled trials, controlled clinical trials (CCT), prospective cohort studies, and retrospective cohort studies

Materials and methods

This review was conducted and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) statement [23]. A search of studies published between January 2005 and April 2019 was conducted and updated to include articles published from May 2019 to December 2020. This period was selected because ART scale up in SSA started around 2005. Data on strategies that improve retention of men in HIV care in any country in SSA was extracted. The search outputs were summarised in a PRISMA flow chart (Fig 1).

[Figure omitted. See PDF.]

Fig 1. PRISMA flow chart for study selection.

https://doi.org/10.1371/journal.pone.0246471.g001

Inclusion and exclusion criteria

Studies were included if they met the following criteria: published or presented between January 2005 and April 2019 and conducted in SSA. We included randomized controlled trials and cohort studies that recruited adult males (≥15years of age). Studies were excluded if they had other study designs (qualitative, cross-sectional, case control). We also excluded previous systematic reviews, articles that measured other outcomes other than retention, conference abstracts and letters to the editor.

Review protocol

The review protocol was registered in PROSPERO, the International Prospective Register of Systematic Reviews on 29 April 2020. The registration number is CRD42020142923 and can be found online: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020142923.

Data sources and search strategies

Studies were identified through a systematic search in bibliographic databases; using the OVID® interface for (MEDLINE, EMBASE and Global Health). Search terms were developed using relevant key words and medical subject headings (MeSH). The search terms are summarized in S1 Table. Duplicate studies were removed from the results using the “de-duplicate” feature in OVID® and exported to EndNote reference management software (X7).

Screening and selection

Two reviewers (SK and RN) reviewed the identified studies (titles, abstracts, keywords) independently for the eligibility criteria and articles that did not meet the eligibility criteria were excluded at this stage. Articles from stage one were subjected to full text review in which the methods were reviewed for relevance towards the eligibility criteria. More articles were excluded at this stage. Two copies of full text documents were printed for all articles that met eligibility criteria. SK and RN reviewed these independently and were blinded to the results from each other. Any inconsistencies between were discussed and where consensus was not reached, a discussion was held with a third member of the team. Any missing information was not collected from any corresponding authors.

Data extraction

A standardized data extraction form was used to document information from each included study on the following: Data items collected included (a) first author’s name, (b) publication year, (c) country, (d) sample size for males and total population, (e) study design and (f) interventions used to promote retention. Information on outcome measures was also collected.

Risk of bias assessment

Risk of bias within the included studies was assessed using the Cochrane risk of bias tool for non-randomized studies in interventions (ROBINS-I) [24].

Summary measures

We sought to establish retention proportion/rate, attrition rate/proportion, relative risk, hazard ratios, and odds ratios.

Data synthesis

Due to the heterogeneity of studies a meta-analysis was not considered and narrative synthesis of the included papers was conducted. Results were summarized using PRISMA flowchart [23].

Ethics statement

This work did not require an ethics statement.

Results and discussion

Summary of search results

A total of 1620 records were identified through the literature search. Titles and abstracts were reviewed and 1570 articles were excluded because they did not meet the inclusion criteria. An updated search identified 557 records of which 334 were excluded because they did not meet the inclusion criteria.

Study selection

A total of 93 articles were subjected to full text review to determine eligibility (Fig 1), 18 met eligibility. During data extraction, five articles were excluded because they were protocols for planned studies. Therefore, 13 studies were included in this review. An updated search was conducted on 04 December 2020 and 4 additional records were subjected to full text review, and 3 articles were excluded because two did not have clear description of interventions and one did not disaggregate the outcomes by gender. Only one article was include bringing the total number of articles included in this review to 14.

Study characteristics

A summary description of the included studies is presented in Table 1 (adapted from the Cochrane library) [25]. The studies were conducted in eight African countries: Democratic Republic of Congo, Ethiopia, Malawi, Mozambique, Rwanda, South Africa, Tanzania and Uganda between 2005 and December 2020. The number of males in included studies varied and ranged from 122 to 21101, a proportion of 32% of the total population.

[Figure omitted. See PDF.]

Table 1. Studies that met inclusion criteria.

https://doi.org/10.1371/journal.pone.0246471.t001

Risk of bias within studies

The quality of each study was assessed using the Cochrane risk of bias tool for non-randomized studies [24]. The risk of bias with regards to the different domains within included studies varied from low, moderate to serious. With regards to confounding, there was low to moderate risk of bias (Table 2). The bias in methods for selection of study participants was moderate in 10 studies [15,16,28,29,31–36], low in 3 [27,30,37], while there was a serious risk of bias due to absence of data on some variables that were considered confounders [26]. There was bias in some studies due to misclassification of interventions due to recall bias from study participants in one study and [33] and missing data in others [15,16,27–32,34–37].

[Figure omitted. See PDF.]

Table 2. Risk of bias within studies.

https://doi.org/10.1371/journal.pone.0246471.t002

The risk of bias due to deviations from interventions was generally moderate with two studies having low risk of bias [33,37] and another providing no information on deviations [15,16,26–32,34–36]. There was moderate bias due to missing data but most studies adjusted for this in the analysis. However, one study had serious risk of bias in the same domain because they relied on patients to provide information on disclosure [33] while another indicated the lack of information as a limitation for the study [28].

The bias in measurement of outcomes was moderate in most studies as most authors adjusted for the factors that may affect the outcome in data analysis. The bias in selection of the reported result was moderate to low. In most studies, the results were reported as indicated while two studies had moderate risk of bias in this domain as there was no comparison of outcomes in the two groups being studied [30,33].

Retention strategies and outcome measures

In this review, seven studies (7/14) explored community based adherence support groups [15,26–30,37] while two (2/14) compared use of facility versus community-based delivery models [31,32]. Other studies measured the effect of disclosure of HIV status [33], giving psychosocial support [34], national identity cards [35], distance from the health center [36] and six-monthly clinic visits [16]. Retention of men was provided as proportions in two studies [26,29], an average of 56.5% at 24months. Five studies provided risk of attrition from care using hazard ratios ranging from 1.2–1.8 [15,26,27,32,36], four studies documented attrition proportions at an average of 40.0% [26,29,31,35] and two studies an average rate of attrition of 43.4/1000 person years [16,33].

The engagement of men in HIV care is important in ensuring epidemic control and achievement of UNAIDS targets [20]. Therefore, it is necessary to identify and set up strategies that will effectively ensure the retention of men in HIV care [38]. This review showed that few studies have investigated interventions that can be used to retain heterosexual males in HIV care. What is interesting is no study was found that focused on men as a population. Various studies have focused on involving men in PMTCT programs [39,40].

We also found that in this review the highest proportion of men retained in care was observed when community adherence groups were used as an intervention. Although retention in the population was high, the risk of attrition of men from care was at 80% [15]. Other studies also showed a high risk of attrition for men [16,26,27,32,36]. This is similar to what has been studied as predictors for poor retention in various studies in sub Saharan Africa where male gender has been highlighted as a risk factor for mortality and attrition from care [41–44]. Whereas retention is a bigger challenge for men relative to women, various studies did not provide a disaggregation of retention by gender; posing a challenge in identifying interventions that may work for men [45–50]. In contrast, most studies on engaging men who have sex with men have been undertaken outside SSA [51–55] with retention reported at about 64% [50]. A study done in Kenya showed that men who have sex with men (MSM) had lower retention at 12 months compared to heterosexual men and women when ART was received at the clinic compared to when it was not [56].

Although retention in care has been posed as a general challenge in SSA, most especially among men [44] similar sentiments have been seen elsewhere in the developed world like the United States of America where disparities in retention have been reported [57]. Gender and race account for differences in retention and also affect access to care with males and blacks being at higher risk of discontinuing care [58]. However, studies among those disproportionately affected by HIV have shown some improvement in retention in care with community based interventions facilitating engagement in care [59] while mobile phone used improved retention of these groups from 51% to 81% at 12 months [60].

Strengths and limitations

To the best of our knowledge, this is the first systematic review aimed at summarizing strategies to reduce attrition of men from HIV care. However, there are a few limitations to this review. Firstly, only a few studies on retention of heterosexual men in HIV care have been performed and only eight countries in sub Saharan Africa are represented. Eight of these were in southern Africa and six in East Africa. This may limit the generalizability of the findings to central and western Africa that may have different gender-related sociocultural practices. Additionally, the outcome measures used in the identified studies varied widely, making it impractical to perform a pooled analysis.

It is important to note that all the studies that included interventions to improve retention of men in HIV care were retrospective cohorts, making it challenging to account for the effects of confounding factors. While randomized controlled trials (RCT) are the gold standard in evaluating interventions including their effect sizes [61], none of the included studies in this review was an RCT. Therefore, the evidence from this review should be interpreted with caution.

Lastly, we didn’t explore whether the males lost in one program were identified or seen in another. Most of the studies used programmatic data that may not provide the true estimates for retention of men in care.

Conclusions

This review suggests that no studies have explored heterosexual male centered interventions in HIV care. However, in included studies that explored retention in both males and females, there were high rates of attrition in men. The barriers and facilitators for retention of men in HIV care need to be explored in order to design male-centered interventions in SSA. There is also need to study the effectiveness of potentially effective strategies, preferably through randomized controlled trials and any interventions put in place should be evaluated.

Supporting information

S1 Checklist.

https://doi.org/10.1371/journal.pone.0246471.s001

(DOC)

S1 Table. Search term strategy used in Ovid® for three databases (Medline, Embase and Global Health).

https://doi.org/10.1371/journal.pone.0246471.s002

(DOCX)

Acknowledgments

The authors wish to thank the Afya Bora Consortium working group for all the support and guidance offered during the conduct of this review. They would also want to thank Russell Burke of London School of Hygiene and Tropical Medicine for providing enormous support and guidance on library searches.

Citation: Kusemererwa S, Akena D, Nakanjako D, Kigozi J, Nanyunja R, Nanfuka M, et al. (2021) Strategies for retention of heterosexual men in HIV care in sub-Saharan Africa: A systematic review. PLoS ONE 16(2): e0246471. https://doi.org/10.1371/journal.pone.0246471

References

1. UNAIDS. UNAIDS data report 2018. 2018. [cited 2019 March]. https://www.unaids.org/en/resources/documents/2018/unaids-data-2018.

2. Cornell M. Gender inequality: Bad for men’s health. Southern African journal of HIV medicine. 2013;14(1). pmid:24078805

3. Nachega JB, Adetokunboh O, Uthman OA, Knowlton AW, Altice FL, Schechter M, et al. Community-based interventions to improve and sustain antiretroviral therapy adherence, retention in HIV care and clinical outcomes in low-and middle-income countries for achieving the UNAIDS 90-90-90 targets. Current HIV/AIDS Reports. 2016;13(5):241–55. pmid:27475643

4. Druyts E, Dybul M, Kanters S, Nachega J, Birungi J, Ford N, et al. Male sex and the risk of mortality among individuals enrolled in antiretroviral therapy programs in Africa: a systematic review and meta-analysis. Aids. 2013;27(3):417–25. pmid:22948271

5. Avert. HIV AND AIDS IN UGANDA. 2018. [cited 2019 March]. https://www.avert.org/professionals/hiv-around-world/sub-saharan-africa/uganda.

6. Bärnighausen T, Chaiyachati K, Chimbindi N, Peoples A, Haberer J, Newell ML. Interventions to increase antiretroviral adherence in sub-Saharan Africa: a systematic review of evaluation studies. Lancet Infect Dis. 2011;11(12):942–51. pmid:22030332

7. HIV/AIDS JUNPo, UNAIDS D. Geneva, Switzerland; 2018. North American, Western and Central Europe: AIDS epidemic update regional summary. 2019:1–16. [cited 2019 March]. https://www.unaids.org/en/keywords/data-0#:~:text=In%202019%2C%20the%20estimated%201.7,that%20was%20set%20for%202020.

8. Organization WH. Retention in HIV programmes: defining the challenges and identifying solutions: meeting report, 13–15 September 2011. 2012. [cited 2019 March] https://www.who.int/hiv/pub/meetingreports/retention_programmes/en/.

9. Lippman SA, Shade SB, El Ayadi AM, Gilvydis JM, Grignon JS, Liegler T, et al. Attrition and opportunities along the HIV care continuum: findings from a population-based sample, North West Province, South Africa. Journal of acquired immune deficiency syndromes (1999). 2016;73(1):91. pmid:27082505

10. Arnesen R, Moll AP, Shenoi SV. Predictors of loss to follow-up among patients on ART at a rural hospital in KwaZulu-Natal, South Africa. PLoS One. 2017;12(5):e0177168. pmid:28542309

11. Sharma M, Barnabas RV, Celum C. Community-based strategies to strengthen men’s engagement in the HIV care cascade in sub-Saharan Africa. PLoS medicine. 2017;14(4):e1002262. pmid:28399122

12. Govindasamy D, Meghij J, Negussi EK, Baggaley RC, Ford N, Kranzer K. Interventions to improve or facilitate linkage to or retention in pre‐ART (HIV) care and initiation of ART in low‐and middle‐income settings–a systematic review. Journal of the International AIDS Society. 2014;17(1):19032. pmid:25095831

13. Brown LB, Havlir DV, Ayieko J, Mwangwa F, Owaraganise A, Kwarisiima D, et al. High levels of retention in care with streamlined care and universal test-and-treat in East Africa. AIDS (London, England). 2016;30(18):2855. pmid:27603290

14. Floyd S, Ayles H, Schaap A, Shanaube K, MacLeod D, Phiri M, et al. Towards 90–90: Findings after two years of the HPTN 071 (PopART) cluster-randomized trial of a universal testing-and-treatment intervention in Zambia. PloS one. 2018;13(8):e0197904. pmid:30096139

15. Decroo T, Telfer B, Dores CD, White RA, Dos Santos N, Mkwamba A, et al. Effect of Community ART Groups on retention-in-care among patients on ART in Tete Province, Mozambique: a cohort study. BMJ open. 2017;7(8):e016800. pmid:28801427

16. Wringe A, Cawley C, Szumilin E, Salumu L, Amoros Quiles I, Pasquier E, et al. Retention in care among clinically stable antiretroviral therapy patients following a six‐monthly clinical consultation schedule: findings from a cohort study in rural Malawi. Journal of the International AIDS Society. 2018;21(11):e25207. pmid:30450699

17. van der Kop ML, Muhula S, Ekström AM, Jongbloed K, Smillie K, Abunah B, et al. Participation in a mobile health intervention trial to improve retention in HIV care: does gender matter? Journal of telemedicine and telecare. 2017;23(2):314–20. pmid:27080746

18. van der Kop ML, Nagide PI, Thabane L, Gelmon L, Kyomuhangi LB, Abunah B, et al. Retention in clinic versus retention in care during the first year of HIV care in Nairobi, Kenya: a prospective cohort study. Journal of the International AIDS Society. 2018;21(11):e25196. pmid:30489698

19. Jong S, Cuca Y, Thompson LM. Meta-analysis of mobile phone reminders on HIV patients’ retention to care. Journal of mobile technology in medicine. 2017;6(1):5. pmid:30197685

20. Mills EJ, Beyrer C, Birungi J, Dybul MR. Engaging men in prevention and care for HIV/AIDS in Africa. PLoS medicine. 2012;9(2):e1001167. pmid:22346735

21. Mugglin C, Estill J, Wandeler G, Bender N, Egger M, Gsponer T, et al. Loss to programme between HIV diagnosis and initiation of antiretroviral therapy in sub‐Saharan Africa: systematic review and meta‐analysis. Tropical Medicine & International Health. 2012;17(12):1509–20. pmid:22994151

22. Robinson KA, Saldanha IJ, Mckoy NA. Frameworks for determining research gaps during systematic reviews. 2011.

23. Moher D, Liberati A, Tetzlaff J, Altman D. Academia and clinic annals of internal medicine preferred reporting items for systematic reviews and meta-analyses. Annu Intern Med. 2009;151(4):264–9.

24. Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. bmj. 2016;355:i4919. pmid:27733354

25. Van Tulder M, Furlan A, Bombardier C, Bouter L, Group EBotCCBR. Updated method guidelines for systematic reviews in the cochrane collaboration back review group. Spine. 2003;28(12):1290–9. pmid:12811274

26. Decroo T, Koole O, Remartinez D, dos Santos N, Dezembro S, Jofrisse M, et al. Four‐year retention and risk factors for attrition among members of community ART groups in T ete, M ozambique. Tropical Medicine & International Health. 2014;19(5):514–21.

27. Fatti G, Meintjes G, Shea J, Eley B, Grimwood A. Improved survival and antiretroviral treatment outcomes in adults receiving community-based adherence support: 5-year results from a multicentre cohort study in South Africa. JAIDS Journal of Acquired Immune Deficiency Syndromes. 2012;61(4):e50–e8. pmid:22842842

28. Nabaggala MS, Parkes-Ratanshi R, Kasirye R, Kiragga A, Castlenuovo B, Ochaka I, et al. Re-engagement in HIV care following a missed visit in rural Uganda. BMC research notes. 2018;11(1):762. pmid:30359290

29. Rich ML, Miller AC, Niyigena P, Franke MF, Niyonzima JB, Socci A, et al. Excellent clinical outcomes and high retention in care among adults in a community-based HIV treatment program in rural Rwanda. JAIDS Journal of Acquired Immune Deficiency Syndromes. 2012;59(3):e35–e42. pmid:22156912

30. Tsondai PR, Wilkinson LS, Grimsrud A, Mdlalo PT, Ullauri A, Boulle A. High rates of retention and viral suppression in the scale‐up of antiretroviral therapy adherence clubs in Cape Town, South Africa. Journal of the International AIDS Society. 2017;20(Suppl 4):21649. pmid:28770595

31. Kipp W, Konde-Lule J, Saunders LD, Alibhai A, Houston S, Rubaale T, et al. Antiretroviral treatment for HIV in rural Uganda: two-year treatment outcomes of a prospective health centre/community-based and hospital-based cohort. PloS one. 2012;7(7):e40902. pmid:22815862

32. Megerso A, Garoma S. Comparison of survival in adult antiretroviral treatment naïve patients treated in primary health care centers versus those treated in hospitals: retrospective cohort study; Oromia region, Ethiopia. BMC health services research. 2016;16(1):581. pmid:27756372

33. Akilimali PZ, Musumari PM, Kashala-Abotnes E, Kayembe PK, Lepira FB, Mutombo PB, et al. Disclosure of HIV status and its impact on the loss in the follow-up of HIV-infected patients on potent anti-retroviral therapy programs in a (post-) conflict setting: A retrospective cohort study from Goma, Democratic Republic of Congo. PLoS One. 2017;12(2):e0171407. pmid:28170410

34. Siril HN, Kaaya SF, Fawzi MKS, Mtisi E, Somba M, Kilewo J, et al. CLINICAL outcomes and loss to follow-up among people living with HIV participating in the NAMWEZA intervention in Dar es Salaam, Tanzania: a prospective cohort study. AIDS research and therapy. 2017;14(1):18. pmid:28351430

35. Shearer K, Clouse K, Meyer-Rath G, MacLeod W, Maskew M, Sanne I, et al. Citizenship status and engagement in HIV care: an observational cohort study to assess the association between reporting a national ID number and retention in public-sector HIV care in Johannesburg, South Africa. BMJ open. 2017;7(1):e013908. pmid:28119389

36. Bilinski A, Birru E, Peckarsky M, Herce M, Kalanga N, Neumann C, et al. Distance to care, enrollment and loss to follow-up of HIV patients during decentralization of antiretroviral therapy in Neno District, Malawi: A retrospective cohort study. PloS one. 2017;12(10):e0185699. pmid:28973035

37. Bock P, Gunst C, Maschilla L, Holtman R, Grobbelaar N, Wademan D, et al. Retention in care and factors critical for effectively implementing antiretroviral adherence clubs in a rural district in South Africa. Journal of the International AIDS Society. 2019;22 (10) (no pagination)(e25396). pmid:31588668

38. Ochieng-Ooko V, Ochieng D, Sidle JE, Holdsworth M, Wools-Kaloustian K, Siika AM, et al. Influence of gender on loss to follow-up in a large HIV treatment programme in western Kenya. Bulletin of the World Health Organization. 2010;88(9):681–8. pmid:20865073

39. Brusamento S, Ghanotakis E, Car LT, van‐Velthoven MH, Majeed A, Car J. Male involvement for increasing the effectiveness of prevention of mother‐to‐child HIV transmission (PMTCT) programmes. Cochrane Database of Systematic Reviews. 2012;10(10):CD009468. pmid:23076959

40. Reece M, Hollub A, Nangami M, Lane K. Assessing male spousal engagement with prevention of mother-to-child transmission (pMTCT) programs in western Kenya. AIDS care. 2010;22(6):743–50. pmid:20461572

41. Koole O, Tsui S, Wabwire‐Mangen F, Kwesigabo G, Menten J, Mulenga M, et al. Retention and risk factors for attrition among adults in antiretroviral treatment programmes in Tanzania, Uganda and Zambia. Tropical medicine & international health. 2014;19(12):1397–410. pmid:25227621

42. DeSilva MB, Merry SP, Fischer PR, Rohrer JE, Isichei CO, Cha SS. Youth, unemployment, and male gender predict mortality in AIDS patients started on HAART in Nigeria. AIDS care. 2009;21(1):70–7. pmid:19085222

43. Bucciardini R, Fragola V, Abegaz T, Lucattini S, Halifom A, Tadesse E, et al. Retention in care of adult HIV patients initiating antiretroviral therapy in Tigray, Ethiopia: a prospective observational cohort study. PloS one. 2015;10(9):e0136117. pmid:26340271

44. Fox MP, Rosen S. Patient retention in antiretroviral therapy programs up to three years on treatment in sub‐Saharan Africa, 2007–2009: systematic review. Tropical medicine & international health. 2010;15:1–15. pmid:20586956

45. Achieng L, Musangi H, Ong’uti S, Ombegoh E, Bryant L, Mwiindi J, et al. An observational cohort comparison of facilitators of retention in care and adherence to anti-eetroviral therapy at an HIV treatment center in Kenya. PloS one. 2012;7(3):e32727. pmid:22427869

46. Assefa Y, Kiflie A, Tekle B, Mariam DH, Laga M, Van Damme W. Effectiveness and acceptability of delivery of antiretroviral treatment in health centres by health officers and nurses in Ethiopia. Journal of Health Services Research & Policy. 2012;17(1):24–9. pmid:22096081

47. Braitstein P, Siika A, Hogan J, Kosgei R, Sang E, Sidle J, et al. A clinician-nurse model to reduce early mortality and increase clinic retention among high-risk HIV-infected patients initiating combination antiretroviral treatment. Journal of the International AIDS Society. 2012;15(1):7. pmid:22340703

48. Chang LW, Nakigozi G, Billioux VG, Gray RH, Serwadda D, Quinn TC, et al. Effectiveness of peer support on care engagement and preventive care intervention utilization among pre-antiretroviral therapy, HIV-infected adults in Rakai, Uganda: a randomized trial. AIDS and Behavior. 2015;19(10):1742–51. pmid:26271815

49. Elul B, Lamb MR, Lahuerta M, Abacassamo F, Ahoua L, Kujawski SA, et al. A combination intervention strategy to improve linkage to and retention in HIV care following diagnosis in Mozambique: A cluster-randomized study. PLoS medicine. 2017;14(11):e1002433. pmid:29136001

50. McNairy ML, Lamb MR, Gachuhi AB, Nuwagaba-Biribonwoha H, Burke S, Mazibuko S, et al. Effectiveness of a combination strategy for linkage and retention in adult HIV care in Swaziland: The Link4Health cluster randomized trial. PLoS medicine. 2017;14(11):e1002420. pmid:29112963

51. Biello KB, Oldenburg CE, Safren SA, Rosenberger JG, Novak DS, Mayer KH, et al. Multiple syndemic psychosocial factors are associated with reduced engagement in HIV care among a multinational, online sample of HIV-infected MSM in Latin America. AIDS care. 2016;28(sup1):84–91. pmid:26883009

52. Tanner AE, Mann L, Song E, Alonzo J, Schafer K, Arellano E, et al. weCARE: A social media–based intervention designed to increase HIV care linkage, retention, and health outcomes for racially and ethnically diverse young MSM. AIDS Education and Prevention. 2016;28(3):216–30. pmid:27244190

53. Hightow-Weidman LB, Smith JC, Valera E, Matthews DD, Lyons P. Keeping them in “STYLE”: finding, linking, and retaining young HIV-positive black and Latino men who have sex with men in care. AIDS patient care and STDs. 2011;25(1):37–45. pmid:21162690

54. McFall AM, Mehta SH, Srikrishnan AK, Lucas GM, Vasudevan CK, Celentano DD, et al. Getting to 90: linkage to HIV care among men who have sex with men and people who inject drugs in India. AIDS care. 2016;28(10):1230–9. pmid:27054274

55. Nugroho A, Erasmus V, Coulter RW, Koirala S, Nampaisan O, Pamungkas W, et al. Driving factors of retention in care among HIV-positive MSM and transwomen in Indonesia: A cross-sectional study. PloS one. 2018;13(1):e0191255. pmid:29342172

56. Graham SM, Mugo P, Gichuru E, Thiong’o A, Macharia M, Okuku HS, et al. Adherence to antiretroviral therapy and clinical outcomes among young adults reporting high-risk sexual behavior, including men who have sex with men, in coastal Kenya. AIDS and Behavior. 2013;17(4):1255–65. pmid:23494223

57. Anderson AN, Higgins CM, Haardörfer R, Holstad MM, Nguyen MLT, Waldrop-Valverde D. Disparities in retention in care among adults living with HIV/AIDS: a systematic review. AIDS and Behavior. 2020;24(4):985–97. pmid:31555931

58. Rebeiro PF, Abraham AG, Horberg MA, Althoff KN, Yehia BR, Buchacz K, et al. Sex, race, and HIV risk disparities in discontinuity of HIV care after antiretroviral therapy initiation in the United States and Canada. AIDS patient care and STDs. 2017;31(3):129–44. pmid:28282246

59. Raj A, Yore J, Urada L, Triplett DP, Vaida F, Smith LR, et al. Multi-site evaluation of community-based efforts to improve engagement in HIV care among populations disproportionately affected by HIV in the United States. AIDS patient care and STDs. 2018;32(11):438–49. pmid:30398952

60. Dillingham R, Ingersoll K, Flickinger TE, Waldman AL, Grabowski M, Laurence C, et al. PositiveLinks: a mobile health intervention for retention in HIV care and clinical outcomes with 12-month follow-up. AIDS patient care and STDs. 2018;32(6):241–50. pmid:29851504

61. Hayes RJ, Moulton LH. Cluster randomised trials: Chapman and Hall/CRC; 2017.