Single-test syphilis serology: A case of not seeing the forest for the trees

Abstract

Introduction

There have been few empirical studies for diagnostic test accuracy of syphilis using a sequence of rapid tests in populations with low prevalence of syphilis such as pregnant women. This analysis describes syphilis test positivity frequency among pregnant women at an antenatal clinic in Zambia using a reverse-sequence testing algorithm for antenatal syphilis screening.

Methods

Between August 2019 and May 2023, we recruited 1510 pregnant women from a peri-urban hospital in Lusaka, Zambia. HIV positive and HIV negative women were enrolled in a 1:1 ratio. Blood collected at recruitment from the pregnant mothers was tested on-site for syphilis using a rapid treponemal test. Samples that tested positive were further tested at a different laboratory, with rapid plasma reagin using archived plasma.

Results

Of the total 1,421 sera samples which were screened with a rapid treponemal test, 127 (8.9%) were positive and 1,294 (91.1%) were negative. Sufficient additional samples were available to perform RPR testing on 114 of the 127 (89.8%) RDT positive specimens. Thirty-one (27.2%) of these 114 were reactive by RPR and 83 (72.8%) were negative, resulting in a syphilis overtreatment rate of 3 fold (i.e, 84/114). Insufficient sample or test kit availability prevented any testing for the remaining 89 (5.9%) participants.

Conclusion

Use of only treponemal tests in low prevalence populations, like pregnant women, subjects individuals with non-active syphilis to the costs and possible risks of overtreatment. The use of the dual treponemal and non-treponemal tests would minimize this risk at some additional cost.

Background

Syphilis, a sexually transmitted disease caused by bacterium Treponema pallidum, remains the second leading global cause of stillbirths. Untreated maternal syphilis result in congenital syphilis in 80% of the cases leading to significant adverse birth outcomes in 52% of pregnant women [1]. In Zambia, data about case rates of congenital syphilis at subnational and national level are limited. However, the prevalence of syphilis among pregnant women in Zambia during the 2018 to 2019 period was reported to be 5.6% [2].

Syphilis screening of all pregnant women is part of the basic antenatal care (ANC) package recommended by the World Health Organisation (WHO) as a cost-efficient method to reduce the incidence of congenital syphilis [3]. In recent years, there has been a growing trend towards using point-of-care rapid tests for syphilis, including rapid syphilis test (RST) and rapid plasma reagin (RPR) to allow for same-visit treatment [4]. While there is evidence of single-test strategies amongst the general population, there have been few empirical studies for diagnostic test accuracy using a sequence of tests in populations with low prevalence of syphilis such as pregnant women [5]. This creates major challenges in syphilis surveillance reporting and management among laboratories, clinicians and public health practitioners, such as overestimation of syphilis seroprevalence and overtreatment of syphilis since a positive treponemal test result alone can persist over a lifetime.

To improve pregnancy and birth outcomes, the Zambia Ministry of Health recommends syphilis testing to be conducted in every trimester of pregnancy [6]. The most common point-of-care tests for syphilis used in Zambia can be classified into two types: treponemal and non-treponemal tests [7]. Treponemal tests include Enzyme immunoassay (EIA), IgM-Enzyme Immunoassay, Fluorescent Treponemal Antibody Absorption (FTA-abs), Treponemal Pallidum Hemagglutination Assay (TPHA) and Treponemal Pallidum Particle Agglutination (TPPA). Conversely, the non-treponemal tests, which are not specific to syphilis, include the RPR and the Venereal Disease Research Laboratory (VDRL) [7]. Recently, there is considerable use of dual rapid HIV and treponemal syphilis screening tests in hospitals. While the RPR test was used in the past for initial screening purposes, the advent of automation and treponemal rapid tests has led to a rapid increase of new treponemal tests on the market [8]. Consequently, the Zambia Ministry of Health has adopted the “reverse algorithm for syphilis” which involves an initial treponemal antibody screening immunoassay test, followed by confirmation with non-treponemal antibody testing (RPR), if available.

While the screening guidelines advocate the “reverse algorithm for syphilis” diagnosis, the health system in Zambia still faces several challenges in policy implementation. One such challenge is the erratic supply of testing kits and essential medicines [7,9]. In accordance with WHO guidelines for syphilis screening and treatment among pregnant women, it is common for health facilities to perform single serology syphilis tests and provide same-day treatment based on positive results of the rapid test only, without confirmatory testing [3]. This may result in overtreatment of pregnant women without active syphilis, defined as positivity on both a treponemal and nontreponemal test [3,10,11].

A recent meta-analysis of 44 studies showed a 2.87% pooled prevalence of syphilis among pregnant women in sub-Sahara Africa [12]. However, nearly all of the included studies used results from either a single test strategy or the traditional approach, except for one study by Taylor et al which reported on syphilis seropositivity using reverse-sequence testing algorithm [13].

This manuscript describes syphilis positivity results among pregnant women at an antenatal clinical located in peri-urban Lusaka, Zambia using a reverse-sequence testing algorithm for antenatal syphilis screening (treponemal testing followed by nontreponemal testing for confirmation) with the aims to: estimate active syphilis cases in a pregnant population; predict occurrence of possible overtreatment among pregnant women testing positive with a single treponemal test and balance antimicrobial stewardship with the risk of pregnant women at high risk of delivering infants with congenital syphilis.

Methods

Population

We tested blood of pregnant women at antenatal first booking who were enrolled into a prospective cohort study investigating whether HIV-exposed but uninfected infants (HEU) are at increased risk of mortality and morbidity compared to their HIV- unexposed uninfected (HUU) counterparts. The study, the Zambia Infant Cohort Study, was approved by both the University of Zambia Biomedical Research Ethics and Boston University Institutional Review Board. Between August 2019 and May 2023, we recruited 1510 participants from a peri-urban hospital in Lusaka, the capital city of Zambia. Both HIV positive and HIV negative women were enrolled in a 1:1 ratio.

Following an explanation of what study participation entailed, the participant was offered an opportunity to have all of their questions answered before consenting to participation in the study. Written informed consent was obtained from every participant. For minors, written informed consent was obtained from the parents or guardians. A copy of the consent form was given to the participant and the signed original was maintained with the study records.

Laboratory testing

Blood collected at recruitment was initially tested on-site for syphilis using a rapid treponemal test following the manufacturer’s instruction. The syphilis rapid test (syphilis strip test manufactured by BHAT, Bengaluru City, India) uses chromatographic immunoassay for the qualitative detection of antibodies (either IgG or IgM) to Treponema pallidum in serum or plasma. Samples that tested positive were further tested at a different laboratory, the CLIA approved Center for Infectious Diseases Research Zambia with rapid plasma reagin (Becton Dickson Macro-Vue^TM RPR Card Tests) using archived plasma. A titre of 1:4 or higher was considered reactive. No further testing was done for those samples that initially tested negative with the initial rapid treponemal test. Active infection was defined as (RDT + / RPRT +). Past infection was defined as (RDT + / RPRT -).

Statistical analyses

We compared baseline maternal factors and syphilis infection between HIV-infected and HIV-uninfected pregnant mothers using χ ² tests or Fisher’s exact tests (where cell frequencies where small) for categorical factors and Wilcoxon Rank Sum tests for continuous variable.

Results

Table 1 shows baseline characteristics of the women included in the syphilis testing. Both groups were of comparable socio-economic status, as shown in all five socioeconomic status quintiles. The mean age of participants was 28, with women living with HIV (WLHIV) being slightly older (mean of 29 years vs. mean of 26 years for the uninfected, p < .0001), owing likely to their older age and longer period of sexual activity. WLHIV were more likely to have active syphilis infection (4.1% vs. 1.2%, p = 0.0007) and past syphilis infection compared to HIV-uninfected participants (7.8% vs. 2.8%, p <0.0001). The majority of the WLWHIV had been on ART for more than 6 months (525/731, 71.4%). Alcohol use in pregnancy was more common among WLHIV than HIV-uninfected (15.1% v 7.1%, p<0.0001).

[Figure omitted. See PDF.]

Syphilis testing was performed at enrollment on 735 HIV-infected and 686 HIV-uninfected pregnant women (N = 1421), as depicted in Fig 1. Of the total 1,421 sera which were screened with a rapid treponemal test, 127 (8.9%) were positive and 1,294 (91.1%) were negative. All women with a positive rapid test were offered treatment for syphilis with three doses of benzathine penicillin. Treatment with a single dose of penicillin is not standard practice because of lack of reagents to monitor titres. Sufficient additional sample was available to perform RPR testing on 114 of the 127 (89.8%) RDT positive specimens. Thirty-one (27.2%) of these 114 were reactive by RPR and 83 (72.8%) were non-reactive resulting in an overtreatment rate of 84/114. Thus, nearly 3-fold more pregnant women without active syphilis would be recommended for treatment based on results of rapid testing alone for each PW with active syphilis confirmed by RPR. Insufficient sample or test kit availability prevented any testing for the remaining 89 (5.9%) participants.

[Figure omitted. See PDF.]

Abbreviations: RDT = rapid diagnostic test.

Discussion

Using only treponemal testing resulted in a higher overtreatment rate when compared to using a reverse testing algorithm which deploys both treponemal and non-treponemal tests. This observed difference could be attributed to treponemal tests’ greater sensitivity and inability to distinguish past or previously treated syphilis infection from active infection [11]. Treating all treponemal positive-tested pregnant women who are yet unconfirmed by nontreponemal testing will result in over treatment. Current practice is premised on the notion that the risk associated with untreated maternal syphilis and risk of congenital syphilis significantly outweighs the risk of overtreatment. Congenital syphilis has dire consequences for infected infants and an aggressive treatment strategy may be a reflection of that risk. However, the implementation of a reverse testing algorithm for syphilis may reduce overtreatment and unnecessary exposure to antibiotics, while still mitigating the risk of vertical transmission with more precision. Recent research suggests that antibiotic treatment during pregnancy may alter infant gut microbiota and increases risk for sepsis and necrotizing enterocolitis (NEC), particularly in premature infants [14]. To date, Treponema pallidum has not shown any documented resistance to penicillin but given the global emergence of widespread antimicrobial resistance, antibiotic stewardship remains a priority.

While the Zambia national policy recommends the reverse algorithm for syphilis screening, we witnessed implementation deficits at our study site which was subject to hospital resources–and shortages–for syphilis testing. On several occasions, there were stock-outs of treponemal tests, and confirmation at the hospital associated laboratory testing with RPR largely did not occur due to lack of reagents. In resource-constrained settings like ours, frontline workers were left to report only unconfirmed syphilis results from a treponemal test and only when RDT kits were available. This has serious implications on the accuracy of syphilis surveillance in that community and ultimately in the national statistics. For example, according to 2021 WHO global health observatory data, only 44% of women who accessed ANC services received a syphilis test and of the 3.4% who tested positive, it is not clear how many were treated [15]. Worse still, periodic stock-outs of benzathine penicillin G are often observed in Zambian clinics, made worse recently by the general disruptions of supply chains created by the COVID-19 pandemic [9]. National and global shortages of benzathine penicillin related to production and procurement also call for targeted use [16].

In designing healthcare policy, a major factor is the cost-effectiveness of the testing strategy. Unfortunately, it is extremely difficult to make meaningful statements about which algorithm is cost-effective without either knowing the financial threshold for the local healthcare system or true prevalence of syphilis. Only a few studies have attempted to undertake the research on the cost-effectiveness of serology syphilis testing algorithms in low middle-income countries. In a study investigating cost-effectiveness of several algorithms, Fern et al. found the use of a single rapid treponemal diagnostic test was the most cost-effective diagnostic approach in Peru, Tanzania and Zambia, while mass treatment was the most-cost effective approach in the high prevalence settings [17]. Further, the reverse algorithm for syphilis screening performed better in identifying true cases while reducing overtreatment but was not as cost-effective as a one-step approach [17]. However, one concern with these assessments is that they did not capture the costs of treating the partner of an infected mother, the exposed infant or indeed repeated treponemal tests and treatment for those who continued to be positive in subsequent pregnancies. Importantly, none of these studies considered the cost of overtreatment and antimicrobial resistance at population level.

On the contrary, a study by Owusu-Edusei et al, found the treponemal-only algorithm to be less cost-effective compared to the 2-step algorithms in low prevalence syphilis settings [18]. While data in this study was from a high-income country, it still illustrates the possibility that public clinics with higher rates of previously treated syphilis may be incurring higher costs by using a treponemal-only algorithm because of the approach’s inability to distinguish active from prior infections.

In light of emerging evidence of the potential risk of sepsis and NEC due to antibiotic exposure, a new cost-effectiveness model will need to include the cost of treating sequelae of antibiotic exposure [14,19]. Ultimately, this calls for a strengthened syphilis-testing strategy that would balance the risk of missing infants at high risk of acquiring congenital syphilis with the adverse outcomes of antibiotic overuse. There is now in use a rapid treponemal/nontreponemal test that can detect positivity on both of these serologies in a single test cartridge. This test is currently under review for performance in the United States and would allow for identification of point-of-care active syphilis when used in antenatal care settings thus facilitating appropriate treatment [11].

Finally, and though not shown in this paper, when exploring the data on whether syphilis was a potential confounder or mediator of the association between HIV exposure and adverse birth outcomes, it was not surprising that the results of our analyses differed depending on which algorithm for syphilis screening (treponemal-only algorithms or reverse algorithm) was used. For example, the association between HIV exposure and syphilis on birth outcomes was statistically significant when results from the treponemal-only algorithm were used. However, this association with HIV exposure was attenuated and no longer statistically significant when using results from the reverse algorithm for syphilis diagnosis. This provides a cautionary tale to clinicians, epidemiologists, ministries of health, partners and researchers of how to interpret syphilis results.

Conclusion

Use of only treponemal tests in low prevalence populations, like pregnant women, introduces the problem of identifying non-active syphilis resulting in subsequent overtreatment. Treponemal EIAs are cheap and are becoming increasingly available, but it is important to remember that confirmation of results by RPR is equally necessary for monitoring syphilis treatment. The use of the dual treponemal and non-treponemal tests would address the problem of overtreatment and promote antibiotics stewardship. Thus, there is need for consistent supply of testing reagents to ensure universal syphilis screening of all pregnant women. More importantly, further studies are needed to establish which syphilis algorithm offers both cost-effectiveness and health benefits in the Zambian context. With growing evidence of association of antibiotic use and potentially harmful changes in gut microbiota, future cost-effectiveness studies will have to incorporate costs from antibiotic overuse.

Supporting information

S1 File. Syphilis results by year.

https://doi.org/10.1371/journal.pone.0303253.s001

(DOCX)

S2 File. Syphilis dataset.

https://doi.org/10.1371/journal.pone.0303253.s002

(CSV)

Acknowledgments

We would like to express our sincere gratitude to all the study participants that accepted to be a part of the study. Without them, this research would not have been possible. We would also like to thank you the Centre for Infectious Disease Research in Zambia for their technical expertise on laboratory work. Lastly, we would like to acknowledge, our colleague, Roy Chavuma who provided valuable leadership and insight on the study before his untimely death.

Citation: Zulu EM, Herlihy JM, Duffy CR, Mwananyanda L, Chilengi R, Forman L, et al. (2024) Single-test syphilis serology: A case of not seeing the forest for the trees. PLoS ONE 19(5): e0303253. https://doi.org/10.1371/journal.pone.0303253

About the Authors:

Ethan Mabvuto Zulu

Contributed equally to this work with: Ethan Mabvuto Zulu, Julie M. Herlihy, Lawrence Mwananyanda, Leah Forman, Donald M. Thea

Roles: Investigation, Project administration, Writing – original draft, Writing – review & editing

E-mail: [email protected], [email protected]

Affiliation: Right to Care Zambia, Lusaka, Zambia

ORICD: https://orcid.org/0009-0005-8491-7346

Julie M. Herlihy

Contributed equally to this work with: Ethan Mabvuto Zulu, Julie M. Herlihy, Lawrence Mwananyanda, Leah Forman, Donald M. Thea

Roles: Conceptualization, Investigation, Writing – review & editing

Affiliations: Department of Pediatrics, Boston Medical Center, Boston University, Chobanian & Avedisian School of Medicine, Boston, Massachusetts, United States of America, Department of Global Health, Boston University School of Public Health, Boston, Massachusetts, United States of America

Cassandra R. Duffy

Roles: Investigation, Writing – review & editing

¶‡ These authors also contributed equally to this work

Affiliation: Department of Obstetrics & Gynecology, Division of Maternal-Fetal Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, United States of America

Lawrence Mwananyanda

Contributed equally to this work with: Ethan Mabvuto Zulu, Julie M. Herlihy, Lawrence Mwananyanda, Leah Forman, Donald M. Thea

Roles: Investigation, Writing – review & editing

Affiliation: Department of Global Health, Boston University School of Public Health, Boston, Massachusetts, United States of America

Roma Chilengi

Roles: Formal analysis

¶‡ These authors also contributed equally to this work

Affiliation: Centre for Infectious Disease Research in Zambia, Lusaka, Zambia

Leah Forman

Contributed equally to this work with: Ethan Mabvuto Zulu, Julie M. Herlihy, Lawrence Mwananyanda, Leah Forman, Donald M. Thea

Roles: Data curation, Formal analysis, Writing – review & editing

Affiliation: Biostatistics and Epidemiology Data Analytics Center, Boston University School of Public Health, Boston, Massachusetts, United States of America

Tim Heeren

Roles: Data curation, Formal analysis

¶‡ These authors also contributed equally to this work

Affiliation: Department of Biostatistics, Boston University School of Public Health, Boston, Massachusetts, United States of America

Christopher J. Gill

Roles: Formal analysis, Writing – review & editing

¶‡ These authors also contributed equally to this work

Affiliation: Department of Global Health, Boston University School of Public Health, Boston, Massachusetts, United States of America

Roy Chavuma

† Deceased.

Roles: Investigation, Project administration

Affiliation: Right to Care Zambia, Lusaka, Zambia

Barbara Payne-Lohman

Roles: Conceptualization

¶‡ These authors also contributed equally to this work

Affiliation: Institute for Immunology and Informatics, University of Rhode Island, Kingston, Rhode Island, United States of America

Donald M. Thea

Contributed equally to this work with: Ethan Mabvuto Zulu, Julie M. Herlihy, Lawrence Mwananyanda, Leah Forman, Donald M. Thea

Roles: Conceptualization, Formal analysis, Investigation, Methodology, Writing – review & editing

Affiliation: Department of Global Health, Boston University School of Public Health, Boston, Massachusetts, United States of America

[/RAW_REF_TEXT]

[/RAW_REF_TEXT]

[/RAW_REF_TEXT]

[/RAW_REF_TEXT]

[/RAW_REF_TEXT]

[/RAW_REF_TEXT]

[/RAW_REF_TEXT]

References

1. Ministry of Health. Elimination of mother to child transmission of HIV and Syphilis. National operational plan 2019–2021. Lusaka: Ministry of Health; 2019.P.1-2.

2. Anna J, Mwangelwa M, Yumo X, Herbert K, Maureen M, Albert M, et al. Low Treatment Rates and Associated Factors Among Pregnant Women with Syphilis in Zambia, Open Forum Infectious Diseases, Volume 9, Issue Supplement_2, December 2022, ofac492.1012, https://doi.org/10.1093/ofid/ofac492.1012.

3. WHO. Introduction. ln: WHO, editors. Guidelines on syphilis screening and treatment for pregnant women. Geneva: World health organization; 2017. P.10-12.

4. Seña AC, White BL, Sparling PF. Novel Treponema pallidum serologic tests: a paradigm shift in syphilis screening for the 21st century. Clin Infect Dis. 2010 Sep 15;51(6):700–8. pmid:20687840.

5. Centers for Disease Control and Prevention (CDC). Discordant results from reverse sequence syphilis screening—five laboratories, United States, 2006–2010. MMWR Morb Mortal Wkly Rep. 2011 Feb 11;60(5):133–7. PMID: 21307823.

6. Ministry of Health. Maternal and newborn. Ln: Ministry of Health, editors. Annual health statistical report. Lusaka; Ministry of Health; 2017–2021. p. 28–36.

7. Ministry of Health. Syphilis. ln: Ministry of Health, editors. Zambia national sexually transmitted infections treatment guidelines. Lusaka: Ministry of Health;2023. p.32-34.

8. Henao-Martínez AF, Johnson SC. Diagnostic tests for syphilis: New tests and new algorithms. Neurol Clin Pract. 2014 Apr;4(2):114–122. pmid:27606153; PMCID: PMC4999316.

9. Ministry of Health. Diagnostic services. ln: Ministry of Health, editors. National Health strategic plan. Lusaka: Ministry of Health; 2022–2026. p.81-82.

10. Peeling RW, Mabey D, Kamb ML, Chen X-S, Radolf JD, Benzaken AS. 2017. Syphilis. Nat Rev Dis Primers 3:17073. pmid:29022569

11. Satyaputra F, Hendry S, Braddick M, Sivabalan P, Norton R. The Laboratory Diagnosis of Syphilis. J Clin Microbiol. 2021 Sep 20;59(10):e0010021. Epub 2021 May 12. pmid:33980644; PMCID: PMC8451404. The Laboratory Diagnosis of Syphilis ‐ PubMed (nih.gov).

12. Hussen S, Tadesse B. Prevalence of Syphilis among Pregnant Women in Sub-Saharan Africa: A Systematic Review and Meta-Analysis. BioMed Res.I. 2019 Jul 16. 2019(4):1–10. Available from: 10.1155/2019/4562385 pmid:31392211

13. Taylor MM, Ebrahim S, Abiola N, Kinkodi DK, Mpingulu M, Kabuayi JP, et al. Correlates of syphilis seropositivity and risk for syphilis-associated adverse pregnancy outcomes among women attending antenatal care clinics in the Democratic Republic of Congo. Int J STD AIDS. 2014 Sep;25(10):716–25. Epub 2014 Jan 22. pmid:24452733; PMCID: PMC6764440.

14. Pammi M, Cope J, Tarr PI, Warner BB, Morrow AL, Mai V, et al. Intestinal dysbiosis in preterm infants preceding necrotizing enterocolitis: a systematic review and meta-analysis. Microbiome. 2017 Mar 9;5(1):31. pmid:28274256; PMCID: PMC5343300.

15. WHO global health data repository on syphilis in pregnancy. Women accessing antenatal care (ANC) who were tested for syphilis (%) [internet]2021. Available from:https://www.who.int/data/gho/data/indicators/indicator-details/GHO/women-accessing-antenatal-care-(anc)-services-who-were-tested-for-syphilis-(-).

16. Frederic S, Melanie T, Andrew S, Jicui D, Teodora W, Rosemary W, et al. Securing the supply of benzathine penicillin: a global perspective on risks and mitigation strategies to prevent future shortages, International Health, 2023; ihad087, https://doi.org/10.1093/inthealth/ihad087.

17. Terris-Prestholt F, Vickerman P, Torres-Rueda S, Santesso N, Sweeney S, Mallma P, et al. The cost-effectiveness of 10 antenatal syphilis screening and treatment approaches in Peru, Tanzania, and Zambia. Int J Gynaecol Obstet. 2015 Jun;130 Suppl 1(Suppl 1):S73–80. Epub 2015 Apr 29. pmid:25963907; PMCID: PMC4510253.

18. Owusu-Edusei K Jr, Koski KA, Ballard RC. The tale of two serologic tests to screen for syphilis—treponemal and nontreponemal: does the order matter? Sex Transm Dis. 2011 May;38(5):448–56. pmid:21183862.

19. Nogacka A, Salazar N, Suárez M, et al. Impact of intrapartum antimicrobial prophylaxis upon the intestinal microbiota and the prevalence of antibiotic resistance genes in vaginally delivered full term neonates. Microbiome. 2017 Aug 18; 5(93). available from: pmid:28789705