Developing monitoring and evaluation tools for event-based surveillance: experience from Vietnam

Abstract

Background

In 2016–2017, Vietnam’s Ministry of Health (MoH) implemented an event-based surveillance (EBS) pilot project in six provinces as part of Global Health Security Agenda (GHSA) efforts. This manuscript describes development and design of tools for monitoring and evaluation (M&E) of EBS in Vietnam.

Methods

A strategic EBS framework was developed based on the EBS implementation pilot project’s goals and objectives. The main process and outcome components were identified and included input, activities, outputs, and outcome indicators. M&E tools were developed to collect quantitative and qualitative data. The tools included a supervisory checklist, a desk review tool, a key informant interview guide, a focus group discussion guide, a timeliness form, and an online acceptability survey. An evaluation team conducted field visits for assessment of EBS 5–9 months after implementation.

Results

The quantitative data collected provided evidence on the number and type of events that were being reported, the timeliness of the system, and the event-to-signal ratio. The qualitative and subjective data collected helped to increase understanding of the system’s field utility and acceptance by field staff, reasons for non-compliance with established guidelines, and other factors influencing implementation.

Conclusions

The use of M&E tools for the EBS pilot project in Vietnam provided data on signals and events reported, timeliness of reporting and response, perceptions and opinions of implementers, and fidelity of EBS implementation. These data were valuable for Vietnam’s MoH to understand the function of the EBS program, and the success and challenges of implementing this project in Vietnam.