Effectiveness of a primary care-based integrated mobile health intervention for stroke management in rural China (SINEMA): A cluster-randomized controlled trial

Abstract

According to recent systematic reviews, these trials as a whole were effective in improving the quality of primary and community-based care, while results from mobile health (mHealth) technological interventions, mainly message-based programs, were inconclusive [8–11]. Over a 1-year period in preparation for the trial, we conducted extensive contextual field research on intervention design, technology development, and a 3-month pilot study in 4 villages [15,18,19]. Village clinics and township healthcare centers form the rural primary healthcare system and provide both general clinical care and the National Basic Public Health Services Program to residents in the region [23,25]. In brief, the intervention included both provider-side components and patient-facing components and were supported by a digital health system consisted of an Android-based smart phone application—SINEMA App—for providers and linked with a voice messages system for patients (see S1 Fig for a diagram depicting the intervention design).

Introduction

Since the Declaration of Alma-Ata in 1978, primary care strengthening has been identified as the key strategy for disease management and achieving universal health coverage [1]. Low-and middle-income countries (LMICs) bear the double burdens of long-standing infectious diseases and emerging noncommunicable chronic diseases (NCDs) [2]. However, primary care providers in LMICs often focus on infectious diseases and maternal and child health; thus, there is a lack of capacity to provide evidence-based essential primary care for patients with NCDs [3]. Several dozen trials have been conducted to evaluate various human-based or technological approaches to strengthen primary care for NCD control [4–9]. According to recent systematic reviews, these trials as a whole were effective in improving the quality of primary and community-based care, while results from mobile health (mHealth) technological interventions, mainly message-based programs, were inconclusive [8–11].

Our previous trials in rural China and India demonstrated that primary care-based multicomponent interventions to train, equip, and incentivize primary care providers were effective in changing providers’ behaviors and improving patient outcomes [12–14]. However, the interventions were not embedded in the existing healthcare system. In addition, in previous studies, the mHealth components targeted either providers [13] or patients [14] but were not integrated with each other. Many other trials suffered from similar problems [6] or did not utilize the rapidly evolving and promising mHealth technology at all [4,5].

To address these limitations, we designed an intervention program entitled “system-integrated and technology-enabled model of care (SINEMA)” [15]. This model strengthens the existing primary care workforce through training and support embedded in the entire healthcare system and integrates both provider-side and patient-facing mHealth technology. It is applicable to many types of NCDs, but we chose to focus on stroke management in rural China. Stroke is the leading cause of death and disability in rural China where primary care lacks the capacity to provide guideline-based essential care to stroke patients, and community-based management for secondary prevention of stroke is far from adequate [16,17]. We performed extensive feasibility and contextual research to adopt this model for stroke management in the setting of resource-limited areas in rural China [15,18,19]. We hypothesized that the SINEMA intervention would be more effective in improving blood pressure (BP) control and other health outcomes than usual care among stroke patients. To test this hypothesis, we conducted a cluster-randomized controlled trial in Northern China.

Methods

Trial design

The SINEMA study was an open-label, two-arm, cluster-randomized controlled trial with blinded assessment and analysis. We chose cluster-randomized design to implement the intervention at the cluster (village) level. Such a design could reduce contamination within clusters and enhance the feasibility of implementation. Over a 1-year period in preparation for the trial, we conducted extensive contextual field research on intervention design, technology development, and a 3-month pilot study in 4 villages [15,18,19]. We then conducted the main trial in 50 rural villages in rural China to evaluate the effectiveness of the intervention with embedded process evaluation and economic evaluation. Duration of the intervention was 12 months. The trial was registered on clinicaltrials.gov (NCT03185858). The study is reported according to the CONSORT guidance for reporting cluster-randomized trial (S1 Checklist) [20]. The trial protocol, technological development, and statistical analysis plan were published in detail [15,18,19,21]. We describe a condensed version below.

Study setting and participants

The study was conducted in a rural region of Hebei Province, Northern China, where the incidence of stroke was 236.2 per 100,000 population, more than double the national average (109.7 per 100,000 population) [16,22]. In rural China, there is a 3-tier healthcare system including village clinics, township healthcare centers, and county hospitals [23,24]. Village clinics and township healthcare centers form the rural primary healthcare system and provide both general clinical care and the National Basic Public Health Services Program to residents in the region [23,25]. Village doctors who are not board-certified physicians but government-sponsored primary healthcare providers practice in village clinics. In general, they have high school or equivalent education with prescription rights for medicines in provincial essential medicine formularies. They are managed by and receive their supply from township healthcare centers. Although substantial investment and efforts had been made in primary healthcare strengthening since the Chinese healthcare reform in 2009, the resources remained substantially constrained, the quality of care is still suboptimal, and the utilization of primary care services has decreased [23–25].

In our study, eligible clusters were villages with a minimum population size of 1,500 and at least 1 village doctor who was willing to participate. The research team screened the eligible clusters among 218 villages from 8 townships in the region and selected 60 potentially eligible villages from 5 townships (as strata) where there were at least 10 clusters for further screening and recruitment. The main participant inclusion criteria were adults with a history of stroke diagnosed at the county- or higher-level hospitals and in a clinically stable condition with at least basic communication ability. Patients who were unable to get out of bed, had severe life-threatening diseases, or an expected life span shorter than 6 months were excluded. To ensure generalizability, mobile phone ownership or technology literacy was not a criterion for patient recruitment. Village doctors screened and invited potentially eligible patients in their villages to participate in the study. The research team conducted the final recruitment and consent process.

Randomization and masking

Eligible villages were randomized in a 1:1 ratio to the intervention or the control arm with stratification by the township. A biostatistician who was not part of the study performed the randomization using a computer-generated random numbering system. Randomization allocation was not revealed to any staff during patient recruitment and assessment. Village doctors were informed only after patients’ baseline assessments were completed. Given the nature of the intervention, patients and health providers were not blinded to intervention assignment. Outcome assessors were kept unaware of the trial protocol and blinded throughout the study period to ensure the objectivity of assessment. Statisticians who were masked to intervention allocation conducted all statistical analyses, and allocation status was not revealed until all results were generated.

Procedures

The SINEMA intervention package was developed with careful contextual research and pilot study lasting for 1-year long. The contents were consistent with China’s clinical guidelines for stroke prevention in a primary care setting [26] and tailored to the local context with special intervention focus on medication adherence and physical activities by considering the capacity and available resources [18,19]. In brief, the intervention included both provider-side components and patient-facing components and were supported by a digital health system consisted of an Android-based smart phone application—SINEMA App—for providers and linked with a voice messages system for patients (see S1 Fig for a diagram depicting the intervention design). The SINEMA App has been designed for multiple end-users including village doctors and township and county physicians and included multiple modules including patients’ profiles, follow-up visits, training, performance indicators, and follow-up visits reminders [19]. Aided by the SINEMA App, village doctors could collect, record, and retrieve patients’ information and follow-up history, and physicians from upper-tier hospitals could review the records and monitoring village doctors’ performance. The digital health system was linked with a third-party dispatching platform and a message bank containing more than 180 messages that we codesigned with clinical experts and local healthcare providers. These messages followed the same structure, was recorded in the local dialect, and were dispatched daily with different contents to participants. More detailed description on the development of the intervention package and digital health system could be found in previous publications [15,18,19].

After allocation of randomization, village doctors in the intervention arm were invited to a 1-day training session delivered by county hospital physicians who were trained by neurologists from a tertiary hospital. The training session covered the evidence-based use of essential medicines, skills for promoting patients’ behavior changes, and the use of SINEMA App. Each village doctor was also provided with a written intervention manual and an Android smartphone with the SINEMA App installed to support intervention delivery. Android instead of iOS (iPhone) was the smartphone operating system of choice due to its lower cost and widespread use among village doctors. A refresh training session was provided at the third month.

During the 12 months of the intervention period, village doctors delivered monthly follow-up visits to participants at the village clinics or participants’ homes, according to the standardized interventional plan. The follow-up visits covered BP monitoring, stroke symptom review, medication use assessment, and health education with a focus on medication adherence and physical activity. These 2 aspects were emphasized because our contextual research in the study region showed the importance of these behaviors among our study population and feasibility to intervene. Consistent with stroke management guidelines, [26] emphases on medication use were placed on 3 types of medicines (antiplatelet, statin, and antihypertensive). Village doctors were aided by the flow laid out in the SINEMA App to follow the standardized procedures. In each monthly follow-up visit, they gave participants a standardized single-sheet picture-rich handout listing their medications and exercise goals as a tool to illustrate the personalized recommendations. There was no cost for follow-up visits, but the cost of medications was borne primarily by the participants with partial coverage by social insurance, in consideration of the local norms and the need for sustainability and scalability.

Village doctors were provided with quarterly performance-based financial payment based on the quantity of services and bonuses for the top 5 village doctors determined by performance indicators that were generated from the SINEMA App and quality control measures provided by township physicians. Village doctors were encouraged to communicate with peers and township physicians through the App, phone calls, and the study’s virtual groups to share experience, seek clinical support, and provide feedback.

In addition to follow-up visits, participants who had access to their own or shared cell phones received 1 daily voice message at no cost to them over 12 months. Many patients were illiterate or not used to receive text messages even if they could read. Our pilot study in 4 villages found that voice calls were preferred over text messages [18]. Therefore, according to an algorithm designed based on our field research and pilot testing, [18] short voice messages—recorded in the local dialect—were automatically dispatched every morning with particular emphases on reminders and tips for medication adherence and physical activity.

In villages randomly assigned to the control arm, participants received usual care and village doctors continued their existing general clinical practices and the Basic Public Health Services. In the context of rural China, usual care involved patients seeking care in village clinics, township healthcare centers, or county hospitals, as needed. Some participants may also receive quarterly follow-up visits by village doctors if they had hypertension or diabetes, and receive general health education as such health promotion activities covered by the Basic Public Health Services were implemented widely across China [24].

Outcomes

The primary outcome for patients was the 12-month change in systolic BP, analyzed as the difference between arms in the 12-month change in systolic BP from baseline to 12-month follow-up. The relatively short intervention duration and small sample size precluded the choice of stroke as the primary outcome. Systolic BP was chosen due to its well-established and significant impact on stroke recurrence and other cardiovascular events [16]. There were 7 prespecified secondary outcomes: diastolic BP, mobility functioning measured by the “timed up and go” test [27], physical activity based on the short-form International Physical Activity Questionnaire [28], health-related quality of life assessed by the EuroQol-5 Dimension-5L [29], and self-reported medication adherence to antiplatelet, statin, and antihypertensive measured separately by the 4-item Morisky Green Levine Scale [30]. Four prespecified exploratory outcomes included stroke recurrence and hospitalization, disability (modified Rankin Scale) [31], and mortality collected from questionnaires and medical and death records.

Outcome assessors were staff members from the Center for Disease Control and Prevention in a nearby county who were not involved in any of the program implementation. They were blinded on the intervention allocation and trained to follow a standard protocol to measure outcomes in exactly the same way in all villages and for all participants at baseline and 12 months. Data on patients’ self-reported information were collected through face-to-face interviews and recorded in an online survey platform (Qualtrics, Provo, Utah), with built-in skip patterns, logic checks, and quality control. BP was measured on the right upper arm with participants seated and after 5 minutes of rest, with an electronic BP monitor (Omron HEM-7052), validated by the European Society of Hypertension. Two measurements were taken. If the difference between the 2 systolic BP measures was larger than 10 mm Hg, a third measurement was conducted. The mean value of the only or the last 2 readings was used in all analyses.

Sample size calculation and statistical analysis

We estimated that a sample of 1,250 prevalent stroke patients in 50 villages (with 25 villages per arm and on average 25 patients per village) would provide 83% power at a two-tailed 5% significance level to detect a 5-mm Hg mean difference in 1-year change of systolic BP between the intervention and control arms [32]. This estimation considered the cluster design and assumed a loss of 2 clusters per arm and loss of 1 patient per village, a standard deviation of change of 25 mm Hg, and an intracluster correlation coefficient of change of 0.04.

Analyses were conducted in the intention-to-treat framework, and all analyses were at an individual level with clusters and stratified design taken into account by following the prepublished statistical analysis plan [21]. The main analysis (minimally adjusted) compared the 1-year change in systolic BP between the intervention and control arms by using a mixed-effect model with a random intercept for the cluster (village) and a fixed effect for townships to account for the stratified design, baseline systolic BP, age, and sex. Restricted maximum likelihood was used together with the between-within method to calculate degrees of freedom [33]. Outliers were removed from change in systolic BP based on an a priori decision to remove those values which were more than 2 interquartile ranges above the third quartile or below the first quartile of the distribution [21]. Four types of sensitivity analyses were performed through changes to the minimally adjusted primary analysis model: (1) adjusting for baseline covariates that were identified as being imbalanced between the 2 arms or associated with lost-to-follow-up (fully adjusted analyses); (2) adjusting for covariates that were associated with baseline imbalance only; (3) adjusting for covariates that were associated with lost-to-follow-up only; and (4) with outliers included. We performed prespecified subgroup analyses (age, education, and duration since stroke event) by adding the subgroup variable and its interaction term with the intervention as fixed effects to the minimally adjusted model used in the main analysis.

Analysis of secondary and exploratory outcomes adopted a similar approach for the minimally adjusted models, fully adjusted models, and other sensitivity analyses. For continuous outcomes, the same mixed-effect modeling approach was used as described above. For binary outcome variables, the generalized estimating equation approach was used to obtain population-averaged intervention effects using a Poisson model with log-link and robust standard errors in order to obtain risk ratios [34,35]. An independent working correlation matrix was pre-specified because it was expected to provide greater stability when the cluster sizes were variable. In addition to all prespecified analyses in the statistical analysis plan [21], post hoc analysis on BP control rate (considering both systolic BP and diastolic BP) was also conducted to further estimate the clinical importance of the intervention. Risk differences for binary outcomes are computed directly from the outcome percentages at follow-up. All analyses were conducted in Stata version 15.1 (StataCorp, College Station, Texas) and were replicated by an independent statistician blinded to the results reported from Stata, using the R software (version 3.5.2) with the package of geeM [36] and Ime4 [37].

Ethical statement

The study was approved by the Institutional Review Boards at Duke University, USA, Beijing Tiantan Hospital, and Duke Kunshan University, China. All participants (both providers and patients) provided written informed consent before participation. Cluster-level consent was provided by opinion leaders in the townships and villages.

Results

Recruitment and follow-up of study population

Among 8 townships, we invited 5 townships where there were enough potentially eligible clusters to participate in the study and 60 village doctors performed eligibility screening among a total of 2,333 stroke patients from 60 villages (Fig 1). After excluding 10 ineligible villages and people who did not meet the inclusion criteria from the remaining villages, we recruited 50 villages with a total of 1,299 patients in the trial between June 23 and July 21, 2017. These 50 villages were randomized into the intervention arm (25 villages, 637 patients, and mean cluster size 25.5 patients per village [standard deviation–SD 3.2] and the control arm (25 villages, 662 patients, and mean cluster size 26.5 [SD 2.7]). After excluding those who died during the follow-up (n = 30, 2.3%) or lost to follow-up (n = 43, 3.3%), the final analyses included 1,226 participants.

[Figure omitted. See PDF.]

Fig 1. Flow diagram of trial participants.

https://doi.org/10.1371/journal.pmed.1003582.g001

Baseline characteristics at patient and cluster level

Baseline characteristics at the patient level are summarized in Table 1 and at the cluster and village doctor levels in S1 Table. For each of these 3 levels, the intervention and control arms were generally comparable. Patients in our trial were older adults (mean [SD] age 65.6 [8.2] years) who had low educational level (71.2% with no schooling or only a primary school education). The vast majority of participants (86.1%) had an ischemic stroke and had living with stroke for a median of 5.3 years (interquartile: 2.3 years, 9.8 years). Participants who died or were lost to follow-up (n = 73) were more likely (p < 0.05) to be male, younger, a current or former smoker, and in the control arm, and to have higher total family income and lower systolic BP at baseline (S2 Table).

[Figure omitted. See PDF.]

Table 1. Baseline characteristics for the SINEMA trial at the patient level.

https://doi.org/10.1371/journal.pmed.1003582.t001

Implementation fidelity and program delivery cost

The intervention was implemented with relatively high fidelity to the study protocol (S3 Table). All village doctors participated in the training adopted the SINEMA App for follow-up visits and utilized the support mechanisms. About 90.5% participants received 12 follow-up visits as planned. The daily voice messages were dispatched to 80.4% of participants in the intervention arm with access to cell phones, and on any given day, half (49.7%) of dispatched voice messages were successfully answered. The estimated annual cost of program delivery was about US$24.3 per patient (S4 Table).

Effect of interventions on primary, secondary, and exploratory outcomes

We observed a modest but significant intervention effect on systolic BP with a greater reduction in mean systolic BP among patients in the intervention arm (−7.1 mm Hg) compared with the control arm (−4.3 mm Hg) (adjusted mean difference: −2.8 mm Hg, 95% confidence interval [CI]: −4.8, −0.9, p = 0.005) within the primary minimally adjusted analytic model. The estimated intracluster correlation for this model was 0.001. The fully adjusted model for the primary outcome of change in systolic BP yielded a slightly higher adjusted mean reduction (−3.3 mm Hg, 95% CI: −5.2, −1.4) (Table 2). Results were robust and consistent within each level of the prespecific binary subgroup variables with exceptions of males (−0.3 mm Hg, 95% CI: −2.8, 2.2) and those less than 65 years old (−2.0 mm Hg, 95% CI: −5.1, 1.0) for which the between-arm differences were small (Fig 2). The additional analysis on BP control revealed that the intervention resulted in a 19% (95% CI: 8%, 30%) relative increase in the proportion of patients reaching the target of BP control (systolic BP < 140 mm Hg and diastolic BP < 90 mm Hg) (S5 Table).

[Figure omitted. See PDF.]

Fig 2. The adjusted mean difference in change in systolic blood pressure for the total population and by prespecified subgroups.

https://doi.org/10.1371/journal.pmed.1003582.g002

[Figure omitted. See PDF.]

Table 2. Minimally adjusted and fully adjusted results on primary, secondary, and exploratory outcomes.

https://doi.org/10.1371/journal.pmed.1003582.t002

We observed significant and meaningful beneficial effects of the intervention on 6 out of 7 prespecified secondary outcomes with a significantly greater reduction in diastolic BP, improvement in health-related quality of life, performance in “timed up and go” test, physical activity level, and medication adherence to statin and antihypertensives in the intervention arm (Table 2). The intervention arm also brought significantly fewer number of events in stroke recurrence (4.4% versus 9.3%; risk ratio [RR] = 0.46, 95% CI 0.32, 0.66; risk difference [RD] = 4.9 percentage points [pp]), hospitalization (4.4% versus 9.3%; RR = 0.45, 95% CI 0.32, 0.62; RD = 4.9 pp), disability (20.9% versus 30.2%; RR = 0.65, 95% CI 0.53, 0.79; RD = 9.3 pp), and death (1.8% versus 3.1%; RR = 0.52, 95% CI 0.28, 0.96; RD = 1.3 pp. Results were consistent in 3 additional sets of sensitivity analyses (S6 Table).

Discussion

Principal findings and interpretations

In this cluster-randomised controlled trial conducted among stroke patients in rural China, BP control was significantly improved through the primary care-based integrated mHealth intervention. The intervention also improved 6 out of 7 prespecified secondary outcomes and all exploratory outcomes on stroke recurrence, hospitalization, disability, and mortality, at an annual cost of less than US$24 per patient.

The intervention group experienced a 7.1-mm Hg reduction in the primary outcome of systolic BP, and the control group also had a 4.3-mm Hg reduction; thus, the magnitude of the net between-group difference was modest (−2.8 mm Hg). Plausible explanations for this finding included (1) a deliberate interventional design that relied on existing resources, e.g., not providing free medicines like previous trials [4]; (2) the lower BP level of 145.9 mm Hg and higher treatment rate (79.3%) at baseline compared to other trials [4,6]; and (3) improved implementation of the government-funded nationwide basic public health services [23,24] leading to the considerable reduction in the control group. Although the observed difference of 2.8 mm Hg was smaller than the 5-mm Hg estimate in the a priori power calculation, it was statistically significant (p = 0.005), possibly due to the smaller than hypothesized intracluster correlation coefficient or smaller than hypothesized standard deviation. More importantly, even a net reduction of only 2 mm Hg in systolic BP is clinically meaningful as ample research has shown that it can lead to a 7% to 10% decrease in fatal and nonfatal cardiovascular risks [38–40]. Additionally, our study was not a BP trial but a multicomponent stroke management trial with BP instead of stroke as the primary outcome due to the relatively short intervention duration of 1 year. Consistent results in systolic BP from sensitivity analyses and large effects on behavioral, functioning, and hard clinical outcomes were reassuring.

Quality of care improvement at the primary care level for chronic diseases management is a global challenge, especially for resource-limited settings. Rural China bears disproportionately high burdens of stroke, lacks capacity in delivering stroke care among community-dwelling patients, and encounters barriers in quality improvements at both the health system and individual levels [16,22]. Our study findings suggested that the benefit of the primary care mHealth-integrated intervention could be far beyond BP reduction alone, as demonstrated in the results on physical functioning, and even reduction in hospitalization and mortality. Although we were not able to pinpoint the mechanism of impact on these outcomes, the consistently significant results in stroke events, hospitalization, and mortality were potentially due to our practical and integrated intervention that addressed multiple domains. In line with previous literature [4,8,11], the training sessions, ongoing system-level technical support, and mHealth technological enablement improved the capacity of primary healthcare providers and the financial and nonfinancial incentives motivated them to provide evidence-based care. As the goalkeepers living within the community, providing monthly follow-up visits through village doctors was feasible and sustainable. The maintenance of the behavior changes was further strengthened through low-cost automated daily voice messages sent directly to patients. Such an intervention model is designed to be applicable to other NCDs and with high potential to be adapted to other LMICs settings for strengthening the capacity of the primary healthcare system in chronic disease management.

Comparison with other studies

Different from other recent trials in LMICs that have shown the effectiveness of multicomponent interventions in hypertension and NCD control [4–6], our trial has 2 parallel features that synergistically supported each other and ensured the scalability and sustainability of the intervention. First, our primary care-based intervention was delivered by existing health workforce with system-level support and performance-based incentives. Instead of introducing new health workforces, we relied on primary care providers in the public sector who were already part of the primary care infrastructure. The quality of care they provided to stroke patients was improved through carefully designed evidence-based measures including training and ongoing support, mHealth technology, and incentives, which addressed existing challenges [23] and were in line with current guidelines [26].

Second, the intervention integrated provision of mHealth technology for both providers (village doctors and township physicians) and stroke patients. Compared to other stand-alone mHealth studies with inconsistent results [9,10], the SINEMA intervention was predominantly a primary care-based model emphasizing provider–patient interactions that were empowered via technologies. The Android-based App assisted village doctors by guiding follow-up visit procedures, collecting and storing related information, and managing the follow-up schedules and also shared the information with township physicians for quality control and monitoring. The step-to-step guidance and patients’ BP history and other information contained in the App may improve village doctors’ behaviors in prescribing evidence-based medicines and their communication with patients on adherence to treatment and lifestyle modifications. The automated voice messaging system dispatched a sizable amount of health education messages and reminders to patients that could not be achieved by traditional labor-intensive approaches. These voice messages provided suggestions and reminders on medication adherence and physical activities, which were consistent with the focus of the follow-up visits provided by village doctors and may reinforce the maintenance of behavior changes. The integrated mHealth system not only created new channels of communication and information flow in an effective and smart approach but also enhanced the effectiveness of human-delivered intervention components by removing barriers and reinforcing the maintenance of behavior changes among both providers and patients. Although we could not pinpoint the specific quantitative contributions of the integrated mHealth component in our study, our qualitative research provided evidence that the mHealth technology as an integral part of the package was well accepted and enhanced the effectiveness of the overall intervention.

Our intervention is different from previous studies as it targeted and reached a general village-dwelling population who had stroke for a relatively long term. Our participants had a median of 5 years duration living with stroke, 69.1% had been aware of having hypertension at baseline, and 37.2% self-reported that they were a current or former smoker. These characteristics of our participants are similar to those reported in the national registration of stroke survivors in rural China [41]. Such target population also distinguished our study from some of the existing hospital-oriented strategies of improving the care among stroke survivors who are recently discharged from the hospitals [41,42].

Strengths and limitations

This trial has many strengths. First, it was designed on the bases of previous trials in rural China [12,13] and extensive field research for contextualization and adaption of the SINEMA model to local settings [15,18,19]. Second, it was rigorously implemented, including high recruitment rate with minimal loss to follow-up; satisfactory protocol fidelity; and independent standardized outcome assessment. Third, randomization and data analyses were performed by experienced biostatisticians in the United States who were not involved in trial implementation. Lastly, the report of study findings in this paper is in line with the prespecified and prepublished trial design [15] and statistical analysis plan [21].

Our study also has limitations. First, it was conducted in one province in Northern China, which may limit the generalizability of the study findings. However, our study population are similar to the national registered population, and our findings are relevant not only to rural China but other resource-limited settings as the intervention model is potentially feasible to scale-up to blood pressure or stroke management in other settings. Importantly, the adaptation of these strategies to local contexts is indispensable. For example, village doctors are best suited to deliver the intervention in rural China, while in other LMICs countries, collaborations between general practitioners and community health workers are necessary. We have been working with local and national governments in China to replicate the intervention with scale-up trial and also have assessed the feasibility of the intervention approach in other LMICs to provide more evidence on the generalizability [43–45]. Second, the trial was only 1 year long, and it was not powered for subgroup analyses, so larger studies are needed for better understanding of subgroup differences and long-term impacts. Third, we could not assess the independent contributions of each component and fully capture the mechanism of change due to the nature of the complex intervention design. We have conducted process evaluation through quarterly qualitative interviews among both providers and patients. Results from the process evaluation will be presented in a separate full-length manuscript to provide a deeper overview on the facilitators and barriers related to the intervention reach, adoption, implementation and effectiveness, and further explanation on the mechanism of impact. Although we have reported the cost of the delivery, we will also report cost-effectiveness modeling in another full-length manuscript.

Implications for policy and future research

Our primary care-based integrated mHealth intervention, rigorously designed and implemented, resulted in a significant decrease in systolic BP, improvement in other health outcomes, and reduction in hospitalization and mortality among stroke patients in rural China. Chronic disease management requires continuous reliance on primary care, especially when the entire healthcare system is threatened by new global health crises such as the Coronavirus Disease 2019 (COVID-19). Our trial, conducted in the pre-COVID era, may have more important implications in the future as effort to strengthen primary care is needed to combat both NCDs and emerging infectious diseases. In LMICs where resources are limited or in low-resource areas in high-income countries, mHealth technology holds the potential to bring disruptive changes to health service delivery, quality improvement, and NCD control owing to its reach, convenience, cost efficiency, and lack of other traditional resources [8,9]. Thus, our SINEMA model, which is primary care-based, integrates provider-side and patient-side mHealth technology, and designed with the principles of sustainability and scalability, has the potential to be applied to other NCDs besides stroke and to other settings in China and globally. If demonstrated to be cost-effectiveness through full economic evaluation, the model may also have great potential to be adapted and scaled up to other settings to expand the health and economic benefits.

Conclusions

Our primary care-based integrated mHealth intervention, rigorously designed and implemented, resulted in a significant decrease in systolic BP, improvement in other health outcomes, and reduction in hospitalization and mortality among stroke patients in rural China. Our low-cost intervention seamlessly combines service delivery by existing primary care workforce with mobile technology that integrates provider- and patient-side measures. If scaled up, it is expected to lead to large health and economic benefits in rural China and with adequate adaptations, potentially also in other resource-limited settings in both LMICs and high-income countries.

Supporting information

S1 Checklist. CONSORT checklist.

https://doi.org/10.1371/journal.pmed.1003582.s001

(DOCX)

S1 Fig. SINEMA intervention diagram.

https://doi.org/10.1371/journal.pmed.1003582.s002

(TIF)

S1 Table. Baseline characteristics for the SINEMA trial at the cluster and provider level.

https://doi.org/10.1371/journal.pmed.1003582.s003

(DOCX)

S2 Table. Baseline characteristics by status on loss to follow-up at the patient level.

https://doi.org/10.1371/journal.pmed.1003582.s004

(DOCX)

S3 Table. Fidelity to the intervention protocol in the 25 intervention villages.

https://doi.org/10.1371/journal.pmed.1003582.s005

(DOCX)

S4 Table. Program delivery costs over 12 months in US dollar.

https://doi.org/10.1371/journal.pmed.1003582.s006

(DOCX)

S5 Table. Sensitivity analysis of systolic blood pressure and diastolic blood pressure as hypertension control.

https://doi.org/10.1371/journal.pmed.1003582.s007

(DOCX)

S6 Table. Sensitivity analysis results on primary, secondary and exploratory outcomes.

https://doi.org/10.1371/journal.pmed.1003582.s008

(DOCX)

Acknowledgments

We would like to thank the independent International Steering Committee Chair (Yangfeng Wu) and members (Eric Peterson and Craig Anderson) and Advisory group members (Alba Amaya-Burns, Allan Burns, Ninghua Wang, Xie Bin, Jesse Hao, Jixiang Ma, Jixin Sun, Jianxin Zhang, Jianmin Yao, Jinmei Liu, Qian Long, and Cheng Sun) who have provided great advice in designing and implementing the study. We would also like to acknowledge collaborators from China Mobile Research Institute (Na Wu, Zhuoran Zhang, Mengyao Chen, Bo Wang, and Nan Ding) and colleagues and students (Erdan Luo, Duan Zhao, Longkai Zang, Peng Bao, Julian Donovan, Heng Jiang, Ying Yang, and Anran Tan) who have contributed to the development of the SINEMA mHealth system and voice messages. We also thank Dejin Dong and his team (Xingtai City Center for Disease Prevention and Control), Zhenli Xu and his team (Nanhe County Center for Disease Prevention and Control), Congxuan Wu and his team (Ren County Center for Disease Prevention and Control), and all staff members from township healthcare centers and village clinics, and all patients who participated or supported the project.

Citation: Yan LL, Gong E, Gu W, Turner EL, Gallis JA, Zhou Y, et al. (2021) Effectiveness of a primary care-based integrated mobile health intervention for stroke management in rural China (SINEMA): A cluster-randomized controlled trial. PLoS Med 18(4): e1003582. https://doi.org/10.1371/journal.pmed.1003582

References

1. Hone T, Macinko J, Millett C. Revisiting Alma-Ata: what is the role of primary health care in achieving the Sustainable Development Goals? Lancet. 2018;392(10156):1461–72. pmid:30343860

2. Naghavi M, Abajobir AA, Abbafati C, Abbas KM, Abd-Allah F, Abera SF, et al. Global, regional, and national age-sex specific mortality for 264 causes of death, 1980–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet. 2017;390(10100):1151–210. pmid:28919116

3. Bitton A, Fifield J, Ratcliffe H, Karlage A, Wang H, Veillard JH, et al. Primary healthcare system performance in low-income and middle-income countries: a scoping review of the evidence from 2010 to 2017. BMJ Glob Health. 2019;4(Suppl 8):e001551–e. pmid:31478028.

4. Schwalm J-D, McCready T, Lopez-Jaramillo P, Yusoff K, Attaran A, Lamelas P, et al. A community-based comprehensive intervention to reduce cardiovascular risk in hypertension (HOPE 4): a cluster-randomised controlled trial. Lancet. 2019;394(10205):1231–42. pmid:31488369

5. Jafar TH, Gandhi M, de Silva HA, Jehan I, Naheed A, Finkelstein EA, et al. A Community-Based Intervention for Managing Hypertension in Rural South Asia. N Engl J Med. 2020;382(8):717–26. pmid:32074419.

6. He J, Irazola V, Mills KT, Poggio R, Beratarrechea A, Dolan J, et al. Effect of a community health worker–led multicomponent intervention on blood pressure control in low-income patients in Argentina: a randomized clinical trial. JAMA. 2017;318(11):1016–25. pmid:28975305

7. Owolabi Mayowa O, Gebregziabher M, Akinyemi Rufus O, Akinyemi Joshua O, Akpa O, Olaniyan O, et al. Randomized Trial of an Intervention to Improve Blood Pressure Control in Stroke Survivors. Circ Cardiovasc Qual Outcomes. 2019;12(12):e005904. pmid:31805787

8. Peiris D, Praveen D, Johnson C, Mogulluru K. Use of mHealth Systems and Tools for Non-Communicable Diseases in Low- and Middle-Income Countries: a Systematic Review. J Cardiovasc Transl Res. 2014;7(8):677–91. pmid:25209729

9. Marcolino MS, Oliveira JAQ, D’Agostino M, Ribeiro AL, Alkmim MBM, Novillo-Ortiz D. The Impact of mHealth Interventions: Systematic Review of Systematic Reviews. JMIR Mhealth Uhealth. 2018;6(1):e23. pmid:29343463; PubMed Central PMCID: PMC5792697.

10. Xiong S, Berkhouse H, Schooler M, Pu W, Sun A, Gong E, et al. Effectiveness of mHealth interventions in improving medication adherence among people with hypertension: a systematic review. Curr Hypertens Rep. 2018;20(10):86. pmid:30088110

11. Winters N, Langer L, Nduku P, Robson J, O’Donovan J, Maulik P, et al. Using mobile technologies to support the training of community health workers in low-income and middle-income countries: mapping the evidence. BMJ Glob Health. 2019;4(4):e001421. pmid:31413872

12. Yan LL, Fang W, Delong E, Neal B, Peterson ED, Huang Y, et al. Population impact of a high cardiovascular risk management program delivered by village doctors in rural China: design and rationale of a large, cluster-randomized controlled trial. BMC Public Health. 2014;14(1):345. pmid:24721435

13. Tian M, Ajay V, Dunzhu D, Hameed S, Li X, Liu Z, et al. A cluster-randomized controlled trial of a simplified multifaceted management program for individuals at high cardiovascular risk (SimCard Trial) in Rural Tibet, China, and Haryana. India Circulation. 2015;132(9):815–24. pmid:26187183

14. Chen S, Gong E, Kazi DS, Gates AB, Bai R, Fu H, et al. Using mobile health intervention to improve secondary prevention of coronary heart diseases in China: mixed-methods feasibility study. JMIR Mhealth Uhealth. 2018;6(1):e9. pmid:29371178

15. Gong E, Gu W, Sun C, Turner EL, Zhou Y, Li Z, et al. System-integrated technology-enabled model of care to improve the health of stroke patients in rural China: protocol for SINEMA—a cluster-randomized controlled trial. Am Heart J. 2019;207:27–39. pmid:30408621

16. Wu S, Wu B, Liu M, Chen Z, Wang W, Anderson CS, et al. Stroke in China: advances and challenges in epidemiology, prevention, and management. Lancet Neurol. 2019;18(4):394–405. pmid:30878104

17. Li Z, Jiang Y, Li H, Xian Y, Wang Y. China’s response to the rising stroke burden. BMJ. 2019;364:l879. pmid:30819725

18. Gong E, Gu W, Luo E, Tan L, Donovan J, Sun C, et al. Development and Local Contextualization of Mobile Health Messages for Enhancing Disease Management Among Community-Dwelling Stroke Patients in Rural China: Multimethod Study. JMIR Mhealth Uhealth. 2019;7(12):e15758. pmid:31845901

19. Wu N, Gong E, Wang B, Gu W, Ding N, Zhang Z, et al. A Smart and Multifaceted Mobile Health System for Delivering Evidence-Based Secondary Prevention of Stroke in Rural China: Design, Development, and Feasibility Study. JMIR Mhealth Uhealth. 2019;7(7):e13503. Epub 2019/07/22. pmid:31325288; PubMed Central PMCID: PMC6676792.

20. Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661. Epub 2012/09/07. pmid:22951546.

21. Gong E, Yan LL, McCormack K, Gallis JA, Bettger JP, Turner EL. System-integrated technology-enabled model of care (SINEMA) to improve the health of stroke patients in rural China: Statistical analysis plan for a cluster-randomized controlled trial. Int J Stroke. 2019;14(2):226–30. pmid:31462178

22. Xu G, Ma M, Liu X. Hankey GJ. Is there a stroke belt in China and why? Stroke. 2013;44(7):1775–83. pmid:23674531

23. Li X, Krumholz HM, Yip W, Cheng KK, De Maeseneer J, Meng Q, et al. Quality of primary health care in China: challenges and recommendations. Lancet. 2020;395(10239):1802–12. Epub 2020/06/09. pmid:32505251; PubMed Central PMCID: PMC7272159.

24. Yuan B, Balabanova D, Gao J, Tang S, Guo Y. Strengthening public health services to achieve universal health coverage in China. BMJ. 2019;365:l2358. pmid:31227480

25. Liu Q, Wang B, Kong Y, Cheng K. China’s primary health-care reform. Lancet. 2011;377(9783):2064–6. pmid:21453962

26. Wang Y. Chinese guideline for cerebrovascular disease management in primary healthcare settings: Peking Union Medical College Press; 2016.

27. Mathias S, Nayak U, Isaacs B. Balance in elderly patients: the" get-up and go" test. Arch Phys Med Rehabil. 1986;67(6):387–9. pmid:3487300

28. Macfarlane DJ, Lee CC, Ho EY, Chan K, Chan DT. Reliability and validity of the Chinese version of IPAQ (short, last 7 days). J Sci Med Sport. 2007;10(1):45–51. pmid:16807105

29. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36. pmid:21479777; PubMed Central PMCID: PMC3220807.

30. Morisky DE, Green LW, Levine DM. Concurrent and predictive validity of a self-reported measure of medication adherence. Med Care. 1986;24(1):67–74. pmid:3945130

31. Banks Jamie L, Marotta CA. Outcomes Validity and Reliability of the Modified Rankin Scale: Implications for Stroke Clinical Trials. Stroke. 2007;38(3):1091–6. pmid:17272767

32. Hayes RJ, Moulton LH. Chapter 7 Sample Size. Cluster randomised trials: Chapman and Hall/CRC; 2017.

33. Li P, Redden DT. Comparing denominator degrees of freedom approximations for the generalized linear mixed model in analyzing binary outcome in small sample cluster-randomized trials. BMC Med Res Methodol. 2015;15(1):38. pmid:25899170

34. Zou G, Donner A. Extension of the modified Poisson regression model to prospective studies with correlated binary co. Stat Methods Med Res. 2013;22(6):661–70. pmid:22072596

35. Gallis JA, Turner EL. Relative measures of association for binary outcomes: Challenges and recommendations for the global health researcher. Ann Glob Health. 2019;85(1):137. pmid:31807416

36. Bates D, Maechler M, Bolker B, Walker S. Fitting Linear Mixed-Effects Models Using Ime4. J Stat Softw. 2015;67(1):1–48.

37. McDaniel LS, Henderson NC, Rathouz PJ. Fast pure R implementation of GEE: application of the Matrix Package. R J. 2013;5(1):181–7. pmid:25587394

38. Psaty BM, Lumley T, Furberg CD, Schellenbaum G, Pahor M, Alderman MH, et al. Health Outcomes Associated With Various Antihypertensive Therapies Used as First-Line AgentsA Network Meta-analysis. JAMA. 2003;289(19):2534–44. pmid:12759325

39. Rashid P, Leonardi-Bee J, Bath P. Blood pressure reduction and secondary prevention of stroke and other vascular events: a systematic review. Stroke. 2003;34(11):2741–8. pmid:14576382

40. Ettehad D, Emdin CA, Kiran A, Anderson SG, Callender T, Emberson J, et al. Blood pressure lowering for prevention of cardiovascular disease and death: a systematic review and meta-analysis. Lancet. 2016;387(10022):957–67. pmid:26724178

41. Wang Y-J, Li Z-X, Gu H-Q, Zhai Y, Jiang Y, Zhao X-Q, et al. China Stroke Statistics 2019: A Report From the National Center for Healthcare Quality Management in Neurological Diseases, China National Clinical Research Center for Neurological Diseases, the Chinese Stroke Association, National Center for Chronic and Non-communicable Disease Control and Prevention, Chinese Center for Disease Control and Prevention and Institute for Global Neuroscience and Stroke Collaborations. Stroke Vasc Neurol. 2020;5(3):211–39. pmid:32826385

42. Wang Y, Li Z, Zhao X, Wang C, Wang X, Wang D, et al. Effect of a multifaceted quality improvement intervention on hospital personnel adherence to performance measures in patients with acute ischemic stroke in china: A randomized clinical trial. JAMA. 2018;320(3):245–54. pmid:29959443

43. Gong E, Lu H, Shao S, Tao X, Peoples N, Kohrt BA, et al. Feasibility assessment of invigorating grassrooTs primary healthcare for prevention and management of cardiometabolic diseases in resource-limited settings in China, Kenya, Nepal, Vietnam (the FAITH study): rationale and design. Glob Health Res Policy. 2019;4(1):1–9. pmid:31742234

44. Ni Z, Atluri N, Shaw RJ, Tan J, Khan K, Merk H, et al. Evaluating the Feasibility and Acceptability of a Mobile Health–Based Female Community Health Volunteer Program for Hypertension Control in Rural Nepal: Cross-Sectional Study. JMIR Mhealth Uhealth. 2020;8(3):e15419. pmid:32149712

45. Hanh TTD, Ngoc LB, Hoa LN, Gong E, Tao X, Yan LL, et al. Improving prevention of cardiovascular diseases: Barriers and facilitators in primary care services in Vietnam. Int J Healthc Manag. 2020:1–9.