Introduction
Background
The critical need to enhance Zambia’s health care workforce, particularly involving doctors, nurses, and other health care workers (HCWs), is driven by a substantial shortage of qualified HCWs. In this study, we define HCWs as individuals whose primary professional goal is to maintain or enhance the health of others, including those who provide patient care and diagnostic and treatment services across various clinical settings. The scarcity of HCWs is particularly acute in Zambia’s rural areas, highlighting the importance of addressing this issue to ensure equitable access to health care and improved health outcomes across the country. Addressing this HCWs deficit is essential for enhancing public health outcomes and providing equitable care across the country. Exacerbating this situation are infrastructural obstacles such as the protracted process of developing educational facilities. The convergence of these factors impedes the capacity expansion and the enhancement of health profession training quality. Consequently, addressing these constraints is vital for improving public health outcomes and fostering a robust HCW workforce. These constraints contribute to adverse public health outcomes, including compromised disease treatment efficacy, increased child mortality, and poor maternal health [1]. In 2002, Zambia introduced medical licentiate practitioners (MLPs) through an initial 3-year diploma program, followed by a 2-year medical licentiate, to address the shortage of qualified HCWs, particularly in rural areas, and to upgrade the health care delivery scope of existing clinical officers. MLPs, who have a distinct role compared with traditional medical graduates, now complete a 4-year training program, for example, at the Levy Mwanawasa Medical University (LMMU), earning a Bachelor of Science (BSc) in clinical science [2-4]. This specialized training enables MLPs to perform a limited number of emergency surgeries, including cesarean sections, and to prescribe medications [2]. Their education focuses on 4 primary disciplines that align with the country’s health priorities, particularly in rural areas: surgery, pediatrics, obstetrics and gynecology, and internal medicine [3,4]. The MLP training program comprises a balanced structure, including 2 years of theoretical instruction followed by 2 years of hands-on skills training acquired through rotational assignments at a diverse range of hospitals and health clinics across Zambia.
In low-resource learning environments, such as Zambia, e-learning and self-directed internet materials play a crucial role in overcoming the challenges posed by the scarcity of qualified HCWs, limited infrastructure, and constrained budgets. e-Learning allows for the expansion and enhancement of medical education by providing students with access to up-to-date information and resources regardless of their location. This approach is particularly beneficial for students in rural areas, where there may be a lack of qualified medical educators, limited access to learning resources, and inadequate infrastructure to support traditional face-to-face instruction [3,5].
Furthermore, self-directed internet materials encourage learners to take charge of their own education, allowing them to study at their own pace and focus on the topics most relevant to their professional development. This flexibility is crucial in low-resource settings, where e-learning can provide access to up-to-date information, reducing the reliance on on-site classes in areas facing a shortage of medical educators [3-5].
The integration of e-learning and self-directed internet materials into medical education programs in low-resource settings can help bridge the gap between theoretical knowledge and practical application, thus improving the overall quality of health care [6-8]. For example, virtual patient (VP) scenarios can provide students with a more interactive and engaging learning experience, enhancing their clinical reasoning skills and compensating for the scarcity of senior HCWs for face-to-face training [9]. By leveraging e-learning and self-directed internet materials, medical education programs in low-resource settings can better prepare students for the challenges they will face in their professional careers, ultimately leading to improved health care outcomes.
Interactive Medical Learning Through VPs
VPs are defined by the American Association of Medical Colleges as “a specific type of computer-based program that simulates real-life clinical scenarios” [10]. VPs offer the advantage of addressing multiple cognitive levels while enhancing the learning experience through supplementary channels such as visual and auditory information. Students may develop clinical reasoning skills by using VPs, which bridge the gap between theoretical clinical knowledge and practical clinical application [3-5]. Assuming the role of a clinician, VPs enable students to practice diagnostic, treatment, and follow-up procedures. This approach may bolster student motivation as they become more aware of the importance of practice [10-12], rather than solely focusing on academic performance or examination scores [13,14]. A systematic review conducted by Kononowicz et al [11] revealed that VPs are capable of improving skills and knowledge as effectively as, or even surpassing, other prevalent educational methodologies. They observed improvements in clinical reasoning, procedural skills, and a combination of procedural and team skills in both low-income and high-income settings [11]. Bediang et al [15] assessed the impact of VP training on the clinical skills of Cameroonian health care professionals and found that such training could contribute to the advancement of users’ clinical operational skills [15].
In the Zambian context, implementing VPs as a learning resource can help mitigate challenges associated with the shortage of senior medical lecturers and infrastructure limitations. By integrating VPs into the existing e-learning platform, we can provide a more interactive and engaging learning experience, enhance clinical reasoning skills, and compensate for the scarcity of senior HCWs for face-to-face training. Furthermore, VPs can be accessed remotely, allowing students in rural areas or those with limited access to traditional educational resources to benefit from this innovative learning approach [9]. To improve medical education at LMMU within the BSc clinical sciences program, we devised and assessed 2 VP scenarios. VPs could be a highly accepted and effective tool for integration into the existing e-learning platform for MLPs at LMMU, thus expanding the range of digital learning resources available. Our study specifically focused on examining 2 primary research questions that aimed to evaluate the effectiveness and impact of these scenarios on student learning and clinical reasoning skills. By addressing these questions, we sought to provide valuable insights into the potential benefits and limitations of implementing VP scenarios in medical education, particularly within the context of low-resource settings such as Zambia. Outcomes may differ from those in high-income countries because of differences in educational systems, infrastructure, and technological access. Evaluating the potential impact of VPs in a context such as LMMU can inform targeted interventions aimed at enhancing medical education, which may ultimately contribute to improved health care outcomes within such settings.
In the context of LMMU, our study aimed to address two primary research questions: (1) How effectively do VPs contribute to knowledge acquisition in comparison with the traditional learning resources prevalent in Zambia, such as learning from textbooks, using free internet searches, and accessing preselected static resources on a medical e-learning platform? and (2) How does student acceptance of VPs compare with their acceptance of traditional textbooks, internet searches, and a medical e-learning platform as learning tools?
Methods
Overview
We conducted a noninferior, randomized controlled trial with a mixed methods research design (convergent) to evaluate the effectiveness of VPs in terms of acceptance and knowledge acquisition (Figure 1). The analysis team was blinded to the study. The students, who were informed through a flyer distributed beforehand, were aware that the study aimed to investigate VPs as a learning method. The CONSORT (Consolidated Standards of Reporting Trials) checklist was used for reporting this study [16] (for the CONSORT checklist, refer to Multimedia Appendix 1). The study participants were recruited on November 29, 2021, and the study took place on December 10, 2021, at the main campus of LMMU in Lusaka, Zambia. All third- and fourth-year BSc clinical science students aged ≥18 years were eligible to participate in this study.
Randomization, Blinding, and Implementation
The study participants were recruited through digital messaging services, email, and the local university administration. A total of 63 third- and fourth-year BSc clinical science students aged ≥18 years were invited to participate in this study. Randomization was implemented in a 2-step process. Initially, participants were assigned to 1 of the 2 study groups (appendicitis or severe acute malnutrition [SAM]) based on their study ID. Subsequently, within each study group, participants were stratified according to their academic year. We used stratified randomization to guarantee a balanced allocation of participants, considering the stratum of academic year. This procedure ensured an equitable distribution across study groups while addressing potential variations associated with participants’ academic advancement. To maintain the integrity of the study, the data analysis team remained independent of the data collection process. Only third- and fourth-year BSc clinical science students were asked to participate in the study, as they had previously been exposed to the 2 medical topics of appendicitis and SAM during their first 2 years of university training. The learning resources that the students were exposed to are presented in Textbox 1.
Students’ learning resources.
* Severe acute malnutrition (SAM): The VP medical topic was developed using materials from the World Health Organization’s country guidelines on managing SAM in infants and children [17], web-based resources [18,19], and relevant sections from Nelson’s Textbook of Pediatrics [20] (refer to Multimedia Appendix 2 for the detailed VP medical topic).
Both VP medical topics were uploaded to LMMU’s Moodle e-learning platform [3] but remained inaccessible to participants until the day of the trial.
All participants, regardless of their assigned study group, completed a pretest before accessing their designated learning resource for a 30-minute period. After the intervention, a posttest identical to the pretest was administered to all the participants. Furthermore, each participant completed a questionnaire evaluating their acceptance of the respective learning resource (Multimedia Appendix 4). During the entire 4-hour study period, participants were explicitly instructed to refrain from communicating with one another.
Data Collection
To evaluate knowledge acquisition from the 4 learning resources, we administered multiple-choice question (MCQ) tests before (pretest) and after (posttest) the intervention. The appendicitis-related MCQ test comprised 20 questions (maximum score: 1000 points), whereas the SAM-related test contained 15 questions (maximum score: 720 points; refer to Multimedia Appendix 5 for pre- and posttests). Each question was presented with 4 answer options, with 1 correct answer. All the groups received identical questions. An internal pilot study was conducted before the randomized controlled trial to ensure that participants could successfully pass the tests using any of the 4 learning resources. The pilot study involved a small sample of participants (n=6), including students (n=4) and faculty members (n=2), who were not part of the main study. The primary objective of this pilot study was to assess the clarity, comprehensibility, and effectiveness of the study materials, including the questionnaires and VPs. This preliminary testing helped to identify any potential issues, ambiguities, or biases in the questions and to evaluate the overall efficacy of the questionnaire. By addressing these concerns, we aimed to enhance the validity and reliability of the study instruments and, ultimately, the quality of the data collected in the main study.
The pilot study addressed uncertainties regarding the effectiveness and time allocation of the various study methods. This facilitated the refinement of the learning materials and ensured appropriate time durations for each method, allowing for adequate knowledge acquisition. The pilot study also confirmed that each learning resource covered course objectives, preventing participants from focusing solely on pretest questions, and enabled the assessment of pre- and posttest questions to accurately measure knowledge acquisition across learning methods. By integrating the pilot study findings into the main study design, the research team mitigated concerns about the effectiveness of various study methods and the sufficiency of the time allocated for each approach.
The VPs were developed to be consistent with the Zambian context, incorporating relevant resources and guidelines, such as the World Health Organization’s country-specific guidance on managing SAM in infants and children [17], and the curricular standards of LMMU. This method ensured that the VPs were customized to suit the requirements and expectations of BSc clinical science students as well as to address the specific demands of the local health care system.
Acceptance Questionnaire
We assessed the acceptance of the 4 learning resources using a questionnaire adapted from the study by Davis [24] on the technology acceptance model. The technology acceptance model includes six dimensions: (1) perceived usefulness, (2) perceived ease of use, (3) attitude toward use, and (4) behavioral intention to use, (5) job relevance, and (6) perceived enjoyment. The original fifth component (actual system use) was excluded from our study’s questionnaire, as it did not pertain to our research objectives. We incorporated 2 additional dimensions—(5) and (6)—based on the study by Salloum et al [25]. The questionnaire comprised 15 items, with responses recorded on a 5-point Likert scale.
Data Analysis
Before conducting the analyses, we examined all data for normal distribution using the Shapiro-Wilk test. P values < .05 were considered statistically significant. We analyzed both study groups separately. Descriptive statistics including frequency, percentage, mean, median, and SD were used to evaluate the distribution of age, sex, and prior medical knowledge within the groups. Here, prior medical knowledge refers to the participants’ preexisting knowledge specifically related to appendicitis and SAM.
The pre- and posttest outcomes were evaluated through the following analyses:
Ethics Approval, Informed Consent, and Participation
This study was approved by the Heidelberg University Hospital Ethical Committee on August 30, 2021 (S-685/2021) and the LMMU Research Ethics Committee on November 29, 2021 (LMMU-REC 00005/21). We informed all potential and selected participants about the study’s objectives and procedures as well as their right to withdraw at any time without consequences. Before participation, each individual provided written informed consent, ensuring their voluntary involvement in the study.
Results
Demographics
A total of 63 students consented to participate and were included in the study. The mean age of the participants was 39.56 (SD 6.05) years, with age ranging from 22 to 46 years. The sample consisted of 39 male students and 23 female students, with 1 participant identifying as “diverse.” Regarding the participants’ academic progression, 32 were in their third year of study, whereas 31 were in their fourth year (refer to Table 1 for a detailed breakdown).
Table 1. Overview of the study groups’ composition and demographic characteristics (N=63).
| Intervention group | Participants, n | Age (years), mean (SD) | Sex, n (%) | Study year, n (%) | |||||||||
| Female | Male | Diverse | Third | Fourth | |||||||||
| Study group 1—medical topic: severe acute malnutrition (n=32) | |||||||||||||
| Virtual patient | 8 | 29.38 (1.77) | 4 (50) | 4 (50) | 0 (0) | 4 (50) | 4 (50) | ||||||
| Textbook | 8 | 27 (5.04) | 3 (38) | 5 (62) | 0 (0) | 4 (50) | 4 (50) | ||||||
| Preselected e-learning materials | 8 | 30,38 (6.82) | 4 (50) | 3 (38) | 1 (12) | 4 (50) | 4 (50) | ||||||
| Self-guided internet materials | 8 | 32.75 (9.66) | 0 (0) | 8 (100) | 0 (0) | 4 (50) | 4 (50) | ||||||
| Study group 2—medical topic: appendicitis (n=31) | |||||||||||||
| Virtual patient | 8 | 29.39 (4.57) | 5 (62) | 3 (57) | 0 (0) | 4 (50) | 4 (50) | ||||||
| Textbook | 7 | 29.17 (3.87) | 2 (29) | 5 (71) | 0 (0) | 4 (57) | 3 (43) | ||||||
| Preselected e-learning materials | 8 | 33.75 (4.74) | 1 (13) | 7 (87) | 0 (0) | 4 (50) | 4 (50) | ||||||
| Self-guided internet materials | 8 | 32.28 (7.51) | 4 (50) | 4 (50) | 0 (0) | 4 (50) | 4 (50) | ||||||
MCQ Pre- and Posttests
Pre- and Posttests for SAM
The pretest revealed a significant difference in knowledge between the VP group (mean score 480, SD 76.97) and the textbook group (mean score 456, SD 67.88) participants (P=.01) as well as a difference between the VP group and self-guidedinternet group (P=.05; refer to Table 2 for detailed results). Participants in the VP group achieved the highest pretest scores, with a mean of 68% (43/63; mean score 480, SD 76.97) of the questions correctly answered, followed closely by the e-learning group, who correctly answered 63% (40/63) of the questions (mean score 456, SD 67.88). Students in the self-guidedinternet group scored 50% (mean score 360, SD 105.79), whereas students in the textbook group scored 48% (mean score 342, SD 82.89). Although differences in scores between the groups persisted in the posttest compared with the pretest, the overall knowledge gap between the groups narrowed: The VP group scored 79% (mean score 570, SD 82.89), the e-learning group scored 68% (mean score 468, SD 132.7), the self-guidedinternet group scored 59% (mean score 426, SD 165.16), and the textbook group scored 59% (mean score 426, SD 82.89; refer to Table 2 for details).
No significant increase in knowledge was observed in the e-learning group (mean score 468, SD 132.7) and the self-guidedinternet group (mean score 426, SD 165.16). However, significant knowledge growth was identified in both the textbook group (P=.01) and the VP group (P=.01; refer to Multimedia Appendix 6 for details).
Table 2. Overview of the 4 exposure intervention groups that were exposed to the medical topic of severe acute malnutrition as well as their relative test scores (pre- and posttest) and average knowledge increase.
| Intervention group (severe acute malnutrition) | Pretest score, mean (SD) | Posttest score, mean (SD) | Knowledge gain score, mean (SD) |
| Virtual patient | 480 (76.97) | 570 (82.89) | 90 (90.48) |
| Textbook contents | 342 (82.89) | 426 (82.89) | 84 (80.11) |
| Preselected e-learning materials | 456 (67.88) | 468 (132.7) | 12 (114.02) |
| Self-guided internet materials | 360 (105.79) | 426 (165.16) | 66 (122.88) |
Pre- and Posttests for Appendicitis
The pretest for the medical topic of appendicitis did not reveal a significant difference in knowledge acquisition between the 4 intervention groups (P=.62; refer to Table 3 for detailed results). Participants in the e-learning group achieved the highest pretest score, with a mean score 75% (mean score 750, SD 46.29), closely followed by participants in the self-guidedinternet group with 74% (mean score 73.5, SD 112.6), the textbook group with 74% (mean score 735, SD 146.3), and the VP group with 72% (mean score 718, SD 106.7). In the posttest, a difference was observed between the intervention groups, although this difference was not substantial (Table 3). On the basis of the individual learning curves, moderate knowledge acquisition was observed in all 4 groups, although these changes were not substantial (refer to Multimedia Appendix 7 for details).
Table 3. Overview of the 4 exposure intervention groups that were exposed to the medical topic of appendicitis as well as their relative test scores (pre- and posttest) and average knowledge increase.
| Intervention group (appendicitis) | Pretest score, mean (SD) | Posttest score, mean (SD) | Knowledge acquisition, mean (SD) |
| Virtual patient | 718 (106.7) | 800 (128.17) | 81.25 (106.7) |
| Textbook | 735 (146.3) | 821.43 (128.64) | 85.71 (85.22) |
| Preselected e-learning materials | 750 (46.29) | 887.5 (74.4) | 137.5 (87.63) |
| Self-guided internet materials | 735 (112.6) | 850 (75.59) | 112.5 (99.1) |
Acceptance Questionnaire
We observed that the acceptance of learning resources varied depending on the medical topic. For the topic of SAM, the response to the statement “If given the opportunity, I would favor this learning resource over others” showed a significant difference between the e-learning group (mean 2.5, SD 0.33; P=.01) and the self-guided internet group (mean 1.25, SD 0.46). In contrast, the VP group had a favorable score (mean 1.62, SD 0.72). For the topic of appendicitis, the mean response to the same statement in the e-learning group was 1.38 (SD 0.52), which is significantly lower than the mean response in the VP group (mean 3.62, SD 1.41; P=.02).
Regarding the statement “I think this learning resource is a good instrument to acquire knowledge,” a difference between the e-learning group (mean 1.5, SD 0.53) and the self-guided internet group (mean 3.12, SD 1.13) with P=.02 was observed for the topic of appendicitis. This finding indicated that the e-learning group received more positive feedback than the self-guided internet group (Table 4).
One misinterpreted question in the study was removed because of its outlier status (question item: “Interacting with the learning mode required considerable effort.”).
Table 4. The acceptance questionnaire results for both study groups by intervention groups showing mean and SD.
| Study arm and questions items (acceptance questionnaire) | Intervention groups, mean (SD) | ||||
| Virtual patient group | Textbook group | Preselected e-learning materials | Self-guided internet materials | ||
| Study arm 1: severe acute malnutrition | |||||
| “I think this learning resource is a good instrument to acquire knowledge.” | 1.75 (0.89) | 1.88 (1.13) | 2.00 (0.76) | 1.62 (0.52) | |
| “If given the opportunity, I would favor this learning resource over others.” | 1.62 (0.74) | 2.62 (1.19) | 2.5 (0.53) | 1.25 (0.46) | |
| Study arm 2: appendicitis | |||||
| “I think this learning resource is a good instrument to acquire knowledge.” | 2.12 (0.64) | 1.4 (0.89) | 1.5 (0.53) | 3.12 (1.13) | |
| “If given the opportunity I would favor this learning resource over others.” | 3.62 (1.41) | 2.00 (0.82) | 1.38 (0.52) | 2.75 (1.04) | |
Discussion
Principal Findings
In our study, we developed and assessed 2 interactive VP medical topics focusing on SAM and appendicitis, aiming to evaluate their effectiveness and acceptance compared with other prevalent learning resources at LMMU. The efficacy of transferring knowledge to students, and the precise impact of certain VP features, had previously been ambiguous. Our study aimed to address these aspects.
The primary aim of this study was to evaluate the acceptance and knowledge acquisition of BSc clinical sciences students at LMMU when using VPs as a learning resource in comparison with textbooks, preselected e-learning materials, and self-guided internet materials. A key finding of this study was that all 4 learning resources demonstrated their effectiveness in promoting knowledge gain within the study setting. Furthermore, VPs were well received by the students and proved to be noninferior compared with the other 3 learning methods.
Comparison With Prior Work
Knowledge acquisition significantly increased in the VP and textbook groups but not in the e-learning or self-guided internet groups. The differences in knowledge acquisition between these groups can be attributed to various factors. Each learning resource provides different levels of structure and guidance, with some students preferring visual or interactive content (eg, VPs) and others opting for text-based resources (eg, textbooks). These individual preferences may influence the effectiveness of each learning method, thus impacting knowledge acquisition across the groups. Motivation and engagement may also play a role, as VPs and textbooks potentially offer a more structured and engaging learning experience, which could lead to increased motivation and improved information retention. In contrast, general e-learning and self-guided internet materials may require a higher degree of self-discipline and motivation to effectively navigate and absorb the content. Another aspect to consider is the familiarity with learning resources. Students might be more familiar with traditional learning resources, such as textbooks, compared with newer methods, such as VPs or e-learning platforms. This familiarity could influence the ease with which students can use and learn from these resources, thus affecting their knowledge acquisition. Finally, access to specific, targeted learning materials is essential. The VP and textbook groups had access to well-organized, systematic learning materials, making it easier for students to focus on relevant content and efficiently grasp key concepts. In contrast, participants in the e-learning and self-guided internet groups had to navigate and search for pertinent information independently. This process could be time consuming and challenging, as students might encounter a vast amount of information of varying complexity that is not always directly related to course objectives. Consequently, these students may have faced difficulties in identifying and assimilating the critical knowledge required for the subject matter, leading to a smaller increase in knowledge acquisition compared with their counterparts in the VP and textbook groups. However, this observation was not reflected in the acceptance questionnaire. In the second trial group (appendicitis), the pre- and posttest results revealed no significant differences in knowledge acquisition among participants in the intervention groups, although all 4 groups demonstrated an increase in knowledge. The acceptance questionnaires indicated similar responses for all 4 learning resources across 6 technology acceptance dimensions (perceived usefulness, perceived ease of use, attitude toward using, behavioral intention to use, job relevance, and perceived enjoyment) but showed mixed results when comparing the 2 medical subjects of SAM and appendicitis.
Participants exposed to the SAM VP intervention displayed a higher preference for this learning resource, which was not observed in the group exposed to the appendicitis VP. This difference could be attributed to the SAM VP’s integration of more images and a visually appealing design, making it more engaging for students. The varying success of VPs for the 2 subjects may be attributed to differences in content and design. The appendicitis VP might have lacked the engaging elements found in the SAM VP, leading to a lower preference among participants. In addition, the participants’ higher familiarity with or the lower complexity of 1 topic could have contributed to the observed differences in the success of the respective VPs. However, it is important to consider that the design of the 2 VP medical topics may have acted as a confounding factor, potentially influencing the outcomes. As such, we cannot definitively attribute the observed differences solely to the subject matter or the VP medical topic design. Further research is needed to identify the specific factors that contribute to the success of VPs in medical education.
In the SAM group, the preselected e-learning materials (AMBOSS platform) received the lowest mean rating among all intervention groups. Conversely, the appendicitis group demonstrated a positive response to the AMBOSS platform but displayed indifference toward self-guided web-based learning materials. The disparity in the acceptance of the AMBOSS platform as a learning resource between the 2 study groups might be attributed to the platform’s content, which primarily targets the global north.
The content of the AMBOSS platform may not be adequately tailored to the specific learning needs and objectives of the SAM group, possibly because of differences in guidelines, treatment protocols, or context-specific challenges in managing SAM between the United States and Zambia. In addition, the AMBOSS platform may use terminology, examples, or scenarios predominantly familiar to US-based learners, which could pose comprehension difficulties for Zambian students when addressing the specific topic of SAM. SAM is a pressing issue in Zambia, with treatment priorities and modalities that may differ from those in the United States. In contrast, appendicitis holds similar importance in both countries.
Pre- and Posttests
Upon comparing the pre- and posttest results of all study participants, the most substantial improvement was observed among fourth-year students. This finding aligns with the study by Kiesewetter et al [26], who reported that students with less prior knowledge experienced a greater cognitive load compared with those with more prior knowledge. A potential advantage of using VPs is their accessibility, as textbooks can be expensive, sometimes scarce, and may contain outdated content when published. Incorporating VPs into the curriculum can help overcome these limitations and provide students with up-to-date and readily available learning resources. Overall, our pre- and posttest findings indicate that VPs are as effective in promoting learning as other widely used learning resources. Previous research has indicated that the use of VPs leads to significant increases in knowledge, enhanced understanding, and improved problem-solving skills when compared with lecture-based small seminar groups [3,27,28]. These studies also evaluated long-term knowledge retention, revealing no discernible differences between the 2 groups over a 4- to 6-week period.
Acceptance Questionnaire
The observed disparity in the acceptance of VPs between the 2 study groups, SAM and appendicitis, could potentially be attributed to the differences in the design of the 2 VP medical topics. Peddle et al [29] conducted a study involving student interviews to better understand the acceptance of VPs and discovered that incorporating images improved student comprehension and facilitated knowledge retention. The study emphasized the benefits of using short videos to promote knowledge acquisition.
In general, responses to the acceptance questionnaire were predominantly positive. Participants frequently selected responses that ranged from positive to neutral, whereas negative responses were rare. This pattern was also observed in other studies [30]. The study by Krumpal [31] described this phenomenon as individuals considering risks and losses when determining a response, as they seek social acceptability.
To address this potential bias, we communicated with the participants before the study, emphasizing that their responses to the questionnaires would be handled anonymously and would not affect their academic performance.
Future studies should carefully control for potential confounding factors, such as differences in design, when examining the effectiveness of VPs across different medical subjects. This would allow for a more accurate assessment of the impact of subject matter and case design on learning outcomes.
Strengths and Limitations
Our study, which encompassed a majority of students and investigated 4 distinct learning methods, provides valuable insights into how these approaches might improve student learning. However, several limitations of this study should be acknowledged.
First, the generalizability of our findings is limited because of the study population, which exclusively consisted of third- and fourth-year BSc clinical science students. Consequently, our results may not be directly applicable to other contexts, such as different disciplines.
Second, the content of the AMBOSS platform may not have been adequately tailored to the specific learning needs and objectives of SAM in Zambia. Disparities in the content and design of VP between the 2 case scenarios may also result in differences in the study outcomes. Future studies should consider developing a more robust method for comparing VP cases, such as using a larger sample of case scenarios or ensuring that the cases are matched in terms of difficulty and complexity.
Third, owing to a 1-hour delay at the study’s onset caused by technical issues, some participants might have experienced time pressure during the later stages (posttest and acceptance questionnaire), potentially introducing bias. To mitigate this concern, we requested all participants to wait until the last participant completed the study. However, the delay could have resulted in increased fatigue among the participants, affecting their concentration, motivation, and overall performance during the learning sessions and the pre- and posttests. This factor could have potentially impacted knowledge acquisition, leading to lower scores across all intervention groups. Moreover, the delay may have induced stress or frustration that could have influenced their approach to the learning sessions and the pre- and posttests, resulting in less accurate or reliable data and affecting the overall interpretation of the study results.
Fourth, the study did not examine long-term knowledge retention or evaluate traits such as clinical reasoning using MCQs. Therefore, additional research is warranted to investigate long-term knowledge acquisition, as this study concentrated solely on immediate knowledge gain.
Fifth, in our study, we acknowledge the possibility that participants may have been hesitant to provide negative feedback because of concerns regarding anonymity and potential implications for their academic performance. To address this concern, we implemented several measures to ensure anonymity of the data collected. These measures included (1) emphasizing the confidentiality of the study in the information provided to the participants, both verbally and in written form; (2) assigning unique participant identification numbers, which were not linked to personal information, to protect the identity of the participants during data collection and analysis; (3) ensuring that the questionnaires were completed individually and without peer or instructor influence; and (4) storing the collected data securely and restricting access to only the researchers directly involved in the study.
By implementing these measures, we aimed to minimize any potential bias arising from the participants’ reluctance to provide negative feedback. Nevertheless, it is important to recognize that a certain degree of social desirability bias may still be present, which is common in self-reporting studies. Future research could explore alternative methods of data collection or use more indirect questioning techniques to further reduce the impact of such biases on the study results.
Future Directions
At present, LMMU is in the process of revising its e-learning strategy, with the aim of fully integrating e-learning into the curriculum in the future. In light of the findings from our study, it is important to consider potential methodological concerns, such as the content of the AMBOSS platform not being adequately tailored to the specific learning needs and objectives of SAM for Zambia, as well as disparities in the content and design of VP between the 2 case scenarios that may result in differences in study outcomes. Despite these concerns, the updated e-learning strategy and our study results may support the potential inclusion of VPs within the curriculum as a means to enhance medical education at LMMU. Future research should address these methodological concerns to ensure that the implementation of VP scenarios is tailored to the specific needs and contexts of medical education in Zambia, ultimately leading to more robust and reliable outcomes.
Conclusions
The primary aim of this study was to assess the acceptability and effectiveness of VPs for knowledge acquisition in the BSc clinical science program at LMMU in Zambia, comparing their performance with 3 other prevalent learning resources: textbook content, preselected e-learning materials, and self-guided internet materials. In the context of a low-resource setting, our findings demonstrate that although VPs are well accepted, their effectiveness in terms of knowledge acquisition may vary depending on the specific case scenario and content design.
These results underscore the importance of adapting VP designs to Zambian needs and addressing the limitations observed in the appendicitis case before making broad statements regarding their comparability with other learning methods. When appropriately tailored to local contexts, VPs can function as an engaging and interactive learning strategy to enhance web-based or blended learning programs in settings with a high student-to-faculty ratio and limited teaching resources.
Nonetheless, further research on the acceptability and effectiveness of VPs is warranted, as the incorporation of additional VP medical topics into the blended learning program at LMMU for BSc clinical science students is planned. Expanding the evidence base will ensure that VPs continue to contribute positively to medical education in low-resource settings, support the ongoing development and refinement of these learning resources, and address potential disparities in content and design that may impact their effectiveness.
Acknowledgments
This work was supported by the Else Kröner-Fresenius-Stiftung (2019_HA25). For the publication fee, the authors acknowledge financial support from the Deutsche Forschungsgemeinschaft within the funding program “Open Access Publikationskosten” as well as from the Heidelberg University. The authors would like to thank Engagement Global GmbH for their support within the framework of the ASA program.
Data Availability
The data sets generated and analyzed during this study are not publicly available because of data protection regulations but are available from the corresponding author upon reasonable request.
Conflicts of Interest
OC was working for AMBOSS during the study but he was not involved in the data analysis nor did his affiliation influence any study outcomes.
Multimedia Appendix 1
CONSORT eHEALTH checklist (V 1.6.1).
PDF File (Adobe PDF File), 97 KB
------------
Multimedia Appendix 2
Virtual patient medical topic: severe acute malnutrition.
DOCX File , 34975 KB
------------
Multimedia Appendix 3
Virtual patient medical topic: appendicitis.
DOCX File , 14053 KB
------------
Multimedia Appendix 4
Acceptance questionnaire.
PDF File (Adobe PDF File), 82 KB
------------
Multimedia Appendix 5
Knowledge pre- and posttests.
DOCX File , 25 KB
------------
Multimedia Appendix 6
Individual learning trajectories of study participants in the context of severe acute malnutrition.
PNG File , 119 KB
------------
Multimedia Appendix 7
Individual learning trajectories of study participants in the context of appendicitis.
PNG File , 96 KB
------------
References
Physicians (per 1,000 people). The World Bank. URL: https://data.worldbank.org/indicator/SH.MED.PHYS.ZS [accessed 2023-03-17] Gajewski J, Mweemba C, Cheelo M, McCauley T, Kachimba J, Borgstein E, et al. Non-physician clinicians in rural Africa: lessons from the medical licentiate programme in Zambia. Hum Resour Health 2017 Aug 22;15(1):53 [https://human-resources-health.biomedcentral.com/articles/10.1186/s12960-017-0233-0] Barteit S, Neuhann F, Bärnighausen T, Bowa A, Lüders S, Malunga G, et al. Perspectives of nonphysician clinical students and medical lecturers on tablet-based health care practice support for medical education in Zambia, Africa: qualitative study. JMIR Mhealth Uhealth 2019 Jan 15;7(1):e12637 [https://mhealth.jmir.org/2019/1/e12637/] Barteit S, Jahn A, Bowa A, Lüders S, Malunga G, Marimo C, et al. How self-directed e-learning contributes to training for medical licentiate practitioners in Zambia: evaluation of the pilot phase of a mixed-methods study. JMIR Med Educ 2018 Nov 27;4(2):e10222 [https://mededu.jmir.org/2018/2/e10222/] Barteit S, Guzek D, Jahn A, Bärnighausen T, Jorge MM, Neuhann F. Evaluation of e-learning for medical education in low- and middle-income countries: a systematic review. Comput Educ 2020 Feb;145:103726 [https://europepmc.org/abstract/MED/32565611] Lehmann R, Thiessen C, Frick B, Bosse HM, Nikendei C, Hoffmann GF, et al. Improving pediatric basic life support performance through blended learning with web-based virtual patients: randomized controlled trial. J Med Internet Res 2015 Jul 02;17(7):e162 [https://www.jmir.org/2015/7/e162/] Plackett R, Kassianos AP, Mylan S, Kambouri M, Raine R, Sheringham J. The effectiveness of using virtual patient educational tools to improve medical students' clinical reasoning skills: a systematic review. BMC Med Educ 2022 May 13;22(1):365 [https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-022-03410-x] Plackett R, Kassianos AP, Kambouri M, Kay N, Mylan S, Hopwood J, et al. Online patient simulation training to improve clinical reasoning: a feasibility randomised controlled trial. BMC Med Educ 2020 Jul 31;20(1):245 [https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-020-02168-4] Barteit S, Jahn A, Banda SS, Bärnighausen T, Bowa A, Chileshe G, et al. E-learning for medical education in sub-Saharan Africa and low-resource settings: viewpoint. J Med Internet Res 2019 Jan 09;21(1):e12449 [https://www.jmir.org/2019/1/e12449/] Cook DA, Triola MM. Virtual patients: a critical literature review and proposed next steps. Med Educ 2009 Apr;43(4):303-311 Kononowicz AA, Woodham LA, Edelbring S, Stathakarou N, Davies D, Saxena N, et al. Virtual patient simulations in health professions education: systematic review and meta-analysis by the digital health education collaboration. J Med Internet Res 2019 Jul 02;21(7):e14676 [https://www.jmir.org/2019/7/e14676/] Zary N, Johnson G, Boberg J, Fors UG. Development, implementation and pilot evaluation of a web-based virtual patient case simulation environment--web-SP. BMC Med Educ 2006 Feb 21;6:10 [https://bmcmededuc.biomedcentral.com/articles/10.1186/1472-6920-6-10] Courteille O, Fahlstedt M, Ho J, Hedman L, Fors U, von Holst H, et al. Learning through a virtual patient vs. recorded lecture: a comparison of knowledge retention in a trauma case. Int J Med Educ 2018 Mar 28;9:86-92 [https://europepmc.org/abstract/MED/29599421] Loke SK, Tordoff J, Winikoff M, McDonald J, Vlugter P, Duffull S. SimPharm: how pharmacy students made meaning of a clinical case differently in paper- and simulation-based workshops. Br J Educ Technol 2011 Aug 15;42(5):865-874 [https://bera-journals.onlinelibrary.wiley.com/doi/abs/10.1111/j.1467-8535.2010.01113.x] Bediang G, Franck C, Raetzo MA, Doell J, Ba M, Kamga Y, et al. Developing clinical skills using a virtual patient simulator in a resource-limited setting. Stud Health Technol Inform 2013;192:102-106 [https://pubmed.ncbi.nlm.nih.gov/23920524/] Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Trials 2010 Mar 24;11:32 [https://trialsjournal.biomedcentral.com/articles/10.1186/1745-6215-11-32] Guideline: updates on the management of severe acute malnutrition in infants and children. World Health Organization. Geneva: World Health Organization; 2013. URL: https://apps.who.int/iris/bitstream/handle/10665/95584/9789241506328_eng.pdf;jsessionid=AB9FC2BA117B51F125FAC9085A8FCFB9?sequence=1 [accessed 2023-01-27] Inpatient. International Malnutrition Task Force. URL: https://imtf.org/page/info/malnutrition-management/inpatient/ [accessed 2022-05-10] Cloete J. Management of severe acute malnutrition. S Afr Med J 2015 Sep 22;105(7):605 [http://www.scielo.org.za/scielo.php?pid=S0256-95742015000700035 & script=sci_abstract] Kliegman RM, St. Geme J. Nelson Textbook of Pediatrics, 2-Volume Set. 21st edition. Philadelphia, PA, USA: Elsevier; 2019. Acute appendicitis. AMBOSS. 2021. URL: https://www.amboss.com/us/knowledge/Acute_appendicitis/ [accessed 2022-04-13] Williams NS, O’Connell PR, McCaskie AW. Bailey & Love's Short Practice of Surgery. 27th edition. Boca Raton, FL, USA: CRC Press; 2017. Dashboard. AMBOSS. 2021. URL: https://next.amboss.com/us [accessed 2022-04-19] Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q 1989 Sep;13(3):319-340 [https://www.jstor.org/stable/249008] Salloum SA, Qasim Mohammad Alhamad A, Al-Emran M, Abdel Monem A, Shaalan K. Exploring students’ acceptance of e-learning through the development of a comprehensive technology acceptance model. IEEE Access 2019 Sep 05;7:128445-128462 [https://ieeexplore.ieee.org/document/8825866] Kiesewetter J, Sailer M, Jung VM, Schönberger R, Bauer E, Zottmann JM, et al. Learning clinical reasoning: how virtual patient case format and prior knowledge interact. BMC Med Educ 2020 Mar 14;20(1):73 [https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-020-1987-y] Seifert LB, Socolan O, Sader R, Rüsseler M, Sterz J. Virtual patients versus small-group teaching in the training of oral and maxillofacial surgery: a randomized controlled trial. BMC Med Educ 2019 Dec 04;19(1):454 [https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-019-1887-1] Mardani M, Cheraghian S, Naeeni SK, Zarifsanaiey N. Effectiveness of virtual patients in teaching clinical decision-making skills to dental students. J Dent Educ 2020 May;84(5):615-623 Peddle M, Bearman M, Mckenna L, Nestel D. Exploring undergraduate nursing student interactions with virtual patients to develop 'non-technical skills' through case study methodology. Adv Simul (Lond) 2019 Feb 13;4:2 [https://advancesinsimulation.biomedcentral.com/articles/10.1186/s41077-019-0088-7] He J, Van De Vijver FJ. Effects of a general response style on cross-cultural comparisons: evidence from the teaching and learning international survey. Public Opin Q 2015 May 02;79(S1):267-290 [https://academic.oup.com/poq/article/79/S1/267/2460929] Krumpal I. Determinants of social desirability bias in sensitive surveys: a literature review. Qual Quant 2011 Nov 19;47(4):2025-2047 [https://link.springer.com/article/10.1007/s11135-011-9640-9]
------------
Abbreviations
| BSc: Bachelor of Science |
| CONSORT: Consolidated Standards of Reporting Trials |
| HCW: health care worker |
| LMMU: Levy Mwanawasa Medical University |
| MCQ: multiple-choice question |
| MLP: medical licentiate practitioner |
| SAM: severe acute malnutrition |
| VP: virtual patient |
------------
Edited by T Leung; submitted 20.10.22; peer-reviewed by S El Bialy, S Ganesh; comments to author 18.02.23; revised version received 12.04.23; accepted 20.04.23; published 29.06.23
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2023. This work is licensed under https://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
Background:Zambia is facing a severe shortage of health care workers, particularly in rural areas. Innovative educational programs and infrastructure have been established to bridge this gap; however, they encounter substantial challenges because of constraints in physical and human resources. In response to these shortcomings, strategies such as web-based and blended learning approaches have been implemented, using virtual patients (VPs) as a means to promote interactive learning at the Levy Mwanawasa Medical University (LMMU) in Zambia.
Objective:This study aimed to evaluate the students’ knowledge acquisition and acceptance of 2 VP medical topics as a learning tool on a Zambian higher education e-learning platform.
Methods:Using a mixed methods design, we assessed knowledge acquisition using pre- and posttests. In a randomized controlled trial setting, students were assigned (1:1) to 2 medical topics (topic 1: appendicitis and topic 2: severe acute malnutrition) and then to 4 different learning tools within their respective exposure groups: VPs, textbook content, preselected e-learning materials, and self-guided internet materials. Acceptance was evaluated using a 15-item questionnaire with a 5-point Likert scale.
Results:A total of 63 third- and fourth-year Bachelor of Science clinical science students participated in the study. In the severe acute malnutrition–focused group, participants demonstrated a significant increase in knowledge within the textbook group (P=.01) and the VP group (P=.01). No substantial knowledge gain was observed in the e-learning group or the self-guided internet group. For the appendicitis-focused group, no statistically significant difference in knowledge acquisition was detected among the 4 intervention groups (P=.62). The acceptance of learning materials exhibited no substantial difference between the VP medical topics and other learning materials.
Conclusions:In the context of LMMU, our study found that VPs were well accepted and noninferior to traditional teaching methods. VPs have the potential to serve as an engaging learning resource and can be integrated into blended learning approaches at LMMU. However, further research is required to investigate the long-term knowledge gain and the acceptance and effectiveness of VPs in medical education.
Trial Registration:Pan African Clinical Trials Registry (PACTR) PACTR202211594568574; https://pactr.samrc.ac.za/TrialDisplay.aspx?TrialID=20413
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details
; Lea-Mara Witsch
; Rayford Hazunga
; Namuziya, Natasha
; Gardner Syakantu
; Ahmed, Yusuf
; Cherkaoui, Omar
; Andreadis, Petros
; Neuhann, Florian
; Barteit, Sandra