Comparison of medical students’ perceptions of patient safety: Focusing on simulation training using a high-fidelity simulator

Abstract

Patient safety education is necessary for the provision of high-quality medical services. A significant aspect of patient safety education is simulation training, which allows medical students to experience realistic clinical environments. This study aimed to verify the effectiveness of patient safety education using simulation training. We retrospectively analyzed the results of a 30-question questionnaire survey on the perceptions of patient safety before and after simulation training, which was completed by 40 medical students who participated in clinical practice between June and December 2021. A paired t-test was performed by calculating the mean and standard deviation for each item. We found that students’ overall perceptions of patient safety improved after training. Specifically, after simulation training, attitudes toward patient safety were maintained at the same level as before training, while students’ self-efficacy of patient safety increased. Simulation training is effective in improving students’ perceptions of patient safety, and increasing students’ confidence can improve their clinical performance. To maintain this effect, repeated learning is required, and theoretical classes and simulation training should be used appropriately for patient safety education in the future.

Introduction

Rapid social development and economic growth have resulted in increased demand and expectations for healthcare services. However, with increasing access to healthcare services, the incidence of medical accidents is also increasing. Every year, there are millions of instances of disability, injury, or death due to unsafe medical practices [1], and this has resulted in increased awareness of the importance of patient safety and heightened interest in improving the quality of healthcare services.

Medical accidents cause physical, mental, and material losses for patients, and accidents related to patient safety can be fatal [2]. Therefore, medical institutions and their members should strive to provide quality healthcare services. According to the Institute of Medicine’s 1999 “To Err is Human” report, medical errors are more common than we think, and many are preventable [3]. However, ensuring maximum patient safety in healthcare services is often difficult owing to changes in and increased complexity of healthcare processes, information overload for patients or healthcare providers, increased patient expectations for perfect treatment outcomes, and higher severity of patient conditions and vulnerability [4]. To ensure safe healthcare services, medical accidents must be prevented, and when such accidents do occur, the causes and consequences must be identified to prevent recurrence [5]. In addition, a safe medical system should be developed to effectively prevent and reduce errors and avoid blaming individuals in the event that they do occur [3]. To improve patient safety, processes and systems must be implemented to account for inevitable human errors.

Patient safety education is also becoming increasingly important in medical education. The Institute of Medicine emphasized the need for continuous patient safety education in medical education courses [6]. In line with this suggestion, the World Health Organization announced a patient safety curriculum for medical schools in 2009 [7], and efforts are being made globally to implement patient safety education in medical schools’ basic medical curriculum. In Korea, some individual medical educators, not organizations such as schools, are still recognizing the importance of patient safety education and making efforts [8]. Therefore, since the timing and methods of education vary, it is necessary to consider when and how to provide education more effectively. In Korea, patient safety education in medical schools is mostly provided before clinical practice [8]. However, during the clinical practice period, students will meet patients in person, and medical errors may occur during this period. Therefore, patient safety education should be continuously provided during clinical practice.

Simulation training aims to provide learners with practice opportunities, enabling them to learn from mistakes in a safe environment and acquire mastery by achieving predetermined learning objectives [9]. Additionally, it allows for objective evaluation of learners’ competency through standardized learning content, as well as repeated learning [10]. Therefore, it can be considered an effective educational method for improving students’ competency in medical education, as it allows clinical situations to be designed around various learning goals. These advantages of simulation training can also be applied to patient safety education. In Korea, several previous studies have already verified the effectiveness of simulation training programs on patient safety accidents, such as blood transfusion errors and fall management, for prospective medical personnel [11, 12].

The need for all medical personnel to collaboratively strive for patient safety has been highlighted as a measure to prevent repeated medical accidents. Therefore, patient safety simulation training is essential for prospective medical personnel. In Korea, the effectiveness of simulation training has been verified in several studies that developed such training programs for prospective medical personnel, especially nursing students [11–13]. However, simulation training research on medical students is insufficient. Since 2006, many medical schools in Korea have been operating simulation centers [14]. Therefore, they also need to provide simulation training on patient safety for medical students. Thus, we aim to confirm the effectiveness of simulation training in patient safety education by analyzing medical students’ perceptions of patient safety before and after simulation training.

Materials and methods

Design and setting

We conducted a survey with 40 students (28 men, 12 women) to compare their perceptions of patient safety. The students were juniors taking a clinical practice course on pediatrics and adolescence at a college of medicine in the academic year 2021. They had had three simulation training experiences in previous clinical practice. They participated in the training from June to December 2021, and we retrospectively analyzed the questionnaire data collected during the regular curriculum.

As part of the assessment, students filled out a pre-survey questionnaire on their perceptions of patient safety. Next, an orientation was conducted to inform students about the location and usage of basic equipment through pre-briefing. Then, students were divided into pairs, and each pair was assigned certain roles to facilitate task sharing. The training, supervised by a pediatric medicine professor, lasted 10–15 minutes. Following the training, debriefing sessions provided feedback on students’ learning goals, focusing on their knowledge, skills, and attitudes. Finally, a post-training survey was conducted, employing the same questions as those used in the pre-survey questionnaire (Fig 1).

[Figure omitted. See PDF.]

A total of 40 students, engaged in clinical practice in pediatrics, underwent simulation training and completed a questionnaire both before and after the training.

Ethical considerations

This study was conducted with the approval of the concerned institutional review board (No. AJIRB-SBR-SUR-21-624). Informed consent was not required because the study involved a retrospective analysis based on previously collected data.

Simulation program setting

In the four-week clinical practice course on pediatrics, students were divided into five groups of eight students each. Each group was further subdivided into pairs during the simulation training, which was conducted four times. The training duration for each pair was approximately 10 min on average and did not exceed 15 min. Since falls are one of the most common patient safety-related accidents among pediatric patients, pediatric falls were selected as the subject of the simulation program scenario in this study. A high-fidelity pediatric simulator (SimBaby; Laerdal Medical, Stavanger, Norway) was used to allow students to fully focus on the situation. Vital signs were displayed on the monitor, and test results suitable for the scenario were provided. For a more realistic scenario, one standardized patient playing the role of a patient’s caregiver was recruited and trained in advance to perform the same role during each situation. The simulation training was designed to train students to (1) determine the severity of an adverse event through history-taking and physical examination; (2) communicate appropriately with patients and caregivers; and (3) understand the importance of reporting, analysis, and management of adverse events. The simulation training program was organized into four stages according to the learning objectives, as shown in Fig 2.

[Figure omitted. See PDF.]

The students’ simulation training was conducted according to the steps shown here. It also aimed to achieve the learning objectives corresponding to each stage.

Questionnaire

We used a questionnaire on the perceptions of patient safety. The questions were the same for both the pre- and post-survey questionnaires. However, the post-survey questionnaire included an additional question on students’ feelings. There were 30 questions in all: 24 questions on the participants’ attitudes toward overall safety, including falls, and six questions on self-efficacy related to procedures and methods for coping with falls. All items were answered on a 5-point Likert scale (1 = not at all; 5 = strongly agree).

To determine students’ attitudes toward patient safety, we used an evaluation tool developed by Madigosky et al. [15], which determines the changes in medical students’ knowledge, skills, and attitudes regarding patient safety and medical errors. Further, Kim and Seo’s questionnaire was used to measure students’ knowledge and attitude toward falls [16]. The questionnaire was modified and supplemented to meet the purpose of this study. In addition, Park and Park’s questionnaire was used as a measure of self-efficacy for patient safety-related performance; it included six items related to coping with medical errors, falls, and safety issues [17]. A team of experts, including one medical education department professor, two professors from the department of pediatrics, and one nurse, corrected and supplemented the final questionnaire with any necessary explanations. The Cronbach alpha values of the 30 questions in the final completed questionnaire were 0.781 for the pre-survey and 0.816 for the post-survey.

Statistical analysis

SPSS Statistics 25.0 (IBM Corp., Armonk, NY, USA) was used to analyze the data. Means and standard deviations were calculated for each item to determine students’ perceptions of patient safety, and a paired t-test was performed to compare the pre- and post-training results.

Results

Table 1 presents the results of students’ perceptions of patient safety before and after the simulation training program. In particular, the post-training results demonstrated an improvement in students’ perceptions of patient safety, showing a statistically significant difference.

[Figure omitted. See PDF.]

Further, there was no statistically significant difference in students’ attitudes toward patient safety after training, but the average scores above neutral were maintained. The results also demonstrated a statistically significant level of positive change among students regarding the provision of time for patient safety education at school.

Additionally, the post-training results demonstrated a statistically significant increase in the degree of interest in inpatient falls compared to the pre-training results. The perception of the severity of a patient’s physical injury owing to a fall and the perception of the occurrence of a fall due to a patient’s physical condition were above neutral.

Finally, the post-training results demonstrated a statistically significant increase in students’ self-efficacy related to patient safety. In particular, self-efficacy in writing patient safety event reports increased after the training. The scores of the importance and proper use of the bed, wheelchair, and side rail increased significantly after the training. These questions were related to fall prevention.

Discussion

Patient safety education is becoming increasingly prevalent in medical education worldwide. In this study, we evaluated the effect of patient safety education on students through simulation training. Hazardous events or proximity errors related to patient safety can be life-threatening if not promptly and appropriately handled in real clinical situations. However, patient safety education is difficult to acquire in real clinical situations. Therefore, training related to patient safety education is largely provided in the form of lectures. Although the lecture method is effective for transferring knowledge, it is limited in that the acquired knowledge cannot be directly applied to the actual field of practice where various problems may occur [18]. In this regard, simulation training, which is used to simulate medical accidents that occur in actual clinical settings, has been suggested to overcome the limitations of the lecture method, as it creates the possibility of repeated learning and correcting mistakes [10, 19]. Simulation and team-based training are recommended methods to improve patient safety [20]. Therefore, we conducted simulation training for patient safety education.

The results showed significant differences in students’ perceptions of patient safety before and after simulation training. We conducted one single training session, and no significant difference was observed in students’ attitudes toward patient safety before and after the training; however, the results obtained both before and after the training were confirmed to be above neutral. The results suggest that the training may have helped to form students’ basic attitudes toward patient safety. Prior to this simulation training, the students took a course on patient safety and thus had prior knowledge of it. A previous study of medical students reported that the overall attitude scores improved after systematic education, including patient safety education, was provided as part of the regular curriculum [15]. Unlike in this study, educational activities such as lectures and discussions were conducted several times, which may have contributed to the improvement in students’ attitudes. This means that improving students’ attitudes toward patient safety through one-time education is difficult, and continuous education through a systematic curriculum is necessary.

Self-efficacy in simulation training is the degree of learners’ confidence in providing treatment to patients and performing skills in simulated situations [21]. In this study, self-efficacy related to patient safety increased significantly after the simulation training, indicating its efficacy. A previous systematic literature review of simulation-based education reported that simulation training improves students’ knowledge, critical thinking, and confidence or satisfaction [22]. Improving students’ confidence is an important effect of simulation training, and these aspects are consistent with our results. A previous study that conducted team-based simulation training on patient safety for medical personnel demonstrated an increase in self-efficacy after the training [23]. Another study demonstrated improved self-efficacy among learners after simulation training with a high-fidelity simulator [24]. These results are consistent with those of this study. Further, an increase in students’ confidence owing to simulation training is known to improve their performance ability through motivation, as well as their problem-solving and clinical judgment abilities [25]. Therefore, continuous simulation training can help to improve students’ self-efficacy related to patient safety and their clinical performance. In other words, future patient safety education should appropriately utilize both theoretical classes and simulation training.

This study had several limitations. First, we evaluated students’ subjective responses and did not include objective evaluations of technical aspects. We are preparing a long-term observational study to investigate how they apply to clinical actions. Second, as the simulation training was conducted as part of a medical school’s regular curriculum, with five groups alternately engaging in simulation activities every four weeks, this aspect cannot be completely excluded. Third, since the simulation training was part of the regular curriculum, it was impossible to randomly assign students or set a control group. Therefore, the selection of a single group for the study’s purpose was inevitable. Fourth, significant changes were found in only 6 of the 30 survey items we used in this study. Only three items in attitude and three items in self-efficacy showed significant changes, and these items mainly influenced the change in the overall average score. Therefore, the results may be difficult to interpret with only the change in the overall average, and focusing on each significant item is necessary. Fifth, the results may not be generalizable, and since only one medical school was included, the number of samples was small.

Conclusions

We aimed to evaluate students’ perceptions of patient safety by conducting simulation training using a high-fidelity simulator. We focused on falls as one of the most common accidents related to patient safety. The findings demonstrated no significant difference in students’ attitudes toward patient safety after the simulation training, but students’ self-efficacy was improved when an event related to patient safety occurred.

The result that there was no difference in attitudes toward patient safety suggests that inducing improvement of students’ attitudes through one-time training is not sufficient. Therefore, systematic education programs and repetitive simulation training will be required to effectively improve attitudes. In particular, the patient safety training program should be expanded to include high-fidelity simulators that will help simulate actual clinical situations.

We also confirmed the positive effects of simulation training through improved self-efficacy for patient safety. Simulation training must be used in the medical education field continuously to improve patient safety capabilities.

Acknowledgments

We would like to thank Editage (www.editage.co.kr) for English language editing.

Citation: Lee JE, Yu JH, Lee SK, Lee JH, Jung HJ (2024) Comparison of medical students’ perceptions of patient safety: Focusing on simulation training using a high-fidelity simulator. PLoS ONE 19(7): e0304883. https://doi.org/10.1371/journal.pone.0304883

About the Authors:

Ji Eun Lee

Roles: Conceptualization, Formal analysis, Investigation, Methodology, Supervision, Writing – original draft, Writing – review & editing

Affiliation: Office of Medical Education, Ajou University School of Medicine, Suwon, South Korea

ORICD: https://orcid.org/0000-0002-8424-9297

Ji Hye Yu

Roles: Conceptualization, Formal analysis, Methodology, Supervision, Writing – review & editing

Affiliations: Office of Medical Education, Ajou University School of Medicine, Suwon, South Korea, Department of Medical Education, Ajou University School of Medicine, Suwon, South Korea

Su Kyung Lee

Roles: Conceptualization, Investigation, Writing – review & editing

Affiliation: Ajou Center for Clinical Excellence, Ajou University School of Medicine, Suwon, South Korea

Jang Hoon Lee

Roles: Conceptualization, Supervision, Writing – review & editing

Affiliations: Office of Medical Education, Ajou University School of Medicine, Suwon, South Korea, Department of Medical Education, Ajou University School of Medicine, Suwon, South Korea, Department of Pediatrics, Ajou University School of Medicine, Suwon, South Korea

Hyun Joo Jung

Roles: Conceptualization, Supervision, Writing – original draft, Writing – review & editing

E-mail: [email protected]

Affiliation: Department of Pediatrics, Ajou University School of Medicine, Suwon, South Korea

ORICD: https://orcid.org/0000-0003-3614-1238

[/RAW_REF_TEXT]

[/RAW_REF_TEXT]

[/RAW_REF_TEXT]

[/RAW_REF_TEXT]

[/RAW_REF_TEXT]

[/RAW_REF_TEXT]

References

1. Lawati MHA, Dennis S, Short SD, Abdulhadi NN. Patient safety and safety culture in primary health care: A systematic review. BMC Fam Pract. 2018;19: 104. pmid:29960590

2. Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington District of Columbia: National Academies Press. US; 2001.

3. Institute of Medicine (US) Committee on Quality of Health Care in America, Kohn LT, Corrigan JM, Donaldson MS, editors To err is human: Building a safer health system. Washington District of Columbia: National Academies Press. US; 2000.

4. Kim YM. Integrated review on patients safety. In: Korean nurses’ continuous education text: Safety care. Seoul: Korean Nurses Association; 2009.

5. Wears RL, Janiak B, Moorhead JC, Kellermann AL, Yeh CS, Rice MM, et al. Human error in medicine: Promise and pitfalls, part 1. Ann Emerg Med. 2000;36: 58–60. pmid:10874237

6. Institute of Medicine. Health professions education: A bridge to quality, Greiner AC, Knebel E, editors (US) Committee on th & Health Professions Education Summit. Washington District of Columbia: National Academies Press. US; 2003.

7. World Health Organization. WHO patient safety curriculum guide for medical schools. Geneva: World Health Organization; 2009. 254 p.

8. Roh H. Patient safety education for medical students: Global trends and Korea’s status. Korean Med Educ Rev. 2019;21: 1–12.

9. Aggarwal R, Mytton OT, Derbrew M, Hananel D, Heydenburg M, Issenberg B, et al. Training and simulation for patient safety. Qual Saf Health Care. 2010;19;Suppl 2: i34–i43. pmid:20693215

10. Kneebone R. Simulation in surgical training: Educational issues and practical implications. Med Educ. 2003;37: 267–277. pmid:12603766

11. Kim EJ. Nursing students’ error and recovery in transfusion simulation for safety competency. J Korean Acad Fundam Nurs. 2015;22: 180–189.

12. Yu M, Kim JK, Kim SY, Cho SH, Kim MJ, Seomun G. Development and effects of simulation program for fall management. J Korean Acad Nurs Adm. 2017;23: 548–557.

13. Kim EJ, Nam KA. Effects of team-based simulation training on patient safety confidence and nursing competency among nursing students. J East-West Nurs Res. 2020; 30;26: 130–138.

14. Lee SO, Eom M, Lee JH. Use of simulation in nursing education. J Korean Acad Soc Nurs Edu. 2007;13: 90–94.

15. Madigosky WS, Headrick LA, Nelson K, Cox KR, Anderson T. Changing and sustaining medical students’ knowledge, skills, and attitudes about patient safety and medical fallibility. Acad Med. 2006;81: 94–101. pmid:16377828

16. Kim SH, Seo JM. Geriatric hospital nurses’ knowledge, attitude toward falls, and fall prevention activities. J Korean Gerontol Nurs. 2017;19: 81–91.

17. Park J, Park M. Knowledge, attitude, and confidence on patient safety of undergraduate nursing students. J Korean Acad Soc Nurs Educ. 2014;20: 5–14.

18. Ragsdale MA, Mueller J, Plan, do, study, act model to improve an orientation program. J Nurs Care Qual. 2005;20: 268–272. pmid:15965393

19. Durham CF, Alden KR. Chapter 51. Enhancing patient safety in nursing education through patient simulation. In: Hughes RG, editor. Patient safety and quality: An evidence-based handbook for nurses. Rockville: Agency for Healthcare Research and Quality; 2008.

20. Shekelle PG, Pronovost PJ, Wachter RM, McDonald KM, Schoelles K, Dy SM, et al. The top patient safety strategies that can be encouraged for adoption now. Ann Intern Med. 2013;158: 365–368. pmid:23460091

21. Nishisaki A, Keren R, Nadkarni V. Does simulation improve patient safety? Self-efficacy, competence, operational performance, and patient safety. Anesthesiol Clin. 2007;25: 225–236. pmid:17574187

22. Cant RP, Cooper SJ. Simulation-based learning in nurse education: Systematic review. J Adv Nurs. 2010;66: 3–15. pmid:20423432

23. Meurling L, Hedman L, Sandahl C, Felländer-Tsai L, Wallin CJ. Systematic simulation-based team training in a Swedish intensive care unit: A diverse response among critical care professions. BMJ Qual Saf. 2013;22: 485–494. pmid:23412932

24. Reznek M, Smith-Coggins R, Howard S, Kiran K, Harter P, Sowb Y, et al. Emergency medicine crisis resource management (EMCRM): Pilot study of a simulation-based crisis management course for emergency medicine. Acad Emerg Med. 2003;10: 386–389. pmid:12670855

25. Lasater K. High-fidelity simulation and the development of clinical judgment: Students’ experiences. J Nurs Educ. 2007;46: 269–276. pmid:17580739