Consensus development and validation of entrustable professional activities for nephrology fellowship training in Saudi

Abstract

Objectives: This study aimed to develop and validate entrustable professional activities (EPAs) for the nephrology fellowship program in Saudi Arabia. Methods: This study utilized a two-round modified Delphi design involving nephrology consultants across Saudi Arabia. The initial list of 39 EPAs was created through a literature review and expert input, followed by a piloting process that refined these activities based on feedback. A target sample of 26 nephrology consultants was invited, achieving an 80% response rate in the first round with 21 participants. Descriptive statistics, including means and percentages, summarized demographic characteristics and group responses. Participants rated the relevance of each EPA using a 5-point Likert scale. Consensus was defined as at least 75% agreement among participants, which guided the refinement of EPAs across the Delphi rounds. The study was approved by the institutional review board at Umm Al-Qura University, Makkah, Saudi Arabia. Results: In the first round, consensus was achieved for 34 EPAs, while 5 were excluded for lack of relevance and 6 were modified. The second round confirmed full consensus on the revised 34 EPAs, with an 81% response rate among the 21 experts. Conclusions: This study successfully developed and validated EPAs for the nephrology fellowship program in Saudi Arabia. Implementing these EPAs is expected to enhance training, assessment, and clinical competence for nephrology fellows. Future studies should explore the long-term impact of these EPAs on training outcomes and consider adapting them for other specialties.

Headnote

Abstract

Objectives: This study aimed to develop and validate entrustable professional activities (EPAs) for the nephrology fellowship program in Saudi Arabia.

Methods: This study utilized a two-round modified Delphi design involving nephrology consultants across Saudi Arabia. The initial list of 39 EPAs was created through a literature review and expert input, followed by a piloting process that refined these activities based on feedback. A target sample of 26 nephrology consultants was invited, achieving an 80% response rate in the first round with 21 participants. Descriptive statistics, including means and percentages, summarized demographic characteristics and group responses. Participants rated the relevance of each EPA using a 5-point Likert scale. Consensus was defined as at least 75% agreement among participants, which guided the refinement of EPAs across the Delphi rounds. The study was approved by the institutional review board at Umm Al-Qura University, Makkah, Saudi Arabia.

Results: In the first round, consensus was achieved for 34 EPAs, while 5 were excluded for lack of relevance and 6 were modified. The second round confirmed full consensus on the revised 34 EPAs, with an 81% response rate among the 21 experts.

Conclusions: This study successfully developed and validated EPAs for the nephrology fellowship program in Saudi Arabia. Implementing these EPAs is expected to enhance training, assessment, and clinical competence for nephrology fellows. Future studies should explore the long-term impact of these EPAs on training outcomes and consider adapting them for other specialties.

Keywords: Entrustable professional activities, EPAs, nephrology, fellowship, medical education, competency by design, training programs, Saudi Arabia

Introduction

EPAs are defined as responsibilities or tasks that can be entrusted to trainees for unsupervised practice once they have attained sufficient specific competencies.'? First published in 2005. EPAs have since been supported by workshops, courses, and conferences aimed at helping faculty develop programs and assessment procedures.·5 However, there remains a significant need for clarification and effective implementation of EPAs.· Well-written EPAs provide a natural framework for establishing training objectives, requiring comprehensive descriptions that justify each component], 4 importantly, EPAs are not substitutes for competencies; they translate competencies into day-to-day clinical tasks.4,6 Competencies describe the traits of a physician, while EPAs delineate the specific work." · Several published EPAs exist for nephrology postgraduate training programs, such as those from Canada and the United States.>7"' However, adopting EPAs from other cultures can be challenging due to differences in local culture, patient values, and healthcare systems. Institutions worldwide that have adopted EPAs have developed and validated their own based on specific needs." The Canadian Medical Education Directives for Specialists (CanMEDS) framework" widely used in postgraduate training, outlines physician competencies that extend beyond medical expertise, emphasizing roles that meet societal needs. In response, the Saudi Commission for Health Specialties (SCFHS) is integrating the CanMEDS framework into the core curriculum for all training programs, including the nephrology fellowship.'·'5 For example, educators may struggle with defining the practical applications of these competencies and ensuring consistent assessment across diverse clinical settings. EPAs, in contrast, outline the essential tasks that a newly graduated nephrologist must perform independently, thus advancing competency-based medical education (CBME) by enabling specific clinical tasks to be entrusted to trainees once they are proficient.>'>'>" The aim of this study is to develop and validate end-of-training EPAs for nephrology fellowship training in Saudi Arabia. This study is part of a larger initiative aimed at developing and validating EPAs across various internal medicine specialties in the country, building on previously published work that established foundational EPAs in related fields."

Methods

The study consisted of two phases: the first phase aimed to develop a preliminary list of EPAs for the nephrology fellowship program based on a comprehensive literature review and expert opinions. The second phase sought to establish consensus on the suggested EPA list through two rounds of Delphi techniques with nephrology experts. The study was approved by the institutional review board at Umm Al-Qura University, Makkah, Saudi Arabia.

Study population and sampling

The study population included nephrology consultants in Saudi Arabia, each with over two years of experience in the field and involvement in postgraduate training programs. Consultants were selected through purposeful sampling to ensure geographic balance and subspecialty expertise across regions. Written informed consent was obtained from all participants.

Demographic characteristics

Twenty-six nephrology consultants were invited to participate in the modified Delphi technique survey, achieving an 80% response rate with 21 participants. Most participants were male, constituting 85.7% of the group. In terms of nationality, 76% identified as Saudi. The age distribution revealed that most participants (71%) were between 35 and 44 years old. Regarding leadership roles, approximately 43% of the participants held positions within nephrology fellowship Int J Med Educ. 2025; 16:92-99 programs. Furthermore, regional representation included participants from Riyadh (43%), Jeddah (24%), and Makkah, Abha, and Taif, each contributing 10% to the cohort. (see Table 1).

Preliminary phase

A preliminary set of EPAs was developed by three nephrologists and two medical educators, who conducted a thorough literature review of international EPAs and frameworks, including the SCFHS competency training framework for nephrology." 14171922 This set was organized into four categories: clinical assessment, clinical management, procedures, and transferable skills. A pilot survey was then conducted to gather feedback on the clarity and relevance of the EPAs, leading to their refinement based on panelists' qualitative comments. Specific modifications were made in response to the feedback, and additional demographic questions were included to enhance data collection.

Second phase

The second phase involved two rounds of the Delphi technique conducted via online surveys. The first round included demographic data and the preliminary list of EPAs, where panelists rated the representativeness and relevance of each EPA on a 5-point Likert scale (1 = not important, 5 = extremely important). Panelists could also suggest changes or introduce new EPAs. The consensus criteria for retaining EPAs included an average rating of 4 or higher and at least 80% of panelists rating the EPA as 4 or 5. The mean and standard deviation were computed for each EPA, and modifications were made based on qualitative feedback.

In the second round, the same expert panel reviewed the modified list, using the same rating scale and providing feedback on the applied changes. The analysis of ratings and comments followed the same framework as the first round, ensuring consistency in evaluation.

Internal consistency of Delphi rounds

Descriptive statistics summarized participants demographic characteristics and group responses across all rounds. A target response rate of 80% was set. Cronbach's alpha was calculated to assess the internal consistency of the ratings, indicating reliability in the assessments. Additionally, standard deviation (SD) was employed to evaluate the consensus among panelists regarding the mean values for each EPA. Statistical procedures were reported, including the presentation of results with means and standard deviations.

Results

Preliminary phase

In the preliminary phase, an initial list of 39 EPAs was developed for the nephrology fellowship program in Saudi Arabia. A draft Delphi study questionnaire was created and piloted among five nephrologists. The pilot results highlighted specific concerns about the clarity and relevance of some EPAs, particularly regarding their applicability in clinical practice. In response, modifications were made to the wording of several EPAs to enhance clarity, and demographic questions were added to the final questionnaire to gather more comprehensive feedback from participants.

First round of Delphi technique

In the first round of the Delphi technique, the 39 suggested EPAs were evaluated. Consensus was defined as achievingan average mean score of at least 4.0 and a rating of 4 or higher by over 80% of panel members. A total of 34 EPAs achieved this consensus. Based on expert feedback, which primarily highlighted concerns about redundancy and the feasibility of implementation, five EPAs were deleted. Additionally, the wording of six others was modified to improve clarity and applicability. This process resulted in a refined list of 34 prefinal EPAs (see Table 2).

Second round of Delphi technique

The second round involved the same participants reviewing the modified, pre-final list of 34 EPAs. Of the 26 invited experts, 21 (81%) completed this round. Consensus was achieved for all 34 EPAs, each obtaining an average mean score of 4.0 or higher and over 80% agreement on their importance and relevance. Panelists evaluated the modifications made in the first round; 55% (11 out of 20 respondents) agreed With the amendments and deletions, while 45% disagreed. This disagreement was discussed among the panelists, highlighting the diverse perspectives on the issue. Further refinements were made to address the concerns raised, ultimately leading to a final consensus on the 34 end-of-training EPAs for the nephrology fellowship training program in Saudi Arabia (see Table 3).

Internal consistency of Delphi rounds

The internal consistency of the modified Delphi rounds was assessed using Cronbach's alpha, yielding values of a = 0.91 for the first round and a = 0.97 for the second round (see Table 2). Descriptive statistics, including means and standard deviations, were calculated for each EPA.

Discussion

This study aimed to develop a consensus-based set of EPAs for Saudi Arabia's nephrology fellowship programs. These EPAs are designed to enhance the training, assessment, and clinical skills of nephrology fellows, ultimately improving patient care in Saudi Arabia. To meet international standards while addressing local healthcare needs, it is essential to incorporate these EP As into fellowship programs and evaluate their impact on trainee performance and patient outcomes. The development process followed established guidelines for creating effective EP As." The initial list of EPAs and the number of nephrology consultants involved in the Delphi process were based on expert recommendations.» Feedback from the panel of nephrologists was carefully reviewed, leading to necessary adjustments during the second round of the Delphi technique. This iterative process allowed the study to reach a consensus, resulting in a final list of 34 EPAs, consistent with literature suggestions."°

The initiative is part of a broader institutional project to develop an EPA framework for Internal Medicine Specialized fellowship programs, promoting standardization in training, By providing a structured approach, these EPAs ensure that trainees acquire consistent skills and knowledge, leading to improved patient outcomes.» Furthermore, the development of the EPAs framework supports the implementation of Competency-Based Medical Education (CBME) in nephrology training, allowing for focused and individualized assessments.'??%! EPAs outline the essential tasks that graduating nephrologists must perform independently in clinical practice.' They encompass multiple competencies, allowing for varied approaches to achieving mastery. EPAs translate competencies into practical tasks, emphasizing hands-on experience to facilitate the transition from training to autonomous practice." Therefore, they should be viewed as part of a dynamic curriculum process, with regular reviews to align with evolving trends in nephrology healthcare practice." The alignment of EPAs with the Saudi Commission for Health Specialties (SCFHS) development and quality improvement initiatives is crucial. By identifying essential skills and knowledge required for nephrologists, programs can target areas for improvement, ensuring that trainees meet the evolving needs of patients." ·"·· Feedback from nephrology consultants during the Delphi process led to adjustments in the EPAs. For example, EPA A3 was modified to encompass a broader scope of "Applying basic medical knowledge in daily practice," reflecting the necessity for comprehensive training. Some EPAs, such as EPA В11, 'Assessing the suitability of deceased donors and potential living donors for kidney transplantation, were excluded due to their specificity to transplant nephrologists, indicating the need for further training or dedicated fellowships. However, the importance of transplantation was emphasized, as fellows should manage pre- and post-operative care for renal transplant recipients and assess eligibility for kidney transplantation, as demonstrated in EPAs B9, 10, and 12.The exclusion of procedural skills, such as HD catheter placement (EPA C2) and kidney biopsies (EPA C3), sparked significant debate, particularly with nearly 45% of respondents disagreeing with these decisions in the second round. This highlights the ongoing discussions about nephrologists' responsibilities in their training.?02>2677 While international standards from organizations like the American Society of Nephrology (ASN)"·· and Саnadian EPAs,® recognize certain procedures as essential to nephrology training, the common practice in Saudi hospitals often involves interventional radiologists performing these tasks. This situation complicates the discussion around the EPAs, as some important procedures, such as HD catheter insertion, are left out of the fellowship training framework. Despite this omission, gaining hands-on experience in these areas remains vital for fellows, helping them manage complications effectively and provide comprehensive care to dialysis patients. For example, learning how to insert HD catheters is a key part of nephrology training and fits well with guidelines for managing vascular access.'7?>s Similarly, developing skills in native or transplant kidney biopsies is important for accurately diagnosing and treating patients." " This ongoing debate highlights the need to find a balance between global standards and local practices, ensuring that nephrology fellows are well-prepared to handle these critical procedures. We noted a 45% disagreement regarding the exclusion of certain EPAs. This analysis helped us understand the diverse perspectives on the issue. Ultimately, we decided not to make certain EPAs mandatory, believing that it's important for nephrology fellows to develop these essential skills at their own pace. This approach encourages engagement and motivation, allowing them to effectively tackle challenges in dialysis and nephrology care. In summary, our final decision balanced the need for skill development with the autonomy of individual learning.

The study has several limitations. Firstly, generalizability may be limited; while a diverse panel of nephrology experts from Saudi Arabia contributed, the findings might not be applicable to other regions. Future research should explore the generalizability of these EP As. Additionally, the potential for expert bias exists, as the Delphi technique relies heavily on expert opinions. To mitigate this, future studies could incorporate broader methodologies, such as systematic literature reviews or focus groups. In terms of future research, concrete next steps could include longitudinal studies aimed at tracking the effectiveness of these EPAs in improving patient outcomes and the quality of fellowship training. Specific suggestions for implementing EPAs in Saudi fellowship programs include faculty training workshops, pilot programs, and establishing feedback loops for ongoing revisions. By integrating global standards while respecting local healthcare constraints, Saudi fellowship programs can enhance their training frameworks effectively.

Conclusions

This study successfully established and validated EPAs for the Saudi nephrology fellowship training program, marking a meaningful progression in regional medical education. These EPAs aim to elevate the training, assessment, and clinical abilities of nephrology fellows in Saudi Arabia. To ensure they are in line with international standards while addressing the specific needs of local healthcare, it is vital to integrate these EPAs into fellowship programs and assess their effects on both trainee performance and patient care outcomes. Future research should prioritize validating this framework within the nephrology community, gathering insights from both educators and trainees to continuously refine and improve the EPAs. This ongoing feedback loop will be essential for adapting the EPAs to meet the dynamic challenges of nephrology practice in Saudi Arabia.

Acknowledgements

The authors sincerely appreciate and extend their gratitude to the nephrology consultants who attended and participated in the modified Delphi rounds.

Conflict of Interest

The author declares that there is no conflict of interest.

Sidebar

Correspondence: Manal E. Alotaibi, Department of Medicine, Medical College, Umm Al-Qura University, Makkah, Saudi Arabia

[email protected]

Accepted: May 06, 2025

References

References

1. Ten Cate O, Balmer DF, Caretta-Weyer H, Hatala R, Hennus MP, West DC. Entrustable professional activities and entrustment decision making: a development and research agenda for the next decade. Acad Med. 2021;96(7 Suppl):S96-S104.

2. Amare EM, Siebeck M, Sendekie TY, Fischer MR, Berndt M. Development of an entrustable professional activities (EPA) framework to inform surgical residency training programs in Ethiopia: a three-round national Delphi method study. J Surg Educ. 2022;79(1):56-68.

3. Ten Cate O. Entrustability of professional activities and competency-based training. Med Educ. 2005;39(12):1176-7

4. Ten Cate O. Nuts and bolts of entrustable professional activities. J Grad Med Educ. 2013;5(1):157-8.

5. Ten Cate O, Chen HC, HoffRG, Peters H, Bok H, van der Schaaf M. Curriculum development for the workplace using entrustable professional activities (EPAs): AMEE guide no. 99. Med Teach. 2015;37(11):983-1002.

6. Ten Cate O, Taylor DR. The recommended description of an entrustable professional activity: AMEE guide no. 140. Med Teach. 2021;43(10):1106-14.

7. Tanaka A, Kondo T, Urushibara-Miyachi Y, Maruyama S, Nishigori H. Development of entrustable professional activities for residents rotating nephrology department in a Japanese university hospital: a Delphi study. V M J Open. 2021;11(8):e047923.

8. Nephrology Specialty Committee. EPA guide: adult nephrology. Ottawa: Royal College of Physicians and Surgeons of Canada; 2017. [Cited 25 April 2025J; Available from: https://www.royalcollege.ca/content/dam/documents/ibd/nephrology/epa-guide-adult-nephrology-e.pdf.

9. Royal College of Physicians and Surgeons of Canada. Entrustable professional activities for pediatric nephrology. 2019. [Cited 25 April 2025J; Available from: https://www.royalcollege.ca/content/dam/documents/ibd/nephrology/epa-guide-pediatric-nephrology-e.pdf.

10. Rinaldi I, Findyartini A, Widaty S, Hasan I. Identification and validation of entrustable professional activities in Indonesian internal medicine residency programs. Acta Med Indones. 2022;54(1):79-96.

11. Watson A, Leroux T, Ogilvie-Harris D, Nousiainen M, Ferguson PC, Murnaghan L, et al. Entrustable professional activities in orthopaedics. JB JS Open Access. 2021;6(2):e21.00039.

12. FrankJR, editor. The CanMEDS 2005 physician competency framework. Better standards. Better physicians. Better care. Ottawa: Royal College of Physicians and Surgeons of Canada; 2005. [Cited 25 April 2025J; Available from: https://www.ciperj.org/imagens/canmed2005.pdf.

13. Chou S, Cole С, McLaughlin К, Lockyer J. CanMEDS evaluation in Canadian postgraduate training programmes: tools used and programme director satisfaction. Med Educ. 2008;42(9):879-86.

14. Royal College of Physicians and Surgeons of Canada. Nephrology competencies. 2018. [Cited 25 April 2025J; Available from: https://www-test.roy-alcollege.ca/content/dam/documents/ibd/nephrology/nephrology-compe- tencies-e.pdf.

15. CullyJL, Schwartz SB, Quinonez R, Martini A, Klein M, Schumacher DJ. Development of entrustable professional activities for post-doctorate pediatric dentistry education. J Dent Educ. 2023;87(1):6-17.

16. AlSheikh MH, Zaini RG, Igbal MZ. Developing and mapping entrustable professional activities with Saudi MEDs competency framework: a consensus study. Adv Med Educ Pract. 2022;13:1367-77.

17. Accreditation Council for Graduate Medical Education. ACGME program requirements for graduate medical education in nephrology. 2023. [Cited 25 April 2025J; Available from: https://www.acgme.org/globalassets/pfassets/programrequirements/2024-prs/148_nephrology_2024.pdf.

18. Alharbi LA, Cheikh M, Alotaibi ME, Alkhotani AA, Alim HM, Almalki F, et al. Developing and validating entrustable professional activities (EPAs) for rheumatology fellowship training programs in Saudi Arabia: a Delphi study. Adv Med Educ Pract. 2024;15:845-56.

19. Ramaswamy V, Fitzgerald M, Danciu T, Nalliah R, de Peralta T, Munz SM, et al. Entrustable professional activities framework for assessment in pre-doctoral dental education, developed using a modified Delphi process. J Dent Educ. 2021;85(8):1349-61.

20. American Board of Internal Medicine. Nephrology policies. 2024. [Cited 25 April 2025J; Available from: https://www.abim.org/certification/policies/internal-medicine-subspecialty-policies/nephrology/.

21. Saudi Commission for Health Specialties. Saudi fellowship program in nephrology. 2020. [Cited 25 April 2025J; Available from: https://scfhs.org.sa/sites/default/files/2022-02/Nephrology%20%202020.pdf.

22. American Society of Nephrology Training Program Directors. Nephrology curricular milestones: implementation draft. 2014. [Cited 25 April 2025J; Available from: https://www.asn-online.org/education/training/thd/ASN_Nephrology Curricular _Milestones.pdf.

23. Ganzhorn A, Schulte-Uentrop L, Kullmei J, Zollner С, Moll-Khosrawi P. National consensus on entrustable professional activities for competency-based training in anaesthesiology. PLoS One. 2023;18(7):e0288197.

24. Ten Cate O, Carraccio C, Damodaran A, Gofton W, Hamstra SJ, Hart DE, et al. Entrustment decision making: extending Miller's pyramid. Acad Med. 2021;96(2):199-204.

25. Zaini RG, Al-Rumayyan A, Abdulghani H, AlQumaizi К, Al-Kadi A, Alsaedi A, et al. Saudi medical education directives (MEDs) framework. Health Prof Educ. 2023;9(4):i-e.

26. Norby SM. Requirements for procedural skills in nephrology training programs: framing the conversation. Clin J Am Soc Nephrol. 2018;13(7):1096-8.

27. Obaidi Z, Sozio SM. Kidney biopsy should remain a required procedure for nephrology training programs: PRO. Kidney360. 2022;3(10):1664-6.

28. American Board of Internal Medicine. Policies and procedures for certification. 2018. [Cited 25 April 2025J; Available from https://www.abim.org/certification/policies.