Acquisition Status of Basic Clinical Skills in Japanese Novice Rehabilitation Therapists: A Preliminary Single-Center Study

Abstract

The number of post-graduate rehabilitation therapists (novice therapists) is increasing due to the growing demand for rehabilitation services in Japan. This study investigated the acquisition status of Japanese novice therapists’ basic clinical skills to clarify their quality and characteristics. Eleven participants’ basic clinical skills (eight physical and three occupational therapists) were assessed using an Objective Structured Clinical Examination. Tasks included exercises of joint range of motion, muscle strengthening, getting up, standing up and sitting down, and transferring between wheelchair and bed. Assessment items were subdivided into categories: attitude, preparation, intervention, safety management, and feedback. One-way ANOVA and Friedman test were used for statistical analysis to compare the data between tasks and categories. The scores for each task’s achievement rate were not statistically significant. However, the achievement rate of each category including tasks was 92.6% (SD 4.0%) for attitude, 81.4% (SD 11.1%) for preparation, 77.9% (SD 14.7%) for intervention, 87.6% (SD 17.3%) for safety management, and 64.0% (SD 14.2%) for feedback. There were significant differences between attitude and feedback (p < 0.001), and between safety management and feedback (p = 0.012). Post-graduate training programs should focus on improving the quality of clinical skills, especially in skills related to feedback.

1. Introduction

The rapid increase in the rate of aging has led Japan to become the world’s first super-aging society. Estimates indicate that the older adult population will account for more than 30% of the national population by 2030 and reach approximately 40% in 2050 [1]. The number of people living with diseases and disabilities has increased alongside the aging rate. The proportion of medical and nursing care expenses under social security benefits is increasing annually [2]. Consequently, there are high social expectations for rehabilitation medicine and its aim to improve mental and physical functioning, the ability to perform activities of daily living (ADL), and quality of life (QOL) for the aged and disabled populations [3].

In 2000, 3048 physical therapists (PT) and 2347 occupational therapists (OT) passed the National Examination for rehabilitation professionals in Japan, while these numbers were 9434 PTs and 4510 OTs in 2021 [4,5,6]. As of 2021, there are 192,327 qualified PTs and 108,814 qualified OTs [4,5,6,7], and due to the recent increase, most related professionals have less than five years of clinical experience, accounting for about 25% of the whole. Advanced clinical skills are necessary to provide optimized and individualized physical or occupational therapy to patients with a wide range of issues related to physical and mental functions, ADL, and QOL. It takes about three years for a new PT to achieve a level of autonomous proficiency, implying that clinical experience is necessary for improving skills [8]. Accordingly, the Ministry of Education, Culture, Sports, Science and Technology has made clinical practice a compulsory part of undergraduate education for rehabilitation therapists [9]. Contents of clinical practice involve observation and practice in clinical settings under the guidance and supervision of practical instructors. However, the clinical skills that clinical practice students learn are limited to “those actions that have been deemed not to be highly mentally or physically invasive” [2,10]. For this reason, more than 90% of the new post-graduate therapists feel that they lack the knowledge and technical skills to start working, although they comply with all requisites for engaging in clinical practice [11]. Therefore, there is a need for post-graduate training on the knowledge, clinical skills, problem solving, and thought processes necessary for clinical practice even after obtaining national certification [12].

To develop an efficient post-graduate training program, it is necessary to identify the new rehabilitation therapists’ clinical skills gained prior to graduation and those that remain underdeveloped. The Objective Structured Clinical Examination (OSCE) [13,14], which is a structured test developed in the 1970s to evaluate clinical skills objectively [15], is widely used in the education of medical professionals [16,17,18,19]; it is also used to evaluate rehabilitation therapists’ basic clinical skills. An OSCE for PTs and OTs (Therapist OSCE) has already been proposed and is now widely used in undergraduate education [20]. The Therapist OSCE text systematically outlines the procedures and key points of basic clinical skills for therapists. It is used to educate and evaluate clinical skills prior to graduation [13]. However, to the best of our knowledge, the only report on the use of the OSCE in evaluating the clinical proficiency of new rehabilitation therapists is Refs. [12,13]. However, the study did not examine the intervention skills of therapists.

This study aimed to evaluate the acquisition status of basic clinical skills to clarify their quality and characteristics among novice therapists. It used the Therapist OSCE for this evaluation to determine the attainment of each skill objectively. The knowledge gained through this research will be key for developing efficient post-graduate training programs for novice therapists in Japan, which may help enhance the quality of rehabilitation care.

2. Materials and Methods

This prospective study was approved by the Certified Clinical Research Review Board in our institution (HM21-377) and conducted according to the guidelines of the Declaration of Helsinki.

2.1. Participants

The inclusion criterion was post-graduate new physical or occupational therapists who had been working in a general hospital for three months. The exclusion criterion was therapists who did not give consent to participate in this study. The study included eight PTs (four male) and three OTs (three male), all of whom were employed in the rehabilitation ward and had provided written informed consent to participate following a study briefing.

The new therapists performed the following tasks within the first three months of employment. In the first month, they primarily acquired the knowledge and skills necessary for clinical practice through an introduction to the workplace (e.g., learning about employment rules and personal information protection law, handling medical records, etc.), observation, and by providing clinical support to senior therapists. In the second month, they delivered therapeutic practice to patients under the guidance of a therapist with clinical experience. In the third month, physical or occupational therapy plans were developed and delivered to patients autonomously by the new therapists under the supervision of senior, experienced therapists.

2.2. Procedure

The Therapist OSCE was conducted based on a textbook [20]. The textbook contains a total of 18 OSCE tasks, among which five basic and frequently used clinical skills were selected: joint range of motion exercise (ROM), muscle strengthening exercise (MS), getting up exercise (Getting up), standing up and sitting down exercise (Standing up), and transferring between wheelchair and bed exercise (Transfer). Test-candidate therapists were afforded five minutes to deliver the exercise to the simulated patient and were scored for clinical skills.

The scoring Items for each task consisted of 15, 15, 12, 18, and 17 items for ROM, MS, Getting up, Standing up, and Transfer, respectively. Scoring items were evaluated on three levels: 0 (Incapable), 1 (Inadequate), and 2 (Capable). Therefore, the total score for each task was 30, 30, 24, 36, and 34, respectively. Two PTs who were familiar with the tasks and scoring of this examination scored the test-candidate therapists; one of them also simulated the role of a patient in the tests. After the examination, the two PTs conferred to determine the participants’ scores.

2.3. Analysis

The scoring items for each task were classified into the following five categories: Attitude, Preparation (environment configuration and orientation), Intervention, Safety management, and Feedback. The number of items per category for each task is shown in Table 1. The categories Attitude, Preparation, Intervention, Safety management, and Feedback comprised 15, 14, 37, 5, and 6 items, respectively, with a total score of 30, 28, 74, 10, and 12 points, respectively.

To analyze the results of the Therapist OSCE, the achievement rate for each task, the achievement rate for each category, and the achievement rate for each category of each task were calculated. Statistical analysis was performed using Shapiro–Wilk test to verify normality. Following this, scores were compared using a one-way analysis of variance [21], where normality was confirmed, and a Friedman test [22] was used for non-normality. Regarding significant differences, multiple comparisons were performed; the value of the significant probability was adjusted using a Bonferroni correction [22]. Statistical processing was conducted using SPSS Statistics ver. 27 (IBM, Armonk, NY, USA), and the significance level was 5%.

3. Results

3.1. Comparison of the Total Scores for Each Task

The achievement rate for each task is shown in Figure 1a. The achievement rate was 88.5% (standard deviation [SD] 4.8%) for ROM, 83.6% (SD 6.4%) for MS, 80.4% (SD 15.2%) for Getting up, 78.9 (SD 14.7%) for Standing up, and 77.5% (SD 15.2%) for Transfer. There was no statistically significant difference in achievement rates.

3.2. Comparison of the Total Scores for Each Category

The achievement rate for each category is shown in Figure 1b. The achievement rate was 92.6% (SD 4.0%) for Attitude, 81.4% (SD 11.1) for Preparation, 77.9% (SD 14.7%) for Intervention, 87.6% (SD 17.3%) for Safety management, and 64.0% (SD 14.2%) for Feedback. A significant difference was found between category scores (df = 4, p < 0.001). Multiple comparison results indicated a significant difference between Attitude and Feedback (p < 0.001) and between Safety management and Feedback (p = 0.012).

3.3. Comparison of the Total Score Percentage for Each Category of Each Task

Figure 2 shows the achievement rate for each category of each task. For ROM, there was a significant difference in the achievement rate between categories (df = 4, p = 0.035), but there was no significant difference in the multiple comparison. For MS, there was a significant difference in achievement rate between categories (df = 4, p < 0.001). Multiple comparison results indicated significant differences between Attitude and Preparation, Intervention, and Feedback (p = 0.007, 0.037, 0.002, respectively), Preparation and Safety management (p = 0.030), and Safety management and Feedback (p = 0.007). For Getting up, there was no significant difference between the categories. Regarding Standing up, there was a significant difference in achievement rate between the categories (df = 4, p = 0.002). Multiple comparisons indicated significant differences between Attitude and Feedback (p = 0.015) and between Safety management and Feedback (p = 0.019). For Transfer, there were no significant differences between the categories.

4. Discussion

This research used the Therapist OSCE to determine the rehabilitation therapist’s acquisition status of basic clinical skills soon after becoming employed. Results indicate that the achievement rates for the Getting up, Standing up, and Transfer tasks were not significantly different, albeit lower than those for the ROM and MS, and that individual differences were large. When comparing categories, the achievement rate was the highest for Attitude skills, while Feedback skills had the lowest achievement rate. Similar results were obtained in a previous study that assessed the clinical competence of new therapists using the OSCE [13]; it reported that new therapists tended to have higher attitudinal scores than technical scores.

Developed to assess the basic clinical skills of therapists, the Therapist OSCE provides an objective assessment of basic patient attitude, safety management, and situational feedback skills set in tasks likely to be encountered in clinical practice [15,16,17,18,19]. In our sample, the variation in achievement levels between tasks may have been influenced by differences in the nature and difficulty of the tasks. The ROM and MS tasks exhibited a high average achievement rate trend. In these tasks, the simulated patient was lying in bed with no major postural changes, meaning that test-candidate therapists needed to pay attention mostly to the upper or lower extremities. Meanwhile, the Getting up, Standing up, and Transfer tasks involve a greater postural change from supine to sitting and sitting to standing [20]. Therefore, the test-candidate therapist must be able to facilitate and guide the major postural change of the simulated patient while paying attention to the whole body and focusing on safety management regarding the possibility of falls or tripping. Tasks involving simultaneous movement and cognition are likely to have high difficulty levels since the performance of one or both tasks is likely to decline [23,24].

In the comparative investigation of each category, the achievement rates for Attitude and Safety management were high. For medical and healthcare professionals, basic attitudes and safety management are important topics pertaining to clinical practice in undergraduate education and are set as achievement targets [10,25]. Similarly, in early-stage post-graduate training, the importance of attitudes (e.g., appearance, courteousness, etc.) and safety management to prevent medical accidents are emphasized [12]. Therefore, the achievement rates for Attitude and Safety management were high, possibly due to the great likelihood that the novice therapists continued to receive education and training in related skills. Conversely, achievement rates for Preparation and Intervention skills were low. “Being able to provide treatment under the guidance of a supervisor” is the achievement level goal for therapists who have just gained national qualifications [26]. Therefore, the results suggest that novice therapists and related stakeholders should spend time and energy focusing on Preparation and Intervention skills training.

In clinical practice, there are several instances where rehabilitation therapists have to deal with multiple disabilities of a patient that stem from comorbid disorders. Therefore, post-graduate training may be necessary to optimize the application of basic clinical skills for individual, complex cases. In particular, researchers have suggested that Feedback, which had the lowest achievement rate in our sample, could be an important topic to be emphasized in post-graduate training for rehabilitation therapists. External oral feedback from the therapist and internal feedback (e.g., the individual’s inherent sensations) are important for those undergoing physical or occupational therapy to learn the movements [27]. Given that proper feedback requires timely, language-based communication and immediate interpretation of the patient’s responses and movements, it may be a highly difficult skill for novice therapists to learn.

Qualitative research identified seven categories of abilities that therapists should obtain [28]: “Knowledge required for treatment delivery”, “Clinical thinking skills”, “Medical professional skills for therapists”, “Communication skills”, “Professional attitude”, “Self-learning capability”, and “Self-management capability.” Despite the large number of skills that novice therapists are required to acquire, there are no established standards nor unified programs for measuring their clinical skill levels. Furthermore, the availability of relevant methods for evaluating the clinical skills of novice rehabilitation therapists may be deemed a critical requirement for ensuring the effectiveness of their post-graduate training because such training requires accurate data on their skill levels. As such, various explicit attempts to identify indicators, strategies, and even the clinician growth process have been reported [29,30,31].

This study has several limitations. First, the sample size was small and included both physical and occupational therapists. Moreover, not all participants belonged to the same school, and this led to differences in each school’s training characteristics and the number of hours of clinical practice in the curriculum. Additionally, the research participants were limited to novice therapists in the first three months of employment at a single facility. Therefore, differences in clinical experience among them during the first three months after graduation may have affected the results. Finally, differences in the characteristics of facilities may also have caused the results to differ. Therefore, in the future, the generalizability of these results must be verified with a larger number of participants who graduated from different schools.

5. Conclusions

This study clarified the acquisition status of basic clinical skills in novice therapists soon after graduation using the Therapist OSCE. The results suggested that the therapists had high achievement levels for skills emphasized in undergraduate and post-graduate training, such as basic attitudes and safety management. However, their proficiency in skills that require high attentiveness and patient responsiveness during implementation may be insufficient. To improve the quality of clinical skills among novice therapists, post-graduate training programs should be tailored according to their acquisition status of basic clinical skills. Furthermore, since this was a single-center study, further research with a larger number of participants and different institutions is needed in the future.

Author Contributions

Study design, K.F., H.S., S.K. and Y.K.; Data collection, K.F., H.S., T.I. and S.S.; Data analysis, K.F., H.S. and K.T.; Manuscript writing, K.F., H.S., S.K., S.T., K.T., T.I., S.S., Y.K., K.F. and H.S. contributed equally to this study. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Fujita Health University Review Board for Accredited Clinical Research (HM21-377).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data collected and analyzed during the current study are available from the corresponding author on reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Figures and Table

Figure 1. (a) Achievement rate for each task; Joint range of movement exercise showed the highest rate, while Transfer showed the lowest rate. (b) Achievement rate for each category; Attitude showed the highest rate, while Feedback showed the lowest rate.

Figure 2. Achievement rate for each classification of each task; The Feedback category showed the lowest rate. Significant differences were indicated between the categories of Muscle strengthening and Standing up and sitting down exercises.

Table 1

Number of items according to each task and category.

Category/Task	ROM 1	MS 2	Getting Up 3	Standing Up 4	Transfer 5	Total
Attitude	3	3	3	3	3	15
Preparation	4	3	1	3	3	14
Intervention	5	7	6	10	9	37
Safety management	1	1	1	1	1	5
Feedback	2	1	1	1	1	6

¹ ROM, joint range of motion exercise; ² MS, muscle strengthening exercise; ³ Getting up, getting up exercise; ⁴ Standing up, standing up and sitting down exercise; ⁵ Transfer, transfer between wheelchair and bed exercise.

References

1. United Nations Department of Economic and Social Affairs. Population Dynamics. World Population Prospects. 2019; Available online: https://population.un.org/wpp/ (accessed on 4 January 2022).

2. Ministry of Finance Japan. Social Security Expenses, etc. Available online: https://www.mof.go.jp/about_mof/councils/fiscal_system_council/sub-of_fiscal_system/proceedings/material/zaiseia20210415/02.pdf (accessed on 4 January 2022). (In Japanese)

3. Yoshino, J. Study of the Levels and Secular Changes of Clinical Competencies of Physical Therapists. Rigakuryoho Kagaku; 2021; 36, pp. 699-704. (In Japanese) [DOI: https://dx.doi.org/10.1589/rika.36.699]

4. Japanese Association of Occupational Therapists. Member Statistics. J. Jpn. Assoc. Occupat. Ther.; 2020; 102, pp. 5-18. Available online: https://www.jaot.or.jp/files/page/jimukyoku/kaiintoukei2019.pdf. (accessed on 4 January 2022). (In Japanese)

5. Japanese Physical Therapy Association. Statistics. Site for Citizens. Available online: https://www.japanpt.or.jp/activity/data/ (accessed on 4 January 2022). (In Japanese)

6. Ministry of Health, Labour, and Welfare of Japan. Announcement of Passing the 56th National Examination for Physical Therapists and the 56th National Examination for Occupational Therapists. Available online: https://www.mhlw.go.jp/general/sikaku/successlist/2021/siken08_09/about.html (accessed on 4 January 2022). (In Japanese)

7. Ministry of Health, Labour, and Welfare of Japan. Announcement of Passing of the 54th National Examination for Physical Therapists and the 54th National Examination for Occupational Therapists. Available online: https://www.mhlw.go.jp/general/sikaku/successlist/2019/siken08_09/about.html (accessed on 4 January 2022). (In Japanese)

8. Yoshino, J. New hire education goals. Jpn. J. Physic. Ther.; 2010; 44, pp. 357-363. (In Japanese)

9. Ministry of Education, Culture, Sports, Science, and Technology Japan. Regulations for Designation of Establishing Training Schools for Physical and Occupational Therapists. Available online: https://elaws.e-gov.go.jp/document?lawid=341M50000180003 (accessed on 23 July 2022). (In Japanese)

10. Japanese Association of Occupational Therapists. Occupational Therapy Clinical Practice Guidelines. Available online: https://www.jaot.or.jp/files/page/wp-content/uploads/2013/12/shishin-tebiki2018-2.pdf (accessed on 6 January 2022). (In Japanese)

11. Suzuki, Y.; Nagai, S. The actual situation of clinical training in physical therapy education: Suggestive of actual status of student learning by questionnaire survey. Med. Health Sci. Res.; 2012; 3, pp. 103-114. (In Japanese)

12. Yoshino, J.; Usuda, S. Current state of physical therapist continuing education in medical facilities. J. Phys. Ther. Sci.; 2010; 25, pp. 55-60. (In Japanese) [DOI: https://dx.doi.org/10.1589/rika.25.55]

13. Motoya, I.; Takeda, K.; Koyama, S.; Kojima, R.; Hirakawa, Y.; Sakurai, H.; Kanada, Y.; Kawamura, N.; Tanabe, S. The characteristics of the clinical competence of novice physical therapists and occupational therapists at the time of hiring in a single institution in Japan. Health Prof. Educ.; 2020; 6, pp. 538-551. [DOI: https://dx.doi.org/10.1016/j.hpe.2020.04.005]

14. Saitoh, H.; Koseki, M. Recent clinical education techniques and clinical skills assessment—Application and practical report of OSCE in post-graduate education. Physic. Ther. Jpn.; 2008; 35, pp. 455-456. (In Japanese)

15. Harden, R.M.; Stevenson, M.; Downie, W.W.; Wilson, G.M. Assessment of clinical competence using objective structured examination. Br. Med. J.; 1975; 1, pp. 447-451. [DOI: https://dx.doi.org/10.1136/bmj.1.5955.447]

16. Ito, F.; Suzuki, K.; Muraki, T.; Saito, S.; Tsuchisawa, K. A trial of objective structured clinical examination (OSCE) before clinical practice in our occupational therapy education. Jpn. J. Res. Occup. Ther. Educ.; 2006; 6, pp. 18-26. (In Japanese)

17. Kohno, M.; Watanabe, A.; Sakurai, H. Practice of OSCE in therapist education. Jpn. J. Res. Occupat. Ther. Educ.; 2004; 4, pp. 38-41. (In Japanese)

18. Yamaji, T.; Watanabe, J.; Asakawa, Y.; Matsuda, Y.; Usuda, S.; Endo, F.; Uchiyama, Y.; Sakamoto, M.; Yamaguchi, H.; Nakazawa, T. et al. Development and trial of objective structured clinical examination in physical therapy education. J. Jpn. Physic. Ther. Assoc.; 2004; 31, pp. 348-358. (In Japanese)

19. SSimon, S.R.; Bui, A.; Day, S.; Berti, D.; Volkan, K. The relationship between second-year medical students’ OSCE scores and USMLE Step 2 scores. J. Eval. Clin. Pract.; 2007; 13, pp. 901-905. [DOI: https://dx.doi.org/10.1111/j.1365-2753.2006.00768.x] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/18070260]

20. Saitoh, E. Clinical Skills for PT/OT and OSCE—Intervention for Functional Disorders and Reduced Capabilities Edition; KANEHARA & CO., LTD.: Tokyo, Japan, 2017; (In Japanese)

21. Bewick, V.; Cheek, L.; Ball, J. Statistics review 9: One-way analysis of variance. Crit. Care; 2004; 8, pp. 130-136. [DOI: https://dx.doi.org/10.1186/cc2836]

22. Sheldon, M.R.; Fillyaw, M.J.; Thompson, W.D. The use and interpretation of the Friedman test in the analysis of ordinal-scale data in repeated measures designs. Physiother. Res. Int.; 1996; 1, pp. 221-228. [DOI: https://dx.doi.org/10.1002/pri.66] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/9238739]

23. Koshino, H. Neural basis of dual-tasking. Jpn. J. Psychonomic. Sci.; 2009; 28, pp. 59-71. (In Japanese)

24. Watanabe, K.; Funahashi, S. Neural mechanisms of dual-task interference and cognitive capacity limitation in the prefrontal cortex. Nat. Neurosci.; 2014; 17, pp. 601-611. [DOI: https://dx.doi.org/10.1038/nn.3667]

25. Japanese Physical Therapy Association. Clinical Training Educational Guide; 6th ed. JPTA: Tokyo, Japan, 2020; Available online: https://www.japanpt.or.jp/assets/pdf/activity/books/education_01/tebiki6_201225.pdf (accessed on 6 January 2022). (In Japanese)

26. Shinohara, T.; Gokan, H.; Hiraishi, T.; Yagi, I.; Tani, T. Internal consistency and factor structure of the therapist achievement evaluation scale developed as an education tool for on-the-job training: Consideration of attainment of target of providing physical therapy based on the advice of a tutor. J. Jpn. Physic. Ther. Assoc.; 2018; 33, pp. 331-336. (In Japanese) [DOI: https://dx.doi.org/10.1589/rika.33.331]

27. Tani, H. Are instructions and feedback by a therapist effective in the motor learning?. Physic. Ther. Jpn.; 2006; 21, pp. 69-73. (In Japanese) [DOI: https://dx.doi.org/10.1589/rika.21.69]

28. Yoshino, J.; Futawatari, T.; Otani, K. Qualitative study of the primary goals of continuing education in physical therapy. J. Jpn. Physic. Ther. Assoc.; 2010; 37, pp. 410-416. (In Japanese)

29. Black, L.L.; Jensen, G.M.; Mostrom, E.; Perkins, J.; Ritzline, P.D.; Hayward, L.; Blackmer, B. The first year of practice: An investigation of the professional learning and development of promising novice physical therapists. Physic. Ther.; 2010; 90, pp. 1758-1773. [DOI: https://dx.doi.org/10.2522/ptj.20100078]

30. Hayward, L.M.; Black, L.L.; Mostrom, E.; Jensen, G.M.; Ritzline, P.D.; Perkins, J. The first two years of practice: A longitudinal perspective on the learning and professional development of promising novice physical therapists. Physic. Therap; 2013; 93, pp. 369-383. [DOI: https://dx.doi.org/10.2522/ptj.20120214] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/23064736]

31. Yoshino, J.; Usuda, S. Development and reliability of a clinical competence evaluation scale in physical therapy. J. Jpn. Physic. Ther. Assoc.; 2012; 27, pp. 651-655. (In Japanese) [DOI: https://dx.doi.org/10.1589/rika.27.651]