Inter-rater variability of three-dimensional fracture reduction planning according to the educational background

Abstract

Background

Computer-assisted three-dimensional (3D) planning is increasingly delegated to biomedical engineers. So far, the described fracture reduction approaches rely strongly on the performance of the users. The goal of our study was to analyze the influence of the two different professional backgrounds (technical and medical) and skill levels regarding the reliability of the proposed planning method. Finally, a new fragment displacement measurement method was introduced due to the lack of consistent methods in the literature.

Methods

3D bone models of 20 distal radius fractures were presented to nine raters with different educational backgrounds (medical and technical) and various levels of experience in 3D operation planning (0 to 10 years) and clinical experience (1.5 to 24 years). Each rater was asked to perform the fracture reduction on 3D planning software.

Results

No difference was demonstrated in reduction accuracy regarding rotational (p = 1.000) and translational (p = 0.263) misalignment of the fragments between biomedical engineers and senior orthopedic residents. However, a significantly more accurate planning was performed in these two groups compared with junior orthopedic residents with less clinical experience and no 3D planning experience (p < 0.05).

Conclusion

Experience in 3D operation planning and clinical experience are relevant factors to plan an intra-articular fragment reduction of the distal radius. However, no difference was observed regarding the educational background (medical vs. technical) between biomedical engineers and senior orthopedic residents. Therefore, our results support the further development of computer-assisted surgery planning by biomedical engineers. Additionally, the introduced fragment displacement measure proves to be a feasible and reliable method.

Level of Evidence

Diagnostic Level II