Reliability Exercise of Ultrasound Salivary Glands in Sjögren’s Disease: An International Web Training Initiative

Abstract

Introduction

Major salivary gland ultrasonography (SGUS) demonstrated its good metric properties as an outcome measure for diagnosing primary Sjögren’s disease (SD). The objective was to assess SGUS reliability among sonographers with different levels of experience, using web training.

Methods

Sonographers from expert centers participated in the reliability exercise. Before exercises, training was done by videoconferencing. Reliability of the two most experienced sonographers (MES) was assessed and then compared to other sonographers. Intra-reader and inter-reader reliability of SGUS items were assessed by computing Cohen’s κ coefficients.

Results

All sets were read twice by all 14 sonographers within a 4-month interval. Intra-reader reliability of MES was almost perfect for homogeneity, substantial for Outcome Measures in Rheumatology (OMERACT) scoring system (OMERACTss). Among LES (less experienced sonographers), reliability was moderate to almost perfect for homogeneity, fair to moderate for OMERACTss, and fair to almost perfect for binary OMERACTss. Inter-reader reliability between MES was almost perfect for homogeneity, substantial for diagnosis, moderate for OMERACTss, and substantial for binary OMERACTss. Compared to MES, reliabilities of LES were moderate to almost perfect for both homogeneity and diagnosis, only fair to moderate for OMERACTss, but increased in binary OMERACTss.

Conclusions

Videoconferencing training sessions in an international reliability exercise could be an excellent tool to train experienced and less-experienced sonographers. SGUS homogeneity items is useful to distinguish normal from abnormal salivary glands parenchyma independently of diagnosis. Structural damage evaluations by OMERACT scoring system is a new comprehensive score to diagnose patients with SD and could be easily used by sonographers in a binary method.

Plain Language Summary

The goal of this project was to evaluate the reliability of salivary gland ultrasonography in patients with Sjögren’s disease using online training in an international study. Currently, salivary gland ultrasonography is routinely used only by European expert sonographers but few studies have studied intra-reader and inter-reader reliability, among less experienced international sonographers. Many salivary gland ultrasonography scoring systems are used today, but it is difficult to know how to put them into practice. Online training on an international level allows a significant number of practitioners to use the different scoring systems including the latest OMERACT (Outcome Measures in Rheumatology) score, which is simple and comprehensive. There were two phases to this project: A first step consisted in a training session by videoconferencing to all sonographers, the second step was an inter and intra-reader reliability exercises. The results of our study showed satisfactory results, especially for parenchyma homogeneity. Regarding the comprehensive OMERACT score, the results are quite disparate, notably for less experienced sonographers and could be explained by this new comprehensive scoring system. However, when binary OMERACT score (minor damage versus major damage of salivary gland parenchyma (OMERACT score 0–1 vs. 2–3) was employed, reliability increased and can be very useful for novice sonographers in routine practice because it does not require scoring of all the pathological features in Sjögren’s disease. This study highlights the need to train non-experts interested in this field and demonstrates the potential for beginners to quickly become experts.