Full text

Turn on search term navigation

© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.

Abstract

Video-capsule endoscopy (VCE) reading is a time- and energy-consuming task. Agreement on findings between readers (either different or the same) is a crucial point for increasing performance and providing valid reports. The aim of this systematic review with meta-analysis is to provide an evaluation of inter/intra-observer agreement in VCE reading. A systematic literature search in PubMed, Embase and Web of Science was performed throughout September 2022. The degree of observer agreement, expressed with different test statistics, was extracted. As different statistics are not directly comparable, our analyses were stratified by type of test statistics, dividing them in groups of “None/Poor/Minimal”, “Moderate/Weak/Fair”, “Good/Excellent/Strong” and “Perfect/Almost perfect” to report the proportions of each. In total, 60 studies were included in the analysis, with a total of 579 comparisons. The quality of included studies, assessed with the MINORS score, was sufficient in 52/60 studies. The most common test statistics were the Kappa statistics for categorical outcomes (424 comparisons) and the intra-class correlation coefficient (ICC) for continuous outcomes (73 comparisons). In the overall comparison of inter-observer agreement, only 23% were evaluated as “good” or “perfect”; for intra-observer agreement, this was the case in 36%. Sources of heterogeneity (high, I2 81.8–98.1%) were investigated with meta-regressions, showing a possible role of country, capsule type and year of publication in Kappa inter-observer agreement. VCE reading suffers from substantial heterogeneity and sub-optimal agreement in both inter- and intra-observer evaluation. Artificial-intelligence-based tools and the adoption of a unified terminology may progressively enhance levels of agreement in VCE reading.

Details

Title
Inter/Intra-Observer Agreement in Video-Capsule Endoscopy: Are We Getting It All Wrong? A Systematic Review and Meta-Analysis
Author
Valdivia, Pablo Cortegoso 1   VIAFID ORCID Logo  ; Deding, Ulrik 2   VIAFID ORCID Logo  ; Bjørsum-Meyer, Thomas 2 ; Baatrup, Gunnar 2 ; Fernández-Urién, Ignacio 3 ; Dray, Xavier 4 ; Boal-Carvalho, Pedro 5 ; Ellul, Pierre 6   VIAFID ORCID Logo  ; Toth, Ervin 7   VIAFID ORCID Logo  ; Rondonotti, Emanuele 8 ; Kaalby, Lasse 2   VIAFID ORCID Logo  ; Pennazio, Marco 9 ; Koulaouzidis, Anastasios 10   VIAFID ORCID Logo 

 Gastroenterology and Endoscopy Unit, University Hospital of Parma, University of Parma, 43126 Parma, Italy 
 Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark; Department of Surgery, Odense University Hospital, 5000 Odense, Denmark 
 Department of Gastroenterology, University Hospital of Navarra, 31008 Pamplona, Spain 
 Center for Digestive Endoscopy, Sorbonne University, Saint Antoine Hospital, APHP, 75012 Paris, France 
 Gastroenterology Department, Hospital da Senhora da Oliveira, Creixomil, 4835 Guimarães, Portugal 
 Division of Gastroenterology, Mater Dei Hospital, 2090 Msida, Malta 
 Department of Gastroenterology, Skåne University Hospital, Lund University, 20502 Malmö, Sweden 
 Gastroenterology Unit, Valduce Hospital, 22100 Como, Italy 
 University Division of Gastroenterology, City of Health and Science University Hospital, University of Turin, 10126 Turin, Italy 
10  Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark; Department of Medicine, OUH Svendborg Sygehus, 5700 Svendborg, Denmark; Surgical Research Unit, OUH, 5000 Odense, Denmark; Department of Social Medicine and Public Health, Pomeranian Medical University, 70-204 Szczecin, Poland 
First page
2400
Publication year
2022
Publication date
2022
Publisher
MDPI AG
e-ISSN
20754418
Source type
Scholarly Journal
Language of publication
English
ProQuest document ID
2728457157
Copyright
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.