Abstract

While precision medicine applications of radiomics analysis are promising, differences in image acquisition can cause “batch effects” that reduce reproducibility and affect downstream predictive analyses. Harmonization methods such as ComBat have been developed to correct these effects, but evaluation methods for quantifying batch effects are inconsistent. In this study, we propose the use of the multivariate statistical test PERMANOVA and the Robust Effect Size Index (RESI) to better quantify and characterize batch effects in radiomics data. We evaluate these methods in both simulated and real radiomics features extracted from full-field digital mammography (FFDM) data. PERMANOVA demonstrated higher power than standard univariate statistical testing, and RESI was able to interpretably quantify the effect size of site at extremely large sample sizes. These methods show promise as more powerful and interpretable methods for the detection and quantification of batch effects in radiomics studies.

Details

Title
Multivariate testing and effect size measures for batch effect evaluation in radiomic features
Author
Horng, Hannah 1 ; Scott, Christopher 2 ; Winham, Stacey 2 ; Jensen, Matthew 2 ; Pantalone, Lauren 3 ; Mankowski, Walter 3 ; Kerlikowske, Karla 4 ; Vachon, Celine M. 2 ; Kontos, Despina 5 ; Shinohara, Russell T. 6 

 University of Pennsylvania, Department of Bioengineering, Philadelphia, USA (GRID:grid.25879.31) (ISNI:0000 0004 1936 8972); University of Pennsylvania, Department of Radiology, Center for Biomedical Image Computing and Analysis (CBICA), Philadelphia, USA (GRID:grid.25879.31) (ISNI:0000 0004 1936 8972); University of Pennsylvania, Penn Statistics in Imaging Endeavor (PennSIVE), Department of Biostatistics, Epidemiology, and Informatics, Philadelphia, USA (GRID:grid.25879.31) (ISNI:0000 0004 1936 8972) 
 Mayo Clinic, Rochester, USA (GRID:grid.66875.3a) (ISNI:0000 0004 0459 167X) 
 University of Pennsylvania, Department of Radiology, Center for Biomedical Image Computing and Analysis (CBICA), Philadelphia, USA (GRID:grid.25879.31) (ISNI:0000 0004 1936 8972) 
 University of California, San Francisco, USA (GRID:grid.266102.1) (ISNI:0000 0001 2297 6811) 
 University of Pennsylvania, Department of Radiology, Center for Biomedical Image Computing and Analysis (CBICA), Philadelphia, USA (GRID:grid.25879.31) (ISNI:0000 0004 1936 8972); Columbia University, Center for Innovation in Imaging Biomarkers and Integrated Diagnostics (CIMBID), New York, USA (GRID:grid.21729.3f) (ISNI:0000 0004 1936 8729) 
 University of Pennsylvania, Department of Radiology, Center for Biomedical Image Computing and Analysis (CBICA), Philadelphia, USA (GRID:grid.25879.31) (ISNI:0000 0004 1936 8972); University of Pennsylvania, Penn Statistics in Imaging Endeavor (PennSIVE), Department of Biostatistics, Epidemiology, and Informatics, Philadelphia, USA (GRID:grid.25879.31) (ISNI:0000 0004 1936 8972) 
Pages
13923
Publication year
2024
Publication date
2024
Publisher
Nature Publishing Group
e-ISSN
20452322
Source type
Scholarly Journal
Language of publication
English
ProQuest document ID
3068991415
Copyright
© The Author(s) 2024. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.