INCloud: integrated neuroimaging cloud for data collection, management, analysis and clinical translations

Abstract

Background

Neuroimaging techniques provide rich and accurate measures of brain structure and function, and have become one of the most popular methods in mental health and neuroscience research. Rapidly growing neuroimaging research generates massive amounts of data, bringing new challenges in data collection, large-scale data management, efficient computing requirements and data mining and analyses.

Aims

To tackle the challenges and promote the application of neuroimaging technology in clinical practice, we developed an integrated neuroimaging cloud (INCloud). INCloud provides a full-stack solution for the entire process of large-scale neuroimaging data collection, management, analysis and clinical applications.

Methods

INCloud consists of data acquisition systems, a data warehouse, automatic multimodal image quality check and processing systems, a brain feature library, a high-performance computing cluster and computer-aided diagnosis systems (CADS) for mental disorders. A unique design of INCloud is the brain feature library that converts the unit of data management from image to image features such as hippocampal volume. Connecting the CADS to the scientific database, INCloud allows the accumulation of scientific data to continuously improve the accuracy of objective diagnosis of mental disorders.

Results

Users can manage and analyze neuroimaging data on INCloud, without the need to download them to the local device. INCloud users can query, manage, analyze and share image features based on customized criteria. Several examples of 'mega-analyses' based on the brain feature library are shown.

Conclusions

Compared with traditional neuroimaging acquisition and analysis workflow, INCloud features safe and convenient data management and sharing, reduced technical requirements for researchers, high-efficiency computing and data mining, and straightforward translations to clinical service. The design and implementation of the system are also applicable to imaging research platforms in other fields.

Correspondence to Dr Zhi Yang; [email protected]

Key messages

The known

• Rapidly growing neuroimaging research generates massive amounts of data.

• A cloud solution helps standardise the acquisition, management, analyses and utilization of large-scale neuroimaging data.

• There is a need to make neuroimaging research data available to serve clinical practice in the diagnosis and treatment of mental disorders.

The new

• INCloud provides a full-stack solution for the entire process of large-scale neuroimaging data collection, management, analysis, and clinical applications.

• INCloud helps standardize the acquisition and pre-processing of neuroimaging data, making it easier to aggregate data collected by multiple teams.

• INCloud implements a brain feature library that allows users to query, manage, analyze and share brain features, and therefore accelerates the utilisation of neuroimaging data.

• INCloud connects scientific data to CADs so that research data can contribute to clinical service.

Introduction

Brain research is essential for understanding, diagnosis and treatment of mental disorders. Neuroimaging precisely reflects the structure and function of the human brain and has become a commonly used technique in brain research.^1–8 Various neuroimaging modalities and analytic methodologies have been applied to characterise the brain of those with mental disorders.^9–11 The deployment of various brain research projects has significantly accelerated neuroimaging research on normal populations and people with mental illness. Accordingly, there are new challenges to data collection, data management and sharing, computational resources and data mining.

Neuroimaging data collected by different research groups often have inconsistent scanning parameters, which may affect the quality consistency of the data and harm the statistical power of the analyses.^{12 13} Before data collection, the efforts of the neuroimaging centre to standardise and accurately manage scanning parameters can help unify data quality and promote more efficient accumulation and sharing of neuroimaging data. At the same time, standardised subject registration and scanning procedures are required to maximise the consistency of the data collection process and provide an important foundation for neuroimaging data management, standardised processing and connection with clinical information.

The management of large-scale neuroimaging data, especially for mental disorders, is another challenge for imaging centres. Specifically, the diverse diagnosis of mental illness and the multiple imaging modalities used in research bring complexity to the centralised management and cleaning of data. Data collection and analysis are usually carried out in the form of a team (multiperson) or teamwork (multiteam), which brings challenges to data authority management and security assurance. There are some large-scale neuroimaging data management and sharing systems, such as LONI\IDA (The Image and Data Archive at the Laboratory of Neuro Imaging),¹⁴ COINS (The Collaborative Informatics and Neuroimaging Suite),¹⁵ NITRC-IR (The Neuroimaging Informatics Tools and Resources Clearinghouse Image Repository)¹⁶ and XNAT (The Extensible Neuroimaging Archive Toolkit)¹⁷ systems (table 1). These systems are versatile and emphasise the authority management of data, so the unit of data management is the dataset. It should be emphasised that the neuroimaging data management system is not equivalent to the data warehouse. In addition to the management of access rights and sharing, it is also necessary to consider how to connect each individual’s specific scan or imaging features to other data, such as scans using other imaging modalities and clinical phenotypes. Therefore, we need a more sophisticated data management system.

Table 1

Comparison between INCloud and other neuroimaging platforms

Neuroimaging platform	Connection to scanner	Data storage/backup	Image database	Automatic processing	Brain feature library	Cloud workstation
Neuroscience gateway	No	Storage for computing	No	No	No	Yes Log on using a web browser
Cbrain	No	Storage for computing	No	No	No	Yes Log on using a web browser or a RESTful Web API
XNAT	Yes	Neuroimage data archive	Yes	No	No	No
OpenNeuro	No	Neuroimage data archive	Yes but no cross-project inquiry	Connect to Brainlife for analysis	No	Yes Log on to the data archive using a web browser
COINS	No	Neuroimage data archive	Yes	No	No	Log on to the data archive using a web browser
LONI\IDA	No	Neuroimage data archive	Yes	No	Yes	Yes Log on to the data archive using a web browser
NITRC-IR	No	Cloud storage for computing; Neuroimage data archive	Yes	No	No	Yes Log on to the data archive using a web browser
INCloud	Yes	Cloud storage for computing; Neuroimage data archive	Yes	Web-based neuroimaging processing pipeline	Yes	Yes Log on to the data archive using a web browser, or SSH terminal

COINS, Collaborative Informatics Neuroimaging Suite; INCloud, Integrated Neuroimaging Cloud; LONI\IDA, Image and Data Archive at the Laboratory of Neuro Imaging; NITRC-IR, Neuroimaging Informatics Tools and Resources Clearinghouse Image Repository; SSH, Secure Shell; XNAT, Extensible Neuroimaging Archive Toolkit.

The processing of neuroimages usually relies on complex calculations that combine multiple general or specialised software programs, such as Matlab and FreeSurfer. Installing this software on personal computers and maintaining their operation is not a simple task. The neuroimaging research of many non-technically-oriented researchers has been hindered by this starting point. There is research evidence that the software version and even the operating system version have a systematic influence on the calculation results. For example, FreeSurfer running on different versions of Linux systems will give different skin thickness estimation results. In addition, with the rapid increase in the amount of data and the increase in computational complexity, the performance requirements of computing devices for data analysis far exceed the capacity of personal computers. Therefore, providing researchers with a cloud computing platform can create a seamless connection from the scanner to the data inspection and data analysis platform, reduce technical obstacles for neuroimaging researchers, and improve the efficiency of data analysis and the use of computing resources. There are several cloud-based computing platforms available, such as Neuroscience gateway¹⁸ and Cbrain¹⁹ (see table 1), providing different degrees of flexibility for image analyses. Nevertheless, in terms of ease of use, user familiarity and flexible use of tools, there is still much room for improvement in the computing system for clinical researchers.

To speed up the utilisation of large-scale neuroimaging data, it is necessary to provide a standardised preprocessing pipeline to make the data of multiple research groups comparable and make cross-disease comparison possible. At present, some data-sharing platforms have conducted standardised data mining and analysis attempts. Among them, ENIGMA²⁰ provides ComBat²¹ scripts to deal with the differences between different sites, and proposes agreements for quality control and analysis of genomics and MRI; for ABIDE dataset,²² preprocessed data using five different image processing pipelines, including CCS (Connectome Computation System),²³ C-PAC (Configurable Pipeline for the Analysis of Connectomes),²⁴ DPARSF (Data Processing Assistant for Resting-State fMRI (functional magnetic resonance imaging)),²⁵ CIVET²⁶ and NIAK (Neuroimaging Analysis Kit),²⁷ are shared. In addition, some independent data processing systems, such as volBrain,²⁸ provide automatic brain image processing (skull stripping and brain morphological measures) service and an easy-to-use webpage interface. Furthermore, clinical researchers need a simple and automated multimodal image analysis system to help standardise and simplify neuroimaging preprocessing. To adapt to the cloud storage and management system of neuroimaging data, the pipeline of neuroimaging processing should also be able to be deployed in the cloud and work in connection with the cloud image database. Currently, no system integrates an automated, multi-modal neuroimaging preprocessing and feature extraction pipeline with a cloud database.

In terms of research and clinical transformation of mental disorders, the current neuroimaging research needs to answer questions including the sensitivity and specificity of neuroimaging markers and the dimension of brain abnormalities across mental disorders.^{29 30} Aggregating multiple types of mental disorders data with similar data quality and similar social and cultural conditions on the same platform is conducive to exploring and testing neuroimaging markers for mental disorders. In addition, based on large-scale and highly homogenous neuroimaging data, artificial intelligence methods will promote the application of neuroimaging technology to the diagnosis and treatment of mental disorders and even the choice of treatment options, thereby bringing technological innovations to the diagnosis and treatment of mental illnesses.

To meet the above challenges, we have developed an integrated and highly automated cloud neuroimaging system, Integrated Neuroimaging Cloud (INCloud). INCloud provides a highly automated cloud solution that connects the acquisition, management, analysis and mining, and clinical applications of neuroimaging data. The aims of INCloud are to (1) enhance the value of neuroimaging information to the scientific research and clinical application of neuropsychiatric diseases; (2) relieve researchers from the complex processes of computational environment deployment, image manipulations and preprocessing; (3) provide efficient facilities for cross-disease and cross-modal analyses and (4) translate research data into resources supporting clinical practice.

Design of INCloud

INCloud consists of two main parts, the Neuroimage acquisition system and the Neuroimage computing platform (figure 1). The Neuroimage acquisition system implements functions for scan reservation, basic information acquisition and image data transmission from scanner to cloud. The Neuroimage computing platform serves for data storage/backup, data management, image analyses, brain feature library and clinical services such as computer-aided diagnosis. The arrows in figure 1 indicate the major information flows that connect the functional components.

Figure 1. The overall architecture of INCloud. INCloud, Integrated Neuroimaging Cloud; MRI, magnetic resonance imaging.

Scan reservation system

The neuroimage acquisition system aims to standardise the neuroimage data collection procedures, scan parameters and provides an avenue to connect the images with clinical and historical data. It implements a scan time reservation system that manages the scanners’ operation time slots and user accounts. Meanwhile, the system provides complete sets of commonly used scan sequences and parameter sets for users to choose from and use. Therefore, users can determine the scan sequences and parameters when scheduling a scan. The system encourages users to adopt standardised scanning parameters, so it provides one-key selections of common parameter sets. Users can also customise parameter sets in the system. The scan parameter information selected by the user is passed to the image data transmission system, which will be bound with the image data into the database.

Participant database

The reservation system is connected to the encrypted participant database. The database manages the demographic and major clinical information of the participants, and it can convert the participant’s identity information into an internal unique ID. When users make an appointment for the scanner, they can obtain the internal identifier (ID) of the participants through the participant database. This conversion is essential for securing sensitive information and keeping the data anonymised. The basic information acquisition system can also link previous scans of the same participants and connect to necessary clinical information stored in the hospital information system. After the scan is completed, the participant’s internal ID enters the image data transmission system along with the image data, scan parameter information and so on, to complete the data verification and storage.

Neuroimage database

The neuroimage database is used to manage all neuroimage data. The incoming data are automatically anonymised and backed up. Besides storing the raw image data, the database maintains meta information, such as the internal ID, age, gender, education level and diagnosis categories of the participants, scan date, data owner, sequence name, scan parameters and initial quality assessment. The database also allows data owners to pull their data and authorise other users or user group members to obtain the data.

Image quality control and analysis system

A neuroimage quality control and analysis system is developed to automatically process the multimodal images and extract commonly used brain structural and functional features. This effort helps accelerate the utilisation of neuroimage data and reduce the technical obstacles for clinical researchers to obtain brain measures. The system includes three modules: data conversion, quality control and preprocessing and feature extraction. After converting images from DICOM format to NIFTI format, the quality of the image is evaluated, yielding quality indices such as head motion, signal-to-noise ratio and functional contrast-to-noise ratio. The quality-controlled images are further processed by the preprocessing and feature extraction module. In this module, the neuroimage data of different modalities undergo standardised preprocessing operations, including denoising, spatial transformation, cortical reconstruction of structural images and slice timing correction and registration of functional images. After the image data undergo above standard operations, structural and functional features such as cortical thickness, brain area volume in T1-MPRAGE scans, the amplitude of low-frequency fluctuations, regional homogeneity (ReHo), functional connectivity matrix in BOLD fMRI scans and fractional anisotropy (FA), mean diffusivity (MD) in diffusion tensor imaging (DTI) scans are extracted using a specified parcellation atlas. Both the preprocessed images and the feature tables can be downloaded by authorised users. All the computations are parallelised on a high-performance cluster.

The quality control and image preprocessing system provides a webpage-based user interface for necessary user interactions. After data format conversion, authorised users can manually select which scans enter the automatic processing pipeline. Meanwhile, we provide an interface for users to upload their images to the processing system. After quality control, users and administrators can inspect the quality indices and the images on a webpage to select data for further analyses. When the processing is finished, authorised users can check the quality of the imaging processing, such as the quality of registration, segmentation and parcellation on a webpage. The progress of the processing is also displayed on a webpage with users’ information.

Brain feature library

The brain measures extracted in the analysis system are managed in a neuroimage feature library, combined with demographic and major clinical information. Authorised users can search the library by a variety of conditions regarding the participants and the images. To balance the publicity of information and the protection of users’ private information, we designed the system to display the number of all data items that meet the query conditions, but only list the brain feature data that the current user has sharing permissions for.

Cloud workstation

To provide a flexible, ready-to-use and high-performance platform for customised preprocessing and statistical analyses, we also implement virtual desktops as cloud workstations. Users can access the cloud workstations through Secure Shell (SSH) tunnels or webpages and use them as Linux workstations. The cloud workstations are connected to the neuroimage database, analysis system and feature library, so that users can conduct almost all analyses on the cloud, without the need to download image data to local devices.

Computer-aided diagnosis system

To promote the accumulated data’s value to clinical practice, a computer-aided diagnosis system (CADS) is deployed to learn from the data and provide diagnosis references. The CADS can automatically generate individualised reports for the brain imaging data of specified subjects. The report includes indications of abnormal brain regions and probabilities of diagnostic categories. With the continuous accumulation of image data in INCloud, the internal parameters of CADS are iteratively updated to enhance accuracy.

Functions and advantages

The INCloud provides a full-stack solution for the entire process of large-scale neuroimaging data collection, management, analysis and clinical application. The system has been designed to solve the challenges of the new era of large-scale neuroimaging studies. Figure 2 presents an overview of the INCloud user interface, in which users can launch a variety of functional components.

Figure 2. The web interface of the neuroimaging computing platform, showing functional modules available to users.

A unique feature of INCloud is that it integrates the entire process of neuroimaging research, especially neuroimaging research for brain diseases, into a cloud system. There are several advantages of this feature: (1) Throughout the entire process of data acquisition, management and analysis, the image data are all in the INCloud without downloading to the local device, thereby enhancing the data security and operational efficiency. (2) From the starting point, uniform standards, parameters and procedures are applied as much as possible, and consistent processing procedures and computing environments are used during the data analysis. This is conducive to the integration and in-depth utilisation of data. (3) The shared use and dynamic allocation of computing and storage resources help to improve resource utilisation and reduce resource waste caused by repeated construction. (4) Standardised and integrated systems make sure the management of image data does not just stay in the role of ‘network disk’ but refines the managed objects into neuroimaging features. This enables more information contained in neuroimaging to be discovered, used and shared. (5) A complete data collection and analysis chain helps the accumulated neuroimaging data to be conveniently and quickly converted from basic research to clinical services.

Connecting the image quality control and analysis system to the neuroimage database brings in another novel feature of INCloud, the brain feature library. This database manages image features so that they can be queried, integrated, analysed and shared. Figure 3A shows the query interface of the brain feature library. Users can query brain measures based on the unique ID of a participant, birth date, sex, major diagnostic category, whether it is first-episode, drug medication, with follow-up measures, research project name, age range, scanner, version of the processing pipeline and image quality ratings. Figure 3B presents an example of the query result page. The available features can be viewed on this webpage and downloaded as a table.

Figure 3. The query interface of the brain feature library (A) and the query results (B).

On the one hand, this function helps clinical researchers to obtain image data analysis results in a highly structured form that is ready for statistical analyses, thereby alleviating research difficulties caused by technical reasons, on the other hand, this database can support a new type of brain feature meta-analysis. Researchers can request brain feature data for in-depth analysis for specific scientific questions. This realises the protection of the raw data and also promotes the extensive sharing and mining of brain characteristic information. Different from the existing imaging meta-analyses, the collection and process of the data in the brain feature library have applied consistent standards and procedures, which eliminates many confounding factors and is expected to improve the statistical power of the analysis.

Figure 4 presents a few examples of studies that are conducted using the brain feature library. As an example of a study using real data from INCloud, the researchers first queried and downloaded image feature data across multiple psychiatric disorders through the query interface of the brain feature library. After that, it is possible to conduct a cross-disease investigation on certain brain regions (figure 4A). Both the relationships between brain features in a given population and interpopulational relationships based on multivariate patterns of brain features can be investigated (figure 4B). Furthermore, in the psychiatric research field, there are new research questions towards transdiagnosis. Figure 4C demonstrates transdiagnosis investigations based on multivariate brain features. Meanwhile, the CADS, which is based on the current state-of-the-art artificial intelligence technology and tuned by the large-scale brain feature library, provides clinicians with valuable reference opinions in the diagnosis process, and clinicians can acquire individualised image reports of the patients for references of diagnostic opinions, as shown in figure 4D.

Figure 4. Examples of research that can be carried out based on INCloud. (A) Cross-disease investigation of a certain brain region. (B) Covariation analysis of brain regions across different diseases (a), effect size analysis (b), multivariate pattern analyses (c) and disease similarity analyses (d). (C) Transdiagnostic analysis of dimensions of brain deficits. (D) Development of computer-aided diagnosis system. INCloud,Integrated Neuroimaging Cloud; MR, magnetic resonance.

Summary and outlook

INCloud crystallises the ideas and methods developed in our many years of practice to solve the practical difficulties encountered in large-scale neuroimaging research of brain diseases. At present, INCloud has been deployed and widely used at the Shanghai Mental Health Center and other research and medical institutions. The biggest advantage of this system is that it realises the integrated management and processing of the whole process of neuroimaging research and is optimised for brain disease research, so it is suitable for institutions with brain disease as a major research object. INCloud helps multiple teams work together to collect high-consistency large-scale neuroimaging data and provides high-performance, automated analysis, a data-sharing platform and other functions for such projects. We plan to use cloud servers to make components of INCloud, that is, the image quality control and preprocessing system and cloud workstation available outside the hospital, and we expect this system to make an important contribution to the research of brain diseases. In the future, we will continuously improve INCloud, implementing more choices for the image processing engine, integrating more data-mining algorithms^31–35 and further enhancing the accuracy of the CADS.

We acknowledge all members of the Psychiatric Imaging Consortium for sharing data; Shanghai Qianhu Technology Co., Ltd. provided technical assistance for the realisation of INCloud.

Data availability statement

Data may be obtained from a third party and are not publicly available.

Ethics statements

Patient consent for publication

Not applicable.

Ethics approval

This study does not involve human participants.

Footnote

Twitter @ZhiYang_psy

QL and LJ contributed equally.

Contributors QL and LJ performed the literature search and drafted the manuscript. QL, LJ, KQ, YH, YD, and XZ were involved in building the INCloud. ZY and CL designed the INCloud and edited the manuscript. All authors read and approved the final version of the manuscript. ZY serves as the guarantor who accepts full responsibility for the work and the conduct of the study, had access to the data, and controlled the decision to publish the manuscript.

Funding This work was supported by the National Key R&D Program of China (2018YFC2001605), National Natural Science Foundation of China (81971682, 81571756), Natural Science Foundation of Shanghai (20ZR1472800), Shanghai Municipal Commission of Education (Gaofeng Clinical Medicine-20171929), Shanghai Clinical Research Center for Mental Health (19MC1911100), Shanghai Municipal Health Commission (2019ZB0201, 2018BR17), Shanghai Science and Technology Commission (18JC1420305), Shanghai Mental Health Center Clinical Research Center (CRC2018DSJ01-5, CRC2019ZD04), and Research Funds from Shanghai Mental Health Center (13dz2260500, 2018-YJ-02).

Competing interests None declared.

Provenance and peer review Commissioned; externally peer reviewed.

References

¹ Boedhoe PSW, van Rooij D, Hoogman M, et al. Subcortical brain volume, regional cortical thickness, and cortical surface area across disorders: findings from the enigma ADHD, ASD, and OCD working groups. Am J Psychiatry 2020; 177: 834–43. doi:10.1176/appi.ajp.2020.19030331 http://www.ncbi.nlm.nih.gov/pubmed/32539527

² Lees B, Squeglia LM, McTeague LM, et al. Altered neurocognitive functional connectivity and activation patterns underlie psychopathology in preadolescence. Biol Psychiatry Cogn Neurosci Neuroimaging 2021; 6: 387–98. doi:10.1016/j.bpsc.2020.09.007 http://www.ncbi.nlm.nih.gov/pubmed/33281105

³ Tang S, Sun N, Floris DL, et al. Reconciling dimensional and categorical models of autism heterogeneity: a brain connectomics and behavioral study. Biol Psychiatry 2020; 87: 1071–82. doi:10.1016/j.biopsych.2019.11.009 http://www.ncbi.nlm.nih.gov/pubmed/31955916

⁴ Cheng W, Zhang F, Liu Z, et al. A psychological health support scheme for medical teams in COVID-19 outbreak and its effectiveness. Gen Psychiatr 2020; 33: e100288. doi:10.1136/gpsych-2020-100288 http://www.ncbi.nlm.nih.gov/pubmed/34192236

⁵ Cheng W, Zhang F, Hua Y, et al. Development of a psychological first-aid model in inpatients with COVID-19 in Wuhan, China. Gen Psychiatr 2020; 33: e100292. doi:10.1136/gpsych-2020-100292 http://www.ncbi.nlm.nih.gov/pubmed/32596642

⁶ Mu Y, Li Y, Zhang Q, et al. Amplitude of low-frequency fluctuations on Alzheimer's disease with depression: evidence from resting-state fMRI. Gen Psychiatr 2020; 33: e100147. doi:10.1136/gpsych-2019-100147 http://www.ncbi.nlm.nih.gov/pubmed/32695958

⁷ Yang H, Xu H, Li Q, et al. Study of brain morphology change in Alzheimer's disease and amnestic mild cognitive impairment compared with normal controls. Gen Psychiatr 2019; 32: e100005. doi:10.1136/gpsych-2018-100005 http://www.ncbi.nlm.nih.gov/pubmed/31179429

⁸ Cai H, Ning S, Li W, et al. Patient with frontal-variant syndrome in early-onset Alzheimer's disease. Gen Psychiatr 2020; 33: e100173. doi:10.1136/gpsych-2019-100173 http://www.ncbi.nlm.nih.gov/pubmed/32215362

⁹ Gao J, Chen G, Wu J, et al. Reliability map of individual differences reflected in inter-subject correlation in naturalistic imaging. Neuroimage 2020; 223: 117277. doi:10.1016/j.neuroimage.2020.117277 http://www.ncbi.nlm.nih.gov/pubmed/32818614

¹⁰ Xie S, Zhang X, Cheng W, et al. Adolescent anxiety disorders and the developing brain: comparing neuroimaging findings in adolescents and adults. Gen Psychiatr 2021; 34: e100411. doi:10.1136/gpsych-2020-100411 http://www.ncbi.nlm.nih.gov/pubmed/34423252

¹¹ Radua J, Vieta E, Shinohara R, et al. Increased power by harmonizing structural MRI site differences with the combat batch adjustment method in enigma. Neuroimage 2020; 218: 116956. doi:10.1016/j.neuroimage.2020.116956 http://www.ncbi.nlm.nih.gov/pubmed/32470572

¹² Yu M, Linn KA, Cook PA, et al. Statistical harmonization corrects site effects in functional connectivity measurements from multi-site fMRI data. Hum Brain Mapp 2018; 39: 4213–27. doi:10.1002/hbm.24241 http://www.ncbi.nlm.nih.gov/pubmed/29962049

¹³ Antony JW, Hartshorne TH, Pomeroy K, et al. Behavioral, physiological, and neural signatures of surprise during naturalistic sports viewing. Neuron 2021; 109: 377–90. doi:10.1016/j.neuron.2020.10.029 http://www.ncbi.nlm.nih.gov/pubmed/33242421

¹⁴ Crawford KL, Neu SC, Toga AW. The image and data archive at the laboratory of Neuro imaging. Neuroimage 2016; 124: 1080–3. doi:10.1016/j.neuroimage.2015.04.067 http://www.ncbi.nlm.nih.gov/pubmed/25982516

¹⁵ Landis D, Courtney W, Dieringer C, et al. Coins data exchange: an open platform for compiling, curating, and disseminating neuroimaging data. Neuroimage 2016; 124: 1084–8. doi:10.1016/j.neuroimage.2015.05.049 http://www.ncbi.nlm.nih.gov/pubmed/26019122

¹⁶ Kennedy DN, Haselgrove C, Riehl J, et al. The NITRC image Repository. Neuroimage 2016; 124: 1069–73. doi:10.1016/j.neuroimage.2015.05.074 http://www.ncbi.nlm.nih.gov/pubmed/26044860

¹⁷ Herrick R, Horton W, Olsen T, et al. XNAT central: open sourcing imaging research data. Neuroimage 2016; 124: 1093–6. doi:10.1016/j.neuroimage.2015.06.076 http://www.ncbi.nlm.nih.gov/pubmed/26143202

¹⁸ Carnevale T, Majumdar A, Sivagnanam S, et al. The neuroscience gateway portal: high performance computing made easy. BMC Neurosci 2014; 15: 101. doi:10.1186/1471-2202-15-S1-P101

¹⁹ Sherif T, Rioux P, Rousseau M-E, et al. CBRAIN: a web-based, distributed computing platform for collaborative neuroimaging research. Front Neuroinform 2014; 8: 54. doi:10.3389/fninf.2014.00054 http://www.ncbi.nlm.nih.gov/pubmed/24904400

²⁰ Thompson PM, Stein JL, Medland SE, et al. The enigma Consortium: large-scale collaborative analyses of neuroimaging and genetic data. Brain Imaging Behav 2014; 8: 153–82. doi:10.1007/s11682-013-9269-5 http://www.ncbi.nlm.nih.gov/pubmed/24399358

²¹ Johnson WE, Li C, Rabinovic A. Adjusting batch effects in microarray expression data using empirical Bayes methods. Biostatistics 2007; 8: 118–27. doi:10.1093/biostatistics/kxj037 http://www.ncbi.nlm.nih.gov/pubmed/16632515

²² Di Martino A, Yan C-G, Li Q, et al. The autism brain imaging data exchange: towards a large-scale evaluation of the intrinsic brain architecture in autism. Mol Psychiatry 2014; 19: 659–67. doi:10.1038/mp.2013.78 http://www.ncbi.nlm.nih.gov/pubmed/23774715

²³ Xu T, Yang Z, Jiang L, et al. A connectome computation system for discovery science of brain. Sci Bull 2015; 60: 86–95. doi:10.1007/s11434-014-0698-3

²⁴ Craddock C, Sikka S, Cheung B, et al. Towards automated analysis of connectomes: the configurable pipeline for the analysis of connectomes (C-PAC). Front. Neuroinform. Conference Abstract: Neuroinformatics 2013, 2013. doi:10.3389/conf.fninf.2013.09.00042

²⁵ Chao-Gan Y, Yu-Feng Z. DPARSF: A MATLAB Toolbox for "Pipeline" Data Analysis of Resting-State fMRI. Front Syst Neurosci 2010; 4: 13. doi:10.3389/fnsys.2010.00013 http://www.ncbi.nlm.nih.gov/pubmed/20577591

²⁶ Kim JS, Singh V, Lee JK, et al. Automated 3-D extraction and evaluation of the inner and outer cortical surfaces using a Laplacian map and partial volume effect classification. Neuroimage 2005; 27: 210–21 http://www.ncbi.nlm.nih.gov/pubmed/15896981 doi:10.1016/j.neuroimage.2005.03.036

²⁷ Bellec P, Rosa-Neto P, Lyttelton OC, et al. Multi-Level bootstrap analysis of stable clusters in resting-state fMRI. Neuroimage 2010; 51: 1126–39 http://www.ncbi.nlm.nih.gov/pubmed/20226257 doi:10.1016/j.neuroimage.2010.02.082

²⁸ Manjón JV, Coupé P. volBrain: an online MRI brain volumetry system. Front Neuroinform 2016; 10: 30. doi:10.3389/fninf.2016.00030 http://www.ncbi.nlm.nih.gov/pubmed/27512372

²⁹ Mitelman SA. Transdiagnostic neuroimaging in psychiatry: a review. Psychiatry Res 2019; 277: 23–38. doi:10.1016/j.psychres.2019.01.026 http://www.ncbi.nlm.nih.gov/pubmed/30639090

³⁰ Lerman-Sinkoff DB, Kandala S, Calhoun VD, et al. Transdiagnostic multimodal neuroimaging in psychosis: structural, resting-state, and task magnetic resonance imaging correlates of cognitive control. Biol Psychiatry Cogn Neurosci Neuroimaging 2019; 4: 870–80. doi:10.1016/j.bpsc.2019.05.004 http://www.ncbi.nlm.nih.gov/pubmed/31327685

³¹ Yang Z, Wu J, Xu L, et al. Individualized psychiatric imaging based on inter-subject neural synchronization in movie watching. Neuroimage 2020; 216: 116227. doi:10.1016/j.neuroimage.2019.116227 http://www.ncbi.nlm.nih.gov/pubmed/31568871

³² Yang Z, Zuo X-N, Wang P, et al. Generalized RAICAR: discover homogeneous subject (sub)groups by reproducibility of their intrinsic connectivity networks. Neuroimage 2012; 63: 403–14. doi:10.1016/j.neuroimage.2012.06.060 http://www.ncbi.nlm.nih.gov/pubmed/22789741

³³ Yang Z, Xu Y, Xu T, et al. Brain network informed subject community detection in early-onset schizophrenia. Sci Rep 2014; 4: 5549. doi:10.1038/srep05549 http://www.ncbi.nlm.nih.gov/pubmed/24989351

³⁴ Li Q, Xing X, Sun Y, et al. Novel iterative attention focusing strategy for joint pathology localization and prediction of MCI progression. International Conference on Medical Image Computing and Computer-Assisted Intervention, 2019: 307–15.

³⁵ Li Q, Huo Q, Xing X. Spatial and depth weighted neural network for diagnosis of Alzheimer's disease. Int Soc Opt Photonics 2019; 10950. doi:10.1117/12.2512645