Classification of Healthy Subjects and Alzheimer's Disease Patients with Dementia from Cortical Sources of Resting State EEG Rhythms: A Study Using Artificial Neural Networks

Abstract

Previous evidence showed a 75.5% best accuracy in the classification of 120 Alzheimer’s disease (AD) patients with dementia and 100 matched normal elderly (Nold) subjects based on cortical source current density and linear lagged connectivity estimated by eLORETA freeware from resting state eyes-closed electroencephalographic (rsEEG) rhythms (Babiloni et al., 2016). Specifically, that accuracy was reached using the ratio between occipital delta and alpha1 current density for a linear univariate classifier (receiver operating characteristic curves). Here we tested an innovative approach based on an artificial neural network (ANN) classifier from the same database of rsEEG markers. Frequency bands of interest were delta (2-4 Hz), theta (4-8 Hz Hz), alpha1 (8-10.5 Hz), and alpha2 (10.5-13 Hz). ANN classification showed an accuracy of 77% using the most 4 discriminative rsEEG markers of source current density (delta/alpha1 and theta/alpha1 ratios in posterior cortical lobes). It also showed an accuracy of 72% using the most 4 discriminative rsEEG markers of source lagged linear connectivity (alphas between posterior cortical lobes). With these 8 markers combined, an accuracy of at least 76% was reached. Although these linear rsEEG markers of cortical activity and connectivity unveil different relevant neurophysiological mechanisms underpinning cortical arousal and vigilance in AD patients, they provide quite redundant information for classification purposes. Future AD studies should use ANNs combining the present markers with other linear (i.e. directed transfer function) and nonlinear rsEEG markers to improve the classification accuracy.

Introduction

Alzheimer's disease (AD) is the most prevalent neurodegenerative disorder affecting the aged people. In AD, a progressive neurodegeneration leads to dementia, characterized by severe cognitive deficits, behavioral symptoms, and loss of autonomy in the daily life (Braak and Braak, 1995).

In the past years, the International Working Group (IWG) and the US National Institute on Aging–Alzheimer's Association (NIA-AA) have proposed an algorithm for the diagnosis of AD based on in vivo biomarkers and clinical phenotypes of disease (Förstl and Kurz, 1999; Dubois et al., 2007, 2014; Jack et al., 2010; Albert et al., 2011; McKhann et al., 2011; Sperling et al., 2011). According to the last IWG guidelines (Dubois et al., 2014), diagnostic biomarkers are limited to pathophysiological markers. On one hand, these markers include cerebrospinal fluid (CSF) markers, as revealed by the measures of Aβ-42, total tau, and phospho-tau; on the other hand, they include abnormal Aβ-42 and tau accumulation in the brain, as revealed by ligand positron emission tomography (PET) (Förstl and Kurz, 1999). The last IWG guidelines encourage the use of topographic markers even if they are not diagnostic. These markers are quite useful to map structural and functional impairment of the brain over time, especially in elderly subjects with initial objective evidence of mild cognitive impairment (MCI) including memory and other cognitive domains but with preserved independence in the daily activities. The topographic markers include maps of brain hypometabolism, as revealed by FDG-PET, and maps of brain atrophy and abnormalities of structural and functional brain connectivity, as revealed by structural and functional magnetic resonance imaging (MRI). All those methodologies can capture several processes of disease, but their use is limited because of low availability of the instruments, costs or invasiveness, especially for serial recordings over time.

Keeping in mind the intrinsic limitations of the CSF, MRI, and PET, several independent research groups tested indexes of resting state eyes-closed electroencephalographic (rsEEG) rhythms as candidate topographic markers of AD (Babiloni et al., 2016b). EEG rhythms are the most important feature of collective behavior of brain neural populations and are very relevant for human cognition. Furthermore, EEG procedures are largely available in any country, well tolerated by patients, not affected by subjects' anxiety or task difficulty, and can be repeated over time without habituation effects (Babiloni et al., 2016b).

Previous studies in AD patients and elderly subjects with amnesic MCI have shown that rsEEG may be promising markers for a neurophysiological evaluation of disease status as topographic markers. When compared to groups of normal elderly (Nold) subjects, AD groups have been characterized by high power of widespread delta and theta rhythms, as well as by low power of posterior alpha and/or beta rhythms (Dierks et al., 1993, 2000; Huang et al., 2000; Ponomareva et al., 2003; Jeong, 2004).

The use of rsEEG variables as neurophysiologic topographic markers of AD implies that these variables can classify Nold and AD individuals at least with a moderate classification accuracy of 75–80%. In the past years, two papers revised the literature on the accuracy of the classification between AD and Nold individuals by rsEEG features systematically. The article of Jonkman (1997) reviewed 16 studies published in 1983–1995. In those studies, the classification accuracy ranged from 54 to 100% (median of 81%) for the discrimination of the patients with AD dementia and Nold subjects. In the same vein, the paper of Jelic and Kowalski (2009) reviewed 46 studies published in 1980–2008. The classification accuracy ranged from 80 to 85% for the discrimination of the patients with AD dementia (or MCI) and control subjects such as Nold or other forms of dementia.

The present research group has been investigating markers of rsEEG rhythms in MCI, AD, and control subjects in the framework of “BRAINON” program (http://www.brainon.eu). In previous studies of this program, cortical sources of rsEEG rhythms in MCI, AD, and control groups of subjects were estimated by the freeware low-resolution brain electromagnetic tomography (LORETA; Pascual-Marqui et al., 1994). The aim was to enhance spatial information content of scalp-recorded EEG data and to unveil topography of EEG abnormalities associated with AD from prodromal to overt clinical stages (Babiloni et al., 2004, 2008, 2009, 2010, 2011a,b, 2013a,b, 2016b). It was reported that temporal, parietal, and occipital cortical sources of delta and alpha rhythms were altered in AD groups compared with control groups as a function cognitive deficits and abnormalities in brain integrity (Babiloni et al., 2004, 2008, 2009, 2010, 2011a,b, 2013a,b, 2016b).

Recently, our research group tested the hypothesis that Nold and AD individuals with dementia can be discriminated with a moderate accuracy using topographic markers of the rsEEG source current density and functional connectivity (Babiloni et al., 2016a). Results showed a classification accuracy of 75.5% in the discrimination of 120 AD patients with dementia and 100 matched Nold subjects based on cortical source current density (Babiloni et al., 2016a). Of note, this accuracy was obtained by an univariate classifier such as receiver operating characteristic (ROC) curve from the ratio between occipital delta (2–4 Hz) and alpha 1 (8–10.5 Hz) current density. Here we tested if a multivariate classification with artificial neural networks (ANNs) improved that classification accuracy of those original rsEEG markers in AD and Nold individuals. The main issue was whether the combined use of cortical source current density and functional connectivity as inputs of a trained ANN would provide more accurate classifications than those obtained with the two classes of spectral EEG markers considered separately.

Materials and Methods

Details on the subjects, rsEEG database, eLORETA source estimation, and classification with ROC curves were reported in the reference paper quoted in the previous section (Babiloni et al., 2016a). In the following sections, we provide a short description of those methodological procedures for readers' convenience.

Subjects and Diagnostic Criteria

The clinical and rsEEG data of the present study refer to 120 AD with dementia and 100 Nold individuals, matched for age, years of education, and gender. Committees of local institutional ethics approved the recording and analysis of EEG data for scientific purposes. Each participant or caregiver subscribed informed consent, in line with the Code of Ethics of the World Medical Association (Declaration of Helsinki).

Probable AD was diagnosed according to the criteria of the Diagnostic and Statistical Manual of Mental Disorders, fourth edition (DSM-IV-TR; American Psychiatric Association) and the National Institute of Neurological Disorders and Stroke–Alzheimer Disease and Related Disorders (NINCDS-ADRDA) working group (McKhann et al., 1984). Individuals underwent medical, neuropsychological, neurological, and psychiatric assessments including Instrumental Activities of Daily Living scale (IADL; Lawton and Brody, 1969), Mini-Mental State Examination (Folstein et al., 1975), Clinical Dementia Rating (CDR; Hughes et al., 1982), and Geriatric Depression Scale (GDS; Yesavage et al., 1983). Exclusion criteria included any kind of evidence of other forms or causes of dementia such as frontotemporal dementia (The Lund and Manchester Groups, 1994), vascular dementia diagnosed according to the criteria of the National Institute of Neurological Disorders and Stroke and Association Internationale pour la Recherché et l'Enseignement en Neurosciences (NINDS-AIREN) working group (Román et al., 1993), Parkinson disease (PD), Dementia with Lewy Bodies (DLB; McKeith et al., 2005), metabolic syndrome, nutritional deficits, tumors, etc. When given, benzodiazepines, antidepressant and/or antihypertensive were suspended for about 24 h before EEG recordings. This procedure did not ensure a complete washout of the drug–longer periods would not have been applicable for obvious ethical reasons- but it made it possible to compare the drug condition across the AD patients. Of note, most of the AD patients (114 out of 120 patients, i.e., 95%) followed a long-term treatment with standard daily doses of acetylcholinesterase inhibitors. In detail, they followed a treatment with donepezil (71 patients; 5–10 mg/die), rivastigmine (29 patients; 10 mg/die) or galantamine (14 patients; 16–36 mg/die).

The Nold subjects underwent medical, neurological, and psychiatric assessments including MMSE (Folstein et al., 1975), Clinical Dementia Rating (CDR; Hughes et al., 1982) and geriatric depression scale (GDS; Yesavage et al., 1983), to exclude from the study subjects with a history of neurological, or psychiatric disorders (including abuse of substances). Finally, a further exclusion criterion was a score in the MMSE lower than 27 for the Nold subjects and higher than 24 for the AD subjects, according to Alzheimer‘s Disease Neuroimaging Initiative (ADNI; http://adni.loni.usc.edu).

Table 1 summarizes some demographic and clinical data of the subjects. T-test evaluated the differences (p < 0.05, one-tailed) between the groups (Nold and AD) for age, education, MMSE score, and individual alpha frequency (IAF; see below for a description of this index). As expected, a statistically significant difference was found for the MMSE score (p < 0.0001; higher MMSE score in the Nold than in the AD group) and for the IAF (p < 0.0001; higher IAF in the Nold than in the AD group), while no statistically significant difference was found for age, gender, and education (p > 0.05).

TABLE 1

Table 1. Demographic and clinical data of normal elderly (Nold) subjects and Alzheimer's disease (AD) patients with dementia.

EEG Recordings and Preliminary Data Analysis

During rsEEG recordings, all subjects had to stay with eyes closed in a relaxing state, not moving or talking. 5 min of rsEEG data (EB-Neuro Be-light©, Firenze, Italy) were recorded (128 Hz or higher sampling rate, with a bandpass between 0.01 and 100 Hz) from 19 scalp electrodes positioned over the whole scalp according to the 10–20 System (i.e., Fp1, Fp2, F7, F3, Fz, F4, F8, T3, C3, Cz, C4, T4, T5, P3, Pz, P4, T6, O1, and O2). EEG recordings were performed using frontal cephalic or extracephalic (linked earlobe) reference. Linked earlobe reference electrode was preferred because frontal cephalic reference could attenuate the extracerebral ocular activity on prefrontal (i.e., Fp1, Fp2) and frontal (i.e., F7, F3, Fz, F4, F8) electrodes. However, the use of extracephalic reference was not mandatory to respect the methodological facilities and standard internal protocols of the clinical recording units when the data collection occurred outside a formal clinical trial with a harmonized protocol for the electrode montage. A ground electrode was located between the AFz and Fz electrodes, and scalp electrodes impedances were kept below 5 Kohm. Horizontal and vertical electro-oculographic (EOG) potentials (0.3–70 Hz bandpass) were also recorded to monitor blinking and eye movements.

As a methodological remark, all the mentioned clinical units recorded EEG data with the sampling rate and EEG bandpass set to avoid aliasing. A minority of these rsEEG data (less than 20%) was acquired with 128-Hz sampling frequency. Noteworthy, the use of 128 Hz sampling frequency was sub-optimal for a correct reconstruction of rsEEG signal beyond 40 Hz without aliasing (One has to set a factor from 3 or 4 between the low-pass limit of the analog bandpass filter and the rsEEG sampling frequency).

The EEG data were divided into segments of 2 s and analyzed off-line. The epochs affected by any physiological (ocular, muscular) or non-physiological artifacts were preliminarily identified by an automatic computerized procedure. Two independent experimenters manually checked the artifact-free EEG epochs, before successive analysis. Particular attention was dedicated to the identification of extracerebral contamination of ocular activity (i.e., blinking) in frontal (i.e., F7, F3, Fz, F4, and F8) and prefrontal (Fp1 and Fp2) electrodes, comparing EOG and EEG traces, in EEG recordings with frontal cephalic reference. Finally, all recorded artifact-free EEG data were off-line re-referenced to common average to harmonize the EEG data collected with different reference electrodes.

We computed the spectral power density of the EEG rhythms using a 0.5 Hz frequency resolution Fast Fourier Transform (FFT, Welch algorithm, Hanning window, no phase shift). In line with previous relevant EEG studies (Jelic et al., 1996; Besthorn et al., 1997; Chiaramonti et al., 1997; Babiloni et al., 2005, 2006, 2011b, 2013c), we considered the following standard frequency bands of interest: Delta (2–4 Hz), theta (4–8 Hz), alpha 1 (8–10.5 Hz), alpha 2 (10.5–13 Hz), beta 1 (13–20 Hz), beta 2 (20–30 Hz), and gamma (30–40).

Cortical Sources of rsEEG Rhythms as Computed by eLORETA

We used the free tool “exact LORETA” (eLORETA) for the linear estimation of the cortical sources activity of rsEEG rhythms in the frequency domain (Pascual-Marqui, 2007a). eLORETA represents the improved version of the previous pieces of software called LORETA (Pascual-Marqui et al., 1994) and standardized LORETA (Pascual-Marqui et al., 2002). Both standardized LORETA and eLORETA showed the same low spatial resolution, with zero localization error in the presence of measurement and biological noise (Pascual-Marqui et al., 2002; Pascual-Marqui, 2007a). However, eLORETA exhibited a better source location in some control parameters (Canuet et al., 2011).

eLORETA uses a head volume conductor model composed of the scalp, skull, and brain. In the scalp compartment, exploring electrodes can be virtually positioned to give EEG data as an input to the source estimation (Jurcak et al., 2007). The brain model is based on a realistic cerebral shape taken from a template typically used in the neuroimaging studies, namely that of the Montreal Neurological Institute (MNI152 template; Mazziotta et al., 1995). The electrical brain source space is formed by 6239 voxels with 5 mm resolution, restricted to cortical gray matter (Fuchs et al., 2002). An equivalent current dipole is located in each voxel. eLORETA solves the so-called EEG inverse problem in the mentioned head volume conductor model estimating “neural” current density values at any cortical voxel for each frequency bin. Input for this regularized inverse estimation (Pascual-Marqui et al., 2002) is the EEG spectral power density computed at all virtual scalp electrodes.

In line with the general low spatial resolution of the present EEG methodological approach (i.e., 19 scalp electrodes), the eLORETA solutions were averaged across all voxels in a given cortical macroregion of interest (ROI). The ROIs corresponding to frontal, central, parietal, occipital, temporal, and limbic large regions are shown in Figure 1. These eLORETA solutions were used as rsEEG markers of “cortical source current density reflecting neural synchronization” for the present classification purposes.

FIGURE 1

Figure 1. Regions of interest (ROIs) for the estimation of the cortical sources of resting state eyes-closed electroencephalographic (rsEEG) rhythms by exact low-resolution brain electromagnetic tomography (eLORETA) software.

eLORETA was also used to estimate the functional connectivity between pairs of ROIs as a measurement of the neural signal communication across distributed populations of cortical neurons in the resting state condition. To this aim, we used the so-called lagged linear connectivity (LLC) tool of eLORETA (Pascual-Marqui, 2007b; Pascual-Marqui et al., 2011). LLC is a linear measure of rsEEG coherence that overcomes the problem of the high phase synchronization and the zero-lag coherence possibly introduced by the procedure of eLORETA source estimation. LLC is also expected to minimize the influence of a third rsEEG source having an influence on the instantaneous coherence between two rsEEG sources not dependent each other (the so-called “common feeding” issue).

For each subject and rsEEG frequency band of interest (i.e., delta, theta, alpha 1, alpha 2, beta 1, beta 2, and gamma), the LLC was computed for 6 ROIs (i.e., frontal, central, parietal, occipital, temporal, and limbic). For the inter-hemispherical analysis, the LLC estimates were calculated between all voxels of the mentioned ROIs of each hemisphere with the corresponding ones of the other hemisphere. The LLC solutions for all voxels of a given pair of ROIs were averaged. For the intra-hemispherical analysis, the LLC estimates were computed for all voxels of a particular ROI with all voxels of another ROI of the same hemisphere. The LLC solutions for all voxels of a given pair of ROIs were averaged, for both the right and the left hemisphere. Those LLC solutions were used as rsEEG markers of “cortical functional connectivity” for the present classification purposes.

The rsEEG Markers Used as Inputs for Artificial Neural Networks (ANNs)

In the present study, we selected the markers of eLORETA source current density and functional connectivity (LLC) showing a better discrimination between the Nold and AD individuals as revealed by an area under the ROC curves over 70% in the reference study (Babiloni et al., 2016a). According to this criterion, alpha 2, beta 1, beta 2, and gamma rsEEG markers were not considered in the following.

For the eLORETA source current density, we considered 10 markers showing a classification accuracy higher than 75%, namely parietal, temporal, occipital, limbic, central, and frontal theta/alpha1 (i.e., ratio between theta and alpha 1) as well as parietal, temporal, occipital, and limbic delta/alpha1 (i.e., ratio between delta and alpha 1).

For the eLORETA source functional connectivity (LLC), we used 4 markers exhibiting a classification accuracy better than 70%, namely inter-hemispherical occipital delta/alpha 1 as well as intra-hemispherical left occipital-temporal theta/alpha 1, right parietal-limbic alpha 1, and right occipital-temporal theta/alpha 1.

ANNs: Architecture and Procedure for the Classification of rsEEG Markers in Nold and AD Individuals

ANN is a mathematical machine learning technique inspired by the core functioning of a biologic nervous system composed of simple processing elements that are interconnected and layered. The main elements of the ANN were inputs, internal, and output layers, which were composed of virtual neurons highly interconnected with each other according to different topologies. Any virtual neuron of a layer was connected to all the neurons of the adjacent layers. Every connection between two virtual neurons was expressed by weight, which represented the “strength” of the connection itself. The weight between each pair of virtual neurons was computed by a learning algorithm along the training phase of ANN, when a set of input examples (training dataset with known classification output) were used as an input to ANN to allow this network to represent the implicit rules that link input features and the classification required as an output (e.g., in the present study, Nold vs. AD individuals). At the end of the training phase, the weights between pairs of neurons represented such rules. In the testing phase, the ability of the ANN to classify was tested in an independent series of datasets.

From a formal point of view, let us indicate with N1 the number of virtual neurons belonging to the l^th layer and with ok the output of the kth neuron of the l^th layer. Then, the computation performed by each virtual neuron can be expressed as:

netkl=∑l=1Nl−1wkjlojl−1okl =f(netkl)

Wherenetkl is the weighted sum of the k neurons of the l^th layer, wkj is the weight by which the same virtual neuron multiplies the outputoj(l−1) of the j^th neuron of the previous layer, and f(.) is the so-called activation function, (Basheer and Hajmeer, 2000). The principal activation functions are: log-sigmoid function (logsig), tangent sigmoid function (tansig), saturating linear function (satlin), symmetric saturating linear function (satlins), and pure linear function (purelin).

In the present study, the ANN procedure for the classification of the Nold and AD individuals was formed by the following three steps (see details in Bevilacqua et al., 2016).

In the first step of the procedure, the optimal topology and minimization functions of the ANNs were defined, namely the proper number of ANN hidden layers, the types of activation functions and the number of virtual neurons per any layer, based on the general features of the rsEEG markers in the Nold and AD individuals to be classified. Several approaches could be found in the literature for the search of ANNs best topology using genetic algorithms, e.g., in Bevilacqua et al. (2006). In a previous study (Bevilacqua et al., 2015) a Multi-Objective Genetic Algorithm strategy was proposed to design a robust supervised ANN classifier between AD and NOLD based on EEG markers. Conversely, in this work the search of ANNs best topology was performed by using a Mono-Objective Genetic Algorithm (see details in Bevilacqua et al., 2016) maximizing the mean accuracy calculated on 500 iterations of training, validation and test using random permutations of the input dataset.

Specifically, each “chromosome” modeled all the main features of ANN topology, or rather the number of neurons in the hidden layers (ranging between 1 and 256 for the first hidden layer and from 0 to 255 for the other layers) and their activation functions; in this work, the considered activation functions were the logsig, tansig, purelin, and satlins. Moreover, the activation function set for the neuron in the output layer was the hyperbolic tangent sigmoid (tansig). Before training phase, the whole dataset was standardized using the z-score technique (Zill and Cullen, 2000) whose aim was to rescale data absolute value in an interval centered in 0 and with variance equal to 1.

In the second step of the procedure, the ANNs were trained to determine the connection weights for all virtual neurons and layers. These weights had to optimize the association between the rsEEG source markers in the Nold and AD individual datasets as an input and the correct classification as “Nold” or “AD” in the output virtual neuron. This second step started with the initialization of the connection weights of the virtual neurons by the Nguyen-Widrow's algorithm (Nguyen and Widrow, 1990), which is an efficient method to speed up such a training phase.

After that initialization, the ANNs were trained by a standard supervised learning algorithm namely “Resilient Backpropagation” (Riedmiller and Braun, 1993), adapting the connection weights to minimize the error in the association between the rsEEG source markers in the virtual input neurons and the correct classification as “Nold” or “AD”. In the training phase, the ANN assumed to the best connection weights for all virtual neurons and layers to optimize that association. To this purpose, the whole database of the mentioned rsEEG source markers was divided into three subsets corresponding to 60% (training subset), 20% (validation subset), and 20% (testing subset) of all Nold and AD individual datasets available, respectively. During the second step of the procedure, the training subset was used to train the ANN while the validation subset served to adapt the connection weights of the virtual neurons to avoid the overfitting problem (Witten and Frank, 2005). When the connection weights computed from the training subset produced higher classification errors in the association of the inputs (rsEEG markers) and classification outputs (“Nold” vs. “AD”) in the validation set, the ANN was assumed to fit too much the training set (“overfitting state”). This case was avoided stopping early the ANN training if the network performance fails to improve or remains the same for a number of epochs fixed to 100.

In the third step of the procedure, the performance of the ANNs to classify the Nold and AD individual datasets of the testing subset only (not used in the training and validation phases). That performance in the binary classification (Nold vs. AD) was measured by the following indexes expressed as percentages (%):

1. Sensitivity, defined as the rate of the AD individual testing datasets classified as AD correctly; this index was termed true positive (TP) or TP rate (TPR);

2. Specificity, defined as the rate of the Nold individual testing datasets classified as Nold correctly; this index was termed as true negative (TN) or TN rate (TNR);

3. Accuracy, defined as the sum of the TP and the TN divided by the total number of the individual datasets of the two classes (AD and Nold).

This step-wise classification procedure with training subset, validation subset, and a testing subset was repeated 500 times (iterations). Any iteration produced a value of sensitivity, specificity, and accuracy. The findings reported in the “Results” section refer to the average of the values of sensitivity, specificity, and accuracy over all 500 iterations.

ANNs: Experimental Design and Statistical Analysis

The experimental design aimed at computing the sensitivity, specificity, and accuracy of the classifications of the Nold and AD individual datasets for the following sessions:

1. The 4 most discriminant markers of eLORETA source current density (SCD), namely parietal, temporal, and occipital theta/alpha1 and the occipital delta/alpha 1;

2. The 4 most discriminant markers of eLORETA source functional connectivity (LLC) as listed in the previous section entitled “The rsEEG markers used as inputs for ANNs”;

3. The combination of the mentioned 8 most discriminant markers of eLORETA source current density (SCD) and the functional connectivity (LLC).

Figure 2 shows the peculiar architectures of the ANNs used for the above three sessions (they were optimized by the MOGA technique; Bevilacqua et al., 2006). For a given session, the mean and standard deviation of the classification accuracy were computed using the accuracy values of all 500 iterations of that session.

FIGURE 2

Figure 2. Structures of the three artificial neural networks (ANNs) used to classify Alzheimer's disease patients with dementia (AD) from Normal elderly subjects (Nold). EEG markers are given as inputs in the first layer (input layer); every node (the numbered circles) of every successive layer (i.e., the hidden layers and the output layer) is characterized by an activation function: A non-linear function to decide, in analogy with biological neurons, the output of the node (0 or 1). The output node (O) provides the classification result (AD or Nold). Legend for the input markers: (top) the four best Lagged Linear Connectivity (LLC) markers; (bottom left) the four best LLC markers together with the four best Source Current Density (SCD) markers; (bottom right) the four best SCD markers. Legend for the activation functions: log-sigmoid (logsig), linear (purelin), and tan-sigmoid (tansig).

The freeware tool “R” (https://www.r-project.org/) was used to compare the means of the classification accuracy for the following statistical contrasts (p < 0.05):

1. The 4 most discriminant markers of eLORETA source current density (SCD) vs. the 4 most discriminant markers of eLORETA source functional connectivity (LLC);

2. The 4 most discriminant markers of eLORETA source current density (SCD) vs. the combination of the mentioned 8 most discriminant markers of eLORETA source current density (SCD) and the functional connectivity (LLC);

3. The 4 most discriminant markers of eLORETA source functional connectivity (LLC) vs. the combination of the mentioned 8 most discriminant markers of eLORETA source current density (SCD) and the functional connectivity (LLC);

4. The 4 most discriminant markers of eLORETA source current density (SCD) vs. the 10 most discriminant markers of eLORETA source current density (SCD).

These statistical contrasts were performed by Shapiro-Wilk normality test (p < 0.05). The dependent variable was the classification accuracy while the factor was the Session (4 best discriminant variables of eLORETA source current density, 4 best discriminant variables eLORETA source connectivity, etc.). Dunn's post-hoc test was used for multiple comparisons (p < 0.05). Tables 2, 3 listed the best 10 markers of SCD and LLC.

TABLE 2

Table 2. Results of the classification between single AD and Nold subjects based on composite rsEEG markers of source activity.

TABLE 3

Table 3. Results of the classification between single AD and Nold subjects based on composite EEG markers of lagged linear connectivity.

Results

Classification Performance of the ANNs

Among the above sessions of ANN classification of the Nold and AD individuals, the best 4 discriminant markers of the rsEEG source current density reached the following best sorting rate: A sensitivity of 79.3%, a specificity of 74.3%, and an accuracy of 77%. Furthermore, the best 4 discriminant markers of the rsEEG source lagged linear connectivity showed a sensitivity of 74.2%, a specificity of 68.9%, and an accuracy of 71.6%. Finally, the combination of the above best 8 discriminant markers of the rsEEG source current density and linear lagged connectivity exhibited a sensitivity of 80%, a specificity of 72.7%, and an accuracy of 76.7%. Table 4 reports these values associated with their standard deviations. Figure 3 illustrates a topographical representation of the best 8 discriminant markers of the rsEEG source current density and linear lagged connectivity. The Shapiro-Wilk normality test (p < 0.05) showed that the accuracy values in the 500 iterations of any classification session (i.e., the best 4 discriminant markers of the rsEEG source current density; the best 4 discriminant markers of the rsEEG linear lagged connectivity; the above best 8 discriminant markers) were not Gaussian as distributions. From these distributions, Kruskal-Wallis test disclosed a statistically significant effect (p < 0.0001) while Dunn's post-hoc test revealed some interesting statistically significant differences in the classification accuracy between session pairs. Specifically, the classification accuracy was higher for the best 4 discriminant markers of rsEEG source current density than the best 4 discriminant markers of rsEEG source linear lagged connectivity (p < 0.0001). Furthermore, this accuracy was lower for the best 4 discriminant markers of rsEEG source linear lagged connectivity than the best 8 discriminant markers of the rsEEG source current density and linear lagged connectivity (p < 0.0001). In contrast, no difference in the classification accuracy was found between the best 4 discriminant markers of the rsEEG source current density and the best 8 discriminant markers of the rsEEG source current density and linear lagged connectivity (p > 0.05).

TABLE 4

Table 4. Accuracy, sensibility (true positive rate), and sensitivity (true negative rate) of the ANNs proposed, express as percentage (mean ± standard deviation).

FIGURE 3

Figure 3. (Left) : A topographical representation of the following best 4 discriminant markers of the rsEEG SCD for the classification of Nold and AD individuals. These markers are the following (from the top to the bottom): parietal theta/alpha 1, temporal theta/alpha 1, occipital theta/alpha 1, and occipital delta/alpha 1. (Right): A topographical representation of the following best 4 discriminant markers of the rsEEG LLC for the classification between Nold and AD individuals. These markers are the following (from the top to the bottom): inter-hemispherical occipital delta/alpha 2, intra-hemispherical right parietal-limbic alpha 1, intra-hemispherical left occipital-temporal theta/alpha 1, intra-hemispherical right occipital-temporal theta/alpha 1.

Control Analysis

As reported above, the highest ANN classification of the Nold and AD individuals was obtained with the best 4 discriminant markers of the rsEEG source current density. Therefore, we tested if the 10 best discriminant markers of rsEEG source current density would improve this classification accuracy (Table 2 reports the list of those 10 rsEEG markers). To this aim, the MOGA procedure (Bevilacqua et al., 2006) optimized an ANN with the following features: 1 hidden layer composed of 54 virtual neurons with a LOGSIG activation function; an output neuron with a TANSIG activation function. With this ANN, the best 10 discriminant markers of rsEEG source current density showed a sensitivity of 77.1%, a specificity of 68%, and an accuracy of 74.2%. Again, the distribution of the accuracy values was not Gaussian (Shapiro-Wilk normality test, p < 0.05), so we used Wilcoxon test (p < 0.05) to evaluate the possible statistically significant differences in the classification of the Nold and AD individuals between the best 10 vs. the best 4 discriminant markers of the rsEEG source current density. Results showed no statistically significant difference (p > 0.05).

Discussion

The present Consortium designed a research program to define and validate rsEEG topographic markers useful to understand the neurophysiological underpinnings of the AD status and the effects of new medications on those underpinnings. Furthermore, the program has to investigate if rsEEG topographic markers can stratify AD individuals based on these neurophysiological bases, namely AD people with “Nold-like” rsEEG markers from those with “AD-like” rsEEG markers. A reliable classification ability of these rsEEG markers would be quite useful in both clinical practice and clinical trials (see Jelic and Kowalski, 2009, for a review). Indeed, AD people with “AD-like” rsEEG markers are expected to have a lower cerebral reserve across the disease evolution. In this line, we have previously used rsEEG markers of the cortical source current density and lagged linear connectivity for the classification of 120 AD patients with dementia and 100 Nold subjects with a linear univariate classifier such as the computation of ROC curves. The results showed that the best classification accuracy of 75.5% was reached using occipital delta/alpha 1 source current density (sensitivity of 73.3% and specificity of 78%). In the present study, we re-analyzed the same database of rsEEG markers with a non-linear multivariate classifier such as the ANN.

The results of the present study showed that the ANN classification produced a classification accuracy of 77% (sensitivity of 79.3% and specificity of 74.3%) using the best 4 discriminant markers of the rsEEG source current density (i.e., occipital, temporal, and parietal theta/alpha 1; occipital delta/alpha 1). Noteworthy, this accuracy was higher than that (71.6%) obtained by the best 4 discriminant markers of the rsEEG source lagged linear connectivity (i.e., inter-hemispherical occipital delta/alpha 1 as well as intra-hemispherical left and right occipital-temporal theta/alpha 1, and right parietal-limbic alpha 1). Furthermore, it did not differ from those reached using the mentioned 8 discriminant rsEEG markers (76.7%) or the best 10 rsEEG markers of source current density (77.1%). Overall, the multivariate non-linear ANN classifiers of the present study reached a moderate classification accuracy that cross-validated that obtained with a standard univariate linear classifier (i.e., ROC curves) from the same database of rsEEG marker (Babiloni et al., 2016a). The same consideration is true for other databases of rsEEG markers of source current density. In previous studies, we have reported that the occipital alpha or the ratio between parietooccipital delta and alpha source current density showed a moderate accuracy of about 75–80% in the classification of Nold subjects and AD patients with dementia (Babiloni et al., 2015, 2016a; Lizio et al., 2015).

The present findings extend to rsEEG markers of source current density and linear lagged connectivity a bulk of previous evidence of other research groups indicating that rsEEG activity provided qualitative markers allowing a moderate discrimination of about 80% between Nold and AD individuals (Brenner et al., 1986, 1988; Hooijer et al., 1990; Strijers et al., 1997; Claus et al., 1999). The present findings also extend the following previous pieces of evidence using quantitative rsEEG markers for classification purposes, mostly from spectral analysis. Huang et al. (2000) combined alpha and theta global field power to reach an accuracy of 84% to classify Nold individuals and AD patients with dementia, and an accuracy of 78% to discriminate the AD patients with dementia and MCI individuals. Adler et al. (2003) reported that the left temporal alpha coherence and the global theta power density returned an accuracy of 80% for the classification of Nold individuals and AD patients with dementia. Moretti et al. (2011) showed that increased global theta/gamma and alpha 3/alpha 2 power density ratios predicted the conversion from MCI to AD or non-AD dementia with an accuracy of 88%. Trambaiolli et al. (2011) described that the temporal modulation of the energy in the delta, theta, alpha, beta, and gamma bands gave an accuracy of 91% in the classification of Nold individuals and AD patients with dementia. Engedal et al. (2015) reported that 20 rsEEG markers (including the alpha frequency peak, total power density, and coherence between electrodes) allowed an accuracy of 90% in the classification of AD patients with dementia from elderly subjects without or with other forms of dementia (e.g., Parkinson's Disease, Dementia with Lewy Bodies). As mentioned in the Introduction section, a full review of the rsEEG classification studies can be found in two articles. One of them (Jonkman, 1997) reported an accuracy ranging from 54 to 100% in the classification of the Nold and AD subjects while the other article (Jelic and Kowalski, 2009) reported an accuracy of about 80–85% between the patients with AD dementia or MCI and the individuals without or with other forms of dementia. Noteworthy, these rates of classification accuracy are in the same order of those obtained from other reliable CSF and neuroimaging biomarkers of AD (Stoeckel et al., 2004; van der Flier, 2005; Klöppel et al., 2008; Álvarez et al., 2009).

Another interesting finding of the present study was that the classification accuracy was not improved combining the (eLORETA) rsEEG markers of the cortical source current density and lagged linear connectivity from the delta, theta, and alpha rhythms recorded during a resting state eyes-closed condition. In this condition of quiet wakefulness, healthy subjects show dominant rsEEG oscillations at about 8–13 Hz in posterior areas of cerebral cortex, the so-called alpha rhythms. These rhythms are associated with a fluctuating cortical inhibition due to a widespread synchronization of activity of cortical pyramidal neurons. These neurons would receive synchronizing signals at around 10 Hz from neurons of thalamocortical, brainstem-cortical, and corticocortical circuits underpinning vigilance and several cognitive functions such as attention and memory (Steriade and Llinás, 1988; Rossini et al., 1991; Neubauer and Freudenthaler, 1995; Klimesch et al., 1996; Klimesch, 1999; Pfurtscheller and Lopes da Silva, 1999; Roh et al., 2011). In the condition of quiet wakefulness, healthy subjects also show low values of delta (<4 Hz) and theta (4–7 Hz) rsEEG rhythms. When delta rhythms reach high power values in that condition, an abnormal tonic “disconnection mode” of the cerebral cortex can be hypothesized. In the quiet wakefulness, these abnormal delta rhythms might have a different neural substrate from sleep delta rhythms (i.e., in stage 4) caused by low-frequency oscillatory signals across cortico-thalamic (<1 Hz) and thalamocortical (<4 Hz) circuits (Steriade, 2003).

Here we report that the classification accuracy based on 8 (linear) rsEEG markers as inputs to ANN (e.g., about 76%) was similar to that obtained with a single rsEEG marker in a previous seminal study on the same database (75.5%; Babiloni et al., 2016a). How can we interpret this finding? From a neurophysiological point of view, the present rsEEG markers of source current density would probe cortical neural synchronization while rsEEG markers of functional connectivity would probe the functional interdependence and efficiency of neurotransmission in different regions of the cerebral cortex. Although these linear rsEEG source markers unveil different relevant neurophysiological mechanisms underpinning low cortical arousal and vigilance in AD patients, they may provide the same core neurophysiological information for the classification of Nold and AD individuals. A high degree of redundancy would prevent an improvement of the classification accuracy either be combining the present linear rsEEG markers of source current density and functional connectivity or increasing the number of rsEEG markers used. To improve the classification accuracy, future studies may use other independent linear and non-linear classes of rsEEG markers as an input to the ANNs, in addition to the present ones. On the one hand, the additional linear markers could be derived from autoregressive models, directed transfer function (DTF), and Granger causality (Granger, 1969; Kaminski and Blinowska, 1991; Kaminski et al., 1997; Korzeniewska et al., 1997; Blinowska, 2011; Katarzyn and Jaroslaw, 2011; Babiloni et al., 2016a). On the other hand, the non-linear ones could be derived from chaos, entropy, and synchronization likelihood (Micheloyannis et al., 1998; Stam, 2005). It can be speculated that those independent mathematical procedures would produce less correlated and redundant input variables for ANNs.

Conclusions

In a previous study, we showed the best accuracy of 75.5% in the classification of 120 AD patients with dementia and 100 matched Nold subjects based on eLORETA cortical source current density and lagged linear connectivity estimated from rsEEG rhythm (Babiloni et al., 2016a). Specifically, that accuracy was reached using the ratio between occipital delta and alpha1 current density as an input to a linear univariate classifier (i.e., ROC curves). In the present study, we tested the use of ANNs with the same database of eLORETA rsEEG markers. Frequency bands of interest were delta, theta, alpha 1, and alpha 2. Results showed that ANN classification reached an accuracy of 77% using the most 4 discriminative rsEEG markers of source current density (delta/alpha 1 and theta/alpha 1 ratios in posterior cortical lobes). The ANN classification exhibited an accuracy of 72% using the most 4 discriminative rsEEG markers of source lagged linear connectivity (alphas between posterior cortical lobes). With these 8 markers combined, an accuracy of 76% was reached.

Overall, the present results suggest that a non-linear (ANN) multivariate classification rate cross-validated that obtained using a linear univariate classifier in the previous reference study (Babiloni et al., 2016a). Although the linear rsEEG markers of cortical current density and connectivity probe different relevant neurophysiological mechanisms underpinning cortical arousal and vigilance in AD patients, they provide quite redundant information for classification purposes. In future AD studies, inputs to ANNs should combine the present markers with other linear (i.e., directed transfer function, phase lag index) and non-linear (i.e., chaos, entropy, synchronization likelihood) rsEEG markers to improve the classification accuracy of the present moderate values (about 75–80%).

Author Contributions

AT, CBa, RF, RL, CD, and VB gave their contributions to the conception and design of the work. AS, RF, FN, LG, RT, VC, MB, AG, PS, SA, GB, GS, GLo, GLa, FO, CBu, FG, FS and GF were responsible for the enrollments, all the clinical evaluations, and the recordings of EEG data. AT, RL, and CD performed the analysis of data. VB and AB built and trained the Artificial Neural Networks. AT, CD, RL, FC, and GT performed the statistical analysis. AT, CBa, RL, and CD gave their contribution in the interpretation of the results. AT, CD, RL, VB, and CBa contributed in drafting the work and revising it critically for important intellectual content. AS, RF, FN, LG, RT, VC, MB, AG, PS, SA, GB, GS, GLo, GLa, FO, CBu, FG, FS, and GF contributed to the revision of the first and later versions of the manuscript.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The present study was developed and granted in the framework of the following projects: “Smart Health 2.0” (Italian Ministry of University and Technological Research, Pon04a2_C-MIUR D.D. 626/Ric e 703/Ric), “Italian DIAfN” (Italian Ministry of Health, Finalized Research program, RF-2010-2319722) and “GRIDCORE” (Italian Ministry of Health, Finalized Research program, prot. RF-2010-2319113).

References

Adler, G., Brassen, S., and Jajcevic, A. (2003). EEG coherence in Alzheimer's dementia. J. Neural Transm. 110, 1051–1058. doi: 10.1007/s00702-003-0024-8

Albert, M. S., DeKosky, S. T., Dickson, D., Dubois, B., Feldman, H. H., Fox, N. C., et al. (2011). The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimer's & Dementia? J. Alzheimer's Assoc. 7, 270–279. doi: 10.1016/j.jalz.2011.03.008

Álvarez, I., López, M., Górriz, J. M., Ramírez, J., Salas-Gonzalez, D., Puntonet, C. G., et al. (2009). “Automatic classification system for the diagnosis of alzheimer disease using Component-Based SVM aggregations,” in Advances in Neuro-Information Processing, (Heidelberg; Auckland: Springer), 402–409.

Babiloni, C., Binetti, G., Cassetta, E., Cerboneschi, D., Dal Forno, G., Del Percio, C., et al. (2004). Mapping distributed sources of cortical rhythms in mild Alzheimer's disease. A multicentric EEG study. Neuroimage 22, 57–67. doi: 10.1016/j.neuroimage.2003.09.028

Babiloni, C., Brancucci, A., Capotosto, P., Romani, G. L., Arendt-Nielsen, L., Chen, A. C., et al. (2005). Slow cortical potential shifts preceding sensorimotor interactions. Brain Res. Bull. 65, 309–316. doi: 10.1016/j.brainresbull.2004.11.023

Babiloni, C., Brancucci, A., Vecchio, F., Arendt-Nielsen, L., Chen, A. C., and Rossini, P. M. (2006). Anticipation of somatosensory and motor events increases centro-parietal functional coupling: an EEG coherence study. Clin. Neurophysiol. 117, 1000–1008. doi: 10.1016/j.clinph.2005.12.028

Babiloni, C., Del Percio, C., Boccardi, M., Lizio, R., Lopez, S., Carducci, F., et al. (2015). Occipital sources of resting-state alpha rhythms are related to local gray matter density in subjects with amnesic mild cognitive impairment and Alzheimer's disease. Neurobiol. Aging 36, 556–570. doi: 10.1016/j.neurobiolaging.2014.09.011

Babiloni, C., Del Percio, C., Bordet, R., Bourriez, J.-L., Bentivoglio, M., Payoux, P., et al. (2013c). Effects of acetylcholinesterase inhibitors and memantine on resting-state electroencephalographic rhythms in Alzheimer's disease patients. Clin. Neurophysiol. 124, 837–850. doi: 10.1016/j.clinph.2012.09.017

Babiloni, C., Frisoni, G. B., Pievani, M., Vecchio, F., Infarinato, F., Geroldi, C., et al. (2008). White matter vascular lesions are related to parietal-to-frontal coupling of EEG rhythms in mild cognitive impairment. Hum. Brain Mapp. 29, 1355–1367. doi: 10.1002/hbm.20467

Babiloni, C., Frisoni, G. B., Pievani, M., Vecchio, F., Lizio, R., Buttiglione, M., et al. (2009). Hippocampal volume and cortical sources of EEG alpha rhythms in mild cognitive impairment and Alzheimer disease. Neuroimage 44, 123–135. doi: 10.1016/j.neuroimage.2008.08.005

Babiloni, C., Frisoni, G. B., Vecchio, F., Lizio, R., Pievani, M., Cristina, G., et al. (2011a). Stability of clinical condition in mild cognitive impairment is related to cortical sources of alpha rhythms: an electroencephalographic study. Hum. Brain Mapp. 32, 1916–1931. doi: 10.1002/hbm.21157

Babiloni, C., Frisoni, G. B., Vecchio, F., Pievani, M., Geroldi, C., De Carli, C., et al. (2010). Global functional coupling of resting EEG rhythms is related to white-matter lesions along the cholinergic tracts in subjects with amnesic mild cognitive impairment. J. Alzheimers. Dis. 19, 859–871. doi: 10.3233/JAD-2010-1290

Babiloni, C., Infarinato, F., Aujard, F., Bastlund, J. F., Bentivoglio, M., Bertini, G., et al. (2013a). Effects of pharmacological agents, sleep deprivation, hypoxia and transcranial magnetic stimulation on electroencephalographic rhythms in rodents: towards translational challenge models for drug discovery in Alzheimer's disease. Clin. Neurophysiol. 124, 437–451. doi: 10.1016/j.clinph.2012.07.023

Babiloni, C., Infarinato, F., Triggiani, A. I., Lizio, R., Percio, C., Del Marzano, N., et al. (2013b). Resting state EEG rhythms as network disease markers for drug discovery in Alzheimer's disease. Drug Discov. Today Ther. Strateg. 10, e85–e90. doi: 10.1016/j.ddstr.2014.02.003

Babiloni, C., Lizio, R., Carducci, F., Vecchio, F., Redolfi, A., Marino, S., et al. (2011b). Resting state cortical electroencephalographic rhythms and white matter vascular lesions in subjects with Alzheimer's disease: an Italian multicenter study. J. Alzheimers. Dis. 26, 331–346. doi: 10.3233/JAD-2011-101710

Babiloni, C., Lizio, R., Marzano, N., Capotosto, P., Soricelli, A., Triggiani, A. I., et al. (2016b). Brain neural synchronization and functional coupling in Alzheimer's disease as revealed by resting state EEG rhythms. Int. J. Psychophysiol. 103, 88–102. doi: 10.1016/j.ijpsycho.2015.02.008

Babiloni, C., Triggiani, A. I., Lizio, R., Cordone, S., Tattoli, G., Bevilacqua, V., et al. (2016a). Classification of single normal and alzheimer's disease individuals from cortical sources of resting state EEG rhythms. Front. Neurosci. 10:47. doi: 10.3389/fnins.2016.00047

Basheer, I. A., and Hajmeer, M. (2000). Artificial neural networks: fundamentals, computing, design, and application. J. Microbiol. Methods 43, 3–31. doi: 10.1016/S0167-7012(00)00201-3

Besthorn, C., Zerfass, R., Geiger-Kabisch, C., Sattel, H., Daniel, S., Schreiter-Gasser, U., et al. (1997). Discrimination of Alzheimer's disease and normal aging by EEG data. Electroencephalogr. Clin. Neurophysiol. 103, 241–248.

Bevilacqua, V., Brunetti, A., Triggiani, M., Magaletti, D., Telegrafo, M., and Moschetta, M. (2016). “An optimized feed-forward artificial neural network topology to support radiologists in breast lesions classification,” in Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion, (Denver: ACM), 1385–1392.

Bevilacqua, V., Mastronardi, G., Menolascina, F., Pannarale, P., and Pedone, A. (2006). “A novel multi-objective genetic algorithm approach to artificial neural network topology optimisation: the breast cancer classification problem,” in Neural Networks, IJCNN'06. International Joint Conference on (Vancouver, BC), 1958–1965.

Bevilacqua, V., Salatino, A. A., Di Leo, C., Tattoli, G., Buongiorno, D., Signorile, D., et al. (2015). “Advanced classification of Alzheimer's disease and healthy subjects based on EEG markers,” in 2015 International Joint Conference on Neural Networks (IJCNN), (Killarney: IEEE), 1–5.

Blinowska, K. J. (2011). Review of the methods of determination of directed connectivity from multichannel data. Med. Biol. Eng. Comput. 49, 521–529. doi: 10.1007/s11517-011-0739-x

Braak, H., and Braak, E. (1995). Staging of Alzheimer's disease-related neurofibrillary changes. Neurobiol. Aging 16, 271–278.

Brenner, R. P., Reynolds, C. F. III, and Ulrich, R. F. (1988). Diagnostic efficacy of computerized spectral versus visual EEG analysis in elderly normal, demented and depressed subjects. Electroencephalogr. Clin. Neurophysiol. 69, 110–117. doi: 10.1016/0013-4694(88)90206-4

Brenner, R. P., Ulrich, R. F., Spiker, D. G., Sclabassi, R. J., Reynolds, C. F. III, Marin, R. S., et al. (1986). Computerized EEG spectral analysis in elderly normal, demented and depressed subjects. Electroencephalogr. Clin. Neurophysiol. 64, 483–492. doi: 10.1016/0013-4694(86)90184-7

Canuet, L., Ishii, R., Pascual-Marqui, R. D., Iwase, M., Kurimoto, R., Aoki, Y., et al. (2011). Resting-state EEG source localization and functional connectivity in schizophrenia-like psychosis of epilepsy. PLoS ONE 6:e27863. doi: 10.1371/journal.pone.0027863

Chiaramonti, R., Muscas, G. C., Paganini, M., Müller, T. J., Fallgatter, A. J., Versari, A., et al. (1997). Correlations of topographical EEG features with clinical severity in mild and moderate dementia of Alzheimer type. Neuropsychobiology 36, 153–158.

Claus, J. J., Strijers, R. L., Jonkman, E. J., Ongerboer de Visser, B. W., Jonker, C., Walstra, G. J., et al. (1999). The diagnostic value of electroencephalography in mild senile Alzheimer's disease. Clin. Neurophysiol. 110, 825–832.

Dierks, T., Ihl, R., Frölich, L., and Maurer, K. (1993). Dementia of the Alzheimer type: effects on the spontaneous EEG described by dipole sources. Psychiatry Res. 50, 151–162. doi: 10.1016/0925-4927(93)90027-F

Dierks, T., Jelic, V., Pascual-Marqui, R. D., Wahlund, L., Julin, P., Linden, D. E., et al. (2000). Spatial pattern of cerebral glucose metabolism (PET) correlates with localization of intracerebral EEG-generators in Alzheimer's disease. Clin. Neurophysiol. 111, 1817–1824. doi: 10.1016/S1388-2457(00)00427-2

Dubois, B., Feldman, H. H., Jacova, C., Dekosky, S. T., Barberger-Gateau, P., Cummings, J., et al. (2007). Research criteria for the diagnosis of Alzheimer's disease: revising the NINCDS-ADRDA criteria. Lancet. Neurol. 6, 734–746. doi: 10.1016/S1474-4422(07)70178-3

Dubois, B., Feldman, H. H., Jacova, C., Hampel, H., Molinuevo, J. L., Blennow, K., et al. (2014). Advancing research diagnostic criteria for Alzheimer's disease: the IWG-2 criteria. Lancet Neurol. 13, 614–629. doi: 10.1016/S1474-4422(14)70090-0

Engedal, K., Snaedal, J., Hoegh, P., Jelic, V., Bo Andersen, B., Naik, M., et al. (2015). Quantitative EEG applying the statistical recognition pattern method: a useful tool in dementia diagnostic workup. Dement. Geriatr. Cogn. Disord. 40, 1–12. doi: 10.1159/000381016

Folstein, M. F., Folstein, S. E., and McHugh, P. R. (1975). “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12, 189–198.

Förstl, H., and Kurz, A. (1999). Clinical features of Alzheimer's disease. Eur. Arch. Psychiatry Clin. Neurosci. 249, 288–290.

Fuchs, M., Kastner, J., Wagner, M., Hawes, S., and Ebersole, J. S. (2002). A standardized boundary element method volume conductor model. Clin. Neurophysiol. 113, 702–712. doi: 10.1016/S1388-2457(02)00030-5

Granger, C. W. J. (1969). Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37, 424–438. doi: 10.2307/1912791

Hooijer, C., Jonker, C., Posthuma, J., and Visser, S. L. (1990). Reliability, validity and follow-up of the EEG in senile dementia: sequelae of sequential measurement. Electroencephalogr. Clin. Neurophysiol. 76, 400–412.

Huang, C., Wahlund, L.-O., Dierks, T., Julin, P., Winblad, B., and Jelic, V. (2000). Discrimination of Alzheimer's disease and mild cognitive impairment by equivalent EEG sources: a cross-sectional and longitudinal study. Clin. Neurophysiol. 111, 1961–1967. doi: 10.1016/S1388-2457(00)00454-5

Hughes, C. P., Berg, L., and Danziger, W. L. (1982). A new clinical scale for the staging of dementia. Br. J. Psychiatry 140, 566–572. doi: 10.1192/bjp.140.6.566

Jack, C. R., Knopman, D. S., Jagust, W. J., Shaw, L. M., Aisen, P. S., Weiner, M. W., et al. (2010). Hypothetical model of dynamic biomarkers of the Alzheimer's pathological cascade. Lancet. Neurol. 9, 119–128. doi: 10.1016/S1474-4422(09)70299-6

Jelic, V., and Kowalski, J. (2009). Evidence-based evaluation of diagnostic accuracy of resting EEG in dementia and mild cognitive impairment. Clin. EEG Neurosci. 40, 129–142. doi: 10.1177/155005940904000211

Jelic, V., Shigeta, M., Julin, P., Almkvist, O., Winblad, B., and Wahlund, L. O. (1996). Quantitative electroencephalography power and coherence in Alzheimer's disease and mild cognitive impairment. Dementia 7, 314–323. doi: 10.1159/000106897

Jeong, J. (2004). EEG dynamics in patients with Alzheimer's disease. Clin. Neurophysiol. 115, 1490–1505. doi: 10.1016/j.clinph.2004.01.001

Jonkman, E. J. (1997). The role of the electroencephalogram in the diagnosis of dementia of the Alzheimer type: an attempt at technology assessment. Neurophysiol. Clin. Neurophysiol. 27, 211–219.

Jurcak, V., Tsuzuki, D., and Dan, I. (2007). 10/20, 10/10, and 10/5 systems revisited: their validity as relative head-surface-based positioning systems. Neuroimage 34, 1600–1611. doi: 10.1016/j.neuroimage.2006.09.024

Kaminski, M., Blinowska, K., and Szclenberger, W. (1997). Topographic analysis of coherence and propagation of EEG activity during sleep and wakefulness. Electroencephalogr. Clin. Neurophysiol. 102, 216–227. doi: 10.1016/S0013-4694(96)95721-5

Kaminski, M. J., and Blinowska, K. J. (1991). A new method of the description of the information flow in the brain structures. Biol. Cybern. 65, 203–210. doi: 10.1007/BF00198091

Katarzyna, J. B., and Jaroslaw, Z. (2011). Series in Medical Physics and Biomedical Engineering. CRC Press, 324.

Klimesch, W. (1999). EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res. Brain Res. Rev. 29, 169–195.

Klimesch, W., Doppelmayr, M., Schimke, H., and Pachinger, T. (1996). Alpha frequency, reaction time, and the speed of processing information. J. Clin. Neurophysiol. 13, 511–518.

Klöppel, S., Stonnington, C. M., Chu, C., Draganski, B., Scahill, R. I., Rohrer, J. D., et al. (2008). Automatic classification of MR scans in Alzheimer's disease. Brain 131, 681–689. doi: 10.1093/brain/awm319

Korzeniewska, A., Kasicki, S., Kamiński, M., and Blinowska, K. J. (1997). Information flow between hippocampus and related structures during various types of rat's behavior. J. Neurosci. Methods 73, 49–60. doi: 10.1016/S0165-0270(96)02212-1

Lawton, M. P., and Brody, E. M. (1969). Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist 9, 179–186. doi: 10.1093/geront/9.3_Part_1.179

Lizio, R., Del Percio, C., Marzano, N., Soricelli, A., Yener, G. G., Başar, E., et al. (2015). Neurophysiological assessment of Alzheimer's disease individuals by a single electroencephalographic marker. J. Alzheimers. Dis. 49, 159–177. doi: 10.3233/JAD-143042

Mazziotta, J. C., Toga, A. W., Evans, A., Fox, P., and Lancaster, J. (1995). A probabilistic atlas of the human brain: theory and rationale for its development. The International Consortium for Brain Mapping (ICBM). Neuroimage 2, 89–101. doi: 10.1006/nimg.1995.1012

McKeith, I. G., Dickson, D. W., Lowe, J., Emre, M., O'Brien, J. T., Feldman, H., et al. (2005). Diagnosis and management of dementia with Lewy bodies: third report of the DLB consortium. Neurology 65, 1863–1872. doi: 10.1212/01.wnl.0000187889.17253.b1

McKhann, G., Drachman, D., Folstein, M., Katzman, R., Price, D., and Stadlan, E. M. (1984). Clinical diagnosis of Alzheimer's disease: report of the NINCDS-ADRDA work group under the auspices of department of health and human services task force on alzheimer's disease. Neurology 34, 939–944. doi: 10.1212/WNL.34.7.939

McKhann, G. M., Knopman, D. S., Chertkow, H., Hyman, B. T., Jack, C. R., Kawas, C. H., et al. (2011). The diagnosis of dementia due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. 7, 263–269. doi: 10.1016/j.jalz.2011.03.005

Micheloyannis, S., Flitzanis, N., Papanikolaou, E., Bourkas, M., Terzakis, D., Arvanitis, S., et al. (1998). Usefulness of non-linear EEG analysis. Acta Neurol. Scand. 97, 13–19.

Moretti, D. V., Frisoni, G. B., Fracassi, C., Pievani, M., Geroldi, C., Binetti, G., et al. (2011). MCI patients' EEGs show group differences between those who progress and those who do not progress to AD. Neurobiol. Aging 32, 563–571. doi: 10.1016/j.neurobiolaging.2009.04.003

Neubauer, A. C., and Freudenthaler, H. H. (1995). Ultradian rhythms in cognitive performance: no evidence for a 1.5-h rhythm. Biol. Psychol. 40, 281–298. doi: 10.1016/0301-0511(95)05121-P

Nguyen, D., and Widrow, B. (1990). “Improving the learning speed of 2-layer neural networks by choosinginitial values of the adaptive weights,” in International Joint Conference Neural Networks. (San Diego, CA).

Pascual-Marqui, R. D. (2007a). Discrete, 3D distributed, linear imaging methods of electric neuronal activity. Part 1: exact, zero error localization. arXiv:0710.3341 [math-ph]. Available online at: https://arxiv.org/abs/0710.3341

Pascual-Marqui, R. D. (2007b). Instantaneous and lagged measurements of linear and nonlinear dependence between groups of multivariate time series: frequency decomposition. arXiv:0711.1455 [stat.ME]. Available online at: http://arxiv.org/abs/0711.1455

Pascual-Marqui, R. D., Michel, C. M., and Lehmann, D. (1994). Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. Int. J. Psychophysiol. 18, 49–65.

Pascual-Marqui, R. D., Esslen, M., Kochi, K., and Lehmann, D. (2002). Functional imaging with low-resolution brain electromagnetic tomography (LORETA): a review. Methods Find. Exp. Clin. Pharmacol. 24(Suppl. C), 91–95. doi: 10.1016/j.jneumeth.2006.10.023

Pascual-Marqui, R. D., Lehmann, D., Koukkou, M., Kochi, K., Anderer, P., Saletu, B., et al. (2011). Assessing interactions in the brain with exact low-resolution electromagnetic tomography. Philos. Trans. R. Soc. London A Math. Phys. Eng. Sci. 369, 3768–3784. doi: 10.1098/rsta.2011.0081

Pfurtscheller, G., and Lopes da Silva, F. H. (1999). Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin. Neurophysiol. 110, 1842–1857. doi: 10.1016/S1388-2457(99)00141-8

Ponomareva, N. V., Selesneva, N. D., and Jarikov, G. A. (2003). EEG alterations in subjects at high familial risk for Alzheimer's disease. Neuropsychobiology 48, 152–159. doi: 10.1159/000073633

Riedmiller, M., and Braun, H. (1993). “A direct adaptive method for faster backpropagation learning: The RPROP algorithm,” in IEEE International Conference on Neural Networks - Conference Proceedings (San Francisco, CA), 586–591.

Roh, J. H., Park, M. H., Ko, D., Park, K.-W., Lee, D.-H., Han, C., et al. (2011). Region and frequency specific changes of spectral power in Alzheimer's disease and mild cognitive impairment. Clin. Neurophysiol. 122, 2169–2176. doi: 10.1016/j.clinph.2011.03.023

Román, G. C., Tatemichi, T. K., Erkinjuntti, T., Cummings, J. L., Masdeu, J. C., Garcia, J. H., et al. (1993). Vascular dementia: diagnostic criteria for research studies. Report of the NINDS-AIREN International Workshop. Neurology 43, 250–260. doi: 10.1212/WNL.43.2.250

Rossini, P. M., Desiato, M. T., Lavaroni, F., and Caramia, M. D. (1991). Brain excitability and electroencephalographic activation: non-invasive evaluation in healthy humans via transcranial magnetic stimulation. Brain Res. 567, 111–119. doi: 10.1016/0006-8993(91)91442-4

Sperling, R. A., Jack, C. R., Black, S. E., Frosch, M. P., Greenberg, S. M., Hyman, B. T., et al. (2011). Amyloid-related imaging abnormalities in amyloid-modifying therapeutic trials: Recommendations from the Alzheimer's Association Research Roundtable Workgroup. Alzheimer's Dement. 7, 367–385. doi: 10.1016/j.jalz.2011.05.2351

Stam, C. J. (2005). Nonlinear dynamical analysis of EEG and MEG: review of an emerging field. Clin. Neurophysiol. 116, 2266–2301. doi: 10.1016/j.clinph.2005.06.011

Steriade, M. (2003). Cerebello-cerebral interactions during states of vigilance. Cerebellum 2, 82–83. doi: 10.1080/14734220309404

Steriade, M., and Llinás, R. R. (1988). The functional states of the thalamus and the associated neuronal interplay. Physiol. Rev. 68, 649–742.

Stoeckel J., Ayache N., Malandain G., Koulibaly P. M., Ebmeier K. P., and Darcourt, J. (2004). Automatic classification of SPECT images of Alzheimer's disease patients and control subjects. Lecture Notes in Computer Science (Sophia Antipolis), 3217(1 PART 2), 654, 662. Available online at: https://www.scopus.com/inward/record.uri?eid=2-s2.0-20344398668&partnerID=40&md5=b8af0975f7f7ffdcdb25dc5ca60006b5

Strijers, R. L., Scheltens, P., Jonkman, E. J., de Rijke, W., Hooijer, C., and Jonker, C. (1997). Diagnosing Alzheimer's disease in community-dwelling elderly: a comparison of EEG and MRI. Dement. Geriatr. Cogn. Disord. 8, 198–202.

The Lund and Manchester Groups (1994). Clinical and neuropathological criteria for frontotemporal dementia. The Lund Manchester Groups. J. Neurol. Neurosurg. Psychiatry 57, 416–418. doi: 10.1136/jnnp.57.4.416

Trambaiolli, L. R., Lorena, A. C., Fraga, F. J., Kanda, P. A. M., Anghinah, R., and Nitrini, R. (2011). Improving Alzheimer's disease diagnosis with machine learning techniques. Clin. EEG Neurosci. 42, 160–165.

van der Flier, W. M. (2005). Use of laboratory and imaging investigations in dementia. J. Neurol. Neurosurg. Psychiatry 76, v45–v52. doi: 10.1136/jnnp.2005.082149

Witten, I. H., and Frank, E. (2005). Data Mining: Practical Machine Learning Tools and Techniques. Available online at: http://www.amazon.com/Data-Mining-Practical-Techniques-Management/dp/0120884070/ref=sr_1_2?s=books&ie=UTF8&qid=1329477320&sr=1-2

Yesavage, J. A., Brink, T. L., Rose, T. L., Lum, O., Huang, V., Adey, M., et al. (1983). Development and validation of a geriatric depression screening scale: a preliminary report. J. Psychiatr. Res. 17, 37–49.

Zill, D. G., and Cullen, M. R. (2000). Advanced Engineering Mathematics. Biotechnol. Bioeng. 90, 926. doi: 10.1002/bit.20432