International Journal of Fuzzy Logic and Intelligent Systems 2020; 20(4): 255-260
Published online December 25, 2020
https://doi.org/10.5391/IJFIS.2020.20.4.255
© The Korean Institute of Intelligent Systems
Nishant Chauhan and Byung-Jae Choi
Department of Electronic Engineering, Daegu University, Gyeongsan, Korea
Correspondence to :
Byung-Jae Choi (bjchoi@daegu.ac.kr)
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted noncommercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
DNN based Classification of ADHD fMRI Data using Functional Connectivity CoefficientFunctional magnetic resonance imaging (fMRI) has emerged as a popular research topic in neuroimaging for automated classification and recognition of different brain disorders. Attention Deficit Hyperactivity Disorder (ADHD) is one of the most common behavioral disorders in young children because its underlying mechanism is still not completely understood. The use of fMRI data in ADHD research is utilized to reflect the neural mechanism and functional integration of the brain. Alteration in the functional connectivity of the brain is expected to provide useful information for classifying or predicting brain disorders. In this study, a deep neural network (DNN) approach was applied to classify ADHD using functional connectivity-based fMRI data. The functional connectivity coefficient was extracted between regions determined by independent component analysis (ICA) and used to feed the DNN for classification. The DNN model demonstrated an accuracy of 95% with the preprocessed fMRI data from Nilearn, which is a Python module for neuroimaging data.
Keywords: Functional Magnetic Resonance Imaging (fMRI), Deep Neural Network (DNN), Attention Deficit Hyperactivity Disorder (ADHD), Independent Component Analysis (ICA), Nilearn
The advancement in methods for studying human brain structure and its functionality is one of the great landmarks of medical research [1]. The human brain can speculate a huge and complex network that efficiently controls the complicated systems of the human body. The brain regions continuously send and receive information to perform bodily functions. The temporal correlation of these regions is assumed to be functionally connected. Recently, we have seen a spike in brain imaging research for analysis of the brain mechanism and pathophysiology involved in neurodegenerative diseases and associated mental disorders. The analysis of functional connectivity of brain regions has become more popular because it is believed that functional connectivity can be key to understanding the cognitive processes of the brain [2].
Recent research has shown that some brain disorders, such as Parkinson’s, Alzheimer’s, and ADHD, are the outcome of the alteration of functional connectivity of the brain network [3]. To understand the mechanism of the disorder, it is important to precisely identify the altered functional connectivity. ADHD is the most common brain disorder found in young children and is characterized by hyperactivity, lack of attention, and behavior control issues [4]. Like many other brain disorders, ADHD increases the difficulty in life not only for the patient but also for a family [5]. Studies have shown that reduced or altered functional connectivity between the anterior cingulate cortex (ACC) and posterior cingulate cortex (PCC) is detected in the ADHD induced brain [6].
There are many imaging techniques available to study brain structure and physiology. Magnetic resonance imaging (MRI) provides structural information about the brain. Diffusion tensor imaging (DTI) displays the fiber connections between brain regions, and positron emission tomography (PET) captures the regional cerebral blood flow (CBF). To investigate the functional connectivity of the brain, functional magnetic resonance imaging (fMRI) has emerged as a favorable neuroimaging tool [2]. In particular, fMRI has the potential to identify the connectivity alteration caused by brain disorders such as Alzheimer’s, epilepsy, schizophrenia, and ADHD.
In this paper, a DNN model is introduced to show the classification of ADHD using fMRI data based on functional connectivity analysis. This approach is not directly based on neuroimaging scans but rather on vectorized functional connectivity measures. The functional connectivity coefficients were extracted using independent component analysis (ICA) and used for training and testing for DNN.
The rest of the paper is organized into the following sections: Section 2 provides a brief literature review of existing methods. Section 3 explains the materials and methods used in the proposed classification model. Section 4 contains the results and discussion. Finally, the concluding remarks are provided in Section 5.
Based on fMRI techniques, many researchers have investigated brain functionality and discovered the structural and functional abnormalities between individuals with ADHD and the control (healthy) group. Nakao et al. [7] used voxel-based morphological analysis in ADHD and found a decrease in the gray matter volume of the lenticular nucleus. A detection algorithm for ADHD using L2-regularized logistic regression and fMRI features was proposed and showed prominent results. However, for non-linear data, the detection accuracy decreased [8, 9]. A functional anatomical discriminative region model for pattern classification and discriminant feature identification was proposed in which ICA was used to extract functional networks in the brain [10]. ICA based methods are considered to be favorable for fMRI studies because there is no prior information required regarding spatial or temporal patterns of source signals. However, these methods have some limitations. First, it is difficult to understand the ICA components, and it is based on assumptions on the independence of components, either spatially or temporally. In addition, the selection of the threshold value for independent component maps and component counts might become uncertain and problematic [11].
In recent years, machine learning and deep learning have been applied to various study areas and shown incredible results. The analysis of fMRI data using machine learning and deep learning techniques is said to be the future of neuroimaging. A convolutional neural network approach was proposed for the recognition of Alzheimer’s disease and showed high accuracy [12, 13].
Correlation is a well-known approach to estimate function connectivity, and there are 65 different correlation methods known to compute the functional connectivity of the brain. Dai et al. used segmentation to obtain 351 regions of interest (ROIs) of the brain and calculated the functional connectivity using Pearson’s correlation [15].
In this study, a canonical ICA analysis was performed on fMRI data. Among these regions, functional connectivity coefficients have been extracted based on their connectivity parameters and used for classification using DNN.
We proposed a framework for the classification of individuals with ADHD and controls (healthy brain). Figure 1 illustrates the framework of this study. First, all preprocessed fMRI data were decomposed using ICA. It provided a unique representation of data and maps of activities that are as spatially independent as possible. Subsequently, functional connectivity coefficients were extracted and feature vectors of these coefficients used to train and test the DNN model for final classification. Furthermore, connectivity matrices for ADHD versus controls were also formed to visualize functional connectivity.
In this study, we used ADHD-200 publicly accessible data composed of resting-state fMRI (rs-fMRI) and anatomical data accumulated from multiple research institutes [16]. This data was preprocessed by three teams using their preferred tools. The first team named their preprocessing the Athena pipeline, in which they used the tools from the FSL and AFNI packages; the second team named it NIAK pipeline, which is based on a neuroimaging analysis kit from CBRAIN software; and the third team carried out the voxel-based morphometry processing using the SPM8 tool, which is called the Burner pipeline. There were 40 data subjects’ and four types of information: (1) paths to rs-fMRI data images (func), (2) CSV files that contain nuisance variables (confounds), (3) preprocessing step details (phenotypic), and (4) data description (description). The dataset featured both typically developing individuals called “controls” and those diagnosed with ADHD called “treatments.”
Decomposition was the first step in extracting functional connectivity coefficients. ICA is commonly used to analyze fMRI data. To estimate functional connectivity, it is important to determine the appropriate ROIs. Nilearn has a function for group-level ICA called CanICA, which allows single subject variability control with respect to functional networks [17]. As recommended by Nilean documentation, 20 component decompositions have been chosen and independent components have been estimated. These independent components have been plotted on default anatomical brain images using a statistical atlas map to show the default mode network (DMN). The total components yielded by decomposition have been shown using a probabilistic atlas map on default anatomical brain images (Figure 2).
However, decomposition was still difficult to understand as we saw different brain regions. To resolve this issue, we summarized the brain signals obtained using ICA and transformed the extracted data into time series. Next, we determined the functional connectivity coefficient based on correlation, which is found to be more accurate in classification than other connectivity parameters (tangent, partial correlation). Correlation simply calculates the marginal connectivity between pairwise ROIs. To compute correlation matrices, Nilearn provides a built-in function called ConnectivityMeasures, which requires two parameters: functional connectivity type (correlation) and time series data acquired from the previous step. This will calculate the connectivity matrices for all subjects. To check the average connectivity coefficient matrices, 20 ADHD (treatments) and 20 control subjects were chosen. Figure 3 shows the average connectivity matrices.
The diagonal lines in Figure 3 can be ignored, as they show correlation with themselves. For better visualization, we can plot the functional connectivity coefficients matrices on default brain image (Figure 4).
The ADHD connections seem less dense compared to the control ones, which indicated the reduced functional connectivity caused by ADHD. The fewer connections in the superior parietal cortex (circled), which is responsible for attention, seemed altered due to ADHD (Figure 4). The collected correlation matrices that provide a vectorized measure of functional connectivity provided the input data for our DNN model for classification.
A four-layer sequential model was used for classification with a specific number of nodes (32,16,16,1). The output node was 1 because it is a binary classification. The reason for choosing four layers was because we were dealing with functions that were not necessarily linearly separable. The input length was set to 32 because the ADHD-200 data set had 40 subjects. The model architecture is shown in Figure 5.
The DNN classification models were implemented using the Intel PC (Intel Core i5-4590, 16 GB RAM, Nvidia GEFORCE GTX 1070 Ti GPU). Python 3.6 and TensorFlow 1.5 libraries with CUDA 10.0 enable were utilized to implement these models. Some Python libraries, such as Keras, Numpy, Pandas, Matplotlib, and Nilearn were used.
For activation functions, we used Tanh and Sigmoid activation for the first and last layer, respectively, because both are pointed by the vanishing gradient problem. In two hidden layers, the ReLu activation function was used to overcome the problem of hidden layers.
Finally, Adam optimization and binary-cross entropy loss functions were used for training the DNN. The reason to select Adam was because it has shown good performance on noisy data. In addition, binary-cross entropy is a good choice for classification problems because it ensures that one output vector is unaffected by other factors, and it is independent for each class. The learning rate and epochs for the model were set to 0.0001 and 100, respectively, with a batch size of 32.
To check the performance of the DNN model, we used accuracy as an evaluation metric [18]. Accuracy(A) can be measured as the number of all correct predictions divided by the total number of predictions/datasets:
The best accuracy value was 1.0 (100%) and the worst was 0.0 (0%).
Figure 6(a) shows the model accuracy graph. As shown in Figure 6, the training and testing accuracy increases with epochs and model loss and decreases with epochs. The DNN models achieved 95% accuracy, which showed that our decision to select correlation as a functional connectivity matrix was successful. These findings showed that classification models in fMRI are not always dependent on imaging data. Functional connectivity coefficients can be used for classification and detection in brain disorders, such as ADHD.
In this study, we explored how functional connectivity can be used to classify fMRI data for ADHD. Functional connectivity correlation coefficients for multiple ROIs were extracted using ICA, and the DNN model was used for classification. The model showed 95% classification accuracy. It will be interesting to see more work with a larger dataset and manual preprocessing steps using Nilearn built-in functions. The results of this study suggested that the DNN model has the potential to recognize individuals with ADHD.
No potential conflict of interest relevant to this article was reported.
E-mail: nishantsep1090@daegu.ac.kr.
E-mail: bjchoi@daegu.ac.kr.
International Journal of Fuzzy Logic and Intelligent Systems 2020; 20(4): 255-260
Published online December 25, 2020 https://doi.org/10.5391/IJFIS.2020.20.4.255
Copyright © The Korean Institute of Intelligent Systems.
Nishant Chauhan and Byung-Jae Choi
Department of Electronic Engineering, Daegu University, Gyeongsan, Korea
Correspondence to:Byung-Jae Choi (bjchoi@daegu.ac.kr)
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted noncommercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
DNN based Classification of ADHD fMRI Data using Functional Connectivity CoefficientFunctional magnetic resonance imaging (fMRI) has emerged as a popular research topic in neuroimaging for automated classification and recognition of different brain disorders. Attention Deficit Hyperactivity Disorder (ADHD) is one of the most common behavioral disorders in young children because its underlying mechanism is still not completely understood. The use of fMRI data in ADHD research is utilized to reflect the neural mechanism and functional integration of the brain. Alteration in the functional connectivity of the brain is expected to provide useful information for classifying or predicting brain disorders. In this study, a deep neural network (DNN) approach was applied to classify ADHD using functional connectivity-based fMRI data. The functional connectivity coefficient was extracted between regions determined by independent component analysis (ICA) and used to feed the DNN for classification. The DNN model demonstrated an accuracy of 95% with the preprocessed fMRI data from Nilearn, which is a Python module for neuroimaging data.
Keywords: Functional Magnetic Resonance Imaging (fMRI), Deep Neural Network (DNN), Attention Deficit Hyperactivity Disorder (ADHD), Independent Component Analysis (ICA), Nilearn
The advancement in methods for studying human brain structure and its functionality is one of the great landmarks of medical research [1]. The human brain can speculate a huge and complex network that efficiently controls the complicated systems of the human body. The brain regions continuously send and receive information to perform bodily functions. The temporal correlation of these regions is assumed to be functionally connected. Recently, we have seen a spike in brain imaging research for analysis of the brain mechanism and pathophysiology involved in neurodegenerative diseases and associated mental disorders. The analysis of functional connectivity of brain regions has become more popular because it is believed that functional connectivity can be key to understanding the cognitive processes of the brain [2].
Recent research has shown that some brain disorders, such as Parkinson’s, Alzheimer’s, and ADHD, are the outcome of the alteration of functional connectivity of the brain network [3]. To understand the mechanism of the disorder, it is important to precisely identify the altered functional connectivity. ADHD is the most common brain disorder found in young children and is characterized by hyperactivity, lack of attention, and behavior control issues [4]. Like many other brain disorders, ADHD increases the difficulty in life not only for the patient but also for a family [5]. Studies have shown that reduced or altered functional connectivity between the anterior cingulate cortex (ACC) and posterior cingulate cortex (PCC) is detected in the ADHD induced brain [6].
There are many imaging techniques available to study brain structure and physiology. Magnetic resonance imaging (MRI) provides structural information about the brain. Diffusion tensor imaging (DTI) displays the fiber connections between brain regions, and positron emission tomography (PET) captures the regional cerebral blood flow (CBF). To investigate the functional connectivity of the brain, functional magnetic resonance imaging (fMRI) has emerged as a favorable neuroimaging tool [2]. In particular, fMRI has the potential to identify the connectivity alteration caused by brain disorders such as Alzheimer’s, epilepsy, schizophrenia, and ADHD.
In this paper, a DNN model is introduced to show the classification of ADHD using fMRI data based on functional connectivity analysis. This approach is not directly based on neuroimaging scans but rather on vectorized functional connectivity measures. The functional connectivity coefficients were extracted using independent component analysis (ICA) and used for training and testing for DNN.
The rest of the paper is organized into the following sections: Section 2 provides a brief literature review of existing methods. Section 3 explains the materials and methods used in the proposed classification model. Section 4 contains the results and discussion. Finally, the concluding remarks are provided in Section 5.
Based on fMRI techniques, many researchers have investigated brain functionality and discovered the structural and functional abnormalities between individuals with ADHD and the control (healthy) group. Nakao et al. [7] used voxel-based morphological analysis in ADHD and found a decrease in the gray matter volume of the lenticular nucleus. A detection algorithm for ADHD using L2-regularized logistic regression and fMRI features was proposed and showed prominent results. However, for non-linear data, the detection accuracy decreased [8, 9]. A functional anatomical discriminative region model for pattern classification and discriminant feature identification was proposed in which ICA was used to extract functional networks in the brain [10]. ICA based methods are considered to be favorable for fMRI studies because there is no prior information required regarding spatial or temporal patterns of source signals. However, these methods have some limitations. First, it is difficult to understand the ICA components, and it is based on assumptions on the independence of components, either spatially or temporally. In addition, the selection of the threshold value for independent component maps and component counts might become uncertain and problematic [11].
In recent years, machine learning and deep learning have been applied to various study areas and shown incredible results. The analysis of fMRI data using machine learning and deep learning techniques is said to be the future of neuroimaging. A convolutional neural network approach was proposed for the recognition of Alzheimer’s disease and showed high accuracy [12, 13].
Correlation is a well-known approach to estimate function connectivity, and there are 65 different correlation methods known to compute the functional connectivity of the brain. Dai et al. used segmentation to obtain 351 regions of interest (ROIs) of the brain and calculated the functional connectivity using Pearson’s correlation [15].
In this study, a canonical ICA analysis was performed on fMRI data. Among these regions, functional connectivity coefficients have been extracted based on their connectivity parameters and used for classification using DNN.
We proposed a framework for the classification of individuals with ADHD and controls (healthy brain). Figure 1 illustrates the framework of this study. First, all preprocessed fMRI data were decomposed using ICA. It provided a unique representation of data and maps of activities that are as spatially independent as possible. Subsequently, functional connectivity coefficients were extracted and feature vectors of these coefficients used to train and test the DNN model for final classification. Furthermore, connectivity matrices for ADHD versus controls were also formed to visualize functional connectivity.
In this study, we used ADHD-200 publicly accessible data composed of resting-state fMRI (rs-fMRI) and anatomical data accumulated from multiple research institutes [16]. This data was preprocessed by three teams using their preferred tools. The first team named their preprocessing the Athena pipeline, in which they used the tools from the FSL and AFNI packages; the second team named it NIAK pipeline, which is based on a neuroimaging analysis kit from CBRAIN software; and the third team carried out the voxel-based morphometry processing using the SPM8 tool, which is called the Burner pipeline. There were 40 data subjects’ and four types of information: (1) paths to rs-fMRI data images (func), (2) CSV files that contain nuisance variables (confounds), (3) preprocessing step details (phenotypic), and (4) data description (description). The dataset featured both typically developing individuals called “controls” and those diagnosed with ADHD called “treatments.”
Decomposition was the first step in extracting functional connectivity coefficients. ICA is commonly used to analyze fMRI data. To estimate functional connectivity, it is important to determine the appropriate ROIs. Nilearn has a function for group-level ICA called CanICA, which allows single subject variability control with respect to functional networks [17]. As recommended by Nilean documentation, 20 component decompositions have been chosen and independent components have been estimated. These independent components have been plotted on default anatomical brain images using a statistical atlas map to show the default mode network (DMN). The total components yielded by decomposition have been shown using a probabilistic atlas map on default anatomical brain images (Figure 2).
However, decomposition was still difficult to understand as we saw different brain regions. To resolve this issue, we summarized the brain signals obtained using ICA and transformed the extracted data into time series. Next, we determined the functional connectivity coefficient based on correlation, which is found to be more accurate in classification than other connectivity parameters (tangent, partial correlation). Correlation simply calculates the marginal connectivity between pairwise ROIs. To compute correlation matrices, Nilearn provides a built-in function called ConnectivityMeasures, which requires two parameters: functional connectivity type (correlation) and time series data acquired from the previous step. This will calculate the connectivity matrices for all subjects. To check the average connectivity coefficient matrices, 20 ADHD (treatments) and 20 control subjects were chosen. Figure 3 shows the average connectivity matrices.
The diagonal lines in Figure 3 can be ignored, as they show correlation with themselves. For better visualization, we can plot the functional connectivity coefficients matrices on default brain image (Figure 4).
The ADHD connections seem less dense compared to the control ones, which indicated the reduced functional connectivity caused by ADHD. The fewer connections in the superior parietal cortex (circled), which is responsible for attention, seemed altered due to ADHD (Figure 4). The collected correlation matrices that provide a vectorized measure of functional connectivity provided the input data for our DNN model for classification.
A four-layer sequential model was used for classification with a specific number of nodes (32,16,16,1). The output node was 1 because it is a binary classification. The reason for choosing four layers was because we were dealing with functions that were not necessarily linearly separable. The input length was set to 32 because the ADHD-200 data set had 40 subjects. The model architecture is shown in Figure 5.
The DNN classification models were implemented using the Intel PC (Intel Core i5-4590, 16 GB RAM, Nvidia GEFORCE GTX 1070 Ti GPU). Python 3.6 and TensorFlow 1.5 libraries with CUDA 10.0 enable were utilized to implement these models. Some Python libraries, such as Keras, Numpy, Pandas, Matplotlib, and Nilearn were used.
For activation functions, we used Tanh and Sigmoid activation for the first and last layer, respectively, because both are pointed by the vanishing gradient problem. In two hidden layers, the ReLu activation function was used to overcome the problem of hidden layers.
Finally, Adam optimization and binary-cross entropy loss functions were used for training the DNN. The reason to select Adam was because it has shown good performance on noisy data. In addition, binary-cross entropy is a good choice for classification problems because it ensures that one output vector is unaffected by other factors, and it is independent for each class. The learning rate and epochs for the model were set to 0.0001 and 100, respectively, with a batch size of 32.
To check the performance of the DNN model, we used accuracy as an evaluation metric [18]. Accuracy(A) can be measured as the number of all correct predictions divided by the total number of predictions/datasets:
The best accuracy value was 1.0 (100%) and the worst was 0.0 (0%).
Figure 6(a) shows the model accuracy graph. As shown in Figure 6, the training and testing accuracy increases with epochs and model loss and decreases with epochs. The DNN models achieved 95% accuracy, which showed that our decision to select correlation as a functional connectivity matrix was successful. These findings showed that classification models in fMRI are not always dependent on imaging data. Functional connectivity coefficients can be used for classification and detection in brain disorders, such as ADHD.
In this study, we explored how functional connectivity can be used to classify fMRI data for ADHD. Functional connectivity correlation coefficients for multiple ROIs were extracted using ICA, and the DNN model was used for classification. The model showed 95% classification accuracy. It will be interesting to see more work with a larger dataset and manual preprocessing steps using Nilearn built-in functions. The results of this study suggested that the DNN model has the potential to recognize individuals with ADHD.
ADHD classification framework.
Decomposition using ICA.
Functional connectivity coefficients matrices based on correlation.
Functional connectivity coefficients visualization.
DNN model architecture.
(a) DNN model accuracy and (b) DNN model loss.
ADHD classification framework.
|@|~(^,^)~|@|Decomposition using ICA.
|@|~(^,^)~|@|Functional connectivity coefficients matrices based on correlation.
|@|~(^,^)~|@|Functional connectivity coefficients visualization.
|@|~(^,^)~|@|DNN model architecture.
|@|~(^,^)~|@|(a) DNN model accuracy and (b) DNN model loss.