# The Role of Medication Data to Enhance the Prediction of Alzheimer’s Progression Using Machine Learning

Authors: Shaker El-Sappagh; Tamer Abuhmed; Bader Alouffi; Radhya Sahal; Naglaa Abdelhade; Hager Saleh
Journal: Computational Intelligence and Neuroscience
 (2021)

---

## Abstract

Early detection of Alzheimer’s disease (AD) progression is crucial for proper disease management. Most studies concentrate on neuroimaging data analysis of baseline visits only. They ignore the fact that AD is a chronic disease and patient’s data are naturally longitudinal. In addition, there are no studies that examine the effect of dementia medicines on the behavior of the disease. In this paper, we propose a machine learning-based architecture for early progression detection of AD based on multimodal data of AD drugs and cognitive scores data. We compare the performance of five popular machine learning techniques including support vector machine, random forest, logistic regression, decision tree, and K-nearest neighbor to predict AD progression after 2.5 years. Extensive experiments are performed using an ADNI dataset of 1036 subjects. The cross-validation performance of most algorithms has been improved by fusing the drugs and cognitive scores data. The results indicate the important role of patient’s taken drugs on the progression of AD disease.


---

## Body

## 1. Introduction

Alzheimer’s disease (AD) is considered as one of the most severe diseases that destroy the brain (Zheng and Xu [1]). According to the Alzheimer’s Association report by Huber-Carol et al. [2], more than sixty million people around the globe would suffer from AD in the next fifty years. Moreover, based on the report estimation, one person is affected by dementia every three seconds. Consequently, by 2050, the potential number is 152 million internationally [3]. As dementia has several stages, there is a stage called mild cognitive impairment (MCI) between healthy aging and AD. Most people with MCI are gradually advance to dementia within five years (Ye et al. [4]). In addition, MCI patients who are ranged between d 10% to 20% convert to AD per year as estimated by Qiu et al. [5]. Therefore, the early-stage discovery of AD could provide an opportunity for a treatment that slows down AD symptoms and improve the patient’s life (Gray et al. [6]). The early identification of patients in whom AD and progressive MCI (pMCI) is converted from stable MCI (sMCI) is a complex problem because patients always have similar signs (Lee et al. [7]). Machine learning (ML) techniques is playing an essential role in many areas such as engineering, physics, mathematics, marketing, and computer science (Liu et al. [8, 9]). ML techniques have great potential to adopt with this medical challenge (Liu et al. [10]). As AD is considered as chronic disease, the collected patients’ data are considered to be time-series and multimodal data. Furthermore, the AD patients’ data is considered as heterogeneous based on the patients' profiles. Recently, several ML models such as K-nearest neighbor (KNN), support vector machine (SVM), multilayer perceptron (MLP), and logistic regression (LR) have been employed to classify a patient as cognitive normal (CN), MCI, or AD (Moradi et al. [11]; Park et al. [12]). These studies focus primarily on using single modalities including magnetic resonance imaging (MRI) (Liu et al. [10]), fluoro-deoxyglucose positron emission tomography (FDGPET) (Hinrichs et al. [13]), diffusion tensor imaging (DTI), and cerebrospinal fluid (CSF). However, using single modalities negatively affects models’ performance because some useful additional information from various biomarker modalities is omitted (Ye et al. [4]). Some studies have investigated the combination of multiple modalities for AD classification, and they achieved better performance compared to methods based on single modalities (Gray et al. [6], Zhang et al. [14]). In this context, Wee et al. [15] used both DTI and MRI to identify ten patients with MCI from 17 matched CN patients. The accuracy is increased by 7.4% better than using the single-modality-based method. Bouwman et al. [16] diagnosed CN patients from MCI using two modalities: MRI and CSF. For predicting cognitive loss in MCI, Fellgiebel et al. [17] used PET and CSF to predict cognitive loss in MCI. Zhang et al. [14] classified AD and MCI from CN using integration between three modalities: MRI, FDGPET, and CSF. Gray et al. [6] applied a random forest (RF) algorithm to four modalities: genetics, MRI, CSF, and FDGPET to classify AD versus MCI versus CN. In the other hand, there are some works that used time-series approaches to detect AD progression. The authors in Moradi et al. [11] used semisupervised learning to predict MCI-to-AD conversion between one to three years using MRI modality.The authors in El-Sappagh et al. [18] used ensemble machine learning classifiers based on RF for the two layers, utilizing multimodal AD datasets. Venugopalan et al. [19] used different models including, SVM, DT, RF, and KNN, to early detect the AD stage. In addition, they demonstrated multimodality data and single-modality models. Moore et al. [20] studied the relationship between pairs of data points at various time separations using RF. In addition, they used three modalities: demographic, physical, and cognitive data.Model performance is improved using time-series data with multimodel consideration for AD progression detection. The resulting models are expected to be more stable and medically acceptable because they mimic the real procedures followed by medical experts. In addition to MRI, PET, and CSF, there is a crucial data source, which has not been studied in the literature of AD. This data source is dementia medications, which are taken during patient’s observation period. The drugs contains of chemical substances which are accumulated in the body in some forms, which increases the probability of disease progression, or the drugs could help to improve the patient conditions, which decreases the probability of disease progression. Thus, it is necessary to study the impact of these drugs on the disease’s progression (Zimmerman [21]). Furthermore, there is no study in the literature that discussed this issue. In this work, we have provided an ML-based model to predict AD progression after 2.5 years. In doing so, we have implemented and tested a set of ML techniques according to the patient multimodal time-series data. The study is based on the cognitive score and Alzheimer’s medication (AM) data. For every patient, these modalities are collected for 1.5 years (baseline, month-6, month-12, and month-18) and used to predict the patient’s state at month 48. We used the ADNI dataset. ADNI is real clinical data, so our results have potential practical applications. Extensive experiments have been performed, and AM data showed the superiority of improving the CV performance of most algorithms. All models have been optimized using the grid search technique. Furthermore, the effect of the feature selection process on the model’s performance has been studied.The rest of this paper is structured as follows: Section2 presents the architecture of the proposed system of predicting Alzheimer’s progression. Section 3 describes the experimental results. Finally, the paper is concluded in Section 4.


## 2. The Proposed System of Predicting Alzheimer’s Progression

The proposed system of predicting Alzheimer’s progression is described in Figure1. It consists of the following steps: data collection, data preprocessing, data fusion and splitting, data balancing, classifiers optimization and training, and models evaluation. Each step of the proposed system is described in detail in the following subsections.Figure 1
The architecture of the proposed system of predicting Alzheimer’s progression.


### 2.1. Data Collection

Data used in this work was collected from the Alzheimer’s disease neuroimaging initiative (ADNI) database disease neuroimaging initiative [22]. Over 57 sites in the United States and Canada have enrolled subjects El-Sappagh et al. [18]. The study was carried out in accordance with GCP principles, the Declaration of Helsinki, and US 21 CFR part 50 —Protection of Human Subjects—and part 56 —Institutional Review Boards. Subjects were willing and able to participate in test procedures such as neuroimaging and follow-up, and they gave written informed consent. All data are open to the public at disease neuroimaging initiative [22]. The collected dataset has 1036 subjects categorized into four groups, as shown in Table 1. The study is based on two time-series modalities of the cognitive score (CS) and Alzheimer’s medication (AM). The CS dataset includes eight features: CDRSB, GDTOTAL, FAQ, ADAS 13, CDG, MMSE, MOCA, and NPISCORE. Based on the ADNI dataset, we designed a drug dataset that includes nine features: antidepressant, Cognex, Aricept, Namenda, Exelon, Razadyne, Other, and None. These drugs are sorted according to their popularity in our dataset as Aricept, Namenda, antidepression, Exelon, and Cognex (42.18%, 25.77%, 23.84%, 6.18%, and 0.09%, respectively). Mostly the CN (85.94%) patients did not take any drugs. As a result, we removed this class from the dataset. All datasets have 787 patients and three classes (sMCI, pMCI, and AD). Table 1 shows the patients’ demographics.Table 1
Patients’ statistics at baseline.
sMCI (n = 363)pMCI (n = 106)AD (n = 318)Combined (n = 1036)Sex (M/F)210/15344/62142/176483/553Age (years)72.92± 07.7673.89± 06.8475.01± 07.8173.82± 07.18Education15.80± 02.9716.13± 02.7115.13± 02.9815.85± 02.90FAQ02.64± 03.3107.63± 04.4916.42± 06.5906.81± 08.01MMSE27.62± 01.9525.46± 01.8420.95± 03.9525.66± 04.17MoCA22.96± 02.2120.69± 01.8417.11± 03.4321.56± 04.14APOE400.51± 00.6600.85± 00.7100.85± 00.7100.56± 00.67ADAS 1314.69± 06.7122.69± 05.2933.59± 09.3919.73± 12.24ADAS 1109.18± 04.4714.25± 03.9022.82± 08.0912.96± 08.88CDRSB01.42± 00.7902.99± 01.1905.99± 02.4902.67± 02.79∗ Data are mean ± standard deviation.


#### 2.1.1. Data Preprocessing

We prepare both the drugs and cognitive scores datasets that we collected from the ADNI dataset, as shown in Figure2. The drug dataset has several preprocessing steps:Time filtering: In this phase, we filtered data of four visits, that is, the first four visits (bl, M06, M12, M18) denoted to baseline, month 6, month 12, and month 18, respectively. These visits data are exploited with and without drug data to explore the effects of drugs on predicting an AD patient’s progression after 2.5 years (at month 48).Code separation: The drug dataset includes a column containing multiple values and delimiter “:” that separates values. We separate the row into two multirows using “:” delimiter. The Cognex feature has been removed because only 0.09% of the patients used it.Data encoding: The dataset includes a column with names of patients’ drugs; we split each drug’s name and create a new dataset that includes nine columns. The names of the drugs are listed in these columns. Each column has a binary value (i.e., 0 or 1) indicating whether or not the patient is taking the drug.Aggregation: The last dataset includes multiple rows of each patient. We convert multiple rows of each patient into one row by grouping rows using the RID column and get max value for each column.Figure 2
Data fusion steps.The preprocessing of the CS dataset has been done as follows:The randomness of the data has been checked, and the data are missing at random.To minimize the negative effect of missing data on our dataset, any case with missing baseline scores or features with missing values of more than 30% was deleted. We used the forward filling technique to handle missing time-series data, where the previous values were used if the diagnosis was not changed for a time step.Data normalization for CS data has been done using the z-score method. Fourth, aggregated features from the four historical time steps were collected to summarize time-series data. We took the average of each CS for each patient.


#### 2.1.2. Dataset Splitting

Given the two collected features sets (i.e., CS, AM), three datasets are created: (1) CS features only dataset, (2) AM features dataset, and (3) CS-AM dataset, where the CS and AM modalities are fused. The stratified method is used to split each dataset into 90% of the dataset as the training set, and 10% of the dataset as the unseen test set. The Ml models were trained and optimized using the training set; the ML models were evaluated using the unseen test set.


#### 2.1.3. Dataset Balancing

Biased models are always the outcome of unbalanced datasets. The synthetic minority oversampling approach (SMOTE) proposed by Chawla et al. [23] was used to handle the class imbalance to avoid the biased models. The SMOTE is applied to only the training set.


#### 2.1.4. Classifiers Optimization and Training

The optimal values of hyperparameters of the ML models were selected using the grid search approach with stratified 10-fold CV. The five were applied to each dataset:Support vector machine (SVM) is a supervised learning approach that analyzes data for classification or regression. The SVM is a discriminative algorithm that is formalized by an optimum hyperplane. It generates an optimal hyperplane result, which classifies unknown instances, and datasets that support the hyperplane are referred to as support vectors. However, selecting the optimum hyperplane is tough since it must be noise-free and accurate in its generalization of data sets. SVM is attempting to discover an optimum hyperplane that delivers a significant minimum distance to the trained data set.Decision tree (DT) by Sweety and Jiji [24] is one of the most widely used machine learning classifiers. It is pretty trendy because it can be customized to nearly all kinds of data types. It is a supervised learning technique that partitions training data into smaller chunks to extract patterns for classification. The knowledge is then shown as a tree, which is easy to understand. The decision model is constructed from the top-down of the tree structure, beginning with the (top) root node. The root nodes are significant predictors, while the leaf nodes have a final classification.K-nearest neighbor (KNN) is a type of supervised algorithm. A KNN algorithm attempts to locate the pattern space for thek instances of training that are similar in new instances when analyzing testing data. KNN classifier may be appropriate for the dependent variable, covering two principles: low risk, medium risk, and high risk. Moreover, the KNN classification needs the same number of bad and good sample examples for better performance. The selection of k also fulfills the KNN process performance.Random forest (RF) by Alickovic et al. [25] is a machine learning classifier based on trees that leverages the power of multiple decision trees for making decisions. RF is made up of several decision trees, each of which chooses its separation features from a bootstrap training set. RF offers several advantages: the approach of classification is exact, quick, and noise-resistant. In RF, random selection and bagging features are merged. The values of independently sampled random vectors are influenced by every tree in the forest and have the same distribution as every other tree.Logistic regression (LR) Mirzaei et al. [26] is a supervised machine learning classifier that predicts the likelihood of a target variable. It is a multivariate technique that seeks to create functional relationships between numerous predictor variables and a single output. In most situations, the LR output variable is categorical because it can only be assigned to a limited number of classes. LR is a powerful ML algorithm because it can generate probabilities and categorize new data using discrete and continuous datasets.


#### 2.1.5. Evaluation Metrics

Models are evaluated using four standard metrics: accuracy, precision, recall, and F1-score, where TP stands for true positive, TN for true negative, FP for false positive, and FN for false negative, as shown in equations (1)–(4).(1)Accuracy=TP+TNTP+FP+TN+FN,(2)Precision=TPTP+FP,(3)Recall=TPTP+FN,(4)F1=2·precision·recallprecision+recall.


## 2.1. Data Collection

Data used in this work was collected from the Alzheimer’s disease neuroimaging initiative (ADNI) database disease neuroimaging initiative [22]. Over 57 sites in the United States and Canada have enrolled subjects El-Sappagh et al. [18]. The study was carried out in accordance with GCP principles, the Declaration of Helsinki, and US 21 CFR part 50 —Protection of Human Subjects—and part 56 —Institutional Review Boards. Subjects were willing and able to participate in test procedures such as neuroimaging and follow-up, and they gave written informed consent. All data are open to the public at disease neuroimaging initiative [22]. The collected dataset has 1036 subjects categorized into four groups, as shown in Table 1. The study is based on two time-series modalities of the cognitive score (CS) and Alzheimer’s medication (AM). The CS dataset includes eight features: CDRSB, GDTOTAL, FAQ, ADAS 13, CDG, MMSE, MOCA, and NPISCORE. Based on the ADNI dataset, we designed a drug dataset that includes nine features: antidepressant, Cognex, Aricept, Namenda, Exelon, Razadyne, Other, and None. These drugs are sorted according to their popularity in our dataset as Aricept, Namenda, antidepression, Exelon, and Cognex (42.18%, 25.77%, 23.84%, 6.18%, and 0.09%, respectively). Mostly the CN (85.94%) patients did not take any drugs. As a result, we removed this class from the dataset. All datasets have 787 patients and three classes (sMCI, pMCI, and AD). Table 1 shows the patients’ demographics.Table 1
Patients’ statistics at baseline.
sMCI (n = 363)pMCI (n = 106)AD (n = 318)Combined (n = 1036)Sex (M/F)210/15344/62142/176483/553Age (years)72.92± 07.7673.89± 06.8475.01± 07.8173.82± 07.18Education15.80± 02.9716.13± 02.7115.13± 02.9815.85± 02.90FAQ02.64± 03.3107.63± 04.4916.42± 06.5906.81± 08.01MMSE27.62± 01.9525.46± 01.8420.95± 03.9525.66± 04.17MoCA22.96± 02.2120.69± 01.8417.11± 03.4321.56± 04.14APOE400.51± 00.6600.85± 00.7100.85± 00.7100.56± 00.67ADAS 1314.69± 06.7122.69± 05.2933.59± 09.3919.73± 12.24ADAS 1109.18± 04.4714.25± 03.9022.82± 08.0912.96± 08.88CDRSB01.42± 00.7902.99± 01.1905.99± 02.4902.67± 02.79∗ Data are mean ± standard deviation.


### 2.1.1. Data Preprocessing

We prepare both the drugs and cognitive scores datasets that we collected from the ADNI dataset, as shown in Figure2. The drug dataset has several preprocessing steps:Time filtering: In this phase, we filtered data of four visits, that is, the first four visits (bl, M06, M12, M18) denoted to baseline, month 6, month 12, and month 18, respectively. These visits data are exploited with and without drug data to explore the effects of drugs on predicting an AD patient’s progression after 2.5 years (at month 48).Code separation: The drug dataset includes a column containing multiple values and delimiter “:” that separates values. We separate the row into two multirows using “:” delimiter. The Cognex feature has been removed because only 0.09% of the patients used it.Data encoding: The dataset includes a column with names of patients’ drugs; we split each drug’s name and create a new dataset that includes nine columns. The names of the drugs are listed in these columns. Each column has a binary value (i.e., 0 or 1) indicating whether or not the patient is taking the drug.Aggregation: The last dataset includes multiple rows of each patient. We convert multiple rows of each patient into one row by grouping rows using the RID column and get max value for each column.Figure 2
Data fusion steps.The preprocessing of the CS dataset has been done as follows:The randomness of the data has been checked, and the data are missing at random.To minimize the negative effect of missing data on our dataset, any case with missing baseline scores or features with missing values of more than 30% was deleted. We used the forward filling technique to handle missing time-series data, where the previous values were used if the diagnosis was not changed for a time step.Data normalization for CS data has been done using the z-score method. Fourth, aggregated features from the four historical time steps were collected to summarize time-series data. We took the average of each CS for each patient.


### 2.1.2. Dataset Splitting

Given the two collected features sets (i.e., CS, AM), three datasets are created: (1) CS features only dataset, (2) AM features dataset, and (3) CS-AM dataset, where the CS and AM modalities are fused. The stratified method is used to split each dataset into 90% of the dataset as the training set, and 10% of the dataset as the unseen test set. The Ml models were trained and optimized using the training set; the ML models were evaluated using the unseen test set.


### 2.1.3. Dataset Balancing

Biased models are always the outcome of unbalanced datasets. The synthetic minority oversampling approach (SMOTE) proposed by Chawla et al. [23] was used to handle the class imbalance to avoid the biased models. The SMOTE is applied to only the training set.


### 2.1.4. Classifiers Optimization and Training

The optimal values of hyperparameters of the ML models were selected using the grid search approach with stratified 10-fold CV. The five were applied to each dataset:Support vector machine (SVM) is a supervised learning approach that analyzes data for classification or regression. The SVM is a discriminative algorithm that is formalized by an optimum hyperplane. It generates an optimal hyperplane result, which classifies unknown instances, and datasets that support the hyperplane are referred to as support vectors. However, selecting the optimum hyperplane is tough since it must be noise-free and accurate in its generalization of data sets. SVM is attempting to discover an optimum hyperplane that delivers a significant minimum distance to the trained data set.Decision tree (DT) by Sweety and Jiji [24] is one of the most widely used machine learning classifiers. It is pretty trendy because it can be customized to nearly all kinds of data types. It is a supervised learning technique that partitions training data into smaller chunks to extract patterns for classification. The knowledge is then shown as a tree, which is easy to understand. The decision model is constructed from the top-down of the tree structure, beginning with the (top) root node. The root nodes are significant predictors, while the leaf nodes have a final classification.K-nearest neighbor (KNN) is a type of supervised algorithm. A KNN algorithm attempts to locate the pattern space for thek instances of training that are similar in new instances when analyzing testing data. KNN classifier may be appropriate for the dependent variable, covering two principles: low risk, medium risk, and high risk. Moreover, the KNN classification needs the same number of bad and good sample examples for better performance. The selection of k also fulfills the KNN process performance.Random forest (RF) by Alickovic et al. [25] is a machine learning classifier based on trees that leverages the power of multiple decision trees for making decisions. RF is made up of several decision trees, each of which chooses its separation features from a bootstrap training set. RF offers several advantages: the approach of classification is exact, quick, and noise-resistant. In RF, random selection and bagging features are merged. The values of independently sampled random vectors are influenced by every tree in the forest and have the same distribution as every other tree.Logistic regression (LR) Mirzaei et al. [26] is a supervised machine learning classifier that predicts the likelihood of a target variable. It is a multivariate technique that seeks to create functional relationships between numerous predictor variables and a single output. In most situations, the LR output variable is categorical because it can only be assigned to a limited number of classes. LR is a powerful ML algorithm because it can generate probabilities and categorize new data using discrete and continuous datasets.


### 2.1.5. Evaluation Metrics

Models are evaluated using four standard metrics: accuracy, precision, recall, and F1-score, where TP stands for true positive, TN for true negative, FP for false positive, and FN for false negative, as shown in equations (1)–(4).(1)Accuracy=TP+TNTP+FP+TN+FN,(2)Precision=TPTP+FP,(3)Recall=TPTP+FN,(4)F1=2·precision·recallprecision+recall.


## 2.1.1. Data Preprocessing

We prepare both the drugs and cognitive scores datasets that we collected from the ADNI dataset, as shown in Figure2. The drug dataset has several preprocessing steps:Time filtering: In this phase, we filtered data of four visits, that is, the first four visits (bl, M06, M12, M18) denoted to baseline, month 6, month 12, and month 18, respectively. These visits data are exploited with and without drug data to explore the effects of drugs on predicting an AD patient’s progression after 2.5 years (at month 48).Code separation: The drug dataset includes a column containing multiple values and delimiter “:” that separates values. We separate the row into two multirows using “:” delimiter. The Cognex feature has been removed because only 0.09% of the patients used it.Data encoding: The dataset includes a column with names of patients’ drugs; we split each drug’s name and create a new dataset that includes nine columns. The names of the drugs are listed in these columns. Each column has a binary value (i.e., 0 or 1) indicating whether or not the patient is taking the drug.Aggregation: The last dataset includes multiple rows of each patient. We convert multiple rows of each patient into one row by grouping rows using the RID column and get max value for each column.Figure 2
Data fusion steps.The preprocessing of the CS dataset has been done as follows:The randomness of the data has been checked, and the data are missing at random.To minimize the negative effect of missing data on our dataset, any case with missing baseline scores or features with missing values of more than 30% was deleted. We used the forward filling technique to handle missing time-series data, where the previous values were used if the diagnosis was not changed for a time step.Data normalization for CS data has been done using the z-score method. Fourth, aggregated features from the four historical time steps were collected to summarize time-series data. We took the average of each CS for each patient.


## 2.1.2. Dataset Splitting

Given the two collected features sets (i.e., CS, AM), three datasets are created: (1) CS features only dataset, (2) AM features dataset, and (3) CS-AM dataset, where the CS and AM modalities are fused. The stratified method is used to split each dataset into 90% of the dataset as the training set, and 10% of the dataset as the unseen test set. The Ml models were trained and optimized using the training set; the ML models were evaluated using the unseen test set.


## 2.1.3. Dataset Balancing

Biased models are always the outcome of unbalanced datasets. The synthetic minority oversampling approach (SMOTE) proposed by Chawla et al. [23] was used to handle the class imbalance to avoid the biased models. The SMOTE is applied to only the training set.


## 2.1.4. Classifiers Optimization and Training

The optimal values of hyperparameters of the ML models were selected using the grid search approach with stratified 10-fold CV. The five were applied to each dataset:Support vector machine (SVM) is a supervised learning approach that analyzes data for classification or regression. The SVM is a discriminative algorithm that is formalized by an optimum hyperplane. It generates an optimal hyperplane result, which classifies unknown instances, and datasets that support the hyperplane are referred to as support vectors. However, selecting the optimum hyperplane is tough since it must be noise-free and accurate in its generalization of data sets. SVM is attempting to discover an optimum hyperplane that delivers a significant minimum distance to the trained data set.Decision tree (DT) by Sweety and Jiji [24] is one of the most widely used machine learning classifiers. It is pretty trendy because it can be customized to nearly all kinds of data types. It is a supervised learning technique that partitions training data into smaller chunks to extract patterns for classification. The knowledge is then shown as a tree, which is easy to understand. The decision model is constructed from the top-down of the tree structure, beginning with the (top) root node. The root nodes are significant predictors, while the leaf nodes have a final classification.K-nearest neighbor (KNN) is a type of supervised algorithm. A KNN algorithm attempts to locate the pattern space for thek instances of training that are similar in new instances when analyzing testing data. KNN classifier may be appropriate for the dependent variable, covering two principles: low risk, medium risk, and high risk. Moreover, the KNN classification needs the same number of bad and good sample examples for better performance. The selection of k also fulfills the KNN process performance.Random forest (RF) by Alickovic et al. [25] is a machine learning classifier based on trees that leverages the power of multiple decision trees for making decisions. RF is made up of several decision trees, each of which chooses its separation features from a bootstrap training set. RF offers several advantages: the approach of classification is exact, quick, and noise-resistant. In RF, random selection and bagging features are merged. The values of independently sampled random vectors are influenced by every tree in the forest and have the same distribution as every other tree.Logistic regression (LR) Mirzaei et al. [26] is a supervised machine learning classifier that predicts the likelihood of a target variable. It is a multivariate technique that seeks to create functional relationships between numerous predictor variables and a single output. In most situations, the LR output variable is categorical because it can only be assigned to a limited number of classes. LR is a powerful ML algorithm because it can generate probabilities and categorize new data using discrete and continuous datasets.


## 2.1.5. Evaluation Metrics

Models are evaluated using four standard metrics: accuracy, precision, recall, and F1-score, where TP stands for true positive, TN for true negative, FP for false positive, and FN for false negative, as shown in equations (1)–(4).(1)Accuracy=TP+TNTP+FP+TN+FN,(2)Precision=TPTP+FP,(3)Recall=TPTP+FN,(4)F1=2·precision·recallprecision+recall.


## 3. Results

The Python 3.7.3 distributed in Anaconda 4.7.7 (64-bit) were used to run the experiment. The models were implemented using the Scikit-Scikit-learn 0.20.0 library Pedregosa et al. [27] The performance of ML models: SVM, LR, KNN, DT, and RF were registered to three datasets: CS, AM, and AM-CS. Three experiments were conducted to obtain the results. Each conducted experiment has been repeated 6 times, and the average of accuracy, precision, recall, and F1-score was registered (where A: Accuracy, P: Precision, R: Recall, and F1: F1-score). In the first experiment, we initially aimed to evaluate the capability of the ML models to distinguish patients of AD, pMCI, and sMCI classes based on either cognitive scores or Alzheimer’s medication. Then, we tried to answer the question: to what extent does the features infusion of the CS and AM affect the performance of the ML models? Table 2 presents the first experimental results. In the second experiment, we evaluated the effect of AM on detecting pMCI within MCI patients. The experiment tries to answer the question: to what extent does the AM-CS fusion con-tribute to the overall performance of the ML models within the MCI patients? Table 3 presents the second experimental results. The third experiment is similar to experiment 2; however, this experiment answers the question: to what extent does the AM-CS fusion con-tribute to the overall performance of the ML models between the MCI and AD patients? Table 4 presents the third experimental results. For the last two experiments, we try to evaluate the performance of the ML models for MCI patients, who have similar cognitive scores and Alzheimer’s medication, and sMCI vs. AD patients, who have medically different cognitive scores and Alzheimer’s medication.Table 2
The performance for the AD vs. pMCI vs sMCI task.
Testing performanceCross-validation performanceModelDatasetAPRF1APRF1RFCS87.7687.7687.7987.7690.35± 2.990.49± 2.890.47± 2.790.28± 2.5AM68.0567.4768.8268.0558.39± 4.158.3± 4.2660.74± 4.358.27± 4.2AM-CS88.5488.5188.9288.5492.74± 3.192.87± 3.193.03± 2.693.21± 3.3DTCS90.8990.9491.1590.8983.08± 4.983.08± 4.983.49± 4.983.13± 4.8AM64.8164.6469.1564.8153.23± 4.353.23± 4.655.27± 4.753.21± 4.2AM-CS89.3289.3089.7489.3284.96± 3.784.95± 3.785.61± 3.585.15± 3.7LRCS76.8577.1578.3476.8579.85± 4.479.96± 4.380.61± 4.279.85± 4.4AM53.2451.3252.7653.2455.39± 4.654.64± 4.654.7± 4.7155.39± 4.6AM-CS85.4285.4085.6485.4288.40± 3.388.36± 3.388.91± 3.188.4± 3.28SVMCS81.0281.1181.4081.0279.95± 3.979.93± 4.080.7± 3.9679.95± 3.9AM58.3357.0558.8558.3355.35± 4.555.52± 4.456.54± 4.355.35± 4.5AM-CS76.3976.5577.0476.3982.89± 3.182.78± 3.183.18± 3.182.89± 3.1KNNCS73.6174.3176.5373.6176.32± 3.776.8± 3.6880.52± 3.476.32± 3.7AM48.0042.6745.2048.0052.31± 3.243.13± 3.439.62± 7.552.31± 3.2AM-CS74.2272.3782.9974.2282.43± 4.282.11± 4.484.62± 3.882.43± 4.2Table 3
The performance for the sMCI vs pMCI task.
Testing performanceCross-validation performanceModelDatasetAPRF1APRF1RFCS82.9863.6463.6463.6487.76± 4.088.56± 5.387.14± 6.387.66± 4.0AM59.5733.3372.7345.7173.56± 5.270.70± 5.181.05± 7.975.37± 4.8AM-CS85.1166.6772.7369.5787.90± 4.187.47± 4.888.68± 6.787.96± 4.2DTCS87.1675.0081.8278.2689.30± 3.788.37± 4.788.97± 4.788.58± 3.6AM55.3240.7772.7352.2572.79± 5.469.71± 4.481.03± 8.874.79± 5.2AM-CS89.3680.0072.7376.1989.54± 3.689.34± 5.189.58± 6.989.27± 3.9LRCS80.8558.3363.6460.8784.86± 4.086.86± 6.182.55± 4.684.53± 3.9AM61.7046.7872.7356.9367.59± 4.667.68± 4.667.93± 5.467.68± 4.4AM-CS87.2376.4777.4776.9687.07± 4.187.42± 4.986.90± 6.686.99± 4.3SVMCS83.5683.5284.0183.5683.95± 4.583.86± 4.684.61± 4.483.95± 4.5AM69.6869.4770.2169.6867.51± 4.067.07± 4.168.55± 4.567.51± 4.0AM-CS86.5786.5786.6586.5787.10± 4.787.06± 4.787.48± 4.687.1± 4.72KNNCS81.9481.5185.2381.9483.41± 3.682.99± 3.986.66± 3.083.41± 3.6AM75.6974.9079.4575.6966.39± 6.765.46± 7.867.71± 6.666.39± 6.7AM-CS75.2374.9276.5075.2379.62± 4.479.44± 4.580.59± 4.479.62± 4.9Table 4
The performance for the AD vs sMCI task.
Testing performanceCross-validation performanceModelDatasetAPRF1APRF1RFCS94.1494.1494.2494.1494.76± 2.794.66± 2.995.1± 2.6594.71± 2.8AM77.4877.4377.7677.4877.12± 4.976.8± 5.1178.59± 4.877.46± 5.1AM-CS94.8294.8294.8394.8294.96± 2.494.96± 2.595.20± 2.394.91± 2.4DTCS88.5288.5088.6688.5293.02± 2.793.01± 2.793.36± 2.593.08± 2.7AM73.4273.2274.1873.4275.76± 5.175.18± 5.278.42± 5.475.76± 5.1AM-CS84.9184.9085.0584.9193.66± 3.093.76± 2.893.83± 2.793.69± 2.9LRCS92.3492.3492.4092.3494.05± 2.494.5± 2.3994.64± 2.394.05± 2.4AM72.3071.9273.5472.3078.99± 4.278.8± 4.3280.02± 4.178.99± 4.2AM-CS95.9595.9595.9895.9594.12± 2.894.11± 2.894.27± 2.794.12± 2.8SVMCS89.8689.8689.8989.8694.19± 3.394.18± 3.394.36± 3.294.19± 3.3AM75.2375.2275.2475.2377.82± 5.977.44± 6.179.5± 5.7777.82± 5.9AM-CS90.0990.0990.1490.0994.50± 2.694.5± 2.6194.64± 2.594.5± 2.6KNNCS92.7992.7992.8192.7994.17± 2.994.16± 2.994.29± 2.994.17± 2.9AM70.2770.0470.9470.2778.10± 4.077.82± 4.179.46± 3.878.10± 4.0AM-CS94.8294.8294.9494.8294.00± 2.893.99± 2.894.14± 2.894.0± 2.86


### 3.1. Experiment 1: sMCI vs. pMCI vs. AD

Table2 shows that the ML models achieved the best CV performance for the fused dataset. For example, the RF, DT, LR, SVM, and KNN models achieved an accuracy of 92.74%, 84.96%, 88.4%, 82.89%, and 82.43%, respectively. RF is an ensemble classifier, which could be the main reason for its high performance. For the testing performance, three out of the five ML models achieved the highest performance using the fused dataset with accuracies 88.54%, 85.42%, and 74.22% for RF, LR, and KNN models, respectively. This indicates the importance of the AM data for the AD progression detection task. Table 2 also shows that the AM features alone are insufficient and CS-based models can be improved by AM-CS fusion.


### 3.2. Experiment 2: sMCI vs. pMCI

The results of this experiment as shown in Table3 assert the crucial role of AM-CS fusion to enhance the ML model’s performance. For the CV results, the RF, DT, LR, and SVM models with the AM-CS dataset outperformed other models with accuracies 87.90%, 89.54%, 87.07%, and 87.10%, respectively. Besides, testing results of these four ML models show an improvement using the AM-CS dataset with accuracies 85.11%, 89.36%, 87.23%, and 86.57% for RF, DT, LR, and SVM models, respectively. These models achieved testing AUC of 0.878, 0.815, 0.910, and 0.897 for RF, DT, LR, and SVM models, respectively. The results of ML models based on AM dataset alone achieved better performance than recent studies such as Ye et al. [4]. For example, the KNN and SVM models achieved testing accuracies 75.69% and 69.68%. These results are better than the Yao et al. model, which achieved an accuracy of 68.98% based on neuroimaging data.


### 3.3. Experiment 3: sMCI vs. AD

Similar to experiment 2, the results of this experiment assert the importance of AM-CS fusion to improve the detection of AD patients from MCI cases. Moreover, the performance of this experiment is better than the previous two experiments because all ML models can easily separate both sMCI and AD cases. For the CV results, the RF, DT, LR, and SVM models with AM-CS dataset outperformed other models with accuracies 94.96%, 93.66%, 94.12%, and 94.50%, respectively. Besides, testing results of these four ML models show an improvement using the AM-CS dataset with accuracies 94.82%, 95.95%, 90.09%, and 94.82% for RF, LR, SVM, and KNN models, respectively. These models achieved testing AUC of 0.941, 0.955, 0.897, and 0.941 for RF, LR, SVM, and KNN models, respectively. All the experiments confirmed our hypothesis that AM-CS fusion has a positive effect on the performance of progression detection problem in Alzheimer’s disease.


## 3.1. Experiment 1: sMCI vs. pMCI vs. AD

Table2 shows that the ML models achieved the best CV performance for the fused dataset. For example, the RF, DT, LR, SVM, and KNN models achieved an accuracy of 92.74%, 84.96%, 88.4%, 82.89%, and 82.43%, respectively. RF is an ensemble classifier, which could be the main reason for its high performance. For the testing performance, three out of the five ML models achieved the highest performance using the fused dataset with accuracies 88.54%, 85.42%, and 74.22% for RF, LR, and KNN models, respectively. This indicates the importance of the AM data for the AD progression detection task. Table 2 also shows that the AM features alone are insufficient and CS-based models can be improved by AM-CS fusion.


## 3.2. Experiment 2: sMCI vs. pMCI

The results of this experiment as shown in Table3 assert the crucial role of AM-CS fusion to enhance the ML model’s performance. For the CV results, the RF, DT, LR, and SVM models with the AM-CS dataset outperformed other models with accuracies 87.90%, 89.54%, 87.07%, and 87.10%, respectively. Besides, testing results of these four ML models show an improvement using the AM-CS dataset with accuracies 85.11%, 89.36%, 87.23%, and 86.57% for RF, DT, LR, and SVM models, respectively. These models achieved testing AUC of 0.878, 0.815, 0.910, and 0.897 for RF, DT, LR, and SVM models, respectively. The results of ML models based on AM dataset alone achieved better performance than recent studies such as Ye et al. [4]. For example, the KNN and SVM models achieved testing accuracies 75.69% and 69.68%. These results are better than the Yao et al. model, which achieved an accuracy of 68.98% based on neuroimaging data.


## 3.3. Experiment 3: sMCI vs. AD

Similar to experiment 2, the results of this experiment assert the importance of AM-CS fusion to improve the detection of AD patients from MCI cases. Moreover, the performance of this experiment is better than the previous two experiments because all ML models can easily separate both sMCI and AD cases. For the CV results, the RF, DT, LR, and SVM models with AM-CS dataset outperformed other models with accuracies 94.96%, 93.66%, 94.12%, and 94.50%, respectively. Besides, testing results of these four ML models show an improvement using the AM-CS dataset with accuracies 94.82%, 95.95%, 90.09%, and 94.82% for RF, LR, SVM, and KNN models, respectively. These models achieved testing AUC of 0.941, 0.955, 0.897, and 0.941 for RF, LR, SVM, and KNN models, respectively. All the experiments confirmed our hypothesis that AM-CS fusion has a positive effect on the performance of progression detection problem in Alzheimer’s disease.


## 4. Conclusion

This paper studies the role of dementia drugs in improving the progression detection for AD patients based on multimodal time-series data. The algorithm is based on the patient’s four-time-step time-series data and can predict AD within 2.5 years of M18. The model is based on the early merging of time-series modalities from CS and AM. We have optimized and tested five ML models using the real-world ADNI dataset. The results showed the crucial role of drugs features to enhance the performance of these ML models. In the future, we will extend this work by studying the interpretability features of these models.



---

*Source: 8439655-2021-09-22.xml*