# A Novel Triple Matrix Factorization Method for Detecting Drug-Side Effect Association Based on Kernel Target Alignment

Authors: Xiaoyi Guo; Wei Zhou; Yan Yu; Yijie Ding; Jijun Tang; Fei Guo
Journal: BioMed Research International
 (2020)

---

## Abstract

All drugs usually have side effects, which endanger the health of patients. To identify potential side effects of drugs, biological and pharmacological experiments are done but are expensive and time-consuming. So, computation-based methods have been developed to accurately and quickly predict side effects. To predict potential associations between drugs and side effects, we propose a novel method called the Triple Matrix Factorization- (TMF-) based model. TMF is built by the biprojection matrix and latent feature of kernels, which is based on Low Rank Approximation (LRA). LRA could construct a lower rank matrix to approximate the original matrix, which not only retains the characteristics of the original matrix but also reduces the storage space and computational complexity of the data. To fuse multivariate information, multiple kernel matrices are constructed and integrated via Kernel Target Alignment-based Multiple Kernel Learning (KTA-MKL) in drug and side effect space, respectively. Compared with other methods, our model achieves better performance on three benchmark datasets. The values of the Area Under the Precision-Recall curve (AUPR) are 0.677, 0.685, and 0.680 on three datasets, respectively.


---

## Body

## 1. Introduction

Drug treatment of patients’ diseases may be accompanied by side effects, endangering the life and health of patients. Therefore, how to quickly and accurately find potential drug side effect information becomes an important step in the drug development process. The traditional methods to detect the side effects of drugs are usually biological and pharmacological experiments. These approaches often take a long time and huge capital investment. So, it is necessary to accurately and quickly predict the potential side effects of drugs through computation-based methods [1]. Most computation-based methods for predicting drug side effects used Machine Learning (ML) classification models to predict side effect categories by extracted features from the biochemical characteristics of drugs. ML has been widely used in the field of computational biology, containing potential disease-associated microRNAs [2, 3] or circRNAs [4], O-GlcNAcylation sites [5], prediction of DNA or RNA methylcytosine sites [6, 7], protein function identification [8–12], protein remote homology [13], analyzing microbiology [14], electron transport proteins [15], drug-target interactions [16], drug-side effect association [17, 18], protein-protein interactions [19, 20], and lncRNA-miRNA interactions [21].Pauwels and Stoven develop a predictive model of drug-side effect association by Ordinary Canonical Correlation Analysis (OCCA) and Sparse Canonical Correlation Analysis (SCCA) [1, 22]. The input feature of OCCA and SCCA is extracted from chemical structures of drugs. Cheng and Wang proposed the Phenotypic Network Inference Model (PNIM) [23] to detect new potential drug-side effect associations. Mizutani and Stoven [24] utilized cooccurrence of drug profiles and protein interaction profiles to predict side effects. The Support Vector Machine (SVM) was used to build Adverse Drug Reaction (ADR) prediction, which is based on chemical structures, biological properties of drugs, and phenotypic characteristics [25]. Zhang et al. [26–28] built an ensemble method, which was based on the Integrated Neighborhood-Based Method (INBM) and Restricted Boltzmann Machine-Based Method (RBMBM). Matrix Factorization- (MF-) based methods have been widely used for link prediction in bipartite networks of systems biology. To predict drug-target interactions, Neighborhood Regularized Logistic Matrix Factorization (NRLMF) [29], Collaborative Matrix Factorization (CMF) [30], and Graph Regularized Matrix Factorization (GRMF) [31] were developed via the MF theory.In our study, we develop a Triple Matrix Factorization- (TMF-) based model to identify the associations of drug and side effect. TMF employs the biprojection matrix and two latent feature matrices (from drug and side effect space) to estimate the strength of new drug-side effect associations. Latent feature matrices are built via Low Rank Approximation (LRA), which could construct a lower rank matrix to approximate the original matrix. To improve the performance of prediction, Kernel Target Alignment-based Multiple Kernel Learning (KTA-MKL) is used to integrate multiple kernel matrices in drug and side effect space, respectively. Our method can fuse multivariate information (multiple kernels) and obtain new associations through matrix projection. Compared with other existing methods, our model obtains better performance on three benchmark datasets.


## 2. Method

### 2.1. Problem Description

The dataset of drug-side effect association can be regarded as a bipartite network, which hasn drugs and m side effects. The relationships of drug and side effect can be represented as a n×m adjacent matrix Y∈Rn×m. D=d1,d2,⋯,dn and S=s1,s2,⋯,sm are the drug and side effect sets, respectively. Yi,j=1 denotes that drug di and side effect sj are related; otherwise, it is 0. The associations between drugs and side effect terms are shown in Figure 1. The solid lines link the known drug-side effect associations. The hollow circles and filled squares are drugs and side effects, respectively. The prediction of new associations is a recommender task.Figure 1
The schematic diagram of associations between drugs and side effects.


### 2.2. Drug Kernels and Side Effect Kernels

To predict the associations of drugs and side effects, we need to construct the relationship between drugs (or side effects). In this study, we build different kernels (similarity matrices) to describe the relationships of drugs (or side effects). In drug space, the fingerprint of 881 chemical substructures is employed to encode the drug chemical structure, which is shown in Figure2. The fingerprint represents whether some substructures are present (1) or absent (0). What is more, the known links between drugs and side effect terms (a side effect profile for a specific drug) are also used to represent the information of the subjacent network, which is shown on the right side of Figure 1. In side effect space, the drug profile for a side effect also represents the subjacent network of side effects.Figure 2
An example of the fingerprint vector.There are four different types of measure functions, including Gaussian Interaction Profile (GIP) kernel [32–35], COsine Similarity (COS) [26], Correlation coefficient (Corr) [26], and Mutual Information (MI) [36, 37], which are employed to calculate the similarity between the drugs (or side effects).For drugdi and dk, the GIP kernel is defined as follows:
(1)KGIP−link,ddi,dk=exp−γprdi−prdk2,where γ is the bandwidth of the Gaussian kernel. γ is set as 1 in our study. prdi and prdk are the side effect profile of drug di and dk, respectively.The COS is defined as follows:(2)KCOS−link,ddi,dk=prdiprdkTprdiprdk.The Corr kernel is calculated as follows:(3)KCorr−link,ddi,dk=Covprdi,prdkVarprdiVarprdk.In order to describe the degree of correlation between two random variables, we further use Mutual Information (MI) to measure the similarity between the two random variables:(4)KMI−link,ddi,dk=Iprdi,prdk=∑u=01∑v=01fu,vlogfu,vfufv,where fu (fv) denotes the observed frequency of value u (v) in profile prdi (prdk). fu,v is the observed relative frequency. Similarly, the kernels of the fingerprint (drug space: KGIP−chem,d, KCOS−chem,d, KCorr−chem,d, and KMI−chem,d) and drug profile of side effects (side effect space: KGIP−link,s, KCOS−link,s, KCorr−link,s, and KMI−link,s) can be constructed via the above functions. The drug space has 8 kernels, and the side effect space has 4 kernels, which are listed in Table 1.Table 1
Summary of kernels for two feature spaces.
Chemical fingerprint (drug space)Side effect profiles (drug space)Drug profiles (side effect space)GIPKGIP−chem,dKGIP−link,dKGIP−link,sCOSKCOS−chem,dKCOS−link,dKCOS−link,sCorrKCorr−chem,dKCorr−link,dKCorr−link,sMIKMI−chem,dKMI−link,dKMI−link,s


### 2.3. Kernel Target Alignment-Based Multiple Kernel Learning

In our study, the kernel sets for drug spaceKd=K1,d,K2,d,⋯,Kkd,d and side effect space Ks=K1,s,K2,s,⋯,Kks,s are combined via multiple kernel learning, respectively. kd and ks are the number of kernels in drug and side effect space, respectively. A heuristic approach of Kernel Target Alignment-based Multiple Kernel Learning (KTA-MKL) [38, 39] is employed to calculate the weights of each kernel. The optimal kernels of Kd∗ and Ks∗ can be obtained as follows:
(5)Kd∗=∑p=1kdβp,dKp,d,Kp,d∈Rn×n,Ks∗=∑q=1ksβq,sKq,s,Kq,s∈Rm×m,where βd=β1,d,β2,d,⋯,βkd,d and βs=β1,s,β2,s,⋯,βks,s are the weights of kernels in drug and side effect space, respectively. KTA-MKL estimates the weight of each kernel by COsine Similarity of matrices (drug space):
(6)AP,Q=P,QF∥P∥F∥Q∥F,where PF=P,PF denotes the Frobenius norm. P,QF=TracePTQ is the Frobenius inner product. The value of kernel alignment can describe similarity of two kernels. KTA-MKL estimates the value between the ideal kernel matrix and the drug kernel (or side effect kernel) as follows:
(7)βp,d=AKp,d,Kideal,d∑k=1kdAKk,d,Kideal,d,p=1,2,⋯,kd,βq,s=AKq,s,Kideal,s∑k=1ksAKk,s,Kideal,s,q=1,2,⋯,ks,where Kideal,d=YtrainYtrainT∈Rn×n and Kideal,s=YtrainTYtrain∈Rm×m are the ideal kernels of drug and side effect, respectively, which are built via the training label (known associations).


### 2.4. Triple Matrix Factorization-Based Model

Inspired by MF [29–31, 40], the similarity between drugs (or side effects) can be approximated by the inner product of two drug (or side effect) features as follows:
(8)Kd∗≈AAT,A∈Rn×rd,Ks∗≈BBT,B∈Rm×rs,where A and B are the matrices of Low Rank Approximation and rd and rs are the dimensions of the latent feature space in drug and side effect space, respectively. The objective function of TMF is defined as follows:
(9)minJΘ=Ytrain−AΘBTF2+λΘF2,where Θ∈Rrd×rs is the biprojection matrix. λ is the regularization coefficient of Θ. In our study, λ is set as 1.Let∂J/∂Θ=0, so we can obtain functions as follows:
(10)∂Ytrain−AΘBTF2+λΘF2∂Θ=0,(11)−2ATYtrain−AΘBTB+2λΘ=0,(12)ATAΘBTB+λΘ=ATYtrainB,(13)ATAΘ+λΘBTB−1=ATYtrainBBTB−1,(14)ATAΘ+λΘBTB−1=ATYtrainBT−1,where Equation (14) is a Sylvester equation. The final prediction can be constructed by
(15)Y∗=AΘBT.The overview of our proposed method is shown in Figure3 and Algorithm 1.Algorithm 1: Algorithm of our method.
Require: A training matrixYtrain∈Rn×m (known associations), the fingerprint vector fdichem∈R1×8811≤i≤n for the drug; Two parameters: the rd and rs for TMF;Ensure: The prediction ofY∗∈Rn×m;1: Constructing the drug and side effect kernels, which are listed in Table1;2: Utilizing Equation (7) (KTA-MKL) to obtain the weights βd and βs for drug and side effect, respectively;3: BuildingKd∗ and Ks∗ via Equation (5), respectively;4: CalculatingA∈Rn×rd and B∈Rm×rs by Singular Value Decomposition (SVD);5: Solving Equation (14) (TMF) to estimate Θ;6: CalculatingY∗=AΘBT;Figure 3
Overview of our method.


## 2.1. Problem Description

The dataset of drug-side effect association can be regarded as a bipartite network, which hasn drugs and m side effects. The relationships of drug and side effect can be represented as a n×m adjacent matrix Y∈Rn×m. D=d1,d2,⋯,dn and S=s1,s2,⋯,sm are the drug and side effect sets, respectively. Yi,j=1 denotes that drug di and side effect sj are related; otherwise, it is 0. The associations between drugs and side effect terms are shown in Figure 1. The solid lines link the known drug-side effect associations. The hollow circles and filled squares are drugs and side effects, respectively. The prediction of new associations is a recommender task.Figure 1
The schematic diagram of associations between drugs and side effects.


## 2.2. Drug Kernels and Side Effect Kernels

To predict the associations of drugs and side effects, we need to construct the relationship between drugs (or side effects). In this study, we build different kernels (similarity matrices) to describe the relationships of drugs (or side effects). In drug space, the fingerprint of 881 chemical substructures is employed to encode the drug chemical structure, which is shown in Figure2. The fingerprint represents whether some substructures are present (1) or absent (0). What is more, the known links between drugs and side effect terms (a side effect profile for a specific drug) are also used to represent the information of the subjacent network, which is shown on the right side of Figure 1. In side effect space, the drug profile for a side effect also represents the subjacent network of side effects.Figure 2
An example of the fingerprint vector.There are four different types of measure functions, including Gaussian Interaction Profile (GIP) kernel [32–35], COsine Similarity (COS) [26], Correlation coefficient (Corr) [26], and Mutual Information (MI) [36, 37], which are employed to calculate the similarity between the drugs (or side effects).For drugdi and dk, the GIP kernel is defined as follows:
(1)KGIP−link,ddi,dk=exp−γprdi−prdk2,where γ is the bandwidth of the Gaussian kernel. γ is set as 1 in our study. prdi and prdk are the side effect profile of drug di and dk, respectively.The COS is defined as follows:(2)KCOS−link,ddi,dk=prdiprdkTprdiprdk.The Corr kernel is calculated as follows:(3)KCorr−link,ddi,dk=Covprdi,prdkVarprdiVarprdk.In order to describe the degree of correlation between two random variables, we further use Mutual Information (MI) to measure the similarity between the two random variables:(4)KMI−link,ddi,dk=Iprdi,prdk=∑u=01∑v=01fu,vlogfu,vfufv,where fu (fv) denotes the observed frequency of value u (v) in profile prdi (prdk). fu,v is the observed relative frequency. Similarly, the kernels of the fingerprint (drug space: KGIP−chem,d, KCOS−chem,d, KCorr−chem,d, and KMI−chem,d) and drug profile of side effects (side effect space: KGIP−link,s, KCOS−link,s, KCorr−link,s, and KMI−link,s) can be constructed via the above functions. The drug space has 8 kernels, and the side effect space has 4 kernels, which are listed in Table 1.Table 1
Summary of kernels for two feature spaces.
Chemical fingerprint (drug space)Side effect profiles (drug space)Drug profiles (side effect space)GIPKGIP−chem,dKGIP−link,dKGIP−link,sCOSKCOS−chem,dKCOS−link,dKCOS−link,sCorrKCorr−chem,dKCorr−link,dKCorr−link,sMIKMI−chem,dKMI−link,dKMI−link,s


## 2.3. Kernel Target Alignment-Based Multiple Kernel Learning

In our study, the kernel sets for drug spaceKd=K1,d,K2,d,⋯,Kkd,d and side effect space Ks=K1,s,K2,s,⋯,Kks,s are combined via multiple kernel learning, respectively. kd and ks are the number of kernels in drug and side effect space, respectively. A heuristic approach of Kernel Target Alignment-based Multiple Kernel Learning (KTA-MKL) [38, 39] is employed to calculate the weights of each kernel. The optimal kernels of Kd∗ and Ks∗ can be obtained as follows:
(5)Kd∗=∑p=1kdβp,dKp,d,Kp,d∈Rn×n,Ks∗=∑q=1ksβq,sKq,s,Kq,s∈Rm×m,where βd=β1,d,β2,d,⋯,βkd,d and βs=β1,s,β2,s,⋯,βks,s are the weights of kernels in drug and side effect space, respectively. KTA-MKL estimates the weight of each kernel by COsine Similarity of matrices (drug space):
(6)AP,Q=P,QF∥P∥F∥Q∥F,where PF=P,PF denotes the Frobenius norm. P,QF=TracePTQ is the Frobenius inner product. The value of kernel alignment can describe similarity of two kernels. KTA-MKL estimates the value between the ideal kernel matrix and the drug kernel (or side effect kernel) as follows:
(7)βp,d=AKp,d,Kideal,d∑k=1kdAKk,d,Kideal,d,p=1,2,⋯,kd,βq,s=AKq,s,Kideal,s∑k=1ksAKk,s,Kideal,s,q=1,2,⋯,ks,where Kideal,d=YtrainYtrainT∈Rn×n and Kideal,s=YtrainTYtrain∈Rm×m are the ideal kernels of drug and side effect, respectively, which are built via the training label (known associations).


## 2.4. Triple Matrix Factorization-Based Model

Inspired by MF [29–31, 40], the similarity between drugs (or side effects) can be approximated by the inner product of two drug (or side effect) features as follows:
(8)Kd∗≈AAT,A∈Rn×rd,Ks∗≈BBT,B∈Rm×rs,where A and B are the matrices of Low Rank Approximation and rd and rs are the dimensions of the latent feature space in drug and side effect space, respectively. The objective function of TMF is defined as follows:
(9)minJΘ=Ytrain−AΘBTF2+λΘF2,where Θ∈Rrd×rs is the biprojection matrix. λ is the regularization coefficient of Θ. In our study, λ is set as 1.Let∂J/∂Θ=0, so we can obtain functions as follows:
(10)∂Ytrain−AΘBTF2+λΘF2∂Θ=0,(11)−2ATYtrain−AΘBTB+2λΘ=0,(12)ATAΘBTB+λΘ=ATYtrainB,(13)ATAΘ+λΘBTB−1=ATYtrainBBTB−1,(14)ATAΘ+λΘBTB−1=ATYtrainBT−1,where Equation (14) is a Sylvester equation. The final prediction can be constructed by
(15)Y∗=AΘBT.The overview of our proposed method is shown in Figure3 and Algorithm 1.Algorithm 1: Algorithm of our method.
Require: A training matrixYtrain∈Rn×m (known associations), the fingerprint vector fdichem∈R1×8811≤i≤n for the drug; Two parameters: the rd and rs for TMF;Ensure: The prediction ofY∗∈Rn×m;1: Constructing the drug and side effect kernels, which are listed in Table1;2: Utilizing Equation (7) (KTA-MKL) to obtain the weights βd and βs for drug and side effect, respectively;3: BuildingKd∗ and Ks∗ via Equation (5), respectively;4: CalculatingA∈Rn×rd and B∈Rm×rs by Singular Value Decomposition (SVD);5: Solving Equation (14) (TMF) to estimate Θ;6: CalculatingY∗=AΘBT;Figure 3
Overview of our method.


## 3. Result

In this section, we employed benchmark dataset to evaluate our approach and compared it with other existing methods.


### 3.1. Datasets

In order to test the performance of our model, three types of datasets are employed in our study. They are Pauwels’s dataset, Liu’s dataset, and Mizutani’s dataset, which are collected from the DrugBank [41], SIDe Effect Resource (SIDER) [42], KEGG DRUG [43], and PubChemCompound [44, 45]. Table 2 lists benchmark datasets of this study.Table 2
Three benchmark datasets.
DatasetsDrugsSide effectsAssociationsPauwels’s dataset888138561,102Mizutani’s dataset658133949,051Liu’s dataset832138559,205


### 3.2. Evaluation Measurements

The training adjacent matrix can be obtained via randomly setting known associations as 0. In this study, we use 5-fold Cross-Validation (5-CV) and 5-fold local Cross-Validation (5 local CV) to test our method. 5-CV randomly sets known associations as 0 in the whole matrix. 5 local CV is employed to evaluate the prediction of new drugs, which do not have any side effect information. 5 local CV sets some rows of the adjacent matrix as 0 to test related drugs. The Area Under the Precision-Recall curve (AUPR) and Area Under the receiver operating Characteristic curve (AUC) are utilized to evaluate the performance of prediction.


### 3.3. Selecting Optimal Parameters

In this section, we use the grid search method to get the optimalrd and rs. We test different values of and from 100 to the max value with the step of 100. The results of the grid search method are shown in Figure 4 (on Mizutani’s dataset by 5-CV). rd=700 and rs=800 are the best parameters (AUPR) on Mizutani’s dataset. In Figure 4, the lower value of AURP and AUC is blue, and the higher value is yellow. On the other two datasets, we use the same parameters of rd and rs.Figure 4
The AUC and AUPR values (under differentrd and rs).
(a)
AUPR values on Mizutani (under differentrd and rs)(b)
AUC values on Mizutani (under differentrd and rs)


### 3.4. Performance of Different Kernels

We evaluate the performance of multiple kernels and single kernel on three datasets. The results of prediction are listed in Table3 and Figure 5. Obviously, the kernels of KMI−link,d and KMI−link,s have better performance on Pauwels’s dataset (AUPR: 0.6557, AUC: 0.9079), Mizutani’s dataset (AUPR: 0.6615, AUC: 0.9369), and Liu’s dataset (AUPR: 0.6587, AUC: 0.9408). In addition, the KTA-MKL model achieves the best results on Pauwels’s dataset (AUPR: 0.6765, AUC: 0.9434), Mizutani’s dataset (AUPR: 0.6847, AUC: 0.9409), and Liu’s dataset (AUPR: 0.6801, AUC: 0.9426), respectively. KTA-MKL could combine kernels from different sources via the heuristic method, which is better mean weighted.Table 3
The performance of different kernels via 5-fold Cross-Validation.
ModelsPauwels’s datasetMizutani’s datasetLiu’s datasetAUPRAUCAUPRAUCAUPRAUCKGIP−chem,d & KGIP−link,sa0.44200.89500.47350.91480.47180.9145KCOS−chem,d & KCOS−link,sa0.48920.89940.53430.90700.52240.9067KCorr−chem,d & KCorr−link,sa0.49940.89810.52170.90050.51430.9026KMI−chem,d & KMI−link,sa0.49780.90790.55910.92140.55290.9238KGIP−link,d & KGIP−link,sb0.62540.93000.66230.93760.65740.9398KCOS−link,d & KCOS−link,sb0.58610.90350.63240.90900.62520.9087KCorr−link,d & KCorr−link,sb0.58330.89990.61230.90140.60470.9013KMI−link,d & KMI−link,sb0.65570.94280.66150.93690.65870.9408Mean weightedc0.65980.93530.67240.92800.66510.9285KTA-MKLc0.67650.94340.68470.94090.68010.9426aThe TMF uses the drug fingerprint and drug profile for side effects. bThe TMF uses the side effect profile for drugs and drug profile for side effects. cThe TMF uses the drug fingerprint, side effect profile for drugs, and drug profile for side effects.Figure 5
The ROC and PR curves of different models (single kernel and multiple kernels).
(a)
ROC curves on Pauwels’s dataset(b)
PR curves on Pauwels’s dataset(c)
ROC curves on Mizutani’s dataset(d)
PR curves on Mizutani’s dataset(e)
ROC curves on Liu’s dataset(f)
PR curves on Liu’s datasetIn Table4, we list the weight of each kernel on three datasets. We can find that the weights of KMI−link,d and KMI−link,s are the highest than other kernels. At the same time, their performance is also the best. KTA-MKL could reduce bias of kernels by the low weights.Table 4
The kernel weights on three datasets.
KernelPauwels’s datasetMizutani’s datasetLiu’s datasetKGIP−chem,d0.11590.11680.1167KCOS−chem,d0.12240.12260.1226KCorr−chem,d0.12000.12030.1203KMI−chem,d0.11130.11220.1116KGIP−link,d0.05960.06210.0613KCOS−link,d0.15380.15330.1528KCorr−link,d0.15070.14980.1497KMI−link,d0.16640.16280.1650KGIP−link,s0.01510.01730.0152KCOS−link,s0.32860.33740.3380KCorr−link,s0.29090.28650.2855KMI−link,s0.36540.35880.3613


### 3.5. Comparison with Existing Methods

To evaluate the performance of the TMF model, we compare it with other methods. The results are listed in Table5. Obviously, our method (TMF) achieves the best results on Pauwels’s dataset (AUPR: 0.677), Mizutani’s dataset (AUPR: 0.685), and Liu’s dataset (AUPR: 0.680). Zhang et al.’s work (ensemble model) [26] obtained the good performance of AUPRs (0.660, 0.666, and 0.661). The best AUCs (0.954, 0.950, and 0.953) are achieved by Neighborhood Regularized Logistic Matrix Factorization (NRLMF) [29], which is also based on Matrix Factorization (MF). The results of other MF-based models, including Collaborative Matrix Factorization (CMF) [30] and Graph Regularized Matrix Factorization (GRMF) [31], are competitive. Local and Global Consistency (LGC) [18] is our previous work. LGC obtains the second best results of AUPR (0.668, 0.673, and 0.670) on three datasets, respectively.Table 5
Comparison to existing methods via 5-fold Cross-Validation.
DatasetsMethodsAUPRAUCPauwelsPauwels’s methoda0.389±N/A0.897±N/ALiu’s methoda0.345±N/A0.920±N/ACheng’s methoda0.588±N/A0.922±N/ARBMBMa [26]0.612±N/A0.941±N/AINBMa [26]0.641±N/A0.934±N/AEnsemble modela [26]0.660±N/A0.949±N/ACMFb0.646±0.0070.939±0.005GRMFb0.643±0.0060.937±0.005NRLMFb0.654±0.0050.954±0.005LGCb0.668±0.0080.952±0.007Our method0.677±0.0040.943±0.003MizutaniMizutani’s methoda0.412±N/A0.890±N/ALiu’s methoda0.366±N/A0.918±N/ACheng’s methoda0.599±N/A0.923±N/ARBMBMa [26]0.619±N/A0.939±N/AINBMa [26]0.646±N/A0.932±N/AEnsemble modela [26]0.666±N/A0.946±N/ACMFb0.645±0.0050.938±0.006GRMFb0.646±0.0070.937±0.007NRLMFb0.660±0.0060.950±0.005LGCb0.673±0.0070.948±0.007Our method0.685±0.0060.941±0.008LiuLiu’s methoda0.278±N/A0.907±N/ACheng’s methoda0.592±N/A0.922±N/ARBMBMa [26]0.616±N/A0.941±N/AINBMa [26]0.641±N/A0.934±N/AEnsemble modela [26]0.661±N/A0.948±N/ACMFb0.649±0.0060.938±0.005GRMFb0.650±0.0070.938±0.008NRLMFb0.656±0.0050.953±0.006LGCb0.670±0.0080.951±0.007Our method0.680±0.0050.943±0.006aResults are derived from [26]. bResults are derived from [18].


### 3.6. Local CV and Case Study

In some cases, certain drugs are new and have no information of side effects. The 5 local CV is employed to test the performance of the side effect prediction for new drugs. In this section, we also compare TMF with other MF-based models, including NRLMF, CMF, and GRMF. The results are listed in Table6 and Figure 6.Table 6
Comparison with MF-based models via 5-fold local Cross-Validation.
DatasetsMethodsAUPRAUCPauwelsCMF∗0.382±0.0060.894±0.004GRMF∗0.358±0.0080.883±0.005NRLMF∗0.374±0.0070.886±0.004Our method0.392±0.0080.889±0.004MizutaniCMF∗0.395±0.0050.889±0.004GRMF∗0.392±0.0080.890±0.006NRLMF∗0.390±0.0060.882±0.005Our method0.399±0.0130.886±0.003LiuCMF∗0.393±0.0070.894±0.005GRMF∗0.379±0.0080.895±0.006NRLMF∗0.398±0.0060.897±0.004Our method0.401±0.0150.891±0.004∗Results are derived from [18].Figure 6
The ROC and PR curves of different methods via 5 local CV.
(a)
ROC curves on Pauwels’s dataset(b)
PR curves on Pauwels’s dataset(c)
ROC curves on Mizutani’s dataset(d)
PR curves on Mizutani’s dataset(e)
ROC curves on Liu’s dataset(f)
PR curves on Liu’s datasetThe proposed method (TMF) achieves the best results of AUPRs on Pauwels’s dataset (AUPR: 0.392), Mizutani’s dataset (AUPR: 0.399), and Liu’s dataset (AUPR: 0.401). Other MF-based models also are still comparable with our results. NRLMF obtains AUPRs of 0.374, 0.390, and 0.398 on three datasets, respectively.To predict the side effects of a new drug, our model calculates the strength of associations between the new drug and all existing side effects. The predictive strength scores of TMF will be ranked by descending order. The higher the value of the score, the higher the possibility of associations. In this section, we discuss two cases (drug caffeine and captopril on Mizutani’s dataset) of top 10 associations predicted. The details are listed in Tables7 and 8. Results are checked by the masked associations between drug caffeine (or captopril) and side effects.Table 7
Top 10 ranks of predictive side effects for drug caffeine.
Side effectScoreRanksConfirmedDiarrhea0.39921YesDiabetic neuropathy0.38932YesVaricocele0.38443YesGynecomastia0.38154YesConjunctivitis0.37945YesTelangiectasia0.37376NoLump0.36637YesDyskinesia0.36388NoPalpitations0.36329NoFecal incontinence0.356310YesTable 8
Top 10 ranks of predictive side effects for drug captopril.
Side effectScoreRanksConfirmedDiarrhea0.41501NoDiabetic neuropathy0.40432YesVaricocele0.40043YesConjunctivitis0.39734YesGynecomastia0.39385YesMyoglobinuria0.38856NoEsophageal varices0.38547YesLump0.38068YesPalpitations0.37709NoEclampsia0.367410Yes


### 3.7. Running Time

We evaluate the performance for predictive models of running time. The results of test are listed in Table9. The running time of CMF is less than our method (TMF), LGC, GRMF, and NRLMF on Pauwels’s dataset (910 seconds), Mizutani’s dataset (757 seconds), and Liu’s dataset (846 seconds). TMF costs 977, 873, and 929 seconds, which are less than the ensemble model [26].Table 9
The running time (seconds) via 5-fold Cross-Validation.
ModelPauwelsMizutaniLiuOur method977873929LGC [18]129011701211CMF [18]910757846GRMF [18]136011751282NRLMF [18]196612501911Ensemble model [26]433027153611


## 3.1. Datasets

In order to test the performance of our model, three types of datasets are employed in our study. They are Pauwels’s dataset, Liu’s dataset, and Mizutani’s dataset, which are collected from the DrugBank [41], SIDe Effect Resource (SIDER) [42], KEGG DRUG [43], and PubChemCompound [44, 45]. Table 2 lists benchmark datasets of this study.Table 2
Three benchmark datasets.
DatasetsDrugsSide effectsAssociationsPauwels’s dataset888138561,102Mizutani’s dataset658133949,051Liu’s dataset832138559,205


## 3.2. Evaluation Measurements

The training adjacent matrix can be obtained via randomly setting known associations as 0. In this study, we use 5-fold Cross-Validation (5-CV) and 5-fold local Cross-Validation (5 local CV) to test our method. 5-CV randomly sets known associations as 0 in the whole matrix. 5 local CV is employed to evaluate the prediction of new drugs, which do not have any side effect information. 5 local CV sets some rows of the adjacent matrix as 0 to test related drugs. The Area Under the Precision-Recall curve (AUPR) and Area Under the receiver operating Characteristic curve (AUC) are utilized to evaluate the performance of prediction.


## 3.3. Selecting Optimal Parameters

In this section, we use the grid search method to get the optimalrd and rs. We test different values of and from 100 to the max value with the step of 100. The results of the grid search method are shown in Figure 4 (on Mizutani’s dataset by 5-CV). rd=700 and rs=800 are the best parameters (AUPR) on Mizutani’s dataset. In Figure 4, the lower value of AURP and AUC is blue, and the higher value is yellow. On the other two datasets, we use the same parameters of rd and rs.Figure 4
The AUC and AUPR values (under differentrd and rs).
(a)
AUPR values on Mizutani (under differentrd and rs)(b)
AUC values on Mizutani (under differentrd and rs)


## 3.4. Performance of Different Kernels

We evaluate the performance of multiple kernels and single kernel on three datasets. The results of prediction are listed in Table3 and Figure 5. Obviously, the kernels of KMI−link,d and KMI−link,s have better performance on Pauwels’s dataset (AUPR: 0.6557, AUC: 0.9079), Mizutani’s dataset (AUPR: 0.6615, AUC: 0.9369), and Liu’s dataset (AUPR: 0.6587, AUC: 0.9408). In addition, the KTA-MKL model achieves the best results on Pauwels’s dataset (AUPR: 0.6765, AUC: 0.9434), Mizutani’s dataset (AUPR: 0.6847, AUC: 0.9409), and Liu’s dataset (AUPR: 0.6801, AUC: 0.9426), respectively. KTA-MKL could combine kernels from different sources via the heuristic method, which is better mean weighted.Table 3
The performance of different kernels via 5-fold Cross-Validation.
ModelsPauwels’s datasetMizutani’s datasetLiu’s datasetAUPRAUCAUPRAUCAUPRAUCKGIP−chem,d & KGIP−link,sa0.44200.89500.47350.91480.47180.9145KCOS−chem,d & KCOS−link,sa0.48920.89940.53430.90700.52240.9067KCorr−chem,d & KCorr−link,sa0.49940.89810.52170.90050.51430.9026KMI−chem,d & KMI−link,sa0.49780.90790.55910.92140.55290.9238KGIP−link,d & KGIP−link,sb0.62540.93000.66230.93760.65740.9398KCOS−link,d & KCOS−link,sb0.58610.90350.63240.90900.62520.9087KCorr−link,d & KCorr−link,sb0.58330.89990.61230.90140.60470.9013KMI−link,d & KMI−link,sb0.65570.94280.66150.93690.65870.9408Mean weightedc0.65980.93530.67240.92800.66510.9285KTA-MKLc0.67650.94340.68470.94090.68010.9426aThe TMF uses the drug fingerprint and drug profile for side effects. bThe TMF uses the side effect profile for drugs and drug profile for side effects. cThe TMF uses the drug fingerprint, side effect profile for drugs, and drug profile for side effects.Figure 5
The ROC and PR curves of different models (single kernel and multiple kernels).
(a)
ROC curves on Pauwels’s dataset(b)
PR curves on Pauwels’s dataset(c)
ROC curves on Mizutani’s dataset(d)
PR curves on Mizutani’s dataset(e)
ROC curves on Liu’s dataset(f)
PR curves on Liu’s datasetIn Table4, we list the weight of each kernel on three datasets. We can find that the weights of KMI−link,d and KMI−link,s are the highest than other kernels. At the same time, their performance is also the best. KTA-MKL could reduce bias of kernels by the low weights.Table 4
The kernel weights on three datasets.
KernelPauwels’s datasetMizutani’s datasetLiu’s datasetKGIP−chem,d0.11590.11680.1167KCOS−chem,d0.12240.12260.1226KCorr−chem,d0.12000.12030.1203KMI−chem,d0.11130.11220.1116KGIP−link,d0.05960.06210.0613KCOS−link,d0.15380.15330.1528KCorr−link,d0.15070.14980.1497KMI−link,d0.16640.16280.1650KGIP−link,s0.01510.01730.0152KCOS−link,s0.32860.33740.3380KCorr−link,s0.29090.28650.2855KMI−link,s0.36540.35880.3613


## 3.5. Comparison with Existing Methods

To evaluate the performance of the TMF model, we compare it with other methods. The results are listed in Table5. Obviously, our method (TMF) achieves the best results on Pauwels’s dataset (AUPR: 0.677), Mizutani’s dataset (AUPR: 0.685), and Liu’s dataset (AUPR: 0.680). Zhang et al.’s work (ensemble model) [26] obtained the good performance of AUPRs (0.660, 0.666, and 0.661). The best AUCs (0.954, 0.950, and 0.953) are achieved by Neighborhood Regularized Logistic Matrix Factorization (NRLMF) [29], which is also based on Matrix Factorization (MF). The results of other MF-based models, including Collaborative Matrix Factorization (CMF) [30] and Graph Regularized Matrix Factorization (GRMF) [31], are competitive. Local and Global Consistency (LGC) [18] is our previous work. LGC obtains the second best results of AUPR (0.668, 0.673, and 0.670) on three datasets, respectively.Table 5
Comparison to existing methods via 5-fold Cross-Validation.
DatasetsMethodsAUPRAUCPauwelsPauwels’s methoda0.389±N/A0.897±N/ALiu’s methoda0.345±N/A0.920±N/ACheng’s methoda0.588±N/A0.922±N/ARBMBMa [26]0.612±N/A0.941±N/AINBMa [26]0.641±N/A0.934±N/AEnsemble modela [26]0.660±N/A0.949±N/ACMFb0.646±0.0070.939±0.005GRMFb0.643±0.0060.937±0.005NRLMFb0.654±0.0050.954±0.005LGCb0.668±0.0080.952±0.007Our method0.677±0.0040.943±0.003MizutaniMizutani’s methoda0.412±N/A0.890±N/ALiu’s methoda0.366±N/A0.918±N/ACheng’s methoda0.599±N/A0.923±N/ARBMBMa [26]0.619±N/A0.939±N/AINBMa [26]0.646±N/A0.932±N/AEnsemble modela [26]0.666±N/A0.946±N/ACMFb0.645±0.0050.938±0.006GRMFb0.646±0.0070.937±0.007NRLMFb0.660±0.0060.950±0.005LGCb0.673±0.0070.948±0.007Our method0.685±0.0060.941±0.008LiuLiu’s methoda0.278±N/A0.907±N/ACheng’s methoda0.592±N/A0.922±N/ARBMBMa [26]0.616±N/A0.941±N/AINBMa [26]0.641±N/A0.934±N/AEnsemble modela [26]0.661±N/A0.948±N/ACMFb0.649±0.0060.938±0.005GRMFb0.650±0.0070.938±0.008NRLMFb0.656±0.0050.953±0.006LGCb0.670±0.0080.951±0.007Our method0.680±0.0050.943±0.006aResults are derived from [26]. bResults are derived from [18].


## 3.6. Local CV and Case Study

In some cases, certain drugs are new and have no information of side effects. The 5 local CV is employed to test the performance of the side effect prediction for new drugs. In this section, we also compare TMF with other MF-based models, including NRLMF, CMF, and GRMF. The results are listed in Table6 and Figure 6.Table 6
Comparison with MF-based models via 5-fold local Cross-Validation.
DatasetsMethodsAUPRAUCPauwelsCMF∗0.382±0.0060.894±0.004GRMF∗0.358±0.0080.883±0.005NRLMF∗0.374±0.0070.886±0.004Our method0.392±0.0080.889±0.004MizutaniCMF∗0.395±0.0050.889±0.004GRMF∗0.392±0.0080.890±0.006NRLMF∗0.390±0.0060.882±0.005Our method0.399±0.0130.886±0.003LiuCMF∗0.393±0.0070.894±0.005GRMF∗0.379±0.0080.895±0.006NRLMF∗0.398±0.0060.897±0.004Our method0.401±0.0150.891±0.004∗Results are derived from [18].Figure 6
The ROC and PR curves of different methods via 5 local CV.
(a)
ROC curves on Pauwels’s dataset(b)
PR curves on Pauwels’s dataset(c)
ROC curves on Mizutani’s dataset(d)
PR curves on Mizutani’s dataset(e)
ROC curves on Liu’s dataset(f)
PR curves on Liu’s datasetThe proposed method (TMF) achieves the best results of AUPRs on Pauwels’s dataset (AUPR: 0.392), Mizutani’s dataset (AUPR: 0.399), and Liu’s dataset (AUPR: 0.401). Other MF-based models also are still comparable with our results. NRLMF obtains AUPRs of 0.374, 0.390, and 0.398 on three datasets, respectively.To predict the side effects of a new drug, our model calculates the strength of associations between the new drug and all existing side effects. The predictive strength scores of TMF will be ranked by descending order. The higher the value of the score, the higher the possibility of associations. In this section, we discuss two cases (drug caffeine and captopril on Mizutani’s dataset) of top 10 associations predicted. The details are listed in Tables7 and 8. Results are checked by the masked associations between drug caffeine (or captopril) and side effects.Table 7
Top 10 ranks of predictive side effects for drug caffeine.
Side effectScoreRanksConfirmedDiarrhea0.39921YesDiabetic neuropathy0.38932YesVaricocele0.38443YesGynecomastia0.38154YesConjunctivitis0.37945YesTelangiectasia0.37376NoLump0.36637YesDyskinesia0.36388NoPalpitations0.36329NoFecal incontinence0.356310YesTable 8
Top 10 ranks of predictive side effects for drug captopril.
Side effectScoreRanksConfirmedDiarrhea0.41501NoDiabetic neuropathy0.40432YesVaricocele0.40043YesConjunctivitis0.39734YesGynecomastia0.39385YesMyoglobinuria0.38856NoEsophageal varices0.38547YesLump0.38068YesPalpitations0.37709NoEclampsia0.367410Yes


## 3.7. Running Time

We evaluate the performance for predictive models of running time. The results of test are listed in Table9. The running time of CMF is less than our method (TMF), LGC, GRMF, and NRLMF on Pauwels’s dataset (910 seconds), Mizutani’s dataset (757 seconds), and Liu’s dataset (846 seconds). TMF costs 977, 873, and 929 seconds, which are less than the ensemble model [26].Table 9
The running time (seconds) via 5-fold Cross-Validation.
ModelPauwelsMizutaniLiuOur method977873929LGC [18]129011701211CMF [18]910757846GRMF [18]136011751282NRLMF [18]196612501911Ensemble model [26]433027153611


## 4. Conclusion and Discussion

In this study, we develop a Triple Matrix Factorization-based model to predict the associations between drugs and side effect terms. In drug space, several kernels are constructed from the chemical substructure fingerprint and known side effect-associated subnet. The side effect kernels are built from the known drug-associated subnet. The kernel functions include GIP, COS, Corr, and MI. Above kernels are combined by KTA-MKL in drug and side effect space, respectively. The integrated kernel matrices (including drug and side effect) are Low Rank Approximation in the TMF model. Our model (TMF) is tested on three benchmark datasets of drug-side effect association. Compared with other excellent methods, TMF achieves the best results (5-CV) on Pauwels’s dataset (AUPR: 0.677), Mizutani’s dataset (AUPR: 0.685), and Liu’s dataset (AUPR: 0.680), respectively. In addition, our model is also compared with CMF, GRMF, and NRLMF under 5 local CV. The best AUPRs are achieved on Pauwels’s dataset (AUPR: 0.392), Mizutani’s dataset (AUPR: 0.399), and Liu’s dataset (AUPR: 0.401). However, our method does not consider the topological relationship of drugs or side effects. In the future, a graph- or hypergraph-embedded MF-based model will be developed to improve the predictive performance of drug-side effect association.



---

*Source: 4675395-2020-05-29.xml*