BACKGROUND
by conservative estimates, we know the molecular basis of more than  <dig>  human diseases, whereas treatments are available for only about  <dig> of them
<cit> .
the modern drug discovery paradigm, i.e., starting with a disease target and looking for a highly selective small molecule that interacts strongly only with the intended target, is struggling to meet our medical and social requirements
<cit> .
current estimates indicate that it takes an average of 14 years at a cost of close to $ <dig> billion to bring a new, safe, and efficacious drug to market
<cit> .
in the process, more than 90% of the drug candidates fail due to safety concerns, inadequate bioavailability, or lack of efficacy
<cit> .
in reality, highly selective compounds are rare.
the large number of safety and bioavailability issues facing candidate drugs, as well as reported side effects of marketed drugs, is a reflection of many undocumented and deleterious interactions between drugs and human targets.
in addition, many underlying disease causes are multifactorial and can be due to dysfunctional processes involving multiple biomolecules.
even though significant efforts are devoted to understanding the molecular details of drug action, the fact is that the mechanisms of action of many efficacious drugs are poorly understood and, in many cases, remain largely unknown
<cit> .
drug interactions with unintended targets may lead to devastating side effects.
however, these interactions may also signal the possibility for a drug to have therapeutic potential for diseases other than those for which it was approved.
indeed, there are many examples of a drug developed for a specific disease that was later approved for treating an unrelated disease
<cit> .
one of the most dramatic examples is thalidomide, a drug first marketed as an anti-nausea and sedative agent prescribed to treat morning sickness in pregnant women.
thalidomide was found to cause severe birth defects and was withdrawn from the market, but it later proved to have other therapeutic effects and was approved by the united states food and drug administration  for skin lesions caused by leprosy
<cit>  and multiple myeloma
<cit> .
in addition, thalidomide has shown promise in treating cutaneous lupus and behcet’s disease, human immunodeficiency virus -related mouth and throat ulcers, and blood and bone marrow cancers
<cit> .
although the recorded effects of thalidomide are multifaceted, with multiple underlying mechanisms possible
<cit> , clarification of a mechanism
<cit>  that distinguishes between the teratogenic and anticancer therapeutic effects of thalidomide
<cit>  was only recently identified.
the success of drug repurposing, i.e., finding new uses for existing drugs, via serendipitous discoveries inspired the development of many computational approaches for the discovery of the yet unknown therapeutic potentials of existing drugs
<cit> .
a common approach used in drug repurposing is to build a binary classifier based on a training set consisting of drugs with and without a desired therapeutic effect as the positive and negative classes, respectively.
one of the requirements for developing a statistically sound classifier is the availability of a relatively large number of drugs in the training set.
furthermore, it is desirable to have an equal number of drugs with and without the desired therapeutic effect in the training set so as not to bias classifier training.
however, when there are many drugs approved for treating a disease, the need for discovering more drugs for the same disease is less than that for a disease for which there is a very limited number of drugs or no drugs at all.
thus, there is a need to develop computational drug repurposing methods that can be applied to diseases for which there are very few known pharmacological options.
in this article, we report on the development of a computational approach termed “drug-protein interaction-based repurposing”  that is potentially applicable to diseases for which a very limited number of drugs are available.
we based dpir on large-scale drug-protein interaction profiles and bayesian statistics to decipher the drug-protein interactions indicative of a desired therapeutic effect.
these drug-protein interactions are then used to identify other drugs that are likely to have the same therapeutic effect.
methods
source of large-scale chemical-protein interaction information
to create large-scale chemical-protein interaction profiles for fda-approved drugs and drug development candidates, we exploited the search tool for interactions of chemicals  database
<cit> .
the october  <dig> release of the database  contains chemical-protein interaction information, derived from a broad range of sources, between  <dig>  small molecules and  <dig>  million proteins from  <dig>  organisms.
the database provides a confidence measure for each chemical-protein interaction calculated by the equation score =  <dig> – Π
i
, with corrections that take into account the possibility of observing an interaction by chance
<cit> .
in the equation, p
i
denotes the confidence of interaction from the i-th information source.
based on stitch, a score between  <dig>  and  <dig>  indicates medium confidence, between  <dig>  and  <dig>  indicates high confidence, and between  <dig>  and  <dig>  indicates the highest confidence.
to retain high-confidence chemical-protein interactions, we filtered out entries in stitch  <dig>  with confidence scores of < <dig> .
in addition, we removed all entries of chemical interaction with non-human proteins.
the filtering reduced the total number of small molecule-protein interaction entries from > <dig> million to just over a half million.
the categories of chemical-protein interactions with the highest occurrence in the database are binding , inhibition , and activation .
because the therapeutic effects of most drugs are due to chemical modulation of protein function, functional information of chemical-protein interactions, i.e., inhibition or activation, is important.
however, this information is not always available.
instead, the most prevalent type of interaction information is binding.
to create drug-protein interaction profiles relevant for drug repurposing, we retained interactions of only these three categories.
this left  <dig>  interactions between chemicals identified by  <dig>  unique stitch chemical identifiers and  <dig>  unique human proteins.
source of fda-approved drugs and drug development candidates
to generate a list of fda-approved drugs and drug development candidates, we retrieved the smiles strings of all structurally unique small molecule compounds in drugbank
<cit> .
molecular structures represented by the smiles strings were standardized, i.e., we stripped salts, standardized charge representation, removed stereochemistry labeling, removed single atom fragments, neutralized bonded zwitterions, and protonated acids/deprotonated bases.
after structure standardization, we generated canonical smiles and removed duplicates, resulting in  <dig>  unique entries.
they consisted of  <dig>  fda-approved drugs,  <dig>  drug development candidates,  <dig> nutraceuticals, and  <dig> drugs withdrawn from market.
these molecules are all referred to as “drugs” in the remainder of this article.
computational prediction of drug-protein interactions
most of the compounds in drugbank are in the biological activity screening libraries of pharmaceutical companies, government research laboratories, and academic institutions.
however, not all of the drugbank compounds have been tested in all assays evaluating chemical-protein interactions and, hence, the data collected in the stitch database do not cover all drug-protein interactions.
thus, to create as complete drug-protein interaction profiles as possible, we complemented the drug-protein interactions contained in the stitch database with predicted drug-protein interactions based on chemical structural similarity.
this was accomplished by re-implementing the similarity ensemble approach
<cit>  and predicting additional drug-protein interactions based on the collection of chemical-protein interactions contained in stitch  <dig> .
sea predictions are based on two-dimensional molecular structure similarity as measured by tanimoto coefficients between a drug molecule and all known ligands of a protein.
when the similarity score is high, the probability that the drug interacts with the same protein is high.
in this study, we retained drug-protein interaction predictions with a p-value cutoff of  <dig> , and combined these predictions with the high-confidence drug-protein interactions contained in the stitch database.
the so-constructed final set of drug-protein interactions is available for non-commercial use .
creation of a machine-readable representation of drug-protein interaction profiles
for the application of machine learning techniques, we created a binary bit-string representation of the drug-protein interaction profile for each drug.
in the bit-string representation, each protein was assigned up to three bit positions to encode 1) drug interaction  with the protein, 2) drug activation of the protein, and 3) drug inhibition of the protein.
if a drug was recorded in stitch and/or predicted to bind to a protein, the bit representing this drug-protein interaction was turned on, i.e., assigned a value of  <dig> .
otherwise, the bit was turned off .
the bits representing drug activation and drug inhibition of a protein were similarly set.
to reduce memory usage, when a bit was off for all drugs, the bit was removed.
the length of the final binary string was  <dig>  bits, representing drug interactions with  <dig>  unique human proteins.
if the sea-predicted drug-protein interactions were excluded, the length of the final binary string would be  <dig> , representing interactions between  <dig>  drugs and  <dig>  unique human proteins.
thus, in our final drug-protein interaction profile dataset, the number of drugs whose high-confidence protein interaction information was not found in the stitch  <dig>  database, but predicted by sea, was  <dig>  in other words, sea predictions contributed about 10% of the drug-protein interaction pairs in our final drug-protein interaction profiles.
method for identifying drug-protein interactions contributing to a desired therapeutic effect
we found that the laplacian-corrected bayesian method of xia et al.
<cit>  was suitable for identifying drug-protein interactions indicative of a desired therapeutic effect.
to illustrate this method, we used a collection of drug-protein interaction profiles, as shown in figure
<dig>  given that m of the n drugs are approved for a certain disease, we assigned them to the positive class, i.e., those drugs that are known to have a desirable therapeutic effect.
the number of on-bits of bit feature f
i
among the positive class is denoted by a
i
and the number of on-bits of the same bit feature among all drugs is denoted by b
i
.
for drug repurposing, we need to estimate the conditional probability p of a drug-protein interaction represented by bit feature f
i
to be responsible for the desired therapeutic effect of the drugs in the positive class.
bayes theorem gives the following:
p+|fi=p+×pfi|+pfi=mn×aimbin=aibi,
where p is the prior probability for a drug to be positive, p is the conditional probability of f
i
to be an on-bit in the positive class, and p is the probability of f
i
to be an on-bit in all drugs.
in most cases, eq.
<dig> provides a reasonable estimate of p. however, when a bit feature is severely under-sampled, such as in a situation where b
i
= a
i
=  <dig>  then p =  <dig> , which provides an overly optimistic probability estimate.
however, when more samples with this bit feature on are included in the data set, p will most likely decrease.
thus, for diseases with few drugs, we expect the number of drugs in the positive class to be very small, and therefore undersampling of bit features may be common, leading to an inaccurate probability estimate of the predictive value of the bit feature.
to correct for the effect of undersampling, one could assume that if this bit feature were sampled k more times, a reasonable estimate of the number of positive drugs would be k × p. thus, the corrected probability is as follows:
pc+|fi=ai+k×p+bi+k.
this correction ensures that as b
i
→  <dig> and a
i
→  <dig>  p  approaches the prior probability p. when k is set to 1/p, the adjustment corresponds to the laplacian correction
<cit> .
following xia et al.
<cit> , we defined a weight w
i
to represent the contribution of the i-th bit-feature f
i
to the desired therapeutic effect of the positive class, as follows:
wi=logpc+|fip+.
once w
i
for every f
i
has been determined from a training set consisting of positive and negative classes of drugs, one can rank a given drug by its likelihood of having the desired therapeutic effect of the positive drug set based on the following score:
score=∑i=1nwi×fi,
where f
i
equals  <dig> or  <dig>  representing on and off bits, respectively.
the higher the score a drug receives, the more likely it has the therapeutic effect of the positive class of the training set.
in this formulation, the numeric score itself is never used to calculate an absolute probability.
rather, it is only used to rank the likelihood of a drug in a given disease model as a possible repurposing candidate for that disease.
RESULTS
details of model development and quality assessment
to assess performance of the drug repurposing method described above, we used three model development procedures, as shown in figure
<dig>  type i model development represents a conventional machine learning process in which a data set is segregated into a training set and a testing set.
the training set consists of a subset of samples of the positive class and a subset of samples of the negative class.
the remaining samples, including both positive and negative samples, are grouped into the testing set.
the model parameters are determined by the training set only.
the model is then applied to the testing set to assess its ability to distinguish the positive from the negative samples.
in principle, type i models are not suitable for drug repurposing applications because most drugs were developed for treating a specific disease.
accordingly, for most drugs, their ability to treat other diseases has not been systematically evaluated and, in most cases, one cannot confidently label true negative drugs  in the training set.
a more robust model development approach is represented by a type ii model, which is trained with a subset of the positive drugs as the positive class and all other drugs collected in a baseline class, i.e., a large set of compounds that may or may not include drugs with a desired therapeutic effect.
because all drugs are used for model development, there is no testing set.
however, for drug repurposing, one can simply score all the drugs assigned to the baseline class with the model and evaluate the degree of enrichment of the  positive drugs in the highest-scored samples.
type ii models are more appropriate than type i models for drug repurposing, based on the premise that there exist drugs with yet unknown desirable therapeutic effects for a disease among the marketed drugs.
type iii models are constructed for the purpose of examining the impact of false positives on model development.
in this model-building process, k baseline drugs  are purposely introduced in the positive class as false positives.
dpir prediction analysis
to assess the performance of the proposed drug repurposing method, we performed detailed cross-validation analysis using fda-approved drugs for hypertension, hiv, and malaria.
these diseases were selected based on two criteria: the disease is clinically well defined and a significant number of fda-approved drugs are available for cross-validation analyses.
note that our goal was to develop a method that can be applied to a disease with as few as one approved drug.
however, for evaluating the performance of the dpir method and establishing the advantages and disadvantages of different model training processes, we needed to use diseases with a significant number of approved drugs.
for hypertension,  <dig> single-component  drugs on the national institutes of health  high blood pressure  drug list
<cit>  have drug-protein interaction information.
for hiv,  <dig> single-component drugs on fda’s hiv drug list
<cit>  have drug-protein interaction information.
for malaria,  <dig> single-component fda-approved drugs were listed on the centers for disease control and prevention  malaria treatment web site
<cit> .
in addition, we searched drugbank and identified  <dig> additional drugs that were approved for treating malaria but are not in the current cdc’s list because of drug resistance, severe side effects, or because they were replaced by newer generations of antimalarial drugs of the same class.
we included these  <dig> drugs to define a set of  <dig> antimalarial drugs for analysis.
the names of these drugs, their molecular structures in the form of smiles strings, and the number of on-bits in the drug-protein interaction profiles are available via publicly available download at
http://www.bhsai.org/downloads/drugrepurposing.
even though the bit-length of the drug-protein interaction profiles is  <dig> , for a specific drug the number of on-bits is much lower.
it depends on how many proteins a drug interacts with and how many of these interactions have been identified.
thus, newer drugs tend to have a lower number of on-bits, as the synthetic routes may be under patent coverage and, therefore, the compounds are less likely to be found in the catalogs of chemical suppliers.
compounds extracted from natural products  also tend to have lower numbers of on-bits, simply because these compounds are more expensive to acquire than their synthetic counterparts and, therefore, are found in fewer screening libraries.
among the  <dig> hiv drugs, the number of on-bits ranges from  <dig>  to  <dig> , with the average number of on-bits being  <dig>  among the  <dig> antimalarial drugs, the number of on-bits ranges from  <dig>  to  <dig>  with an average of  <dig>  among the  <dig> hypertension drugs, the number of on-bits ranges from  <dig>  to  <dig>  with an average of  <dig>
using the drugs for each disease, we performed complete cross validation by training type i, ii, and iii models using one, two, or three approved drugs in the positive classes.
to perform complete cross validation of models developed using a single positive drug in the positive class, each and every positive drug was used once as the positive class to build a model.
for complete cross validation of models developed with two  positive drugs in the positive class, each unique pair  of the positive drugs was used once as the positive class to develop a model.
with an increasing number of positive drugs and increasing number of positive drugs assigned to the positive class for model development, the total number of models for complete cross validation increases dramatically.
for instance, with  <dig> hbp drugs for hypertension, complete cross validation for models developed with  <dig> positive drugs required training of  <dig>  models.
despite the large number of models to train, the dpir method is computationally efficient as there is no regression or optimization of any parameters required.
we assessed the performance of the models by degree of enrichment of positive drugs in the top-ranked testing sets or baseline classes.
performance of type i models
figure
3a-c shows degrees of enrichment of positive drugs by type i models for hypertension, hiv, and antimalarial drugs.
these results show that with models developed using a single positive drug in the positive class of the training set, on average, between 15% and 20% of positive drugs in the testing sets were in the highest-scored 1% of the tested samples, between 30% and 40% of positive drugs were in the highest-scored 5% of the tested samples, and between 40% and 60% of positive drugs were in the highest-scored 10% of the tested samples.
the corresponding enrichments by models developed from two or three positive drugs in the positive class of the training sets were slightly higher, but, more importantly, they exhibited lower variability, as indicated by decreasing standard deviations of the fraction of positive drugs in the highest-scored testing samples.
this is because increasing the sample size  increases the signal-to-noise ratio, which improves bayesian statistics.
the expected fractions of positive drugs randomly distributed in the testing sets were 1%, 5%, and 10% in the 1%, 5%, and 10% of testing samples, respectively.
compared with a random selection, type i models achieved significant enrichment, especially considering the small number of positive drugs  present in the positive class for model development.
the corresponding p-values for achieving such levels of enrichment by chance ranged from  <dig>  × 10- <dig> to  <dig>  × 10- <dig>
performance of type ii models
figure
3d-f shows the results of type ii models for the three diseases.
even though a large number of positive drugs for each disease are in the baseline class and play the role of false negatives, they had little impact on model performance.
the bar heights of type i and type ii models for each disease and the standard deviations were nearly identical.
the lack of appreciable impact of the false negatives was at first surprising.
however, as the number of false negatives was very small compared with the total number of compounds in the various baseline classes, their effect was minimal.
as a result, the false negatives had negligible impact on the weight w
i
associated with each drug-protein interaction.
thus, the results shown in figure
<dig> indicate that false negatives have a negligible impact on the model development.
impact of false positives on model performance
figure
<dig> shows the comparison between type ii and type iii models.
to develop the type iii models, we included one false positive drug in the positive class for model building.
the comparison shows that a false positive in the training set had a significant negative impact on model quality.
models developed with one true positive and one false positive in the positive class performed no better than picking the drugs randomly.
increasing the number of true positives in the positive class improved model performance; the improvement was not very significant as the enrichment rates of type iii models were significantly lower than the corresponding enrichment rates of type ii models.
the practical implication is that the drugs used for the positive class in the model development should truly be associated with the desired therapeutic effect in order for the repurposing method to work efficiently.
model performance without sea-predicted drug-protein interactions
to examine the impact of sea-predicted drug-protein interactions on model performance, we re-created drug-protein interaction profiles using information only contained in the stitch database and used the profiles to repeat the cross-validation calculations of type ii models.
table
<dig> shows the results in comparison with those obtained using drug-protein interaction information from the stitch database augmented by sea predictions.
for the hypertension and hiv models, the enrichment rates obtained with and without sea-predicted drug-protein interactions were very close, with a slight increase in retrieved drugs when adding the sea predictions.
for malaria, however, the models that did not use sea-predicted drug-protein interactions performed significantly better.
the primary reason for this was that  <dig> out of the  <dig> malaria drugs shared the same mechanism of action.
they consisted of quinine, a natural product extracted from the bark of cinchona trees, and  <dig> synthetic analogs of quinine: amodiaquine, mefloquine, chloroquine, hydroxychloroquine, and primaquine.
because they shared the same mechanism of action, this mechanism of action was already well represented by the drug-protein interactions in the stitch database.
thus, for this model, the additional sea-predicted interactions introduced mechanistic noise through irrelevant interactions that led to a degraded model performance.
a
athe type ii models were built with one, two, and three positive drugs in the positive class of the training set.
the fraction of positive drugs in the baseline class that scored in the highest 1%, 5%, and 10% of the compounds are recorded for models using the stitch  <dig>  database with and without sea-predicted drug-protein interactions.
fraction, fraction of known drugs retrieved; σ, standard deviation; sea, similarity ensemble approach.
in summary, the main contribution of the sea predictions was to make ~10% of the drugs whose protein interaction information was not available in stitch  <dig>  amenable to repurposing.
as an example, among the  <dig> hiv drugs, high-confidence drug-protein interaction information for fosamprenavir, a pro-drug, was not present in stitch  <dig> .
therefore, this compound would not be amenable to repurposing by dpir without including the sea-predicted interactions.
the additional  <dig> protein interactions with fosamprenavir, derived from the sea predictions, allowed us to include it in our modeling analyses.
impact of increasing number of drugs in the positive class on model performance
in the above analyses, all models were built with one to three positive drugs to simulate the situation of a disease with very few approved drugs.
to evaluate the impact of increasing the number of positive drugs on model performance, we also performed cross-validation calculations using  <dig>   <dig>   <dig>  and  <dig> hypertension drugs in the positive class for type ii model development, and we evaluated the enrichment power of the resulting models for the hypertension drugs left in the baseline class.
on average, among the highest-scored 1% baseline compounds, there were 13%, 25%, 33%, and 56% hypertension drugs with models developed with  <dig>   <dig>   <dig>  and  <dig> hypertension drugs.
the corresponding hypertension drugs in the highest-scored 5% baseline compounds were 36%, 61%, 71%, and 85%, respectively, and the corresponding hypertension drugs in the highest-scored 10% baseline compounds were 50%, 77%, 85%, and 100%.
we obtained similar results from the other models .
thus, as expected, increasing the number of compounds in the training set increased the number of positive drugs retrieved.
pharmacological information of top-scored baseline drugs
the analyses above indicate that models derived by increasing the size of the positive class have increasingly better performance.
in practical applications, one should include all drugs approved for an indication/disease in the positive class of the training process.
to this end, we developed our final models for hypertension, hiv, and malaria by including all the drugs for each disease in the respective positive class.
we used the resulting type ii models to score the baseline compounds and we assessed the predictive power of the models by performing literature searches of the relevant information for the  <dig> highest-scored fda-approved drugs for each disease.
tables
<dig>
<dig> and
<dig> summarize the results.
a
b
athe model was developed with all  <dig> drugs in the national institutes of health hypertension drug list in the positive class; the remaining drugs and drug development candidates were potential repurposing candidates in the baseline class.
bref.
<cit> .
ace: angiotensin-converting enzyme.
a
b
athe model was developed with all  <dig> hiv drugs in the fda’s hiv drug list in the positive class; the remaining compounds were potential repurposing candidates in the baseline class.
bref.
<cit> .
a
b
<cit> .
however, two subsequent placebo-controlled clinical trials failed to demonstrate clinical benefit
<cit>  have reported antimalarial activities of azoles, including clotrimazole
<cit>  have reported antimalarial activities of azoles, including ketoconazole
athe model was developed with all  <dig> antimalarial drugs in the positive class; the remaining compounds were potential repurposing candidates in the baseline class.
bref.
<cit> .
because we included all the drugs from the nih’s hypertension drug list in the positive class for model development, the baseline class did not include any of these drugs.
as shown in table
<dig>  among the  <dig> highest-scored fda-approved drugs in the baseline class, six of them have hypertension as part of their approved indications based on information contained in drugbank
<cit> .
in addition, a  <dig> clinical study observed that nimodipine, the second highest-scored baseline drug, reduced systolic and diastolic blood pressures of the central retinal artery, and it therefore may be a candidate for pregnancy-induced hypertension therapy
<cit> .
however, information from drugbank indicates that norepinephrine, the sixth highest-scored drug in table
<dig>  has been approved for the treatment of critical hypotension, and yohimbine was approved for the treatment of impotence.
in addition, epinephrine was approved for asthma and cardiac failure, and a  <dig> review found that use of this drug was associated with small non-significant increases in systolic and diastolic blood pressure
<cit> .
it seems that these three drugs induce a blood pressure increase, contrary to the expected therapeutic effect of hypertension drugs.
this apparent contradiction is rationalized because functional information for many drug-protein interactions contained in the stitch database is incomplete.
although these drugs and the hypertension drugs interact with the same proteins, they induce an opposite functional outcome, i.e., activation instead of inhibition of the targeted proteins.
because of the lack of specific functional information, drugs interacting with the same proteins annotated as “binding” in the stitch database were scored high by the algorithm, even though they may have opposite therapeutic effects.
we similarly observed the same effect in the highest-scored baseline drugs identified by the hiv and malarial models discussed below.
table
<dig> shows the results for the  <dig> baseline drugs scored highest by the hiv type ii model.
among them, amprenavir was approved by the fda as a treatment for hiv- <dig> infection in combination therapy with other anti-hiv drugs, even though it is not approved as a monotherapy for hiv.
surprisingly, two statins, atorvastatin and lovastatin, scored among the top- <dig> drugs, suggesting that they affect proteins that are also targeted by anti-hiv drugs.
indeed, our literature search found a  <dig> study that concluded that statins inhibit hiv- <dig> infection by downregulating rho activity
<cit> .
the anti-inflammation drug dexamethasone also scored high.
our search identified a  <dig> study that found that dexamethasone inhibits cd <dig> t cell death mediated by macrophages from hiv-infected persons
<cit> .
toward the end of an hiv infection, the number of functional cd <dig> t cells falls, which leads to the symptomatic stage of aids.
the observation that dexamethasone inhibits cd <dig> t cell death supports the predictive power of our model.
however, our search for the highest-scored baseline drug, verapamil, did not find a convincing literature report for its putative anti-hiv activity.
instead, a  <dig> study observed that, in high concentration, verapamil can potentiate hiv- <dig> replication in lymphoid cells
<cit> .
its interaction with nuclear factor κ-light-chain enhancer of activated b cells  was suggested to be responsible for this effect.
nf-κb was later considered a potential target of anti-hiv chemotherapy by pande and ramos
<cit> .
the high scoring of verapamil in our model seems to support nf-κb as a target for anti-hiv drugs.
the reason we misidentified the therapeutic effect of verapamil may again be partly rationalized by the lack of functional information  of drug-nf-κb interaction of the anti-hiv drugs in the stitch database.
table
<dig> shows the  <dig> drugs in the baseline class that scored highest by the antimalarial model.
none of them has been approved by the fda for the treatment of malaria.
however, three of them are azole compounds , and many studies that have reported antimalarial activities of azole compounds
<cit>  lend support to our model predictions.
the highest-scored non-malarial drug is dexamethasone.
it has been reported to have dramatic life-saving effects in people with cerebral malaria
<cit> .
however, these effects were not observed in subsequent placebo-controlled clinical trials
<cit> .
a flavonol nutraceutical, quercetin, scored third-highest, as shown in table
<dig>  it was reported in  <dig> to have antiplasmodial activity
<cit> , corroborating our model prediction.
it is interesting to note that two other drugs shown in table
<dig>  verapamil and cimetidine, do not have antimalarial activities themselves but exhibit synergism when used in combination with antimalarial drugs
<cit> .
in the case of verapamil, it was reported that it reverses chloroquine resistance in the malaria parasite
<cit> .
to understand why these two drugs scored high, we investigated the most frequently occurring drug-protein interactions among the antimalarial drugs.
among the  <dig> antimalarial drugs,  <dig> are cytochrome p- <dig> 2d <dig> inhibitors,  <dig> are cyp1a <dig> inhibitors,  <dig> are cyp3a <dig> inhibitors,  <dig> are cyp2c <dig> inhibitors, and  <dig> are cyp1a <dig> activators.
because of their high frequencies among the antimalarial drugs, according to eq.
<dig>  the drug-protein interactions contributing most to the antimalarial model relate to the inhibition of cyp proteins.
however, the human cyp proteins are unlikely malarial drug targets.
instead, the similarity between the cyp-binding site, the heme group, and malarial drug target may be the reason for the apparent importance of cyp inhibition for antimalarial activity.
indeed, one of the proposed antimalarial mechanisms of 4-amino quinolones is the formation of a drug-heme complex that inhibits the polymerization and crystallization of free heme into hemozoin
<cit> .
the malaria parasite digests hemoglobin and produces free heme, which is toxic to the parasite.
the formation of hemozoin is a parasite detoxification pathway.
quinolones with fused bicyclic aromatic rings bind well with heme due to π-π stacking interactions and therefore inhibit hemozoin efficiently.
because heme is also the most important structural moiety of the cyp enzymes, the high affinity of quinolones to heme also makes them inhibitors of cyp enzymes.
verapamil and cimetidine were scored high by the antimalarial model because both of them are inhibitors of cyp2d <dig>  cyp3a <dig>  and cyp2c <dig>  as the compounds do not have a fused bicyclic aromatic moiety, they do not bind well with free heme and, hence, do not have antimalarial activity by themselves.
the reason they enhance the activity of antimalarial drugs is more likely a direct effect of their inhibition of pgh <dig>  an atp-binding cassette protein functioning as a membrane efflux pump
<cit> .
it reduces antimalarial drugs in the parasite food vacuole and therefore results in drug resistance.
the human homologue of pgh <dig> is p-glycoprotein, a well-known multidrug-resistant protein.
both verapamil and cimetidine are inhibitors of p-glycoprotein and, therefore, are also likely inhibitors of pgh1; thus, co-administration of these drugs with traditional malarial drugs should result in enhanced antimalarial activity.
it is interesting to note that five of the ten entries in tables
<dig> and
<dig> are overlapping.
this was partly a reflection of the five drugs having an above-average number of on-bits in their protein interaction profiles, effectively leading to more off-target effects, including a heightened potential for therapeutic repurposing.
the numbers of on-bits in the drug-protein interaction profiles were  <dig>   <dig>   <dig>   <dig>  and  <dig> for dexamethasone, verapamil, cimetidine, ketoconazole, and clotrimazole, respectively, whereas the average number of on-bits of all  <dig>  compounds was  <dig>
in summary, the results shown in tables
<dig>
<dig> and
<dig> support the conclusions we derived from the results shown in figures
<dig> and
3: that the performance of the drug-repurposing method developed in this project is robust and may have practical utility.
the high-scoring drugs derived for each disease not only included drugs approved for the disease but also molecules identified in the literature as potential drugs against the disease.
thus, we can propose top-scored drugs with no recorded indication for the disease as novel drug repurposing candidates for the disease.
in addition, the methodology can be used to characterize and decipher the mode of drug action and identify protein targets that may enhance the effect of existing drugs via synergistic drug combinations.
application to a condition with only one approved drug
impaired blood clotting may lead to hemorrhagic shock and contribute to fatalities resulting from traumatic injuries.
currently, the only drug approved by the fda for reducing or preventing hemorrhage in trauma is tranexamic acid.
we constructed a type ii model using tranexamic acid as the only drug in the positive class.
we used the model to score all other compounds, and table
<dig> shows the highest-scoring compounds.
the highest-scored baseline compound was aminocaproic acid, a drug for the treatment of excessive postoperative bleeding
<cit> .
as an acyclic analog of tranexamic acid, aminocaproic acid and tranexamic acid have a high level of structural similarity.
therefore, it can be expected that they have similar therapeutic effects.
a
b
athe model was developed with tranexamic acid as the only member of the positive class; all other compounds were in the baseline class.
bref.
<cit> .
two other marketed drugs that ranked high were amiloride, approved for congestive heart failure and hypertension, and diethylstilbestrol, approved for the treatment of prostate cancer and the prevention of miscarriage or premature delivery.
amiloride was evaluated for trauma-hemorrhagic shock-induced lung injury in a rat model
<cit> , and diethylstilbestrol was studied for hemostasis in functional uterine hemorrhage and concluded to be of clinical value for excessive or prolonged functional uterine bleeding
<cit> .
these observations are in line with the model predictions.
limitations on comparison with other methods
the comparison of different computational drug repurposing methods is limited by a lack of publicly available datasets and software systems.
further complications arise because different methods rely on different types of information, ranging from experimentally/clinically derived data  to calculated measures .
thus, because most publications do not make software, training data, and test data containing all types of information available, there is little scope for proper methodological comparison, i.e., method a versus method b on the same dataset using a generally accepted standard.
to facilitate future comparison with other methods, we have made our drug-protein interaction dataset publicly available for download .
to enable a reference comparison, we compared the performance of the type ii models with that of a chemical fingerprint similarity search on the same datasets.
thus, we performed cross-validation calculations using one, two, and three positive drugs as the positive classes, and the remaining compounds, including other positive drugs, as the test compounds.
we used the tanimoto chemical similarity between a test compound and a positive class compound, calculated by using accelrys ecfp_ <dig> fingerprints, to rank order the test compounds.
table
<dig> shows the calculated percentages of the positive drugs in the highest-ranked 1%, 5%, and 10% of the test set compounds for all three repurposing models.
the chemical fingerprint searches provided significant enrichments, the success of which was largely determined by the presence or absence of chemically similar drugs in the approved drug set for each disease.
for the hypertension and hiv drugs, the dpir method consistently performed better than the structural similarity search.
this was because the drugs used to construct the models were different from each other and structural similarity was limited, whereas the dpir methodology, based on capturing drug-protein interactions, did not require structural similarities.
in contrast, for malaria drugs the situation was reversed, with structural similarity being the most “successful” repurposing strategy.
however, this was primarily because  <dig> of the  <dig> malaria drugs  were structurally very closely related to quinine, the original malaria drug.
they  are synthetic analogs of quinine and therefore structurally very similar to it.
molecular structures of the hypertension, hiv, and malaria drugs are given in additional file
1: figures s <dig>  additional file
2: figure s <dig>  additional file
3: figure s <dig>  they show that all malaria drugs can be grouped in one structural similarity cluster of six compounds and five singletons.
the hypertension drugs belong to seven structural clusters and  <dig> singletons, and the hiv drugs belong to six clusters and seven singletons.
thus, the hypertension and hiv drug sets represent a more structurally diverse ensemble of drugs than the malaria drugs.
a
athe dpir  models were developed with one, two, or three positive drugs in the positive class of the training set.
the chemical fingerprint search used tanimoto similarity  calculated with the accelrys ecfp_ <dig> fingerprint.
the highest ts coefficient between a baseline compound and a positive compound was used to rank order the baseline compound.
dpir, drug-protein interaction-based repurposing; fraction, fraction of known drugs retrieved; σ, standard deviation; bold font, highest fraction retrieved.
in effect, dpir could identify compounds whose activity was due to structurally similar compounds having similar activity, as well as compounds containing different structural scaffolds but having similar protein interaction profiles.
this was also corroborated by the data shown in table
<dig>  where even though amiloride and diethylstilbestrol were structurally very different from tranexamic acid, dpir successfully scored them high as potential repurposing candidates.
CONCLUSIONS
in this article, we described the development of a bayesian statistics-based computational drug repurposing method termed dpir and assessed its performance.
we demonstrated that the method required very few known drugs to build a successful predictive model for test cases for which there are many approved drugs.
we also demonstrated that for trauma-induced hemorrhage, for which only one fda-approved drug is available, the method gave high scores to two drugs approved for unrelated indications, but with potential therapeutic effects against hemorrhage as supported by literature reports.
these results indicate that dpir is potentially applicable to diseases with as few as one approved drug, a challenging situation for methods based on a binary classifier approach.
dpir relies on large-scale drug-protein interaction information.
in principle, if one knows the molecular mechanisms of a disease and the details of drug-protein interactions, one can predict whether a drug will have the desired therapeutic effect for a specific disease.
however, details of molecular mechanisms of drug action are not well understood and even unknown for many efficacious drugs, complicated by the fact that most drugs interact with a large number of proteins.
bayesian statistics provide a powerful and unbiased approach to identify specific drug-protein interactions critical for a desired therapeutic effect.
the dpir method relies on the association of drug-protein interactions to capture and define the therapeutic effects of the drug based on the knowledge of at least one known drug.
the underlying assumption in this approach is that the main effect of the drug is mediated through drug-protein interactions.
these interactions create a characteristic profile, or signature, that can be used to find other drugs without direct knowledge of how these interactions contribute to disease treatment.
furthermore, as found in the case studies above, the true effect of the drug-protein interaction determines the therapeutic potential and cannot be predicted without accurate interaction annotations.
thus, if the drug-protein activation or inhibition effect is only annotated as “binding”, the model cannot resolve the true nature of the interaction.
experimental verification will, of course, always be required for probing the repurposing potential of any drug.
because of the large number of druggable targets that can be associated with human diseases, a major limitation of our method is availability of large-scale drug-protein interaction information.
this is not a problem for drugs that have been on the market for a long time, as these compounds are increasingly likely to be included in different screening libraries and tested in multiple bioassays over time.
however, for newer drugs, information of their interactions with a broad spectrum of proteins is usually lacking and therefore may limit the applicability of the method.
yet with time, these compounds will be tested in more assays, and information about their interaction with human proteins will become available.
as more and more screening results are deposited in the public domain, the aggregated data will become an invaluable resource for establishing whole genome-wide drug-protein interaction profiles and for discovering new uses for existing drugs.
competing interests
the authors declare that they have no competing interests.
authors’ contributions
all authors contributed to the design of the research.
rl performed the computational implementations and analyses.
rl and aw wrote the article, which was edited by jr. all authors read and approved the final manuscript.
supplementary material
additional file 1: figure s1
hypertension drugs grouped by molecular structure similarity.
molecular structure similarity clusters of the hypertension drugs.
click here for file
additional file 2: figure s2
hiv drugs grouped by molecular structure similarity.
molecular structure similarity clusters of the hiv drugs.
click here for file
additional file 3: figure s3
malaria drugs grouped by molecular structure similarity.
molecular structure similarity clusters of the malaria drugs.
click here for file
acknowledgements
the authors were supported by the u.s. army medical research and materiel command , as part of the u.s. army’s network science initiative.
the opinions and assertions contained herein are the private views of the authors and are not to be construed as official or as reflecting the views of the u.s. army or of the u.s. department of defense.
this paper has been approved for public release with unlimited distribution.

 by conservative estimates, we know the molecular basis of more than human diseases, whereas treatments are available for only about of them. the modern drug discovery paradigm, i.e., starting with a disease target and looking for a highly selective small molecule that interacts strongly only with the intended target, is struggling to meet our medical and social requirements. current estimates indicate that it takes an average of 14 years at a cost of close to $ billion to bring a new, safe, and efficacious drug to market. in the process, more than 90% of the drug candidates fail due to safety concerns, inadequate bioavailability, or lack of efficacy. in reality, highly selective compounds are rare. the large number of safety and bioavailability issues facing candidate drugs, as well as reported side effects of marketed drugs, is a reflection of many undocumented and deleterious interactions between drugs and human targets. in addition, many underlying disease causes are multifactorial and can be due to dysfunctional processes involving multiple biomolecules. even though significant efforts are devoted to understanding the molecular details of drug action, the fact is that the mechanisms of action of many efficacious drugs are poorly understood and, in many cases, remain largely unknown. drug interactions with unintended targets may lead to devastating side effects. however, these interactions may also signal the possibility for a drug to have therapeutic potential for diseases other than those for which it was approved. indeed, there are many examples of a drug developed for a specific disease that was later approved for treating an unrelated disease. one of the most dramatic examples is thalidomide, a drug first marketed as an anti-nausea and sedative agent prescribed to treat morning sickness in pregnant women. thalidomide was found to cause severe birth defects and was withdrawn from the market, but it later proved to have other therapeutic effects and was approved by the united states food and drug administration for skin lesions caused by leprosy and multiple myeloma. in addition, thalidomide has shown promise in treating cutaneous lupus and behcet’s disease, human immunodeficiency virus -related mouth and throat ulcers, and blood and bone marrow cancers. although the recorded effects of thalidomide are multifaceted, with multiple underlying mechanisms possible, clarification of a mechanism that distinguishes between the teratogenic and anticancer therapeutic effects of thalidomide was only recently identified. the success of drug repurposing, i.e., finding new uses for existing drugs, via serendipitous discoveries inspired the development of many computational approaches for the discovery of the yet unknown therapeutic potentials of existing drugs. a common approach used in drug repurposing is to build a binary classifier based on a training set consisting of drugs with and without a desired therapeutic effect as the positive and negative classes, respectively. one of the requirements for developing a statistically sound classifier is the availability of a relatively large number of drugs in the training set. furthermore, it is desirable to have an equal number of drugs with and without the desired therapeutic effect in the training set so as not to bias classifier training. however, when there are many drugs approved for treating a disease, the need for discovering more drugs for the same disease is less than that for a disease for which there is a very limited number of drugs or no drugs at all. thus, there is a need to develop computational drug repurposing methods that can be applied to diseases for which there are very few known pharmacological options. in this article, we report on the development of a computational approach termed “drug-protein interaction-based repurposing” that is potentially applicable to diseases for which a very limited number of drugs are available. we based dpir on large-scale drug-protein interaction profiles and bayesian statistics to decipher the drug-protein interactions indicative of a desired therapeutic effect. these drug-protein interactions are then used to identify other drugs that are likely to have the same therapeutic effect. methods source of large-scale chemical-protein interaction information to create large-scale chemical-protein interaction profiles for fda-approved drugs and drug development candidates, we exploited the search tool for interactions of chemicals database. the october release of the database contains chemical-protein interaction information, derived from a broad range of sources, between small molecules and million proteins from organisms. the database provides a confidence measure for each chemical-protein interaction calculated by the equation score =  – Π i, with corrections that take into account the possibility of observing an interaction by chance. in the equation, p i denotes the confidence of interaction from the i-th information source. based on stitch, a score between and indicates medium confidence, between and indicates high confidence, and between and indicates the highest confidence. to retain high-confidence chemical-protein interactions, we filtered out entries in stitch with confidence scores of <. in addition, we removed all entries of chemical interaction with non-human proteins. the filtering reduced the total number of small molecule-protein interaction entries from > million to just over a half million. the categories of chemical-protein interactions with the highest occurrence in the database are binding, inhibition, and activation. because the therapeutic effects of most drugs are due to chemical modulation of protein function, functional information of chemical-protein interactions, i.e., inhibition or activation, is important. however, this information is not always available. instead, the most prevalent type of interaction information is binding. to create drug-protein interaction profiles relevant for drug repurposing, we retained interactions of only these three categories. this left interactions between chemicals identified by unique stitch chemical identifiers and unique human proteins. source of fda-approved drugs and drug development candidates to generate a list of fda-approved drugs and drug development candidates, we retrieved the smiles strings of all structurally unique small molecule compounds in drugbank. molecular structures represented by the smiles strings were standardized, i.e., we stripped salts, standardized charge representation, removed stereochemistry labeling, removed single atom fragments, neutralized bonded zwitterions, and protonated acids/deprotonated bases. after structure standardization, we generated canonical smiles and removed duplicates, resulting in unique entries. they consisted of fda-approved drugs, drug development candidates, nutraceuticals, and drugs withdrawn from market. these molecules are all referred to as “drugs” in the remainder of this article. computational prediction of drug-protein interactions most of the compounds in drugbank are in the biological activity screening libraries of pharmaceutical companies, government research laboratories, and academic institutions. however, not all of the drugbank compounds have been tested in all assays evaluating chemical-protein interactions and, hence, the data collected in the stitch database do not cover all drug-protein interactions. thus, to create as complete drug-protein interaction profiles as possible, we complemented the drug-protein interactions contained in the stitch database with predicted drug-protein interactions based on chemical structural similarity. this was accomplished by re-implementing the similarity ensemble approach and predicting additional drug-protein interactions based on the collection of chemical-protein interactions contained in stitch. sea predictions are based on two-dimensional molecular structure similarity as measured by tanimoto coefficients between a drug molecule and all known ligands of a protein. when the similarity score is high, the probability that the drug interacts with the same protein is high. in this study, we retained drug-protein interaction predictions with a p-value cutoff of, and combined these predictions with the high-confidence drug-protein interactions contained in the stitch database. the so-constructed final set of drug-protein interactions is available for non-commercial use. creation of a machine-readable representation of drug-protein interaction profiles for the application of machine learning techniques, we created a binary bit-string representation of the drug-protein interaction profile for each drug. in the bit-string representation, each protein was assigned up to three bit positions to encode 1) drug interaction with the protein, 2) drug activation of the protein, and 3) drug inhibition of the protein. if a drug was recorded in stitch and/or predicted to bind to a protein, the bit representing this drug-protein interaction was turned on, i.e., assigned a value of. otherwise, the bit was turned off. the bits representing drug activation and drug inhibition of a protein were similarly set. to reduce memory usage, when a bit was off for all drugs, the bit was removed. the length of the final binary string was bits, representing drug interactions with unique human proteins. if the sea-predicted drug-protein interactions were excluded, the length of the final binary string would be, representing interactions between drugs and unique human proteins. thus, in our final drug-protein interaction profile dataset, the number of drugs whose high-confidence protein interaction information was not found in the stitch database, but predicted by sea, was in other words, sea predictions contributed about 10% of the drug-protein interaction pairs in our final drug-protein interaction profiles. method for identifying drug-protein interactions contributing to a desired therapeutic effect we found that the laplacian-corrected bayesian method of xia et al. was suitable for identifying drug-protein interactions indicative of a desired therapeutic effect. to illustrate this method, we used a collection of drug-protein interaction profiles, as shown in figure  given that m of the n drugs are approved for a certain disease, we assigned them to the positive class, i.e., those drugs that are known to have a desirable therapeutic effect. the number of on-bits of bit feature f i among the positive class is denoted by a i and the number of on-bits of the same bit feature among all drugs is denoted by b i. for drug repurposing, we need to estimate the conditional probability p of a drug-protein interaction represented by bit feature f i to be responsible for the desired therapeutic effect of the drugs in the positive class. bayes theorem gives the following: p+|fi=p+×pfi|+pfi=mn×aimbin=aibi, where p is the prior probability for a drug to be positive, p is the conditional probability of f i to be an on-bit in the positive class, and p is the probability of f i to be an on-bit in all drugs. in most cases, eq. provides a reasonable estimate of p. however, when a bit feature is severely under-sampled, such as in a situation where b i  = a i  =  then p = , which provides an overly optimistic probability estimate. however, when more samples with this bit feature on are included in the data set, p will most likely decrease. thus, for diseases with few drugs, we expect the number of drugs in the positive class to be very small, and therefore undersampling of bit features may be common, leading to an inaccurate probability estimate of the predictive value of the bit feature. to correct for the effect of undersampling, one could assume that if this bit feature were sampled k more times, a reasonable estimate of the number of positive drugs would be k × p. thus, the corrected probability is as follows: pc+|fi=ai+k×p+bi+k. this correction ensures that as b i  →  and a i  →  p approaches the prior probability p. when k is set to 1/p, the adjustment corresponds to the laplacian correction. following xia et al., we defined a weight w i to represent the contribution of the i-th bit-feature f i to the desired therapeutic effect of the positive class, as follows: wi=logpc+|fip+. once w i for every f i has been determined from a training set consisting of positive and negative classes of drugs, one can rank a given drug by its likelihood of having the desired therapeutic effect of the positive drug set based on the following score: score=∑i=1nwi×fi, where f i equals or representing on and off bits, respectively. the higher the score a drug receives, the more likely it has the therapeutic effect of the positive class of the training set. in this formulation, the numeric score itself is never used to calculate an absolute probability. rather, it is only used to rank the likelihood of a drug in a given disease model as a possible repurposing candidate for that disease.  details of model development and quality assessment to assess performance of the drug repurposing method described above, we used three model development procedures, as shown in figure  type i model development represents a conventional machine learning process in which a data set is segregated into a training set and a testing set. the training set consists of a subset of samples of the positive class and a subset of samples of the negative class. the remaining samples, including both positive and negative samples, are grouped into the testing set. the model parameters are determined by the training set only. the model is then applied to the testing set to assess its ability to distinguish the positive from the negative samples. in principle, type i models are not suitable for drug repurposing applications because most drugs were developed for treating a specific disease. accordingly, for most drugs, their ability to treat other diseases has not been systematically evaluated and, in most cases, one cannot confidently label true negative drugs in the training set. a more robust model development approach is represented by a type ii model, which is trained with a subset of the positive drugs as the positive class and all other drugs collected in a baseline class, i.e., a large set of compounds that may or may not include drugs with a desired therapeutic effect. because all drugs are used for model development, there is no testing set. however, for drug repurposing, one can simply score all the drugs assigned to the baseline class with the model and evaluate the degree of enrichment of the positive drugs in the highest-scored samples. type ii models are more appropriate than type i models for drug repurposing, based on the premise that there exist drugs with yet unknown desirable therapeutic effects for a disease among the marketed drugs. type iii models are constructed for the purpose of examining the impact of false positives on model development. in this model-building process, k baseline drugs are purposely introduced in the positive class as false positives. dpir prediction analysis to assess the performance of the proposed drug repurposing method, we performed detailed cross-validation analysis using fda-approved drugs for hypertension, hiv, and malaria. these diseases were selected based on two criteria: the disease is clinically well defined and a significant number of fda-approved drugs are available for cross-validation analyses. note that our goal was to develop a method that can be applied to a disease with as few as one approved drug. however, for evaluating the performance of the dpir method and establishing the advantages and disadvantages of different model training processes, we needed to use diseases with a significant number of approved drugs. for hypertension, single-component drugs on the national institutes of health high blood pressure drug list have drug-protein interaction information. for hiv, single-component drugs on fda’s hiv drug list have drug-protein interaction information. for malaria, single-component fda-approved drugs were listed on the centers for disease control and prevention malaria treatment web site. in addition, we searched drugbank and identified additional drugs that were approved for treating malaria but are not in the current cdc’s list because of drug resistance, severe side effects, or because they were replaced by newer generations of antimalarial drugs of the same class. we included these drugs to define a set of antimalarial drugs for analysis. the names of these drugs, their molecular structures in the form of smiles strings, and the number of on-bits in the drug-protein interaction profiles are available via publicly available download at http://www.bhsai.org/downloads/drugrepurposing. even though the bit-length of the drug-protein interaction profiles is, for a specific drug the number of on-bits is much lower. it depends on how many proteins a drug interacts with and how many of these interactions have been identified. thus, newer drugs tend to have a lower number of on-bits, as the synthetic routes may be under patent coverage and, therefore, the compounds are less likely to be found in the catalogs of chemical suppliers. compounds extracted from natural products also tend to have lower numbers of on-bits, simply because these compounds are more expensive to acquire than their synthetic counterparts and, therefore, are found in fewer screening libraries. among the hiv drugs, the number of on-bits ranges from to, with the average number of on-bits being among the antimalarial drugs, the number of on-bits ranges from to with an average of among the hypertension drugs, the number of on-bits ranges from to with an average of using the drugs for each disease, we performed complete cross validation by training type i, ii, and iii models using one, two, or three approved drugs in the positive classes. to perform complete cross validation of models developed using a single positive drug in the positive class, each and every positive drug was used once as the positive class to build a model. for complete cross validation of models developed with two positive drugs in the positive class, each unique pair of the positive drugs was used once as the positive class to develop a model. with an increasing number of positive drugs and increasing number of positive drugs assigned to the positive class for model development, the total number of models for complete cross validation increases dramatically. for instance, with hbp drugs for hypertension, complete cross validation for models developed with positive drugs required training of models. despite the large number of models to train, the dpir method is computationally efficient as there is no regression or optimization of any parameters required. we assessed the performance of the models by degree of enrichment of positive drugs in the top-ranked testing sets or baseline classes. performance of type i models figure  3a-c shows degrees of enrichment of positive drugs by type i models for hypertension, hiv, and antimalarial drugs. these results show that with models developed using a single positive drug in the positive class of the training set, on average, between 15% and 20% of positive drugs in the testing sets were in the highest-scored 1% of the tested samples, between 30% and 40% of positive drugs were in the highest-scored 5% of the tested samples, and between 40% and 60% of positive drugs were in the highest-scored 10% of the tested samples. the corresponding enrichments by models developed from two or three positive drugs in the positive class of the training sets were slightly higher, but, more importantly, they exhibited lower variability, as indicated by decreasing standard deviations of the fraction of positive drugs in the highest-scored testing samples. this is because increasing the sample size increases the signal-to-noise ratio, which improves bayesian statistics. the expected fractions of positive drugs randomly distributed in the testing sets were 1%, 5%, and 10% in the 1%, 5%, and 10% of testing samples, respectively. compared with a random selection, type i models achieved significant enrichment, especially considering the small number of positive drugs present in the positive class for model development. the corresponding p-values for achieving such levels of enrichment by chance ranged from  × 10- to  × 10- performance of type ii models figure  3d-f shows the results of type ii models for the three diseases. even though a large number of positive drugs for each disease are in the baseline class and play the role of false negatives, they had little impact on model performance. the bar heights of type i and type ii models for each disease and the standard deviations were nearly identical. the lack of appreciable impact of the false negatives was at first surprising. however, as the number of false negatives was very small compared with the total number of compounds in the various baseline classes, their effect was minimal. as a result, the false negatives had negligible impact on the weight w i associated with each drug-protein interaction. thus, the results shown in figure  indicate that false negatives have a negligible impact on the model development. impact of false positives on model performance figure  shows the comparison between type ii and type iii models. to develop the type iii models, we included one false positive drug in the positive class for model building. the comparison shows that a false positive in the training set had a significant negative impact on model quality. models developed with one true positive and one false positive in the positive class performed no better than picking the drugs randomly. increasing the number of true positives in the positive class improved model performance; the improvement was not very significant as the enrichment rates of type iii models were significantly lower than the corresponding enrichment rates of type ii models. the practical implication is that the drugs used for the positive class in the model development should truly be associated with the desired therapeutic effect in order for the repurposing method to work efficiently. model performance without sea-predicted drug-protein interactions to examine the impact of sea-predicted drug-protein interactions on model performance, we re-created drug-protein interaction profiles using information only contained in the stitch database and used the profiles to repeat the cross-validation calculations of type ii models. table  shows the results in comparison with those obtained using drug-protein interaction information from the stitch database augmented by sea predictions. for the hypertension and hiv models, the enrichment rates obtained with and without sea-predicted drug-protein interactions were very close, with a slight increase in retrieved drugs when adding the sea predictions. for malaria, however, the models that did not use sea-predicted drug-protein interactions performed significantly better. the primary reason for this was that out of the malaria drugs shared the same mechanism of action. they consisted of quinine, a natural product extracted from the bark of cinchona trees, and synthetic analogs of quinine: amodiaquine, mefloquine, chloroquine, hydroxychloroquine, and primaquine. because they shared the same mechanism of action, this mechanism of action was already well represented by the drug-protein interactions in the stitch database. thus, for this model, the additional sea-predicted interactions introduced mechanistic noise through irrelevant interactions that led to a degraded model performance. a athe type ii models were built with one, two, and three positive drugs in the positive class of the training set. the fraction of positive drugs in the baseline class that scored in the highest 1%, 5%, and 10% of the compounds are recorded for models using the stitch database with and without sea-predicted drug-protein interactions. fraction, fraction of known drugs retrieved; σ, standard deviation; sea, similarity ensemble approach. in summary, the main contribution of the sea predictions was to make ~10% of the drugs whose protein interaction information was not available in stitch amenable to repurposing. as an example, among the hiv drugs, high-confidence drug-protein interaction information for fosamprenavir, a pro-drug, was not present in stitch. therefore, this compound would not be amenable to repurposing by dpir without including the sea-predicted interactions. the additional protein interactions with fosamprenavir, derived from the sea predictions, allowed us to include it in our modeling analyses. impact of increasing number of drugs in the positive class on model performance in the above analyses, all models were built with one to three positive drugs to simulate the situation of a disease with very few approved drugs. to evaluate the impact of increasing the number of positive drugs on model performance, we also performed cross-validation calculations using and hypertension drugs in the positive class for type ii model development, and we evaluated the enrichment power of the resulting models for the hypertension drugs left in the baseline class. on average, among the highest-scored 1% baseline compounds, there were 13%, 25%, 33%, and 56% hypertension drugs with models developed with and hypertension drugs. the corresponding hypertension drugs in the highest-scored 5% baseline compounds were 36%, 61%, 71%, and 85%, respectively, and the corresponding hypertension drugs in the highest-scored 10% baseline compounds were 50%, 77%, 85%, and 100%. we obtained similar results from the other models. thus, as expected, increasing the number of compounds in the training set increased the number of positive drugs retrieved. pharmacological information of top-scored baseline drugs the analyses above indicate that models derived by increasing the size of the positive class have increasingly better performance. in practical applications, one should include all drugs approved for an indication/disease in the positive class of the training process. to this end, we developed our final models for hypertension, hiv, and malaria by including all the drugs for each disease in the respective positive class. we used the resulting type ii models to score the baseline compounds and we assessed the predictive power of the models by performing literature searches of the relevant information for the highest-scored fda-approved drugs for each disease. tables  and summarize the results. a b athe model was developed with all drugs in the national institutes of health hypertension drug list in the positive class; the remaining drugs and drug development candidates were potential repurposing candidates in the baseline class. bref.. ace: angiotensin-converting enzyme. a b athe model was developed with all hiv drugs in the fda’s hiv drug list in the positive class; the remaining compounds were potential repurposing candidates in the baseline class. bref.. a b. however, two subsequent placebo-controlled clinical trials failed to demonstrate clinical benefit have reported antimalarial activities of azoles, including clotrimazole have reported antimalarial activities of azoles, including ketoconazole athe model was developed with all antimalarial drugs in the positive class; the remaining compounds were potential repurposing candidates in the baseline class. bref.. because we included all the drugs from the nih’s hypertension drug list in the positive class for model development, the baseline class did not include any of these drugs. as shown in table  among the highest-scored fda-approved drugs in the baseline class, six of them have hypertension as part of their approved indications based on information contained in drugbank. in addition, a clinical study observed that nimodipine, the second highest-scored baseline drug, reduced systolic and diastolic blood pressures of the central retinal artery, and it therefore may be a candidate for pregnancy-induced hypertension therapy. however, information from drugbank indicates that norepinephrine, the sixth highest-scored drug in table  has been approved for the treatment of critical hypotension, and yohimbine was approved for the treatment of impotence. in addition, epinephrine was approved for asthma and cardiac failure, and a review found that use of this drug was associated with small non-significant increases in systolic and diastolic blood pressure. it seems that these three drugs induce a blood pressure increase, contrary to the expected therapeutic effect of hypertension drugs. this apparent contradiction is rationalized because functional information for many drug-protein interactions contained in the stitch database is incomplete. although these drugs and the hypertension drugs interact with the same proteins, they induce an opposite functional outcome, i.e., activation instead of inhibition of the targeted proteins. because of the lack of specific functional information, drugs interacting with the same proteins annotated as “binding” in the stitch database were scored high by the algorithm, even though they may have opposite therapeutic effects. we similarly observed the same effect in the highest-scored baseline drugs identified by the hiv and malarial models discussed below. table  shows the results for the baseline drugs scored highest by the hiv type ii model. among them, amprenavir was approved by the fda as a treatment for hiv- infection in combination therapy with other anti-hiv drugs, even though it is not approved as a monotherapy for hiv. surprisingly, two statins, atorvastatin and lovastatin, scored among the top- drugs, suggesting that they affect proteins that are also targeted by anti-hiv drugs. indeed, our literature search found a study that concluded that statins inhibit hiv- infection by downregulating rho activity. the anti-inflammation drug dexamethasone also scored high. our search identified a study that found that dexamethasone inhibits cd t cell death mediated by macrophages from hiv-infected persons. toward the end of an hiv infection, the number of functional cd t cells falls, which leads to the symptomatic stage of aids. the observation that dexamethasone inhibits cd t cell death supports the predictive power of our model. however, our search for the highest-scored baseline drug, verapamil, did not find a convincing literature report for its putative anti-hiv activity. instead, a study observed that, in high concentration, verapamil can potentiate hiv- replication in lymphoid cells. its interaction with nuclear factor κ-light-chain enhancer of activated b cells was suggested to be responsible for this effect. nf-κb was later considered a potential target of anti-hiv chemotherapy by pande and ramos. the high scoring of verapamil in our model seems to support nf-κb as a target for anti-hiv drugs. the reason we misidentified the therapeutic effect of verapamil may again be partly rationalized by the lack of functional information of drug-nf-κb interaction of the anti-hiv drugs in the stitch database. table  shows the drugs in the baseline class that scored highest by the antimalarial model. none of them has been approved by the fda for the treatment of malaria. however, three of them are azole compounds, and many studies that have reported antimalarial activities of azole compounds lend support to our model predictions. the highest-scored non-malarial drug is dexamethasone. it has been reported to have dramatic life-saving effects in people with cerebral malaria. however, these effects were not observed in subsequent placebo-controlled clinical trials. a flavonol nutraceutical, quercetin, scored third-highest, as shown in table  it was reported in to have antiplasmodial activity, corroborating our model prediction. it is interesting to note that two other drugs shown in table  verapamil and cimetidine, do not have antimalarial activities themselves but exhibit synergism when used in combination with antimalarial drugs. in the case of verapamil, it was reported that it reverses chloroquine resistance in the malaria parasite. to understand why these two drugs scored high, we investigated the most frequently occurring drug-protein interactions among the antimalarial drugs. among the antimalarial drugs, are cytochrome p- 2d inhibitors, are cyp1a inhibitors, are cyp3a inhibitors, are cyp2c inhibitors, and are cyp1a activators. because of their high frequencies among the antimalarial drugs, according to eq. the drug-protein interactions contributing most to the antimalarial model relate to the inhibition of cyp proteins. however, the human cyp proteins are unlikely malarial drug targets. instead, the similarity between the cyp-binding site, the heme group, and malarial drug target may be the reason for the apparent importance of cyp inhibition for antimalarial activity. indeed, one of the proposed antimalarial mechanisms of 4-amino quinolones is the formation of a drug-heme complex that inhibits the polymerization and crystallization of free heme into hemozoin. the malaria parasite digests hemoglobin and produces free heme, which is toxic to the parasite. the formation of hemozoin is a parasite detoxification pathway. quinolones with fused bicyclic aromatic rings bind well with heme due to π-π stacking interactions and therefore inhibit hemozoin efficiently. because heme is also the most important structural moiety of the cyp enzymes, the high affinity of quinolones to heme also makes them inhibitors of cyp enzymes. verapamil and cimetidine were scored high by the antimalarial model because both of them are inhibitors of cyp2d cyp3a and cyp2c as the compounds do not have a fused bicyclic aromatic moiety, they do not bind well with free heme and, hence, do not have antimalarial activity by themselves. the reason they enhance the activity of antimalarial drugs is more likely a direct effect of their inhibition of pgh an atp-binding cassette protein functioning as a membrane efflux pump. it reduces antimalarial drugs in the parasite food vacuole and therefore results in drug resistance. the human homologue of pgh is p-glycoprotein, a well-known multidrug-resistant protein. both verapamil and cimetidine are inhibitors of p-glycoprotein and, therefore, are also likely inhibitors of pgh1; thus, co-administration of these drugs with traditional malarial drugs should result in enhanced antimalarial activity. it is interesting to note that five of the ten entries in tables  and are overlapping. this was partly a reflection of the five drugs having an above-average number of on-bits in their protein interaction profiles, effectively leading to more off-target effects, including a heightened potential for therapeutic repurposing. the numbers of on-bits in the drug-protein interaction profiles were and for dexamethasone, verapamil, cimetidine, ketoconazole, and clotrimazole, respectively, whereas the average number of on-bits of all compounds was in summary, the results shown in tables  and support the conclusions we derived from the results shown in figures  and 3: that the performance of the drug-repurposing method developed in this project is robust and may have practical utility. the high-scoring drugs derived for each disease not only included drugs approved for the disease but also molecules identified in the literature as potential drugs against the disease. thus, we can propose top-scored drugs with no recorded indication for the disease as novel drug repurposing candidates for the disease. in addition, the methodology can be used to characterize and decipher the mode of drug action and identify protein targets that may enhance the effect of existing drugs via synergistic drug combinations. application to a condition with only one approved drug impaired blood clotting may lead to hemorrhagic shock and contribute to fatalities resulting from traumatic injuries. currently, the only drug approved by the fda for reducing or preventing hemorrhage in trauma is tranexamic acid. we constructed a type ii model using tranexamic acid as the only drug in the positive class. we used the model to score all other compounds, and table  shows the highest-scoring compounds. the highest-scored baseline compound was aminocaproic acid, a drug for the treatment of excessive postoperative bleeding. as an acyclic analog of tranexamic acid, aminocaproic acid and tranexamic acid have a high level of structural similarity. therefore, it can be expected that they have similar therapeutic effects. a b athe model was developed with tranexamic acid as the only member of the positive class; all other compounds were in the baseline class. bref.. two other marketed drugs that ranked high were amiloride, approved for congestive heart failure and hypertension, and diethylstilbestrol, approved for the treatment of prostate cancer and the prevention of miscarriage or premature delivery. amiloride was evaluated for trauma-hemorrhagic shock-induced lung injury in a rat model, and diethylstilbestrol was studied for hemostasis in functional uterine hemorrhage and concluded to be of clinical value for excessive or prolonged functional uterine bleeding. these observations are in line with the model predictions. limitations on comparison with other methods the comparison of different computational drug repurposing methods is limited by a lack of publicly available datasets and software systems. further complications arise because different methods rely on different types of information, ranging from experimentally/clinically derived data to calculated measures. thus, because most publications do not make software, training data, and test data containing all types of information available, there is little scope for proper methodological comparison, i.e., method a versus method b on the same dataset using a generally accepted standard. to facilitate future comparison with other methods, we have made our drug-protein interaction dataset publicly available for download. to enable a reference comparison, we compared the performance of the type ii models with that of a chemical fingerprint similarity search on the same datasets. thus, we performed cross-validation calculations using one, two, and three positive drugs as the positive classes, and the remaining compounds, including other positive drugs, as the test compounds. we used the tanimoto chemical similarity between a test compound and a positive class compound, calculated by using accelrys ecfp_ fingerprints, to rank order the test compounds. table  shows the calculated percentages of the positive drugs in the highest-ranked 1%, 5%, and 10% of the test set compounds for all three repurposing models. the chemical fingerprint searches provided significant enrichments, the success of which was largely determined by the presence or absence of chemically similar drugs in the approved drug set for each disease. for the hypertension and hiv drugs, the dpir method consistently performed better than the structural similarity search. this was because the drugs used to construct the models were different from each other and structural similarity was limited, whereas the dpir methodology, based on capturing drug-protein interactions, did not require structural similarities. in contrast, for malaria drugs the situation was reversed, with structural similarity being the most “successful” repurposing strategy. however, this was primarily because of the malaria drugs were structurally very closely related to quinine, the original malaria drug. they are synthetic analogs of quinine and therefore structurally very similar to it. molecular structures of the hypertension, hiv, and malaria drugs are given in additional file 1: figures s additional file 2: figure s additional file 3: figure s they show that all malaria drugs can be grouped in one structural similarity cluster of six compounds and five singletons. the hypertension drugs belong to seven structural clusters and singletons, and the hiv drugs belong to six clusters and seven singletons. thus, the hypertension and hiv drug sets represent a more structurally diverse ensemble of drugs than the malaria drugs. a athe dpir models were developed with one, two, or three positive drugs in the positive class of the training set. the chemical fingerprint search used tanimoto similarity calculated with the accelrys ecfp_ fingerprint. the highest ts coefficient between a baseline compound and a positive compound was used to rank order the baseline compound. dpir, drug-protein interaction-based repurposing; fraction, fraction of known drugs retrieved; σ, standard deviation; bold font, highest fraction retrieved. in effect, dpir could identify compounds whose activity was due to structurally similar compounds having similar activity, as well as compounds containing different structural scaffolds but having similar protein interaction profiles. this was also corroborated by the data shown in table  where even though amiloride and diethylstilbestrol were structurally very different from tranexamic acid, dpir successfully scored them high as potential repurposing candidates.  in this article, we described the development of a bayesian statistics-based computational drug repurposing method termed dpir and assessed its performance. we demonstrated that the method required very few known drugs to build a successful predictive model for test cases for which there are many approved drugs. we also demonstrated that for trauma-induced hemorrhage, for which only one fda-approved drug is available, the method gave high scores to two drugs approved for unrelated indications, but with potential therapeutic effects against hemorrhage as supported by literature reports. these results indicate that dpir is potentially applicable to diseases with as few as one approved drug, a challenging situation for methods based on a binary classifier approach. dpir relies on large-scale drug-protein interaction information. in principle, if one knows the molecular mechanisms of a disease and the details of drug-protein interactions, one can predict whether a drug will have the desired therapeutic effect for a specific disease. however, details of molecular mechanisms of drug action are not well understood and even unknown for many efficacious drugs, complicated by the fact that most drugs interact with a large number of proteins. bayesian statistics provide a powerful and unbiased approach to identify specific drug-protein interactions critical for a desired therapeutic effect. the dpir method relies on the association of drug-protein interactions to capture and define the therapeutic effects of the drug based on the knowledge of at least one known drug. the underlying assumption in this approach is that the main effect of the drug is mediated through drug-protein interactions. these interactions create a characteristic profile, or signature, that can be used to find other drugs without direct knowledge of how these interactions contribute to disease treatment. furthermore, as found in the case studies above, the true effect of the drug-protein interaction determines the therapeutic potential and cannot be predicted without accurate interaction annotations. thus, if the drug-protein activation or inhibition effect is only annotated as “binding”, the model cannot resolve the true nature of the interaction. experimental verification will, of course, always be required for probing the repurposing potential of any drug. because of the large number of druggable targets that can be associated with human diseases, a major limitation of our method is availability of large-scale drug-protein interaction information. this is not a problem for drugs that have been on the market for a long time, as these compounds are increasingly likely to be included in different screening libraries and tested in multiple bioassays over time. however, for newer drugs, information of their interactions with a broad spectrum of proteins is usually lacking and therefore may limit the applicability of the method. yet with time, these compounds will be tested in more assays, and information about their interaction with human proteins will become available. as more and more screening results are deposited in the public domain, the aggregated data will become an invaluable resource for establishing whole genome-wide drug-protein interaction profiles and for discovering new uses for existing drugs. competing interests the authors declare that they have no competing interests. authors’ contributions all authors contributed to the design of the research. rl performed the computational implementations and analyses. rl and aw wrote the article, which was edited by jr. all authors read and approved the final manuscript. supplementary material additional file 1: figure s1 hypertension drugs grouped by molecular structure similarity. molecular structure similarity clusters of the hypertension drugs. click here for file additional file 2: figure s2 hiv drugs grouped by molecular structure similarity. molecular structure similarity clusters of the hiv drugs. click here for file additional file 3: figure s3 malaria drugs grouped by molecular structure similarity. molecular structure similarity clusters of the malaria drugs. click here for file acknowledgements the authors were supported by the u.s. army medical research and materiel command, as part of the u.s. army’s network science initiative. the opinions and assertions contained herein are the private views of the authors and are not to be construed as official or as reflecting the views of the u.s. army or of the u.s. department of defense. this paper has been approved for public release with unlimited distribution.
analysis of our model predictions also indicated that the method is potentially useful for understanding molecular mechanisms of drug action and for identifying protein targets that may potentiate the desired therapeutic effects of other drugs. drug repurposingbayes theoremdrug-protein interactionmechanism of drug action detailed cross-validation studies using united states food and drug administration-approved drugs for hypertension, human immunodeficiency virus, and malaria indicated that dpir provides robust predictions. the method, based on genome-wide drug-protein interaction information and bayesian statistics, first identifies drug-protein interactions associated with a desired therapeutic effect. for this approach to be statistically sound, it requires a large number of drugs in both classes. a popular approach is to develop a classification model based on drugs with and without a desired therapeutic effect. then, it uses key drug-protein interactions to score other drugs for their potential to have the same therapeutic effect.
 despite increased investment in pharmaceutical research and development, fewer and fewer new drugs are entering the marketplace. this has prompted studies in repurposing existing drugs for use against diseases with unmet medical needs. a popular approach is to develop a classification model based on drugs with and without a desired therapeutic effect. for this approach to be statistically sound, it requires a large number of drugs in both classes. however, given few or no approved drugs for the diseases of highest medical urgency and interest, different strategies need to be investigated.  we developed a computational method termed “drug-protein interaction-based repurposing” that is potentially applicable to diseases with very few approved drugs. the method, based on genome-wide drug-protein interaction information and bayesian statistics, first identifies drug-protein interactions associated with a desired therapeutic effect. then, it uses key drug-protein interactions to score other drugs for their potential to have the same therapeutic effect.  detailed cross-validation studies using united states food and drug administration-approved drugs for hypertension, human immunodeficiency virus, and malaria indicated that dpir provides robust predictions. it achieves high levels of enrichment of drugs approved for a disease even with models developed based on a single drug known to treat the disease. analysis of our model predictions also indicated that the method is potentially useful for understanding molecular mechanisms of drug action and for identifying protein targets that may potentiate the desired therapeutic effects of other drugs. drug repurposingbayes theoremdrug-protein interactionmechanism of drug action 