BACKGROUND
one of the most fundamental challenges in all forms of 'omic technologies is the connection of biological event signatures with others previously derived to allow the recognition of new molecule properties or biological alteration.
simple, robust, and efficient matching methods are required to connect a new gene expression signature with those in a database.
this problem was first tackled by lamb et al  <cit>  who introduced the connectivity map as a resource and tool to connect small-molecule drugs, genes, and diseases.
the connectivity map achieved a good degree of success, but also suffered from several deficiencies, particularly an inability to apply a measure of statistical validity at the individual reference signature level to allow rational filtering of the results to exclude false connections.
we took the method of lamb et al as a basis for development and have derived a simple, robust and statistically testable method for making connections between biological event signatures.
the method was tested with genomic signatures resulting from small molecule interactions in cells, but also could be applied to any form of signature such as those from proteomic or metabolomic science.
the main assumption behind the concept of a connectivity map is that a biological state, whether physiological, pathological, or induced with chemical or genomic perturbations, can be described in terms of a genomic signature, eg., the genome-wide mrna levels as measured by dna microarray technologies.
the working of a connectivity map involves several key components.
first, a large collection of pre-built reference gene-expression profiles serve as the core database, where each reference profile characterizes a well-defined biological state.
secondly, a query gene signature from some specific studies.
a query gene signature is basically a short  list of genes most relevant and important to characterize the biological state of the researchers' interest.
finally, a pattern matching algorithm or similarity metric defined between a query gene signature and a reference gene-expression profile to quantify the closeness or connection between the two biological states.
such a connectivity map can be used by biomedical researchers to find connections between the reference biological states and those of their own interest, leading to testable new biological hypotheses.
in this paper, we present a new framework for the construction of reference profiles, new connection scoring scheme and testing procedures for the observed connections.
we compare our method with that of lamb et al, and show that more robust results are achieved using our method.
in particular our method not only offers a more principled statistical procedure for testing connections, but more importantly it provides effective safeguards against false connections while at the same time achieving increased sensitivity.
as a consequence it can benefit the end users by saving them time and resources in pursuing new biological hypotheses based on the findings of connectivity maps.
RESULTS
construction of reference profiles
for the first-generation connectivity map, lamb et al carried out a series of gene-expression profiling experiments  <cit> , using  <dig> distinct small-molecule compounds in a few selected human cell lines.
each treatment instance consisted of one treatment sample and one  vehicle control samples, whose genome wide mrna levels were measured using affymetrix genechip microarrays.
in total  <dig> samples were microarrayed, which represented  <dig> different treatment instances.
for example, treatment instance id <dig> consisted of  <dig> treatment sample and  <dig> vehicle control samples.
the treatment sample was obtained by treating human mcf <dig> cells with  <dig> nm estradiol for  <dig> hours.
the control samples were obtained by treating mcf <dig> cells with vehicle control for  <dig> hours.
a gene-expression profile was constructed for each treatment instance, in which the relative expression  of all the measured genes were specified, and sorted in descending order.
a query gene signature, obtained and ordered in the same manner, can be compared to each reference profile in the connectivity map to calculate a connectivity score.
for "positive connectivity", the up-regulated genes of the query signature find matches near the top of the reference profile, and the down-regulated genes find matches near the bottom of the reference profile.
for "negative connectivity", the matches are opposite.
we obtained lamb et al's data set  from the geo  database, and rebuilt the  <dig> reference gene-expression profiles using a new ranking scheme based on the following guiding principles:  a treatment instance was defined relative to a control, thus the effect of the treatment could be characterized by the relative differential expression status of all the genes together,  different genes were affected to different extents by the treatment, so genes which showed a greater differential expression should have more weight in characterizing this treatment, and  up- and down-regulated genes should be treated equally in a unified manner.
this meant that a 2-fold down-regulated gene was considered as equally important as a 2-fold up-regulated gene in defining a reference profile.
there are several reasons for the choice of treating up- and down-regulated genes equally.
theoretically, unless we have a lot of further information about so many genes on the microarray it is difficult to decide whether this 2-fold up-regulated gene is more important than that 2-fold down-regulated gene or the opposite.
so it is logical to assign them equal weights.
another reason is the consideration of symmetry: if a gene is 2-fold up-regulated in sample  <dig> versus sample  <dig>  it can also be viewed as 2-fold down-regulated in sample  <dig> versus sample  <dig>  we should emphasize that assigning two genes equal weights does not imply in any sense they share the same molecular mechanism.
even two up-regulated genes with the same fold change could be involved in very different molecular mechanisms.
to adhere to the above guidelines, an obvious choice for organizing the genes is the logarithm of the expression ratio .
thus instead of treating the down- and up-regulated genes separately as in the method of lamb et al, we ordered genes in a reference profile by the absolute value of their expression log-ratios.
therefore the most differentially expressed genes  appear first in the list, and those non-differentially expressed genes appear at the bottom of the list.
in this way, the genes are ordered by their importance in defining the reference profile.
it is then straightforward to assign ranks to them.
suppose there are in total n genes, the first gene in the list will be assigned a rank n if it is up-regulated, or a rank -n if it is down-regulated.
in general the ith gene in the list will be ranked with  for up-regulation or -  for down-regulation.
with this new ranking method, the importance of a gene is reflected by the absolute value of its rank, while the sign of its rank indicates its regulation status.
the consequence and advantage of this method for creating reference profiles is that attaching statistical significance to the connection observed is a relatively straightforward step.
the scoring scheme
a query gene signature can be an ordered gene list, or just a collection of genes without specific ordering.
we will refer to these two types of query gene signatures as ordered and unordered gene signatures respectively.
for an ordered gene signature, we rank the genes in the list in the same way as for a reference profile.
namely, the most important  gene in the signature will be assigned a rank m or -m depending on its regulation status, where m is the number of genes in the signature.
while the least important gene in the signature be ranked  <dig> or - <dig>
let r denote a reference gene-expression profile, and s a query gene signature.
we define the connection strength between r and s as
c=∑i=1mrs,
where gi represents the ith gene in the signature, s is its signed rank in the signature, and r is this gene's signed rank in the reference profile.
it is worth noting some properties of the connection strength defined above:  if a gene has the same regulation status  in both the reference and the query, it will make a positive contribution to the connection strength, otherwise its contribution will be negative;  the magnitude of a gene's contribution to the connection strength is determined by its position in both lists; and  a gene signature with some of its genes contributing positively and others negatively will have an overall low connection strength, because the positive and negative contributions cancel each other to some extent.
therefore when calculating the connection strength between a gene signature and a reference profile, the maximum connection strength achievable is the situation where the m genes in the signature match the first m genes in the reference profile in the correct order, and their regulation status also match.
in such a case, the maximum positive connection strength is, for an ordered gene signature,
cmaxo=∑i=1m.
in another equally interesting situation, where the m genes in the signature match the first m genes in the reference profile in the right order, but the sign of each gene in the query is different from its sign in the reference, the connection strength is −cmaxo, the opposite of eq..
for an unordered query signature, all the genes in the list have equal weight because there is no particular ordering among them.
the calculation of connection strength is the same as eq., the only difference being that s =  <dig> if gene gi is up-regulated, or s = - <dig> if it is down-regulated.
consequently, the maximum magnitude of connection strength for an unordered signature is
cmaxu=∑i=1m.
given a query signature gene and a reference gene-expression profile, we can calculate their connection score by
c = c/cmax.
so a connection score c =  <dig> means that the gene signature has the maximum positive connection strength with the reference profile, which indicates that the experimental condition that gave rise to this gene signature had the strongest possible correlation with the treatment instance that generated the reference profile.
a connection score c = - <dig> indicates that the two experimental perturbations were most inversely correlated.
in general, a connection score c will be within the range of .
connection testing
as for most biomedical experiments with unavoidable biological and technical variation, statistical significance is a crucial aid to the interpretation and subsequent validation of the result.
here we propose calculating the p-value associated with a connection score by testing the following null hypothesis.
null hypothesis h0: for a reference gene-expression profile r and a query gene signature s of length m, the null hypothesis h <dig> states that there is no underlying biological connection between the two, and that the query signature s is merely a random m-gene signature, as generated by procedure  <dig> described below.
procedure 1: generation of a random m-gene signature.
let r be a given reference gene-expression profile of n genes.
select m genes sequentially and randomly from the n genes , and assign + <dig>  or - <dig>  randomly with equal probability to each of the m selected genes.
if this gene signature is to be used as an ordered list, its order is just the order in which the m genes are selected; or if this gene signature is to be used as merely a collection of genes, then the order is irrelevant.
given a reference profile r and a gene signature s, we calculate their connection score c by eq., and the two-tailed p-value associated with this observed connection score is
p=prob {|c˜|≥|c||h0},
where c˜ is the connection score between a random gene signature and the reference profile.
to estimate the p-value, a large number  of random gene signatures of the same length m can be generated using procedure  <dig> and their connection scores to reference profile r calculated using eq., the proportion of random scores that are no less than the observed scores c in absolute value is an estimate of the two-tailed p-value.
the  <dig> individual treatment instances of the data set gse <dig> were created using only  <dig> distinct small-molecule compounds.
some treatment instances were replication experiments using the same compound at the same or different doses.
it is thus interesting to consider all the treatment instances of the same compound as a set, and to assess the overall connection of the set with a query gene signature.
we define the connection score for a treatment set as follows
t=1n∑i=1nci,
where n is the number of individual treatment instances belonging to the treatment set, ci is the connection score of the ith instance.
to test the significance of a treatment set as a whole.
we used the following null hypothesis,
null hypothesis h0set: where t denotes a set of treatment instances, ri the reference profile based on treatment instance i, and s a query gene signature of length m, the null hypothesis h0set states that there is no underlying biological connection between the gene signature s and any of the reference profiles in t. the query signature is merely a random m-gene list generated by procedure  <dig>
thus the null hypothesis h0set is an extension of h <dig> to a higher level.
alternatively, h <dig> can be viewed as a special case of h0set, in which there is only one treatment instance in the treatment set.
once the connection score for a set is observed, its associated p value can be estimated in a similar way: a large number of random gene signatures of the same length m are generated using procedure  <dig>  and the connection score of the set to each of the random gene signatures is calculated using eq.
; the proportion of random connection scores that are greater than the observed score in absolute value is an estimation of the p value.
testing with random gene signatures
to compare the specificities of the original connectivity map and the method presented here, we generated random gene signatures and tested these random gene signatures in both.
the first example was a random gene signature, rds <dig>  which contained  <dig> affymetrix probe-set ids randomly selected from the  <dig> ids on the affymetrix hg-u133a microarray platform.
querying the connectivity map with this signature, we obtained the connectivity scores of rds <dig> to all the  <dig> individual treatment instances.
the results are shown in table  <dig>  where  <dig> individual reference profiles have positive connectivity scores ranging from  <dig> to  <dig> ;  <dig> individual reference profiles have negative connectivity scores ranging from - <dig> to - <dig> ; and the remaining  <dig> reference profiles have a null connectivity score  <dig>  however, there is no p value or other statistical significance measure associated with these connectivity scores, so users cannot effectively control possible false connections.
in this case, because rds <dig> was a random gene signature, all these positive and negative connections must be false, including the top ones with connectivity scores + <dig> and - <dig>  so, regardless of what cut-off score is used to call significant connections, all such declared significant connections are false.
the connectivity scores of the random gene signature rds <dig> to the reference profiles in the lamb connectivity map.
the full tabulated results can be found in the supplementary data .
<dig> reference profiles have positive connectivity scores,  <dig> reference profiles have negative connectivity scores.
we then used this same random signature to test the new method presented in this paper .
with a p value calculated for each observed connection score, we can control the expected number of false connections by setting an appropriate threshold p value.
in this paper, the threshold p value is generally set at 1/n, where n is the number of null hypotheses being tested simultaneously.
in this example, n =  <dig> .
so a connection with a p value p < 1/ <dig> =  <dig>  is considered as statistically significant.
the setting of the threshold p value at 1/n was intended to control the expected number of false connections at  <dig>  we thus expected to have one false connection on average among all the connections declared as significant.
table  <dig> shows that our method gave the correct result, ie., no significant connection between this random signature and any of the treatment instances.
note that to control the expected number of false connections more precisely, the threshold hold p value should be set at 1/n <dig>  where n <dig> is the number of true null hypothesis.
of course in a general situation n <dig> is unknown, so it has to be estimated, for example, using the methods developed in  <cit> .
in this paper, we set the threshold p value at 1/n for simplicity.
since n <dig> ≤ n, our criteria tend to be slightly conservative, meaning that the actual number of false connections on average will be ≤  <dig>  the second random gene signature, rds <dig>  consisted of  <dig> affymetrix probe-set ids randomly selected from  <dig>  the full results of querying the connectivity map with this signature can be found in the supplementary data , where  <dig> reference profiles have positive connectivity scores ranging from + <dig> to + <dig> ,  <dig> reference profiles have negative connectivity scores ranging from - <dig> to - <dig> , and the remaining  <dig> reference profiles have a null connectivity score  <dig>  however, once again we know these positive and negative connections must be all false, including the top ones with connectivity scores + <dig> and - <dig>  in contrast, the method presented in this paper gave results that agree with the known truth.
with the criteria set above there was  <dig> connection found significant .
since we expect on average  <dig> false connection, this declared significant connection can be taken as false.
the connection scores for the random gene signature rds <dig> using the new method.
to control the expected number of false connections at  <dig>  the threshold p value was set at 1/ <dig> =  <dig> .
no connection was found to be significant, which agrees with the known truth.
the two examples of random gene signatures above showed that on an individual treatment instance level, the connectivity map does not provide effective safeguards against possible false connections.
on the treatment set level, the connectivity map provides a permutation p value when a set of treatment instances associated with the same compound were viewed as a whole.
the significance of the set of treatment instances in the ordered list of all instances was estimated by permutation .
note that the null hypothesis h0set we use in our set-level analysis is different from that of the connectivity map.
tian et al were among the first groups of authors who made explicit distinctions between two different null hypotheses  <cit>  concerning a set of entities .
other authors also addressed this issue in some recent studies on the significance analysis of gene sets  <cit> .
a more detailed comparison between the null hypotheses used by the set-level analysis of the connectivity map and the method presented here can be found in the supplementary information .
throughout this paper, when we use the permutation p values from the connectivity map to control false connections, the same criteria discussed above for setting threshold p value are used.
the full tabulated results of significance analysis on the connections between the two random gene signatures and the  <dig> treatments sets can be found in the supplementary data.
both our method and the connectivity map gave the right answers for these two random gene signatures, ie, no significant connections were found more than expected by chance.
therefore the set-level analysis of the connectivity map can provide a control over possible false connections by means of permutation p values.
so in the subsequent analysis on the experimentally derived gene signatures, we only use the set-level results of the connectivity map, but not its instance-level results.
we need to point out that, in the connectivity map set-level analysis, permutation p values were not available for all the  <dig> treatment sets.
for those treatment sets which only contain  <dig> treatment instance or those sets with mean connectivity score  <dig>  no permutation p values could be calculated, and hence no statistical significance is attached to them.
this problem affects the coverage and consequently the sensitivity of the connectivity map, because real biological connections between a query gene signature and any of those treatment sets may not be recognized.
testing with experimentally derived gene signatures
hdac inhibitors
to test the ability of the new method for identifying real biological connections we utilized some of the same examples used in  <cit>  to compare with the connectivity map.
the first example was a gene signature of histone deacetylase  inhibitors , which was compiled from an independent study  <cit>  on the responses of t <dig>  mda <dig> and mda <dig> cells respectively to three histone deacetylase  inhibitors: vorinostat, ms-27– <dig>  and trichostatin a. this gene signature consisted of  <dig> up- and  <dig> down-regulated genes, represented by  <dig> affymetrix probe-set ids on the affymetrix hg-u133a microarrays.
as the connectivity map does not provide effective safeguards on individual treatment instance level against possible false connections, we can only use the results of the connectivity map on the treatment set level.
in total  <dig> compounds  were identified to have significant positive connectivity with the hdac inhibitor gene signature; and  <dig> compounds  had significant negative connectivity.
vorinostat, trichostatin a, and valproic acid are known hdac inhibitors thus the identification of these can be regarded as a success of the connectivity map.
however another known hdac inhibitor hc-toxin, a reference profile of which was contained in the database, was not identified.
this happened because there was only one treatment instance of the compound hc-toxin in the database and so no permutation p value could be obtained using the connectivity map.
based on their instance level results, lamb et al highlighted hc-toxin in  <cit>  as it had the 7th highest connectivity score  of all instances in the dataset.
however, the two examples of random gene signatures already showed that at the instance level the connectivity map gave false connections even for the highest connectivity scores + <dig> and - <dig>  so the rational choice is to disregard the instance level results from the connectivity map.
we used this same hdac inhibitor gene signature to test the new method presented here, with p values calculated at both the individual instance level and the treatment set level.
on the individual instance level,  <dig> treatment instances, representing  <dig> distinct compounds, were found to have significant connections to sigs <dig>  on the treatment set level,  <dig> compounds were found to have significant connections with the signature.
near the top of the significant connection list were those known hdac inhibitors highlighted in  <cit> .
importantly though also included in the output was hc-toxin, which was not identified by the set-level analysis of the connectivity map.
the full tabulated results for the hdac inhibitor gene signature are included in the supplementary data.
in fig.
<dig>  we summarize the number of significant connections as identified by:  instance level analysis using the new method presented here;  set level analysis using the new method;  set level analysis using the connectivity map.
in total, our method  and  combined identified  <dig> compounds, while the connectivity map identified  <dig> compounds, as having significant connections to the hdac inhibitors.
our method missed only  <dig> of the  <dig> compounds found significant by the connectivity map, while the latter missed  <dig> of the  <dig> compounds identified by our method, with hc-toxin among the  <dig> compounds that were missed.
the hdac inhibitors example thus shows that our method has a greater sensitivity for detecting real connections.
with the increased sensitivity and false connections being properly controlled, the potential benefit of our method is obvious.
in this example, the set-level analysis of the connectivity map identified  <dig> compounds with a false discovery rate of  <dig> % , while the set-level analysis using our method identified  <dig> compounds with a false discovery rate of  <dig> % .
based on the findings of significant connections, researchers can prioritize a small sub set of those compounds for further investigations and/or developing new biological hypotheses.
for this example, using the connectivity map, the chance of pursuing a false connection is  <dig> %, while using our method it is much lower at  <dig> %.
in practice this would save time and resources and increase the rate of success.
estrogens
the second example was a gene signature  taken from an independent study  <cit>  of mcf <dig> cells treated with estradiol.
this gene signature consisted of  <dig> up- and  <dig> down-regulated genes represented by  <dig> affymetrix probe-set ids on the affymetrix hg-u133a microarrays.
we tested the connectivity map and the method presented in this paper with this estrogen signature.
for the same reason given above, we only used the treatment set level results of the connectivity map, which identified  <dig> compounds  as having significant positive connectivity with the estrogen signature; and  <dig> compounds  that had significant negative connectivity.
using our set-level analysis  <dig> compounds were found to have significant positive connection, and  <dig> compounds had significant negative connection to the estrogen gene signature.
the  <dig> compounds with positive connection included genistein, estradiol, and alpha-estradiol, all known to be estrogen receptor agonists.
the  <dig> compounds with negative connection included fulvestrant, raloxifene and tamoxifen, all known to be estrogen receptor antagonists.
in comparison, the connectivity map identified all the estrogen receptor agonists above, but missed all the estrogen receptor antagonists except fulvestrant.
these results therefore indicate the sensitivity of our method is substantially increased.
the connectivity map was able to detect the pure estrogen receptor antagonist fulvestrant, but missed the two compounds tamoxifen and raloxifene which have mixed antagonist and agonist estrogen receptor activities.
the results from our set level analysis also suggest that nordihydroguaiaretic acid  has significant positive connection with estradiol.
this connection is supported by recent studies  <cit> , where ndga has been shown to have estrogenic activity and able to elicit an estrogen-like response.
another compound monorden , suggested by our method as having negative connection to the estrogen gene signature, has been shown to repress the transcriptional function of the estrogen receptor  <cit>  which suggests that it may have some estrogen receptor antagonist-like properties.
the full tabulated results for the estrogen gene signature are included in the supplementary data.
fig.
<dig> summarizes the numbers of significant connections identified by our method and by the connectivity map.
all  <dig> compounds found significant by the connectivity map were also identified by the our method .
however many compounds identified as significant with either positive or negative connection to estradiol using our method were not identified by the connectivity map, included amongst these were raloxifene, tamoxifen, monorden, and ndga.
immunosuppressive therapy
for further testing we compiled a new gene signature from an independent study on cardiac allograft rejection and response to immunosuppressive therapy  <cit> , where patients were treated with standard immunosuppression with corticosteroids, antimetabolites, calcineurin inhibitors, and/or sirolimus.
this gene signature consisted of  <dig> affymetrix probe set ids .
our set-level analysis identified  <dig> compounds as having significant connections with this gene signature.
the three top compounds were azathioprine, thalidomide, and rosiglitazone.
azathioprine is a commonly used immunosuppressive drug  <cit> , so its significant positive connection with the gene signature is a good indication that the new method works very well here.
the second compound thalidomide, which had a positive connection score, also has known immunosuppressive activities  <cit> , inhibits release of tnfα from monocytes, and modulates other cytokine actions.
the recognized properties of these molecules therefore accord with the outcome of the connectivity matching.
the third compound rosiglitazone had a negative connection with the signature suggesting it may have properties to reduce or mitigate the effects of immunosuppressive activity.
recently, rosiglitazone was reported to suppress cyclosporin-induced chronic transplant dysfunction and prolong survival of rat cardiac allografts  <cit> , where cyclosporin is also a commonly used immunosuppressive drug  <cit> .
at the instance level, our method identified  <dig> reference profiles as having significant connections to the immunosuppressive drug gene signature, representing  <dig> distinct compounds.
the top  <dig> compounds were azathioprine, staurosporine, and trichostatin a, which all achieved positive connection scores with this gene signature.
the second compound, staurosporine, a protein kinase c inhibitor, is classified as an antineoplastic and immunosuppressive antibiotic drug  <cit> .
the third compound, trichostatin a, was recently shown to have some immunosuppressive effects in leukemia t cells  <cit> .
therefore the method of instance testing could be particularly valuable for the identification of pharmacological and toxicological properties in novel molecules.
discussion
our results indicate that the method presented here can identify many significant connections to a query gene signature.
then what criteria should we use and which compounds should we choose if new biological hypotheses are to be developed?
our suggestion is to concentrate more on those compounds which have many replicate instances in the database.
because the results obtained for those big treatment sets do not depend heavily on the quality of a small number of treatment instances, as in the case of small treatment sets or singleton sets .
lamb et al also recognized the importance of having replicate instances, and noted that the power to detect connections might be greater for compounds with many replicates.
in defining a treatment set, ideally only the treatment instances of the same compound with the same dose and the same cell type should be considered as a set.
for example, the biological state of hl <dig> cells perturbed by raloxifene should be considered as a different biological state from that of mcf <dig> cells perturbed with the same compound, thus these two instances of raloxifene should not be put into the same set.
in this paper for comparative purposes we adopted lamb et al's choice in defining a treatment set, i.e., all the instances of a compound were grouped together as a set regardless of their possible differences in dose or cell type.
mixing the instances of a compound with different doses and/or different cell types increases the heterogeneity of an otherwise more homogenous treatment set.
this tends to average out the distinct characteristics attributable to the cell type or dosage difference, making some set-level connections insignificant or their interpretation difficult.
in such cases the instance level connections supported by statistical significance can be of great help in interpreting the results.
for future connectivity maps, efforts should be made to provide as many replicate treatment instances  as possible, so that the undesirable reliance on individual instances can be minimized.
the successful identification of real biological connections between the reference profiles and a gene signature also depends on the quality of the gene signature.
in this paper, all the three experimentally derived signatures were compiled from independent studies, in which the original authors had selected those genes as most relevant to characterize the biological states being studied.
it is reasonable to ask though how many genes should be selected from the full list of genes on the microarray to best characterize a biological state?
we believe this will depend on the specific biological condition being investigated, and is the decision of the individual investigator.
it is expected that only those genes that show significant differential expression should be included in the gene signature.
in our experience, as also shown by the examples here, gene signatures with length in the order of  <dig> to  <dig> work well, but this can only serve as a rough guide.
a java application implementing the method presented in this paper can be downloaded via ftp from our institution's website .
CONCLUSIONS
we have presented in this paper a framework for a new connectivity map, with the advantages that statistical significance measures are calculated at both treatment instance level and treatment set level, thus providing effective control over false connections.
this important safeguard was not available in the original connectivity map at the instance level, as revealed by the two examples of random gene signatures.
as the connectivity maps are most useful for high throughput screening and for generating new biological hypothesis, it is crucial that false connections are tightly controlled.
we compared the performance of the method here with the original connectivity map using two gene signatures  previously compiled in  <cit>  and also a new gene signature for immunosuppressive drugs.
all these examples demonstrated that our method is more sensitive and robust than the original.
with its increased sensitivity and with false connections being properly controlled, the method presented here can potentially benefit biomedical researchers by saving them time and resources and increasing their rate of success in pursuing new biological hypothesis based on the findings of connectivity maps.
authors' contributions
sdz and twg designed the study.
sdz developed the algorithm, implemented the method, and analyzed the data.
sdz and twg wrote the paper.
all authors read and approved the final manuscript.
supplementary material
additional file 1
supplementarydata.
the full tabulated results for the  <dig> gene signatures discussed in the paper, which can be opened with ms excel.
click here for file
additional file 2
supplementaryinfo.
a more detailed discussion on the two different null hypotheses used in the set-level analysis.
click here for file
additional file 3
downloadingsoftware-info.
information for downloading the java application implementing the method presented in this paper.
click here for file
acknowledgements
we wish to acknowledge the support of the microarray team of the mrc toxicology unit.
sdz thanks qing wen for helpful discussions on a searching algorithm in the implementation of the new method.

 one of the most fundamental challenges in all forms of'omic technologies is the connection of biological event signatures with others previously derived to allow the recognition of new molecule properties or biological alteration. simple, robust, and efficient matching methods are required to connect a new gene expression signature with those in a database. this problem was first tackled by lamb et al who introduced the connectivity map as a resource and tool to connect small-molecule drugs, genes, and diseases. the connectivity map achieved a good degree of success, but also suffered from several deficiencies, particularly an inability to apply a measure of statistical validity at the individual reference signature level to allow rational filtering of the results to exclude false connections. we took the method of lamb et al as a basis for development and have derived a simple, robust and statistically testable method for making connections between biological event signatures. the method was tested with genomic signatures resulting from small molecule interactions in cells, but also could be applied to any form of signature such as those from proteomic or metabolomic science. the main assumption behind the concept of a connectivity map is that a biological state, whether physiological, pathological, or induced with chemical or genomic perturbations, can be described in terms of a genomic signature, eg., the genome-wide mrna levels as measured by dna microarray technologies. the working of a connectivity map involves several key components. first, a large collection of pre-built reference gene-expression profiles serve as the core database, where each reference profile characterizes a well-defined biological state. secondly, a query gene signature from some specific studies. a query gene signature is basically a short list of genes most relevant and important to characterize the biological state of the researchers' interest. finally, a pattern matching algorithm or similarity metric defined between a query gene signature and a reference gene-expression profile to quantify the closeness or connection between the two biological states. such a connectivity map can be used by biomedical researchers to find connections between the reference biological states and those of their own interest, leading to testable new biological hypotheses. in this paper, we present a new framework for the construction of reference profiles, new connection scoring scheme and testing procedures for the observed connections. we compare our method with that of lamb et al, and show that more robust results are achieved using our method. in particular our method not only offers a more principled statistical procedure for testing connections, but more importantly it provides effective safeguards against false connections while at the same time achieving increased sensitivity. as a consequence it can benefit the end users by saving them time and resources in pursuing new biological hypotheses based on the findings of connectivity maps.  construction of reference profiles for the first-generation connectivity map, lamb et al carried out a series of gene-expression profiling experiments, using distinct small-molecule compounds in a few selected human cell lines. each treatment instance consisted of one treatment sample and one vehicle control samples, whose genome wide mrna levels were measured using affymetrix genechip microarrays. in total samples were microarrayed, which represented different treatment instances. for example, treatment instance id consisted of treatment sample and vehicle control samples. the treatment sample was obtained by treating human mcf cells with nm estradiol for hours. the control samples were obtained by treating mcf cells with vehicle control for hours. a gene-expression profile was constructed for each treatment instance, in which the relative expression of all the measured genes were specified, and sorted in descending order. a query gene signature, obtained and ordered in the same manner, can be compared to each reference profile in the connectivity map to calculate a connectivity score. for "positive connectivity", the up-regulated genes of the query signature find matches near the top of the reference profile, and the down-regulated genes find matches near the bottom of the reference profile. for "negative connectivity", the matches are opposite. we obtained lamb et al's data set from the geo database, and rebuilt the reference gene-expression profiles using a new ranking scheme based on the following guiding principles: a treatment instance was defined relative to a control, thus the effect of the treatment could be characterized by the relative differential expression status of all the genes together, different genes were affected to different extents by the treatment, so genes which showed a greater differential expression should have more weight in characterizing this treatment, and up- and down-regulated genes should be treated equally in a unified manner. this meant that a 2-fold down-regulated gene was considered as equally important as a 2-fold up-regulated gene in defining a reference profile. there are several reasons for the choice of treating up- and down-regulated genes equally. theoretically, unless we have a lot of further information about so many genes on the microarray it is difficult to decide whether this 2-fold up-regulated gene is more important than that 2-fold down-regulated gene or the opposite. so it is logical to assign them equal weights. another reason is the consideration of symmetry: if a gene is 2-fold up-regulated in sample versus sample it can also be viewed as 2-fold down-regulated in sample versus sample we should emphasize that assigning two genes equal weights does not imply in any sense they share the same molecular mechanism. even two up-regulated genes with the same fold change could be involved in very different molecular mechanisms. to adhere to the above guidelines, an obvious choice for organizing the genes is the logarithm of the expression ratio. thus instead of treating the down- and up-regulated genes separately as in the method of lamb et al, we ordered genes in a reference profile by the absolute value of their expression log-ratios. therefore the most differentially expressed genes appear first in the list, and those non-differentially expressed genes appear at the bottom of the list. in this way, the genes are ordered by their importance in defining the reference profile. it is then straightforward to assign ranks to them. suppose there are in total n genes, the first gene in the list will be assigned a rank n if it is up-regulated, or a rank -n if it is down-regulated. in general the ith gene in the list will be ranked with for up-regulation or - for down-regulation. with this new ranking method, the importance of a gene is reflected by the absolute value of its rank, while the sign of its rank indicates its regulation status. the consequence and advantage of this method for creating reference profiles is that attaching statistical significance to the connection observed is a relatively straightforward step. the scoring scheme a query gene signature can be an ordered gene list, or just a collection of genes without specific ordering. we will refer to these two types of query gene signatures as ordered and unordered gene signatures respectively. for an ordered gene signature, we rank the genes in the list in the same way as for a reference profile. namely, the most important gene in the signature will be assigned a rank m or -m depending on its regulation status, where m is the number of genes in the signature. while the least important gene in the signature be ranked or - let r denote a reference gene-expression profile, and s a query gene signature. we define the connection strength between r and s as c=∑i=1mrs, where gi represents the ith gene in the signature, s is its signed rank in the signature, and r is this gene's signed rank in the reference profile. it is worth noting some properties of the connection strength defined above: if a gene has the same regulation status in both the reference and the query, it will make a positive contribution to the connection strength, otherwise its contribution will be negative; the magnitude of a gene's contribution to the connection strength is determined by its position in both lists; and a gene signature with some of its genes contributing positively and others negatively will have an overall low connection strength, because the positive and negative contributions cancel each other to some extent. therefore when calculating the connection strength between a gene signature and a reference profile, the maximum connection strength achievable is the situation where the m genes in the signature match the first m genes in the reference profile in the correct order, and their regulation status also match. in such a case, the maximum positive connection strength is, for an ordered gene signature, cmaxo=∑i=1m. in another equally interesting situation, where the m genes in the signature match the first m genes in the reference profile in the right order, but the sign of each gene in the query is different from its sign in the reference, the connection strength is −cmaxo, the opposite of eq.. for an unordered query signature, all the genes in the list have equal weight because there is no particular ordering among them. the calculation of connection strength is the same as eq., the only difference being that s = if gene gi is up-regulated, or s = - if it is down-regulated. consequently, the maximum magnitude of connection strength for an unordered signature is cmaxu=∑i=1m. given a query signature gene and a reference gene-expression profile, we can calculate their connection score by c = c/cmax. so a connection score c = means that the gene signature has the maximum positive connection strength with the reference profile, which indicates that the experimental condition that gave rise to this gene signature had the strongest possible correlation with the treatment instance that generated the reference profile. a connection score c = - indicates that the two experimental perturbations were most inversely correlated. in general, a connection score c will be within the range of. connection testing as for most biomedical experiments with unavoidable biological and technical variation, statistical significance is a crucial aid to the interpretation and subsequent validation of the result. here we propose calculating the p-value associated with a connection score by testing the following null hypothesis. null hypothesis h0: for a reference gene-expression profile r and a query gene signature s of length m, the null hypothesis h states that there is no underlying biological connection between the two, and that the query signature s is merely a random m-gene signature, as generated by procedure described below. procedure 1: generation of a random m-gene signature. let r be a given reference gene-expression profile of n genes. select m genes sequentially and randomly from the n genes, and assign + or - randomly with equal probability to each of the m selected genes. if this gene signature is to be used as an ordered list, its order is just the order in which the m genes are selected; or if this gene signature is to be used as merely a collection of genes, then the order is irrelevant. given a reference profile r and a gene signature s, we calculate their connection score c by eq., and the two-tailed p-value associated with this observed connection score is p=prob {|c˜|≥|c||h0}, where c˜ is the connection score between a random gene signature and the reference profile. to estimate the p-value, a large number of random gene signatures of the same length m can be generated using procedure and their connection scores to reference profile r calculated using eq., the proportion of random scores that are no less than the observed scores c in absolute value is an estimate of the two-tailed p-value. the individual treatment instances of the data set gse were created using only distinct small-molecule compounds. some treatment instances were replication experiments using the same compound at the same or different doses. it is thus interesting to consider all the treatment instances of the same compound as a set, and to assess the overall connection of the set with a query gene signature. we define the connection score for a treatment set as follows t=1n∑i=1nci, where n is the number of individual treatment instances belonging to the treatment set, ci is the connection score of the ith instance. to test the significance of a treatment set as a whole. we used the following null hypothesis, null hypothesis h0set: where t denotes a set of treatment instances, ri the reference profile based on treatment instance i, and s a query gene signature of length m, the null hypothesis h0set states that there is no underlying biological connection between the gene signature s and any of the reference profiles in t. the query signature is merely a random m-gene list generated by procedure thus the null hypothesis h0set is an extension of h to a higher level. alternatively, h can be viewed as a special case of h0set, in which there is only one treatment instance in the treatment set. once the connection score for a set is observed, its associated p value can be estimated in a similar way: a large number of random gene signatures of the same length m are generated using procedure and the connection score of the set to each of the random gene signatures is calculated using eq.; the proportion of random connection scores that are greater than the observed score in absolute value is an estimation of the p value. testing with random gene signatures to compare the specificities of the original connectivity map and the method presented here, we generated random gene signatures and tested these random gene signatures in both. the first example was a random gene signature, rds which contained affymetrix probe-set ids randomly selected from the ids on the affymetrix hg-u133a microarray platform. querying the connectivity map with this signature, we obtained the connectivity scores of rds to all the individual treatment instances. the results are shown in table where individual reference profiles have positive connectivity scores ranging from to; individual reference profiles have negative connectivity scores ranging from - to -; and the remaining reference profiles have a null connectivity score however, there is no p value or other statistical significance measure associated with these connectivity scores, so users cannot effectively control possible false connections. in this case, because rds was a random gene signature, all these positive and negative connections must be false, including the top ones with connectivity scores + and - so, regardless of what cut-off score is used to call significant connections, all such declared significant connections are false. the connectivity scores of the random gene signature rds to the reference profiles in the lamb connectivity map. the full tabulated results can be found in the supplementary data. reference profiles have positive connectivity scores, reference profiles have negative connectivity scores. we then used this same random signature to test the new method presented in this paper. with a p value calculated for each observed connection score, we can control the expected number of false connections by setting an appropriate threshold p value. in this paper, the threshold p value is generally set at 1/n, where n is the number of null hypotheses being tested simultaneously. in this example, n =. so a connection with a p value p < 1/ = is considered as statistically significant. the setting of the threshold p value at 1/n was intended to control the expected number of false connections at we thus expected to have one false connection on average among all the connections declared as significant. table shows that our method gave the correct result, ie., no significant connection between this random signature and any of the treatment instances. note that to control the expected number of false connections more precisely, the threshold hold p value should be set at 1/n where n is the number of true null hypothesis. of course in a general situation n is unknown, so it has to be estimated, for example, using the methods developed in. in this paper, we set the threshold p value at 1/n for simplicity. since n ≤ n, our criteria tend to be slightly conservative, meaning that the actual number of false connections on average will be ≤ the second random gene signature, rds consisted of affymetrix probe-set ids randomly selected from the full results of querying the connectivity map with this signature can be found in the supplementary data, where reference profiles have positive connectivity scores ranging from + to +, reference profiles have negative connectivity scores ranging from - to -, and the remaining reference profiles have a null connectivity score however, once again we know these positive and negative connections must be all false, including the top ones with connectivity scores + and - in contrast, the method presented in this paper gave results that agree with the known truth. with the criteria set above there was connection found significant. since we expect on average false connection, this declared significant connection can be taken as false. the connection scores for the random gene signature rds using the new method. to control the expected number of false connections at the threshold p value was set at 1/ =. no connection was found to be significant, which agrees with the known truth. the two examples of random gene signatures above showed that on an individual treatment instance level, the connectivity map does not provide effective safeguards against possible false connections. on the treatment set level, the connectivity map provides a permutation p value when a set of treatment instances associated with the same compound were viewed as a whole. the significance of the set of treatment instances in the ordered list of all instances was estimated by permutation. note that the null hypothesis h0set we use in our set-level analysis is different from that of the connectivity map. tian et al were among the first groups of authors who made explicit distinctions between two different null hypotheses concerning a set of entities. other authors also addressed this issue in some recent studies on the significance analysis of gene sets. a more detailed comparison between the null hypotheses used by the set-level analysis of the connectivity map and the method presented here can be found in the supplementary information. throughout this paper, when we use the permutation p values from the connectivity map to control false connections, the same criteria discussed above for setting threshold p value are used. the full tabulated results of significance analysis on the connections between the two random gene signatures and the treatments sets can be found in the supplementary data. both our method and the connectivity map gave the right answers for these two random gene signatures, ie, no significant connections were found more than expected by chance. therefore the set-level analysis of the connectivity map can provide a control over possible false connections by means of permutation p values. so in the subsequent analysis on the experimentally derived gene signatures, we only use the set-level results of the connectivity map, but not its instance-level results. we need to point out that, in the connectivity map set-level analysis, permutation p values were not available for all the treatment sets. for those treatment sets which only contain treatment instance or those sets with mean connectivity score no permutation p values could be calculated, and hence no statistical significance is attached to them. this problem affects the coverage and consequently the sensitivity of the connectivity map, because real biological connections between a query gene signature and any of those treatment sets may not be recognized. testing with experimentally derived gene signatures hdac inhibitors to test the ability of the new method for identifying real biological connections we utilized some of the same examples used in to compare with the connectivity map. the first example was a gene signature of histone deacetylase inhibitors, which was compiled from an independent study on the responses of t mda and mda cells respectively to three histone deacetylase inhibitors: vorinostat, ms-27– and trichostatin a. this gene signature consisted of up- and down-regulated genes, represented by affymetrix probe-set ids on the affymetrix hg-u133a microarrays. as the connectivity map does not provide effective safeguards on individual treatment instance level against possible false connections, we can only use the results of the connectivity map on the treatment set level. in total compounds were identified to have significant positive connectivity with the hdac inhibitor gene signature; and compounds had significant negative connectivity. vorinostat, trichostatin a, and valproic acid are known hdac inhibitors thus the identification of these can be regarded as a success of the connectivity map. however another known hdac inhibitor hc-toxin, a reference profile of which was contained in the database, was not identified. this happened because there was only one treatment instance of the compound hc-toxin in the database and so no permutation p value could be obtained using the connectivity map. based on their instance level results, lamb et al highlighted hc-toxin in as it had the 7th highest connectivity score of all instances in the dataset. however, the two examples of random gene signatures already showed that at the instance level the connectivity map gave false connections even for the highest connectivity scores + and - so the rational choice is to disregard the instance level results from the connectivity map. we used this same hdac inhibitor gene signature to test the new method presented here, with p values calculated at both the individual instance level and the treatment set level. on the individual instance level, treatment instances, representing distinct compounds, were found to have significant connections to sigs on the treatment set level, compounds were found to have significant connections with the signature. near the top of the significant connection list were those known hdac inhibitors highlighted in. importantly though also included in the output was hc-toxin, which was not identified by the set-level analysis of the connectivity map. the full tabulated results for the hdac inhibitor gene signature are included in the supplementary data. in fig. we summarize the number of significant connections as identified by: instance level analysis using the new method presented here; set level analysis using the new method; set level analysis using the connectivity map. in total, our method and combined identified compounds, while the connectivity map identified compounds, as having significant connections to the hdac inhibitors. our method missed only of the compounds found significant by the connectivity map, while the latter missed of the compounds identified by our method, with hc-toxin among the compounds that were missed. the hdac inhibitors example thus shows that our method has a greater sensitivity for detecting real connections. with the increased sensitivity and false connections being properly controlled, the potential benefit of our method is obvious. in this example, the set-level analysis of the connectivity map identified compounds with a false discovery rate of %, while the set-level analysis using our method identified compounds with a false discovery rate of %. based on the findings of significant connections, researchers can prioritize a small sub set of those compounds for further investigations and/or developing new biological hypotheses. for this example, using the connectivity map, the chance of pursuing a false connection is %, while using our method it is much lower at %. in practice this would save time and resources and increase the rate of success. estrogens the second example was a gene signature taken from an independent study of mcf cells treated with estradiol. this gene signature consisted of up- and down-regulated genes represented by affymetrix probe-set ids on the affymetrix hg-u133a microarrays. we tested the connectivity map and the method presented in this paper with this estrogen signature. for the same reason given above, we only used the treatment set level results of the connectivity map, which identified compounds as having significant positive connectivity with the estrogen signature; and compounds that had significant negative connectivity. using our set-level analysis compounds were found to have significant positive connection, and compounds had significant negative connection to the estrogen gene signature. the compounds with positive connection included genistein, estradiol, and alpha-estradiol, all known to be estrogen receptor agonists. the compounds with negative connection included fulvestrant, raloxifene and tamoxifen, all known to be estrogen receptor antagonists. in comparison, the connectivity map identified all the estrogen receptor agonists above, but missed all the estrogen receptor antagonists except fulvestrant. these results therefore indicate the sensitivity of our method is substantially increased. the connectivity map was able to detect the pure estrogen receptor antagonist fulvestrant, but missed the two compounds tamoxifen and raloxifene which have mixed antagonist and agonist estrogen receptor activities. the results from our set level analysis also suggest that nordihydroguaiaretic acid has significant positive connection with estradiol. this connection is supported by recent studies, where ndga has been shown to have estrogenic activity and able to elicit an estrogen-like response. another compound monorden, suggested by our method as having negative connection to the estrogen gene signature, has been shown to repress the transcriptional function of the estrogen receptor which suggests that it may have some estrogen receptor antagonist-like properties. the full tabulated results for the estrogen gene signature are included in the supplementary data. fig. summarizes the numbers of significant connections identified by our method and by the connectivity map. all compounds found significant by the connectivity map were also identified by the our method. however many compounds identified as significant with either positive or negative connection to estradiol using our method were not identified by the connectivity map, included amongst these were raloxifene, tamoxifen, monorden, and ndga. immunosuppressive therapy for further testing we compiled a new gene signature from an independent study on cardiac allograft rejection and response to immunosuppressive therapy, where patients were treated with standard immunosuppression with corticosteroids, antimetabolites, calcineurin inhibitors, and/or sirolimus. this gene signature consisted of affymetrix probe set ids. our set-level analysis identified compounds as having significant connections with this gene signature. the three top compounds were azathioprine, thalidomide, and rosiglitazone. azathioprine is a commonly used immunosuppressive drug, so its significant positive connection with the gene signature is a good indication that the new method works very well here. the second compound thalidomide, which had a positive connection score, also has known immunosuppressive activities, inhibits release of tnfα from monocytes, and modulates other cytokine actions. the recognized properties of these molecules therefore accord with the outcome of the connectivity matching. the third compound rosiglitazone had a negative connection with the signature suggesting it may have properties to reduce or mitigate the effects of immunosuppressive activity. recently, rosiglitazone was reported to suppress cyclosporin-induced chronic transplant dysfunction and prolong survival of rat cardiac allografts, where cyclosporin is also a commonly used immunosuppressive drug. at the instance level, our method identified reference profiles as having significant connections to the immunosuppressive drug gene signature, representing distinct compounds. the top compounds were azathioprine, staurosporine, and trichostatin a, which all achieved positive connection scores with this gene signature. the second compound, staurosporine, a protein kinase c inhibitor, is classified as an antineoplastic and immunosuppressive antibiotic drug. the third compound, trichostatin a, was recently shown to have some immunosuppressive effects in leukemia t cells. therefore the method of instance testing could be particularly valuable for the identification of pharmacological and toxicological properties in novel molecules. discussion our results indicate that the method presented here can identify many significant connections to a query gene signature. then what criteria should we use and which compounds should we choose if new biological hypotheses are to be developed? our suggestion is to concentrate more on those compounds which have many replicate instances in the database. because the results obtained for those big treatment sets do not depend heavily on the quality of a small number of treatment instances, as in the case of small treatment sets or singleton sets. lamb et al also recognized the importance of having replicate instances, and noted that the power to detect connections might be greater for compounds with many replicates. in defining a treatment set, ideally only the treatment instances of the same compound with the same dose and the same cell type should be considered as a set. for example, the biological state of hl cells perturbed by raloxifene should be considered as a different biological state from that of mcf cells perturbed with the same compound, thus these two instances of raloxifene should not be put into the same set. in this paper for comparative purposes we adopted lamb et al's choice in defining a treatment set, i.e., all the instances of a compound were grouped together as a set regardless of their possible differences in dose or cell type. mixing the instances of a compound with different doses and/or different cell types increases the heterogeneity of an otherwise more homogenous treatment set. this tends to average out the distinct characteristics attributable to the cell type or dosage difference, making some set-level connections insignificant or their interpretation difficult. in such cases the instance level connections supported by statistical significance can be of great help in interpreting the results. for future connectivity maps, efforts should be made to provide as many replicate treatment instances as possible, so that the undesirable reliance on individual instances can be minimized. the successful identification of real biological connections between the reference profiles and a gene signature also depends on the quality of the gene signature. in this paper, all the three experimentally derived signatures were compiled from independent studies, in which the original authors had selected those genes as most relevant to characterize the biological states being studied. it is reasonable to ask though how many genes should be selected from the full list of genes on the microarray to best characterize a biological state? we believe this will depend on the specific biological condition being investigated, and is the decision of the individual investigator. it is expected that only those genes that show significant differential expression should be included in the gene signature. in our experience, as also shown by the examples here, gene signatures with length in the order of to work well, but this can only serve as a rough guide. a java application implementing the method presented in this paper can be downloaded via ftp from our institution's website.  we have presented in this paper a framework for a new connectivity map, with the advantages that statistical significance measures are calculated at both treatment instance level and treatment set level, thus providing effective control over false connections. this important safeguard was not available in the original connectivity map at the instance level, as revealed by the two examples of random gene signatures. as the connectivity maps are most useful for high throughput screening and for generating new biological hypothesis, it is crucial that false connections are tightly controlled. we compared the performance of the method here with the original connectivity map using two gene signatures previously compiled in and also a new gene signature for immunosuppressive drugs. all these examples demonstrated that our method is more sensitive and robust than the original. with its increased sensitivity and with false connections being properly controlled, the method presented here can potentially benefit biomedical researchers by saving them time and resources and increasing their rate of success in pursuing new biological hypothesis based on the findings of connectivity maps. authors' contributions sdz and twg designed the study. sdz developed the algorithm, implemented the method, and analyzed the data. sdz and twg wrote the paper. all authors read and approved the final manuscript. supplementary material additional file 1 supplementarydata. the full tabulated results for the gene signatures discussed in the paper, which can be opened with ms excel. click here for file additional file 2 supplementaryinfo. a more detailed discussion on the two different null hypotheses used in the set-level analysis. click here for file additional file 3 downloadingsoftware-info. information for downloading the java application implementing the method presented in this paper. click here for file acknowledgements we wish to acknowledge the support of the microarray team of the mrc toxicology unit. sdz thanks qing wen for helpful discussions on a searching algorithm in the implementation of the new method.
we tested the new method with two randomly generated gene signatures and three experimentally derived gene signatures. lamb et al first proposed the connectivity map to make successful connections among small molecules, genes, and diseases using genomic signatures. here we have built on the principles of the connectivity map to present a simpler and more robust method for the construction of reference gene-expression profiles and for the connection scoring scheme, which importantly allows the valuation of statistical significance of all the connections observed. interaction of a drug or chemical with a biological system can result in a gene-expression profile or signature characteristic of the event. using a suitably robust algorithm these signatures can potentially be used to connect molecules with similar pharmacological or toxicological properties by gene expression profile. with its robust performance, the method has potential use in the drug development pipeline for the early recognition of pharmacological and toxicological properties in chemicals and new drug candidates, and also more broadly in other'omics sciences. the method presented here not only offers more principled statistical procedures for testing connections, but more importantly it provides effective safeguard against false connections at the same time achieving increased sensitivity.
 interaction of a drug or chemical with a biological system can result in a gene-expression profile or signature characteristic of the event. using a suitably robust algorithm these signatures can potentially be used to connect molecules with similar pharmacological or toxicological properties by gene expression profile. lamb et al first proposed the connectivity map to make successful connections among small molecules, genes, and diseases using genomic signatures.  here we have built on the principles of the connectivity map to present a simpler and more robust method for the construction of reference gene-expression profiles and for the connection scoring scheme, which importantly allows the valuation of statistical significance of all the connections observed. we tested the new method with two randomly generated gene signatures and three experimentally derived gene signatures. our testing with this method indicates that it achieves a higher level of specificity and sensitivity and so advances the original method.  the method presented here not only offers more principled statistical procedures for testing connections, but more importantly it provides effective safeguard against false connections at the same time achieving increased sensitivity. with its robust performance, the method has potential use in the drug development pipeline for the early recognition of pharmacological and toxicological properties in chemicals and new drug candidates, and also more broadly in other'omics sciences. 