BACKGROUND
as microarray experiment has been widely used for various field of biology, public microarray databases have been rapidly growing each year.
currently, the two largest microarray databases, geo  <cit>  and arrayexpress  <cit>  are comprised of several hundreds thousands of expression profiles, representing various biological contexts of various species.
in accordance with this expensive collection of large scale gene expression databases, database searching methods have been developed to make the database easily accessible and practically useful.
since the microarray data is deposited in public microarray database as unit of experiment which is consist of several individual gene expression profiles, search methods also have evolved into two way, experiment dataset level search and individual gene expression profile level search.
most of experiment dataset level search methods are depend on dataset annotation by authors of dataset.
atul b. et al.
has been tried to classify the gene expression experiment dataset in geo  by annotating each geo dataset with medical language terms such as umls and snomed  <cit>  and to make gene expression variation based dataset search possible  <cit> .
yuelin z. et al.
built geometadb  <cit> , which make text match based geo dataset search more affordable than original geo database.
along the attempts to search large public microarray databases at experiment dataset level, individual gene expression profile level search method has also been conceptualized and developed  <cit> .
gest  <cit>  is the first implementation of individual profile level search method.
it uses bayesian similarity metric to measure similarity between gene expression profiles.
horton et al.
devised fast similarity search algorithm and built web based similar gene expression search system, cellmontage  <cit> .
to make cross-platform gene expression profiles search possible, they transformed all gene expression profiles to unigene id based gene expression profiles, averaging expression values of genes for corresponding unigene id if multiple genes are mapped to a single unigene id, then measured similarity between expression profiles using spearman rank correlation coefficient.
cell type classification as a validation of search power of cellmontage revealed that this method is good enough to search similar expression profiles from the same platform, but not from the different platform  <cit> .
here we try to improve similar gene expression profile search.
for this purpose, we devised a pathway based gene expression similarity measuring method.
our pathway based methods outperform conventional method especially for cross-platform and cross-experiment profile search.
methods
gene expression data
we used set of gene expression profiles curated by cellmontage group  <cit> .
each gene expression profile in cellmontage dataset, originally stored in geo, is manually annotated with cell type and gene expression values of original profiles are averaged to represent expression values of corresponding unigene id.
for the classification procedure, we first selected cell types with which at least two different platform types are associated.
for each selected cell type, we select at most two gene expression profiles from each platform in the same experiment.
after the selection procedure, total  <dig> gene expression profiles of  <dig> different cell types from  <dig> different experiment with  <dig> different platform types were remained .
of these selected gene expression profiles, randomly selected one gene expression profile from each cell type was used as query profile and the other remaining profiles build up search database.
finally, the numbers of gene expression profiles in the query set and the search database are  <dig> and  <dig>  respectively.
pathway data
we used c <dig> database of msigdb  <cit>  as pathway data source for pathway summary profiling.
each unigene id in gene expression profiles was mapped to corresponding gene symbol of  <dig>  pathways in msigdb using ncbi unigene database  <cit> .
pathway expression profiling
each gene expression profile was converted to pathway centric expression profile by averaging expression values of genes for corresponding pathways.
pathway expression for pathway k, consisted of n genes, is calculated by
where gi denotes gene expression for gene i for i =  <dig>  ..., n.
gene expression similarity measurement
we used two different scoring methods to measure similarity between gene expression profiles.
the first method, conventional method used by cellmontage, compares common gene set between two comparing gene expression profiles.
let this method call cgsep method.
another method compares common pathway set between two comparing pathway expression profiles converted from gene expression profiles.
to measure the similarity between gene or pathway expression profiles, we used spearman rank correlation test.
spearman rank correlation coefficient between profile x and y is given by
where di = xi-yi, i =  <dig>  ..., n and xi, yi = rank of ith gene or pathway in each profile x and y. spearman rank correlation coefficient ranges from - <dig> to  <dig>  where similarity is maximum at  <dig> and minimum at - <dig>
cell type classification
to evaluate the performance of similarity measuring methods, we conducted cell type classification using nearest neighbor classifier.
for each of  <dig> query gene expression profiles, the similarities to all of  <dig> gene expression profiles in search database were calculated.
then the profile with highest spearman rank correlation coefficient was predicted to have the same cell type to query profile.
predicted profile was considered as correct prediction if its cell type is the same as that of query sample.
if there is no same cell type profile in search database for a query profile, the search for the given query profile is not counted in classification accuracy assessment.
accuracy of classification is calculated by number of correct predictions divided by number of predictions.
similar profile search from the profiles of different platform or different experiment is harder than search from the profiles of the same platform or the same experiment  <cit> .
to evaluate the performance of pathway based similarity measuring method, we conducted two more cell type classifications, cross-platform and cross-experiment classification, where search space is consist of profiles whose platforms or experiments are different from that of query.
RESULTS
we conducted cell type classification using two different similarity measuring methods and access the performances with overall, cross-platform and cross-experiment search databases.
barplot shown in figure  <dig> summarizes all of the classification results.
pathway based similarity measuring method, pepc, consistently shows higher classification accuracies than cgsep method for classifications with three different search databases.
as an example cases, pathway based method, pepc, precisely classified cell types of query profile gsm <dig> of thalamus cell type with overall search database  and query profile gsm <dig> of liver cell type with cross-platform search database  while cgsep failed.
pathway based method shows significant improvement when they were applied for cross-platform search database search as pepc excel cgsep with  <dig> % increased accuracy.
pathway based method also outperformed up to 10% over cgsep for cross-experiment search, however the improvement is not as significant as the cross-platform classification.
we next calculated average similarity score of top scoring hit for correct and incorrect classification cases .
average similarity score of correct cases is higher than incorrect cases except cross-platform search using cgsep method, in which cgsep shows only 10% classification accuracy.
similarity scores for cross-platform search are lower than the other two classifications.
this trend is cause by lower expression variations between expression profiles of the same type of platforms than that of different type of platforms  <cit> .
we analyzed further to figure out the reason for low classification accuracy of cross-experiment search.
more specifically, our question is why cross-experiment searches show lower classification accuracy than that of cross-platform searches even though the similarity scores for top hits are higher than that of cross-platform searches.
to answer this question, we divided cross-experiment search database more specifically into cross-experiment with the same platform profiles and cross-experiment with different platform profiles and conducted cell type classification with those two search databases.
table  <dig> summarizes the classification accuracy with average similarity scores for correct and incorrect cases for limited search databases.
we found again improved classification accuracies with up to 40% higher accuracy compared to original cross-experiment search by pathway based method if cross-experiment search is limited to cross-platform, but this trend is disappeared in search over cross-experiment and the same platform search databases.
the average similarity scores to the top hits of same platform top hits are higher than average similarity scores to the top hits of different platforms in cross-experiment search.
even average similarity scores of incorrect cases with the same platform are higher than average similarity scores of correct cases with different platforms.
therefore, the correct profiles of different platforms to the query profile might not score higher than incorrect profiles of the same platforms.
this seemed to be the reason for low classification accuracy of cross-experiment search.
considering this reason for low classification accuracy of cross-experiment search, different criteria to evaluate similarity score according to platform type could improve classification accuracy of cross-experiment search.
reduced analytical dimension of pathway expression profiles from gene expression profiles might also contribute improved classification accuracy by pathway based methods.
not all genes in gene expression profile are converted to pathway expression profile for the incompleteness of current pathway information  <cit> .
in case of  <dig> query and profiles in search database used for cell type classification, average  <dig> ± 15% genes of common gene set for cgsep method are made up common pathway expression profiles in pepc.
however, the reduced gene expression dimension dose not reduces analytical sensitivity, rather it was reported that classification accuracy is decreased with the addition of feature genes over than the moderate number  <cit> .
likewise, reduced number of genes in the process of pathway expression profiling might increase analytical sensitivity by limiting analytical dimension under moderate size.
we first attempted to use pathway information for gene expression similarity measurement.
as previously developed pathway based gene expression analysis methods were successfully improve intact gene expression based analysis methods  <cit> , pathway based similarity measuring method outperformed conventional method.
along with the reduced analytical dimension effect described earlier, this improvement seems to be contributed by the averaging effect of expression variation of individual genes caused by both biological and technical reasons.
each human gene do not express or is not detected to expressed constantly even under the same biological condition within a specific microarray platform or across different type of platforms, rather it fluctuates  <cit> .
on the other hands, pathway expression, an overall expression pattern of gene set, is robust toward subtle outside stimulation  <cit> .
the pathway based gene expression similarity measuring methods, pepc, we suggested here, compute pathway level expression by averaging expression of genes mapped to pathway.
consequently, expression variations of multiple genes are summarized by a robust pathway expression, which represents the activity of the functional unit rather than a component of the unit, thus the pathway based methods result with higher classification accuracy, which demonstrates again that pathway level expression is more robust than individual gene level expression and pathway based similarity scoring methods could be successfully improve similar gene expression profile search.
CONCLUSIONS
we demonstrated that our new gene expression similarity measuring method improved the precision of similar gene expression profile search when it's applied to cell type classification.
we showed pathway expression profiling based similarity measuring method outperformed conventional gene expression profile based similarity measuring method over at most 50% for cross-platform profile search and 10% for cross-experiment profile search.
at the same time, the classification accuracy shows that the methods still need to be improved, especially for searching similar profiles across different experiment.
we believe that our research shed new light on similar gene expression profile search over rapidly growing large microarray databases by showing that integrating gene expression profile with external data such as pathway could improve search accuracy.
list of abbreviations used
cgsep: common gene set expression profile; pepa: pathway expression profile for all gene set; pepc: pathway expression profile for common gene set.
competing interests
the authors declare that they have no competing interests.
authors' contributions
ck designed whole research process, implemented all required methods for the research, analyzed results, drafted and revised the manuscript.
jhw devised similarity scoring algorithm with ck and revised the manuscript.
wso and ktn helped the conceptualization of the research process.
all authors read and approved the final manuscript.
note
other papers from the meeting have been published as part of bmc bioinformatics volume  <dig> supplement  <dig>  2009: eighth international conference on bioinformatics : bioinformatics, available online at http://www.biomedcentral.com/1471-2105/10?issue=s <dig>
supplementary material
additional file 1
dataset detail for cell type classification.
all  <dig> gene expression profiles used for cell type classification are listed with detailed information.
each gene expression profile is annotated with three original geo accession id, sample id, experiment id and platform id, and cell type.
click here for file
acknowledgements
this work was supported by grants  from korea food & drug administration.
this article has been published as part of bmc genomics volume  <dig> supplement  <dig>  2009: eighth international conference on bioinformatics : computational biology.
the full contents of the supplement are available online at http://www.biomedcentral.com/1471-2164/10?issue=s <dig>

 as microarray experiment has been widely used for various field of biology, public microarray databases have been rapidly growing each year. currently, the two largest microarray databases, geo and arrayexpress are comprised of several hundreds thousands of expression profiles, representing various biological contexts of various species. in accordance with this expensive collection of large scale gene expression databases, database searching methods have been developed to make the database easily accessible and practically useful. since the microarray data is deposited in public microarray database as unit of experiment which is consist of several individual gene expression profiles, search methods also have evolved into two way, experiment dataset level search and individual gene expression profile level search. most of experiment dataset level search methods are depend on dataset annotation by authors of dataset. atul b. et al. has been tried to classify the gene expression experiment dataset in geo by annotating each geo dataset with medical language terms such as umls and snomed and to make gene expression variation based dataset search possible. yuelin z. et al. built geometadb, which make text match based geo dataset search more affordable than original geo database. along the attempts to search large public microarray databases at experiment dataset level, individual gene expression profile level search method has also been conceptualized and developed. gest is the first implementation of individual profile level search method. it uses bayesian similarity metric to measure similarity between gene expression profiles. horton et al. devised fast similarity search algorithm and built web based similar gene expression search system, cellmontage. to make cross-platform gene expression profiles search possible, they transformed all gene expression profiles to unigene id based gene expression profiles, averaging expression values of genes for corresponding unigene id if multiple genes are mapped to a single unigene id, then measured similarity between expression profiles using spearman rank correlation coefficient. cell type classification as a validation of search power of cellmontage revealed that this method is good enough to search similar expression profiles from the same platform, but not from the different platform. here we try to improve similar gene expression profile search. for this purpose, we devised a pathway based gene expression similarity measuring method. our pathway based methods outperform conventional method especially for cross-platform and cross-experiment profile search. methods gene expression data we used set of gene expression profiles curated by cellmontage group. each gene expression profile in cellmontage dataset, originally stored in geo, is manually annotated with cell type and gene expression values of original profiles are averaged to represent expression values of corresponding unigene id. for the classification procedure, we first selected cell types with which at least two different platform types are associated. for each selected cell type, we select at most two gene expression profiles from each platform in the same experiment. after the selection procedure, total gene expression profiles of different cell types from different experiment with different platform types were remained. of these selected gene expression profiles, randomly selected one gene expression profile from each cell type was used as query profile and the other remaining profiles build up search database. finally, the numbers of gene expression profiles in the query set and the search database are and respectively. pathway data we used c database of msigdb as pathway data source for pathway summary profiling. each unigene id in gene expression profiles was mapped to corresponding gene symbol of pathways in msigdb using ncbi unigene database. pathway expression profiling each gene expression profile was converted to pathway centric expression profile by averaging expression values of genes for corresponding pathways. pathway expression for pathway k, consisted of n genes, is calculated by where gi denotes gene expression for gene i for i =..., n. gene expression similarity measurement we used two different scoring methods to measure similarity between gene expression profiles. the first method, conventional method used by cellmontage, compares common gene set between two comparing gene expression profiles. let this method call cgsep method. another method compares common pathway set between two comparing pathway expression profiles converted from gene expression profiles. to measure the similarity between gene or pathway expression profiles, we used spearman rank correlation test. spearman rank correlation coefficient between profile x and y is given by where di = xi-yi, i =..., n and xi, yi = rank of ith gene or pathway in each profile x and y. spearman rank correlation coefficient ranges from - to where similarity is maximum at and minimum at - cell type classification to evaluate the performance of similarity measuring methods, we conducted cell type classification using nearest neighbor classifier. for each of query gene expression profiles, the similarities to all of gene expression profiles in search database were calculated. then the profile with highest spearman rank correlation coefficient was predicted to have the same cell type to query profile. predicted profile was considered as correct prediction if its cell type is the same as that of query sample. if there is no same cell type profile in search database for a query profile, the search for the given query profile is not counted in classification accuracy assessment. accuracy of classification is calculated by number of correct predictions divided by number of predictions. similar profile search from the profiles of different platform or different experiment is harder than search from the profiles of the same platform or the same experiment. to evaluate the performance of pathway based similarity measuring method, we conducted two more cell type classifications, cross-platform and cross-experiment classification, where search space is consist of profiles whose platforms or experiments are different from that of query.  we conducted cell type classification using two different similarity measuring methods and access the performances with overall, cross-platform and cross-experiment search databases. barplot shown in figure summarizes all of the classification results. pathway based similarity measuring method, pepc, consistently shows higher classification accuracies than cgsep method for classifications with three different search databases. as an example cases, pathway based method, pepc, precisely classified cell types of query profile gsm of thalamus cell type with overall search database and query profile gsm of liver cell type with cross-platform search database while cgsep failed. pathway based method shows significant improvement when they were applied for cross-platform search database search as pepc excel cgsep with % increased accuracy. pathway based method also outperformed up to 10% over cgsep for cross-experiment search, however the improvement is not as significant as the cross-platform classification. we next calculated average similarity score of top scoring hit for correct and incorrect classification cases. average similarity score of correct cases is higher than incorrect cases except cross-platform search using cgsep method, in which cgsep shows only 10% classification accuracy. similarity scores for cross-platform search are lower than the other two classifications. this trend is cause by lower expression variations between expression profiles of the same type of platforms than that of different type of platforms. we analyzed further to figure out the reason for low classification accuracy of cross-experiment search. more specifically, our question is why cross-experiment searches show lower classification accuracy than that of cross-platform searches even though the similarity scores for top hits are higher than that of cross-platform searches. to answer this question, we divided cross-experiment search database more specifically into cross-experiment with the same platform profiles and cross-experiment with different platform profiles and conducted cell type classification with those two search databases. table summarizes the classification accuracy with average similarity scores for correct and incorrect cases for limited search databases. we found again improved classification accuracies with up to 40% higher accuracy compared to original cross-experiment search by pathway based method if cross-experiment search is limited to cross-platform, but this trend is disappeared in search over cross-experiment and the same platform search databases. the average similarity scores to the top hits of same platform top hits are higher than average similarity scores to the top hits of different platforms in cross-experiment search. even average similarity scores of incorrect cases with the same platform are higher than average similarity scores of correct cases with different platforms. therefore, the correct profiles of different platforms to the query profile might not score higher than incorrect profiles of the same platforms. this seemed to be the reason for low classification accuracy of cross-experiment search. considering this reason for low classification accuracy of cross-experiment search, different criteria to evaluate similarity score according to platform type could improve classification accuracy of cross-experiment search. reduced analytical dimension of pathway expression profiles from gene expression profiles might also contribute improved classification accuracy by pathway based methods. not all genes in gene expression profile are converted to pathway expression profile for the incompleteness of current pathway information. in case of query and profiles in search database used for cell type classification, average ± 15% genes of common gene set for cgsep method are made up common pathway expression profiles in pepc. however, the reduced gene expression dimension dose not reduces analytical sensitivity, rather it was reported that classification accuracy is decreased with the addition of feature genes over than the moderate number. likewise, reduced number of genes in the process of pathway expression profiling might increase analytical sensitivity by limiting analytical dimension under moderate size. we first attempted to use pathway information for gene expression similarity measurement. as previously developed pathway based gene expression analysis methods were successfully improve intact gene expression based analysis methods, pathway based similarity measuring method outperformed conventional method. along with the reduced analytical dimension effect described earlier, this improvement seems to be contributed by the averaging effect of expression variation of individual genes caused by both biological and technical reasons. each human gene do not express or is not detected to expressed constantly even under the same biological condition within a specific microarray platform or across different type of platforms, rather it fluctuates. on the other hands, pathway expression, an overall expression pattern of gene set, is robust toward subtle outside stimulation. the pathway based gene expression similarity measuring methods, pepc, we suggested here, compute pathway level expression by averaging expression of genes mapped to pathway. consequently, expression variations of multiple genes are summarized by a robust pathway expression, which represents the activity of the functional unit rather than a component of the unit, thus the pathway based methods result with higher classification accuracy, which demonstrates again that pathway level expression is more robust than individual gene level expression and pathway based similarity scoring methods could be successfully improve similar gene expression profile search.  we demonstrated that our new gene expression similarity measuring method improved the precision of similar gene expression profile search when it's applied to cell type classification. we showed pathway expression profiling based similarity measuring method outperformed conventional gene expression profile based similarity measuring method over at most 50% for cross-platform profile search and 10% for cross-experiment profile search. at the same time, the classification accuracy shows that the methods still need to be improved, especially for searching similar profiles across different experiment. we believe that our research shed new light on similar gene expression profile search over rapidly growing large microarray databases by showing that integrating gene expression profile with external data such as pathway could improve search accuracy. list of abbreviations used cgsep: common gene set expression profile; pepa: pathway expression profile for all gene set; pepc: pathway expression profile for common gene set. competing interests the authors declare that they have no competing interests. authors' contributions ck designed whole research process, implemented all required methods for the research, analyzed results, drafted and revised the manuscript. jhw devised similarity scoring algorithm with ck and revised the manuscript. wso and ktn helped the conceptualization of the research process. all authors read and approved the final manuscript. note other papers from the meeting have been published as part of bmc bioinformatics volume supplement 2009: eighth international conference on bioinformatics: bioinformatics, available online at http://www.biomedcentral.com/1471-2105/10?issue=s supplementary material additional file 1 dataset detail for cell type classification. all gene expression profiles used for cell type classification are listed with detailed information. each gene expression profile is annotated with three original geo accession id, sample id, experiment id and platform id, and cell type. click here for file acknowledgements this work was supported by grants from korea food & drug administration. this article has been published as part of bmc genomics volume supplement 2009: eighth international conference on bioinformatics: computational biology. the full contents of the supplement are available online at http://www.biomedcentral.com/1471-2164/10?issue=s 
gene expression similarity measuring methods were developed and applied to search rapidly growing public microarray databases. considering the fact that public microarray database is consist of gene expression profiles of various experiments with various type of platform, pathway based gene expression similarity measuring method could be successfully applied for searching large public microarray databases. 7– september asia pacific bioinformatics network eighth international conference on bioinformatics singapore we devised new gene expression similarity measuring method based on pathway information. to evaluate pathway based gene expression similarity measuring method, we conducted cell type classification test. especially, pathway based methods outperform at most 50% and 10% over conventional gene expression similarity method when search databases are limited to cross-platform profiles and cross-experiment profiles. the pathway based gene expression similarity measuring method outperforms commonly used similarity measuring methods. pathway based similarity measuring method shows higher classification accuracy. however, current expression similarity measuring methods need to be improved to accurately measure similarity between gene expression profiles from different platforms or different experiments. in short, newly devised method measure similarity between gene expression profiles after converting them into pathway based expression profiles.
 gene expression similarity measuring methods were developed and applied to search rapidly growing public microarray databases. however, current expression similarity measuring methods need to be improved to accurately measure similarity between gene expression profiles from different platforms or different experiments.  we devised new gene expression similarity measuring method based on pathway information. in short, newly devised method measure similarity between gene expression profiles after converting them into pathway based expression profiles. to evaluate pathway based gene expression similarity measuring method, we conducted cell type classification test. pathway based similarity measuring method shows higher classification accuracy. especially, pathway based methods outperform at most 50% and 10% over conventional gene expression similarity method when search databases are limited to cross-platform profiles and cross-experiment profiles.  the pathway based gene expression similarity measuring method outperforms commonly used similarity measuring methods. considering the fact that public microarray database is consist of gene expression profiles of various experiments with various type of platform, pathway based gene expression similarity measuring method could be successfully applied for searching large public microarray databases. 7– september asia pacific bioinformatics network eighth international conference on bioinformatics singapore 