BACKGROUND
large-scale genome sequencing projects have discovered many new proteins.
of all the proteins whose sequences are known, functions have been experimentally determined for only a small percentage  <cit> .
annotation of a genome involves assignment of functions to proteins in most cases on the basis of sequence similarity.
protein function assignments based on postulated homology as recognized by sequence identity or significant expectation value of alignment are used routinely in genome analysis.
over the past years, many computational methods  <cit>  have been developed to predict function through identifying sequence similarity between a protein of unknown function and one or more proteins with experimentally characterized or computationally predicted functions.
however, it is widely recognized that functional annotations should be transferred with caution, as the sequence similarity does not guarantee evolutionary or functional relationship.
in addition, if a protein is assigned an incorrect function in a database, the error could carry over to other proteins for which functions are inferred by sequence relationship to the protein with errant function assignment  <cit> .
despite the central role that sequence comparison programs play in functional annotation, a thorough analysis of the quality of methods based on a large-scale dataset has not been performed.
improvements in the sensitivity of sequence comparison algorithms have reached the point that proteins with previously undetectable sequence relationship, for instance with 10–15% identical residues, may be classified as similar  <cit> .
on the other hand, alignments are more likely to be correct for higher levels of pairwise sequence identity; and are less likely to be correct in the so-called "twilight zone", where the sequence similarity is low  <cit> .
an estimate of the expectation value of an alignment provides a good assessment for whether the two aligned proteins are homologous  <cit> .
nevertheless, prediction of protein function from sequence is a difficult problem, because not only sequence similarity does not guarantee homology, but also homologous proteins often have different functions  <cit> .
in particular, when two proteins are distantly related, there is no good indicator to reliably assess whether they are homologous or not.
figure  <dig> shows the number of unique orthologous pairs between the yeast saccharomyces cerevisiae and arabidopsis thaliana acquired from the website of clusters of orthologous groups of proteins   <cit> .
the cog pairs distribute in a broad range of sequence identity and expectation value.
it is clear that neither percentage of sequence identity nor expectation value can give a complete insight into the relationship between the two proteins.
towards this we wish to study the detailed quantitative relationship in terms of functions and relate it with sequence identity and expectation value intervals.
a number of studies in sequence-function relationship have been carried out.
shah et al.
<cit>  showed that many ec  classes could not be perfectly discriminated by sequence similarity at any threshold.
pawlowski et al.
<cit>  have studied the relation between sequence similarity and functional similarities based on the ec classification for the e. coli genome.
however, this study is limited only to within genome comparisons and lacks any analysis based on inter-genome comparisons.
devos et al.
<cit>  have studied the complexity in transferring function between similar sequences.
their study shows that binding site, keywords, and functional class annotations are less conserved than ec numbers, and all of them in turn are less conserved than protein structure.
wilson et al.
showed that percent identity in sequence alignment is more effective at quantifying functional conservation of their simple classification of scop domains than modern probabilistic scores  <cit> .
however, all these studies did not use a broad definition of functions for a systematic large-scale analysis.
in this paper, we will build a comprehensive and systematic benchmark for the sequence-function relationship using four model organisms  and controlled vocabularies of function annotation terms in the gene ontology  <cit>  from three different perspectives, i.e., biological process, molecular function, and cellular component.
<dig>
RESULTS
the sequence comparisons within and across the four genomes provide a global view on the relationship between sequence similarity and function similarity.
figure  <dig> shows a consistent correlation between function similarity of biological process at different go index levels and the expectation values  of sequence alignment using blast  <cit> .
there is also a higher functional similarity for the lower go index levels in comparison to the higher index levels.
in particular, at levels  <dig> and  <dig>  the function similarity reaches very high even when the sequence similarity is insignificant.
this is mainly due to the fact that many more genes can be found under a go index of lower level than of higher level, and hence, there is a higher chance for two randomly picked genes to share the go index at the lower level .
functional conservation measures from go annotations based on computational techniques such as electronic annotation based on sequence similarity has a behavioral pattern completely different from figures  <dig>   <dig> and  <dig>  when go biological process annotations are made based on evidences from experimental validations , such proteins tend to conserve and share functions with higher probability for pairs with high sequence identity as compared to pairs with remote sequence similarity.
in all cases, when a pair of proteins share sequence identity 30% or less, the chance for them to share any of the three go categories at high levels is about 50% or less.
however, this pattern is lost when annotations are made purely based on computational techniques  and the functions are conserved with almost equal probabilities irrespective of the sequence conservation.
this depicts the difference in the quality of these two annotations, and indicates that many annotations based on computational techniques may be incorrect.
some of these incorrect annotations could be due to over-extension of functional details when inferring a query protein from a protein hit with known function.
for example, a protein in two-component signal transduction system  could be predicted to cell surface receptor linked signal transduction , although both proteins are in signal transduction .
the trend stands true for both molecular function and cellular component .
we also compared the subloc predicted localizations for all the proteins across genomes.
figure  <dig> shows the localization similarity versus the sequence similarity in terms of e-value and percentage of sequence identity for intra-genome comparisons within four genomes.
in this case the localization is measured by five types as described in section  <dig> , instead of the go cellular component annotation, a detailed level that no existing software can predict reliably.
subcellular localization conservation shows similar results when compared in terms of e-value or sequence identity.
inter-genome comparisons based on the predicted subcellular localizations also behave in a manner similar to the intra-genome comparisons .
it is interesting to note that the behavior of the curves of the four genomes is similar in respect of e-value .
on the other hand, the behavior of the curves of the four genomes shows the difference in respect to the sequence identity , in particular, caenorrhabditis elegans shows significantly more divergence in localization under the same sequence identity than the other three genomes.
we also calculated functional similarity in terms of semantic similarity between the functional annotation terms of go  using blast.
figure  <dig> shows the relationship between semantic similarity and sequence identity for all four genomes combined for all three ontologies.
the semantic similarity measures remove the bias seen between different levels of indices of the ontology.
figure  <dig> shows the relationship between remote homologs using psi-blast  <cit>  and semantic similarity.
for many of the psi-blast pairs, the sequence identity is below 30%.
hence, we focus the sequence-function relationship based on e-value, instead of sequence identity.
we have also computed results as described above for any random pairs with known function annotation.
then, we calculated a normalized ratio of function similarity in terms of sequence identity by comparing the results in figures  <dig> through  <dig> against similar results from random pairs.
figure  <dig> shows the normalized ratio results for go biological process, molecular function and cellular component annotations in subplots a, b and c, respectively.
our results clearly show that the normalized ratio increases for higher sequence identity intervals as well as higher levels of shared go indices, highlighting the higher chance of functional conservation over randomly chosen pairs for these groups.
go annotations for index level  <dig> and above are very informative as the probability of correct functional assignment based on sequence similarity is significantly above random.
figure 10d shows normalized results for all three annotations using psi-blast in subplot d. it indicates that psi-blast has substantial enrichment of function assignment for function prediction.
this may be because psi-blast utilizes multiple sequence profiles that enhance the recognition of the sequence-function relationship.
<dig>
CONCLUSIONS
it has been long recognized that genome annotations using computational methods produce many false function assignments.
many of these methods have been applied to function prediction.
they often provide valuable hypotheses, but none are perfect.
as a result, it is known that many databases contain incorrect function assignments, and these erroneous assignments propagate from one database to another.
nevertheless, up until now there has been no systematic study for this critical issue.
the question whether two proteins are functionally similar is very complex to answer.
function is a very complex notion involving many different aspects including chemical, biochemical, cellular, organism mediated, and developmental processes.
qualitatively it is expected that with higher sequence similarity, the two proteins are more likely to have related functions.
however, quantitatively the relationship between function similarity at the different categories and sequence similarity has not been studied deeply.
such a quantitative study is fundamentally important, as it can provide assessment of gene function prediction quality and insights into the underlying mechanisms of new evolving functions through changes in sequence  <cit> .
our study confirms that sequence comparison often provides good suggestions for gene functions or related functions.
these suggestions serve as useful hypotheses for further experimental work to confirm, refine or refute the predictions.
such a process can substantially increase the speed of biological knowledge discovery.
on the other hand, when assigning function based purely on similarity to proteins of known function , it is important to be aware of incomplete or wrong annotations.
given the value of computational function annotation, our study also shows that a significant portion of gene annotations of biological process, molecular function, and cellular component based solely on sequence similarity, in particular, when the sequence similarity is low, are unreliable.
our study also provides a numerical benchmark for the extent to which one can trust computational annotation.
it is possible that a confidence score can be derived from our study for any annotation based on sequence similarity.
with this score in the annotation file, the user can have a better insight about the quality of the annotations.
furthermore, our analyses highlights the different sequence-function relationships identified from blast versus psi-blast, sequence identity versus expectation value, go indices versus semantic similarity approaches and within genome versus between genome comparisons, for the three go classification types.
there are some limitations in our current study.
our study can only reflect certain aspect of protein function.
protein function variations may result from factors other than sequence, such as alternative splicing and post-translational modification, and our method does not address these factors.
another limitation is that when we assess gene function prediction, we only consider one hit at a time in a database.
in many cases, sequence comparison yields multiple hits for one query protein and these hits may have different functions.
in our future study, we will develop a new method to assess the function prediction for a query protein by combining the functions of multiple hits while considering the dependence among these functions and the e-values of the hits.
<dig>  methods
<dig>  protein sequence databases
we selected the genomes of arabidopsis thaliana, saccharomyces cerevisiae, caenorrhabditis elegans and drosophila melanogaster for the study.
all four genomes are well-studied model organisms in eukaryotes.
the complete set of arabidopsis thaliana protein sequences for  <dig>  orfs was acquired from the arabidopsis information resource   <cit> .
we also obtained proteins sequences for  <dig>  caenorrhabditis elegans orfs,  <dig> saccharomyces cerevisiae orfs and  <dig>  drosophila melanogaster orfs from ncbi  <cit> .
table  <dig> lists the number of orfs for all the four genomes whose functions are annotated based on experimental evidences or sequence similarity measures for all the three functional categories.
<dig>  protein functional classification
the gene ontology  functional classification  <cit>  has three functional categories, i.e., biological process, molecular function and cellular component.
it is not a hierarchical tree but the directed acyclic nature of the graph can be well captured in a series of numerical numbers.
we have generated a numerical go index for all three classifications individually, which represents the structure of every ontology.
the deepest level of index is  <dig>  a go index, as denoted by numbers, e.g.
1-4-2- <dig>  characterizes the function of every protein.
the first number corresponds to the type of functional category, e.g.
<dig> represents biological process,  <dig> represents molecular function and  <dig> represents cellular component.
the subsequent numbers correspond to subcategories describing the type of function or localization in increasing detail.
the higher the go index level, the more specific is the functional category the protein belongs to.
table  <dig> shows an example of go indices.
we assume that the functional relationship between two proteins is reflected by the number of index levels that they share.
we have demonstrated the usefulness of such an assumption in our early studies for gene function prediction  <cit> .
we acquired the go annotations for all the genes in the four genomes and for the three functional categories from go website  <cit> .
a gene can  belong to multiple indices at various levels in the graph, as proteins may be involved in multiple functions in a cell.
different indices could correspond to the same go term as well.
gene ontology annotation is based on various evidences to annotate functional categories.
towards quality control, all the plots  presented in this paper are based on the annotations with actual experimental evidences such as ida , iep , igi , imp , ipi , rca  and tas .
we performed some comparisons using annotations assigned purely based on computational methods such as iss  and iea , but the plots are not presented here.
we have removed the functional annotations that were purely based on evidences such as nd  and nas  and level  <dig>  and will have functional similarity equal to  <dig>  the functional similarity defined this way can assume values from  <dig> to  <dig>
we also calculate functional similarity in terms of semantic similarity between the go functional annotation terms  <cit> .
an example of calculating the probabilities is shown in figure  <dig>  to calculate semantic similarity between the protein pairs, the probability of each term assigned to the gene product is first derived.
for each gene in the organism, the probability is calculated by counting the number of the descendants of an assigned go term plus  <dig> , divided by the total number of go term annotations in the organism.
the probability of each node increases as we go towards the root of the go ontology, which is defined as "biological process" , "molecular function"  or "cellular component"  in the three ontologies and has a probability of  <dig>  the semantic similarity between ontology terms is defined as:
ss  = -ln pms
where, pms is the probability of the minimum subsumer for terms t <dig> and t <dig>  the minimum subsumer for terms t <dig> and t <dig> is defined as the common parent of the deepest go index level shared by t <dig> and t <dig>
<dig>  protein subcellular localization
the subcellular distribution of proteins within a proteome is useful and important to a global understanding of the molecular mechanisms of a cell.
protein localization can be seen as an indicator of its function.
localization data can be used as a means of evaluating protein information inferred from other resources.
furthermore, the subcellular localization of a protein often reveals its activity mechanism.
the subcellular localization information was predicted using subloc  <cit> .
the five main subcellular localization categories as predicted by subloc are cytoplasmic, nuclear, mitochondrial, transmembrane, and extracellular.
the total numbers of proteins with predicted subcellular localization are  <dig> in saccharomyces cerevisiae,  <dig>  in arabidopsis thaliana,  <dig>  in caenorrhabditis elegans, and  <dig>  in drosophila melanogaster.
it is worth mentioning that the subcellular localization predictions were not based on sequence similarity.
<dig>  protein sequence similarity search
the sequence similarity search was done using tools such as blast  <cit> , fasta  <cit>  and psi-blast  <cit> .
blast is the most widely used sequence comparison tool, particularly for genome annotation.
fasta is more sensitive in accuracy but slower than blast.
both fasta and blast were developed for pairwise local alignment, with heuristics used.
psi-blast is used to identify remote homology based on iterative blast searches.
we compared the sequences for within as well as between genome sequence similarities.
each protein sequence was compared against the complete set of proteins for the same genome for within genome comparisons.
for between genome comparisons, a pair of similar protein pair was identified using the reciprocal search method  <cit> , i.e., the two proteins in the pair are the best hits in each other's genome from sequence search.
intra-genome sequence comparison would reflect the sequence similarity between the paralogs; while the inter-genome comparison would partially highlight the orthologous sequence similarities.
to assess the significance of a sequence comparison, an expectation value or e-value can be calculated.
this value represents the number of different alignments with the observed alignment score or better that are expected to occur in the database search simply by chance.
the e-value is a widely accepted measure for assessing potential biological relationship, as it is an indicator of the probability for finding the match by chance.
smaller e-values represent more likelihood of having an underlying biological relationship.
in this study, we will use both e-value and sequence identity as parameters to quantify sequence similarity.
on the other hand, e-values depend on a number of computational factors, such as the length of the query protein and the size of search database.
the issues prevent the e-value from being a reliable indicator for homology, as addressed in fig.
<dig> and related discussions.
<dig>  availability
the data and results are publicly available at our website  <cit> .
authors' contributions
tj contributed in the data collection, sequence alignments and generation and analysis of the results.
both tj and dx contributed in the formulation, design and writing of the study.
both authors read and approved the final manuscript.

 large-scale genome sequencing projects have discovered many new proteins. of all the proteins whose sequences are known, functions have been experimentally determined for only a small percentage. annotation of a genome involves assignment of functions to proteins in most cases on the basis of sequence similarity. protein function assignments based on postulated homology as recognized by sequence identity or significant expectation value of alignment are used routinely in genome analysis. over the past years, many computational methods have been developed to predict function through identifying sequence similarity between a protein of unknown function and one or more proteins with experimentally characterized or computationally predicted functions. however, it is widely recognized that functional annotations should be transferred with caution, as the sequence similarity does not guarantee evolutionary or functional relationship. in addition, if a protein is assigned an incorrect function in a database, the error could carry over to other proteins for which functions are inferred by sequence relationship to the protein with errant function assignment. despite the central role that sequence comparison programs play in functional annotation, a thorough analysis of the quality of methods based on a large-scale dataset has not been performed. improvements in the sensitivity of sequence comparison algorithms have reached the point that proteins with previously undetectable sequence relationship, for instance with 10–15% identical residues, may be classified as similar. on the other hand, alignments are more likely to be correct for higher levels of pairwise sequence identity; and are less likely to be correct in the so-called "twilight zone", where the sequence similarity is low. an estimate of the expectation value of an alignment provides a good assessment for whether the two aligned proteins are homologous. nevertheless, prediction of protein function from sequence is a difficult problem, because not only sequence similarity does not guarantee homology, but also homologous proteins often have different functions. in particular, when two proteins are distantly related, there is no good indicator to reliably assess whether they are homologous or not. figure shows the number of unique orthologous pairs between the yeast saccharomyces cerevisiae and arabidopsis thaliana acquired from the website of clusters of orthologous groups of proteins. the cog pairs distribute in a broad range of sequence identity and expectation value. it is clear that neither percentage of sequence identity nor expectation value can give a complete insight into the relationship between the two proteins. towards this we wish to study the detailed quantitative relationship in terms of functions and relate it with sequence identity and expectation value intervals. a number of studies in sequence-function relationship have been carried out. shah et al. showed that many ec classes could not be perfectly discriminated by sequence similarity at any threshold. pawlowski et al. have studied the relation between sequence similarity and functional similarities based on the ec classification for the e. coli genome. however, this study is limited only to within genome comparisons and lacks any analysis based on inter-genome comparisons. devos et al. have studied the complexity in transferring function between similar sequences. their study shows that binding site, keywords, and functional class annotations are less conserved than ec numbers, and all of them in turn are less conserved than protein structure. wilson et al. showed that percent identity in sequence alignment is more effective at quantifying functional conservation of their simple classification of scop domains than modern probabilistic scores. however, all these studies did not use a broad definition of functions for a systematic large-scale analysis. in this paper, we will build a comprehensive and systematic benchmark for the sequence-function relationship using four model organisms and controlled vocabularies of function annotation terms in the gene ontology from three different perspectives, i.e., biological process, molecular function, and cellular component.  the sequence comparisons within and across the four genomes provide a global view on the relationship between sequence similarity and function similarity. figure shows a consistent correlation between function similarity of biological process at different go index levels and the expectation values of sequence alignment using blast. there is also a higher functional similarity for the lower go index levels in comparison to the higher index levels. in particular, at levels and the function similarity reaches very high even when the sequence similarity is insignificant. this is mainly due to the fact that many more genes can be found under a go index of lower level than of higher level, and hence, there is a higher chance for two randomly picked genes to share the go index at the lower level. functional conservation measures from go annotations based on computational techniques such as electronic annotation based on sequence similarity has a behavioral pattern completely different from figures and when go biological process annotations are made based on evidences from experimental validations, such proteins tend to conserve and share functions with higher probability for pairs with high sequence identity as compared to pairs with remote sequence similarity. in all cases, when a pair of proteins share sequence identity 30% or less, the chance for them to share any of the three go categories at high levels is about 50% or less. however, this pattern is lost when annotations are made purely based on computational techniques and the functions are conserved with almost equal probabilities irrespective of the sequence conservation. this depicts the difference in the quality of these two annotations, and indicates that many annotations based on computational techniques may be incorrect. some of these incorrect annotations could be due to over-extension of functional details when inferring a query protein from a protein hit with known function. for example, a protein in two-component signal transduction system could be predicted to cell surface receptor linked signal transduction, although both proteins are in signal transduction. the trend stands true for both molecular function and cellular component. we also compared the subloc predicted localizations for all the proteins across genomes. figure shows the localization similarity versus the sequence similarity in terms of e-value and percentage of sequence identity for intra-genome comparisons within four genomes. in this case the localization is measured by five types as described in section, instead of the go cellular component annotation, a detailed level that no existing software can predict reliably. subcellular localization conservation shows similar results when compared in terms of e-value or sequence identity. inter-genome comparisons based on the predicted subcellular localizations also behave in a manner similar to the intra-genome comparisons. it is interesting to note that the behavior of the curves of the four genomes is similar in respect of e-value. on the other hand, the behavior of the curves of the four genomes shows the difference in respect to the sequence identity, in particular, caenorrhabditis elegans shows significantly more divergence in localization under the same sequence identity than the other three genomes. we also calculated functional similarity in terms of semantic similarity between the functional annotation terms of go using blast. figure shows the relationship between semantic similarity and sequence identity for all four genomes combined for all three ontologies. the semantic similarity measures remove the bias seen between different levels of indices of the ontology. figure shows the relationship between remote homologs using psi-blast and semantic similarity. for many of the psi-blast pairs, the sequence identity is below 30%. hence, we focus the sequence-function relationship based on e-value, instead of sequence identity. we have also computed results as described above for any random pairs with known function annotation. then, we calculated a normalized ratio of function similarity in terms of sequence identity by comparing the results in figures through against similar results from random pairs. figure shows the normalized ratio results for go biological process, molecular function and cellular component annotations in subplots a, b and c, respectively. our results clearly show that the normalized ratio increases for higher sequence identity intervals as well as higher levels of shared go indices, highlighting the higher chance of functional conservation over randomly chosen pairs for these groups. go annotations for index level and above are very informative as the probability of correct functional assignment based on sequence similarity is significantly above random. figure 10d shows normalized results for all three annotations using psi-blast in subplot d. it indicates that psi-blast has substantial enrichment of function assignment for function prediction. this may be because psi-blast utilizes multiple sequence profiles that enhance the recognition of the sequence-function relationship.  it has been long recognized that genome annotations using computational methods produce many false function assignments. many of these methods have been applied to function prediction. they often provide valuable hypotheses, but none are perfect. as a result, it is known that many databases contain incorrect function assignments, and these erroneous assignments propagate from one database to another. nevertheless, up until now there has been no systematic study for this critical issue. the question whether two proteins are functionally similar is very complex to answer. function is a very complex notion involving many different aspects including chemical, biochemical, cellular, organism mediated, and developmental processes. qualitatively it is expected that with higher sequence similarity, the two proteins are more likely to have related functions. however, quantitatively the relationship between function similarity at the different categories and sequence similarity has not been studied deeply. such a quantitative study is fundamentally important, as it can provide assessment of gene function prediction quality and insights into the underlying mechanisms of new evolving functions through changes in sequence. our study confirms that sequence comparison often provides good suggestions for gene functions or related functions. these suggestions serve as useful hypotheses for further experimental work to confirm, refine or refute the predictions. such a process can substantially increase the speed of biological knowledge discovery. on the other hand, when assigning function based purely on similarity to proteins of known function, it is important to be aware of incomplete or wrong annotations. given the value of computational function annotation, our study also shows that a significant portion of gene annotations of biological process, molecular function, and cellular component based solely on sequence similarity, in particular, when the sequence similarity is low, are unreliable. our study also provides a numerical benchmark for the extent to which one can trust computational annotation. it is possible that a confidence score can be derived from our study for any annotation based on sequence similarity. with this score in the annotation file, the user can have a better insight about the quality of the annotations. furthermore, our analyses highlights the different sequence-function relationships identified from blast versus psi-blast, sequence identity versus expectation value, go indices versus semantic similarity approaches and within genome versus between genome comparisons, for the three go classification types. there are some limitations in our current study. our study can only reflect certain aspect of protein function. protein function variations may result from factors other than sequence, such as alternative splicing and post-translational modification, and our method does not address these factors. another limitation is that when we assess gene function prediction, we only consider one hit at a time in a database. in many cases, sequence comparison yields multiple hits for one query protein and these hits may have different functions. in our future study, we will develop a new method to assess the function prediction for a query protein by combining the functions of multiple hits while considering the dependence among these functions and the e-values of the hits. methods protein sequence databases we selected the genomes of arabidopsis thaliana, saccharomyces cerevisiae, caenorrhabditis elegans and drosophila melanogaster for the study. all four genomes are well-studied model organisms in eukaryotes. the complete set of arabidopsis thaliana protein sequences for orfs was acquired from the arabidopsis information resource. we also obtained proteins sequences for caenorrhabditis elegans orfs, saccharomyces cerevisiae orfs and drosophila melanogaster orfs from ncbi. table lists the number of orfs for all the four genomes whose functions are annotated based on experimental evidences or sequence similarity measures for all the three functional categories. protein functional classification the gene ontology functional classification has three functional categories, i.e., biological process, molecular function and cellular component. it is not a hierarchical tree but the directed acyclic nature of the graph can be well captured in a series of numerical numbers. we have generated a numerical go index for all three classifications individually, which represents the structure of every ontology. the deepest level of index is a go index, as denoted by numbers, e.g. 1-4-2- characterizes the function of every protein. the first number corresponds to the type of functional category, e.g. represents biological process, represents molecular function and represents cellular component. the subsequent numbers correspond to subcategories describing the type of function or localization in increasing detail. the higher the go index level, the more specific is the functional category the protein belongs to. table shows an example of go indices. we assume that the functional relationship between two proteins is reflected by the number of index levels that they share. we have demonstrated the usefulness of such an assumption in our early studies for gene function prediction. we acquired the go annotations for all the genes in the four genomes and for the three functional categories from go website. a gene can belong to multiple indices at various levels in the graph, as proteins may be involved in multiple functions in a cell. different indices could correspond to the same go term as well. gene ontology annotation is based on various evidences to annotate functional categories. towards quality control, all the plots presented in this paper are based on the annotations with actual experimental evidences such as ida, iep, igi, imp, ipi, rca and tas. we performed some comparisons using annotations assigned purely based on computational methods such as iss and iea, but the plots are not presented here. we have removed the functional annotations that were purely based on evidences such as nd and nas and level and will have functional similarity equal to the functional similarity defined this way can assume values from to we also calculate functional similarity in terms of semantic similarity between the go functional annotation terms. an example of calculating the probabilities is shown in figure to calculate semantic similarity between the protein pairs, the probability of each term assigned to the gene product is first derived. for each gene in the organism, the probability is calculated by counting the number of the descendants of an assigned go term plus, divided by the total number of go term annotations in the organism. the probability of each node increases as we go towards the root of the go ontology, which is defined as "biological process", "molecular function" or "cellular component" in the three ontologies and has a probability of the semantic similarity between ontology terms is defined as: ss = -ln pms where, pms is the probability of the minimum subsumer for terms t and t the minimum subsumer for terms t and t is defined as the common parent of the deepest go index level shared by t and t protein subcellular localization the subcellular distribution of proteins within a proteome is useful and important to a global understanding of the molecular mechanisms of a cell. protein localization can be seen as an indicator of its function. localization data can be used as a means of evaluating protein information inferred from other resources. furthermore, the subcellular localization of a protein often reveals its activity mechanism. the subcellular localization information was predicted using subloc. the five main subcellular localization categories as predicted by subloc are cytoplasmic, nuclear, mitochondrial, transmembrane, and extracellular. the total numbers of proteins with predicted subcellular localization are in saccharomyces cerevisiae, in arabidopsis thaliana, in caenorrhabditis elegans, and in drosophila melanogaster. it is worth mentioning that the subcellular localization predictions were not based on sequence similarity. protein sequence similarity search the sequence similarity search was done using tools such as blast, fasta and psi-blast. blast is the most widely used sequence comparison tool, particularly for genome annotation. fasta is more sensitive in accuracy but slower than blast. both fasta and blast were developed for pairwise local alignment, with heuristics used. psi-blast is used to identify remote homology based on iterative blast searches. we compared the sequences for within as well as between genome sequence similarities. each protein sequence was compared against the complete set of proteins for the same genome for within genome comparisons. for between genome comparisons, a pair of similar protein pair was identified using the reciprocal search method, i.e., the two proteins in the pair are the best hits in each other's genome from sequence search. intra-genome sequence comparison would reflect the sequence similarity between the paralogs; while the inter-genome comparison would partially highlight the orthologous sequence similarities. to assess the significance of a sequence comparison, an expectation value or e-value can be calculated. this value represents the number of different alignments with the observed alignment score or better that are expected to occur in the database search simply by chance. the e-value is a widely accepted measure for assessing potential biological relationship, as it is an indicator of the probability for finding the match by chance. smaller e-values represent more likelihood of having an underlying biological relationship. in this study, we will use both e-value and sequence identity as parameters to quantify sequence similarity. on the other hand, e-values depend on a number of computational factors, such as the length of the query protein and the size of search database. the issues prevent the e-value from being a reliable indicator for homology, as addressed in fig. and related discussions. availability the data and results are publicly available at our website. authors' contributions tj contributed in the data collection, sequence alignments and generation and analysis of the results. both tj and dx contributed in the formulation, design and writing of the study. both authors read and approved the final manuscript. 
we present an analysis of the relationship between sequence similarity and function similarity for the proteins in four model organisms, i.e., arabidopsis thaliana, saccharomyces cerevisiae, caenorrhabditis elegans, and drosophila melanogaster. various sequence-function relationships were identified from blast versus psi-blast, sequence identity versus expectation value, go indices versus semantic similarity approaches, and within genome versus between genome comparisons, for the three go categories. however, sequence comparison may lead to creation and propagation of function assignment errors. thus, it is important to perform a thorough analysis for the quality of sequence-based function assignment using large-scale data in a systematic way. using a measure of functional similarity based on the three categories of gene ontology classifications, we quantified the correlation between functional similarity and sequence similarity measured by sequence identity or statistical significance of the alignment and compared such a correlation against randomly chosen protein pairs. our study provides a benchmark to estimate the confidence in assignment of functions purely based on sequence similarity. comparative sequence analysis is considered as the first step towards annotating new proteins in genome annotation.
 comparative sequence analysis is considered as the first step towards annotating new proteins in genome annotation. however, sequence comparison may lead to creation and propagation of function assignment errors. thus, it is important to perform a thorough analysis for the quality of sequence-based function assignment using large-scale data in a systematic way.  we present an analysis of the relationship between sequence similarity and function similarity for the proteins in four model organisms, i.e., arabidopsis thaliana, saccharomyces cerevisiae, caenorrhabditis elegans, and drosophila melanogaster. using a measure of functional similarity based on the three categories of gene ontology classifications, we quantified the correlation between functional similarity and sequence similarity measured by sequence identity or statistical significance of the alignment and compared such a correlation against randomly chosen protein pairs.  various sequence-function relationships were identified from blast versus psi-blast, sequence identity versus expectation value, go indices versus semantic similarity approaches, and within genome versus between genome comparisons, for the three go categories. our study provides a benchmark to estimate the confidence in assignment of functions purely based on sequence similarity. 