BACKGROUND
cancer is an extremely heterogeneous disease that is induced by mutations or other alterations in many genes  <cit> .
identification of genes that are causally implicated in oncogenesis is of basic importance for predicting novel cancer genes  <cit> , and studying their evolutionary conservation  <cit> , biological network features  <cit>  and functions  <cit> .
it can also provide valuable biomarkers for cancer diagnosis and drug development  <cit> .
until now, hundreds of cancer genes that have been found in small-scale experiments have been collected in various databases such as cancer gene census   <cit> , online mendelian inheritance in man   <cit> , and many others  <cit> .
recently, by high-throughput somatic mutational screening of cancer genomes  <cit> , hundreds of new cancer genes that carry driver mutations are being identified rapidly.
these increasingly abundant data provide us with an excellent opportunity to understand the underlying complex mechanisms of oncogenesis.
nevertheless, we face new challenges to interpret and apply these abundant yet diverse data sources efficiently.
in particular, it is important to evaluate the consistency and reliability of the information from different data sources.
in this work, we analyzed six lists of cancer genes separately from six major databases  <cit>  and two lists of candidate cancer genes identified by two types of high-throughput techniques  <cit> .
first, we showed that these gene lists were highly inconsistent in terms of overlapping genes, which reflected partially their various types of cancer and mutations.
in particular, most cancer genes accumulated in small-scale experiments could not be reproduced in current high-throughput mutational screening of cancer genomes, even when comparing cancer type-specific genes.
this suggests that the sample sizes used in the small-scale studies or high-throughput genome screening might have been too small to capture consistently genes that are causally related to cancers with extremely heterogeneous genetic mechanisms.
on the other hand, various gene lists might capture separately different genes in a few functional pathways that are related to human cancer  <cit> .
based on protein-protein interaction  data, we introduced the pogf  metric to evaluate the functional consistency of gene lists, and found that most of them were actually highly functionally consistent.
specifically, most cancer genes accumulated in previous small-scale studies could be functionally reproduced in current high-throughput studies.
the cgc database is the most widely utilized cancer gene data source  <cit> , therefore, we used it as a benchmark for evaluating and selecting functionally consistent cancer genes from other data sources.
we found that the selected genes were more significantly enriched in cancer pathways than the rest of the genes.
finally, we developed the database f-census for collecting functionally consistent cancer genes from various data sources http://bioinfo.hrbmu.edu.cn/fcensus/.
methods
cancer gene lists
we analyzed six databases of cancer genes whose alterations might play causative roles in carcinogenesis .
we also analyzed a list of  <dig> cancer genes provided by mutational screening in cancer genomes for four cancer types  <cit>  and another list of  <dig> cancer genes identified by retroviral insertional mutagenesis screening  <cit> .
http://rtcgd.ncifcrf.gov
note: *the numbers of genes compiled in the original datasets; **the numbers of genes with ppi data.
a cancer genes were extracted from omim as did in  <cit> .
b cancer genes from two reviews which are collected in the cancergenes database  <cit> .
ppi and gene ontology  data
the ppi data were derived from the human protein reference database   <cit> , which contains  <dig>  <dig> interactions that involve  <dig> proteins after removing self-interactions, including  <dig>  <dig> interactions between  <dig> proteins derived from high-throughput yeast two-hybrid experiments.
the go annotation data  <cit>  were downloaded on september  <dig>   <dig>
evaluating the consistency of gene lists by pog scores
the pog  metric was used to evaluate the consistency of two gene lists  <cit> .
if list  <dig> with length l <dig> and list  <dig> with length l <dig> have m overlapping genes, then the score from list  <dig> to list  <dig> is pog <dig> = m/l <dig> and the score from list  <dig> to list  <dig> is pog <dig> = m/l <dig>  to reduce the effect of list lengths on the pog scores, we also calculated the normalized scores as follows  <cit> :
where e and e are the pog scores expected by random chance, which are estimated separately as the average of the scores for  <dig>  <dig> pairs of gene lists  extracted randomly from the human genome.
evaluating the functional consistency of gene lists at the network level
we proposed to evaluate the functional consistency of two gene lists by taking into account functionally similar genes between the lists.
first, a gene was defined to be functionally similar to a gene list if its ppi links to the genes in the list were significantly more than expected by random chance .
here, a ppi link between two genes means that the two genes interact with each other or share at least one neighbour in the ppi network  <cit> .
suppose a gene has k ppi links to the m genes in a list, then the probability of observing at least k links by random chance can be calculated by the hypergeometric probability model:
where n is the number of all the possible links between this gene and other genes in the ppi network, and n is the observed number.
then, we proposed the pogf score between gene list  <dig> with length l <dig> and list  <dig> with length l <dig> as follows:
where o is the number of genes shared by the two lists, and of <dig>  is the number of genes in list  <dig>  not shared by but functionally similar to genes in list  <dig> .
to remove the effect of list lengths, we normalized the pogf scores for the two lists as follows  <cit> :
where e and e are the scores expected by random chance for two gene lists , which are estimated separately as the average of the scores of  <dig>  <dig> pairs of gene lists  extracted randomly from all the genes in the ppi network.
statistical significance of a consistency score
to evaluate the significance of an observed pog  score between two lists , we selected randomly a pair of gene lists  and calculated the score by the same method.
this process was repeated  <dig>  <dig> times.
the significance  of the score was calculated as the percentage of the random scores that were larger than the observed score.
the p value of a npog or npogf score is the same as that of the corresponding pog or pogf score because the e or e that is used to normalize the pog or pogf score is a constant  <cit> .
selecting functionally consistent cancer genes
the cgc database comprises cancer genes with relatively stringent criteria.
therefore, we filtered other gene lists according to their functional similarity to the genes included in the cgc database.
a gene was selected if its functional links to genes from cgc were significantly more than expected by random chance, with the p value calculated by formula  and corrected by the fdr control  <cit> .
then, for the selected genes and the remaining ones, respectively, we calculated the probabilities of their enrichment in each of the  <dig> cancer pathways described in the cancer cell map database  <cit> , by the hypergeometric distribution model.
RESULTS
consistency between gene lists in terms of gene overlapping
cgc is the most widely utilized cancer gene data source in various applications  <cit> , therefore, we used it as a baseline for the comparison.
the pog  score from reviews to cgc was  <dig>   and  <dig>   from cgc to reviews.
however, as shown in figure 1a, most other gene lists were highly inconsistent with cgc.
the pog  score from omim to cgc was  <dig>   and  <dig>   in the other direction.
notably, 55% of the genes in cgc were labelled with leukaemia/lymphoma, whereas only about 21% of the genes in omim were associated with this cancer.
the pog  score from agcoh to cgc was  <dig>   and  <dig>   from cgc to agcoh.
among the  <dig> genes shared by these two databases,  <dig>  were associated with haematological cancer.
the pog  score from tgdbs to cgc was  <dig>   and  <dig>   from cgc to tgdbs, which only included genes discovered in six epithelial cancer types.
tsgdb only included tumor suppressor genes, therefore, the pog  score from it to cgc was only  <dig>   and  <dig>   in the other direction.
the above results showed that these lists of cancer genes were highly inconsistent in terms of gene overlapping.
however, all the observed pog and npog scores were significantly larger than the scores expected by random chance .
functional consistency between gene lists
although different gene lists are inconsistent in terms of overlapping genes, they could each capture different genes in the same pathways associated with cancer.
for example, as shown in figure  <dig>  different lists of cancer genes covered various genes in the wnt and egrf <dig> pathways.
next, we evaluated the functional consistency of the gene lists based on the pogf  scores.
as shown in figure 1a , the pogf  scores from reviews, omim, agcoh, tgdbs and tsgdb to cgc were  <dig>  ,  <dig>  ,  <dig>  ,  <dig>   and  <dig>  , respectively.
in another direction, the pogf  scores from cgc to the other lists were as high as  <dig>  ,  <dig>  ,  <dig>  ,  <dig>   and  <dig>  .
from tgdbs to cgc, although the pog  score was only  <dig>  , the pogf  score was as high as  <dig>  , which indicated that the genes in tgdbs shared similar functions with those in cgc.
another impressive result was that the pogf  score from tsgdb to cgc was as high as  <dig>   and  <dig>   in the other direction, although the corresponding pog  scores were very low.
all the observed pogf and npogf scores were statistically significant .
consistency of gene lists discovered in low- and high-throughput studies
we used the l-list for the  <dig> distinct genes extracted from the six databases that contained cancer genes discovered in small-scale studies, and the h-list for the  <dig> cancer genes identified by mutational screening for four cancer types  <cit> .
from the l-list to the h-list, the pog  score was as low as  <dig>  , which indicated that most cancer genes accumulated in the small-scale studies were not rediscovered in the high-throughput data.
from the h-list to the l-list, the score was a little larger, but still low, at  <dig>  , which indicated that the high-throughput screening studies could find only a small fraction of all cancer genes.
for each of the four cancer types, the consistency of the sub-lists of cancer genes extracted from the l-list and h-list was also very low .
note: a the number of cancer genes with ppi data for the low- and high-throughput data.
all the scores are statistically significant .
on the other hand, the pogf  score from the l-list to the h-list was  <dig>   and  <dig>   in the other direction.
thus, functionally, cancer genes found in small-scale experiments were consistent with those found in the high-throughput studies.
as shown in table  <dig>  from the sub-lists of cancer genes discovered by the genome screening to the sub-lists of cancer genes discovered in small-scale experiments for breast, colon and pancreatic cancers, and glioblastoma, the pogf  scores were as high as  <dig>  ,  <dig>  ,  <dig>   and  <dig>  , respectively.
in the other direction, the pogf  scores were much lower, which were  <dig>  ,  <dig>  ,  <dig>   and  <dig>   for the four cancer types, respectively.
thus, for each cancer type, the cancer genes discovered by the genome screening might cover more functions of cancer genomes than the cancer genes accumulated from small-scale experiments.
we used the r-list for the  <dig> cancer genes indentified by the high-throughput retroviral insertional mutagenesis screening.
as shown in figure 2b, the pog  scores from the r-list to the l-list were  <dig>   and  <dig>   in the other direction.
however, the pogf  scores were as high as  <dig>   and  <dig>   in the two directions, respectively.
these results were similar to those for the h-list.
the pog  score from the r-list to the h-list was only  <dig>   and  <dig>   in the other direction.
the pogf  scores in the two directions were  <dig>   and  <dig>  , respectively, which suggested that these two lists of cancer genes were less functionally overlapped.
cancer genes selected by functional consistency and the f-census database
even at the functional level, some inconsistency still existed between cgc and other databases.
therefore, we selected genes from other lists according to their functional similarity to genes in the cgc database.
with fdr 1% and fdr 5%, respectively,  <dig> and  <dig> genes were selected.
as shown in table  <dig>  in most of the  <dig> cancer-related pathways from cancer cell map, the selected genes were significantly enriched , whereas the remaining genes were not .
in these pathways, most ratios of the selected genes to the other genes were > <dig>  which supports the hypothesis that the selected genes are more likely to be cancer-associated.
note: a the number of genes in the pathway;* the p value of the enrichment of the selected genes; ** the p value of the enrichment of the rest cancer genes; *** inf means none of the rest genes are annotated in the pathway.
based on the above results, we have developed a database named f-census for extracting functionally consistent cancer genes from different data sources.
this database is available at http://bioinfo.hrbmu.edu.cn/fcensus/.
using this database, users can extract cancer genes from several databases to obtain their union and intersection gene sets, thus providing information about cancer genes, such as their type , their occurrence in different cancers, and their mutation frequencies estimated from the high-throughput studies.
also, the users can obtain the cancer gene list pre-selected by our criteria based on their functional similarity to genes in cgc.
the users can upload a list of candidate genes and prioritize the genes in the list according to their functional similarity to cancer genes in cgc.
finally, the users can look up the functional categories enriched with cancer genes from various cancer gene lists .
discussion
in this study, we showed that current cancer gene data sources were highly inconsistent in terms of gene overlapping.
this suggested that the sample sizes used in either the small-scale studies or high-throughput genome screening might be too small to provide enough power for consistently capturing genes causally related to the extremely heterogeneous cancer  <cit> .
nevertheless, most cancer gene lists were functionally consistent, which indicated that they might all come from some key pathways associated with cancer.
based on this assumption, for a list of cancer genes, there should be subsets of non-redundant genes that could functionally represent the full list of genes.
actually, by the algorithm described in additional file  <dig>  we could select  <dig> genes from gcg, which could represent all the  <dig> cancer genes from cgc, in the sense that all  <dig> cancer genes are frequently connected to the  <dig> cancer genes in the ppi network .
a future study is warranted to establish whether such a non-redundant subset of genes hints at the organization of cancer-related functions.
the biological function of a gene can be defined at several levels, ranging from the basic biological attributes of a protein product, to the nature of physical and regulatory interactions, membership in a given biological pathway, and membership of a specific biological network   <cit> .
we could consider that the functional consistency of gene lists evaluated by the pogf score based on ppi links is at the ppi network level.
we could also evaluate the consistency of gene lists at other functional levels.
for example, using go terms at separate levels of the go hierarchy, we could evaluate the consistency of gene lists at various levels of pathway specificity, and find the most specific level at which the consistency changes from high to low.
to design such go-based consistency scores, we need to consider the limitations that go levels are artificially defined, and a large fraction of genes are only annotated to general high-level terms.
it would be interesting to identify a functional level at which cancer genes of the same cancer type overlap strongly and cancer genes of different cancer types can be distinguished.
however, it might be difficult, if not impossible, to achieve this goal because most genes responsible for tumorigenesis of different cancer types might disrupt the same or similar pathways  <cit> .
in the kegg database, all the  <dig> pathways labelled with cancer types, according to some so far agreed cancer-type-specific genes, such as apc of colorectal cancer, actually consist of similar biological pathways, such as mitogen-activated protein kinase, p <dig>  transforming growth factor-β and jak-stat pathways  <cit> .
statistically, because of the small samples studied for some cancers, the lists of cancer genes accumulated so far for different cancers might be inconsistent and insufficient for functional discrimination of cancer types.
as demonstrated in our previous work  <cit> , even for the same cancer, the true disease markers identified in different studies with insufficient samples  are highly likely to be inconsistent.
we believe that it might be necessary to use more samples and combine functional data with tissue expression data to study cancer-type-specific mechanisms.
the literature-based interaction data in the hprd database might be biased towards well-studied cancer genes.
however, ciccarelli et al.
<cit>  have argued that such a bias might be ignorable because, in the high-throughput ppi data, cancer genes also tend to have higher degrees in the ppi network than other genes.
similarly, using cancer genes with both literature-based interaction data and high-throughput interaction data in the hprd database, we found that the literature-based degrees of these cancer genes were significantly correlated with their high-throughput data-based degrees , indicating our functional assessment would not be severely affected by the research bias.
this problem should be further addressed when more high-throughput ppi data become available.
another concern that should be addressed is that current ppi data are incomplete.
however, as in the present study, the functional similarity measure based on indirect ppi links might lessen the effect of the incompleteness of the direct ppi links.
in our study, cgc was employed as a benchmark for the comparison because it is the most widely applied data source.
however, this benchmark might be biased because genes collected in cgc tend to originate from lymphoma/leukaemia, and most genes were of translocation mutations.
thus, in our future work, we will exploit other criteria to define more reliable and unbiased benchmark cancer gene sets.
one approach might be to find genes non-randomly co-mutated with other genes in cancer samples.
as implied by our work  <cit>  and yeang et al.
<cit> , this statistically sound approach could bypass the unsolved difficulty of the background mutation rate estimation in so-far used prediction methods.
finally, we note that the f-census database is still under development, and is aimed at including more comprehensive information on cancer genes.
for example, we have included in the database genes non-randomly co-mutated with other genes in cancer samples, which can provide strong statistical evidence on their involvement and functional coordination in cancer  <cit> .
additionally, we have collected mirnas that could play important roles in oncogenesis by regulating cancer genes  <cit> .
we will also try to consider the full spectrum of genetic and epigenetic changes in cancer in our future studies  <cit> .
CONCLUSIONS
because cancer is an extremely heterogeneous disease, low consistency in the discovery of cancer genes could have been expected in studies that have used insufficient samples.
although most data sources have low gene overlapping, they are highly consistent at the functional level, which indicates that they might capture separately different genes in a few key pathways associated with cancer.
our database provides biologists with a useful tool for browsing and extracting functionally consistent cancer genes from various data sources.
authors' contributions
xg and zg designed the project and contributed to the draft of the manuscript.
xg, rw, yz, wz carried out all the data analysis and result interpretation.
rw and lc developed the database.
yg, lz, jw and jz contributed to the draft of the manuscript.
supplementary material
additional file 1
algorithm for finding a non-redundant gene set from a list.
click here for file
acknowledgements
this work was supported in part by the national natural science foundation of china .

 cancer is an extremely heterogeneous disease that is induced by mutations or other alterations in many genes. identification of genes that are causally implicated in oncogenesis is of basic importance for predicting novel cancer genes, and studying their evolutionary conservation, biological network features and functions. it can also provide valuable biomarkers for cancer diagnosis and drug development. until now, hundreds of cancer genes that have been found in small-scale experiments have been collected in various databases such as cancer gene census, online mendelian inheritance in man, and many others. recently, by high-throughput somatic mutational screening of cancer genomes, hundreds of new cancer genes that carry driver mutations are being identified rapidly. these increasingly abundant data provide us with an excellent opportunity to understand the underlying complex mechanisms of oncogenesis. nevertheless, we face new challenges to interpret and apply these abundant yet diverse data sources efficiently. in particular, it is important to evaluate the consistency and reliability of the information from different data sources. in this work, we analyzed six lists of cancer genes separately from six major databases and two lists of candidate cancer genes identified by two types of high-throughput techniques. first, we showed that these gene lists were highly inconsistent in terms of overlapping genes, which reflected partially their various types of cancer and mutations. in particular, most cancer genes accumulated in small-scale experiments could not be reproduced in current high-throughput mutational screening of cancer genomes, even when comparing cancer type-specific genes. this suggests that the sample sizes used in the small-scale studies or high-throughput genome screening might have been too small to capture consistently genes that are causally related to cancers with extremely heterogeneous genetic mechanisms. on the other hand, various gene lists might capture separately different genes in a few functional pathways that are related to human cancer. based on protein-protein interaction data, we introduced the pogf metric to evaluate the functional consistency of gene lists, and found that most of them were actually highly functionally consistent. specifically, most cancer genes accumulated in previous small-scale studies could be functionally reproduced in current high-throughput studies. the cgc database is the most widely utilized cancer gene data source, therefore, we used it as a benchmark for evaluating and selecting functionally consistent cancer genes from other data sources. we found that the selected genes were more significantly enriched in cancer pathways than the rest of the genes. finally, we developed the database f-census for collecting functionally consistent cancer genes from various data sources http://bioinfo.hrbmu.edu.cn/fcensus/. methods cancer gene lists we analyzed six databases of cancer genes whose alterations might play causative roles in carcinogenesis. we also analyzed a list of cancer genes provided by mutational screening in cancer genomes for four cancer types and another list of cancer genes identified by retroviral insertional mutagenesis screening. http://rtcgd.ncifcrf.gov note: *the numbers of genes compiled in the original datasets; **the numbers of genes with ppi data. a cancer genes were extracted from omim as did in. b cancer genes from two reviews which are collected in the cancergenes database. ppi and gene ontology data the ppi data were derived from the human protein reference database, which contains interactions that involve proteins after removing self-interactions, including interactions between proteins derived from high-throughput yeast two-hybrid experiments. the go annotation data were downloaded on september evaluating the consistency of gene lists by pog scores the pog metric was used to evaluate the consistency of two gene lists. if list with length l and list with length l have m overlapping genes, then the score from list to list is pog = m/l and the score from list to list is pog = m/l to reduce the effect of list lengths on the pog scores, we also calculated the normalized scores as follows: where e and e are the pog scores expected by random chance, which are estimated separately as the average of the scores for pairs of gene lists extracted randomly from the human genome. evaluating the functional consistency of gene lists at the network level we proposed to evaluate the functional consistency of two gene lists by taking into account functionally similar genes between the lists. first, a gene was defined to be functionally similar to a gene list if its ppi links to the genes in the list were significantly more than expected by random chance. here, a ppi link between two genes means that the two genes interact with each other or share at least one neighbour in the ppi network. suppose a gene has k ppi links to the m genes in a list, then the probability of observing at least k links by random chance can be calculated by the hypergeometric probability model: where n is the number of all the possible links between this gene and other genes in the ppi network, and n is the observed number. then, we proposed the pogf score between gene list with length l and list with length l as follows: where o is the number of genes shared by the two lists, and of is the number of genes in list not shared by but functionally similar to genes in list. to remove the effect of list lengths, we normalized the pogf scores for the two lists as follows: where e and e are the scores expected by random chance for two gene lists, which are estimated separately as the average of the scores of pairs of gene lists extracted randomly from all the genes in the ppi network. statistical significance of a consistency score to evaluate the significance of an observed pog score between two lists, we selected randomly a pair of gene lists and calculated the score by the same method. this process was repeated times. the significance of the score was calculated as the percentage of the random scores that were larger than the observed score. the p value of a npog or npogf score is the same as that of the corresponding pog or pogf score because the e or e that is used to normalize the pog or pogf score is a constant. selecting functionally consistent cancer genes the cgc database comprises cancer genes with relatively stringent criteria. therefore, we filtered other gene lists according to their functional similarity to the genes included in the cgc database. a gene was selected if its functional links to genes from cgc were significantly more than expected by random chance, with the p value calculated by formula and corrected by the fdr control. then, for the selected genes and the remaining ones, respectively, we calculated the probabilities of their enrichment in each of the cancer pathways described in the cancer cell map database, by the hypergeometric distribution model.  consistency between gene lists in terms of gene overlapping cgc is the most widely utilized cancer gene data source in various applications, therefore, we used it as a baseline for the comparison. the pog score from reviews to cgc was and from cgc to reviews. however, as shown in figure 1a, most other gene lists were highly inconsistent with cgc. the pog score from omim to cgc was and in the other direction. notably, 55% of the genes in cgc were labelled with leukaemia/lymphoma, whereas only about 21% of the genes in omim were associated with this cancer. the pog score from agcoh to cgc was and from cgc to agcoh. among the genes shared by these two databases, were associated with haematological cancer. the pog score from tgdbs to cgc was and from cgc to tgdbs, which only included genes discovered in six epithelial cancer types. tsgdb only included tumor suppressor genes, therefore, the pog score from it to cgc was only and in the other direction. the above results showed that these lists of cancer genes were highly inconsistent in terms of gene overlapping. however, all the observed pog and npog scores were significantly larger than the scores expected by random chance. functional consistency between gene lists although different gene lists are inconsistent in terms of overlapping genes, they could each capture different genes in the same pathways associated with cancer. for example, as shown in figure different lists of cancer genes covered various genes in the wnt and egrf pathways. next, we evaluated the functional consistency of the gene lists based on the pogf scores. as shown in figure 1a, the pogf scores from reviews, omim, agcoh, tgdbs and tsgdb to cgc were,,, and, respectively. in another direction, the pogf scores from cgc to the other lists were as high as,,, and. from tgdbs to cgc, although the pog score was only, the pogf score was as high as, which indicated that the genes in tgdbs shared similar functions with those in cgc. another impressive result was that the pogf score from tsgdb to cgc was as high as and in the other direction, although the corresponding pog scores were very low. all the observed pogf and npogf scores were statistically significant. consistency of gene lists discovered in low- and high-throughput studies we used the l-list for the distinct genes extracted from the six databases that contained cancer genes discovered in small-scale studies, and the h-list for the cancer genes identified by mutational screening for four cancer types. from the l-list to the h-list, the pog score was as low as, which indicated that most cancer genes accumulated in the small-scale studies were not rediscovered in the high-throughput data. from the h-list to the l-list, the score was a little larger, but still low, at, which indicated that the high-throughput screening studies could find only a small fraction of all cancer genes. for each of the four cancer types, the consistency of the sub-lists of cancer genes extracted from the l-list and h-list was also very low. note: a the number of cancer genes with ppi data for the low- and high-throughput data. all the scores are statistically significant. on the other hand, the pogf score from the l-list to the h-list was and in the other direction. thus, functionally, cancer genes found in small-scale experiments were consistent with those found in the high-throughput studies. as shown in table from the sub-lists of cancer genes discovered by the genome screening to the sub-lists of cancer genes discovered in small-scale experiments for breast, colon and pancreatic cancers, and glioblastoma, the pogf scores were as high as,, and, respectively. in the other direction, the pogf scores were much lower, which were,, and for the four cancer types, respectively. thus, for each cancer type, the cancer genes discovered by the genome screening might cover more functions of cancer genomes than the cancer genes accumulated from small-scale experiments. we used the r-list for the cancer genes indentified by the high-throughput retroviral insertional mutagenesis screening. as shown in figure 2b, the pog scores from the r-list to the l-list were and in the other direction. however, the pogf scores were as high as and in the two directions, respectively. these results were similar to those for the h-list. the pog score from the r-list to the h-list was only and in the other direction. the pogf scores in the two directions were and, respectively, which suggested that these two lists of cancer genes were less functionally overlapped. cancer genes selected by functional consistency and the f-census database even at the functional level, some inconsistency still existed between cgc and other databases. therefore, we selected genes from other lists according to their functional similarity to genes in the cgc database. with fdr 1% and fdr 5%, respectively, and genes were selected. as shown in table in most of the cancer-related pathways from cancer cell map, the selected genes were significantly enriched, whereas the remaining genes were not. in these pathways, most ratios of the selected genes to the other genes were > which supports the hypothesis that the selected genes are more likely to be cancer-associated. note: a the number of genes in the pathway;* the p value of the enrichment of the selected genes; ** the p value of the enrichment of the rest cancer genes; *** inf means none of the rest genes are annotated in the pathway. based on the above results, we have developed a database named f-census for extracting functionally consistent cancer genes from different data sources. this database is available at http://bioinfo.hrbmu.edu.cn/fcensus/. using this database, users can extract cancer genes from several databases to obtain their union and intersection gene sets, thus providing information about cancer genes, such as their type, their occurrence in different cancers, and their mutation frequencies estimated from the high-throughput studies. also, the users can obtain the cancer gene list pre-selected by our criteria based on their functional similarity to genes in cgc. the users can upload a list of candidate genes and prioritize the genes in the list according to their functional similarity to cancer genes in cgc. finally, the users can look up the functional categories enriched with cancer genes from various cancer gene lists. discussion in this study, we showed that current cancer gene data sources were highly inconsistent in terms of gene overlapping. this suggested that the sample sizes used in either the small-scale studies or high-throughput genome screening might be too small to provide enough power for consistently capturing genes causally related to the extremely heterogeneous cancer. nevertheless, most cancer gene lists were functionally consistent, which indicated that they might all come from some key pathways associated with cancer. based on this assumption, for a list of cancer genes, there should be subsets of non-redundant genes that could functionally represent the full list of genes. actually, by the algorithm described in additional file we could select genes from gcg, which could represent all the cancer genes from cgc, in the sense that all cancer genes are frequently connected to the cancer genes in the ppi network. a future study is warranted to establish whether such a non-redundant subset of genes hints at the organization of cancer-related functions. the biological function of a gene can be defined at several levels, ranging from the basic biological attributes of a protein product, to the nature of physical and regulatory interactions, membership in a given biological pathway, and membership of a specific biological network. we could consider that the functional consistency of gene lists evaluated by the pogf score based on ppi links is at the ppi network level. we could also evaluate the consistency of gene lists at other functional levels. for example, using go terms at separate levels of the go hierarchy, we could evaluate the consistency of gene lists at various levels of pathway specificity, and find the most specific level at which the consistency changes from high to low. to design such go-based consistency scores, we need to consider the limitations that go levels are artificially defined, and a large fraction of genes are only annotated to general high-level terms. it would be interesting to identify a functional level at which cancer genes of the same cancer type overlap strongly and cancer genes of different cancer types can be distinguished. however, it might be difficult, if not impossible, to achieve this goal because most genes responsible for tumorigenesis of different cancer types might disrupt the same or similar pathways. in the kegg database, all the pathways labelled with cancer types, according to some so far agreed cancer-type-specific genes, such as apc of colorectal cancer, actually consist of similar biological pathways, such as mitogen-activated protein kinase, p transforming growth factor-β and jak-stat pathways. statistically, because of the small samples studied for some cancers, the lists of cancer genes accumulated so far for different cancers might be inconsistent and insufficient for functional discrimination of cancer types. as demonstrated in our previous work, even for the same cancer, the true disease markers identified in different studies with insufficient samples are highly likely to be inconsistent. we believe that it might be necessary to use more samples and combine functional data with tissue expression data to study cancer-type-specific mechanisms. the literature-based interaction data in the hprd database might be biased towards well-studied cancer genes. however, ciccarelli et al. have argued that such a bias might be ignorable because, in the high-throughput ppi data, cancer genes also tend to have higher degrees in the ppi network than other genes. similarly, using cancer genes with both literature-based interaction data and high-throughput interaction data in the hprd database, we found that the literature-based degrees of these cancer genes were significantly correlated with their high-throughput data-based degrees, indicating our functional assessment would not be severely affected by the research bias. this problem should be further addressed when more high-throughput ppi data become available. another concern that should be addressed is that current ppi data are incomplete. however, as in the present study, the functional similarity measure based on indirect ppi links might lessen the effect of the incompleteness of the direct ppi links. in our study, cgc was employed as a benchmark for the comparison because it is the most widely applied data source. however, this benchmark might be biased because genes collected in cgc tend to originate from lymphoma/leukaemia, and most genes were of translocation mutations. thus, in our future work, we will exploit other criteria to define more reliable and unbiased benchmark cancer gene sets. one approach might be to find genes non-randomly co-mutated with other genes in cancer samples. as implied by our work and yeang et al., this statistically sound approach could bypass the unsolved difficulty of the background mutation rate estimation in so-far used prediction methods. finally, we note that the f-census database is still under development, and is aimed at including more comprehensive information on cancer genes. for example, we have included in the database genes non-randomly co-mutated with other genes in cancer samples, which can provide strong statistical evidence on their involvement and functional coordination in cancer. additionally, we have collected mirnas that could play important roles in oncogenesis by regulating cancer genes. we will also try to consider the full spectrum of genetic and epigenetic changes in cancer in our future studies.  because cancer is an extremely heterogeneous disease, low consistency in the discovery of cancer genes could have been expected in studies that have used insufficient samples. although most data sources have low gene overlapping, they are highly consistent at the functional level, which indicates that they might capture separately different genes in a few key pathways associated with cancer. our database provides biologists with a useful tool for browsing and extracting functionally consistent cancer genes from various data sources. authors' contributions xg and zg designed the project and contributed to the draft of the manuscript. xg, rw, yz, wz carried out all the data analysis and result interpretation. rw and lc developed the database. yg, lz, jw and jz contributed to the draft of the manuscript. supplementary material additional file 1 algorithm for finding a non-redundant gene set from a list. click here for file acknowledgements this work was supported in part by the national natural science foundation of china.
first, we showed that the lists of cancer genes from some major data sources were highly inconsistent in terms of overlapping genes. in particular, most cancer genes accumulated in previous small-scale studies could not be rediscovered in current high-throughput genome screening studies. finally, we extracted functionally consistent cancer genes from various data sources and collected them in our database f-census. our results suggest that the sample sizes currently used for cancer studies might be inadequate for consistently capturing individual cancer genes, but could be sufficient for finding a number of cancer genes that could represent functionally most cancer genes. the f-census database provides biologists with a useful tool for browsing and extracting functionally consistent cancer genes from various data sources. although they have very low gene overlapping, most cancer gene data sources are highly consistent at the functional level, which indicates that they can separately capture partial genes in a few key pathways associated with cancer. then, based on a metric proposed in this study, we showed that most cancer gene lists from different data sources were highly functionally consistent. for efficient application of these abundant but diverse data sources, it is of fundamental importance to evaluate their consistency. hundreds of genes that are causally implicated in oncogenesis have been found and collected in various databases.
 hundreds of genes that are causally implicated in oncogenesis have been found and collected in various databases. for efficient application of these abundant but diverse data sources, it is of fundamental importance to evaluate their consistency.  first, we showed that the lists of cancer genes from some major data sources were highly inconsistent in terms of overlapping genes. in particular, most cancer genes accumulated in previous small-scale studies could not be rediscovered in current high-throughput genome screening studies. then, based on a metric proposed in this study, we showed that most cancer gene lists from different data sources were highly functionally consistent. finally, we extracted functionally consistent cancer genes from various data sources and collected them in our database f-census.  although they have very low gene overlapping, most cancer gene data sources are highly consistent at the functional level, which indicates that they can separately capture partial genes in a few key pathways associated with cancer. our results suggest that the sample sizes currently used for cancer studies might be inadequate for consistently capturing individual cancer genes, but could be sufficient for finding a number of cancer genes that could represent functionally most cancer genes. the f-census database provides biologists with a useful tool for browsing and extracting functionally consistent cancer genes from various data sources. 