BACKGROUND
the encode  <cit> , mouseencode  <cit> , and modencode  <cit>  consortia published a huge amount of high-throughput genome-wide and context-specific  data sets, including extensive metadata for human, mouse, fly, and worm.
the goal of the encode projects is to provide a comprehensive view on regulatory features in hundreds of different contexts measured with a wide range of standardized high-throughput techniques.
such a compendium of measurements  and associated describing information  provides a rich resource for further analyses, experiments, and comparisons.
moreover, additional compendia such as tcga  <cit>  and epigenomics roadmap  <cit>  offer even larger and more diverse data and metadata on the regulation of biological systems.
the data provided in these large and complex compendia are well-structured according to various dimensions such as species, tissue, cell-line, experimental technique, treatment, gene, and protein, essentially forming a large and high-dimensional data cube.
of course, there are many ways to interpret and analyze the available information and data.
any approach for comprehensive interpretation  is difficult due to the sheer amount and complexity of the data.
in principle, it is straightforward to navigate the data cube and select specific  data sets, but the currently available browsers of the compendia are limited to narrowing down the selection of experiments via simple filters.
for example, one way to analyze regulatory information is to look at specific genomic regions  in the raw data with tools like the ucsc genome browser  <cit> , or portals like modmine  <cit>  and the encode meta-database  <cit> .
however, the measured complex and complicated interactions between genes and specific genomic regions are obfuscated by analyzing individual data sets and individual genomic measurements.
thus, a standard approach to analyze, interpret, and visualize context-specific raw data is via modeling of transcription factor  – target gene  regulatory networks  <cit> .
we call these networks data derived regulatory networks .
ddrns are graphs  defined on a common set of vertices v and specific sets of edges e between them.
they provide an abstracted view on the data and are used as the main tool to enable a straightforward analysis, comparison and integration of data sets across different contexts, experimental techniques, and cell-lines, even across different compendia and across different species via basic network operations.
such regulatory networks are used in various contexts for generating and validating new biological hypotheses, for explaining experimental data , and for studying evolutionary mechanisms  <cit> .
initial analyses revealed that regulatory elements and the corresponding ddrns are highly context-specific and complex  <cit> .
thus, differential and context-specific network analysis is now becoming a prevalent tool, as it enables the identification of new interactions, complexes and pathways, which would be obscured in context independent networks  <cit> .
for example, tools and web-services like netwas and giant  <cit>  allow to infer and browse tissue-specific functional networks in order to identify tissue-specific disease-gene associations.
the construction of ddrns from experimental binding data requires the identification of binding sites and the prediction of possible targets for the dna binding protein in the respective context.
chip-seq experiments directly measure the binding of a protein to the dna, making the inference for regulatory targets for the chip-ed factor possible for all genes with bindings within the promoter region.
this approach was, for instance, used by kim et al.
<cit>  for several transcription factors in mouse embryonic stem cells in order to induce cell type-specific regulatory sub-networks.
advanced experimental techniques and computational predictions like the combination of open chromatin data and transcription factor specific position weight matrices  allow for the construction of networks for many factors at once.
neph et al.
<cit>  introduce such an approach by combining digital genomic footprinting   <cit>  from  <dig> cell-lines and tissues with binding site predictions using pwms to infer tf-tf regulations on a genome-wide scale for  <dig> transcription factors at once, in order to investigate the cell-specificity of transcription factors and well-studied regulatory sub-networks.
via an interactive web tool, these  <dig> ddrns can be visually compared.
furthermore, platforms like the network data exchange  <cit>  framework allow users to share, upload and distribute biological networks publicly.
although these tool and platforms provide a user-friendly overview of the networks, their functionalities are limited with respect to comparative analysis and the number of available networks.
using cytoscape  <cit>  in combination with additional plug-ins, advanced network analysis and operations can be performed, but networks have to be defined and imported  into cytoscape making it infeasible to work with many and huge context-specific regulatory ddrns.
approaches like diffany  <cit>  enable context-specific and differential network analysis and inference of networks from an arbitrary number of heterogeneous data sets.
however, to the best of our knowledge, no comprehensive network repository and tool set exists currently for the cross-species and context-specific regulatory networks analysis.
with croco, we present a repository of pre-computed regulatory networks  and a user-friendly tool suite  for the efficient cross-species and cross-context comparison of ddrns from the encode data sets and regulatory networks derived from the literature, curated resources, and computational predictions.
implementation
architecture of croco framework
the representation of regulatory data as graphs g= ) with a common set of genes v and distinct set of regulations  e allows for a uniform processing of the regulations from thousands of data sets of heterogeneous types, various experimental techniques, and from different sources.
in the croco network repository, we maintain such a common set of genes by mapping the respective measured objects, i.e., the transcription factors and target genes, to ensembl gene identifiers  <cit> .
the same set of genes allows simple means to combine different networks in a straightforward and easy to interpret way.
furthermore, a more challenging mapping between species is obtained from orthology mappings via ensembl compara  <cit>  to allow mapping of networks across species  <cit> , again with a common set of genes for the respective species .
fig.
<dig> overview of the croco framework.
croco provides a uniform view on the encode compendia of genome-wide measurements along with global networks derived from structured databases and further resources.
a) data sets in these compendia are classified into a high-dimensional data cube along dimensions such as cell-line species and treatment.
b) croco uses default or user-defined procedures to define and extract ddrns resulting in a high-dimensional cube of networks structured along the same dimensions.
these networks can be filtered, merged, and combined in various ways to produce new networks.
moreover, networks can be transferred between species via orthology mappings of the network nodes.
this enables the prediction of regulatory interactions from one or a set of species to closely related species.
via combination and transfer operations, new networks are defined, thereby enabling the flexible construction of user-specified networks from the compendia
as thousands of different ddrns can be extracted from encode experimental data, a convenient organization is needed to allow for the flexible selection of networks of interest.
the encode data sets are classified with respect to various criteria defined in the associated metadata.
this induces a multidimensional organization of the available compendium.
we use the seven classification criteria : compendium × development stage × chip-factor × experimental technique × species × tissue/cell-line × treatment.
croco systematically exploits this structure for representing, browsing, and processing the available data sets and the associated networks in the software.
users may start in the croco cytoscape plug-in and the croco web-application navigating the dimensions of the compendia in any order, starting with an arbitrary dimension and continuing subsequently along any other of the remaining dimensions.
this is implemented by the croco multidimensional browsing feature.
thereby, croco provides an intuitive overview of all available networks and the associated data sets in the corresponding compendia.
moreover, we systematically employ ontologies to structure any dimension of the compendia.
these ontologies are either provided by the metadata of the data compendia or are derived from additional information.
components of the croco framework
the network repository  is the central component of the croco system which consists of more than  <dig>  pre-computed global networks and context-specific ddrns for human, mouse, fly, and worm together with gene annotations and ortholog mappings.
the analysis of the networks in the croco-repo is supported via a client side cytoscape plug-in  and a web-application .
with croco-web we offer a web interface, which allows —without the need of installing additional client-side software — to query and compare network statistics or to look-up evidence for specific tf-tg relations using standard web browsers.
for complex downstream network analyses we developed a plug-in for the bioinformatics network tool cytoscape in order to access the croco-repo and to efficiently perform common network operations.
thus, croco consists of five components:
the network repository croco-repo,
the application programming interface  croco-api,
the cytoscape plug-in croco-cyto,
the web application croco-web, and
the web-service for remote access to the central repository .
fig.
<dig> components of the croco framework.
the croco framework consists of a data repository , an application programming interface  , an interactive web interface , and a cytoscape plug-in .
the croco-repo is a central database, which includes derived context-specific and global networks, ortholog mappings, and gene annotations.
via the croco-web interface, networks can be compared based on several properties such as the number of total interactions, or the number of in-/out-interactions  of specific genes.
for cytoscape, we developed a plug-in  for downstream analysis.
finally, in order to assist the development of customized workflows, the croco-api can be used to integrate croco in additional processing and analysis pipelines
through the combination of the publicly available web-service and the croco-api the server-side data repository can be accessed from the client-side.
we structured the croco-api into:  a repository query layer,  a network operation layer, and  the network construction workflows .
the query layer provides a low level set of operations to access the croco-repo such as: list networks in the repository, read a network, and retrieve the metadata and the construction parameters for a specific network.
the croco-repo can either be accessed via a direct database connection using the structured query language  or via the hypertext transfer protocol .
the web-service exposes the query operations to a web-server and tunnels the requests to a server side croco-api instance with direct access to the croco-repo.
on top of this api, we developed croco-cyto and croco-web for network analyses.
the components have been implemented in java in combination with mysql for the croco-repo and the open source community edition of the zkoss web framework  <cit>  for croco-web.
regulatory network repository and network definition
in the croco-repo the following two types of networks were integrated:  ddrns: networks that represent a specific state of a system derived from an experimental measurement and global networks: networks that represent context-independent interactions of a system .
besides global networks and context-specific ddrns, croco-repo contains ortholog mappings for  <dig> eukaryotic species from ensembl compara, and gene annotations for the organisms investigated in an encode project .
the networks  are represented as nodes v with ensembl gene identifiers and edges e⊆v×v as directed pair of nodes.
this uniform representation of the networks facilitates the comparison of species-specific networks between different contexts  and between species .
we downloaded genomic regions with enriched aligned chip and open chromatin reads  from the encode project sites and followed standard procedures for the networks definition  <cit> .
we used the following network definitions to derive the edges  from binding site predictions and chip, as well as open chromatin experiments:
transcription factor binding site  predicted networks: we used fimo  <cit>  with position weight matrices  from transfac   <cit> , jaspar   <cit> , uniprobe  <cit> , wei et al.
<cit> , wang et al.
<cit> , and chen et al.
<cit>  to scan for possible binding sites in the genomes of human, mouse, and worm.
we set the p-value threshold in fimo for the reported bindings to 10− <dig>  regulations were predicted between tf-tg if a pwm hit associated with the tf is located within ±  <dig>  base pairs  of the transcription start sites  of the tg in human and mouse and ±  <dig> bp in worm.
furthermore, we constructed a high-confidence network by further filtering the binding site predictions with a p-value threshold of 10− <dig>  in addition, conserved tfbs predictions in  <dig> drosophila genomes were integrated from kheradpour et al.
<cit>  for fly.
chip-chip and chip-seq networks: chip peaks are provided by the encode projects for human, mouse, fly, and worm for thousands of different contexts.
regulations were inferred between the chip-ed protein and all tgs with peaks within ±  <dig>  bp for human and mouse and  <dig> bp for worm and fly of their tsss.
open chromatin network
we integrated the  <dig> human pre-computed cell-specific tf-tf networks derived from digital genomic footprinting  published by neph et al.
<cit> .
they used dgf footprints with a length of 6– <dig> bp  <cit>  and overlapped those footprints with predicted transfac motif-binding sites using fimo with a p-value threshold of 10− <dig>  regulations were inferred between two transcription factors if an associated pwm for the first tf is found within a footprint of the second tf.
similar to neph et al.
<cit> , we used open chromatin peaks derived from all encode dgf, dnase and fair-seq experiments to predict regulations.
we overlaid these peaks with our tfbs predicted networks in order to infer interactions between tfs and all tgs with predicted bindings.
in addition, we integrated networks from conreg  <cit> , a resource for global regulatory networks.
conreg provides the following network types:
curated-database networks: networks extracted from structured regulatory databases like oreganno  <cit>  or redfly  <cit> .
literature-networks: networks derived from the scientific literature  using a text mining approach.
first, sentences with at least two genes and a regulatory keyword like ‘regulates’ were identified.
next, relations were predicted between all genes identified in those sentences.
in order to filter the networks and to generate more specific networks, versions of the text mining network were produced using a species filter and an approach to generate directed networks .
croco network operations
since the croco-repo contains many and large networks, efficient network operations are crucial to perform network analyses in a user-friendly and interactive way.
thus, the croco-api provides various common network operations optimized to work on the networks from the repository.
each network operation takes one or more networks and additional parameters as input in order to produce a new network.
in addition to the basic network operations union, intersection, and set-difference, the following operations are provided: orthology transfer: transfers a network using orthologs from the croco-repo to another species.
gene set filter: creates an induced network consisting of genes only with a particular gene ontology  annotation, or genes from a user-defined gene set.
support filter: removes edges which have been observed in less than a user-defined number of times in a merged network.
binding site filter: filters interactions based on the p-value of the predicted binding, or the genomic distance of the binding of the tf to the transcription start site  of the tg.
interactive comparative network operation with croco-cyto and croco-web
croco-cyto: the networks contained in the croco-repo, together with the available network operations in the croco-api can be accessed via croco-cyto, a plug-in for the networks analysis tool cytoscape.
result networks, for example shared conserved networks of the analogous leukemia cell-lines in mouse and human, for genes involved in a certain pathway can be produced by selecting the respective networks and applying a sequence of network operations in croco-cyto.
croco-cyto uses the croco-api to retrieve the pre-computed networks, ortholog mappings, and gene descriptions from the server-side croco-repo via the publicly available web-service.
thus, networks of interest can be easily defined, e.g., shared sub-networks between cell-lines, or conserved sub-networks among different species.
croco-web: the web-service croco-web gives a first view on the networks in the croco-repo and enables several network queries, without the need of installing additional software.
croco-web consists of three analysis tools:
network-browser,
geneset overlap browser, and
evidence-lookup.
the network-browser allows to perform cross-species comparisons of networks according to the following network metrics:
the number of interactions,
the number of genes,
the in-, out- and total-degree of specific genes, and
the overlap of interactions with a user-defined regulatory sub-network.
any combination of networks from the croco-repo can be selected for comparisons and, if desired, the network operation union and intersect can be applied to the selected networks.
the regulatory sub-network overlap function allows to investigate the occurrence of regulatory interactions  in different contexts.
with croco-web, such regulatory sub-networks can either be manually defined, or selected from a pre-defined set of small networks from the croco-repo.
selected networks can be organized into groups in order to support the structured comparison of sets of networks, for example, a collection of stem cell networks can be assigned to one group and a collection of t-cell networks can be assigned to another group.
furthermore, for the special case where exactly two groups are defined, a t-test between the two groups is performed according to the selected metrics.
the second main feature is the gene-set overlap browser, which allows to navigate the croco-repo according to the number of interactions between a user-defined set of genes.
finally, the evidence-lookup allows to investigate regulatory interactions and literature references from the croco-repo for any user-defined tf-tg pair of interest.
RESULTS
in the following use cases, we demonstrate the application of the croco cytoscape plug-in  and the croco web-application  to the identification of conserved and context-specific regulations, network features, and sub-networks.
we summarize the number of networks in the publicly available croco network repository  and describe their organization according to ontologies which support the navigation of networks of interest.
subsequently, an evaluation to existing software solutions for the comparative cross-species and cross-context network analysis is provided.
identification of conserved regulatory networks in human k <dig> and mouse mel cell-lines
the first use case demonstrates the identification of conserved networks with croco-cyto in the data derived regulatory networks  from the analogous leukemia cell-lines k <dig> and mel in human and mouse, respectively.
we filtered the networks to genes and orthologs involved in the human kegg  <cit>  chronic myeloid leukemia pathway .
for the selected gene set, we created two networks, a unified network consisting of all interactions from the k <dig> and mel network  and a network consisting only of the interactions, which were apparent in both networks .
in order to compare the networks from the different species, the networks need to be transferred to a common gene set .
here, we transferred the mouse mel networks to human gene identifiers as the desired gene set of the kegg chronic myeloid leukemia pathway was defined for human.
we used functionalities of croco-cyto in order to retrieve the k <dig> and mel ddnrs from the croco-repo and to transfer, unify, intersect, and filter the networks.
in fig.
<dig> the selected network operations in croco-cyto are shown for constructing the combined and intersected networks.
fig.
<dig>
croco-cyto network operations.
networks can be selected from the croco-repo and network operations can be applied to the selected networks.
once networks and network operations are selected, croco-cyto retrieves the networks from the croco-repo and performs the desired network operations in order to produce the final network and to import the final network into cytoscape.
the screenshots show the network operations used in croco-cyto in order to construct the a) combined and b) intersected mel and k <dig> networks
the combined k <dig> and mel ddrn for the selected gene set consists of  <dig> regulations .
from these  <dig> regulations,  <dig> regulations are observed in both the human and mouse ddrns.
furthermore, for  <dig> of the conserved regulations further support in the scientific literature could be found  using the human text-mining network as an additional resource.
fig.
<dig> context-specific regulatory networks derived from analogous cell-lines.
the screenshot shows: a) the union of the orthology-transferred ddrns from three mel and two human k <dig> experiments consisting of  <dig> interactions, and b) the conserved network between the mel and k <dig> ddrns consisting of  <dig> consistently inferred interactions.
the edges are colored according to the available evidence for an interaction.
grey edges represent interactions observed only in the human k <dig> ddrns, blue edges represent interactions observed only in mouse mel ddrns, green edges represent conserved interactions , and red edges represent conserved interactions with literature references
thus, via straightforward and simple network and network operation selections in croco-cyto, complex cross-species network comparisons can be performed.
since k <dig> and mel are analogous cell-lines in different species, the analysis allows determining species-specific regulatory adaptions and similarities in the same context .
interactive cross-species and cross-context network browsing
the second use case highlights some of the network comparison features of croco-web.
croco-web enables a wide-range of complex and powerful on-demand cross-species and cross-context network comparisons and explorations of all networks available in the croco-repo.
thus, interactive and fast testing of biological hypotheses can be conducted.
to demonstrate some of the interactive analysis features of croco-web, we:
used the network overlap feature in order to study the context-specificity of a well-curated regulatory sub-network,
compared the transcription factor activity of transformation-related protein  <dig>  in mouse embryonic stem cells  and t-cells, and
queried evidence for the regulation of early growth response protein  <dig>  and the myc proto-oncogene protein .
context-specific regulatory sub-networks
similar to neph et al.
<cit> , we used a stem cell related sub-network consisting of four major pluripotency factors with  <dig> regulatory interactions from kim et al.
<cit>  and overlapped this sub-network with ddrns extracted from mouse t- and es-cells in order to compute the fraction of common interactions in the sub-network and the selected ddrns.
we selected the corresponding networks from the network-browser in croco-web and used the network overlap metric to compare the networks according to their overlap with the stem cell sub-network.
the results of this comparison plotted by croco-web show that the cells cluster, as expected, according to their biological classification .
that is, a significant overlap with the regulatory sub-network for the pluripotency factors is observed only in the embryonic stem cells.
thus, the potential regulatory function of this sub-network appears to be inactive in t-cells.
such an overlap functionality allows to distinguish between context-specific regulations  and unspecific regulations.
fig.
<dig> context-specific sub-network.
four embryonic stem cells  and four t-cell ddrns derived from the mouseencode open chromatin experiments with two to four replicates were intersected with a well studied stem cell related regulatory sub-network consisting of four pluripotency transcription factors  using the network browser in croco-web.
the figure shows the fraction of the interactions of the selected sub-network found in the es and t-cell ddrns.
the automatically generated croco-web plot for this use case shows that almost all regulations from the selected sub-network can be found in the es-cell ddrns, but only very few regulations can be found in the t-cells ddrns
transcription factor activity of transformation-related protein  <dig>  in mouse es- and t-cells:
p <dig> is one of the best characterized genes, due to its role in apoptosis, genome stability and its frequent mutation in human cancer  <cit> .
recent studies indicate that p <dig> also plays an important role in stem cells and has a high abundance in es-cells .
to further analyze this, we again used the network-browser in croco-web to compare the number of target genes of trp <dig>  in mouse embryonic stem cells  and t-cells .
as the networks have different sizes, the number of target genes for a specific transcription factor was normalized by the network size.
this analysis highlights that, in general, a significantly larger number of regulations of trp <dig> is observed in es-cells than in t-cells.
fig.
<dig> number of regulations for the p <dig> ortholog tpr <dig> in mouse t- and es-cells ddrns.
we selected four embryonic stem cells  and four t-cell ddrns derived from the mouseencode open chromatin experiments with two to four replicates in order to compare the number of regulations of tpr <dig> in the cell-lines.
we normalized the number of interactions by the size of the individual networks in order to account for the different networks sizes.
the generated croco-web plot highlights that  a significantly number of regulations can be observed in the es-cells ddrns
a detailed analysis of the target genes of tp <dig> in these ddrns may help to further characterize the function and role of tp <dig> in es-cells.
query of regulatory evidence for tf-tgs
the evidence-lookup tool in croco-web allows to query regulatory relations between a transcription factor and target gene.
we employed the evidence-lookup tool as a use case to query information of the regulation of early growth response protein  <dig>  and the myc proto-oncogene protein  from the croco-repo.
for that particular example, several binding site predictions and experimental chip bindings of egr <dig> were found within the promoter region of myc .
furthermore, several open chromatin regions overlap with the experimental chip peaks and the predicted tfbs bindings.
in addition, literature references describe regulatory mechanisms between the selected tf and tg.
fig.
<dig> evidence for the regulation of myc by egr <dig>  the evidence-lookup shows predicted and experimental binding sites and literature references for a given tf and tg.
the screenshot shows the tfbs predicted and chip, as well as and open chromatin identified binding sites  of egr <dig> within ±  <dig>  bp of the five annotated transcription start sites  of myc.
it also contains the available literature references and regulatory evidence between the corresponding orthologous genes
thus, there is evidence for this particular regulation in different contexts and the regulation is also well described in the scientific literature.
croco-repo: a comprehensive regulatory network repository
the previously demonstrated use cases can be conducted with croco-cyto and croco-web for all networks in the croco-repo.
in the following, we summarize the available networks and their organization in the croco-repo.
croco-repo contains context- and species-specific ddrns for every chip and open chromatin encode data set.
in addition,  <dig> global networks are integrated in the repository, yielding  <dig>  networks in total.
the availability of experimental data differs across the considered species in the croco-repo.
for instance, open chromatin derived networks are only available for human and mouse, whereas literature derived and binding site derived networks are available for all species.
for human,  <dig>  networks are contained in the repository:  <dig> networks from curated databases,  <dig> networks predicted with different pwm collection sets,  <dig> literature derived networks,  <dig>  chip-derived factor-specific networks for  <dig> different cell-lines, and  <dig>  open chromatin derived networks.
chip experiments have been conducted for different conditions and with different antibodies.
for example, for the human cell k <dig>  the binding of  <dig> different tf have been measured, whereas for the human cell-line wi- <dig> only the binding of ctcf was investigated.
the different human open chromatin networks stem from  <dig> dnase-seq,  <dig> dgf,  <dig> fair-seq experiments in combination with the  <dig> different binding site predicted networks and the  <dig> networks from neph et al.
<cit> , i.e.
experiments ×  <dig> binding site networks +  <dig> networks =  <dig>  different open chromatin networks.
in table  <dig>  we summarize the available networks for the considered species in the croco-repo.
∑
∑
global networks and context-specific networks derived from the encode data are integrated into the croco repository.
database derived networks stem from different curated sources .
the binding site predicted networks result from different pwm collections and a sensitive and a specific pwm match threshold.
furthermore, four different global literature derived networks are included for each species.
the majority of networks in the repository is inferred from context-specific chip and open chromatin experiments.
in total,  <dig>  networks derived from chip experiments performed for different antibodies and cell-lines are integrated into croco.
additionally,  <dig>  networks derived from  <dig> open chromatin based experiments  are integrated into croco
n=number of networks
co=number of different contexts
ab=number of different antibodies
e=number of experiments
in order to enable flexible navigation and selection of networks from the croco-repo in croco-cyto and croco-web, we organized the networks according to various dimensions .
we used the following seven dimensions: compendium: encode, modencode, mouseencode species: human, mouse, fly, worm encode gene name: transcription factors with corresponding encode chip-seq experiments, e.g., ctcf, gata <dig>  mef2a development stage: e.g., embroys, adult-male, adult-female treatment: e.g., insulin, ifna <dig>  estrogen experimental technique: chromatin immunoprecipitation , database , open chromatin, text-mining, transcription factor binding site  prediction tissue/cell-line: e.g., k <dig>  h7-hesc, es-e <dig>
each dimension can be further structured according to simple value lists, or according to specific ontologies.
networks are assigned to node in the dimension-specific value lists and ontologies based on their meta-information.
for example, a ddrn from a human chip-seq experiment performed by encode for ctcf in k <dig> cells is assigned to: encode in the compendium dimension, human in the species dimension, ctcf in the encode gene name dimension, chip-seq in the experimental technique dimension, and k <dig> in the tissue/cell-line dimension.
note, however, that not all networks can be categorized and organized according to all dimensions.
we build a meta-ontology, which includes the seven dimensions including their categorizations.
in the components of the croco system, users can start at any of our specified dimensions, e.g.
species, and browse for attributes of interest in the corresponding value list and ontologies .
as soon as a leaf node within the specific dimension is reached  the user can select a further dimension to browse the remaining networks according to the not yet selected dimensions .
that way it is possible to first select a species and then to select an experimental technique, or vice versa.
fig.
<dig> structure of the croco network ontology.
the networks in the croco-repo are structured according to seven dimensions.
each dimension can be further structured according to dimension-specific ontologies, e.g.
the brenda tissue ontology for the blue tissue/cell-line dimension.
in the croco-web and croco-cyto graphical user interfaces, the networks can be browsed in a recursive manner.
a) shows the dimension and the ontologies used to organize the networks and the first recursion step, where all not yet selected dimensions are appended to the ‘leaf’ node ‘homo sapiens’ in the species dimension.
the screenshot in b) shows a specific realization of the recursive browsing in croco-web.
in croco-web and croco-cyto, only dimensions are visualized, which further separate the data.
here, the last column  lists the number of the selected networks in the respective row
discussion
the different components of croco have been designed to:  support the identification of possible conservations as well as differences between networks from different species and from different cell-lines,  provide a uniform collection of networks for several model organisms, and  allow for the straightforward navigation through thousands of derived networks.
croco has a particular focus on the encode projects and currently contains all encode regulatory data sets.
use cases for croco range from the general comparison of network properties to the validation of hypotheses such as the identification of sub-networks that are conserved or unique in a set of cell-lines or species.
croco supports the following key functionalities, which we identified to perform the outlined use cases: encode data: availability of encode context-specific ddrns in a unified format, and structured according to their metadata via appropriate ontologies.
comparative analysis: fast and efficient network operations on many and large networks for the collection of encode networks to enable comparative network analysis.
downstream analysis: downstream network analysis such as network clustering or significant sub-network identification on ddrns from different encode data sets.
network property look-up: comparative network property analysis in order to get a first overview on the networks.
additional information: query of additional evidence for a particular regulatory relations, e.g.
query literature evidence for a specific regulation.
databases like the ncbi sra, the geo database  <cit> , modmine  <cit> , and the encode genome browser  <cit>  provide only the raw data, thus making computational and labor intensive work necessary in order to collect the data and derive networks from them.
in the supplement of the neph et al.
<cit>  publication, an interactive web application is presented, which allows to visually compare their derived regulatory networks for the  <dig> human cell-lines.
although the interactive web site gives a convenient overview of the networks, its functionality is limited with respect to comparative analysis and the number of available networks.
cytoscape, in combination with additional plug-ins, comes close to implementing the needed functionalities provided by croco.
with the cytoscape advanced network merge and id mapping option, networks can be intersected, set-differenced and merged.
available plug-ins allow to perform various downstream analyses including ortholog network transfers using the homecat plug-in  <cit>  and literature queries for protein interactions using the agilent literature search plug-in.
via the network analysis feature, network properties can be visualized.
finally, the diffany  <cit>  cytoscape plug-in enables different network analysis and inference.
nevertheless, there are shortcomings, which limit the usability of currently available cytoscape plugins for the analysis of many and large ddrns.
for example, each network needs to be loaded into cytoscape before network operations can be performed, and thus network operations on a large number of networks require tedious and error-prone manual work.
furthermore, since no comprehensive encode network repository exists, ddrns need to be manually created, which requires knowledge of the encode data structure and resource intensive computation in order to derive networks.
with croco, we provide a collection of pre-computed networks  derived from encode  and further external databases organized in an easy to navigate multidimensional network ontology.
network operations, including the transfer of many and large networks from the croco-repo, can be processed at once.
this can be done via croco-cyto, which makes the repository and the croco api functionality available within cytoscape.
also, several network queries, like the comparison of network features and the query of regulatory evidence for user-specified tf-tg pairs, can be performed directly via croco-web .
the raw data processing workflow, the choice of thresholds, and the used data processing tools have impacts on the network model.
currently, the networks in the croco-repo are pre-processed, which allow, on the one hand, a fast retrieval of networks, but, on the other hand, limits the network definition.
in order to provide a higher flexibility, the network construction workflows are included in the croco-api.
these workflows allow the generation of entirely new networks with desired parameters and input data.
additionally, interactions can be filtered using different criteria like the pwm p-value threshold, and the distance to a tss.
the croco system implies several avenues for further research: possible extensions are the integration of networks from further sources, e.g., ddrns from the tcga  <cit>  and roadmap epigenomics  <cit> , from protein-protein interaction networks, and from proteomics data.
other extensions involve the development of approaches for fast, flexible, and resource efficient redefinition of the networks included in the croco-repo.
this would enable the flexible variation of parameters defining the edges and allow for the analysis of the implied changes in the resulting networks.
CONCLUSIONS
the encode projects  and other large-scale compendia, such as tcga and epigenomics roadmap provide genome-wide annotations for hundreds of cell-lines, tissues, and treatments using standardized experimental protocols for the model organisms human, mouse, fly, and worm.
determining the similarities and differences between different species and cell-lines can improve our understanding of the evolution and conservation of regulatory mechanisms and the interpretation of observed data  <cit> .
however, due to the large amount of data, the use and the systematic analysis of these data compendia is not straightforward as a systematic cross-species and cross-condition comparative analysis requires a lot of cumbersome work as well as local storage to download and process the data.
the croco network repository provides a network-oriented view on all regulatory data sets from the encode projects structured according to ontologies derived from the metadata.
thereby, croco provides intuitive views on the data and allows for the investigation of regulatory mechanisms.
via the croco tool suite, convenient browsing and aggregating of networks along the ontology structures is enabled.
network representations can be employed for intuitive abstracted views on the data and the investigation of regulatory mechanisms.
available network tools, such as cytoscape, contain a wide range of interesting network analysis functionalities.
in order to use them in combination with encode data, time-consuming manual work is required for downloading and pre-processing the data as well as extracting the networks.
with the croco system, systematic analysis of networks is supported via a network repository containing thousands of global and context-specific data derived regulatory networks.
the modular design of croco and the wide range of query operations available via the web application , via a cytoscape plug-in , and via an application programming interface  provide access to networks and analysis tools to a broad user community.
finally, croco features the data cube paradigm characterized by:  the convenient multidimensional navigation in any order of the dimensions,  the ontology-supported browsing of the data cube dimensions,  combination, and  comparison of networks, including cross-species transfer of regulatory network models.
availability and requirements
project name: crocoproject home page:http://services.bio.ifi.lmu.de/croco-weboperating system: platform independentprogramming language: javaother requirements: java  <dig>  or higher, and cytoscape  <dig> .
<dig> or higher for croco-cytolicense: gnu lesser general public license  v <dig> .
we would like to thank madox sesen for prototyping the network motif overlap functionality.
funding
part of this work has been funded by dfg graduate school recess and the dfg crc  <dig> conformational switches.
authors’ contributions
rp and rz conceived and designed the software system.
rp implemented the system.
rp and rz wrote the manuscript.
both authors read and approved the final manuscript.
competing interests
the authors declare that they have no competing interests.
consent for publication
not applicable.
ethics approval and consent to participate
not applicable.

 the encode, mouseencode, and modencode consortia published a huge amount of high-throughput genome-wide and context-specific data sets, including extensive metadata for human, mouse, fly, and worm. the goal of the encode projects is to provide a comprehensive view on regulatory features in hundreds of different contexts measured with a wide range of standardized high-throughput techniques. such a compendium of measurements and associated describing information provides a rich resource for further analyses, experiments, and comparisons. moreover, additional compendia such as tcga and epigenomics roadmap offer even larger and more diverse data and metadata on the regulation of biological systems. the data provided in these large and complex compendia are well-structured according to various dimensions such as species, tissue, cell-line, experimental technique, treatment, gene, and protein, essentially forming a large and high-dimensional data cube. of course, there are many ways to interpret and analyze the available information and data. any approach for comprehensive interpretation is difficult due to the sheer amount and complexity of the data. in principle, it is straightforward to navigate the data cube and select specific data sets, but the currently available browsers of the compendia are limited to narrowing down the selection of experiments via simple filters. for example, one way to analyze regulatory information is to look at specific genomic regions in the raw data with tools like the ucsc genome browser, or portals like modmine and the encode meta-database. however, the measured complex and complicated interactions between genes and specific genomic regions are obfuscated by analyzing individual data sets and individual genomic measurements. thus, a standard approach to analyze, interpret, and visualize context-specific raw data is via modeling of transcription factor – target gene regulatory networks. we call these networks data derived regulatory networks. ddrns are graphs defined on a common set of vertices v and specific sets of edges e between them. they provide an abstracted view on the data and are used as the main tool to enable a straightforward analysis, comparison and integration of data sets across different contexts, experimental techniques, and cell-lines, even across different compendia and across different species via basic network operations. such regulatory networks are used in various contexts for generating and validating new biological hypotheses, for explaining experimental data, and for studying evolutionary mechanisms. initial analyses revealed that regulatory elements and the corresponding ddrns are highly context-specific and complex. thus, differential and context-specific network analysis is now becoming a prevalent tool, as it enables the identification of new interactions, complexes and pathways, which would be obscured in context independent networks. for example, tools and web-services like netwas and giant allow to infer and browse tissue-specific functional networks in order to identify tissue-specific disease-gene associations. the construction of ddrns from experimental binding data requires the identification of binding sites and the prediction of possible targets for the dna binding protein in the respective context. chip-seq experiments directly measure the binding of a protein to the dna, making the inference for regulatory targets for the chip-ed factor possible for all genes with bindings within the promoter region. this approach was, for instance, used by kim et al. for several transcription factors in mouse embryonic stem cells in order to induce cell type-specific regulatory sub-networks. advanced experimental techniques and computational predictions like the combination of open chromatin data and transcription factor specific position weight matrices allow for the construction of networks for many factors at once. neph et al. introduce such an approach by combining digital genomic footprinting from cell-lines and tissues with binding site predictions using pwms to infer tf-tf regulations on a genome-wide scale for transcription factors at once, in order to investigate the cell-specificity of transcription factors and well-studied regulatory sub-networks. via an interactive web tool, these ddrns can be visually compared. furthermore, platforms like the network data exchange framework allow users to share, upload and distribute biological networks publicly. although these tool and platforms provide a user-friendly overview of the networks, their functionalities are limited with respect to comparative analysis and the number of available networks. using cytoscape in combination with additional plug-ins, advanced network analysis and operations can be performed, but networks have to be defined and imported into cytoscape making it infeasible to work with many and huge context-specific regulatory ddrns. approaches like diffany enable context-specific and differential network analysis and inference of networks from an arbitrary number of heterogeneous data sets. however, to the best of our knowledge, no comprehensive network repository and tool set exists currently for the cross-species and context-specific regulatory networks analysis. with croco, we present a repository of pre-computed regulatory networks and a user-friendly tool suite for the efficient cross-species and cross-context comparison of ddrns from the encode data sets and regulatory networks derived from the literature, curated resources, and computational predictions. implementation architecture of croco framework the representation of regulatory data as graphs g= ) with a common set of genes v and distinct set of regulations e allows for a uniform processing of the regulations from thousands of data sets of heterogeneous types, various experimental techniques, and from different sources. in the croco network repository, we maintain such a common set of genes by mapping the respective measured objects, i.e., the transcription factors and target genes, to ensembl gene identifiers. the same set of genes allows simple means to combine different networks in a straightforward and easy to interpret way. furthermore, a more challenging mapping between species is obtained from orthology mappings via ensembl compara to allow mapping of networks across species, again with a common set of genes for the respective species. fig. overview of the croco framework. croco provides a uniform view on the encode compendia of genome-wide measurements along with global networks derived from structured databases and further resources. a) data sets in these compendia are classified into a high-dimensional data cube along dimensions such as cell-line species and treatment. b) croco uses default or user-defined procedures to define and extract ddrns resulting in a high-dimensional cube of networks structured along the same dimensions. these networks can be filtered, merged, and combined in various ways to produce new networks. moreover, networks can be transferred between species via orthology mappings of the network nodes. this enables the prediction of regulatory interactions from one or a set of species to closely related species. via combination and transfer operations, new networks are defined, thereby enabling the flexible construction of user-specified networks from the compendia as thousands of different ddrns can be extracted from encode experimental data, a convenient organization is needed to allow for the flexible selection of networks of interest. the encode data sets are classified with respect to various criteria defined in the associated metadata. this induces a multidimensional organization of the available compendium. we use the seven classification criteria: compendium × development stage × chip-factor × experimental technique × species × tissue/cell-line × treatment. croco systematically exploits this structure for representing, browsing, and processing the available data sets and the associated networks in the software. users may start in the croco cytoscape plug-in and the croco web-application navigating the dimensions of the compendia in any order, starting with an arbitrary dimension and continuing subsequently along any other of the remaining dimensions. this is implemented by the croco multidimensional browsing feature. thereby, croco provides an intuitive overview of all available networks and the associated data sets in the corresponding compendia. moreover, we systematically employ ontologies to structure any dimension of the compendia. these ontologies are either provided by the metadata of the data compendia or are derived from additional information. components of the croco framework the network repository is the central component of the croco system which consists of more than pre-computed global networks and context-specific ddrns for human, mouse, fly, and worm together with gene annotations and ortholog mappings. the analysis of the networks in the croco-repo is supported via a client side cytoscape plug-in and a web-application. with croco-web we offer a web interface, which allows —without the need of installing additional client-side software — to query and compare network statistics or to look-up evidence for specific tf-tg relations using standard web browsers. for complex downstream network analyses we developed a plug-in for the bioinformatics network tool cytoscape in order to access the croco-repo and to efficiently perform common network operations. thus, croco consists of five components: the network repository croco-repo, the application programming interface croco-api, the cytoscape plug-in croco-cyto, the web application croco-web, and the web-service for remote access to the central repository. fig. components of the croco framework. the croco framework consists of a data repository, an application programming interface, an interactive web interface, and a cytoscape plug-in. the croco-repo is a central database, which includes derived context-specific and global networks, ortholog mappings, and gene annotations. via the croco-web interface, networks can be compared based on several properties such as the number of total interactions, or the number of in-/out-interactions of specific genes. for cytoscape, we developed a plug-in for downstream analysis. finally, in order to assist the development of customized workflows, the croco-api can be used to integrate croco in additional processing and analysis pipelines through the combination of the publicly available web-service and the croco-api the server-side data repository can be accessed from the client-side. we structured the croco-api into: a repository query layer, a network operation layer, and the network construction workflows. the query layer provides a low level set of operations to access the croco-repo such as: list networks in the repository, read a network, and retrieve the metadata and the construction parameters for a specific network. the croco-repo can either be accessed via a direct database connection using the structured query language or via the hypertext transfer protocol. the web-service exposes the query operations to a web-server and tunnels the requests to a server side croco-api instance with direct access to the croco-repo. on top of this api, we developed croco-cyto and croco-web for network analyses. the components have been implemented in java in combination with mysql for the croco-repo and the open source community edition of the zkoss web framework for croco-web. regulatory network repository and network definition in the croco-repo the following two types of networks were integrated: ddrns: networks that represent a specific state of a system derived from an experimental measurement and global networks: networks that represent context-independent interactions of a system. besides global networks and context-specific ddrns, croco-repo contains ortholog mappings for eukaryotic species from ensembl compara, and gene annotations for the organisms investigated in an encode project. the networks are represented as nodes v with ensembl gene identifiers and edges e⊆v×v as directed pair of nodes. this uniform representation of the networks facilitates the comparison of species-specific networks between different contexts and between species. we downloaded genomic regions with enriched aligned chip and open chromatin reads from the encode project sites and followed standard procedures for the networks definition. we used the following network definitions to derive the edges from binding site predictions and chip, as well as open chromatin experiments: transcription factor binding site predicted networks: we used fimo with position weight matrices from transfac, jaspar, uniprobe, wei et al., wang et al., and chen et al. to scan for possible binding sites in the genomes of human, mouse, and worm. we set the p-value threshold in fimo for the reported bindings to 10− regulations were predicted between tf-tg if a pwm hit associated with the tf is located within ± base pairs of the transcription start sites of the tg in human and mouse and ± bp in worm. furthermore, we constructed a high-confidence network by further filtering the binding site predictions with a p-value threshold of 10− in addition, conserved tfbs predictions in drosophila genomes were integrated from kheradpour et al. for fly. chip-chip and chip-seq networks: chip peaks are provided by the encode projects for human, mouse, fly, and worm for thousands of different contexts. regulations were inferred between the chip-ed protein and all tgs with peaks within ± bp for human and mouse and bp for worm and fly of their tsss. open chromatin network we integrated the human pre-computed cell-specific tf-tf networks derived from digital genomic footprinting published by neph et al.. they used dgf footprints with a length of 6– bp and overlapped those footprints with predicted transfac motif-binding sites using fimo with a p-value threshold of 10− regulations were inferred between two transcription factors if an associated pwm for the first tf is found within a footprint of the second tf. similar to neph et al., we used open chromatin peaks derived from all encode dgf, dnase and fair-seq experiments to predict regulations. we overlaid these peaks with our tfbs predicted networks in order to infer interactions between tfs and all tgs with predicted bindings. in addition, we integrated networks from conreg, a resource for global regulatory networks. conreg provides the following network types: curated-database networks: networks extracted from structured regulatory databases like oreganno or redfly. literature-networks: networks derived from the scientific literature using a text mining approach. first, sentences with at least two genes and a regulatory keyword like ‘regulates’ were identified. next, relations were predicted between all genes identified in those sentences. in order to filter the networks and to generate more specific networks, versions of the text mining network were produced using a species filter and an approach to generate directed networks. croco network operations since the croco-repo contains many and large networks, efficient network operations are crucial to perform network analyses in a user-friendly and interactive way. thus, the croco-api provides various common network operations optimized to work on the networks from the repository. each network operation takes one or more networks and additional parameters as input in order to produce a new network. in addition to the basic network operations union, intersection, and set-difference, the following operations are provided: orthology transfer: transfers a network using orthologs from the croco-repo to another species. gene set filter: creates an induced network consisting of genes only with a particular gene ontology annotation, or genes from a user-defined gene set. support filter: removes edges which have been observed in less than a user-defined number of times in a merged network. binding site filter: filters interactions based on the p-value of the predicted binding, or the genomic distance of the binding of the tf to the transcription start site of the tg. interactive comparative network operation with croco-cyto and croco-web croco-cyto: the networks contained in the croco-repo, together with the available network operations in the croco-api can be accessed via croco-cyto, a plug-in for the networks analysis tool cytoscape. result networks, for example shared conserved networks of the analogous leukemia cell-lines in mouse and human, for genes involved in a certain pathway can be produced by selecting the respective networks and applying a sequence of network operations in croco-cyto. croco-cyto uses the croco-api to retrieve the pre-computed networks, ortholog mappings, and gene descriptions from the server-side croco-repo via the publicly available web-service. thus, networks of interest can be easily defined, e.g., shared sub-networks between cell-lines, or conserved sub-networks among different species. croco-web: the web-service croco-web gives a first view on the networks in the croco-repo and enables several network queries, without the need of installing additional software. croco-web consists of three analysis tools: network-browser, geneset overlap browser, and evidence-lookup. the network-browser allows to perform cross-species comparisons of networks according to the following network metrics: the number of interactions, the number of genes, the in-, out- and total-degree of specific genes, and the overlap of interactions with a user-defined regulatory sub-network. any combination of networks from the croco-repo can be selected for comparisons and, if desired, the network operation union and intersect can be applied to the selected networks. the regulatory sub-network overlap function allows to investigate the occurrence of regulatory interactions in different contexts. with croco-web, such regulatory sub-networks can either be manually defined, or selected from a pre-defined set of small networks from the croco-repo. selected networks can be organized into groups in order to support the structured comparison of sets of networks, for example, a collection of stem cell networks can be assigned to one group and a collection of t-cell networks can be assigned to another group. furthermore, for the special case where exactly two groups are defined, a t-test between the two groups is performed according to the selected metrics. the second main feature is the gene-set overlap browser, which allows to navigate the croco-repo according to the number of interactions between a user-defined set of genes. finally, the evidence-lookup allows to investigate regulatory interactions and literature references from the croco-repo for any user-defined tf-tg pair of interest.  in the following use cases, we demonstrate the application of the croco cytoscape plug-in and the croco web-application to the identification of conserved and context-specific regulations, network features, and sub-networks. we summarize the number of networks in the publicly available croco network repository and describe their organization according to ontologies which support the navigation of networks of interest. subsequently, an evaluation to existing software solutions for the comparative cross-species and cross-context network analysis is provided. identification of conserved regulatory networks in human k and mouse mel cell-lines the first use case demonstrates the identification of conserved networks with croco-cyto in the data derived regulatory networks from the analogous leukemia cell-lines k and mel in human and mouse, respectively. we filtered the networks to genes and orthologs involved in the human kegg chronic myeloid leukemia pathway. for the selected gene set, we created two networks, a unified network consisting of all interactions from the k and mel network and a network consisting only of the interactions, which were apparent in both networks. in order to compare the networks from the different species, the networks need to be transferred to a common gene set. here, we transferred the mouse mel networks to human gene identifiers as the desired gene set of the kegg chronic myeloid leukemia pathway was defined for human. we used functionalities of croco-cyto in order to retrieve the k and mel ddnrs from the croco-repo and to transfer, unify, intersect, and filter the networks. in fig. the selected network operations in croco-cyto are shown for constructing the combined and intersected networks. fig. croco-cyto network operations. networks can be selected from the croco-repo and network operations can be applied to the selected networks. once networks and network operations are selected, croco-cyto retrieves the networks from the croco-repo and performs the desired network operations in order to produce the final network and to import the final network into cytoscape. the screenshots show the network operations used in croco-cyto in order to construct the a) combined and b) intersected mel and k networks the combined k and mel ddrn for the selected gene set consists of regulations. from these regulations, regulations are observed in both the human and mouse ddrns. furthermore, for of the conserved regulations further support in the scientific literature could be found using the human text-mining network as an additional resource. fig. context-specific regulatory networks derived from analogous cell-lines. the screenshot shows: a) the union of the orthology-transferred ddrns from three mel and two human k experiments consisting of interactions, and b) the conserved network between the mel and k ddrns consisting of consistently inferred interactions. the edges are colored according to the available evidence for an interaction. grey edges represent interactions observed only in the human k ddrns, blue edges represent interactions observed only in mouse mel ddrns, green edges represent conserved interactions, and red edges represent conserved interactions with literature references thus, via straightforward and simple network and network operation selections in croco-cyto, complex cross-species network comparisons can be performed. since k and mel are analogous cell-lines in different species, the analysis allows determining species-specific regulatory adaptions and similarities in the same context. interactive cross-species and cross-context network browsing the second use case highlights some of the network comparison features of croco-web. croco-web enables a wide-range of complex and powerful on-demand cross-species and cross-context network comparisons and explorations of all networks available in the croco-repo. thus, interactive and fast testing of biological hypotheses can be conducted. to demonstrate some of the interactive analysis features of croco-web, we: used the network overlap feature in order to study the context-specificity of a well-curated regulatory sub-network, compared the transcription factor activity of transformation-related protein in mouse embryonic stem cells and t-cells, and queried evidence for the regulation of early growth response protein and the myc proto-oncogene protein. context-specific regulatory sub-networks similar to neph et al., we used a stem cell related sub-network consisting of four major pluripotency factors with regulatory interactions from kim et al. and overlapped this sub-network with ddrns extracted from mouse t- and es-cells in order to compute the fraction of common interactions in the sub-network and the selected ddrns. we selected the corresponding networks from the network-browser in croco-web and used the network overlap metric to compare the networks according to their overlap with the stem cell sub-network. the results of this comparison plotted by croco-web show that the cells cluster, as expected, according to their biological classification. that is, a significant overlap with the regulatory sub-network for the pluripotency factors is observed only in the embryonic stem cells. thus, the potential regulatory function of this sub-network appears to be inactive in t-cells. such an overlap functionality allows to distinguish between context-specific regulations and unspecific regulations. fig. context-specific sub-network. four embryonic stem cells and four t-cell ddrns derived from the mouseencode open chromatin experiments with two to four replicates were intersected with a well studied stem cell related regulatory sub-network consisting of four pluripotency transcription factors using the network browser in croco-web. the figure shows the fraction of the interactions of the selected sub-network found in the es and t-cell ddrns. the automatically generated croco-web plot for this use case shows that almost all regulations from the selected sub-network can be found in the es-cell ddrns, but only very few regulations can be found in the t-cells ddrns transcription factor activity of transformation-related protein in mouse es- and t-cells: p is one of the best characterized genes, due to its role in apoptosis, genome stability and its frequent mutation in human cancer. recent studies indicate that p also plays an important role in stem cells and has a high abundance in es-cells. to further analyze this, we again used the network-browser in croco-web to compare the number of target genes of trp in mouse embryonic stem cells and t-cells. as the networks have different sizes, the number of target genes for a specific transcription factor was normalized by the network size. this analysis highlights that, in general, a significantly larger number of regulations of trp is observed in es-cells than in t-cells. fig. number of regulations for the p ortholog tpr in mouse t- and es-cells ddrns. we selected four embryonic stem cells and four t-cell ddrns derived from the mouseencode open chromatin experiments with two to four replicates in order to compare the number of regulations of tpr in the cell-lines. we normalized the number of interactions by the size of the individual networks in order to account for the different networks sizes. the generated croco-web plot highlights that a significantly number of regulations can be observed in the es-cells ddrns a detailed analysis of the target genes of tp in these ddrns may help to further characterize the function and role of tp in es-cells. query of regulatory evidence for tf-tgs the evidence-lookup tool in croco-web allows to query regulatory relations between a transcription factor and target gene. we employed the evidence-lookup tool as a use case to query information of the regulation of early growth response protein and the myc proto-oncogene protein from the croco-repo. for that particular example, several binding site predictions and experimental chip bindings of egr were found within the promoter region of myc. furthermore, several open chromatin regions overlap with the experimental chip peaks and the predicted tfbs bindings. in addition, literature references describe regulatory mechanisms between the selected tf and tg. fig. evidence for the regulation of myc by egr the evidence-lookup shows predicted and experimental binding sites and literature references for a given tf and tg. the screenshot shows the tfbs predicted and chip, as well as and open chromatin identified binding sites of egr within ± bp of the five annotated transcription start sites of myc. it also contains the available literature references and regulatory evidence between the corresponding orthologous genes thus, there is evidence for this particular regulation in different contexts and the regulation is also well described in the scientific literature. croco-repo: a comprehensive regulatory network repository the previously demonstrated use cases can be conducted with croco-cyto and croco-web for all networks in the croco-repo. in the following, we summarize the available networks and their organization in the croco-repo. croco-repo contains context- and species-specific ddrns for every chip and open chromatin encode data set. in addition, global networks are integrated in the repository, yielding networks in total. the availability of experimental data differs across the considered species in the croco-repo. for instance, open chromatin derived networks are only available for human and mouse, whereas literature derived and binding site derived networks are available for all species. for human, networks are contained in the repository: networks from curated databases, networks predicted with different pwm collection sets, literature derived networks, chip-derived factor-specific networks for different cell-lines, and open chromatin derived networks. chip experiments have been conducted for different conditions and with different antibodies. for example, for the human cell k the binding of different tf have been measured, whereas for the human cell-line wi- only the binding of ctcf was investigated. the different human open chromatin networks stem from dnase-seq, dgf, fair-seq experiments in combination with the different binding site predicted networks and the networks from neph et al., i.e. experiments × binding site networks + networks = different open chromatin networks. in table we summarize the available networks for the considered species in the croco-repo. ∑ ∑ global networks and context-specific networks derived from the encode data are integrated into the croco repository. database derived networks stem from different curated sources. the binding site predicted networks result from different pwm collections and a sensitive and a specific pwm match threshold. furthermore, four different global literature derived networks are included for each species. the majority of networks in the repository is inferred from context-specific chip and open chromatin experiments. in total, networks derived from chip experiments performed for different antibodies and cell-lines are integrated into croco. additionally, networks derived from open chromatin based experiments are integrated into croco n=number of networks co=number of different contexts ab=number of different antibodies e=number of experiments in order to enable flexible navigation and selection of networks from the croco-repo in croco-cyto and croco-web, we organized the networks according to various dimensions. we used the following seven dimensions: compendium: encode, modencode, mouseencode species: human, mouse, fly, worm encode gene name: transcription factors with corresponding encode chip-seq experiments, e.g., ctcf, gata mef2a development stage: e.g., embroys, adult-male, adult-female treatment: e.g., insulin, ifna estrogen experimental technique: chromatin immunoprecipitation, database, open chromatin, text-mining, transcription factor binding site prediction tissue/cell-line: e.g., k h7-hesc, es-e each dimension can be further structured according to simple value lists, or according to specific ontologies. networks are assigned to node in the dimension-specific value lists and ontologies based on their meta-information. for example, a ddrn from a human chip-seq experiment performed by encode for ctcf in k cells is assigned to: encode in the compendium dimension, human in the species dimension, ctcf in the encode gene name dimension, chip-seq in the experimental technique dimension, and k in the tissue/cell-line dimension. note, however, that not all networks can be categorized and organized according to all dimensions. we build a meta-ontology, which includes the seven dimensions including their categorizations. in the components of the croco system, users can start at any of our specified dimensions, e.g. species, and browse for attributes of interest in the corresponding value list and ontologies. as soon as a leaf node within the specific dimension is reached the user can select a further dimension to browse the remaining networks according to the not yet selected dimensions. that way it is possible to first select a species and then to select an experimental technique, or vice versa. fig. structure of the croco network ontology. the networks in the croco-repo are structured according to seven dimensions. each dimension can be further structured according to dimension-specific ontologies, e.g. the brenda tissue ontology for the blue tissue/cell-line dimension. in the croco-web and croco-cyto graphical user interfaces, the networks can be browsed in a recursive manner. a) shows the dimension and the ontologies used to organize the networks and the first recursion step, where all not yet selected dimensions are appended to the ‘leaf’ node ‘homo sapiens’ in the species dimension. the screenshot in b) shows a specific realization of the recursive browsing in croco-web. in croco-web and croco-cyto, only dimensions are visualized, which further separate the data. here, the last column lists the number of the selected networks in the respective row discussion the different components of croco have been designed to: support the identification of possible conservations as well as differences between networks from different species and from different cell-lines, provide a uniform collection of networks for several model organisms, and allow for the straightforward navigation through thousands of derived networks. croco has a particular focus on the encode projects and currently contains all encode regulatory data sets. use cases for croco range from the general comparison of network properties to the validation of hypotheses such as the identification of sub-networks that are conserved or unique in a set of cell-lines or species. croco supports the following key functionalities, which we identified to perform the outlined use cases: encode data: availability of encode context-specific ddrns in a unified format, and structured according to their metadata via appropriate ontologies. comparative analysis: fast and efficient network operations on many and large networks for the collection of encode networks to enable comparative network analysis. downstream analysis: downstream network analysis such as network clustering or significant sub-network identification on ddrns from different encode data sets. network property look-up: comparative network property analysis in order to get a first overview on the networks. additional information: query of additional evidence for a particular regulatory relations, e.g. query literature evidence for a specific regulation. databases like the ncbi sra, the geo database, modmine, and the encode genome browser provide only the raw data, thus making computational and labor intensive work necessary in order to collect the data and derive networks from them. in the supplement of the neph et al. publication, an interactive web application is presented, which allows to visually compare their derived regulatory networks for the human cell-lines. although the interactive web site gives a convenient overview of the networks, its functionality is limited with respect to comparative analysis and the number of available networks. cytoscape, in combination with additional plug-ins, comes close to implementing the needed functionalities provided by croco. with the cytoscape advanced network merge and id mapping option, networks can be intersected, set-differenced and merged. available plug-ins allow to perform various downstream analyses including ortholog network transfers using the homecat plug-in and literature queries for protein interactions using the agilent literature search plug-in. via the network analysis feature, network properties can be visualized. finally, the diffany cytoscape plug-in enables different network analysis and inference. nevertheless, there are shortcomings, which limit the usability of currently available cytoscape plugins for the analysis of many and large ddrns. for example, each network needs to be loaded into cytoscape before network operations can be performed, and thus network operations on a large number of networks require tedious and error-prone manual work. furthermore, since no comprehensive encode network repository exists, ddrns need to be manually created, which requires knowledge of the encode data structure and resource intensive computation in order to derive networks. with croco, we provide a collection of pre-computed networks derived from encode and further external databases organized in an easy to navigate multidimensional network ontology. network operations, including the transfer of many and large networks from the croco-repo, can be processed at once. this can be done via croco-cyto, which makes the repository and the croco api functionality available within cytoscape. also, several network queries, like the comparison of network features and the query of regulatory evidence for user-specified tf-tg pairs, can be performed directly via croco-web. the raw data processing workflow, the choice of thresholds, and the used data processing tools have impacts on the network model. currently, the networks in the croco-repo are pre-processed, which allow, on the one hand, a fast retrieval of networks, but, on the other hand, limits the network definition. in order to provide a higher flexibility, the network construction workflows are included in the croco-api. these workflows allow the generation of entirely new networks with desired parameters and input data. additionally, interactions can be filtered using different criteria like the pwm p-value threshold, and the distance to a tss. the croco system implies several avenues for further research: possible extensions are the integration of networks from further sources, e.g., ddrns from the tcga and roadmap epigenomics, from protein-protein interaction networks, and from proteomics data. other extensions involve the development of approaches for fast, flexible, and resource efficient redefinition of the networks included in the croco-repo. this would enable the flexible variation of parameters defining the edges and allow for the analysis of the implied changes in the resulting networks.  the encode projects and other large-scale compendia, such as tcga and epigenomics roadmap provide genome-wide annotations for hundreds of cell-lines, tissues, and treatments using standardized experimental protocols for the model organisms human, mouse, fly, and worm. determining the similarities and differences between different species and cell-lines can improve our understanding of the evolution and conservation of regulatory mechanisms and the interpretation of observed data. however, due to the large amount of data, the use and the systematic analysis of these data compendia is not straightforward as a systematic cross-species and cross-condition comparative analysis requires a lot of cumbersome work as well as local storage to download and process the data. the croco network repository provides a network-oriented view on all regulatory data sets from the encode projects structured according to ontologies derived from the metadata. thereby, croco provides intuitive views on the data and allows for the investigation of regulatory mechanisms. via the croco tool suite, convenient browsing and aggregating of networks along the ontology structures is enabled. network representations can be employed for intuitive abstracted views on the data and the investigation of regulatory mechanisms. available network tools, such as cytoscape, contain a wide range of interesting network analysis functionalities. in order to use them in combination with encode data, time-consuming manual work is required for downloading and pre-processing the data as well as extracting the networks. with the croco system, systematic analysis of networks is supported via a network repository containing thousands of global and context-specific data derived regulatory networks. the modular design of croco and the wide range of query operations available via the web application, via a cytoscape plug-in, and via an application programming interface provide access to networks and analysis tools to a broad user community. finally, croco features the data cube paradigm characterized by: the convenient multidimensional navigation in any order of the dimensions, the ontology-supported browsing of the data cube dimensions, combination, and comparison of networks, including cross-species transfer of regulatory network models. availability and requirements project name: crocoproject home page:http://services.bio.ifi.lmu.de/croco-weboperating system: platform independentprogramming language: javaother requirements: java or higher, and cytoscape. or higher for croco-cytolicense: gnu lesser general public license v. we would like to thank madox sesen for prototyping the network motif overlap functionality. funding part of this work has been funded by dfg graduate school recess and the dfg crc conformational switches. authors’ contributions rp and rz conceived and designed the software system. rp implemented the system. rp and rz wrote the manuscript. both authors read and approved the final manuscript. competing interests the authors declare that they have no competing interests. consent for publication not applicable. ethics approval and consent to participate not applicable.
many of these context-specific data can be modeled as data derived regulatory networks representing the complex and complicated interactions between transcription factors and target genes. croco adds an intuitive unifying view on the data from the encode projects via a comprehensive repository of derived context-specific regulatory networks and enables flexible cross-context, cross-species, and cross-compendia comparison via a basis set of analysis tools. encodegene regulatory networks cross-species transfercytoscapeweb applicationsoftwaredfg recessdfg crc conformational switchesissue-copyright-statement© the author 2016 many large data compendia on context-specific high-throughput genomic and regulatory data have been made available by international research consortia such as encode, tcga, and epigenomics roadmap. ddrns can be combined with additional information and networks derived from the literature, curated resources, and computational predictions in order to enable detailed exploration and cross checking of regulatory interactions. applications of the croco framework range from simple evidence look-up for user-defined regulatory interactions to the identification of conserved sub-networks in diverse cell-lines, conditions, and even species. the croco web-application and cytoscape plug-in are freely available at: http://services.bio.ifi.lmu.de/croco-web. the cross-species conservation framework provides a network-oriented view on the encode regulatory data, convenient ways to access and browse networks and metadata, and a method to combine networks across compendia, experimental techniques, and species. these ddrns are useful for the understanding of regulatory mechanisms and helpful for interpreting biomedical data. the web-page links to a detailed system description, a user guide, and tutorial videos presenting common use cases of the croco framework.
 many large data compendia on context-specific high-throughput genomic and regulatory data have been made available by international research consortia such as encode, tcga, and epigenomics roadmap. the use of these resources is impaired by the sheer size of the available big data and big metadata. many of these context-specific data can be modeled as data derived regulatory networks representing the complex and complicated interactions between transcription factors and target genes. these ddrns are useful for the understanding of regulatory mechanisms and helpful for interpreting biomedical data.  the cross-species conservation framework provides a network-oriented view on the encode regulatory data, convenient ways to access and browse networks and metadata, and a method to combine networks across compendia, experimental techniques, and species. ddrns can be combined with additional information and networks derived from the literature, curated resources, and computational predictions in order to enable detailed exploration and cross checking of regulatory interactions. applications of the croco framework range from simple evidence look-up for user-defined regulatory interactions to the identification of conserved sub-networks in diverse cell-lines, conditions, and even species.  croco adds an intuitive unifying view on the data from the encode projects via a comprehensive repository of derived context-specific regulatory networks and enables flexible cross-context, cross-species, and cross-compendia comparison via a basis set of analysis tools. the croco web-application and cytoscape plug-in are freely available at: http://services.bio.ifi.lmu.de/croco-web. the web-page links to a detailed system description, a user guide, and tutorial videos presenting common use cases of the croco framework. keywords encodegene regulatory networks cross-species transfercytoscapeweb applicationsoftwaredfg recessdfg crc conformational switchesissue-copyright-statement© the author 2016 