BACKGROUND
the recent advances in experimental biotechnologies have made it possible to start screening genome-wide datasets of quantitative genetic interactions in model organisms such as yeast  <cit> .
high-throughput genetic screening approaches, such as those based on epistatic miniarray profiling   <cit> , genetic interaction mapping   <cit> , and synthetic genetic array   <cit> , have provided systematic means to global investigation of quantitative relationship between genotype and phenotype, with potential implications for a wide range of biological phenomena, including, for instance, modularity, essentiality, redundancy, buffering, epistasis, evolution, canalization and development of human disease  <cit> .
the rapid accumulation of quantitative genetic interaction data is providing us with unique opportunities to decipher how genes function as networks to regulate cellular processes and to maintain mutational robustness.
however, the massive datasets also call for principled modelling frameworks and efficient analytic approaches to take a full advantage of the in-depth information encoded in the available and emerging quantitative interaction datasets  <cit> .
in particular, efficient bioinformatics procedures enabling integrative analysis of multiple datasets from various screening approaches could increase the quality and coverage of the genetic interaction maps, with the aim of completing the genetic interaction networks in yeast and other organisms.
comparing the results from the alternative experimental approaches is crucial for validating the observed interactions, estimating the biases related to each approach, and filling the gaps in the currently incomplete datasets.
it is therefore likely that comprehensive mapping of the quantitative genetic interaction networks will require integration of a number datasets from different screening approaches, similar to the recent efforts to complete the physical protein-protein interaction  networks in yeast and human  <cit> .
a major challenge in such integrative analysis is that quantitative interaction data generated with the complementary experimental approaches in different laboratories are not directly comparable, due to differences, for instance, in experimental designs, growth conditions or screening protocols as well as in data pre-processing or scoring options.
even when the same mutant pairs are considered, the technical variation can lead to some disagreement in the detection results and to relatively large inconsistency between the datasets in general  <cit> .
the correction for such discrepancy can be beyond the capacity of the customized data processing techniques used within the individual screening approaches  <cit> .
a common modelling framework, adjusted for the different screening approaches, could improve the comparability of the results and allow for integrative analysis.
compared to ppi networks, an additional challenge originates from the quantitative nature of the genetic interaction datasets; instead of comparing the overlap in binary terms, such as presence or absence of a physical interaction, here we should take into account the full spectrum of genetic interactions, ranging from extreme cases of negative interactions  to the positive classes of interacting pairs   <cit> .
we have recently shown that the quantitative data matrices obtained from the individual quantitative screening approaches can capture different portions of this spectrum, as compared to known classes of genetic interactions; for instance, the sga and gim datasets captured relatively well the negative classes of interactions, whereas the prediction of the positive interactions proved much more challenging when using the provided double-mutant fitness data alone  <cit> .
similar observations have been made also when using the highly processed e-map data  <cit> .
to improve the predictive power of the individual quantitative datasets, we further developed our computational matrix approximation strategy  <cit> , and showed that it could transform the original fitness matrices so that these allow for better discrimination of not only negative but also the positive end of interaction spectrum from the background variability  <cit> .
in the present study, toward combining the quantitative detections from multiple large-scale genetic interaction approaches, we investigated the consistency among the currently available quantitative interaction datasets in yeast, as well as the sensitivity and specificity of the genetic interactions detected by using the three screening approaches , with respect to their overlap in common mutant pairs and coverage of known interacting pairs, as extracted from a gold-standard reference database of genetic interactions .
we first show that the comparability of the detections between the different approaches can be improved using standardized matrix-based modelling framework within each individual dataset.
using appropriate scoring and aggregation functions, we then demonstrate how the detections from the different screening approaches can be combined more effectively, compared to that when using the individual datasets alone, suggesting that the matrix approximation-based meta-analytic procedure allows for the full exploitation of the existing data when predicting novel interactions or designing new experiments.
to promote its widespread usage in the future screening studies, we have made publicly available an efficient, stand-alone r-implementation of the quantile-based matrix approximation procedure , which includes a number of user-adjustable options that can be used to fine-tune the procedure for any given experimental dataset.
RESULTS
scoring of quantitative genetic interactions
we have previously introduced a matrix-based modelling and approximation framework, and showed that it provides a quantitative and efficient means for scoring genetic interactions among thousands of genes, thereby leading to improved detection of both positive and negative pairs of interactions in large-scale quantitative screening experiments  <cit> .
briefly, the matrix approximation strategy is based on the observation that most gene pairs in the large-scale genetic interaction screens have no significant interaction with each other  <cit> .
this implies that the single-mutant fitness effects, which are needed in the interaction scoring, could be estimated using solely the information encoded in the observed, double-mutant fitness matrix w, with entries wab corresponding to the m query and n array strains, respectively, that is, a =  <dig> ,...m and b =  <dig> ,...n. the underlying idea of the matrix approximation it to decompose the original fitness matrix into separate components, w = x ⊗y, where the m and n-dimensional vectors x and y model the variability across the array and query mutants, respectively  <cit> .
in the symmetric case, that is , the above equation expresses in matrix notation the well-established multiplicative null model, wab = wawb, which states that the expected neutral phenotype of an organism's fitness, under the null hypothesis that it carries two non-interacting mutations , can be estimated by the product of the corresponding single-mutant fitness effects   <cit> .
it was shown on symmetric, high-resolution data that the product function is the best null model among a family of alternative models , in the sense that it yields a distribution with location close to zero and low dispersion over all of the measured deviations εab = wab - wawb  <cit> .
in the non-symmetric case, n ≠ m, even though the single-mutant effects x and y are not necessarily equal, these together can provide individual estimates for wa and wb, respectively.
in the present work, the estimation of x and y was performed using a robust, rank-one matrix approximation method, named quantile-based matrix approximation   <cit> .
after performing the approximation of the double-mutant fitness matrix w under the null multiplicative model, the interaction class of a mutant pair  can be predicted using a specific scoring function s, such as minimum, maximum, product or scaled epistasis  <cit> , which transform the original fitness matrix into a score  matrix sab = wab - s. it has been shown before that there exists effective alternatives to the traditional product function when further classifying the significant genetic interactions into the positive and negative classes  <cit> .
accordingly, the score values sab can be used in place of the traditional deviations εab to test for a genetic interaction between genes a and b, where a large absolute score provides evidence for genetic interaction, while scores close to zero indicate non-interacting gene pairs.
the positive interactions  should result in positive scores , and the negative interactions  in negative scores , with synthetic lethality being the extreme case .
following the lessons learned from the integrative analysis of high-throughput ppi datasets  <cit> , we first evaluated separately the data from the individual screening approaches , against a gold-standard reference database of know interactions   <cit> .
such within-approach benchmarking resulted in specific parameter combinations for the data-adjusted qma estimates and scoring functions for positive and negative genetic interaction classes   <cit> .
in the following analyses, we utilized these same parameters and scoring functions to assess their robustness, and to demonstrate the relative advantages of the generic matrix approximation strategy, in terms of both improved comparability of the interaction scores as well as integrative detection of genetic interactions, among the screening approaches, in comparison to using the individual datasets alone.
our specific focus here is on the detection of pairs of positive interactions, the accurate scoring of which has been challenging in the past despite the quantitative approaches.
agreement between the quantitative datasets
using the datasets available from three representative screening approaches  <cit> , we started with pairwise comparisons among the three datasets and characterized the number of common pairs of array and query mutants shared by the datasets , as well as the distribution of the known pairs of positive and negative interactions into the data intersections .
the number of shared mutant pairs was largest in the sga - e-map data pair , second largest in the sga - gim data pair , and smallest in the gim - e-map data pair .
to investigate the coverage of the known pairs of genetic interactions in the three datasets, we used the existing information on genetically interacting pairs as available in the gold-standard biogrid database  <cit> .
for the positive class of interactions, we combined the 'positive genetic' and 'phenotypic suppression' categories, which are composed of alleviating mutant pairs, and for the negative class of interactions, we merged four of the biogrid's aggravating categories, namely, 'negative genetic', 'synthetic growth defect', 'synthetic lethality', and 'phenotypic enhancement'.
the values above the diagonal give the number of array and query mutants in common between each pair of datasets, and the values below the diagonal give the percentage of the overlap when compared to the smaller of the two datasets.
the diagonal gives the original dataset dimensions .
only the non-missing mutant pairs shared by the datasets were included in the comparative analyses.
the original studies were as follows: sga  <cit> , gim  <cit> , e-map  <cit> .
the values above and below the diagonal give the number and percentage, respectively, of known genetic interactions in each of the pairwise intersections as available from biogrid .
left, positive interactions; right, negative interactions.
only the unambiguous mutant pairs were used here in the comparative evaluations.
the biogrid interactions extracted from these three datasets under the study were pairwise excluded from the positive and negative classes of reference interactions.
the diagonal gives the number of interactions excluded from each of the individual datasets.
in addition to the e-map dataset used in the present analyses, the biogrid database contains genetic interactions extracted from three other large-scale screening studies performed with the e-map approach  <cit> .
the three dataset intersections contained such interactions as follows : sga - gim  <dig> / <dig> , sga - e-map  <dig> / <dig> , and gim - e-map:  <dig> / <dig> .
even if the interactions extracted from the three datasets under study were pairwise deleted from the biogrid's genetic interaction categories , there may remain some bias in these categories toward the e-map approach due to the large number of interactions identified in the three other large-scale e-map studies  <cit> .
if these had also been excluded from the comparative analyses, the sizes of the reference positive and negative classes would have become much smaller, hence hindering the comparative evaluations.
due to this potential bias, the interaction detection results for the data pairs other than the sga - gim should be interpreted with caution.
moreover, it was not initially expected that the matrix approximation could provide any further improvements in the e-map data, since this data has already been heavily pre-processed and custom-scored against an expected fitness  <cit> , resulting in a symmetric and close to zero-centered data matrix  <cit> .
therefore, we focus here on illustrating the benefits of qma-based integrative analysis using the detection of positive interactions in the sga - gim data pair as our principal case study; however, the full set of results are provided in additional files  <dig> -  <dig>
the correlations between the double-mutant fitness matrices were relatively poor among all the three dataset pairs ; especially striking is the negative correlation between the sga and gim fitness matrices .
beyond the original fitness matrices, we also evaluated - as for the point of comparison for our qma-based scoring system - their scored versions using the custom-designed scoring systems in the sga dataset   <cit> , and the median estimate for the single-mutant effects with product scoring function in the gim and e-map datasets   <cit> .
it was found out, however, that the correlation between the interaction scores between the screening approaches remained relatively low even after such scoring of the individual datasets .
as expected, the comparability of the originally scored e-map dataset did not improve by the use of an additional median scoring, especially when the non-parametric spearman's rank correlation coefficient was being used as a measure of association between the datasets.
in contrast, the sga and gim datasets benefited to some extent from their individual scorings.
the values above and below the diagonal give the pearson and spearman correlation, respectively, as calculated over the non-missing mutant pairs shared by each dataset pair.
fitness, original double-mutant fitness measurements from a screening approach; score, custom-designed score provided in the sga dataset or the median estimate for single-mutant effects with product scoring function in the e-map and gim datasets.
the reason for the negligible correlation between the sga and gim datasets is clearly visible in their scatter plot .
it is very difficult to see any apparent patterns of association between the original double-mutant fitness measurements, even for those mutant pairs coding for known genetic interaction .
the custom-scored versions could not provide much improvement in their association, especially for the positive pairs of interactions .
similar observations were made also in the other dataset pairs .
it should be noted, however, that for reproducible identification of genetic interactions, it suffices that the datasets share similar levels of interaction scores for the most extreme pairs .
similarly, since the ranking of the mutant pairs in terms of their evidence for genetic interactions is of more practical and biological importance, and due to the sensitivity of the pearson correlation to data transformations and outlier pairs, we will use the more robust spearman's rank correlation coefficient as our principal measure of association between the quantitative genetic interaction datasets in the next sections.
predictive relationship between the datasets
to investigate whether the matrix approximation-based scoring strategy could enhance the between-approach comparability of the quantitative information encoded in the double-mutant fitness matrices, we next used the same estimation parameters and scoring functions defined in the previous within-approach evaluations  <cit> .
briefly, three parameter combinations for the two qma parameters were specified per each dataset: one for detecting all the interaction classes simultaneously , and the others for detecting either the negative or positive classes separately .
the scoring functions were also shown to be specific to the alleviating and aggravating interaction classes .
with the use of these qma-based single-mutant fitness estimation and interaction scoring options, there was an increasing trend in the spearman's rank correlation coefficient between all the three datasets, when compared to the original double-mutant fitness measurements or the reference scoring approaches, especially when the adjusted qma setting was used for the positive interactions .
interestingly, with qma adjusted to negative interactions, the original sga double-mutant fitness matrix provided better correlation with the gim dataset than when using the custom-designed sga scores .
the relatively low spearman's rank correlation in the interaction scores between the sga and gim datasets is also visible in their rank-based scatter plots .
even if there were no clear patterns of association in the interactions rankings as a whole, the bulk of the positive pairs were supported consistently by both of the datasets, with only a relatively few interaction pairs near one of the data axes only.
such mutant pairs with discrepancy in their interaction scores may be either due to differences in the screening approaches or due to false positive findings.
the interaction pairs lying in the middle of the rank scatter plot are likely to correspond to true non-interaction mutant pairs .
with the negative interaction pairs, there seems to be more variability between the datasets, which may be attributable to the fact that we used here the fixed qma parameters and scoring functions chosen for positive interactions for illustration purposes.
moreover, the number of known negative interactions is much higher than the number of positive interactions in the datasets .
even so, the enrichment of both positive and negative pairs at the extreme corners of the two-dimensional grid was highly statistically significant .
similar findings were also seen in the other datasets .
although the spearman's correlation is useful for evaluating an overall association between interaction datasets, it may be dominated by the non-interacting pairs near the zero scores, which often are not the most interesting from the biological point of view.
to evaluate the agreement between the interaction scores among the most extreme levels, we tested next how accurately one can predict the 3% of the most positive values across the datasets using the same options as in figure  <dig>  similarly as with the rank correlation coefficient, the predictive accuracy increased when moving from the original double-mutant fitness values and their custom or median scores to the qma-based scores using either its fixed or adjusted settings in all the three data pairs .
these results demonstrate that it is possible to find such estimation parameters and scoring functions that can markedly improve the prediction of those most extreme positive interaction scores that are shared across the datasets, compared to using the original fitness values or interaction scores only.
in the negative classes of interactions, these baseline prediction accuracies were already much higher, especially in those pairs involving the e-map dataset, and, accordingly, the benefits of the qma procedure were not so evident here .
the modelling framework makes it also possible to avoid performing the single-mutant growth experiments in the large-scale genetic interaction screens, without compromising their quantitative scoring accuracy.
moreover, the model-estimated array-vector was in a good agreement with the experimentally-derived single-mutant fitness measurements available in the sga data .
despite such high rank correlation levels, however, there is a significant difference in the location and scaling between the estimated and measured fitness values, indicating that the estimates encode added information for interaction scoring.
the qma settings used here were originally selected on the basis of the pre-release version of the sga data  <cit> , which contained only  <dig> of the query mutations of the current sga dataset , thus indicating the robustness of the qma settings.
in the following section, we further highlight the potential of the model-based strategy in integrative analysis by using the same qma setup selected specifically for the positive interactions, even if this will likely to result in compromised prediction accuracies in the negative interaction classes.
integrative identification of genetic interactions
after showing that the usage of the matrix approximation-based scoring system in place of the original double-mutant fitness matrix or its custom-scored version can lead to improvements in the comparability between the dataset pairs, we next evaluated whether these observed improvements in the rank correlation or prediction of the extreme pairs could contribute also to improved identification of genetic interactions, when using multiple datasets together, compared to using single datasets alone.
to choose an appropriate data integration approach, we first evaluated the predictive performance of four rank aggregation functions , in terms of how accurately they can detect known pairs of interacting genes.
even if the qma-based scoring setup was aimed here at the detection of positive interactions, we further tested its prediction capability also for the negative interactions to study its generalization capability beyond the type of interactions it was initially designed for.
the prediction performance is illustrated here using the unbiased gim-sga data pair, whereas the e-map - sga and e-map - gim pairs are provided in additional file  <dig>
when combining the interaction scores in the sga and gim datasets to detect pairs of positive interactions, the conservative maximum aggregation score gave the best prediction accuracy in terms of the overall auc .
however, when focusing on the early sensitivity at the highest specificity levels , which are often more important in many practical applications, the borda count and rank product were the two best performing methods .
in the detection of the negative interactions in the sga - gim dataset pair, the rank product performed better than the borda count or either of the individual datasets alone , whereas the liberal minimum rank gave the highest overall auc performance .
the good performance of the borda count and rank product with the positive interactions was also supported by the integrative analysis in the sga - e-map and e-map - gim dataset pairs, especially at the highest specificity levels .
however, the maximum function soon outperformed these two methods when an increasing number of positive interactions were predicted .
the rank product was found generally best in the prediction of negative interactions in each of the dataset pairs.
the bolded values indicate the best ranking method in terms of the three evaluation metrics: early sensitivity, true positive rate  at 1% false positive rate ; partial auc, area under the curve  at 10% fpr; overall auc, auc at 100% fpr.
the random classifier accuracies were used as baseline for assessing whether similar accuracies could be obtained by pure chance alone.
the rankings provided by the individual datasets  were used as reference values for the integrative detection using four different rank aggregation functions .
the detection accuracies of the e-map ranking alone may be highly overestimated due to a large number of such genetic interaction pairs in the biogrid that were extracted from the other large-scale e-map screening studies .
taken together the integrative prediction results in the three dataset pairs, the borda count and the rank product performed equally well when the aim is to identify the first candidate set of positive interactions with the highest specificity for follow-up studies, whereas the more stringent maximum function provided the best prediction accuracy when larger numbers of positive interactions are being identified.
in the detection of negative interactions, the intermediate rank product showed consistently the best results among all the data pairs, making it an appropriate rank aggregation function in case both positive and negative interactions are being detected using the same setup.
in addition to showing the benefits of the integrative detection, these results can also be used for comparative evaluation of the detection power among the individual datasets from the different screening approaches.
for instance, on the basis of the same reference set of known interactions on a common set of shared mutant pairs in the sga and gim datasets, the gim approach seems to detect particularly well larger number of negative interactions , whereas the nearly genome-wide sga dataset provides comparable detection power in the positive end of the genetic interaction spectrum .
although the integrative detection based on combined scores was shown to provide marked improvements in the detection of both positive and negative interaction classes when using the sga and gim datasets together, it was interesting to note that in the sga - e-map dataset pair, the e-map data alone provided extremely good detection accuracies in the positive class of interactions .
rather than being a result of the superiority of this particular dataset, this is more likely attributable to the fact that many of the pairs  of positive interactions in the biogrid originate from the other large-scale genetic interaction screens performed with the e-map approach  <cit>  .
these pairs clearly dominate the joint distribution of the positive interactions, while being supported by the sga approach to a varying degree .
interestingly, the detection of the negative interactions by the e-map approach alone was found sub-optimal .
moreover, the additional benefits gained by the integrative analysis were more pronounced in the gim - e-map than in the sga - e-map data pair .
these results demonstrate that the intrinsic differences between the screening approaches influence how much they can complement each other.
CONCLUSIONS
to our knowledge, the present study is the first systematic and objective comparative evaluation of data from the main large-scale quantitative genetic interaction screening approaches .
we showed here that even if the association between the original fitness measurements or their interaction scores is relatively low, their comparability can be improved by means of our matrix approximation technique.
toward an integrative analysis, we showed that a multi-approach analysis of quantitative genetic interactions can provide novel findings which are complementary to those obtained using any single screening approach alone.
an integrative analysis can therefore provide a systematic means to pool information from previous interaction studies, with the aim of maximizing the number of both positive and negative interactions without compromising the reliability of the detections, as well as of minimizing the number of additional experiments needed when prioritizing of future screens.
in general, such computational approach can facilitate the experimental efforts by improving the quality and coverage of the current genetic interaction networks, towards completing the still incomplete information of genetic interactions in yeast, which is - by and large - complementary to that obtained from the physical protein interactions and complexes  <cit> .
although these results already demonstrate the potential of integrating datasets across different screening approaches using the matrix approximation strategy, more comprehensive studies are warranted in the future that combine experimental data from various types of genetic interaction studies, such as those performed under different environmental conditions, using fitness phenotypes other than growth, or on multiple perturbations or study organisms to investigate questions related, for instance, to plasticity and evolution of genetic networks or higher-order and interspecies interactions  <cit> .
although we illustrated here the feasibility of the integrative analysis through qma with its previously fixed parameters and scoring functions selected for each screening approach individually, even better prediction accuracies will likely to be obtained after a systematic optimization of these options for each dataset combination, downstream analysis objective, and interaction strength level separately .
the efficient qma r-package, which includes a number of user-adjustable parameters , was made available here to enable such tailored matrix approximation that meets the needs of a given study.
a potential limitation of the current evaluation setup is the definition of the reference set of interactions using the biogrid database.
for instance, since the interactions in the biogrid database originate from multiple genetic interaction screening studies, there can be cases where a mutant pair ab is reported as encoding an interaction, even if ba is not, or where the reciprocal pairs ab and ba are marked as belonging to different classes of interactions.
to make sure that such cases do not interfere with the comparative evaluations, we filtered out any unambiguous interaction pairs, and for the remaining interactions, we used the same interaction class for the reciprocal mutant pairs.
moreover, to provide as fair assessment as possible, we excluded those interactions identified from the datasets under comparison.
therefore, the detection accuracies presented here should be considered as lower bounds for the true accuracy of the screening approaches or their combination.
even if there may still remain some biases, especially toward the well-represented e-map approach, the biogrid database includes also a wide range of other large-scale studies, thus providing a comprehensive reference set for the evaluations.
to improve the future benchmarking studies, it would be beneficial to add a specific category for known non-interacting mutant pairs, similar to that available for physically non-interacting protein pairs  <cit> .
analogous to efforts for completing the mapping of the physical ppi networks  <cit> , it would be important to provide the community with an easy access also to the raw interaction datasets, similar to that provided in the sga database drygin  <cit> .
for instance, our matrix approximation procedure was much more efficient with the original double-mutant fitness measurements, as provided by the sga and gim laboratories, compared to the highly processed and scored e-map datasets.
the results with the e-map being one of the datasets were in many cases drastically different from that with the sga - gim dataset pair.
as with any high-throughput assays, the large-scale genetic screening approaches are inherently noisy and biased in their nature, suggesting that each single assay can reveal only a limited scope of the full spectrum of genetic interaction classes.
therefore, it is likely that integrative analysis of data from the complementary screening approaches will be essential to complete the quantitative genetic interaction networks in yeast and other organisms.
we invite those participating in the genetic interaction mapping effort to try out the matrix approximation-based procedure and to give us input and suggestions for its further improvements.

 the recent advances in experimental biotechnologies have made it possible to start screening genome-wide datasets of quantitative genetic interactions in model organisms such as yeast. high-throughput genetic screening approaches, such as those based on epistatic miniarray profiling, genetic interaction mapping, and synthetic genetic array, have provided systematic means to global investigation of quantitative relationship between genotype and phenotype, with potential implications for a wide range of biological phenomena, including, for instance, modularity, essentiality, redundancy, buffering, epistasis, evolution, canalization and development of human disease. the rapid accumulation of quantitative genetic interaction data is providing us with unique opportunities to decipher how genes function as networks to regulate cellular processes and to maintain mutational robustness. however, the massive datasets also call for principled modelling frameworks and efficient analytic approaches to take a full advantage of the in-depth information encoded in the available and emerging quantitative interaction datasets. in particular, efficient bioinformatics procedures enabling integrative analysis of multiple datasets from various screening approaches could increase the quality and coverage of the genetic interaction maps, with the aim of completing the genetic interaction networks in yeast and other organisms. comparing the results from the alternative experimental approaches is crucial for validating the observed interactions, estimating the biases related to each approach, and filling the gaps in the currently incomplete datasets. it is therefore likely that comprehensive mapping of the quantitative genetic interaction networks will require integration of a number datasets from different screening approaches, similar to the recent efforts to complete the physical protein-protein interaction networks in yeast and human. a major challenge in such integrative analysis is that quantitative interaction data generated with the complementary experimental approaches in different laboratories are not directly comparable, due to differences, for instance, in experimental designs, growth conditions or screening protocols as well as in data pre-processing or scoring options. even when the same mutant pairs are considered, the technical variation can lead to some disagreement in the detection results and to relatively large inconsistency between the datasets in general. the correction for such discrepancy can be beyond the capacity of the customized data processing techniques used within the individual screening approaches. a common modelling framework, adjusted for the different screening approaches, could improve the comparability of the results and allow for integrative analysis. compared to ppi networks, an additional challenge originates from the quantitative nature of the genetic interaction datasets; instead of comparing the overlap in binary terms, such as presence or absence of a physical interaction, here we should take into account the full spectrum of genetic interactions, ranging from extreme cases of negative interactions to the positive classes of interacting pairs. we have recently shown that the quantitative data matrices obtained from the individual quantitative screening approaches can capture different portions of this spectrum, as compared to known classes of genetic interactions; for instance, the sga and gim datasets captured relatively well the negative classes of interactions, whereas the prediction of the positive interactions proved much more challenging when using the provided double-mutant fitness data alone. similar observations have been made also when using the highly processed e-map data. to improve the predictive power of the individual quantitative datasets, we further developed our computational matrix approximation strategy, and showed that it could transform the original fitness matrices so that these allow for better discrimination of not only negative but also the positive end of interaction spectrum from the background variability. in the present study, toward combining the quantitative detections from multiple large-scale genetic interaction approaches, we investigated the consistency among the currently available quantitative interaction datasets in yeast, as well as the sensitivity and specificity of the genetic interactions detected by using the three screening approaches, with respect to their overlap in common mutant pairs and coverage of known interacting pairs, as extracted from a gold-standard reference database of genetic interactions. we first show that the comparability of the detections between the different approaches can be improved using standardized matrix-based modelling framework within each individual dataset. using appropriate scoring and aggregation functions, we then demonstrate how the detections from the different screening approaches can be combined more effectively, compared to that when using the individual datasets alone, suggesting that the matrix approximation-based meta-analytic procedure allows for the full exploitation of the existing data when predicting novel interactions or designing new experiments. to promote its widespread usage in the future screening studies, we have made publicly available an efficient, stand-alone r-implementation of the quantile-based matrix approximation procedure, which includes a number of user-adjustable options that can be used to fine-tune the procedure for any given experimental dataset.  scoring of quantitative genetic interactions we have previously introduced a matrix-based modelling and approximation framework, and showed that it provides a quantitative and efficient means for scoring genetic interactions among thousands of genes, thereby leading to improved detection of both positive and negative pairs of interactions in large-scale quantitative screening experiments. briefly, the matrix approximation strategy is based on the observation that most gene pairs in the large-scale genetic interaction screens have no significant interaction with each other. this implies that the single-mutant fitness effects, which are needed in the interaction scoring, could be estimated using solely the information encoded in the observed, double-mutant fitness matrix w, with entries wab corresponding to the m query and n array strains, respectively, that is, a =,...m and b =,...n. the underlying idea of the matrix approximation it to decompose the original fitness matrix into separate components, w = x ⊗y, where the m and n-dimensional vectors x and y model the variability across the array and query mutants, respectively. in the symmetric case, that is, the above equation expresses in matrix notation the well-established multiplicative null model, wab = wawb, which states that the expected neutral phenotype of an organism's fitness, under the null hypothesis that it carries two non-interacting mutations, can be estimated by the product of the corresponding single-mutant fitness effects. it was shown on symmetric, high-resolution data that the product function is the best null model among a family of alternative models, in the sense that it yields a distribution with location close to zero and low dispersion over all of the measured deviations εab = wab - wawb. in the non-symmetric case, n ≠ m, even though the single-mutant effects x and y are not necessarily equal, these together can provide individual estimates for wa and wb, respectively. in the present work, the estimation of x and y was performed using a robust, rank-one matrix approximation method, named quantile-based matrix approximation. after performing the approximation of the double-mutant fitness matrix w under the null multiplicative model, the interaction class of a mutant pair can be predicted using a specific scoring function s, such as minimum, maximum, product or scaled epistasis, which transform the original fitness matrix into a score matrix sab = wab - s. it has been shown before that there exists effective alternatives to the traditional product function when further classifying the significant genetic interactions into the positive and negative classes. accordingly, the score values sab can be used in place of the traditional deviations εab to test for a genetic interaction between genes a and b, where a large absolute score provides evidence for genetic interaction, while scores close to zero indicate non-interacting gene pairs. the positive interactions should result in positive scores, and the negative interactions in negative scores, with synthetic lethality being the extreme case. following the lessons learned from the integrative analysis of high-throughput ppi datasets, we first evaluated separately the data from the individual screening approaches, against a gold-standard reference database of know interactions. such within-approach benchmarking resulted in specific parameter combinations for the data-adjusted qma estimates and scoring functions for positive and negative genetic interaction classes. in the following analyses, we utilized these same parameters and scoring functions to assess their robustness, and to demonstrate the relative advantages of the generic matrix approximation strategy, in terms of both improved comparability of the interaction scores as well as integrative detection of genetic interactions, among the screening approaches, in comparison to using the individual datasets alone. our specific focus here is on the detection of pairs of positive interactions, the accurate scoring of which has been challenging in the past despite the quantitative approaches. agreement between the quantitative datasets using the datasets available from three representative screening approaches, we started with pairwise comparisons among the three datasets and characterized the number of common pairs of array and query mutants shared by the datasets, as well as the distribution of the known pairs of positive and negative interactions into the data intersections. the number of shared mutant pairs was largest in the sga - e-map data pair, second largest in the sga - gim data pair, and smallest in the gim - e-map data pair. to investigate the coverage of the known pairs of genetic interactions in the three datasets, we used the existing information on genetically interacting pairs as available in the gold-standard biogrid database. for the positive class of interactions, we combined the'positive genetic' and'phenotypic suppression' categories, which are composed of alleviating mutant pairs, and for the negative class of interactions, we merged four of the biogrid's aggravating categories, namely,'negative genetic','synthetic growth defect','synthetic lethality', and'phenotypic enhancement'. the values above the diagonal give the number of array and query mutants in common between each pair of datasets, and the values below the diagonal give the percentage of the overlap when compared to the smaller of the two datasets. the diagonal gives the original dataset dimensions. only the non-missing mutant pairs shared by the datasets were included in the comparative analyses. the original studies were as follows: sga, gim, e-map. the values above and below the diagonal give the number and percentage, respectively, of known genetic interactions in each of the pairwise intersections as available from biogrid. left, positive interactions; right, negative interactions. only the unambiguous mutant pairs were used here in the comparative evaluations. the biogrid interactions extracted from these three datasets under the study were pairwise excluded from the positive and negative classes of reference interactions. the diagonal gives the number of interactions excluded from each of the individual datasets. in addition to the e-map dataset used in the present analyses, the biogrid database contains genetic interactions extracted from three other large-scale screening studies performed with the e-map approach. the three dataset intersections contained such interactions as follows: sga - gim /, sga - e-map /, and gim - e-map: /. even if the interactions extracted from the three datasets under study were pairwise deleted from the biogrid's genetic interaction categories, there may remain some bias in these categories toward the e-map approach due to the large number of interactions identified in the three other large-scale e-map studies. if these had also been excluded from the comparative analyses, the sizes of the reference positive and negative classes would have become much smaller, hence hindering the comparative evaluations. due to this potential bias, the interaction detection results for the data pairs other than the sga - gim should be interpreted with caution. moreover, it was not initially expected that the matrix approximation could provide any further improvements in the e-map data, since this data has already been heavily pre-processed and custom-scored against an expected fitness, resulting in a symmetric and close to zero-centered data matrix. therefore, we focus here on illustrating the benefits of qma-based integrative analysis using the detection of positive interactions in the sga - gim data pair as our principal case study; however, the full set of results are provided in additional files - the correlations between the double-mutant fitness matrices were relatively poor among all the three dataset pairs; especially striking is the negative correlation between the sga and gim fitness matrices. beyond the original fitness matrices, we also evaluated - as for the point of comparison for our qma-based scoring system - their scored versions using the custom-designed scoring systems in the sga dataset, and the median estimate for the single-mutant effects with product scoring function in the gim and e-map datasets. it was found out, however, that the correlation between the interaction scores between the screening approaches remained relatively low even after such scoring of the individual datasets. as expected, the comparability of the originally scored e-map dataset did not improve by the use of an additional median scoring, especially when the non-parametric spearman's rank correlation coefficient was being used as a measure of association between the datasets. in contrast, the sga and gim datasets benefited to some extent from their individual scorings. the values above and below the diagonal give the pearson and spearman correlation, respectively, as calculated over the non-missing mutant pairs shared by each dataset pair. fitness, original double-mutant fitness measurements from a screening approach; score, custom-designed score provided in the sga dataset or the median estimate for single-mutant effects with product scoring function in the e-map and gim datasets. the reason for the negligible correlation between the sga and gim datasets is clearly visible in their scatter plot. it is very difficult to see any apparent patterns of association between the original double-mutant fitness measurements, even for those mutant pairs coding for known genetic interaction. the custom-scored versions could not provide much improvement in their association, especially for the positive pairs of interactions. similar observations were made also in the other dataset pairs. it should be noted, however, that for reproducible identification of genetic interactions, it suffices that the datasets share similar levels of interaction scores for the most extreme pairs. similarly, since the ranking of the mutant pairs in terms of their evidence for genetic interactions is of more practical and biological importance, and due to the sensitivity of the pearson correlation to data transformations and outlier pairs, we will use the more robust spearman's rank correlation coefficient as our principal measure of association between the quantitative genetic interaction datasets in the next sections. predictive relationship between the datasets to investigate whether the matrix approximation-based scoring strategy could enhance the between-approach comparability of the quantitative information encoded in the double-mutant fitness matrices, we next used the same estimation parameters and scoring functions defined in the previous within-approach evaluations. briefly, three parameter combinations for the two qma parameters were specified per each dataset: one for detecting all the interaction classes simultaneously, and the others for detecting either the negative or positive classes separately. the scoring functions were also shown to be specific to the alleviating and aggravating interaction classes. with the use of these qma-based single-mutant fitness estimation and interaction scoring options, there was an increasing trend in the spearman's rank correlation coefficient between all the three datasets, when compared to the original double-mutant fitness measurements or the reference scoring approaches, especially when the adjusted qma setting was used for the positive interactions. interestingly, with qma adjusted to negative interactions, the original sga double-mutant fitness matrix provided better correlation with the gim dataset than when using the custom-designed sga scores. the relatively low spearman's rank correlation in the interaction scores between the sga and gim datasets is also visible in their rank-based scatter plots. even if there were no clear patterns of association in the interactions rankings as a whole, the bulk of the positive pairs were supported consistently by both of the datasets, with only a relatively few interaction pairs near one of the data axes only. such mutant pairs with discrepancy in their interaction scores may be either due to differences in the screening approaches or due to false positive findings. the interaction pairs lying in the middle of the rank scatter plot are likely to correspond to true non-interaction mutant pairs. with the negative interaction pairs, there seems to be more variability between the datasets, which may be attributable to the fact that we used here the fixed qma parameters and scoring functions chosen for positive interactions for illustration purposes. moreover, the number of known negative interactions is much higher than the number of positive interactions in the datasets. even so, the enrichment of both positive and negative pairs at the extreme corners of the two-dimensional grid was highly statistically significant. similar findings were also seen in the other datasets. although the spearman's correlation is useful for evaluating an overall association between interaction datasets, it may be dominated by the non-interacting pairs near the zero scores, which often are not the most interesting from the biological point of view. to evaluate the agreement between the interaction scores among the most extreme levels, we tested next how accurately one can predict the 3% of the most positive values across the datasets using the same options as in figure similarly as with the rank correlation coefficient, the predictive accuracy increased when moving from the original double-mutant fitness values and their custom or median scores to the qma-based scores using either its fixed or adjusted settings in all the three data pairs. these results demonstrate that it is possible to find such estimation parameters and scoring functions that can markedly improve the prediction of those most extreme positive interaction scores that are shared across the datasets, compared to using the original fitness values or interaction scores only. in the negative classes of interactions, these baseline prediction accuracies were already much higher, especially in those pairs involving the e-map dataset, and, accordingly, the benefits of the qma procedure were not so evident here. the modelling framework makes it also possible to avoid performing the single-mutant growth experiments in the large-scale genetic interaction screens, without compromising their quantitative scoring accuracy. moreover, the model-estimated array-vector was in a good agreement with the experimentally-derived single-mutant fitness measurements available in the sga data. despite such high rank correlation levels, however, there is a significant difference in the location and scaling between the estimated and measured fitness values, indicating that the estimates encode added information for interaction scoring. the qma settings used here were originally selected on the basis of the pre-release version of the sga data, which contained only of the query mutations of the current sga dataset, thus indicating the robustness of the qma settings. in the following section, we further highlight the potential of the model-based strategy in integrative analysis by using the same qma setup selected specifically for the positive interactions, even if this will likely to result in compromised prediction accuracies in the negative interaction classes. integrative identification of genetic interactions after showing that the usage of the matrix approximation-based scoring system in place of the original double-mutant fitness matrix or its custom-scored version can lead to improvements in the comparability between the dataset pairs, we next evaluated whether these observed improvements in the rank correlation or prediction of the extreme pairs could contribute also to improved identification of genetic interactions, when using multiple datasets together, compared to using single datasets alone. to choose an appropriate data integration approach, we first evaluated the predictive performance of four rank aggregation functions, in terms of how accurately they can detect known pairs of interacting genes. even if the qma-based scoring setup was aimed here at the detection of positive interactions, we further tested its prediction capability also for the negative interactions to study its generalization capability beyond the type of interactions it was initially designed for. the prediction performance is illustrated here using the unbiased gim-sga data pair, whereas the e-map - sga and e-map - gim pairs are provided in additional file when combining the interaction scores in the sga and gim datasets to detect pairs of positive interactions, the conservative maximum aggregation score gave the best prediction accuracy in terms of the overall auc. however, when focusing on the early sensitivity at the highest specificity levels, which are often more important in many practical applications, the borda count and rank product were the two best performing methods. in the detection of the negative interactions in the sga - gim dataset pair, the rank product performed better than the borda count or either of the individual datasets alone, whereas the liberal minimum rank gave the highest overall auc performance. the good performance of the borda count and rank product with the positive interactions was also supported by the integrative analysis in the sga - e-map and e-map - gim dataset pairs, especially at the highest specificity levels. however, the maximum function soon outperformed these two methods when an increasing number of positive interactions were predicted. the rank product was found generally best in the prediction of negative interactions in each of the dataset pairs. the bolded values indicate the best ranking method in terms of the three evaluation metrics: early sensitivity, true positive rate at 1% false positive rate; partial auc, area under the curve at 10% fpr; overall auc, auc at 100% fpr. the random classifier accuracies were used as baseline for assessing whether similar accuracies could be obtained by pure chance alone. the rankings provided by the individual datasets were used as reference values for the integrative detection using four different rank aggregation functions. the detection accuracies of the e-map ranking alone may be highly overestimated due to a large number of such genetic interaction pairs in the biogrid that were extracted from the other large-scale e-map screening studies. taken together the integrative prediction results in the three dataset pairs, the borda count and the rank product performed equally well when the aim is to identify the first candidate set of positive interactions with the highest specificity for follow-up studies, whereas the more stringent maximum function provided the best prediction accuracy when larger numbers of positive interactions are being identified. in the detection of negative interactions, the intermediate rank product showed consistently the best results among all the data pairs, making it an appropriate rank aggregation function in case both positive and negative interactions are being detected using the same setup. in addition to showing the benefits of the integrative detection, these results can also be used for comparative evaluation of the detection power among the individual datasets from the different screening approaches. for instance, on the basis of the same reference set of known interactions on a common set of shared mutant pairs in the sga and gim datasets, the gim approach seems to detect particularly well larger number of negative interactions, whereas the nearly genome-wide sga dataset provides comparable detection power in the positive end of the genetic interaction spectrum. although the integrative detection based on combined scores was shown to provide marked improvements in the detection of both positive and negative interaction classes when using the sga and gim datasets together, it was interesting to note that in the sga - e-map dataset pair, the e-map data alone provided extremely good detection accuracies in the positive class of interactions. rather than being a result of the superiority of this particular dataset, this is more likely attributable to the fact that many of the pairs of positive interactions in the biogrid originate from the other large-scale genetic interaction screens performed with the e-map approach. these pairs clearly dominate the joint distribution of the positive interactions, while being supported by the sga approach to a varying degree. interestingly, the detection of the negative interactions by the e-map approach alone was found sub-optimal. moreover, the additional benefits gained by the integrative analysis were more pronounced in the gim - e-map than in the sga - e-map data pair. these results demonstrate that the intrinsic differences between the screening approaches influence how much they can complement each other.  to our knowledge, the present study is the first systematic and objective comparative evaluation of data from the main large-scale quantitative genetic interaction screening approaches. we showed here that even if the association between the original fitness measurements or their interaction scores is relatively low, their comparability can be improved by means of our matrix approximation technique. toward an integrative analysis, we showed that a multi-approach analysis of quantitative genetic interactions can provide novel findings which are complementary to those obtained using any single screening approach alone. an integrative analysis can therefore provide a systematic means to pool information from previous interaction studies, with the aim of maximizing the number of both positive and negative interactions without compromising the reliability of the detections, as well as of minimizing the number of additional experiments needed when prioritizing of future screens. in general, such computational approach can facilitate the experimental efforts by improving the quality and coverage of the current genetic interaction networks, towards completing the still incomplete information of genetic interactions in yeast, which is - by and large - complementary to that obtained from the physical protein interactions and complexes. although these results already demonstrate the potential of integrating datasets across different screening approaches using the matrix approximation strategy, more comprehensive studies are warranted in the future that combine experimental data from various types of genetic interaction studies, such as those performed under different environmental conditions, using fitness phenotypes other than growth, or on multiple perturbations or study organisms to investigate questions related, for instance, to plasticity and evolution of genetic networks or higher-order and interspecies interactions. although we illustrated here the feasibility of the integrative analysis through qma with its previously fixed parameters and scoring functions selected for each screening approach individually, even better prediction accuracies will likely to be obtained after a systematic optimization of these options for each dataset combination, downstream analysis objective, and interaction strength level separately. the efficient qma r-package, which includes a number of user-adjustable parameters, was made available here to enable such tailored matrix approximation that meets the needs of a given study. a potential limitation of the current evaluation setup is the definition of the reference set of interactions using the biogrid database. for instance, since the interactions in the biogrid database originate from multiple genetic interaction screening studies, there can be cases where a mutant pair ab is reported as encoding an interaction, even if ba is not, or where the reciprocal pairs ab and ba are marked as belonging to different classes of interactions. to make sure that such cases do not interfere with the comparative evaluations, we filtered out any unambiguous interaction pairs, and for the remaining interactions, we used the same interaction class for the reciprocal mutant pairs. moreover, to provide as fair assessment as possible, we excluded those interactions identified from the datasets under comparison. therefore, the detection accuracies presented here should be considered as lower bounds for the true accuracy of the screening approaches or their combination. even if there may still remain some biases, especially toward the well-represented e-map approach, the biogrid database includes also a wide range of other large-scale studies, thus providing a comprehensive reference set for the evaluations. to improve the future benchmarking studies, it would be beneficial to add a specific category for known non-interacting mutant pairs, similar to that available for physically non-interacting protein pairs. analogous to efforts for completing the mapping of the physical ppi networks, it would be important to provide the community with an easy access also to the raw interaction datasets, similar to that provided in the sga database drygin. for instance, our matrix approximation procedure was much more efficient with the original double-mutant fitness measurements, as provided by the sga and gim laboratories, compared to the highly processed and scored e-map datasets. the results with the e-map being one of the datasets were in many cases drastically different from that with the sga - gim dataset pair. as with any high-throughput assays, the large-scale genetic screening approaches are inherently noisy and biased in their nature, suggesting that each single assay can reveal only a limited scope of the full spectrum of genetic interaction classes. therefore, it is likely that integrative analysis of data from the complementary screening approaches will be essential to complete the quantitative genetic interaction networks in yeast and other organisms. we invite those participating in the genetic interaction mapping effort to try out the matrix approximation-based procedure and to give us input and suggestions for its further improvements. 
using large-scale data matrices from epistatic miniarray profiling, genetic interaction mapping, and synthetic genetic array approaches, we carried out here a systematic comparative evaluation among these quantitative maps of genetic interactions in yeast. the relatively low association between the original interaction measurements or their customized scores could be improved using a matrix-based modelling framework, which enables the use of single- and double-mutant fitness estimates and measurements, respectively, when scoring genetic interactions. we have shown here that even if the correlation between the currently available quantitative genetic interaction maps in yeast is relatively low, their comparability can be improved by means of our computational matrix approximation procedure, which will enable integrative analysis and detection of a wider spectrum of genetic interactions using data from the complementary screening approaches. high-throughput genetic screening approaches have enabled systematic means to study how interactions among gene mutations contribute to quantitative fitness phenotypes, with the aim of providing insights into the functional wiring diagrams of genetic interaction networks on a global scale. toward an integrative analysis, we show how the detections from the different screening approaches can be combined to suggest novel positive and negative interactions which are complementary to those obtained using any single screening approach alone. the matrix approximation procedure has been made available to support the design and analysis of the future screening studies. however, it is poorly known how well these quantitative interaction measurements agree across the screening approaches, which hinders their integrated use toward improving the coverage and quality of the genetic interaction maps in yeast and other organisms.
 high-throughput genetic screening approaches have enabled systematic means to study how interactions among gene mutations contribute to quantitative fitness phenotypes, with the aim of providing insights into the functional wiring diagrams of genetic interaction networks on a global scale. however, it is poorly known how well these quantitative interaction measurements agree across the screening approaches, which hinders their integrated use toward improving the coverage and quality of the genetic interaction maps in yeast and other organisms.  using large-scale data matrices from epistatic miniarray profiling, genetic interaction mapping, and synthetic genetic array approaches, we carried out here a systematic comparative evaluation among these quantitative maps of genetic interactions in yeast. the relatively low association between the original interaction measurements or their customized scores could be improved using a matrix-based modelling framework, which enables the use of single- and double-mutant fitness estimates and measurements, respectively, when scoring genetic interactions. toward an integrative analysis, we show how the detections from the different screening approaches can be combined to suggest novel positive and negative interactions which are complementary to those obtained using any single screening approach alone. the matrix approximation procedure has been made available to support the design and analysis of the future screening studies.  we have shown here that even if the correlation between the currently available quantitative genetic interaction maps in yeast is relatively low, their comparability can be improved by means of our computational matrix approximation procedure, which will enable integrative analysis and detection of a wider spectrum of genetic interactions using data from the complementary screening approaches. 