DOI: 10.5281/zenodo.17399372
title: Code and key data for marine microbe gene transfer manuscript

description: Code and key datafiles for manuscript titled "Co-occurrence is associated with horizontal gene transfer across marine bacteria independent of phylogeny".

              

Large files (uploaded separately, to make it easier to download the zipfile of smaller files):



gene_to_cluster.tsv.gz - Mapping of gene ID to cluster ID (based on running CD-HIT to define gene clusters). Used for focal "cluster-based" HGT identification method.

metaG_hyperg_cooccur.allsamples.combined.prepped.tsv.gz - Massive table of genome pairs input to logistic regression for focal model result. Includes all variables, with rows containing NA values (e.g., for cases where genomes could not be placed into tree to get tip distance) removed. This is the data used for the focal logistic regression model we analyzed.


                    

Zipped folder structure (ocean_hgt_zenodo.zip):



code/ - Folder containing zipped GitHub repository releases for custom code used in this manuscript. See README in each repository for details - these are distributed here rather than GitHub, as Zenodo is a more reliable way to ensure long-term open access. 



HoMer_workflow-1.0.zip - Custom code and workflow for running HoMer and RANGER-DTL. Originally on GitHub here: https://github.com/gavinmdouglas/homer_workflow

ocean_cooccur_hgt-1.0.zip - Custom code for running workflows used in the manuscript (with the exception of HoMer and RANGER-DTL, see above). Originally on GitHub here: https://github.com/gavinmdouglas/ocean_cooccur_hgt






cooccur/ - Folder containing co-occurrence results, and related information. Unless otherwise stated, files correspond to focal genome dataset. 



Tara_present_metadata_median_by_sample.tsv.gz - Median environmental values per genome (based on metaG_presence_tara.tsv.gz profiles)

allsamples_present_metadata_median_by_sample.tsv.gz - Median environmental values per genome (based on metaG_presence_allsamples.tsv.gz profiles)

geotraces_present_metadata_median_by_sample.tsv.gz - Median environmental values per genome (based on metaG_presence_geotraces.tsv.gz profiles)

metaG_presence_allsamples.tsv.gz - Presence of genomes across all metagenomics samples.

metaG_presence_geotraces.tsv.gz - Presence of genomes across GEOTRACES metagenomics samples (these and other sample subset files can be slightly different due to how genomes and samples were filtered based on their prevalence in these tables).

metaG_presence_tara.tsv.gz - Presence of genomes across Tara metagenomics samples.

metaG_rpkm_allsamples.tsv.gz - Reads Per Kilobase per Million mapped reads (RPKM) of genomes across all metagenomics samples.

metaG_rpkm_geotraces.tsv.gz - RPKM of genomes across samples where they were called as present. Restricted to GEOTRACES samples only.

metaG_rpkm_tara.tsv.gz - RPKM of genomes across samples where they were called as present. Restricted to Tara samples only.

progenomes/ - Folder containing files with same name as above, but for proGenomes dataset.






hgt_cooccur_phylo/ - Folder containing results related to HGT vs. co-occurrence vs. phylogenetic distance (and other variables).



lessfiltered_taxa_hgt/ - Folder with tables summarizing information for rare genome pairs identified as "less-filtered", which were driving the significant signal in the focal set.



hyperg_clusterbased_lessfilt_hgt_prepped_input.tsv.gz - The subset of the input to the model for these taxa pairs.

hyperg_clusterbased_lessfilt_hgt_taxonomy.tsv.gz - Their taxonomy, as shown in a supplementary table.



model_summaries.tsv.gz - Summary of all models run, similar to results shown in manuscript, but for additional models and columns indicating 95% confidence intervals and P-values.






hgt_prev_analyses/ - Folder containing results related to analyses on HGT prevalence across metagenomics samples. 



genome_gene_prevalence.tsv.gz - Per-genome breakdown of number of genes, genes involved with HGT, proMGE hits, etc.

Tara_lower_fraction_env_matched.tsv.gz - Prevalence of genomes with at least one HGT event (or other related category) for all metagenomics samples in the lower fraction (small particles) in the follow-up Tara oceans analysis.

Tara_upper_fraction_env_matched.tsv.gz - Prevalence of genomes with at least one HGT event (or other related category) for all metagenomics samples in the upper fraction (large particles) in the follow-up Tara oceans analysis.

Tara_fraction_sample_matched_HGT_prev.tsv.gz - As above, but for biological samples matching between the lower and upper fraction, where each biological sample is one row.

random_forest_output/



null_varImp.tsv.gz - Observed vs. null expectation variable importance, with p-value.

rf_output.rds - Raw random forest object as RDS file.

RF_sig_variable_pairwise_H_statistic.tsv.gz - H-statistics indicating pairwise interactions between variables.

var_spearman_vs_hgt_prop.tsv.gz - Spearman correlation coefficients (rho) and P-values for all environmental variables vs. HGT prevalence.





mapfiles/



Dmitrijeva2024_COG_category_HGT_summary.tsv.gz - Breakdown of which COG categories are expected to be depleted / enriched among HGT hits, based on prior study's literature review.

MAG_taxa_breakdown.tsv.gz - Taxonomic breakdown for focal genomes.

progenomes_ncbi_taxonomy.tsv.gz - Taxonomic breakdown for proGenomes subset, based on parsing NCBI taxonomy from TaxIDs.

Tara_PANGAEA_env_data.tsv.gz - Environmental data used for subset of Tara oceans metagenomics samples.






phylogeny/



focal_Aligned_SCGs.phy.treefile - Newick tree for focal genomes.

progenomes_Aligned_SCGs.phy.treefile - Newick tree for proGenomes subset genomes.






putative_hgt/



blast/ - BLASTn-based HGT output on focal dataset.



blast_hit_bedfiles/ - BEDfiles with all BLASTn results presented (with lower scoring hits overlapping with these removed). Results are split by sequence identity cut-off and taxonomic level of comparison. Each region hit is displayed over two lines, with the same "name", but with a different subject and query indicated.

hit_gene_counts_and_lengths.tsv.gz - Breakdown of numbers of genes and region length per hit.

cross_level_tallies_norm.tsv.gz - Numbers of hits per taxonomic level.



cluster/ - Cluster-based HGT results on focal dataset.



all_best_hits.tsv.gz - Putative HGT events based on best hits of cluster across genomes in different genera or above.

clusterbased_COG_category_enrichment_no.unannot.tsv.gz - COG category enrichment results for clusters involved with HGT.

clusterbased_hgt_tallies.tsv.gz - Numbers of hits between genome pairs at each identity cut-off.

clusterbased_posthoc_COG_enrich.tsv.gz - Targeted COG enrichment results (on subset of COG categories of interest at >= 99% identity).

cross_level_tallies_norm.tsv.gz - Numbers of hits per taxonomic level.



num_comparisons_per_inter.level.tsv.gz - Count of number of genomes compared per taxonomic level (in focal genome database).

progenomes_cluster/ - Cluster-based HGT results (for ProGenomes database analysis).



gene_hgt_tallies.tsv.gz - Numbers of hits between genome pairs at each identity cut-off.

putative_hgt_calls.tsv.gz - Breakdown of putative HGT hits.



ranger/ - RANGER-DTL-based HGT results on focal dataset.



homer_rangerdtl_combined_summary.tsv.gz - Overall summary of HGT events per species. 

pairwise_hgt_counts.tsv.gz - HGT tally per taxa pair.








taxa_subsets/ - Lists of taxa IDs of interest.



focal_genomes_freeliving_associated.tsv.gz - Genomes defined as associated with "free-living" samples in focal dataset.

focal_genomes_lessfiltered_associated.tsv.gz - Genomes defined as associated with "less-filtered" samples in focal dataset.

hgt_retained_taxa_missing_from_tree.txt.gz - Genome IDs that were retained for HGT and co-occurrence analyses, but could not be placed into tree.

progenomes_freeliving_associated.tsv.gz - Genomes defined as associated with "free-living" samples in proGenomes subset dataset.

progenomes_highqual_retained.txt.gz - Subset of proGenomes aquatic representative genomes retained as high-quality (non-metagenomic).

progenomes_lessfiltered_associated.tsv.gz - Genomes defined as associated with "less-filtered" samples in proGenomes subset dataset.