# Rice Galaxy: An open resource for plant science

Venice Juanillas, Alexis Dereeper, Nicolas Beaume, Gaëtan Droc, Joshua Dizon, John Robert Mendoza, Jon Peter Perdon, Locedie Mansueto, Lindsay R. Triplett, Jillian M. Lang, et al.

► To cite this version:

Venice Juanillas, Alexis Dereeper, Nicolas Beaume, Gaëtan Droc, Joshua Dizon, et al. Rice Galaxy: An open resource for plant science. Gigascience, 2019, 8 (5), pp.1-14. 10.1093/gigascience/giz028. hal-05173902

HAL Id: hal-05173902

https://hal.science/hal-05173902v1

Submitted on 21 Jul 2025

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
TECHNICAL NOTE

# Rice Galaxy: an open resource for plant science

Venice Juanillas¹, Alexis Dereeper ID², Nicolas Beaume ID¹, Gaetan Droc ID³,
Joshua Dizon¹, John Robert Mendoza⁴, Jon Peter Perdon⁴,
Locedie Mansueto¹, Lindsay Triplett ID⁵, Jillian Lang ID⁵, Gabriel Zhou⁶,
Kunalan Ratharanjan ID⁶, Beth Plale ID⁶, Jason Haga ID⁷, Jan E. Leach ID⁵,
Manuel Ruiz³, Michael Thomson¹,⁸, Nickolai Alexandrov¹,
Pierre Larmande ID², Tobias Kretzschmar¹,⁹ and Ramil P. Mauleon ID¹,⁹,*

¹International Rice Research Institute, DAPO Box 7777, Metro Manila 1301, Philippines; ²Institut de recherche pour le développement (IRD), University of Montpellier, DIADE, IPME, Montpellier, France; ³CIRAD, UMR AGAP, F-34398 Montpellier, France; ⁴Advanced Science and Technology Institute, Department of Science and Technology, Quezon City, Philippines; ⁵Department of Bioagricultural Sciences and Pest Management, Colorado State University, Fort Collins, CO 80523-1177, USA; ⁶Indiana University, 107 S Indiana Ave, Bloomington, IN 47405, USA; ⁷National Institute of Advanced Industrial Science and Technology, AIST Tsukuba Central 1,1-1-1 Umezono, Tsukuba, Ibaraki 305-8560, Japan; ⁸Department of Soil and Crop Sciences, Texas A&M University, Houston, TX, USA and ⁹Southern Cross Plant Science, Southern Cross University, Lismore, Australia

*Correspondence address. Ramil P. Mauleon, E-mail: ramil.mauleon@scu.edu.au http://orcid.org/0000-0001-8512-144X T4 Southern Cross Plant Science, Southern Cross University, Military Road, East Lismore, NSW, Australia 2480

Abstract

**Background:** Rice molecular genetics, breeding, genetic diversity, and allied research (such as rice-pathogen interaction) have adopted sequencing technologies and high-density genotyping platforms for genome variation analysis and gene discovery. Germplasm collections representing rice diversity, improved varieties, and elite breeding materials are accessible through rice gene banks for use in research and breeding, with many having genome sequences and high-density genotype data available. Combining phenotypic and genotypic information on these accessions enables genome-wide association analysis, which is driving quantitative trait loci discovery and molecular marker development. Comparative sequence analyses across quantitative trait loci regions facilitate the discovery of novel alleles. Analyses involving DNA sequences and large genotyping matrices for thousands of samples, however, pose a challenge to non-computer savvy rice researchers. **Findings:** The Rice Galaxy resource has shared datasets that include high-density genotypes from the 3,000 Rice Genomes project and sequences with corresponding annotations from 9 published rice genomes. The Rice Galaxy web server and deployment installer includes tools for designing single-nucleotide polymorphism assays, analyzing genome-wide association studies, population diversity, rice-bacterial pathogen diagnostics, and a suite of published genomic prediction methods. A prototype Rice Galaxy compliant to Open Access, Open Data, and Findable, Accessible, Interoperable, and Reproducible principles is also presented. **Conclusions:** Rice Galaxy is a freely available resource that
empowers the plant research community to perform state-of-the-art analyses and utilize publicly available big datasets for both fundamental and applied science.

**Keywords:** rice; breeding; workflow; genomes; high-density genotypes; reproducibility; single-nucleotide polymorphism; genome-wide association studies; Galaxy project

## Methods

We adopted the Galaxy framework to build the federated Rice Galaxy resource, with shared datasets, tools, and analysis workflows relevant to rice research.

## Background

With the decreasing cost of genome sequencing, rice molecular geneticists, breeders, and diversity researchers are increasingly adopting genotyping technologies as routine components in their workflows, generating large datasets of genotyping and genome sequence information. Concurrently international consortia have made re-sequencing or high-density genotyping data from representative diversity collections publicly available. These include but are not limited to the medium-depth (15–20× coverage) re-sequencing data of the 3,010 accessions from the 3K Rice Genome (3K RG) Project (~1–2 million single-nucleotide polymorphisms [SNPs] per accession) [1, 2] and the 700,000 SNP Affymetrix array data for the 1,445 accessions of the High Density Rice Array (HDRA) germplasm collections [3]. The corresponding accessions are available at non-profit prices from the Genetic Resource Center of the International Rice Research Institute (IRRI) for phenotyping, allowing subsequent genome-wide association studies (GWAS) to be performed. Analysis of such datasets is a challenge to rice researchers owing to (i) the fairly large data matrix and the compute-intensive algorithms that require specialized computing infrastructure (a fairly large RAM, powerful central processing unit [CPU], and large disk space), and (ii) the relative difficulty in using open source/free software tools for analysis, which are commonly provided without graphical user interface and require proper installation in a Linux operating system environment.

On the computational side, public web resources with specialized tools already exist and are maintained at different institutions. The Rice SNP-Seek database [4, 5], largely developed and hosted by IRRI, contains phenotypic, genotypic, and pass-port information for >4,400 rice accessions from large-scale rice diversity projects such as the 3K RG and the HDRA collections. SNP-Seek [6] currently contains phenotype data for 70 different morphological and agronomic traits and stores SNPs and small insertions and deletions (indels) discovered by mapping the 3K RG accessions to 4 published rice draft genome assemblies, collectively resulting in the discovery of ~11 million new SNPs and ~0.5 million new indels. While SNP-Seek focused on delivery of prior analyzed content rather than providing an analysis platform, Gigwa [7, 8], hosted at the South Green portal [9, 10], is a scalable and user-friendly web-based tool that provides an easy and intuitive way to explore large amounts of genotyping data from next-generation sequencing (NGS) experiments. Gigwa allows for filtering of genomic and genotyping data from NGS analyses based not only on variant features, including functional annotations, but also on genotype patterns to explore the structure of genomes in an evolutionary context for a better understanding of the ecological adaptation of organisms. Gramene [11] is a curated, open source, integrated data resource for comparative functional genomics in crops and model

plant species that, among other species, includes rice. Data and analysis tools are available as portals at the Gramene site [12]. In these resources mentioned, the analysis methodologies are custom-built by the respective projects.

There are other freely available web-based bioinformatics and breeding informatics software tools, optimized for plant species other than rice, including Araport [13] for *Arabidopsis*, Cassavabase [14] for cassava, and The Triticeae Toolbox (T3 [15]) for wheat and barley. While these tools are very useful, they are species/crop-specific and custom-built for the specialized requirements of their respective communities (such as project datasets), making adoption in rice challenging for ≥2 reasons: (i) the need to produce curated rice datasets that work seamlessly with the software system (e.g., genome-browser-ready data, curated genes, published quantitative trait loci from bi-parental crosses and GWAS and markers associated to traits), and (ii) the need for a dedicated software development team to customize the application for rice-specific data and analyses.

The ability of software to automate repetitive analysis task is attractive for data analysts, and the public sharing of the analytical methodology (as opposed to just the raw data and the results) enhances reproducibility and is being supported by academic communities of practice such as FORCE11 [16]. Many research groups working with NGS data have a high demand for computing infrastructure, and their complex analyses often comprise several steps using different software tools (pipeline). The deployment of these different software tools is a big challenge to small institutions without dedicated scientific computing support staff. There is no single solution to address these challenges. Our approach to help overcome them is the integration of a range of these different bioinformatics tools into the Galaxy bioinformatics system. Galaxy [17] is a web-based analysis work-bench and workflow management system initiated at Penn State University. It includes a collection of software packages that can be operated via a web browser on a public server. Galaxy is a mature community effort, supported by various high-powered institutions, is relatively easy to deploy and maintain, and is thus well-suited to serve low- and moderately resourced institutions such as IRRI. The graphical user interface of Galaxy means that no knowledge of code is needed, thus facilitating bioinformatics analyses by researches without computational expertise.

We built a suite of federated Galaxy resources and tools, which we collectively named Rice Galaxy (Fig. 1). Rice Galaxy contains shared software tools and datasets tailored to the needs of rice researchers and breeders. A Rice Galaxy web server is also available, providing computing resources through an easy-to-use interface, and allowing reproducibility and publication of analytical methodology and results.

The Rice Galaxy federated resources are available at:

* Rice Galaxy reference web server, with working tools, built-in data, and shared datasets at IRRI [18];

* Rice Galaxy (common) Toolshed hosting the tool wrappers [19];

* Rice Galaxy code and built-in data for local/institutional deployment [20].
<figure><img src="image_2.png" /><figcaption>Figure 1: Rice Galaxy at IRRI with customized analysis tools for genetics, breeding, and custom data sources (i.e., 3000 Rice Genomes project).</figcaption></figure>

# Discussion

## Built-in/interoperable rice data

The Rice Galaxy system is customized to provide rice-specific genomic and genotypic data. Of primary importance is the gold-standard *japonica* variety reference genome (Nipponbare International Rice Genome Sequencing Project [IRGSP] release 1.0) [21], to which the reference gene models and most of the SNPs published have been anchored. In addition, 8 medium- to high-quality published genomes from various sequencing projects and the respective genome annotations for each are installed as alternative genome builds and are available as drop-down menu choices in Rice Galaxy. These include 4 high-quality builds from *indica*-type varieties Minghui 63 and Zhengshan 97 [22], IR 8 (GenBank: MPPV0000000.1), Shuhui 498 [23], as well as the *aus*-type variety N 22 (GenBank: LWDA0000000.1), as well as 4 medium- to low-quality genomes, 2 *indica* (IR 64 [24] and 93-11 [25]) and 2 *aus*-type rice genomes (DJ 123 [24] and Kasalath [26]). While these references were selected to represent diversity, they further represent variety groups that display agronomically important characteristics, such as heat and drought tolerance, disease resistance, submergence tolerance, adaptation to low-phosphorus soil, wide adaptability, good grain quality, aerobic (upland) adaptation, and deep roots [27–29]. Even though these genomes are highly similar to each other, they each contain unique regions (from 12.3 to 79.6 megabase pairs) that may harbor genes restricted to these variety-groups [5]. With the availability of several reference genomes, it becomes relatively straightforward to custom design SNP assays that are either of broad utility across varietal groups or specific to single groups.

Rice Galaxy includes genotyping data of the 3K RG (such as the 3K RG 3,024 accessions × 4.8 million filtered SNPs, 440,000 core SNPs, 1 million GWAS-ready SNPs, and 2.3 million indels) useful for GWAS, region-specific diversity analyses, and single-locus allele mining in the shared data library.

## Toolkits built (and detailed discussion of each toolkit)

**SNP assay design: Lift-over of SNPs from one genome to another**
SNPs discovered relative to the gold-standard reference genome (Nipponbare IRGSP 1.0 [21]) are commonly used in quantitative trait locus mapping (either by GWAS or biparental cross). In order to develop robust markers associated with the trait of interest, however, an SNP assay that works in the target varietal groups is needed. Consequently there is a need to “lift over” SNPs from one genome to another (e.g., from Nipponbare *japonica* to an *indica* varietal group represented by IR 64). The workflow is as follows: (i) get flanking sequences surrounding the target SNP in the source genome (the main reference Nipponbare); (ii) align these flanking sequences to the target genome of the variety of interest to verify whether it hits a unique region in the target genome of similar location from the source genome, allowing some mismatches but not allowing multiple region hits; and (iii) identify the flanking sequences surrounding the lifted-over SNP in the context of the target genome, for SNP assay design. The shared workflow is published in Rice Galaxy as “SNP liftOver,” which runs smoothly in the public Rice Galaxy web server.

### 3K RG data access

Rice Galaxy provides tools that can access the raw variant call format (VCF) files of each accession in the 3K RG project via connection (as data source in Rice Galaxy) to the 3,000 rice genomes at Amazon Web Services (AWS) Public Data [30], with tools allowing region-specific download. In Rice Galaxy, tools in the Get Data/FROM 3KRG section allow listing of the accessions in the 3K RG and retrieval of genotype data for a selected accession of interest from the 3K RG collection. The subset genome region of interest (chromosome name—base start—base end) can be specified and extracted from the VCF of the accession of interest stored in AWS Public Datasets. This functionality addresses a common use case for the 3K RG dataset, wherein a researcher has a gene or small genome region of interest mapped to the Nipponbare reference genome and wishes to determine the vari-
ation of this gene/genome region in a particular accession of interest from the 3K RG. As a result of the default limitations of the public Rice Galaxy server for user data storage space (~6 GB), we recommend downloading subset regions instead of full VCF files (i.e., on average ~2 GB) from the 3K RG collection. Analyses that require full VCF data of multiple 3K RG accessions using the Rice Galaxy server are not recommended; these are best performed using a local deployment of Rice Galaxy. The details of local deployment are discussed in the Rice Galaxy architecture discussion section.

In addition, we developed an original Rice Galaxy component called Rapid Allelic Variant extractor (RAVE), which allows simultaneous extraction of genotyping data from several accessions of the internal 3K RG resource. It relies on the PLINK software [31], which efficiently builds a user-adjusted genotyping submatrix from a compressed PLINK binary bi-allelic genotype table (bed file + bim, fam files). Users can customize the genotyping dataset vertically by choosing a subpopulation (e.g., *indica*, *japonica*, *aromatic*, *aus*, *tropical*, *temperate*) or setting a list of varieties, and horizontally by restricting variations with a list of genomic regions or a list of gene names. Additionally, users can filter the SNP positions by specifying thresholds for missing data or minor allele frequency. The extracted VCFs can be directly generated by Rice Galaxy, stored as output into the history pane of the Galaxy interface, and can be reformatted to Hapmap, a versatile file format for further analyses such as marker (SNP) design, GWAS analyses, or visualized in a JBrowse [32] genome browser (Vcf2jbrowse component). External SNP datasets can also be imported into Rice Galaxy and merged with 3K accessions in order to compare and look at the closest genotypes using the SNiPlay [33] workflow.

## GWAS analysis using TASSEL

The Rice Galaxy web server has sufficient storage and computing resources for GWAS, as long as the genotyping data are in matrix format (such as Hapmap), not as multi-sample VCF. Using this feature, it is relatively easy to construct a genotyping matrix for a subset of accessions from the 3K RG and connect associated phenotypic information to perform GWAS analyses online, with outputs being decorated with various graphical enhancements. For the 3K RG accessions, the subset 1 million GWAS and 440,000 Core SNPs that is usable for GWAS is already available as a shared dataset in Rice Galaxy (Fig. 2). Researchers working on the 3K RG panel can generate new phenotyping data from their respective experiments, upload the phenotype data into Rice Galaxy, and then perform GWAS using the TASSEL (Trait Analysis by Association, Evolution and Linkage) bioinformatics tool [34]. The GWAS Rice Galaxy workflow implementing TASSEL and Multi-Locus Mixed-Model package for association studies is shared from SNiPlay at Rice Galaxy (Fig. 3).

Aside from GWAS with 3K RG datasets, researcher-generated marker (emphasizing that it should be in matrix format) and phenotype data (outside of 3K RG) can also be uploaded to Rice Galaxy for GWAS analysis.

## Genomic selection using Oghma genome prediction tool

The Rice Galaxy server allows the exploration of genomic selection methods. Genomic selection (GS) is a promising breeding technique with potential to improve the efficiency and speed of the breeding process in rice [35]. With the intent of enabling the GS analysis process used on the 2 datasets in the Spindel et al. [35] study (encoding data, filtering data to keep informative markers, creating a model from a training set, evaluating the model, and finally, performing the prediction itself), and to

automate the analysis pipeline, the relevant packages (methods, fpc, cluster, vegan, pheatmap, pROC, randomForest, miscTools, pRF, e1076, rrBLUP, and glmnet) for the R Statistical language [36] were installed in Rice Galaxy and the tool suite was collectively named Oghma (Operators for Genome Deciphering by Machine Learning). A quality control tool (based on PLINK) and imputation tool using Beagle [37, 38] were also installed. Four phenotype prediction/classifier methods (ridge regression best linear unbiased predictor [rrBLUP], random forest, support vector machine [SVM], and lasso) were identified as relevant and deployed as tools in Rice Galaxy (Fig. 4).

Figure 5 shows the overall GS analysis workflow using Oghma. Genotypes are encoded through the "encode" tool. For the training set, an encoded genotype and the corresponding phenotype files are used by a classifier tool to train a model, which can be used with another encoded genotype file to predict trait values (the genomic prediction). It is important to note that (i) both the genotype for training and the genotype to predict must have the same markers (and thus, genotype files must have the same number of columns) to make a prediction, and (ii) the "evaluation" option of the classifier tool can have any value except 1 (it is recommended to keep the default value = 0).

A big challenge when using machine learning approaches for genomic prediction is the optimization of the model based on training data, specifically setting the best parameters of the aforementioned methods. Oghma was designed to automate the optimization of the parameter(s) of the classifiers on the fly (as opposed to manual tweaking), thus allowing users without experience of machine learning to easily optimize a model for their own data. Oghma includes some tools to evaluate prediction accuracy to allow the user to choose the most accurate method on their data by performing a cross-validation with a user-uploaded training set. Two metrics, the coefficient of determination ($R^2$) and the correlation between predicted and observed phenotype, and a visualization (scatterplot of predicted vs observed) have been implemented to evaluate the methods. The "computeR2" and "plotPrediction" tools are used to compute $R^2$ and visualize the accuracy of prediction. These tools both take the true phenotypes and the predicted outputs as inputs (note that both prediction and phenotype data must be in the same order) and return the computed $R^2$ or the scatterplot display of true phenotype vs prediction.

Oghma can be used to evaluate a classifier (Fig. 6). Like the general GS workflow, genotype and phenotype are used as input for any classifier, but the "evaluation" option must be set to 1. Folds for cross-validations are designed through the "fold" tool, which takes as input the encoded file. These folds are used as extra argument by the classifier tools. The chosen classifier tool produces a file, which is not a model but the prediction of the test set for each cross-validation. This output is used as input, along with the phenotypes and folds, by the "evaluation" tool, which outputs some performance indices ($R^2$ and correlation). Although it does give a real indication of performance, trying to predict the training set (i.e., using the same genotype file in the pipeline described above), or at the least, showing whether the classifier is not under-fitting the data.

We installed several classifiers in Oghma to allow users to test and determine the one(s) best suited for their dataset because our literature survey showed that no method seems to outperform the others on all genomic prediction tasks. It was noticed that random forest was the most accurate and the most stable classifier on the Spindel et al. dataset [35]; thus, we set this as the default in Oghma. An original aggregation method is also implemented in Oghma, aggregating outputs of multiple classi-
<figure><img src="image_3.png" /><figcaption>Figure 2: Genome-wide association studies analysis (implemented by TASSEL software) in Rice Galaxy.</figcaption></figure>

<figure><img src="image_4.png" /><figcaption>Figure 3: Genome-wide association studies analysis workflow in SNiPlay as implemented in Rice Galaxy.</figcaption></figure>

fiers to improve prediction. This tool takes as input the prediction of n classifiers and tries to aggregate them through weighted mean of the prediction (weight optimized by genetic algorithm) or regression (multiple types of regression have been implemented, based on decision tree, SVM, and random forest). Limited testing has shown this approach to be promising, matching random forest in some cases, especially with a meta-SVM, with a polynomial or linear model as the aggregation method, but it still needs some improvement because the accuracy remains unstable when evaluated through cross-validation (data

not shown). The aggregation method can also be evaluated using the aforementioned evaluation tools.

## Diversity and population structure analysis of end-user datasets

Resources in the Rice Galaxy server allow diversity and population structure analyses. SNP datasets—such as those extracted from the 3K RG resource after filtering by the RAVE module or custom sets directly uploaded in the Rice Galaxy environment (Fig. 7)—can be processed for a complete exploration and large-scale analysis thanks to the SNiPlay Rice Galaxy workflow (Fig.
<figure><img src="image_5.png" /><figcaption>Figure 4: Oghma genomic prediction and selection tools in Rice Galaxy with various classifier tools installed.</figcaption></figure>

8). The workflow is available through the instance, requiring a VCF file as input. This workflow allows various analyses: (i) SNP annotation by snpEff [39] wrapper preconfigured for Rice Genome Annotation Project release 7.0 [40] gene models, (ii) variant filtration using the PLINK wrapper, (iii) general statistics such as transition-transversion ratio, levels of heterozygosity, and missing data for each variety using VCFtools, (iv) SNP density analysis, (v) diversity index calculation in sliding windows along the genome using VCFtools (Pi, Tajima's D, fixation index if subpopulations provided), (vi) linkage disequilibrium, (vii) population structure by sNMF [41], (viii) principal component analysis and identity by state clustering of varieties by PLINK, and (ix) SNP-based distance phylogenetic tree by FastME [42]. Most key steps are decorated with sophisticated visualizations using a dedicated plugin. Visualization can be displayed by clicking on the visualization icon.

In practice, this workflow can be processed for many applications such as the identification of possible introgression events, the identification of putative genomic regions involved in the control of qualitative traits through a fixation index approach, the investigation for potential duplicates in the 3K RG accessions dataset and custom datasets, or the estimate of closest varieties of new sequenced accessions, by ranking a list of varieties from the database most closely matching the given sample. It can also be used for the close inspection of a genomic region of interest after a GWAS analysis, through a linkage disequilibrium focus or the haplotyping of candidate genes.

### Uniqprimer module

Uniqprimer is a workflow for comparative genomics-based diagnostic primer design, developed from a pipeline used in-house at Colorado State University to develop novel species- and subspecies-level diagnostic tools for bacterial plant pathogens including pathovars of Xanthomonas translucens [43], geographical variants of rice-associated Xanthomonas spp. [44–46], and the genetically diverse rice pathogen Pseudomonas fuscovaginae

[47]. Uniqprimer is now deployed in Rice Galaxy for user-friendly diagnostic primer design from draft or complete pathogen genomes. The user inputs multiple bacterial genomes from diagnostic target species as well as non-target species (i.e., “include” and “exclude” genome files), and the tool performs comparative alignment, primer design, and primer validation to output a list of primers that are specific to the target genomes (Fig. 9). The Uniqprimer stand-alone program is written in Python and is available at the South Green github repository [48], along with detailed documentation for developers and end-users. The relatively small size of bacterial genomes allows the Rice Galaxy server to perform Uniqprimer analysis.

### Rice galaxy OA: a prototype for open access

IRRI, as a member center of the Consultative Group for International Agricultural Research (CGIAR [49]), complies with the CGIAR policy on Open Access and Open Data [50]. In collaboration with Indiana University in the United States and the National Institute of Advanced Industrial Science and Technology in Japan, and carried out through grants from the US National Science Foundation (NSF) and the MacArthur Foundation through the Research Data Alliance (RDA [51]), the team undertook a prototyping effort to bring the Rice Galaxy system to maximum compliance with the CGIAR policy.

The basis for the design to add open access (OA) to Rice Galaxy is a foundational technical idea emerging from activities occurring in the international RDA. This idea acknowledges that for open data access to be broadly realized, all meaningful data objects must have a globally unique and persistent identifier (PID). Globally unique means the name is not shared with other objects on a global scale. An identifier is persistent when the PID itself cannot be destroyed and when the relationship between the identifier and the data object it points to is permanent. Through an international working group in RDA, a team of researchers is advancing the notion of PID Kernel Information,
<figure><img src="image_6.png" /><figcaption>A. Overview of the Genomic Selection analyses workflow as implemented in Oghma tool suite.</figcaption></figure>

<figure><img src="image_7.png" /><figcaption>B. Rice Galaxy workflow for genome prediction using Oghma tool suite.</figcaption></figure>

<figure><img src="image_8.png" /><figcaption>Figure 6: Workflow for classifier evaluation in the genome prediction tool suite implemented by Oghma.</figcaption></figure>

which injects a tiny amount of carefully selected metadata into
a PID record. This technique has the potential to stimulate an

entirely new ecosystem of third-party services that can process
the billions of expected PIDs. The key challenge of this working
<figure><img src="image_9.png" /><figcaption>**Figure 7:** Overview schematic showing the integration of the 3K Rice Genomes project genotyping database and rapid extraction of subset SNPs by RAVE module for use by analysis workflows installed in Rice Galaxy.</figcaption></figure>

<figure><img src="image_10.png" /><figcaption>**Figure 8:** Rice Galaxy SNiPlay workflow for diversity and population structure analyses using various software tools.</figcaption></figure>

group is to determine which from amongst thousands of relevant metadata are suitable to embed in the PID record.

Our design draws on earlier work by us in data provenance capture and representation [52–54] and employs a hands-off technique ("data provenance capture") to gather information about a researcher's rice genomics analysis as the analysis is running. Through this technique, information acquired while the analysis is running is compiled and combined with pre-

analysis information that is available at the beginning of the analysis workflow. Such information includes who performed the analysis, when it was performed, and under what conditions.

There have been earlier approaches to capture provenance of Galaxy workflows. Geocks et al. [55] developed a history panel for users to facilitate reproducibility. Gaignard et al. [56] propose the SHARP toolset, a semantic web (i.e., linked data) approach
<figure><img src="image_11.png" /><figcaption>Figure 9: Uniqprimer comparative genomics-based diagnostic primer design tool for microbial pathogen detection installed in Rice Galaxy.</figcaption></figure>

of harmonizing provenance collected from both the Galaxy and Taverna workflow systems. Kanwal et al. [57] captured the activity of a workflow (called a "provenance trace") including the version of analysis tools run, the software parameters used, and the data objects produced at each workflow step. This work also targets increased reproducibility of past workflow instances. Missier et al. [58] propose the "Golden Trail" architecture to describe and store workflow runtime provenance retrieved from Galaxy. The golden trail of provenance that is collected can be used to construct a virtual experiment view of past workflow runs. The 4 research contributions described further underline the need for the capture of provenance from workflow systems. They propose different but equally important uses of data provenance, i.e., to facilitate the improvement of science through reproducibility and construction of virtual views of an experiment once it has completed.

Our design for Rice Galaxy OA shares similarities with these other techniques; however, its end goal is different, which is to advance OA, hence making Rice Galaxy consistent with CGIAR's OA policy. To do this, we focus on each piece of data and information deemed valuable that emerges from workflow runs deemed to be of importance. These particular data and information must be retained and shared with others, while being subject to reasonable restrictions. This is a highly selective approach to provenance capture, and one that makes our work unique. We briefly outline the solution here and identify resources for those interested in pursuing the topic in more detail.

The architecture of Rice Galaxy OA (Fig. 10A) utilizes the Handle system [59] and 2 standards emerging from the RDA, RDA PID Type [60] and the Data Type Registry [61]. It additionally uses storage and computing resources provisioned through the NSF-funded project Pacific Rim Applications and Grid Middleware Assembly (PRAGMA).

A researcher interacts with the OA-enhanced Rice Galaxy system as follows:

(1) Researcher performs an analysis in Rice Galaxy.

(2) Data objects (input data, output data, information such as configuration parameters) are extracted from Rice Galaxy OA into a PRAGMA Data Repository Database (MongoDB) (Fig. 10A).

(3) The data objects are assigned PIDs, the PID Kernel Information is assigned into the PID record at this time, and a landing page is created for each (Fig. 10B).

(4) Data objects can be downloaded from the Data Identity server and re-loaded to the Rice Galaxy server for full faithful reproduction of the analysis.

The resulting prototype system seems to be promising and addresses a number of the recommendations from CGIAR. The Rice Galaxy OA system is a user-transparent means of harvesting DOs from applications and assigning PIDs to scientific outcomes. The architecture is modular and built with default PID information types and metadata using RDA products (Fig. 10A). Although this proof-of-concept prototype successfully demonstrates the feasibility of this approach, there remains some future work. The community needs to provide feedback on which data and information products are most important to retain and make available. Additionally, not all workflow runs are important to a researcher because they could be system tests or new workflow tests. Thus, how a researcher identifies the items he or she wishes to make available to others, and when, remains an important consideration for this system. For more information, points of contact to the team, the underlying software for Rice Galaxy OA, and the link to the prototype server can be found at [62]. Note that Rice Galaxy OA is not implemented in the production Rice Galaxy server.
<figure><img src="image_12.png" /><figcaption>A. The underlying software infrastructure for the components of Rice Galaxy Open Access.</figcaption></figure>

<figure><img src="image_13.png" /><figcaption>B. Digital Object flow in Rice Galaxy Open Access. A Galaxy analysis workflow (exported as JSON file) is deposited to the DO repository, and the data identity server publishes the deposited DO + meta-data for discoverability.</figcaption></figure>

<caption>Figure 10: The components (A) and the flow of digital objects (DOs) from upload to discoverability (B) in the prototype Rice Galaxy OA.</caption>
<figure><img src="image_14.png" /><figcaption>Figure 11: Rice Galaxy Toolshed with the various available tools.</figcaption></figure>

## Rice Galaxy architecture and deployment

We deployed the Rice Galaxy reference server (hosted by IRRI) into an AWS elastic computing cloud (EC2) instance (t2.large instance 2 vCPU, 4 GB RAM) with Linux Ubuntu release 12.04.2 LTS (GNU/Linux 3.2.0-40-virtual x86_64) operating system installed. We deployed Galaxy release 14 to this cloud server, following the method described in the Galaxy documentation. This Galaxy server has modest specifications and allows researchers to test the functionalities of the rice-specific tools installed, as well as conduct analyses on modestly sized datasets as allowed by the default memory and disk space allocation in the standard Galaxy deployment.

External data from the 3K RG Project files stored in the 3K RG AWS Simple Storage Service (S3) Public Data resource hosted at [63] (or s3://3kricegenome/) is accessed using AWS S3 Command Line Interface, a command line tool utility in AWS that provides an interface to access AWS S3 objects (CLI [64]). First, Rice Galaxy connects to the 3K RG AWS bucket using s3API and allows the objects inside the bucket to be transparent to Galaxy. VCF files (and the accompanying index files) are downloaded to Rice Galaxy using the S3 command line interface with the aws S3 cp command, executed as

```
aws -profile user s3 cp s3://3kricegenome/REFERENCE/VCF_FILE.snp.vcf.gz*.
```

The subset region of the VCF file (chromosome: start-end) is then extracted using BCFtools [65] wrapped in Rice Galaxy and exported to the history panel as a bgzipped, indexed BCF file, which can then be converted back to VCF using VCFTOOLS in Rice Galaxy.

Standard methods for tool wrapper development and deployment were followed. All tool wrapper XMLs developed specifically for Rice Galaxy are deposited and shared in a project-specific Rice Galaxy toolshed repository [19] (Fig. 11) and will also be deposited in the central Galaxy toolshed [66]. All developments and testing of Rice Galaxy and Rice Galaxy Toolshed were done in Docker containers hosted in virtual machines at the Advanced Science and Technology Institute, Department of Science and Technology of the Philippine Government (ASTI-DOST) prior to final deployment to the AWS instance.

In addition to the integration of these tools, new Galaxy wrappers and visualization plugins are being developed for visu-

alizing chromosomes and their information (SNP density, structural variants, translocations) either in linear or circular mode, using recent web technologies (Ideogram.js [67], BioCircos.js [68], respectively).

We acknowledge that the reference Rice Galaxy server may not have sufficient storage and computing resources to allow analyses on multiple full-genome VCFs (e.g., full VCFs for 3 or more 3K RG accessions). We recommend the deployment of a local Rice Galaxy instance on a server that has more resources (RAM, disk space) and configuring Galaxy to provide access to the additional memory and disk space allocated to users. The general steps for local Rice Galaxy deployment are as follows:

1. Install Rice Galaxy and the required dependencies from the github repository mentioned in the Availability of source code and requirements section to your server.

2. Install the Rice Galaxy tools in your new Galaxy instance from the Rice Galaxy Toolshed; we are still developing these and will push the stable version(s) to the public Galaxy toolshed as soon as they are available.

3. Install the external tools from other projects that are installed in Rice Galaxy (but not in Rice Galaxy Toolshed, e.g., Uniqprimer, SNiPlay, RAVE, Oghma) to the local instance of Galaxy. Documentation on the availability and how to install these tools to local servers are available in their respective repositories and in the Rice Galaxy server Shared data → Pages section.

4. Download the shared 3K RG, test datasets, and tutorial pages from the Rice Galaxy server shared data library to your local Galaxy instance.

We are in the process of developing a Docker container of the Rice Galaxy server with tools following the Galaxy Docker flavor initiative [69] so that local server deployment is easier. The limitation of this method is that we cannot include third-party software in the container. The link to the container will be provided in the Rice Galaxy server once it is available. The institutions collaborating to build the Rice Galaxy system are committed to providing the installer, tools, data, and computing resources (however limited), in order to enhance or even drive the rice research community's respective institutional genetic/genomic/breeding efforts.
## Conclusion

Rice Galaxy is a federated Galaxy resource specialized for rice genetics, genomics, and breeding. The resource empowers the rice research community to utilize publicly available datasets (3K RG), materials (seed/accessions), and their own data, allowing complex data analyses to be performed even without investment in their own computational infrastructure and software development team. Rice research-related tools are also hosted on the Rice Galaxy server (i.e., Uniqprimer rice pathogen diagnostic design).

The Rice Galaxy system is freely accessible to all, and we invite the rice research community to participate in enriching the tools hosted by the resource. It can serve as a repository for data, analysis results, and new bioinformatics tools coming from institutions that have used the publicly available rice diversity panels from 3K RG, or have developed rice genomic/genetic analysis tools that they wish to share to the community, and a modest computing infrastructure for small institutes without in-house computing capability.

## Availability of source code and requirements

### Rice Galaxy

Project name: Rice Galaxy

Project home page: https://github.com/InternationalRiceResearchInstitute/RiceGalaxy

Operating system: Linux Ubuntu release 12.04.2 LTS

Programming language: Python

Other requirements: R release 3.2.3 and following packages: methods, fpc, cluster, vegan, pheatmap, pROC, randomForest, miscTools, pRF, e1076, rrBLUP, glmnet; TASSEL release 5.2.40; plink v1.90b3k; JBrowse 1.14.1; snpEff 4.3T; sNMF 1.2 (and as R package LEA); FastME 2.0

License: Rice Galaxy tools are released under GNU GPL. All software from external sources is bound by their respective licenses. Any restrictions to use by non-academics: Rice Galaxy tools are without restriction to non-academics. All software from external sources is bound by their respective non-academic restrictions.

Code availability: Tool wrappers at Rice Galaxy Toolshed (http://galaxytoolshed.excellenceinbreeding.org). Rice Galaxy is available at IRRI Github (https://github.com/InternationalRiceResearchInstitute/RiceGalaxy).

### Uniqprimer

Project name: Uniqprimer

Project home page: https://github.com/SouthGreenPlatform/Uniqprimer

Operating system(s): Linux OS

Programming Language: Python

Other requirements: MUMmer 3

License: GNU GPL

Project name: PRAGMA Data Service

Project home page: repository https://github.com/Data-to-Insight-Center/RDA-PRAGMA-Data-Service/wiki/Welcome-to-PRAGMA-Data-Service-Prototype

Operating system(s): Platform independent

License: Apache License 2

## Availability of supporting data and materials

3000 Rice Genomes Project data are available from the Gigascience GigaDB repository [70]. Snapshots of the code and Docker images are also available from GigaDB [71].

3K RG BAM and VCF files are available from Amazon Public data and the ASTI-DOST IRODs site; see instructions at http://iric.irr.i.org/resources/3000-genomes-project.

SNP sets and morpho-agronomic characterization from 3K RG are available at the SNP-Seek download site (http://snp-seek.irr.i.org/_download.zul).

## Abbreviations

3K RG: 3000 Rice Genomes; ASTI-DOST: Advanced Science and Technology Institute, Department of Science and Technology of the Philippine Government; AWS: Amazon Web Services; CGIAR: Consultative Group for International Agricultural Research; CPU: central processing unit; DO: digital object; EC2: elastic computing cloud; GS: genomic selection; GWAS: Genome-Wide Association Studies; HDRA: High Density Rice Array; indels: insertions and deletions; IRGSP: International Rice Genome Sequencing Project; IRRI: International Rice Research Institute; NSF: National Science Foundation; NGS: next-generation sequencing; OA: open access; Oghma: Operators for Genome Deciphering by Machine Learning; PID: persistent identifier; PRAGMA: Pacific Rim Applications and Grid Middleware Assembly; RAM: random access memory; RAVE: Rapid Allelic Variant extractor; RDA: Research Data Alliance; rrBLUP: ridge regression best linear unbiased predictor; S3: Simple Storage Service; SNP: single-nucleotide polymorphism; SVM: support vector machine; TASSEL: Trait Analysis by Association, Evolution and Linkage; VCF: variant call format.

## Competing interests

The authors declare that they have no competing interests.

## Funding

Components of the project are supported by the following grants: Taiwan Council of Agriculture Grant to IRRI, International Rice Informatics Consortium, and CGIAR Excellence in Breeding Platform for financial support to the Rice Galaxy main server, the Bill and Melinda Gates Foundation through the Genetic Open-source Breeding Informatics Initiative project for applications development support, the USA National Science Foundation PRAGMA grant No. NSF OCI 1,234,983, the RDA/US-sponsored adoption program funded by the MacArthur Foundation, and the AIST ICT International Collaboration Grant.

## Authors' contributions

V.J. and A.D. equally contributed to create Rice Galaxy. N.B. contributed the genomic prediction tools. A.D., G.D., P.L., and M.R. contributed the RAVE and SNiPLAY tools. J.D., J.R.M., and J.P.P. created the development Rice Galaxy cloud instances hosted at DOST-ASTI. L.M. created the SNP-Seek interfaces. L.T., J.L., and J.E.L. contributed the Uniqprimer tool. G.Z., K.R., B.P., and J.H. contributed the Rice Galaxy Open Access, M.T., N.A., and T.K. contributed to funding acquisition and writing, and R.P.M. coordinated the conceptualization of the project and the writing process.
## Acknowledgements

The authors are grateful to DOST-ASTI for hosting the Rice Galaxy toolshed server and to Jay Santos and Denis Diaz for assistance with AWS architecture.

## Editors Note

As one of the winners of the 2018 *GigaScience* ICG Prize, a video presentation is available from the journal website and youtube channel (https://youtu.be/HWKa3acoDUQ).

## References

1. 3,000 rice genomes project. The 3,000 rice genomes project. *GigaScience* 2014;3:7.

2. Wang W-S, Mauleon R, Chebotarov D, et al. Genomic variation in 3,010 diverse accessions of Asian cultivated rice. *Nature* 2018;557:43–49.

3. McCouch S, Wright M, Tung C-W, et al. Open access resources for genome wide association mapping in rice. *Nat Commun* 2016;7:10532.

4. Alexandrov N, Tai S, Wang W, et al. SNP-Seek database of SNPs derived from 3000 rice genomes. *Nucleic Acids Res* 2015;63:2–6.

5. Mansueto L, Fuentes RR, Chebotarov D, et al. SNP-Seek II: A resource for allele mining and analysis of big genomic data in *Oryza sativa*. *Curr Plant Biol* 2016;6628:16–25.

6. Rice SNP-Seek Database. http://snp-seek.irri.org. Accessed 15 May 2018.

7. Sempéré G, Philippe F, Dereeper A, et al. Gigwa-Genotype investigator for genome-wide analyses. *GigaScience* 2016;5:25.

8. Gigwa v2.0. http://gigwa.southgreen.fr/gigwa/. Accessed 15 May 2018.

9. The South Green Collaborators. The South Green portal: a comprehensive resource for tropical and Mediterranean crop genomics. *Curr Plant Biol* 2016;7:8–9.

10. South Green bioinformatics platform. http://www.southgreen.fr/. Accessed 15 May 2018.

11. Tello-Ruiz MK, Naithani S, Stein JC, et al. Gramene 2018: unifying comparative genomics and pathway resources for plant research. *Nucleic Acids Res* 2018;46(D1):D1181–9.

12. Gramene. http://gramene.org/. Accessed 15 May 2018.

13. Araport Aradopsis information portal. https://www.araport.org/. Accessed 15 May 2018.

14. Cassavabase. https://cassavabase.org/. Accessed 15 May 2018.

15. The Triticeae Toolbox. https://triticeaetoolbox.org/. Accessed 15 May 2018.

16. FORCE1. https://www.force11.org. Accessed 15 May 2018.

17. Afgan E, Baker D, van den Beek M, et al. The Galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2016 update. *Nucleic Acids Res* 2016;44(W1):W3–W10.

18. Rice Galaxy. http://galaxy.irri.org. Accessed 15 May 2018.

19. Galaxy Tool Shed. http://galaxytoolshed.excellenceinbreeding.org. Accessed 15 May 2018.

20. Rice Galaxy: Galaxy instance for Rice research. https://github.com/InternationalRiceResearchInstitute/RiceGalaxy. Accessed 15 May 2018.

21. Kawahara T, de la Bastide M, Hamilton JP, et al. Improvement of the *Oryza sativa* Nipponbare reference genome using next generation sequence and optical map data. *Rice* 2013;6:4.

22. Zhang J, Chen L-L, Xing F, et al. Extensive sequence divergence between the reference genomes of two elite *indica* rice varieties Zhenshan 97 and Minghui 63. Proc Natl Acad Sci U S A 2016;113:E5163–71.

23. Du H, Yu Y, Ma Y, et al. Sequencing and *de novo* assembly of a near complete *indica* rice genome. Nat Commun 2017;8:15324.

24. Schatz M, Maron LG, Stein JC, et al. Whole genome *de novo* assemblies of three divergent strains of rice, *Oryza sativa*, document novel gene space of *aus* and *indica*. Genome Biol 2014;15:506.

25. Gao ZY, Zhao SC, He WM, et al. Dissecting yield-associated loci in super hybrid rice by resequencing recombinant inbred lines and improving parental genome sequences. Proc Natl Acad Sci U S A 2013;110(35):14492–7.

26. Sakai H, Kanamori H, Arai-Kichise Y, et al. Construction of pseudomolecule sequences of the *aus* rice cultivar Kasalath for comparative genomics of Asian cultivated rice. DNA Res 2014;21(4):397–405.

27. Xu K, Xu X, Fukao T, et al. *Sub1A* is an ethylene-response-factor-like gene that confers submergence tolerance to rice. Nature 2006;442:705–8.

28. Gamuyao R, Chin JH, Pariasca-Tanaka J, et al. The protein kinase Pstol1 from traditional rice confers tolerance of phosphorus deficiency. Nature 2012;488:535–9.

29. Uga Y, Sugimoto K, Ogawa S, et al. Control of root system architecture by DEEPER ROOTING 1 increases rice yield under drought conditions. Nat Genet 2013;45:1097–102.

30. 3000 Rice Genomes Project. https://aws.amazon.com/public-datasets/3000-rice-genome/. Accessed 15 May 2018.

31. Purcell S, Neale B, Todd-Brown K, et al. PLINK: a toolset for whole-genome association and population-based linkage analysis. Am J Hum Genet 2007;81:559–75.

32. Skinner ME, Uzilov AV, Stein LD, et al. JBrowse: a next-generation genome browser. Genome Res 2009;19:1630–8.

33. Dereeper A, Homa F, Andres G, et al. SNiPlay3: a web-based application for exploration and large scale analyses of genomic variations. *Nucleic Acids Res* 2015;43:W295–300.

34. Bradbury PJ, Zhang Z, Kroon DE, et al. TASSEL: Software for association mapping of complex traits in diverse samples. *Bioinformatics* 2007;23:2633–5.

35. Spindel J, Begum H, Akdemir D, et al. Genomic selection and association mapping in rice (*Oryza sativa*): effect of trait genetic architecture, training population composition, marker number and statistical model on accuracy of rice genomic selection in elite, tropical rice breeding lines. PLOS Genetics 2015;11(2):e1004982.

36. The R Project for Statistical Computing. https://www.r-project.org/. Accessed 15 May 2018.

37. Browning BL, Browning SR. Genotype imputation with millions of reference samples. Am J Hum Genet 2016;98:116–26.

38. Beagle 5.0. https://faculty.washington.edu/browning/beagle/beagle.html. Accessed 15 May 2018.

39. SnpEff. http://snpeff.sourceforge.net/. Accessed 15 May 2018.

40. Rice Genome Annotation Project (RGAP) release 7. 2013. http://rice.plantbiology.msu.edu/. Accessed 3 May 2018.

41. sNMF: Fast and Efficient Estimation of Individual Ancestry Coefficients. http://membres-timc.imag.fr/Olivier.Franc-ois/snmf/index.htm. Accessed 15 May 2018.

42. FastME 2.0: a comprehensive, accurate and fast distance-based phylogeny inference program. http://www.atgc-mon-tpelier.fr/fastme/. Accessed 15 May 2018.

43. Langlois PA, Snelling J, Hamilton JP, et al. Characterization of the *Xanthomonas translucens* complex using draft genomes,
comparative genomics, phylogenetic analysis, and diagnos-
tic LAMP assays. Phytopathology 2017;107:519-27.

44. Triplett L, Hamilton JP, Buell CR, et al. Genomic analysis of *Xanthomonas oryzae* from US rice reveals substantial divergence from known *X. oryzae* pathovars. Appl Environ Microbiol 2011;77(12):3930-7.

45. Lang JM, Langlois P, Nguyen MHR, et al. Sensitive detection of Xanthomonas oryzae pv. oryzae and X. oryzae pv. oryzicola by loop-mediated isothermal amplification. Appl Environ Microb 2014;80:4519-30.

46. Triplett L, Verdier V, Campillo T, et al. Characterization of a novel clade of Xanthomonas isolated from rice leaves in Mali and proposal of Xanthomonas maliensis sp. nov. Antonie van Leeuwenhoek 2015;107:869-81.

47. Ash GJ, Lang JM, Triplett LR, et al. Development of a genomics-based LAMP (Loop-1 mediated isothermal amplification) assay for detection of Pseudomonas fuscovaginae from rice. Plant Dis 2014;98:909-15.

48. Uniqprimer. https://github.com/SouthGreenPlatform/Uniqprimer. Accessed 15 May 2018.

49. CGIAR. https://www.cgiar.org/. Accessed 15 May 2018.

50. CGIAR: Open Access and Open Data. https://www.cgiar.org/how-we-work/accountability/open-access/. Accessed 15 May 2018.

51. Research Data Alliance. https://www.rd-alliance.org/. Accessed 15 May 2018.

52. Simmhan YL, Plale B, Gannon D. A survey of data provenance in e-science. ACM SIGMOD Record 2005;34(3):31-36.

53. Zhou Q, Ghoshal D, Plale B. Study in usefulness of middleware-only provenance. In: 2014 IEEE 10th International Conference on e-Science, Sao Paulo, 2014:215-22,doi:10.1109/eScience.2014.49.

54. Suriarachchi I, Zhou Q, Plale B, et al. A capture and visualization system for scientific data provenance. J Open Res Softw. 2015;3:e4.

55. Goecks J, Nekrutenko A, Taylor J. Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol 2010;11(8):R86.

56. Gaignard A, Belhajjame K, Skaf-Molli H. Sharp: Harmonizing and bridging cross-workflow provenance. In: Blomqvist E, Hose K, Paulheim H, et al., eds. The Semantic Web: ESWC 2017 Satellite Events. Cham: Springer; 2017:219-34.

57. Kanwal S, Zaib Khan F, Lonie A, et al. Investigating repro-

ducibility and tracking provenance - a genomic workflow
case study. BMC Bioinformatics 2017;18(1):337.

58. Missier P, Ludascher B, Dey S, et al. Golden trail: Retrieving the data history that matters from a comprehensive provenance repository. Int J Digit Curation 2012;7(1):139-50.

59. Kahn R, Wilensky R. A framework for distributed digital object services. Int J Digit Libr 2006;6(2):115-23.

60. Research Data Alliance PID Kernel Information Working Group. PID Kernel Information guiding principles. 2018. https://www.rd-alliance.org/group/pid-kernel-information-wg/wiki/pid-kernel-information-guiding-principles. Accessed 15 May 2018.

61. Research Data Alliance Data Type Registry Working Group. RDA Data Type Registries Working Group Output. 2016,doi:10.15497/A5BCD108-ECC4-41BE-91A7-20112FF77458.

62. PRAGMA Data Service Prototype. https://github.com/Data-to-Insight-Center/RDA-PRAGMA-Data-Service/wiki/Welco me-to-PRAGMA-Data-Service-Prototype. Accessed 15 May 2018.

63. 3kricegenome. http://s3.amazonaws.com/3kricegenome/. Accessed 15 May 2018.

64. AWS CLI Command Reference: S3. https://docs.aws.amazon.com/cli/latest/reference/s3/. Accessed 15 May 2018.

65. BCFtools. http://samtools.github.io/bcftools/. Accessed 15 May 2018.

66. Galaxy Tool Shed. https://toolshed.g2.bx.psu.edu/. Accessed 15 May 2018.

67. Dereeper A, Bocs S, Rouard M, et al. The coffee genome hub: a resource for coffee genomes. Nucleic Acids Res 2015;43:D1028-35.

68. Cui Y, Chen X, Luo H, et al. BioCircos.js: An interactive Circos JavaScript library for biological data visualization on web applications. Bioinformatics 2016;32(11):1740-2.

69. Docker Images tracking the stable Galaxy releases. https://gihub.com/bgruening/docker-galaxy-stable. Accessed 15 May 2018.

70. The 3000 Rice Genomes Project: The Rice 3000 Genomes Project Data. GigaScience Database 2014. http://dx.doi.org/10.5524/200001. Accessed 15 May 2018.

71. Juanillas V, Dereeper A, Beaume N, et al. Supporting data for "Rice Galaxy: an open resource for plant science." GigaScience Database 2019. http://dx.doi.org/10.5524/100523. Accessed 15 May 2018.