TITLE: SARS-CoV-2 NCBI submission protocol: SRA, BioSample, and BioProject
AUTHORS: Ruth Timme, Emma Griffiths, Heather Blankenship, Erin Young, Duncan MacCannell, Stacia Wyman, Lee Katz

[DESCRIPTION]
<div class = "text-blocks"><div class = "text-block"><span style = "font-weight:bold;">PURPOSE: </span></div><div class = "text-block"><span style = "font-weight:bold;">This is a SARS-CoV-2 specific protocol that covers the steps needed to establish a new NCBI submission environment for your laboratory, including the creation of new BioProject(s) and submission groups. Once these are step up, the protocol then walks through the process for submitting raw reads to SRA and sample metadata to BioSample through the Submission portal.  </span></div><div class = "text-block">For new submitters, there's quite a bit of groundwork that needs to be established before a laboratory can start its first data submission.  We recommend that one person in the laboratory take a few days to get everything set up in advance of when you expect to do your first data submission. </div><div class = "text-block"><span>If you need a pipeline for frequent or large volume submissions,  follow Step 1 in the </span><a href="https://www.protocols.io/edit/sars-cov-2-ncbi-submission-protocol-sra-biosample-bf7bjrin" style = "text-decoration:underline;color:blue;cursor:pointer;"><span style = ":;font-weight:bold;">SARS-CoV-2 NCBI submission protocol: SRA, BioSample, and BioProject</span></a><span style = ":;font-weight:bold;"> </span><span>to get your NCBI submission environment established, then contact </span><a href="mailto:gb-admin@ncbi.nlm.nih.gov" style = "text-decoration:underline;color:blue;cursor:pointer;"><span style = ":;">gb-admin@ncbi.nlm.nih.gov</span></a><span> to set up an account for submitting through the API. </span></div><div class = "text-block">These protocols cover submission using NCBI's Submission Portal web-interface.</div><div class = "text-block"><span style = "font-weight:bold;">Complete in order (1 then 2):</span></div><div class = "text-block"><span style = "font-weight:bold;">1. </span><a href="https://www.protocols.io/edit/sars-cov-2-ncbi-submission-protocol-sra-biosample-br8ym9xw" style = "text-decoration:underline;color:blue;cursor:pointer;"><span style = ":;font-weight:bold;">SARS-CoV-2 NCBI submission protocol: SRA, BioSample, and BioProject</span></a><span style = "font-weight:bold;"> (included protocol)</span></div><div class = "text-block"><ul style = "list-style-type:disc;"><li style = "counter-reset:ol0;list-style-type:disc;">Step-by-step instructions for establishing a new NCBI laboratory submission account and for creating and linking a new BioProject to an existing umbrella effort.</li><li style = "counter-reset:ol0;list-style-type:disc;">SARS-CoV-2 raw data submission to SRA (Sequence Read Archive) and metadata to BioSample.</li><li style = "counter-reset:ol0;list-style-type:disc;"></li><li style = "counter-reset:ol0;list-style-type:disc;"><span style = "font-weight:bold;">2. </span><a href="https://www.protocols.io/edit/sars-cov-2-ncbi-consensus-submission-protocol-genb-bid7ka9n" style = "text-decoration:underline;color:blue;cursor:pointer;"><span style = ":;font-weight:bold;">SARS-CoV-2 NCBI consensus submission protocol: GenBank</span></a></li><li style = "counter-reset:ol0;list-style-type:disc;"><span>     </span><span style = "font-style:italic;">Required</span><span>: established BioProject and BioSamples</span></li><li style = "counter-reset:ol0;list-style-type:disc;">Submit SARS-CoV-2 assemblies to NCBI GenBank, linking to existing BioProject, BioSamples, and raw data.</li></ul></div><div class = "text-block"><span style = "font-weight:bold;">2. </span><a href="https://www.protocols.io/edit/sars-cov-2-ncbi-consensus-submission-protocol-genb-bid7ka9n" style = "text-decoration:underline;color:blue;cursor:pointer;"><span style = ":;font-weight:bold;">SARS-CoV-2 NCBI consensus submission protocol: GenBank</span></a></div><div class = "text-block"><span>     </span><span style = "font-style:italic;">Required</span><span>: established BioProject and BioSamples</span></div><div class = "text-block"><ul style = "list-style-type:disc;"></ul></div><div class = "text-block"><span>Metadata templates, explained! </span><a href="https://www.protocols.io/edit/sop-for-populating-ncbi-submission-templates-for-s-bsbpnamn" style = "text-decoration:underline;color:blue;cursor:pointer;"><span style = ":;">SOP for populating NCBI submission templates</span></a></div></div>

[STEPS]
?. ["Ingredients" to have in place before starting your submissions]
Set up a new NCBI submission environment for your lab1.1: Create an NCBI user account1.2: Set up an NCBI submission user group for your lab1.4: Bookmark the link to your Submission Portal1.5. Identify or establish new BioProjects (detailed in Step 3)Ready for data submission:After these steps are complete you can proceed with BioSample + SRA data submission in Step 2.
?. ["Ingredients" to have in place before starting your submissions]
Create an NCBI user account at NCBI: https://www.ncbi.nlm.nih.gov/account
?. ["Ingredients" to have in place before starting your submissions]
Establish an NCBI submission user group for your laboratory. We recommend using this user group for all NCBI submissions related to microbial genome surveillance. This will link your laboratory's NCBI data ownership to the user group and not to individuals, allowing anyone in the current group to perform updates or retractions and answer inquiries from the NCBI staff, even if there's been a complete turnover of staff since the original data submission. User groups also ensure consistent data ownership across BioProjects, BioSamples, and sequence data.  If your laboratory has non-overlapping research groups submitting and managing data at NCBI, multiple user groups can be established to track these efforts separately. Your laboratory might already have a submission group established!  Check the "Group" tab in the Submission Portal, https://submit.ncbi.nlm.nih.gov/groups/.  Ask your colleagues to do the same thing, to ensure your laboratory doesn't already have one in place.  Creating a new submission group: 1. Submit an email request to submit-help@ncbi.nlm.nih.gov containing the following information: 2. Look for an email reply entitled "NCBI Submission Portal Group invitation" and click on the enclosed link to accept the invitation.
"Dear NCBI help staff,     Please establish a new user group for my laboratory.     I'm including the following information to help set up the group:    Short name of the group (abbreviation, e.g. "fda_ny")     Full name of the group (e.g. "NY Wadsworth submission group")     Contact email(s) to start the group     Institution and department or group     Physical address including country     Primary contact person, first and last name plus email.     * if you have existing submissions you want to be converted, please request the ownership change in this email.     i.e., Please assign this new user group to the following BioProjects and linked data.    Thank you,"
?. ["Ingredients" to have in place before starting your submissions]
Managing your NCBI submission user group.  After a user group has been established it can be edited for membership and permissions by clicking in the “group” tab of the Submission Portal (https://submit.ncbi.nlm.nih.gov/groups/), then on the Group Id hyperlink, e.g 'fda_ny' in the above example. Users with admin privileges can update contact information in the "profile" tab and membership in the "Members" tab. New members can be invited by clicking on the "Invite members" link.  This user group should be kept up-to-date as members enter and leave the laboratory.Permissions levels:READ: primarily for collaborators who can see the submissions, but not edit them.MODIFY, SUBMIT, DELETE: Permissions to submit, modify, or retract data (members usually have all or none of these permissions)ADMIN: Can invite or remove members of the submission group. Ensure that at least one (or more) members of your group have ADMIN privileges.
?. ["Ingredients" to have in place before starting your submissions]
Bookmark “my submissions” at NCBI: https://submit.ncbi.nlm.nih.gov/subs/. This is the page where you view and track all of your past submissions. If you see a blank page with a yellow box in the upper right corner saying “please login”, click this link and login using the credentials created in Step 1.1.
?. ["Ingredients" to have in place before starting your submissions]
Identify or establish a new BioProjectUmbrella BioProjects. If you are already part of a surveillance network, (e.g. SPHERES, COG-UK, CanCOGeN, etc) you should use one of their established umbrella BioProjects. For reference, here are some of the umbrella projects established for SARS-CoV-2 surveillance:SPHERES (US): PRJNA615625CanCOGeN (Canada), PRJNA623807Data BioProjects. Does your laboratory have an established data BioProject for this effort? If not please follow instructions in Step 3 for creating a new one. Countries with single data projects (not exhaustive):COG-UK (United Kingdom): PRJEB37886Turkey: PRJNA636004Switzerland: PRJEB38472South Africa: PRJNA624358
More information:Learn more about data vs umbrella BioProjects in Step 3.
?. [Data submission (BioSample and SRA) ]
Data submission (source metadata and sequence data):This protocol follows a one-step data submission process where the source metadata is submitted at the same time as the sequence data.SARS-CoV-2 landing page: https://submit.ncbi.nlm.nih.gov/sarscov2/Click "Submit" under the Sequence Read Archive (SRA) option
?. [Data submission (BioSample and SRA) ]
Download and populate the sample (BioSample) and sequence (SRA) metadata templates:1. BioSample package: SARS-CoV-2: clinical or host-associated v1.0BioSample package with custom PHA4GE pick lists: 2. SRA: PHA4GE sequence metadata template. (This is an extension of NCBI's SRA metadata template)For each SARS-CoV-2 isolate intended for submission, you will create one BioSample and one associated SRA entry.  You can submit a single isolate at a time, or as a batch from an entire sequencing run or collection.
Follow PHA4GE guidelines for populating the metadata templates:  PHA4GE SARS-CoV-2 Contextual Data Specification for organizing public and non-public SARS-CoV-2 metadata. **Read through this specification thoroughly before starting your submission.**Protocols.io Guidance for translating the PHA4GE spec into NCBI submission templates.  A brief summary of the above specification for NCBI-relevant attributes.**If your lab is storing metadata in a single spreadsheet (vs a LIMS) you could create one master NCBI metadata submission spreadsheet for *all* isolates, then cut/paste into the respective submission templates.
?. [Data submission (BioSample and SRA) ]
Click the “New submission” box.
?. [Data submission (BioSample and SRA) ]
Submitter tab: Populate with submitter info. The “submitter” is the name of the person, or user group, who is physically doing the submissions, not a supervisor or PI. Select the appropriate submission group name (see Step 1.2 for creating a new submission group), and describe the submitting organization or laboratory name.  This will be auto-populated from the contact info you included in your NCBI user account. Click "Continue" to proceed.
?. [Data submission (BioSample and SRA) ]
GENERAL INFO tab:1. BioProject:  Did you already register a BioProject for this effort?  If not please follow instructions in Step 3 for creating a new BioProject and return back to this step with accession in hand.   Click "Yes" and paste in your data BioProject accession, e.g. PRJNA614995. 2. BioSample: Click "NO" here. You will be registering BioSamples within this current submission3. Release date:  Choose "Release immediately following processing". 4. Click Continue.
?. [Data submission (BioSample and SRA) ]
BIOSAMPLE TYPE tab:You are choosing the appropriate metadata package here (i.e. what kind of samples are you submitting?).Select "SARS-CoV-2: clinical or host-associated"
**Metadata packages are in development for environmental and wastewater samples.**This step will be updated as soon as these packages are available.
?. [Data submission (BioSample and SRA) ]
BIOSAMPLE ATTRIBUTES tab:Choose "Upload a file using Excel or text format (tab-delimited) that includes the attributes for each of your BioSamples".Then click "Choose File" and browse to your populated PHA4GE BioSample_template Excel file.If you have not populated your PHA4GE BioSample metadata template yet, download and follow the guidance in Step  2.1.**Skip antibiogram sections (not relevant for SARS-CoV-2)Click "Continue".NCBI will do a validation check on your metadata.  Resolve any red "errors" reported back by editing the spreadsheet and replacing the uploaded file.  Review any yellow "Warnings" and proceed if everything looks ok.Click "Continue".
?. [Data submission (BioSample and SRA) ]
SRA metadata tab:Choose: "Upload a file using Excel or text format (tab-delimited)"Upload the SRA metadata template populated in Step 2.1 (Excel file works here). Click "Continue".NCBI will do a validation check on your metadata.  Resolve any red "errors" reported back by editing the spreadsheet and replacing the uploaded file.  Review any yellow "Warnings" and proceed if everything looks ok.Click "Continue".
?. [Data submission (BioSample and SRA) ]
Files tab:Each laboratory will establish its own path for transferring files.  In general, selecting the web browser option should work for uploading ~48 sequences at a time. For a more stable internet connection, your laboratory can use FTP or Aspera. Directions for doing so pop up after clicking the FTP radio button
?. [Data submission (BioSample and SRA) ]
REVIEW & SUBMIT tab:Check over your entire submission, then click submit.If corrections are needed, you can go back and select individual tabs to edit your submission.
If you are having trouble finalizing your submission, contact the relevant NCBI database for assistance and include your submission ID in the email subject (SUB#######):BioSample (for source metadata issues): biosamplehelp@ncbi.nlm.nih.govSRA (for raw sequence or sequence metadata issues): sra@ncbi.nlm.nih.gov
?. [Data submission (BioSample and SRA) ]
BioSample accessions will be automatically created upon submission and will be available on the “my submissions” page of the Submission Portal by clicking on “## objects” within the submission record (usually within 2 hours). You can also download by clicking the “Download attributes file with BioSample accessions”. Accessions will start with SAMNxxxxxxxx.  You will also receive an email containing these same accessions.
?. [Data submission (BioSample and SRA) ]
SRA Accessions:SRA run accessions will be available on the “my submissions” page of the Submission Portal by clicking on “## objects” within the submission record (usually within 2 hours). You can also download by clicking the “Download metadata file with SRA accession”. Accessions will start with SRRxxxxxxx.” You will also receive an email containing these same accessions.
?. [Data submission (BioSample and SRA) ]
Important data stewardship and curation notes:For updates, corrections, or retractions to your BioSample and SRA records, follow the guidance provided in the NCBI Curation Protocol: https://www.protocols.io/view/ncbi-data-curation-protocol-bacaiase. Some edits can be made within the Submission Portal and others need to be done via email.
Caution: It is possible for a single BioSample to have more than one SRR IDs. Two scenarios include:Two runs were submitted for the same isolate/BioSample, which is not generally recommended for surveillance. Follow Step 3 in the NCBI curation protocol to retract one of them). if the initial submission was retracted and new a new run was submitted.  It's important to keep track of both IDs, even if one was retracted.
?. [BioProject Creation]
Create a new BioProject  BioProjects are an organizing tool at NCBI that pulls together different kinds of data submitted across multiple NCBI databases. Each BioProject has a unique URL, providing a home page with a title, description, links to lab websites, publications, funding resources associated with a particular project, along with links to the deposited data. A basic data BioProject holds actual sequence data, assemblies, and their associated metadata. An umbrella BioProject is a way to group two or more data BioProjects together, which is useful for coordinating disease surveillance and for looking across the grouped BioProjects in a single view.This protocol describes the steps for creating a new data BioProject linked to an existing umbrella BioProject (usually established by a coordinating group, e.g. SPHERES or CanCOGen).
Umbrella BioProjects: If you think need to establish a new umbrella BioProject (for an entirely new project or laboratory network), send an email to bioprojecthelp@ncbi.hlm.nih.gov and they will help create one for you.
?. [BioProject Creation]
Navigate to the “My Submissions” page, https://submit.ncbi.nlm.nih.gov/subs/, and click “BioProject” in the “Start a new submission” box.
?. [BioProject Creation]
Click the “New submission” button:
?. [BioProject Creation]
SUBMITTER tab: Populate with submitter info. An NCBI "submitter” is the name of the person or submission group who is managing the submissions, not a supervisor or PI. **Select the appropriate submission group name (see Step 1.2 for creating a new submission group), and describe the submitting organization or laboratory name.  This will be auto-populated from the contact info you included in your NCBI user account.
?. [BioProject Creation]
PROJECT TYPE tab: *Project data type: Choose: "Genome sequencing and assembly"*Sample scope: For a Data BioProject: select "multi-isolate:. This will allow you to submit multiple isolates or strains of the same species.
?. [BioProject Creation]
TARGET tab:For a Data BioProject: Populate ONLY the Organism name here: "Severe acute respiratory syndrome coronavirus 2", or higher level taxonomic classification for broader surveilliance.Leave the strain info and Description fields blank.
?. [BioProject Creation]
GENERAL INFO tab: Click “Release immediately following processing”.Include a brief title describing the effort. Data BioProject Title: e.g., “SARS-CoV-2 WGS: Utah Public Health Laboratory”. Public Description: e.g., “Whole-genome sequencing of XXX pathogens as part of XXXX surveillance effort.” Relevance: medical. Is your project part of a larger initiative that is already registered at NCBI? Data BioProjects. Click “Yes” and include a brief description and umbrella BioProject accession number (e.g. for SPHERES use PRJNA615625, or refer to Step 1.5 for full list). This will properly link your data project to the umbrella. Public Description: e.g., “Whole-genome sequencing of XXX pathogens as part of XXXX surveillance effort.” Relevance: medical. Is your project part of a larger initiative that is already registered at NCBI? External links: Include a link to your laboratory’s website here.
?. [BioProject Creation]
BioSample tab: Leave blank!!  You will create biosamples separately.
?. [BioProject Creation]
Publications tab: If relevant, include publications from your laboratory.
?. [BioProject Creation]
Review and Submit tab: Check if everything looks correct and edit if necessary, then click “submit.”
?. [BioProject Creation]
The BioProject accession will be available within a few minutes on the “my submissions” page of the Submission Portal, “PRJNAxxxxxx.”  You will also receive an email containing the new accession.
?. [BioProject Creation]
If you are part of a coordinated surveillance effort, like SPHERES, please alert the coordinating body that a new BioProject was created under an existing umbrella.For SPHERES, contact oamd@cdc.gov.
?. [BioProject Creation]
Important data stewardship and curation notes:Develop an internal method for storing and tracking your BioProject accessions! They are required for every BioSample and sequence data submission to ensure proper linkage.Bookmark URLs for each of your BioProjects to monitor the public-facing view of your submissions.        e.g. Virgina DCLS's SARS-CoV-2 BioProject: https://www.ncbi.nlm.nih.gov/bioproject/625551For updates to your BioProjects, follow the guidance provided in the NCBI Curation Protocol: https://www.protocols.io/view/ncbi-data-curation-protocol-bacaiase. Most edits can be made within the Submission Portal by clicking the "Manage Data" button. Others need to be done via email.