APPENDIX I: Data, Sharing and Archive Process This appendix describes the different types of incident and related data being created and covered under the Plan to meet Critical Information Requirements (CIRs) of the Unified Command (UC). It provides specific details about file types, processing responsibilities, delivery schedule and use restrictions. It also describes who is managing the data, how and when the data will be shared and disseminated to other response staff, if there are any sharing or use restrictions, and how sharing would be managed for the public if appropriate*. This outline describes the functional sections of this appendix. Each Section provides a description and table to capture the pertinent information being created and the operational cycle that each dataset will support for addressing UC CIRs. Section I – DATA MANAGEMENT AND SHARING PROCESS GIS Data Photography & Video Remote Sensing Response Sampling Response Databases Section II – DATA PRESERVATION AND PROTECTION Short-Term Storage Long-Term Storage Transfer to Long-Term Storage Section III – COMMON OPERATING PICTURE Section IV – DATA INFRASTRUCTURE AND HARDWARE Section V – METADATA AND FILE NAMING Section VI – REFERENCES * For any data to be released to the public, it must be approved and released by Unified Command. SECTION I - DATA MANAGEMENT AND SHARING PROCESS:
Overflight oil extent GDB, SHP Based on overflight observations this depicts the extent and transport of oil. Helps to initialize trajectory forecasts. Ephemeral Twice daily Response only Overflight observers and GIS analysts RP, NOAA, USCG GIS unit RP COP, ERMA, NOAA SFTP, RP Central Data Server SCAT GDB, SHP Shoreline Cleanup Assessment Techniques Ephemeral Once daily Response only SCAT Teams SCAT Coordinator SCAT Data Managers RP COP, ERMA, NOAA SFTP, RP Central Data Server Response locations and boundaries GDB, SHP ICP location, Staging Saftey Zones, Security Zones until changed As needed Some public Logistics and Operations Sections OSC, LSC GIS Unit RP COP, ERMA, NOAA SFTP, RP Central Data Server Operational data GDB, SHP Task Force locations, Operations Assets, Shoreline cleanup Ephemeral As needed Response only Operations Section OSC GIS Unit RP COP, ERMA, NOAA SFTP, RP Central Data Server Insitu Burn GDB, SHP Burn locations and InSitu Burn safety zones Ephemeral As needed Response only Operations Section OSC, InSitu Burn unit GIS Unit RP COP, ERMA, NOAA SFTP, RP Central Data Server Dispersant Application GDB, SHP Locations of dispersant application both air and on-water based Ephemeral Once daily Response only Operations Section OSC, Dispersant Operations GIS Unit RP COP, ERMA, NOAA SFTP, RP Central Data Server Waste Transfer and Management GDB, SHP Locations of waste management transfer stations Valid until changed As needed Response only Logistics, Planning and Operations Section LSC, OSC, PSC, Waste Management Unit GIS Unit RP COP, ERMA, NOAA SFTP,
Dataset Data Type & Format Description Temporal Coverage Delivery Schedule Use Restrictions Method of Field Collection Collector & P.O.C. Data Processor & P.O.C Repository RP Aerial Imagery Photo and Video Response photography and video from a UAV Registered Quadcopter RP Central Server, NOAA SFTP, Local Hard drives Wildlife Observations Photo Opportunistic wildlife sightings from daily overflights Helicopter RP, NOAA, USFWS Response Data Management Unit RP Central Server, NOAA SFTP, Local Hard drives Overflight Oil Observations Photos of oil on from daily overflights Helicopter RP, USCG, NOAA Response Data Management Unit RP Central Server, NOAA SFTP, Local Hard drives Remote Sensing: Remote sensing products will largely come from external organizations and not normally from direct efforts within the response organization. Examples are commercial satellite companies, federal remote sensing offices, and private remote sensing companies. The raw data will more than likely be managed and stored with the owner’s infrastructure. The response organization would receive the final analysis products to utilize in response. Below is a documentation of what remote sensing efforts are being used, what products are being requested, and primary contact information. Dataset Data Type & Format Description Temporal Coverage Delivery Schedule Use Restrictions Method of Field Collection Field Collector & P.O.C. Data Processor & P.O.C Short-Term Repository Oil Extent Imagery Remote Sensing: SAR, IR Oil extent imagery from either satellite based platforms or fixed wing. Best Available Best Available Logistics Section (213RR) NOAA NESDIS, External Remote Sensing RP Central Server, NOAA SFTP Response Sampling:
Dataset Data Type & Format Description Temporal Coverage Delivery Schedule Use Restrictions Method of Field Collection Field Collector & P.O.C. Data Processor & P.O.C Short-Term Repository Real-Time Air Monitoring Field samples Operational air sampling. Metadata and physical parameters of samples. Log Book and Mobile App Delivery: Sync to SQL Server RP central Data Server, NOAA DIVER Personal Sampling samples Operational sampling. Metadata and physical parameters of samples. Log Book and Mobile App Delivery: Sync to SQL Server RP central Data Server, NOAA DIVER, SCRIBE Personal Sampling Analytical results Results data for samples Lab EDD Delivery: Lab EDD verified RP Data Managers and imported to SCRIBE RP central Data Server, NOAA DIVER, SCRIBE (Not published) Personal Sampling Validated analytical data Validation data from third party validators Lab EDD edited by Validation personnel to change flags for specific fields Delivery: Lab EDD verified by third party and imported to SCRIBE RP central Data Server, NOAA DIVER, SCRIBE (Not published) Environmental Sampling Field samples Operational sampling. Metadata and physical parameters of samples. Log Book and Mobile App; Delivery: Sync to SQL Server RP Central Data Server, NOAA DIVER, SCRIBE Respository / Field Documents
Environmental Sampling Analytical results Results data for samples Lab EDD; Delivery: Lab EDD verified RP Data Managers and imported to SCRIBE Delivery: Lab EDD verified RP Data Managers and imported to SCRIBE RP Central Data Server, NOAA DIVER, SCRIBE Respository Environmental Sampling Validated analytical data Validation data from third party validators Lab EDD edited by Validation personnel to change flags for specific fields Delivery: Lab EDD verified by third party and imported to SCRIBE RP Central Data Server, NOAA SCRIBE Respository Column Monitoring Samples Operational sampling. May incorporate SMART monitoring. Metadata and physical parameters of samples. monitoring RP Central Data Server, NOAA SCRIBE Respository Oil Characterization Sampling Samples Operational sampling. Metadata and physical parameters of samples. Physical samples, COC RP, NOAA, USCG, RP Lab, , USCG Lab, RP Central Data Server, NOAA DIVER, SCRIBE Respository, State system Oil Characterization Sampling Analytical results Results data for samples RP, NOAA, USCG, Response Databases: During a response multiple databases may be used for various of data. This table is meant to document what efforts are being used, what products are being developed, product schedule, use considerations and primary contact information.
Database Data Type & Format Description Temporal Coverage Delivery Schedule Use Restrictions Method of Field Collection Field Collector & P.O.C. Data Processor & P.O.C Repository RP Central Data Server Data Warehouse NOAA Data Warehouse NOAA’s data warehouse capable of storing and querying both structured and unstructured data and analytical chemistry. NOAA NOAA Amazon Cloud NOAA SFTP Secure File Transfer Protocol Secure File Transfer Protocol setup by NOAA as a working repository for responders. All responders All responders Federal Servers CTEH File Transfer SCAT Database The database for managing daily SCAT observations. Also includes all forms and field documents. SECTION II - DATA PRESERVATION & PROTECTION: