AndreaBozzo/ceres-open-data-index huggingface dataset:
Fish Detection AI, Optic and Sonar-trained Object Detection Models

The Fish Detection AI project aims to improve the efficiency of fish monitoring around marine energy facilities to comply with regulatory requirements. Despite advancements in computer vision, there is limited focus on sonar images, identifying small fish with unlabeled data, and methods for underwater fish monitoring for marine energy.

A YOLO (You Only Look Once) computer vision model was developed using the Eyesea dataset (optical) and sonar images from Alaska Fish and Games to identify fish in underwater environments. Supervised methods were used within YOLO to detect fish based on training using labeled data of fish. These trained models were then applied to different unseen datasets, aiming to reduce the need for labeling datasets and training new models for various locations. Additionally, hyper-image analysis and various image preprocessing methods were explored to enhance fish detection. 

In this research we achieved:
1.	Enhanced YOLO Performance, as compared to a published article (Xu, Matzner 2018) using earlier yolo versions for fish object identification. Specifically, we achieved a best mean Average Precision (mAP) of 0.68 on the Eyesea optical dataset using YOLO v8 (medium-sized model), surpassing previous YOLO v3 benchmarks from that previous article publication. We further demonstrated up to 0.65 mAP on unseen sonar domains by leveraging a hyper-image approach (stacking consecutive frames), showing promising cross-domain adaptability.

This submission of data includes:
- The actual best-performing trained YOLO model neural network weights, which can be applied to do object detection (PyTorch files, .pt). These are found in the Yolo_models_downloaded zip file
- Documentation file to explain the upload and the goals of each of the experiments 1-5, as detailed in the word document (named "Yolo_Object_Detection_How_To_Document.docx")
- Coding files, namely 5 sub-folders of python, shell, and yaml files that were used to run the experiments 1-5, as well as a separate folder for yolo models. Each of these is found in their own zip file, named after each experiment
- Sample data structures (sample1 and sample2, each with their own zip file) to show how the raw data should be structured after running our provided code on the raw downloaded data
- link to the article that we were replicating (Xu, Matzner 2018)
- link to the Yolo documentation site from the original creators of that model (ultralytics)
- link to the downloadable EyeSea data set from PNNL (instructions on how to download and format the data in the right way to be able to replicate these experiments is found in the How To word document)

Tags: ai, code, cross-domain-adaptability, energy, eyesea, eyesea-dataset, eyesea-optical-dataset, fish-detection-ai, hydrokinetic, hyper-image-approach, marine, mhk, neural-networks, object-detection, power, python, pytorch, pytorch-code, shell-code, small-fish-detection, sonar-trained-object-detection-models, yaml-code, yolo-model, yolo-performance, yolo-version-8, yolov8, you-only-look-once-model
Organization: Department of Energy
OC Natural Tree Row

The natural tree row polygon layer was developed in the summer of 2000 with on-screen digitizing in ArcView, using the 1997 Oakland County digital Orthophotography and the 1995 Land Use/Land Cover coverage provided by the Southeastern Michigan Council of Governments (SEMCOG) as reference themes. Note: The southeast portion of the county (9 geographic townships) was excluded from this coverage. The key attribute associated with this coverage is "Acres".

Tags: biota, data-store, economy, environment, farming, natural-area
Organization: City of Ferndale, Michigan
PoroTomo: BRAD, BRD1, and BRDY GPS Station RINEX Files - January 19, 2018

This dataset provides links to daily RINEX files for three GPS stations at Brady's Hot Springs as of January 19, 2018. The data is formatted as compressed GNSS RINEX observation files, accessible through .txt files, as well as in links to the complete daily time series data. Additional Resources, including the original database for direct downloads, links to websites that show the position time-series of BRAD, BRD1, and BRDY stations, and a link to the previous set of RINEX data (as of 10-30-2017), are also provided.

Tags: brad, brady, brd1, brdy, energy, geodesy, geothermal, gps, nevada, porolastic-tomography, porotomo, rinex
Organization: Department of Energy
PoroTomo: BRAD, BRD1, and BRDY GPS Station RINEX Files - October 30, 2017

This dataset provides links to daily RINEX files for three GPS stations at Brady's Hot Springs as of October 30, 2017. The data is formatted as compressed GNSS RINEX observation files, accessible through .txt files, as well as in links to the complete daily time series data. Additional Resources, including the original database for direct downloads, links to websites that show the position time-series of BRAD, BRD1, and BRDY stations, and links to the previous and following set of RINEX data (as of 7-17-2017 and 1-19-2018, respectively), are also provided.



Tags: brad, brady, bradys-hot-springs, brd1, brdy, energy, field, geodesy, geothermal, gps, nevada, poroelastic-tomography, porotomo, rinex
Organization: Department of Energy
Habitat classification from multibeam.  SEFIS Survey Areas in the South Atlantic Bight, 2012

This dataset contains a vector shapefile describing the geomorphology of 21 areas along the shelf edge off the South Atlantic Bight where NOAA South East Fisheries Independent Survey (SEFIS) conducts research on reef fish species of interest. Areas surveyed in 2012 from the NOAA ship Pisces were mapped and classified. Backscatter and bathymetric data were acquired using the SIMRAD ME70 multibeam fisheries sonar system.

Tags: 2012, aquatic habitat, backscatter, bathymetry, bathymetry/seafloor topography, bathymetry/topography, benthic, biogeography, biosphere, continental shelf, country/territory, description, doc/noaa/nos/nccos, earth science, efh, geographic information, gis, habitat, mbes, me70, multibeam, national centers for coastal ocean science, national ocean service, noaa, noaa ship pisces, north carolina, ocean explorer, oceans, reef, reef habitat, se_atl_efh, seafloor, sefis, sonar, south atlantic bight, south atlantic ocean, south carolina, southeast atlantic, u.s. department of commerce, united states of america
Organization: National Oceanic and Atmospheric Administration, Department of Commerce
PoroTomo: BRAD, BRDY, and BRD1 GPS Station Webpages

This dataset provides links to the GPS station websites for the BRAD, BRDY, and BRD1 GPS stations at Brady's Hot Springs in Nevada.  The website is hosted by the Nevada Geodetic Laboratory, and provides plots and time series data for each of the GPS station's locations.

Tags: brad, brady, brady-hot-springs, bradys-hot-springs, brd1, brdy, energy, field, geodesy, geothermal, gps, nevada, poroelastic-tomography, porotomo, rinex
Organization: Department of Energy
PoroTomo: BRAD, BRD1, and BRDY GPS Station RINEX Files - April 14, 2017

This dataset provides links to daily RINEX files for three GPS stations at Brady's Hot Springs as of April 14, 2017. The data is formatted as compressed GNSS RINEX observation files, accessible through formatted CSV files, as well as in links to the complete daily time series data. The CSV files serve as a directory for navigating to the correct FTP locations to access the desired data. Users are advised to cross-reference the filenames and station identifiers (BRAD, BRD1, or BRDY) when downloading files. The files were generated by the UNAVCO GSAC Repository, and all data-related timestamps and units are specified within the CSV structure. Additional Resources, including the original database for direct downloads, links to websites that show the position time-series of BRAD, BRD1, and BRDY stations, and links to the previous and following set of RINEX data (as of 1-18-2017 and 7-17-2017, respectively), are also provided.

Tags: brad, brady, bradys-hot-springs, brd1, brdy, energy, field, ftp-location, geodesy, geothermal, gps, nevada, porotomo, rinex
Organization: Department of Energy
PoroTomo: BRAD, BRD1, and BRDY GPS Station RINEX Files - January 18, 2017

This dataset provides links to daily RINEX files for three GPS stations at Brady's Hot Springs as of January 18, 2017. The data is formatted as compressed GNSS RINEX observation files, accessible through formatted CSV files, as well as in links to the complete daily time series data. The CSV files serve as a directory for navigating to the correct FTP locations to access the desired data. Users are advised to cross-reference the filenames and station identifiers (BRAD, BRD1, or BRDY) when downloading files. The files were generated by the UNAVCO GSAC Repository, and all data-related timestamps and units are specified within the CSV structure. Additional Resources, including the original database for direct downloads, links to websites that show the position time-series of BRAD, BRD1, and BRDY stations, and links to the previous and following set of RINEX data (as of 10-18-2016 and 4-14-2017, respectively), are also provided.

Tags: brad, brady, bradys-hot-springs, brd1, brdy, field, ftp-location, geodesy, geothermal, gps, nevada, porotomo, rinex
Organization: Department of Energy
PoroTomo: BRAD, BRD1, and BRDY GPS Station RINEX Files - October 18, 2016

This dataset provides links to daily RINEX files for three GPS stations at Brady's Hot Springs as of October 18, 2016. The data is formatted as compressed GNSS RINEX observation files, accessible through formatted CSV files, as well as in links to the complete daily time series data. The CSV files serve as a directory for navigating to the correct FTP locations to access the desired data. Users are advised to cross-reference the filenames and station identifiers (BRAD, BRD1, or BRDY) when downloading files. The files were generated by the UNAVCO GSAC Repository, and all data-related timestamps and units are specified within the CSV structure. Additional Resources, including the original database for direct downloads, links to websites that show the position time-series of BRAD, BRD1, and BRDY stations, and links to the previous and following set of RINEX data (as of 4-26-2016 and 1-18-2017, respectively), are also provided.


Tags: brad, brady, bradys-hot-springs, brd1, brdy, field, ftp-location, geodesy, geothermal, gps, nevada, porotomo, rinex, station-deployment
Organization: Department of Energy
PoroTomo: BRAD, BRD1, and BRDY GPS Station RINEX Files - April 26, 2016

This dataset provides links to daily RINEX files for two GPS stations at Brady's Hot Springs as of April 26, 2016. The data is formatted as compressed GNSS RINEX observation files, accessible through formatted CSV files, as well as in links to the complete daily time series data. The CSV files serve as a directory for navigating to the correct FTP locations to access the desired data. Users are advised to cross-reference the filenames and station identifiers (BRAD or BRDY) when downloading files. The files were generated by the UNAVCO GSAC Repository, and all data-related timestamps and units are specified within the CSV structure. Additional Resources, including the original database for direct downloads, links to websites that show the position time-series of BRAD, BRD1, and BRDY stations, and links to the previous and following set of RINEX data (as of 1-4-2016 and 10-18-2016, respectively), are also provided.

Tags: brad, brady, bradys-hot-springs, brd1, brdy, field, ftp-location, geodesy, geothermal, gps, nevada, porotomo, rinex
Organization: Department of Energy
PoroTomo: BRAD and BRDY GPS Station RINEX Files - January 4, 2016

This dataset provides links to daily RINEX files for two GPS stations at Brady's Hot Springs as of January 4, 2016. The data is formatted as compressed GNSS RINEX observation files, accessible through formatted CSV files, as well as in links to the complete daily time series data. The CSV files serve as a directory for navigating to the correct FTP locations to access the desired data. Users are advised to cross-reference the filenames and station identifiers (BRAD or BRDY) when downloading files. The files were generated by the UNAVCO GSAC Repository, and all data-related timestamps and units are specified within the CSV structure. Additional Resources, including the original database for direct downloads, links to websites that show the position time-series of both stations, and links to the previous and following set of RINEX data (as of 9-15-2015 and 4-26-2016, respectively), are also provided.

Tags: brad, brady, bradys-hot-springs, brdy, field, ftp-location, geodesy, geothermal, gps, nevada, porotomo, rinex
Organization: Department of Energy
Monthly Composite Chlorophyll Concentrations - Gulf of Maine

This personal geodatabase contains raster images of chlorophyll concentrations in the Gulf of Maine.  These raster images are monthly composites, and were calculated as means or as medians.   The image composites span from 9/1997 to 6/2005. These images were also reprocessed to remove land and no-data values (value = 252 and value = 0, 253, 251 respectively), as well as to calculate the real world values for chlorophyll in micrograms per liter.

Tags: 1997-2005, chlorophyll, doc/noaa/nos/nccos, environmental monitoring, gulf of maine, monthly averages, monthly medians, national centers for coastal ocean science, national ocean service, noaa, ocean color, sbnms_assess_remote_sensing, seawifs, stellwagen bank, u.s. department of commerce
Organization: National Oceanic and Atmospheric Administration, Department of Commerce
GPS Station RINEX Files and Position Time-Series

Links to URL's with latest position time-series of GPS stations SEMN, SEMS, and GARL at the San Emidio Desert Geothermal Area as well as URL with links to archived RINEX files. The data is being taken as part of the WHOLESCALE project for the purpose of developing a protocol for simulating the spatial distribution and temporal evolution of stress in geothermal systems.

Tags: energy, geodesy, geothermal, geothermal-area, gps, gps-stations, nevada, raw-data, rinex, san-emidio, san-emidio-desert
Organization: Department of Energy
PoroTomo: BRAD and BRDY GPS Station RINEX Files - September 15, 2015

This dataset provides links to daily RINEX files for two GPS stations at Brady's Hot Springs as of September 15, 2015. The data is formatted as compressed GNSS RINEX observation files, accessible through formatted CSV files, as well as in links to the complete daily time series data. The CSV files serve as a directory for navigating to the correct FTP locations to access the desired data. Users are advised to cross-reference the filenames and station identifiers (BRAD or BRDY) when downloading files. The files were generated by the UNAVCO GSAC Repository, and all data-related timestamps and units are specified within the CSV structure. Additional Resources, including the original database for direct downloads, links to websites that show the position time-series of both stations, and links to the previous and following set of RINEX data (as of 3-26-2015 and 1-4-2016, respectively), are also provided.

Tags: brad, brady, bradys-hot-springs, brdy, field, ftp-location, geodesy, geothermal, gps, nevada, porotomo, rinex
Organization: Department of Energy
PoroTomo: BRAD and BRDY GPS Station RINEX Files - March 26, 2015

This dataset provides links to daily RINEX files for two GPS stations at Brady's Hot Springs as of March 26, 2015. The data is formatted as compressed GNSS RINEX observation files, accessible through formatted CSV files, as well as in links to the complete daily time series data. The CSV files serve as a directory for navigating to the correct FTP locations to access the desired data. Users are advised to cross-reference the filenames and station identifiers (BRAD or BRDY) when downloading files. The files were generated by the UNAVCO GSAC Repository, and all data-related timestamps and units are specified within the CSV structure. Additional Resources, including the original database for direct downloads and links to the previous and following set of RINEX data (as of 12-2-14 and 9-17-2015, respectively), are also provided.

Tags: brad, brady, brady-hot-spring, brady-hot-springs, bradys-hot-springs, brdy, field, ftp-location, geodesy, geothermal, gps, hydrothermal, nevada, porotomo, rinex
Organization: Department of Energy
Fallon FORGE: Geodetic Data

Fallon FORGE InSAR and geodetic GPS deformation data. InSAR shapefiles are packaged together as .MPK (ArcMap map package, compatible with other GIS platforms), and as .CSV comma-delimited plaintext. GPS data and additional metadata are linked to the Nevada Geodetic Laboratory database at the Univ. of Nevada, Reno (UNR).

Tags: deformation, egs, energy, fallon, forge, geodesy, geodetics, geospatial-data, geothermal, gps, insar, interferometric, nevada, nv, phase-2b, remote-sensing, synthetic-aperture-radar, vetted-no
Organization: Department of Energy
Real Property Tax Assessment Neighborhoods

<DIV STYLE="text-align:Left;"><DIV><P><SPAN>This dataset contains polygons that represent the boundaries of assessment neighborhoods as defined by the DC Office of Tax and Revenue (OTR) Real Property Tax Administration (RPTA). For analysis purposes, RPTA delineates assessment neighborhoods to group properties that are affected by similar economic, political, governmental, and environmental factors. Assessment neighborhoods are defined by the environment of a subject property that has a direct and immediate effect on its value. The assessment neighborhood is a geographic area (in which there are typically fewer than several thousand properties) defined for some useful purpose, such as to ensure for later multiple regression modeling that the properties are homogeneous and share important locational characteristics. Assessment neighborhoods boundaries typically follow street centerlines, hydrological boundaries, and boundaries of major properties such as parks and monuments.These do not reflect precise neighborhood locations and do not necessarily include all commonly-used neighborhood designations.  There is no formal set of standards that describes which neighborhoods are included in this dataset.  Note that the District of Columbia does not have official neighborhood boundaries.</SPAN></P></DIV></DIV>

Tags: assessment-neighborhood-areas, assessment-neighborhoods, district-of-columbia, neighborhood, rpta-neighborhoods, tax, washington-dc
Organization: District of Columbia
Real Property Tax Assessment Sub-Neighborhoods

<DIV STYLE="text-align:Left;"><DIV><P><SPAN>This dataset contains polygons that represent the boundaries of assessment subneighborhoods as defined by the DC Office of Tax and Revenue (OTR) Real Property Tax Administration (RPTA). For analysis purposes, RPTA delineates assessment neighborhoods to group properties that are affected by similar economic, political, governmental, and environmental factors. Assessment subneighborhoods are defined by the environment of a subject property that has a direct and immediate effect on its value. The assessment subneighborhood is a geographic area (in which there are typically fewer than several thousand properties) defined for some useful purpose, such as to ensure for later multiple regression modeling that the properties are homogeneous and share important locational characteristics. Assessment neighborhoods boundaries typically follow street centerlines, hydrological boundaries, and boundaries of major properties such as parks and monuments.These do not reflect precise neighborhood locations and do not necessarily include all commonly-used neighborhood designations.  There is no formal set of standards that describes which neighborhoods are included in this dataset.  Note that the District of Columbia does not have official neighborhood boundaries.</SPAN></P></DIV></DIV>

Tags: assessment-sub-neighborhoods, district-of-columbia, neighborhood, rpta-neighborhoods, tax, washington-dc
Organization: District of Columbia
Military Bases

<div style='text-align:Left;'><div><div><p><span>Military Facilities. The dataset contains locations and attributes of Military Facilities, created as part of the DC Geographic Information System (DC GIS) for the D.C. Office of the Chief Technology Officer (OCTO) and participating D.C. government agencies. Information researched by the DC Office of the Chief Technology Officer identified Military Facilities and DC GIS staff geo-processed the data. </span></p></div></div></div>

Tags: air-force, army, boundary, d-c, dc, dc-gis, dcgis, defense, district-of-columbia, federal, government-facility, intelligencemilitary, marines, military, navy, planningcadastre, washington
Organization: District of Columbia
Integrated Tax System Property Use Codes

The Property Use Code table contains a code, brief description and long description of DC's property use code system. It provides a complete set of the currently available use codes (with their descriptions) that are applicable to various categories of property. A property use code identifies the predominant use of a parcel of real property (and in certain limited instances, other property characteristics are also identified). Visit <a href='http://otr.cfo.dc.gov/publication/real-property-use-code-listing' target='_blank'>http://otr.cfo.dc.gov/publication/real-property-use-code-listing</a> for more info.

Tags: cadastral, district-of-columbia, june2015, land, open-data, property, usecode, washington-dc
Organization: District of Columbia
Integrated Tax System Mixed Tax Types

<div style='text-align:Left;'><div><div><p><span>A table with mix tax type codes for the Integrated Tax System Public Extract (ITSPE) data layers. </span></p><p><span>Public extract of the database used for sending tax bills, also known as tax assessment roll. ITS stores comprehensive tax information such as ownership, mailing addresses etc., of record lots, tax lots, parcels, condominiums and federally owned lands such as reservations and appropriations. This database also processes notices and tax bills.</span></p></div></div></div>

Tags: cadastral, district-of-columbia, its, itspe, land, mixed-use-code, property, public-extract, tax-rates, vpmdata, washington-dc
Organization: District of Columbia
Integrated Tax System Data Dictionary

<div style='text-align:Left;'><div><div><p><span>Table defining the fields for the attribute table of the owner points feature. It reflects the new table structure OTR adopted in Tax Year 2005 reflecting the systems update to the public release file.</span></p></div></div></div>

Tags: cadastral, definitions, district-of-columbia, itspe, land, location, lot, owner, real-property, square, tax-assessment, washington-dc
Organization: District of Columbia
State of Washington DC - 2021

<div style='text-align:Left;'><div><div><p><span>Planned Land Use from the 2021 Comprehensive Plan Amendment Act of 2021. This data set is an update to the 2006 original version, which was digitized from the Generalized Land Use Map of the District of Columbia Comprehensive Plan. It shows which areas of the city are planned for various uses. These uses include residential and commercial uses at various densities, public land, institutional, federal, and industrial uses. Although planned uses and current uses may be similar, this is not a data set describing current land use. This is a generalized product, and cannot be used to identity specific uses for all specific locations in the District of Columbia.</span></p></div></div></div>

Tags: compplan, comprehensive-plan, comprehensive-plan-land-use, district-of-columbia, future-land-use, land-use, landuse, planning, washington-dc
Organization: District of Columbia