OceanCV/Pythias_Oasis · Hugging Face

Pythia's Oasis Methane Seep YOLOv12 Benthic Megafauna Object Detection Model

Methane seeps are a critical source of habitat and primary productivity in the deep sea. They also support commercially important fish species, including sablefish and rockfish. Due to the difficulty of studying these habitats, many have not been ecologically characterized. In order to monitor the health of the deep ocean in the face of global climate change, it is important to investigate species and habitat diversity around methane seeps. This model aims to help count and identify species at a specific methane seep site called Pythia’s Oasis, off the coast of Oregon. The site is at a depth of about 1,000 meters and is unique because of the presence of warm diffuse flow as well as methane hydrate. The site has a high diversity and density of marine life, and is distinct enough from nearby sites that it requires its own model.

Model Details

This model was trained using YOLOv12 for object detection.

Dataset

This dataset is a series of frames pulled from ROV video during the Pythia’s Oasis research cruise in 2019. Although multiple dives occurred in this location, this dataset only includes imagery from the first dive, J2-1225. The original dive footage was edited down to about an hour and a half, excluding the ascent and descent, as well as removing video with the ROV arm or other machinery. In total, 1,110 images were extracted from the edited footage. Initial annotation predictions were made by Fathomnet, and classes were then cleaned manually. The classes include a variety of anemones, fishes, crabs, corals, sea stars, jellies, and sea cucumbers. Clams and snails, while present, were excluded due to time constraints during annotation.

Original Video Resolution: 1080p

Exported/Edited Video Resolution: 1920 x 1088

Preprocesssing: Auto-orient, resize to 1024 x 1024

Augmentations: Shear (+10 degrees horizontal, +10 degrees vertical), Brightness (between -10% and 10%), and Blur (up to 2.5px)

Dataset size after Augmentations: 2998

Class Name	Number of Annotations
Actiniaria	1865
Transluscent Actinaria	13
Soft Coral	200
Black Coral	10
Hippastera	2
Asteroidea	10
Isosicyonis	208
Small Anemone	56
Scotoplanes	1089
Eelpout	105
Rattail	28
Rockfish	1057
Deep Sea Sole	31
Hagfish	20
Chionoecetes tanneri	10
Ctenophora	219
Cable	9

Examples of each class from the dataset. Top, from left to right: Actiniaria, Black Coral, Soft Coral, and Translucent Actiniaria. Middle, from left to right: Eelpout, Deep Sea Sole, Hippastera, Chionoecetes tanneri, and Small Anemone. Bottom, from left to right: Hagfish, Ctenophora, Asteroidea, Isosicyonis, Cable, and Scotoplanes.

Model Performance

The model currently confuses many classes for the background and misses many classes. This is because of incomplete annotation of all classes, and likely because clams and snails were excluded. Additionally, classes were very unbalanced. Classes with less annotations tended to have either extreme high or low F1 scores, and some classes were not included in the val set (Black Coral). Continued class cleaning and supplementation with additional imagery should improve this model in later versions. Despite these issues with the current model, the F1 score is fairly good on average. Rockfish, Actiniaria, and Scotoplanes performed well in terms of having a high F1 score across a large confidence range, and the number of annotations was high for these classes, so this is more likely to reflect accuracy in the model predictions.

Potential Use Case

This model could be used to characterize species richness, diversity and density along a video transect. This data could then be compared to other methane seep sites, or compared to previous surveys if the site is surveyed again in the future. An example hypothesis that could be addressed with this model would be: Pythia's Oasis has unique species density and diversity compared to other methane seep sites.

Attribution

This project uses imagery from the ROV Jason dive J2-1225 from Dr. Deborah Kelley of the University of Washington's cruise AT42-17: "Pythia's Oasis" funded by NSF OCE award 1658201. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. Imagery access can be requested at https://interactiveoceans.washington.edu/contact/.