| --- |
| tags: [image-classification, plankton, PISCO, vision-transformer] |
| license: mit |
| --- |
| # M181_binary |
| |
| First stage of the PISCO dual-ViT: **living vs not-living**. Fine-tuned |
| `google/vit-base-patch16-224-in21k` on expert-validated crops from cruise |
| **M181** (tropical Atlantic, April-May 2022). Test accuracy 97.65%. |
| |
| **Classes (2):** living, not-living |
| |
| ## Important: this model is coupled to its preprocessing |
| Trained on crops produced by the **231204 LUCYD deconvolution** |
| (`lucyd-edof-plankton_231204.pth`, the pipeline default) with **non-isolated** |
| crops (neighbouring particles present). Running it on crops from a different |
| deconvolution model, or on neighbour-isolated crops, is an out-of-domain shift: |
| measured on ATAIR-BSH, swapping the deconvolution alone collapsed the living |
| rate by 83-93% at unchanged confidence. Treat deconvolution + crop isolation + |
| classifier as one versioned unit. |
|
|
| Preprocessing: resize longest edge to 224, centre-pad to 224x224 with white |
| (255), normalise mean=std=0.5. No rotation at inference. Crops must carry no |
| scale bar (or have it removed with `utils.strip_scale_bar`). |
|
|
| ## Use in the pipeline |
| These are the pipeline defaults (`--binary-model-dir` / `--living-model-dir`), |
| or from any machine: |
| ``` |
| process_pisco_profiles.py --binary-model-hf Veit/M181_binary --living-model-hf Veit/M181_multiclass |
| process_pisco_profiles.py --dualvit-model M181 # resolves both from the Hub when not local |
| ``` |
|
|
