Flamingo for Contrastive
Overview
Working implementation of Flamingo for Contrastive using a large configuration. The repository focuses on transparent code and repeatable smoke tests; benchmark claims are deliberately omitted.
Feedback on the structure is welcome; the code is intentionally short.
Evaluation guidance
A first evaluation could use a task-specific held-out set. Report the metric across at least three seeds and include a matched-capacity baseline; keep logs and library versions with any published number.
Limitations
The checkpoint is untrained and unaudited. Treat the repository as an experimental starting point; anything learned from a future trained version must be documented separately.
Default experiment recipe
Defaults: adam optimizer, constant warmup schedule. Treat these as starting points; a real run should sweep learning rate and batch size before drawing conclusions.
Repository status
- The Python file contains the model and runnable example or training entry point.
config.jsonrecords the generated architecture settings.training_args.jsonrecords the default experiment recipe.model.safetensorsis a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint.- No benchmark score is claimed in this repository.
Changelog
- 2026-10-16 β initial upload
- 2026-10-22 β config and docs sync
Citation
If this repository is useful for your work, a link back is appreciated. No formal citation is required yet.
Files
model.pyβ primary artifactREADME.mdβ this documentationconfig.jsonβ architecture configurationtraining_args.jsonβ default experiment settingsmodel.safetensorsβ initialization checkpointUSE_POLICY.mdβ use and redistribution notesexamples/sample_usage.pyβ usage sketch
License
Distributed under the bsd-3-clause license. External datasets keep their own terms β check them separately.
- Downloads last month
- -