Flamingo for Contrastive

Overview

Working implementation of Flamingo for Contrastive using a large configuration. The repository focuses on transparent code and repeatable smoke tests; benchmark claims are deliberately omitted.

Feedback on the structure is welcome; the code is intentionally short.

Evaluation guidance

A first evaluation could use a task-specific held-out set. Report the metric across at least three seeds and include a matched-capacity baseline; keep logs and library versions with any published number.

Limitations

The checkpoint is untrained and unaudited. Treat the repository as an experimental starting point; anything learned from a future trained version must be documented separately.

Default experiment recipe

Defaults: adam optimizer, constant warmup schedule. Treat these as starting points; a real run should sweep learning rate and batch size before drawing conclusions.

Repository status

  • The Python file contains the model and runnable example or training entry point.
  • config.json records the generated architecture settings.
  • training_args.json records the default experiment recipe.
  • model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint.
  • No benchmark score is claimed in this repository.

Changelog

  • 2026-10-16 β€” initial upload
  • 2026-10-22 β€” config and docs sync

Citation

If this repository is useful for your work, a link back is appreciated. No formal citation is required yet.

Files

  • model.py β€” primary artifact
  • README.md β€” this documentation
  • config.json β€” architecture configuration
  • training_args.json β€” default experiment settings
  • model.safetensors β€” initialization checkpoint
  • USE_POLICY.md β€” use and redistribution notes
  • examples/sample_usage.py β€” usage sketch

License

Distributed under the bsd-3-clause license. External datasets keep their own terms β€” check them separately.

Downloads last month
-
Safetensors
Model size
16.6k params
Tensor type
F32
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support