Instructions to use nvidia/Cosmos3-Edge with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Cosmos
How to use nvidia/Cosmos3-Edge with Cosmos:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Usage: switch reasnor examples to vLLM
#48
by xuanli1 - opened
Replace the native cosmos-framework Reasoner example with the release-tested vLLM serving flow.
Changes:
- Add vLLM container and single-GPU serving instructions.
- Replace the offline Reasoner CLI with an OpenAI-compatible image reasoning example.
- Keep the displayed result on default inference; thinking is enabled by default.
- Document the supported OpenAI client
extra_bodysetting for a no-think response. - Send the local example image as a data URL so the client works with a containerized server.
Compatibility:
- README-only change confined to the Reasoning region.
- Verified to merge cleanly alongside discussion #46, which updates only the Generation region.
- Python example syntax and
git diff --checkpass. - The default example was executed successfully against the latest
vllm/vllm-openai:cosmos3image and latest model weights.