Instructions to use rty813/clef-bf16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use rty813/clef-bf16 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="rty813/clef-bf16")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("rty813/clef-bf16") model = AutoModelForMultimodalLM.from_pretrained("rty813/clef-bf16", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use rty813/clef-bf16 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "rty813/clef-bf16" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "rty813/clef-bf16", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/rty813/clef-bf16
- SGLang
How to use rty813/clef-bf16 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "rty813/clef-bf16" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "rty813/clef-bf16", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "rty813/clef-bf16" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "rty813/clef-bf16", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use rty813/clef-bf16 with Docker Model Runner:
docker model run hf.co/rty813/clef-bf16
clef-bf16 (bf16)
Full-precision (bf16) PyTorch port of Cloudflare/clef, for vLLM / TGI / Xinference / transformers users who don't want the GGUF quant.
- Format:
pytorch_model.bin(bf16). safetensors conversion in progress. - Architecture: identical to the original — drop-in for
AutoModelForCausalLM.from_pretrained("rty813/clef-bf16"). - Also loads in vLLM (
vllm serve rty813/clef-bf16) and Xinference (search "clef").
Original model card:
license: apache-2.0 library_name: transformers pipeline_tag: image-text-to-text base_model: Qwen/Qwen3.8-27B base_model_relation: finetune tags: - clef - cloudflare - systemone - decision-model - qwen3.8 - post-train - image-text-to-typed-output - multimodal - structured-output - classification - custom-code
Clef
- Announcement: Clef decision models on the Cloudflare blog
- Decision Index leaderboard: clef-evals.workers-ai-mle.workers.dev
Clef is a 27B multimodal model that turns a state and a schema of typed questions into decisions. It reads the state as text, JSON, images, or video, and returns a probability for every allowed option of every question in a single forward pass. There is no free-form text generation and no output parsing.
The Clef API is fully compatible with Jev and SystemOne.
Clef is post-trained from Qwen/Qwen3.8-27B. See Clef-Flash for the smaller, faster variant.
Model
- Backbone: Qwen/Qwen3.8-27B with its vision encoder, stored as standard sharded safetensors.
- Joint schema head: a small transformer head that reads the backbone's final hidden states, routes evidence from the state to each question, and scores all options of all questions jointly.
- Output: one logit per allowed option for each question. Apply a softmax per
- Downloads last month
- 51