LimitedMouse/Generative-Embedding-Benchmark-Checkpoints

GEB Decoder Checkpoints

This repository provides the official Qwen decoder checkpoints for the Generative Embedding Benchmark. The GitHub repository is the main entry point for installation, training, and evaluation. Fixed evaluation membership and provenance metadata are hosted in the GEB dataset repository.

Embedder	Mode	Subfolder
Qwen3-VL-Embedding-2B	Visual-only	qwen3vl-2b/visual_only
Qwen3-VL-Embedding-2B	VL-joint	qwen3vl-2b/vl_joint
Qwen3-VL-Embedding-8B	Visual-only	qwen3vl-8b/visual_only
Qwen3-VL-Embedding-8B	VL-joint	qwen3vl-8b/vl_joint

Each checkpoint contains the trained Qwen3-0.6B readout and its embedding adapter. The embedding model itself is not bundled; use the matching embedder and evaluation mode shown above.

git clone https://github.com/LimitedMouse/Generative-Embedding-Benchmark.git
cd Generative-Embedding-Benchmark
pip install -e '.[eval]'

NPROC=8 BATCH_SIZE=16 bash scripts/evaluate_paper.sh \
  qwen3vl-2b auto test visual_only

The checkpoints are intended for reproducing the GEB paper results. The Qwen models and upstream evaluation datasets remain subject to their own licenses.