colqwen2-endpoint — Hugging Face custom Inference Endpoint repo

Minimal repo for deploying ColQwen2.5 multi-vector embeddings on HF Inference Endpoints.

Contents

File	Purpose
handler.py	Custom EndpointHandler — wraps ColQwen2_5 from colpali-engine.
requirements.txt	Python deps.Must satisfy colpali-engine's transformers range.

After changing requirements.txt

git add requirements.txt
git commit -m "Fix transformers pin for colpali-engine compatibility"
git push

Then in the HF dashboard: Endpoint → Retry (or redeploy).

Troubleshooting

• ImportError: cannot import name 'ColQwen2_5' from 'colpali_engine.models': you're on a colpali-engine older than 0.3.9. Use colpali-engine==0.3.10 as in this repo's requirements.txt (and see the table at the top of that file for why 0.3.10 specifically).

• ResolutionImpossible during install: the endpoint's preinstalled huggingface-inference-toolkit hard-pins transformers==4.51.3. Don't downgrade transformers below that, and don't re-pin peft / accelerate / torch here — the base image already ships compatible versions.

• No module named 'colpali_engine': dependency install failed silently or was skipped due to resolver failure. Fix requirements.txt and redeploy.