git clone failing to clone the saftensor files 72B model
Git clone cloning only the pointers and not the actual safetensor files inspite of git lfs being installed
git clone https://huggingface.co/Qwen/Qwen2-VL-72B-Instruct
Cloning into 'Qwen2-VL-72B-Instruct'...
remote: Enumerating objects: 66, done.
remote: Counting objects: 100% (63/63), done.
remote: Compressing objects: 100% (63/63), done.
remote: Total 66 (delta 7), reused 0 (delta 0), pack-reused 3 (from 1)
Unpacking objects: 100% (66/66), 3.62 MiB | 5.61 MiB/s, done.
Total clone repo size ~17M and gets downloaded in less than a minute, any thoughts on why this is happening?
Same happening here
Same happening here
How to use the multi-card method to infer the qwen2VL-72b model through the vllm framework
This worked for me:
git clone https://huggingface.co/Qwen/Qwen2-VL-72B-Instruct
cd Qwen2-VL-72B-Instruct
git lfs track "*.safetensors"
git lfs pull