VPTQ Llama 3.1 70B Instruct without finetune - a VPTQ-community Collection

VPTQ-community 's Collections

VPTQ Llama 3.3 70B Instruct without finetune

VPTQ Llama 3.1 Nemotron 70B Instruct HF without finetune

VPTQ Llama 3.1 405B Instruct without finetune

VPTQ Mistral Large Instruct 2407 without finetune

VPTQ Llama 3.1 70B Instruct without finetune

VPTQ Qwen 2.5 72B Instruct without finetune

VPTQ Qwen 2.5 32B Instruct without finetune

VPTQ Qwen 2.5 14B Instruct without finetune

VPTQ Llama 3.1 8B Instruct without finetune

VPTQ Qwen 2.5 7B Instruct without finetune

Hessian and InvHessian Checkpoints

Reproduced VPTQ Tech Report Baseline

VPTQ Llama 3.1 70B Instruct without finetune

updated Oct 18

arxiv.org/abs/2409.17066, VPTQ Llama 3.1 70B without finetune