Hugging Face model: ChenMnZ/Llama-2-70b-EfficientQAT-w2g128-BitBLAS
Author: ChenMnZ
Created: 2024-07-22 03:01:31
Last modified: 2024-07-22 03:42:13
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 7
Tags: transformers, safetensors, llama, text-generation, arxiv:2407.11062, text-generation-inference, endpoints_compatible, 2-bit, gptq, region:us
Card metadata: