Hugging Face model: ChenMnZ/Llama-3-70b-EfficientQAT-w4g128-BitBLAS
Author: ChenMnZ
Created: 2024-07-22 07:41:24
Last modified: 2024-07-22 12:32:43
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 5
Tags: transformers, safetensors, llama, text-generation, arxiv:2407.11062, text-generation-inference, endpoints_compatible, 4-bit, gptq, region:us
Card metadata: