Hugging Face model: HangGuo/Llama3-70B-QuaRot-OBR-GPTQ-W4A4KV16S50
Author: HangGuo
Created: 2025-08-28 08:37:25
Last modified: 2025-09-26 00:45:20
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 8
Tags: transformers, pytorch, llama, text-generation, quantization, sparsity, llm, qwen2, arxiv:2509.11177, license:mit, text-generation-inference, endpoints_compatible, region:us
Card metadata:
library_name: transformers
pipeline_tag: text-generation
license: mit
tags: quantization, sparsity, llm, qwen2