Hugging Face model: HangGuo/Llama3-70B-QuaRot-OBR-RTN-W4A4KV16S50
Author: HangGuo
Created: 2025-08-28 07:56:50
Last modified: 2025-09-26 00:43:21
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 5
Tags: transformers, pytorch, llama, text-generation, quantization, sparsity, llm, qwen2, arxiv:2509.11177, license:mit, text-generation-inference, endpoints_compatible, region:us
Card metadata:
library_name: transformers
pipeline_tag: text-generation
license: mit
tags: quantization, sparsity, llm, qwen2