Hugging Face model: yw223/Meta-Llama-3.1-8B-Instruct-AQLM-4bit
Author: yw223
Created: 2026-06-29 22:00:32
Last modified: 2026-06-29 22:02:27
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 16
Tags: transformers, pytorch, llama, text-generation, aqlm, quantization, weight-only-quantization, conversational, dataset:allenai/c4, base_model:meta-llama/Llama-3.1-8B-Instruct, base_model:quantized:meta-llama/Llama-3.1-8B-Instruct, text-generation-inference, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: meta-llama/Llama-3.1-8B-Instruct
Card metadata:
base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
library_name: transformers
pipeline_tag: text-generation
tags: aqlm, quantization, weight-only-quantization
datasets: allenai/c4