Hugging Face model: fbaldassarri/EleutherAI_pythia-6.9b-auto_awq-int4-gs64-sym
Author: fbaldassarri
Created: 2026-08-11 22:00:31
Last modified: 2026-08-11 22:10:41
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, safetensors, gpt_neox, text-generation, awq, auto-awq, autoawq, pytorch, causal-lm, autoround, auto-round, intel-autoround, intel, woq, weights-only-quantization, pythia, eleutheraI, 4-bit, en, dataset:EleutherAI/pile, base_model:EleutherAI/pythia-6.9b, base_model:quantized:EleutherAI/pythia-6.9b, license:apache-2.0, text-generation-inference, region:us
Base model relation: quantized
Base models: id: EleutherAI/pythia-6.9b
Card metadata:
language: en
tags: awq, auto-awq, autoawq, pytorch, causal-lm, autoround, auto-round, intel-autoround, intel, woq, weights-only-quantization, pythia, eleutheraI, 4-bit
license: apache-2.0
license_link: https://choosealicense.com/licenses/apache-2.0/
library_name: transformers
model_name: Pythia 6.9b
base_model: EleutherAI/pythia-6.9b
base_model_relation: quantized
model_type: gpt_neox
inference: no
model_creator: fbaldassarri
datasets: EleutherAI/pile
pipeline_tag: text-generation
prompt_template: {prompt} 
quantized_by: fbaldassarri
quantization_config: method: auto_awq
bits: 4
group_size: 64
sym: yes
auto_round_version: 0.13.1
torch_dtype: torch.bfloat16
device: cpu
nsamples: 128
iters: 200
seqlen: 512
batch_size: 4