Hugging Face model: fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int8-gs128-asym
Author: fbaldassarri
Created: 2025-04-06 21:31:14
Last modified: 2025-04-06 21:46:57
Pipeline: text-generation
Likes: 0 | Downloads: 9
Tags: safetensors, llama, pytorch, causal-lm, OpenLLaMA, autoround, auto-round, intel-autoround, gptq, auto-gptq, autogptq, woq, intel, openlm-research, text-generation, dataset:tiiuae/falcon-refinedweb, dataset:bigcode/starcoderdata, dataset:togethercomputer/RedPajama-Data-1T, base_model:openlm-research/open_llama_3b_v2, base_model:quantized:openlm-research/open_llama_3b_v2, license:apache-2.0, 8-bit, region:us
Base model relation: quantized
Base models: id: openlm-research/open_llama_3b_v2
Card metadata:
tags: pytorch, causal-lm, OpenLLaMA, autoround, auto-round, intel-autoround, gptq, auto-gptq, autogptq, woq, intel, pytorch, openlm-research
license: apache-2.0
datasets: tiiuae/falcon-refinedweb, bigcode/starcoderdata, togethercomputer/RedPajama-Data-1T
model_name: OpenLLaMA 3B v2
base_model: openlm-research/open_llama_3b_v2
inference: no
model_creator: openlm-research
pipeline_tag: text-generation
prompt_template: {prompt} 
quantized_by: fbaldassarri