Hugging Face model: fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int8-gs128-asym
Author: fbaldassarri
Created: 2025-04-06 20:58:35
Last modified: 2025-04-06 21:13:54
Pipeline: text-generation
Likes: 0 | Downloads: 10
Tags: safetensors, llama, pytorch, causal-lm, OpenLLaMA, autoround, auto-round, intel-autoround, gptq, woq, intel, openlm-research, text-generation, dataset:tiiuae/falcon-refinedweb, dataset:bigcode/starcoderdata, dataset:togethercomputer/RedPajama-Data-1T, base_model:openlm-research/open_llama_3b_v2, base_model:quantized:openlm-research/open_llama_3b_v2, license:apache-2.0, 8-bit, intel/auto-round, region:us
Base model relation: quantized
Base models: id: openlm-research/open_llama_3b_v2
Card metadata:
tags: pytorch, causal-lm, OpenLLaMA, autoround, auto-round, intel-autoround, gptq, woq, intel, pytorch, openlm-research
license: apache-2.0
datasets: tiiuae/falcon-refinedweb, bigcode/starcoderdata, togethercomputer/RedPajama-Data-1T
model_name: OpenLLaMA 3B v2
base_model: openlm-research/open_llama_3b_v2
inference: no
model_creator: openlm-research
pipeline_tag: text-generation
prompt_template: {prompt} 
quantized_by: fbaldassarri