Hugging Face model: user12043/Llama-3-8B-Instruct-GPTQ-8-Bit-IQ4_NL-GGUF
Author: user12043
Created: 2026-03-08 06:40:01
Last modified: 2026-03-08 06:40:28
Pipeline: text-generation
Likes: 0 | Downloads: 13
Tags: gguf, llama, llama-3, facebook, meta, astronomer, gptq, pretrained, quantized, finetuned, autotrain_compatible, endpoints_compatible, llama-cpp, gguf-my-repo, text-generation, dataset:wikitext, base_model:astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit, base_model:quantized:astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit, license:other, region:us, imatrix, conversational
Base model relation: quantized
Base models: id: astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit
Card metadata:
base_model: astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit
inference: no
model_creator: astronomer-io
model_name: Meta-Llama-3-8B-Instruct
model_type: llama
pipeline_tag: text-generation
prompt_template: {% set loop_messages = messages %}{% for message in loop_messages %}{% set content = '
' + message['role'] + '


'+ message['content'] | trim + '
' %}{% if loop.index0 == 0 %}{% set content = bos_token + content %}{% endif %}{{ content }}{% endfor %}{% if add_generation_prompt %}{{ '
assistant


' }}{% endif %}
quantized_by: davidxmle
license: other
license_name: llama-3-community-license
license_link: https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/blob/main/LICENSE
tags: llama, llama-3, facebook, meta, astronomer, gptq, pretrained, quantized, finetuned, autotrain_compatible, endpoints_compatible, llama-cpp, gguf-my-repo
datasets: wikitext