Hugging Face model: astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit
Author: astronomer
Created: 2024-04-19 15:55:54
Last modified: 2024-04-22 01:34:29
Pipeline: text-generation
Library: transformers
Likes: 26 | Downloads: 21
Tags: transformers, safetensors, llama, text-generation, llama-3, facebook, meta, astronomer, gptq, pretrained, quantized, finetuned, autotrain_compatible, endpoints_compatible, conversational, dataset:wikitext, arxiv:2210.17323, base_model:meta-llama/Meta-Llama-3-8B-Instruct, base_model:quantized:meta-llama/Meta-Llama-3-8B-Instruct, license:other, text-generation-inference, 4-bit, region:us
Base model relation: quantized
Base models: id: meta-llama/Meta-Llama-3-8B-Instruct
Card metadata:
base_model: meta-llama/Meta-Llama-3-8B-Instruct
inference: no
model_creator: astronomer-io
model_name: Meta-Llama-3-8B-Instruct
model_type: llama
pipeline_tag: text-generation
prompt_template: {% set loop_messages = messages %}{% for message in loop_messages %}{% set content = '
' + message['role'] + '


'+ message['content'] | trim + '
' %}{% if loop.index0 == 0 %}{% set content = bos_token + content %}{% endif %}{{ content }}{% endfor %}{% if add_generation_prompt %}{{ '
assistant


' }}{% endif %}
quantized_by: davidxmle
license: other
license_name: llama-3-community-license
license_link: https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/blob/main/LICENSE
tags: llama, llama-3, facebook, meta, astronomer, gptq, pretrained, quantized, finetuned, autotrain_compatible, endpoints_compatible
datasets: wikitext