Hugging Face model: Esperanto/llama3.1-8b-Instruct-kvc-AWQ-int4-onnx
Author: Esperanto
Created: 2024-10-24 13:52:52
Last modified: 2024-12-12 10:03:00
Pipeline: text-generation
Likes: 0 | Downloads: 12
Tags: onnx, text-generation-inference, llama, llama3, 4-bit precision, AWQ, text-generation, base_model:meta-llama/Llama-3.1-8B-Instruct, base_model:quantized:meta-llama/Llama-3.1-8B-Instruct, region:us
Base model relation: quantized
Base models: id: meta-llama/Llama-3.1-8B-Instruct
Card metadata:
tags: text-generation-inference, llama, llama3, 4-bit precision, AWQ
pipeline_tag: text-generation
base_model: meta-llama/Llama-3.1-8B-Instruct