Hugging Face model: solidrust/LLama-3.1-8B-Matrix-AWQ
Author: solidrust
Created: 2024-09-19 08:07:57
Last modified: 2024-09-19 08:30:38
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 5
Tags: transformers, safetensors, llama, text-generation, 4-bit, AWQ, autotrain_compatible, endpoints_compatible, base_model:bunnycore/LLama-3.1-8B-Matrix, base_model:quantized:bunnycore/LLama-3.1-8B-Matrix, text-generation-inference, awq, region:us
Base model relation: quantized
Base models: id: bunnycore/LLama-3.1-8B-Matrix
Card metadata:
base_model: bunnycore/LLama-3.1-8B-Matrix
library_name: transformers
tags: 4-bit, AWQ, text-generation, autotrain_compatible, endpoints_compatible
pipeline_tag: text-generation
inference: no
quantized_by: Suparious