Hugging Face model: solidrust/FrankenLlama-3-12B-AWQ
Author: solidrust
Created: 2024-04-18 20:21:11
Last modified: 2024-09-03 08:43:15
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 23
Tags: transformers, safetensors, llama, text-generation, 4-bit, AWQ, autotrain_compatible, endpoints_compatible, merge, mergekit, lazymergekit, conversational, base_model:mlabonne/Llama-3-12B, base_model:quantized:mlabonne/Llama-3-12B, license:other, text-generation-inference, awq, region:us
Base model relation: quantized
Base models: id: mlabonne/Llama-3-12B
Card metadata:
base_model: mlabonne/FrankenLlama-3-12B
inference: no
library_name: transformers
license: other
merged_models: meta-llama/Meta-Llama-3-8B, meta-llama/Meta-Llama-3-8B
pipeline_tag: text-generation
quantized_by: Suparious
tags: 4-bit, AWQ, text-generation, autotrain_compatible, endpoints_compatible, merge, mergekit, lazymergekit