Hugging Face model: ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8
Author: ISTA-DASLab
Created: 2024-11-08 13:47:44
Last modified: 2024-11-08 13:53:36
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 5
Tags: transformers, safetensors, llama, text-generation, aqlm, facebook, meta, llama-3, conversational, text-generation-inference, arxiv:2401.06118, arxiv:2405.14852, base_model:meta-llama/Llama-3.2-3B, base_model:quantized:meta-llama/Llama-3.2-3B, endpoints_compatible, 8-bit, region:us
Base model relation: quantized
Base models: id: meta-llama/Llama-3.2-3B
Card metadata:
library_name: transformers
tags: aqlm, llama, facebook, meta, llama-3, conversational, text-generation-inference
base_model: meta-llama/Llama-3.2-3B