Hugging Face model: QuantLLM/Llama-3.2-3B-5bit-mlx
Author: QuantLLM
Created: 2025-12-20 19:41:40
Last modified: 2025-12-20 19:42:26
Pipeline: text-generation
Library: mlx
Likes: 0 | Downloads: 9
Tags: mlx, safetensors, llama, text-generation, quantllm, mlx-lm, apple-silicon, transformers, q5_k_m, en, base_model:meta-llama/Llama-3.2-3B, base_model:quantized:meta-llama/Llama-3.2-3B, license:apache-2.0, text-generation-inference, endpoints_compatible, 8-bit, bitsandbytes, region:us
Base model relation: quantized
Base models: id: meta-llama/Llama-3.2-3B
Card metadata:
license: apache-2.0
base_model: meta-llama/Llama-3.2-3B
library_name: mlx
language: en
tags: quantllm, mlx, mlx-lm, apple-silicon, transformers, q5_k_m