Model: QuantLLM/Llama-3.2-3B-5bit-mlx
Author: QuantLLM
Pipeline: text-generation
Library: mlx
Tags: mlx, safetensors, llama, text-generation, quantllm, mlx-lm, apple-silicon, transformers, q5_k_m, en, base_model:meta-llama/Llama-3.2-3B, base_model:quantized:meta-llama/Llama-3.2-3B, license:apache-2.0, text-generation-inference, endpoints_compatible, 8-bit, bitsandbytes, region:us
Base models (quantized): id: meta-llama/Llama-3.2-3B
Card metadata: license: apache-2.0
base_model: meta-llama/Llama-3.2-3B
library_name: mlx
language: en
tags: quantllm, mlx, mlx-lm, apple-silicon, transformers, q5_k_m
Likes: 0 | All-time downloads: 94
Created: 2025-12-20 19:41:40