Quantizations (4-bit) - a parasail-ai Collection

parasail-ai 's Collections

TinyLlama3-1.58B

MicroLlama3-464M

NanoLlama3-157M

Quantizations (4-bit)

Quantizations (4-bit)

updated Jul 15

parasail-ai/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jul 13 • 66 • 1
parasail-ai/aya-23-8B-GPTQ-4bit

Text Generation • Updated Jul 15 • 8 • 2