Favorite Low-End Models - a Crataco Collection

Crataco 's Collections

Favorite Low-End Models

Favorite Old Models

Favorite Low-End Models

updated 5 days ago

These quantized models have a smaller memory footprint, but acceptable quality.

Crataco/TinyDolphin-2.8-1.1b-imatrix-GGUF

Updated Mar 6 • 1.18k • 5

Note Runs on my Pi 4 (2 GB RAM) and phone (3 GB RAM). Works for basic conversation, but otherwise it's a toy.
bartowski/Phi-3-mini-4k-instruct-GGUF

Text Generation • Updated 18 days ago • 9.93k • 4
bartowski/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated 18 days ago • 40.5k • 49

Note Primary model of choice. Great for a small model and follows prompts well. Can run on PCs with 8 GB RAM.