TheBloke/Falcon-180B-GGUF
Updated
•
6
•
20
Scotch & SOTA 🥃 Pt. 2: Quantized Small Boi LLM 👉👈
Run on potato, sir. GGUF & GPTQ are good friends.
Note ~~~ imagine ~~~
TheBloke/Llama-2-13B-chat-GPTQ
Text Generation • Updated • 60.4k • 352Note Probably the go-to for chat on a GPU rig
TheBloke/CodeLlama-34B-GPTQ
Text Generation • Updated • 23 • 20Note Probably the go-to for code on a GPU rig
-
TheBloke/COTHuginn-4.5-19B-GGUF
Updated • 260 • 7 -
TheBloke/Pygmalion-2-13B-GGUF
Text Generation • Updated • 2.28k • 24
TheBloke/Nous-Hermes-13B-Code-GGUF
Updated • 1.63k • 8Note nous hermes has been particularly good to me locally
TheBloke/MythoMax-L2-Kimiko-v2-13B-GPTQ
Text Generation • Updated • 386 • 24Note this one has some big fans 🪭
-
TheBloke/Airoboros-L2-70b-2.2-GGUF
Updated • 415 • 13
TheBloke/Spicyboros-70B-2.2-GGUF
Updated • 490 • 20Note toxic
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation • Updated • 2.85k • 542Note toxic
-
mistralai/Mistral-7B-v0.1
Text Generation • Updated • 1.9M • 3.15k