Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,505

Full-text search

Active filters: 4-bit

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated 24 days ago • 70.8k • 50

MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4-GGUF

Text Generation • Updated 11 days ago • 2.06k • 8

MaziyarPanahi/Llama-3-8B-Instruct-v0.8-GGUF

Text Generation • Updated 1 day ago • 1.18k • 2

cstr/Spaetzle-v60-7b-int4-inc

Text Generation • Updated 3 days ago • 22 • 2

TheBloke/guanaco-65B-GPTQ

Text Generation • Updated Sep 27, 2023 • 1.45k • 265

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • Updated Aug 21, 2023 • 230 • 64

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 119k • 249

TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 16.7k • 257

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 21.4k • 161

TheBloke/Chinese-Alpaca-2-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 131 • 3

TheBloke/CodeLlama-13B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 266 • 8

TheBloke/CodeLlama-7B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 200 • 4

TheBloke/Nous-Hermes-Llama-2-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 65 • 2

TheBloke/Wizard-Vicuna-13B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 25 • 12

TheBloke/storytime-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 154 • 17

TheBloke/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • Updated Sep 29, 2023 • 367k • 73

Vulkane/120-Days-of-Sodom-LoRA-Mistral-7b

Text Generation • Updated Sep 30, 2023 • 9 • 8

TheBloke/CausalLM-14B-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 10

TheBloke/CausalLM-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 10 • 3

TheBloke/zephyr-7B-beta-GPTQ

Text Generation • Updated Oct 27, 2023 • 5.9k • 55

TheBloke/Echidna-13B-v0.3-GPTQ

Text Generation • Updated Oct 28, 2023 • 4 • 8

TheBloke/Mistral-ClaudeLimaRP-v3-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 4 • 4

TheBloke/Uncensored-Jordan-13B-GPTQ

Text Generation • Updated Oct 30, 2023 • 2 • 8

TheBloke/Xwin-MLewd-7B-V0.2-GPTQ

Text Generation • Updated Oct 31, 2023 • 2.5k • 19

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 8k • 32

TheBloke/deepseek-coder-1.3b-instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 27 • 2

TheBloke/deepseek-coder-6.7B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 1.12k • 14

TheBloke/deepseek-coder-1.3b-instruct-GPTQ

Text Generation • Updated Nov 5, 2023 • 286 • 5

TheBloke/dolphin-2_2-yi-34b-AWQ

Text Generation • Updated Nov 13, 2023 • 4 • 12

TheBloke/Euryale-1.4-L2-70B-GPTQ

Text Generation • Updated Nov 18, 2023 • 8 • 2