Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,850

Full-text search

Active filters: 4-bit

MaziyarPanahi/Phi-3-Context-Obedient-RAG-GGUF

Text Generation • Updated May 10 • 450 • 4

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • Updated 11 days ago • 49.3k • 7

Intel/Qwen2-7B-int4-inc

Text Generation • Updated 6 days ago • 7 • 2

SeacomSrl/SeaPhi3-medium

Text Generation • Updated 6 days ago • 234 • 2

LoneStriker/Higgs-Llama-3-70B-4.0bpw-h6-exl2

Text Generation • Updated 6 days ago • 4 • 2

vcadillo/glm-4v-9b-4-bits

Feature Extraction • Updated 5 days ago • 40 • 1

acorreal/phi3-mental-health

Text Generation • Updated 4 days ago • 97 • 1

Orion-zhen/Qwen2-72B-Instruct-mix-calibration-4b-exl2

Text Generation • Updated 1 day ago • 1

AlyBendo/DPO-DoubleQuant-MCQA-TrueMixin

Text2Text Generation • Updated 1 day ago • 2

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 1.82k • 547

TheBloke/vicuna-7B-v1.3-GPTQ

Text Generation • Updated Aug 21, 2023 • 132 • 17

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 926 • 130

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 24.3k • 358

TheBloke/CodeUp-Llama-2-13B-Chat-HF-GPTQ

Text Generation • Updated Sep 27, 2023 • 26 • 16

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 10.8k • 164

clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 1, 2023 • 185 • 8

baichuan-inc/Baichuan2-7B-Chat-4bits

Text Generation • Updated Dec 24, 2023 • 158 • 56

TheBloke/Pygmalion-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 43 • 42

TheBloke/Llama-2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 375 • 12

TheBloke/Llama-2-13B-chat-AWQ

Text Generation • Updated Nov 9, 2023 • 10.1k • 24

TheBloke/Llama-2-13B-German-Assistant-v4-AWQ

Text Generation • Updated Nov 9, 2023 • 7 • 2

Qwen/Qwen-14B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 7.14k • 103

HCCRen/Lamma2-gptq-4bit

Text Generation • Updated Sep 30, 2023 • 107 • 1

TheBloke/LLaMA2-13B-Tiefighter-GPTQ

Text Generation • Updated Oct 22, 2023 • 159k • 32

TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • Updated Nov 2, 2023 • 3.6k • 26

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 741k • 126

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 24.4k • 41

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 88.2k • 38

TheBloke/Mythalion-Kimiko-v2-GPTQ

Text Generation • Updated Dec 14, 2023 • 50 • 4

dvijay/mistral-alpaca2k-3e-lora

Text Generation • Updated Dec 16, 2023 • 10 • 1