Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

6,843

Full-text search

Active filters: 8-bit

Zoyd/maldv_badger-zeta-l3-4x8b-8_0bpw_exl2

Text Generation • Updated Jun 7 • 7

danielm2402/gemma_sci

Updated Jun 7 • 9

FuturisticVibes/WizardLM-2-8x22B-8.0bpw-h8-exl2

Text Generation • Updated Jun 9 • 13

cc8055/tinyllama56k-GPTQ

Text Generation • Updated Jun 7 • 4

gbueno86/Qwen2-72B-Instruct-exl2-8.0bpw

Text Generation • Updated Jun 7 • 7 • 1

kaitchup/Qwen2-0.5B-gptq-8bit

Text Generation • Updated Jun 11

kaitchup/Qwen2-0.5B-Instruct-gptq-8bit

Text Generation • Updated Jun 11

kaitchup/Qwen2-1.5B-gptq-8bit

Text Generation • Updated Jun 11

kaitchup/Qwen2-1.5B-Instruct-gptq-8bit

Text Generation • Updated Jun 11

kaitchup/Qwen2-7B-gptq-8bit

Text Generation • Updated Jun 11

nm-testing/tinyllama-oneshot-w8a8-static-v2

Text Generation • Updated Oct 9 • 8

nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v2

Text Generation • Updated Oct 9 • 6.94k

nm-testing/tinyllama-oneshot-w8a8-static-v3

Text Generation • Updated Jun 17 • 467

nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v3

Text Generation • Updated Jun 17 • 7

StefanKrsteski/Phi-3-mini-4k-instruct-GPTQ-8bit

Text Generation • Updated Jun 8 • 4

kaitchup/Qwen2-7B-Instruct-gptq-8bit

Text Generation • Updated Jun 11

kishorea/test_model2

Text Generation • Updated Jun 8 • 6

LoneStriker/IceCaffeLatteRP-7b-8.0bpw-h8-exl2

Text Generation • Updated Jun 8 • 6

kim512/TooManyMixRolePlay-7B-Story_V3.5-8.0bpw-h8-exl2

Text Generation • Updated Jun 8 • 4

amirMohammadi/Dorna-Llama3-8B-Instruct-Quantized4Bit

Text Generation • Updated Jun 17 • 72 • 10

JayhC/L3-Aethora-15B-8bpw-h8-exl2

Text Generation • Updated Jun 8 • 7

StefanKrsteski/Phi-3-mini-4k-instruct-DPO-EPFL-GPTQ-8bit

Text Generation • Updated Jun 9 • 4

adaniel105/whisper-large-v3-merge-LoRA

Automatic Speech Recognition • Updated Jun 14 • 1

atcsecure/dolphin-2.9.2-qwen72b-8.0bpw-h8-exl2

Text Generation • Updated Jun 9 • 9 • 2

Johnnylai92/dgtkqabot-mistral-7b-v3

Text Generation • Updated Jun 17 • 589

kim512/sunfall-midnight-miqu-v0.2-v1.5-70B-8.0bpw-h8-exl2

Text Generation • Updated Jun 10 • 2

fatyanosa/Komodo-7B-squadpairs-indo

Text Generation • Updated Jun 10 • 15

Rohithqwerty/model

Updated Jun 12 • 19

JeanM45/0f554762-8b

Text Generation • Updated Jun 10 • 7

StefanKrsteski/Phi-3-mini-4k-instruct-sft-8bit

Text Generation • Updated Jun 11 • 5