Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

114

Full-text search

Active filters: autoquant

jcorenday/Daredevil-8B-4.0bpw-exl2

jcorenday/Daredevil-8B-GPTQ

Text Generation • Updated Jul 10 • 6

cowWhySo/NeuralDaredevil-7B-5.0bpw-exl2

mlabonne/NeuralDaredevil-8B-abliterated-4.5bpw-exl2

mlabonne/NeuralDaredevil-8B-abliterated-AWQ

Text Generation • Updated Jul 28 • 32

Pushpendra817/SDXL-Captioner-GGUF

Image-Text-to-Text • Updated Aug 1 • 1

iqbalamo93/Meta-Llama-3.1-8B-Instruct-GPTQ-Q_8

Text Generation • Updated Sep 14 • 831 • 3

jeremierostan/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 3 • 12

jeremierostan/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 3 • 37

jeremierostan/Meta-Llama-3.1-8B-GGUF

Text Generation • Updated Aug 3 • 31

neifuisan/gemma-2b-it-GGUF

Updated Aug 5 • 32

Corianas/mistral-7b-expert-iteration-iter3-GPTQ

Updated Aug 24 • 1

Corianas/mistral-7b-expert-iteration-iter3-GGUF

Updated Aug 19 • 11

hassu619/Llama-2-7b-chat-finetune_UNI-GGML

Question Answering • Updated Aug 20 • 4

Corianas/gpt-j-6B-Dolly-GGUF

bebechien/gemma-2-2b-GGUF

Text Generation • Updated Aug 21 • 39

bebechien/gemma-2-2b-GPTQ

Text Generation • Updated Aug 21 • 11

bebechien/gemma-2-2b-4.5bpw-exl2

Text Generation • Updated Aug 21

Mardiyyah/Llama3-OpenBioLLM-8B-GGUF

Updated Aug 22 • 40 • 1

Corianas/Llama-3-Instruct-8B-SPPO-Iter3-8-32-GPTQ

Text Generation • Updated Aug 25 • 7

Corianas/Mistral7B-PairRM-SPPO-Iter3-4-32-GPTQ

Text Generation • Updated Aug 25 • 7

Corianas/Mistral7B-PairRM-SPPO-Iter3-4-64-GPTQ

Text Generation • Updated Aug 25 • 10

Corianas/Mistral7B-PairRM-SPPO-Iter3-4-128-GPTQ

Text Generation • Updated Aug 25 • 5

Corianas/Mistral7B-PairRM-SPPO-Iter3-8-32-GPTQ

Text Generation • Updated Aug 25 • 5

Corianas/Mistral7B-PairRM-SPPO-Iter3-8bit-64GSize-GPTQ

Text Generation • Updated Aug 25 • 6

Corianas/Mistral7B-PairRM-SPPO-Iter3-8-128-GPTQ

Text Generation • Updated Aug 25 • 8

Corianas/Llama-3-Instruct-8B-SPPO-Iter3-4-32-GPTQ

Text Generation • Updated Aug 25 • 8

Corianas/Llama-3-Instruct-8B-SPPO-Iter3-4-64-GPTQ

Text Generation • Updated Aug 25 • 7

speakleash/Bielik-11B-v2.2-Instruct-onnx-fp16

Text Generation • Updated Oct 7 • 37 • 1

pansophic/pansophic-1-preview-LLaMA3.1-8b-GPTQ

Text Generation • Updated Sep 5 • 14 • 1