Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

1,641

Full-text search

Active filters: chat

internlm/internlm2_5-20b-chat-gguf

Text Generation • Updated Jul 29 • 10.1k • 31

anthracite-org/magnum-v2-12b

Text Generation • Updated 17 days ago • 1.44k • 71

NousResearch/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 23 • 3.36k • 31

anthracite-org/magnum-v2-12b-gguf

Text Generation • Updated Aug 22 • 17.3k • 33

ValiantLabs/Llama3.1-8B-ShiningValiant2

Text Generation • Updated 1 day ago • 2.31k • 14

Qwen/Qwen2-Math-72B-Instruct

Text Generation • Updated 19 days ago • 3.59k • 83

anthracite-org/magnum-v2.5-12b-kto-exl2

Text Generation • Updated Aug 15 • 84 • 9

bartowski/calme-2.3-rys-78b-GGUF

Text Generation • Updated Aug 13 • 263 • 2

mradermacher/calme-2.4-rys-78b-GGUF

Updated 15 days ago • 855 • 5

abacusai/Dracarys-72B-Instruct

Text Generation • Updated 5 days ago • 67 • 15

anthracite-org/magnum-v2.5-12b-kto-gguf

Text Generation • Updated Aug 22 • 3.48k • 29

bartowski/Hermes-3-Llama-3.1-8B-GGUF

Text Generation • Updated Aug 16 • 1.57k • 3

bartowski/Hermes-3-Llama-3.1-70B-GGUF

Text Generation • Updated Aug 20 • 1.39k • 5

mradermacher/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 16 • 398 • 2

mradermacher/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 16 • 115 • 1

mlx-community/Hermes-3-Llama-3.1-70B-4bit

Updated Aug 16 • 36 • 1

ghost-x/ghost-8b-beta-1608

Text Generation • Updated Aug 23 • 4.47k • 28

mradermacher/magnum-v2-123b-GGUF

Updated 23 days ago • 52 • 5

byroneverson/glm-4-9b-chat-abliterated

Text Generation • Updated about 1 month ago • 80 • 13

byroneverson/glm-4-9b-chat-abliterated-gguf

Text Generation • Updated about 1 month ago • 2.13k • 6

genevera/glm-4-9b-chat-abliterated-Q6_K-GGUF

Text Generation • Updated Aug 26 • 23 • 1

bartowski/glm-4-9b-chat-abliterated-GGUF

Text Generation • Updated Aug 30 • 465 • 3

QuantFactory/glm-4-9b-chat-abliterated-GGUF

Text Generation • Updated Aug 31 • 608 • 4

byroneverson/internlm2_5-20b-chat-abliterated

Text Generation • Updated 29 days ago • 47 • 2

byroneverson/Yi-1.5-9B-Chat-16K-abliterated

Text Generation • Updated 25 days ago • 865 • 2

byroneverson/Yi-1.5-9B-Chat-16K-abliterated-gguf

Text Generation • Updated 29 days ago • 59 • 1

byroneverson/internlm2_5-20b-chat-abliterated-gguf

Text Generation • Updated 29 days ago • 161 • 1

byroneverson/Yi-1.5-9B-Chat-abliterated

Text Generation • Updated 27 days ago • 844 • 2

byroneverson/Yi-1.5-9B-Chat-abliterated-gguf

Text Generation • Updated 27 days ago • 34 • 1

byroneverson/Yi-1.5-34B-Chat-abliterated

Text Generation • Updated 18 days ago • 48 • 2