Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

8-bit precision

Carbon Emissions

Other with no match

4-bit precision

text-embeddings-inference

Models

2,691

Full-text search

Active filters: llama-cpp

cpellens/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 11 • 23

ShenghaiWang/Llama3

Text Generation • Updated May 15 • 71

ShenghaiWang/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated May 12 • 60

VaiTon/Minerva-3B-base-v1.0-Q8_0-GGUF

Text Generation • Updated May 12 • 17

VaiTon/Minerva-3B-base-v1.0-Q5_K_M-GGUF

Text Generation • Updated May 12 • 18

VaiTon/Minerva-1B-base-v1.0-Q8_0-GGUF

Text Generation • Updated May 12 • 15

cleatherbury/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 12 • 19

cleatherbury/Phi-3-mini-mango-1-llamafied-Q4_K_M-GGUF

Text Generation • Updated May 12 • 26

Recaru/T3Q-ko-solar-dpo-v7.0-Q4_K_S-GGUF

Updated May 12 • 21

Recaru/T3Q-ko-solar-dpo-v7.0-Q4_K_M-GGUF

Updated May 12 • 17

Recaru/T3Q-ko-solar-dpo-v7.0-Q3_K_L-GGUF

Updated May 12 • 17

Recaru/nox_DPOv3-Q4_K_M-GGUF

Updated May 12 • 17

Recaru/nox_DPOv3-Q4_K_S-GGUF

Updated May 12 • 14

Recaru/nox-solar-10.7b-v4-Q4_K_S-GGUF

Updated May 12 • 18

vinhnx90/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • Updated May 12 • 17

EZPK/Claire-Mistral-7B-0.1-Q4_K_M-GGUF

Text Generation • Updated May 12 • 22

alexcovo/dolphin-2.9.1-llama-3-8b-Q4_K_M-GGUF

Updated May 12 • 33

alexcovo/dolphin-2.9.1-llama-3-8b-Q5_K_M-GGUF

Updated May 12 • 36

NikolayKozloff/Llama-3-KafkaLM-8B-v0.1-Q8_0-GGUF

Text Generation • Updated May 12 • 57 • 1

NikolayKozloff/maestrale-chat-v0.4-alpha-sft-Q8_0-GGUF

Updated May 12 • 17 • 1

NikolayKozloff/Minerva-1B-base-v1.0-Q6_K-GGUF

Text Generation • Updated May 12 • 25 • 1

NikolayKozloff/Minerva-350M-base-v1.0-Q6_K-GGUF

Text Generation • Updated May 12 • 24 • 1

Ransss/Pantheon-RP-1.0-8b-Llama-3-Q8_0-GGUF

Updated May 12 • 44 • 1

NikolayKozloff/Bahasa-4b-Q8_0-GGUF

Updated May 12 • 30 • 1

NikolayKozloff/Bahasa-4b-chat-Q8_0-GGUF

Updated May 12 • 35 • 1

NikolayKozloff/dictalm2.0-Q8_0-GGUF

Text Generation • Updated May 12 • 20 • 1

NikolayKozloff/dictalm2.0-instruct-Q6_K-GGUF

Text Generation • Updated May 12 • 17 • 1

NikolayKozloff/Yi-1.5-6B-Q8_0-GGUF

Updated May 12 • 17 • 1

YorkieOH10/Yi-1.5-6B-Chat-Q8_0-GGUF

Updated May 12 • 18 • 1

NikolayKozloff/Yi-1.5-9B-Q8_0-GGUF

Updated May 12 • 38 • 3