Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

8-bit precision

Other with no match

4-bit precision

text-embeddings-inference

Models

3,065

Full-text search

Active filters: llama-cpp

leafspark/Yi-1.5-9B-Chat-16K-Q4_K_S-GGUF

Updated May 20 • 15

misieur/Mixtral-8x7B-Instruct-v0.1-Q4_K_M-GGUF

Updated May 20 • 16

leafspark/Yi-1.5-34B-Chat-16K-Q4_K_S-GGUF

Updated May 20 • 15

kpkiosk66/L3-8B-Stheno-v3.1-Q8_0-GGUF

Updated May 20 • 31 • 4

jamesburton/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • Updated May 20 • 13

jamesburton/Phi-3-mini-128k-instruct-Q6_K-GGUF

Text Generation • Updated May 20 • 15

e2jhiubyiiyvw/Yi-1.5-9B-Chat-16K-Q5_K_M-GGUF

Updated May 20 • 15

north/mistral-7B-Base_v01-PlayWW-Q4_K_M-GGUF

Updated May 20 • 12

north/mistral-7B-Scand-PlayWW-Q4_K_M-GGUF

Updated May 20 • 12

north/mistral-7B-Instruct_v02-PlayWW-Q4_K_M-GGUF

Updated May 20 • 13

north/llama3-8B-Base_v02-PlayWW-Q4_K_M-GGUF

Updated May 20 • 22

3dsabh/Mistral-7B-v0.1-Q2_K-GGUF

Text Generation • Updated May 20 • 17

3dsabh/Mistral-7B-v0.1-Q4_K_M-GGUF

Text Generation • Updated May 20 • 14

misieur/Mixtral-8x7B-Instruct-v0.1-Q2_K-GGUF

Updated May 20 • 14

pere/mistral-7b-reference-instruction2-Q4_K_M-GGUF

Updated May 20 • 12

jrc/phi3-mini-math-Q4_K_M-GGUF

Text Generation • Updated May 20 • 6

pere/mistral-7b-reference100k-Q4_K_M-GGUF

Updated May 20 • 14

tezcan/Orbita-v0.1-Q4_K_M-GGUF

Updated May 20 • 22

Ransss/Ninja-v1-RP-Q8_0-GGUF

Updated May 20 • 13

leafspark/Yi-1.5-9B-Chat-16K-Q5_K_S-GGUF

Updated May 20 • 14

NikolayKozloff/Falcon2-5.5B-Swedish-Q8_0-GGUF

Updated May 20 • 24 • 1

NikolayKozloff/Falcon2-5.5B-Italian-Q8_0-GGUF

Updated May 20 • 25 • 1

NikolayKozloff/Alphacode-MALI-11B-Q8_0-GGUF

Text Generation • Updated May 20 • 21 • 1

NikolayKozloff/Alphacode-MALI-9B-Q8_0-GGUF

Text Generation • Updated May 20 • 16 • 1

pere/mistral-7b-reference100k-Q8_0-GGUF

Updated May 20 • 16

NikolayKozloff/shisa-v1-llama3-8b-Q8_0-GGUF

Updated May 20 • 32 • 1

NikolayKozloff/llama-3-typhoon-v1.5-8b-instruct-Q6_K-GGUF

Text Generation • Updated May 20 • 22 • 1

tezcan/Kocdigital-LLM-8b-v0.1-Q4_K_M-GGUF

Updated May 20 • 22

bunnycore/Blackbird-Llama-3-8B-Q5_K_M-GGUF

Updated May 20 • 21

ssmits/Falcon2-5.5B-French-GGUF

Updated May 20 • 40