Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Other with no match

4-bit precision

text-embeddings-inference

8-bit precision

Models

3,148

Full-text search

Active filters: gguf-my-repo

pere/llama3-8B-base-instruction2-Q8_0-GGUF

Updated May 21 • 25

NikolayKozloff/phi3-128k-6b-Q8_0-GGUF

Updated May 21 • 20 • 2

powermove72/longchat-7b-v1.5-32k-Q4_K_M-GGUF

Updated May 21 • 17

nitus-ac/nMer1-Q8_0-GGUF

Updated May 21 • 23

ssmits/Falcon2-5.5B-Spanish-GGUF

Updated May 21 • 21

ssmits/Falcon2-5.5B-multilingual-GGUF

Updated May 21 • 31

ssmits/Phi-3-medium-4k-instruct-Q5_K_M-GGUF

Text Generation • Updated May 21 • 20

ssmits/Phi-3-medium-4k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 21 • 22 • 1

ssmits/Phi-3-medium-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 21 • 15 • 1

ssmits/Phi-3-medium-128k-instruct-Q5_K_M-GGUF

Text Generation • Updated May 21 • 23 • 2

ssmits/Phi-3-medium-128k-instruct-Q6_K-GGUF

Text Generation • Updated May 21 • 10 • 1

ssmits/Phi-3-medium-4k-instruct-Q8_0-GGUF

Text Generation • Updated May 21 • 67 • 1

Banished-Privateer/Phi-3-medium-128k-instruct-Q8_0-GGUF

Text Generation • Updated May 21 • 19

ssmits/Phi-3-medium-4k-instruct-Q3_K_M-GGUF

Text Generation • Updated May 21 • 19

ssmits/Phi-3-medium-128k-instruct-Q2_K-GGUF

Text Generation • Updated May 21 • 16

Ransss/Noromaid-13B-0.4-DPO-Q8_0-GGUF

Updated May 21 • 78 • 1

hiddenblue1/granite-34b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 21 • 16

NikolayKozloff/Phi-3-medium-4k-instruct-Q6_K-GGUF

Text Generation • Updated May 21 • 20 • 1

hrus/Mixtral-8x7B-Instruct-v0.1-Q5_K_M-GGUF

Updated May 21 • 26

NikolayKozloff/Phi-3-medium-4k-instruct-Q4_0-GGUF

Text Generation • Updated May 21 • 149 • 1

nitus-ac/nMer1d2-Q8_0-GGUF

Updated May 21 • 24

NikolayKozloff/Phi-3-medium-4k-instruct-Q5_K_S-GGUF

Text Generation • Updated May 21 • 17 • 2

newsletter/microsoft_WizardLM-2-7B-Q6_K-GGUF

Updated May 21 • 19

NikolayKozloff/Phi-3-medium-4k-instruct-Q4_K_S-GGUF

Text Generation • Updated May 21 • 19 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-Q5_0-GGUF

Text Generation • Updated May 21 • 18 • 2

NikolayKozloff/Phi-3-medium-128k-instruct-Q4_0-GGUF

Text Generation • Updated May 21 • 174 • 1

NikolayKozloff/Phi-3-medium-128k-instruct-Q5_K_S-GGUF

Text Generation • Updated May 21 • 17 • 1

NikolayKozloff/Phi-3-medium-128k-instruct-Q4_K_S-GGUF

Text Generation • Updated May 21 • 18 • 1

NikolayKozloff/Phi-3-medium-128k-instruct-Q5_0-GGUF

Text Generation • Updated May 21 • 19 • 2

thorh/Phi-3-medium-4k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 21 • 13