Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Carbon Emissions

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Mixture of Experts

Models

283

Full-text search

Active filters: ggml

leafspark/Reflection-Llama-3.1-70B-GGUF

Text Generation • Updated 10 days ago • 13.1k • 28

mukowaty/ggml-whisper

Updated Jul 15 • 4

mys/ggml_llava-v1.5-7b

Updated Oct 9, 2023 • 23.8k • 102

mys/ggml_llava-v1.5-13b

Updated Oct 10, 2023 • 16.7k • 51

mys/ggml_bakllava-1

Updated Oct 19, 2023 • 9.03k • 74

afrideva/bloom-560m-GGUF

Text Generation • Updated Nov 17, 2023 • 273 • 5

afrideva/Tiny-Vicuna-1B-GGUF

Text Generation • Updated Nov 23, 2023 • 1.28k • 2

Green-Sky/bark-ggml

Updated Apr 22 • 6

afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF

Text Generation • Updated Apr 17 • 172 • 6

afrideva/pip-sql-1.3b-GGUF

Text Generation • Updated May 13 • 61 • 2

afrideva/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 98 • 1

leafspark/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • Updated Jul 25 • 1.83k • 20

leafspark/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Jul 24 • 4

leafspark/L3.1-70B-Celeste-v0.1-GGUF

Text Generation • Updated Aug 8 • 24 • 1

jhofseth/Reflection-Llama-3.1-70B-GGUF

Text Generation • Updated 7 days ago • 589 • 2

malteos/bloom-6b4-clp-german

Text Generation • Updated Apr 6 • 113 • 37

nouamanetazi/bloomz-560m-ggml

Updated Mar 15, 2023 • 4

maximeseth/alpaca-native-7B-ggml

Updated Mar 26, 2023 • 1

bertin-project/bertin-gpt-j-6B-alpaca

Text Generation • Updated Nov 17, 2023 • 688 • 7

CRD716/ggml-LLaMa-65B-quantized

Text Generation • Updated Sep 9, 2023 • 30

CRD716/ggml-vicuna-1.1-quantized

Text Generation • Updated Sep 9, 2023 • 43

Drake-AI/GPT-J-6b-Skein-ggml-q4_1

Updated Apr 18, 2023 • 1

Arjay87/bloomz_7b1.cpp

Updated Apr 21, 2023

nicholascao/chatbloom-1b7-sft

Text Generation • Updated Aug 12, 2023 • 18 • 6

Crataco/Pythia-Deduped-Series-GGML

Text Generation • Updated Oct 1, 2023 • 15

ravenscroftj/CodeGen-350M-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 2

ravenscroftj/CodeGen-2B-multi-ggml-quant

Text Generation • Updated Aug 5, 2023 • 2

ravenscroftj/CodeGen-6B-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 9

ShadowPower/ggml-alpaca-chatgpt

Text Generation • Updated May 12, 2023 • 7

rozek/OpenLLaMA_7B_300BT_q4

Text Generation • Updated May 5, 2023 • 1