Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Carbon Emissions

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Mixture of Experts

Models

284

Full-text search

Active filters: ggml

farmer00317558/quantized_whisper_model

Updated May 11, 2023 • 1

ShadowPower/ggml-alpaca-chatgpt-new

Text Generation • Updated May 27, 2023 • 7

rustformers/mpt-7b-ggml

Text Generation • Updated Jun 9, 2023 • 60 • 46

Crataco/Pygmalion-1.3B-GGML

Updated Sep 24, 2023 • 7

Crataco/RWKV-4-PilePlus-Series-GGML

Text Generation • Updated Oct 1, 2023 • 3

digitous/13B-HyperMantis_GGML

Updated May 24, 2023 • 1

rustformers/redpajama-3b-ggml

Text Generation • Updated Jun 9, 2023 • 57 • 8

rustformers/pythia-ggml

Text Generation • Updated Jun 9, 2023 • 35 • 5

rustformers/bloom-ggml

Text Generation • Updated Jun 9, 2023 • 70 • 8

CalderaAI/30B-Lazarus-GGMLv5_1

Updated May 27, 2023 • 7

rustformers/gpt-j-ggml

Text Generation • Updated Jun 9, 2023 • 20 • 2

rustformers/stablelm-ggml

Text Generation • Updated Jun 9, 2023 • 37 • 3

rustformers/dolly-v2-ggml

Text Generation • Updated Oct 19, 2023 • 39 • 2

rustformers/gpt4all-j-ggml

Text Generation • Updated Jun 9, 2023 • 18 • 11

rustformers/redpajama-7b-ggml

Text Generation • Updated Jun 9, 2023 • 17 • 3

rustformers/open-llama-ggml

Text Generation • Updated Jun 11, 2023 • 12 • 9

phi0112358/Zicklein-7B-german_Alpaca-ggml

Updated Jun 19, 2023 • 4

phi0112358/PMC_LLaMA-7B-ggml

Updated Jun 19, 2023 • 2

mukowaty/ggml-whisper

Updated Jul 15 • 4

Green-Sky/ggml_openai_clip-vit-base-patch32

Updated Jun 25, 2023

Araki/airoboros-33b-gpt4-1.4.1-PI-8192-GGML

Text Generation • Updated Jul 16, 2023 • 2

Araki/Luna-AI-Llama2-Uncensored-GGML

Text Generation • Updated Jul 23, 2023 • 3

richardr1126/spider-skeleton-wizard-coder-ggml

Updated Aug 20, 2023 • 4

jphme/Llama-2-13b-chat-german-GGML

Text Generation • Updated Jul 22, 2023 • 13

Araki/llama2-7b-chat-hf-codeCherryPop-qLoRA-merged-GGML

Text Generation • Updated Jul 22, 2023 • 1

Trelis/Llama-2-7b-chat-hf-function-calling

Text Generation • Updated Aug 22, 2023 • 54 • 47

Trelis/Llama-2-13b-chat-hf-function-calling

Text Generation • Updated Aug 23, 2023 • 4

bornjre/btlm-3b-ggml

Updated Aug 21, 2023 • 7

gorkemgoknar/llama2-7f-moviechatbot-ggml-q4

Text Generation • Updated Oct 11, 2023

Trelis/Llama-2-7b-chat-hf-function-calling-GGML

Text Generation • Updated Aug 11, 2023 • 6