Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

14,611

Full-text search

Active filters: 4-bit

arturoguizar/Llama-2-7b-hf-GPTQ

Text Generation • Updated Jul 16 • 2

PrunaAI/NexaAIDev-Octopus-v2-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 2

alouafi/Meta-llama-3-8B-Instruct-GPTQ

Text Generation • Updated Jul 16 • 1

PrunaAI/NexaAIDev-Octopus-v2-AWQ-4bit-smashed

Text Generation • Updated Jul 16 • 2

ronykris/llama-3-pdfGpt

Text Generation • Updated Jul 16 • 1

ola-akindele/llama3_model_extraction

Text Generation • Updated Jul 16 • 2

PrunaAI/stockmark-stockmark-13b-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 2

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 2

PrunaAI/stockmark-stockmark-13b-AWQ-4bit-smashed

Text Generation • Updated Jul 16 • 2

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-AWQ-4bit-smashed

Text Generation • Updated Jul 16 • 2

ryo0634/tiny-lm-test

Text Generation • Updated Jul 16 • 2

zhoukz/qwen2-57b-a14b-instruct-4bit

Text Generation • Updated Jul 16 • 2

MaziyarPanahi/mathstral-7B-v0.1-GGUF

Text Generation • Updated Jul 16 • 333 • 6

PrunaAI/allganize-Llama-3-Alpha-Ko-8B-Instruct-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 2

zhoukz/qwen2-72b-instruct-4bit

Text Generation • Updated Jul 16 • 1

shuyuej/Command-R-GPTQ

Text Generation • Updated Jul 25 • 5 • 1

zhoukz/qwen2-72b-4bit

Text Generation • Updated Jul 16 • 2

zhoukz/qwen2-57b-a14b-4bit

Text Generation • Updated Jul 16 • 1

gguichard/gemma-9b-finetuned-avocat_3epochs

Text Generation • Updated Jul 16 • 2

codewizardUV/gemma-2b-ft_and_merged

Text Generation • Updated Jul 17 • 2

bullerwins/mathstral-7B-v0.1-exl2_4.0bpw

Text Generation • Updated Jul 16 • 2

arcee-ai/Arcee-Nova-AWQ

Text Generation • Updated Jul 16 • 28

Noppawat-Rew/Mistral-ICD10

Text Generation • Updated Jul 16 • 2

twright8/gemma-2-9b-bnb-4bit

Text Generation • Updated Jul 16 • 2

kushagrrrr/Meta-Llama-3-8B-GPTQ

Text Generation • Updated Jul 16 • 2

thesven/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 16 • 4

MaxwellSilveira/t5-fine-tune-save-example

Text Generation • Updated Jul 16 • 2

MaxwellSilveira/t5-fine

Text Generation • Updated Jul 16 • 2

amgadhasan/NeuralDaredevil-7B-exl2-4bpw

Text Generation • Updated Jul 16 • 1

nikest/llama3-nps-q4

Text Generation • Updated Jul 16 • 2