Edit Models filters

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

2,549

Full-text search

Active filters: 8-bit

RichardErkhov/codellama_-_CodeLlama-13b-Instruct-hf-8bits

Text Generation • Updated 15 days ago

RichardErkhov/eren23_-_DistiLabelOrca-TinyLLama-1.1B-8bits

Text Generation • Updated 15 days ago

RichardErkhov/OPI-PG_-_Qra-13b-8bits

Text Generation • Updated 15 days ago

RichardErkhov/kanishka_-_smolm-autoreg-bpe-seed_1024-8bits

Text Generation • Updated 15 days ago

RichardErkhov/kanishka_-_smolm-autoreg-bpe-seed_6-8bits

Text Generation • Updated 15 days ago • 1

RichardErkhov/kanishka_-_smolm-autoreg-bpe-seed_28-8bits

Text Generation • Updated 15 days ago • 1

RichardErkhov/yanolja_-_EEVE-Korean-Instruct-10.8B-v1.0-8bits

Text Generation • Updated 15 days ago • 1

RichardErkhov/Equall_-_Saul-Instruct-v1-8bits

Text Generation • Updated 15 days ago • 4

RichardErkhov/Locutusque_-_OpenCerebrum-2.0-7B-8bits

Text Generation • Updated 15 days ago • 1

MaziyarPanahi/Llama-3-8B-Instruct-v0.1-GGUF

Text Generation • Updated 15 days ago • 1.07k • 1

MaziyarPanahi/Llama-3-8B-Instruct-v0.2-GGUF

Text Generation • Updated 15 days ago • 1.35k • 1

MaziyarPanahi/Llama-3-8B-Instruct-v0.3-GGUF

Text Generation • Updated 15 days ago • 1.04k • 1

MaziyarPanahi/Llama-3-8B-Instruct-v0.4-GGUF

Text Generation • Updated 15 days ago • 1.57k • 1

RichardErkhov/wenbopan_-_Faro-Yi-9B-8bits

Text Generation • Updated 15 days ago • 1

MaziyarPanahi/Llama-3-8B-Instruct-v0.5-GGUF

Text Generation • Updated 15 days ago • 1.44k • 5

RichardErkhov/deepset_-_xlm-roberta-base-squad2-distilled-8bits

Text Generation • Updated 15 days ago

bullerwins/gradientai_Llama-3-8B-Instruct-262k_v2_exl2_8.0bpw

Text Generation • Updated 15 days ago • 2

RichardErkhov/kanishka_-_smolm-autoreg-bpe-seed_1102-8bits

Text Generation • Updated 15 days ago

RichardErkhov/codellama_-_CodeLlama-13b-hf-8bits

Text Generation • Updated 15 days ago

Dracones/Llama-3-Lumimaid-70B-v0.1_exl2_8.0bpw

Text Generation • Updated 15 days ago • 9 • 1

RichardErkhov/kanishka_-_smolm-autoreg-bpe-seed_8128-8bits

Text Generation • Updated 15 days ago

andreazecca3/vllm_logicllama

Text Generation • Updated 15 days ago • 6

RichardErkhov/Jiqing_-_tiny_random_llama2-8bits

Text Generation • Updated 15 days ago

RichardErkhov/TinyLlama_-_TinyLlama-1.1B-Chat-v0.3-8bits

Text Generation • Updated 14 days ago

RichardErkhov/speakleash_-_Bielik-7B-v0.1-8bits

Text Generation • Updated 14 days ago

andreazecca3/vllm_fol

Text Generation • Updated 14 days ago • 1

JayhC/Llama-3-Soliloquy-8B-v2-8bpw-h8-exl2

Text Generation • Updated 14 days ago • 10 • 1

RichardErkhov/stabilityai_-_StableBeluga-7B-8bits

Text Generation • Updated 14 days ago

RichardErkhov/echarlaix_-_tiny-random-PhiForCausalLM-8bits

Text Generation • Updated 14 days ago

RichardErkhov/kanishka_-_smolm-autoreg-bpe-seed_496-8bits

Text Generation • Updated 14 days ago