Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

14,247

Full-text search

Active filters: 4-bit

Fischerboot/LLama3-Lexi-Aura-3Some-SLERP-SLERP-QLORA

Updated Jun 22 • 2

inflaton/Qwen2-1.5B-Instruct-bnb-4bit-MAC-merged_4bit_forced

Text Generation • Updated Jun 22 • 3

mattzhang/idefics-9b-doodles

Updated Jun 22 • 2

SwordElucidator/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Jun 27 • 2 • 1

FuturisticVibes/dolphin-2.9.2-mixtral-8x22b-4.0bpw-h8-exl2

Text Generation • Updated Jun 22 • 4

wickedfiend/test-llama-model

Text Generation • Updated Jul 2 • 3

V3N0M/Jenna-v3-Qwn2-1.5-4bit

Text Generation • Updated Jun 22 • 3

bullerwins/Llama-3SOME-8B-v2-exl2_4.0bpw

Text Generation • Updated Jun 27 • 3

luchenyu/codestral-22b-v0.1

Text Generation • Updated Jun 22 • 11.7k

Infinirc/Infinirc-Llama3-8B-4bit-AWQ-GEMM-Beta

Text Generation • Updated Jun 28 • 35 • 1

fbaldassarri/modello-italia-9b-autoround-w4g128-gpu

Text Generation • Updated Jun 22 • 3

V3N0M/Jenna-v3-Gemma-2b-4bit

Text Generation • Updated Jun 22 • 4

SoumilB7/School_assistant1

Text Generation • Updated Jun 27 • 1

SoumilB7/School_categoriser

Text Generation • Updated Jun 22 • 1

myrulezzzz/mistral_custom4bit

Text Generation • Updated Jun 22 • 3

mohammad2928git/medical_v1

Text Generation • Updated Jun 22 • 2

WendyHoang/Llama3-70B-RAG-GPTQ-Int4

Text Generation • Updated Jun 22 • 3

notoookay/ragler-llama2-13b

Text Generation • Updated 12 days ago • 2

QuantiPhy/Salesforce_codegen2-7B_P

Text Generation • Updated Jun 22 • 3

Treza12/pleasework

Text Generation • Updated Jun 22 • 3

Fischerboot/llama3-sophie-adapter-model

Updated Jun 22 • 2

inflaton/mistral-7b-instruct-v0.3-MAC-merged_4bit_forced

Text Generation • Updated Jun 22 • 3

Fischerboot/L3-Sophie-8b-test-v2

Updated Jun 22 • 2

tharun01/Llama3-4bit-All-3epoch

Text Generation • Updated Jun 22 • 3

acunamartin1426/nuevo-fen

Text Generation • Updated Jun 22 • 4

IlyaGusev/saiga_aya_23_35b_sft_m1_d5_awq_4bit

Text Generation • Updated Jun 22 • 41 • 3

Weni/ZeroShot-Agents-Llama3-4.0.24-DPO-AWQ

Text Generation • Updated Jun 22 • 2

Weni/ZeroShot-Agents-Llama3-4.0.25-DPO-AWQ

Text Generation • Updated Jun 22 • 3

Fischerboot/ll3-sophie-2-sets-256

Updated Jun 22 • 2

Fischerboot/ll3-sophie-new-8ep

Updated Jun 22 • 2