Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

10,910

Full-text search

Active filters: 4-bit

RichardErkhov/Changgil_-_K2S3-SOLAR-11b-v1.0-4bits

Text Generation • Updated May 21 • 2

RichardErkhov/Changgil_-_K2S3-SOLAR-11b-v3.0-4bits

Text Generation • Updated May 21 • 2

nerottt/test

Text Generation • Updated May 21 • 1

MaziyarPanahi/Experiment27pasticheT3q-7B-GGUF

Text Generation • Updated May 21 • 301

RichardErkhov/Changgil_-_K2S3-SOLAR-11b-v2.0-4bits

Text Generation • Updated May 21 • 1

RichardErkhov/Changgil_-_K2S3-SOLAR-11b-v4.0-4bits

Text Generation • Updated May 21 • 1

MaziyarPanahi/Inex12Multiverseex26-7B-GGUF

Text Generation • Updated May 21 • 304

RichardErkhov/zyh3826_-_llama2-13b-ft-openllm-leaderboard-v1-4bits

Text Generation • Updated May 21 • 2

SalmanHabeeb/Phi-3-mini-128k-instruct-AWQ-4bit

Text Generation • Updated May 21 • 59 • 1

MaziyarPanahi/NeuralsynthesisMeliodas-7B-GGUF

Text Generation • Updated May 21 • 239

Mantis-VL/llava_siglip_llama3_8b_finetune_ablation4_8192_lora

Updated May 22 • 4

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-4_0bpw_exl2

Text Generation • Updated May 21 • 2

MaziyarPanahi/Multi_verse_modelExperiment26-7B-GGUF

Text Generation • Updated May 21 • 366

Mantis-VL/llava_siglip_llama3_8b_finetune_ablation3_8192_lora

Updated May 22 • 2

jmurphy97/mistral-7b-awq

Text Generation • Updated May 21 • 2

RichardErkhov/OpenLLMAI_-_Llama-2-7b-sft-model-ocra-500k-4bits

Text Generation • Updated May 21 • 2

emir12/Gemma-2b-int4-SODA_mark1

Text Generation • Updated May 21 • 3 • 1

MaziyarPanahi/T3qInex12-7B-GGUF

Text Generation • Updated May 21 • 314

RichardErkhov/prometheus-eval_-_prometheus-7b-v2.0-4bits

Text Generation • Updated May 21 • 8

MaziyarPanahi/Experiment27pasticheYamshadowexperiment28-7B-GGUF

Text Generation • Updated May 21 • 297

hjskhan/merged_model

Text Generation • Updated May 21 • 2

MaziyarPanahi/Yamshadowexperiment28M7-7B-GGUF

Text Generation • Updated May 21 • 336

MaziyarPanahi/CalmexperimentMeliodas-7B-GGUF

Text Generation • Updated May 21 • 344

Zoyd/TIGER-Lab_MAmmoTH2-7B-4_0bpw_exl2

Text Generation • Updated May 21 • 2

waffox/lora_model

Text Generation • Updated May 21 • 3

dahwinsingularity/dahyunvision_ultra

Text Generation • Updated May 21 • 2

emir12/Gemma-2b-int4-SODA_mark2

Text Generation • Updated May 21 • 2

MaziyarPanahi/MeliodasM7-7B-GGUF

Text Generation • Updated May 21 • 352

RichardErkhov/Ba2han_-_BruinsV2-OpHermesNeu-11B-4bits

Text Generation • Updated May 21 • 2

blockblockblock/Llama-3-70B-Instruct-abliterated-v3-bpw4-exl2

Text Generation • Updated May 21 • 4 • 1