Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,699

Full-text search

Active filters: 8-bit

kannn044/llama-3-8b-chat-doctor

Text Generation • Updated Jun 21 • 4

syr99/bnb_dpo_8bit

Text Generation • Updated Jun 14 • 3

pkalbhor/Meta-Llama-3-8B-Instruct-8bit

Text Generation • Updated Jun 14 • 2

marcosciala/pastanoodles_dpo_quant

Text Generation • Updated Jun 14 • 3

aerdna/phi2-q

Text Generation • Updated Jun 14 • 2

asbaa/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

Text Generation • Updated Jun 14 • 2

linxsxs/opt-125m-8bit

Text Generation • Updated Jun 14 • 2

bullerwins/Meta-Llama-3-8B-Instruct_exl2_8.0bpw

Text Generation • Updated Jun 14 • 2

broken-pipeline/MCQA-specialized-t5-base-int8

Text2Text Generation • Updated Jun 14 • 2

Douxe/quantizeTestThr1

Text2Text Generation • Updated Jun 14 • 2

broken-pipeline/MCQA-specialized-aligned-t5-base-int8

Text2Text Generation • Updated Jun 14 • 2

nali24mai/base_quantized_model

Text Generation • Updated Jun 14 • 2

Douxe/Quantize_MCQA-SciQ

Text2Text Generation • Updated Jun 14 • 2

chrisswillss98/dpo_mcqa_BBQ_v1.02

Text Generation • Updated Jun 14 • 2

rombirli/q8

Text2Text Generation • Updated Jun 14 • 2

Peaky8linders/football_lora_axolotl

TeeZee/BigMaid-20B-v2.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15 • 2

robertgshaw2/llama-3-w8a8-static-per-tensor-test

Text Generation • Updated Jun 15 • 3

robertgshaw2/llama-3-w8a8-dynamic-per-token-test

Text Generation • Updated Jun 15 • 2

grimjim/Llama-3-Oasis-v1-OAS-8B-8bpw_h8_exl2

Text Generation • Updated Aug 27 • 7

MaziyarPanahi/mergekit-slerp-oztfijl-GGUF

Text Generation • Updated Jun 15 • 128

MaziyarPanahi/EvoluzioneRed-GGUF

Text Generation • Updated Jun 15 • 91

MaziyarPanahi/mergekit-slerp-zwbosgo-GGUF

Text Generation • Updated Jun 15 • 112

MaziyarPanahi/Fimburs11V3-GGUF

Text Generation • Updated Jun 15 • 85

MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF

Text Generation • Updated Jun 15 • 92

TeeZee/DarkForest-20B-v3.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15 • 3

MaziyarPanahi/TopEvolution7RAG-GGUF

Text Generation • Updated Jun 15 • 211

KakaoL0L/Llama38B_CVetOFFRE2_4bit

Text Generation • Updated Jun 15 • 2

MaziyarPanahi/TopEvolutionWiz-GGUF

Text Generation • Updated Jun 15 • 149

MaziyarPanahi/TopEvolution-DPO-32K-GGUF

Text Generation • Updated Jun 15 • 328