Edit Models filters

Inference status

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,817

Full-text search

Active filters: 8-bit

mlx-community/Meta-Llama-3.1-405B-Instruct-8bit

Text Generation • Updated 14 days ago • 277 • 1

mlx-community/Qwen2.5-Coder-32B-8bit

Text Generation • Updated 12 days ago • 104 • 1

lmstudio-community/Qwen2.5-Coder-1.5B-Instruct-MLX-8bit

Text Generation • Updated 11 days ago • 49 • 1

crce9598/Llama3.2-Code-Instruct-Finetune-IPAM

Text Generation • Updated 8 days ago • 23 • 1

mlx-community/Athene-V2-Chat-8bit

Text Generation • Updated 7 days ago • 49 • 1

bullerwins/Athene-V2-Chat-exl2_8.0bpw

Text Generation • Updated 7 days ago • 17 • 1

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated 3 days ago • 17.5k • 1

Beygo/Athene-V2-Agent-Q8-mlx

Text Generation • Updated 3 days ago • 8 • 1

mlx-community/Lumimaid-v0.2-70B

Updated Oct 13 • 10 • 1

MikeRoz/sophosympatheia_Evathene-v1.0-8.0bpw-h8-exl2

Text Generation • Updated 6 days ago • 32 • 1

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 3.39k • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21 • 14 • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29 • 3.37k • 4

ethzanalytics/gpt-j-6B-8bit-sharded

Text Generation • Updated Nov 27, 2022 • 12 • 7

ethzanalytics/gpt-j-8bit-daily_dialogues

Text Generation • Updated Nov 27, 2022 • 26 • 4

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Text Generation • Updated Nov 27, 2022 • 25

ybelkada/bloom-560m-8bit

Text Generation • Updated Apr 12, 2023 • 15

ybelkada/bloom-1b7-8bit

Text Generation • Updated Apr 17, 2023 • 580 • 6

thes41d/fr-boris-8bit

Text Generation • Updated May 20, 2023 • 10

RajuKandasamy/dolly-v2-3b-8bit

Text Generation • Updated Apr 15, 2023 • 11

RajuKandasamy/dolly-v2-7b-8bit

Text Generation • Updated Apr 15, 2023 • 10

seongcho/GenerAd-AI

Text Generation • Updated Apr 21, 2023

Linus4Lyf/Llama-1epoch-Plato

Text Generation • Updated Apr 21, 2023 • 11

Linus4Lyf/Llama-5epoch-Plato

Text Generation • Updated Apr 22, 2023 • 8

Linus4Lyf/Llama-10epoch-Plato

Text Generation • Updated Apr 22, 2023 • 21

ethzanalytics/dolly-v2-12b-sharded-8bit

Text Generation • Updated Apr 29, 2023 • 14 • 4

ethzanalytics/dolly-v2-7b-sharded-8bit

Text Generation • Updated Jun 28, 2023 • 17 • 1

Linus4Lyf/Llama-10epoch-Plato-3epoch-Beauvoir_The_Second_Sex

Text Generation • Updated Apr 25, 2023 • 13

vvsotnikov/stablelm-7b-sft-v7-epoch-3-8bit

Text Generation • Updated Apr 25, 2023 • 103

Linus4Lyf/Llama-10epoch-Plato-3epoch-Hume_A_Treatise_Of_Human_Nature

Text Generation • Updated Apr 26, 2023 • 8