Edit Models filters

Inference Providers

HF Inference API

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,117

Full-text search

Active filters: 8-bit

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29, 2024 • 2.31k • 4

ethzanalytics/gpt-j-6B-8bit-sharded

Text Generation • Updated Jan 10 • 105 • 7

pszemraj/tiny-gpt2-magicprompt

Text Generation • Updated Mar 26, 2023 • 158 • 1

ethzanalytics/gpt-j-8bit-daily_dialogues

Text Generation • Updated Dec 25, 2024 • 31 • 4

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Text Generation • Updated Nov 27, 2022 • 11

ybelkada/bloom-560m-8bit

Text Generation • Updated Apr 12, 2023 • 80

ybelkada/bloom-1b7-8bit

Text Generation • Updated Apr 17, 2023 • 509 • 6

thes41d/fr-boris-8bit

Text Generation • Updated May 20, 2023 • 60

RajuKandasamy/dolly-v2-3b-8bit

Text Generation • Updated Apr 15, 2023 • 76

RajuKandasamy/dolly-v2-7b-8bit

Text Generation • Updated Apr 15, 2023 • 4

KumaTea/twitter-int8

Feature Extraction • Updated 9 days ago • 197

KumaTea/twitter-int4

Feature Extraction • Updated 9 days ago • 197 • 1

seongcho/GenerAd-AI

Text Generation • Updated Apr 21, 2023 • 1

Linus4Lyf/Llama-1epoch-Plato

Text Generation • Updated Apr 21, 2023 • 75

Linus4Lyf/Llama-5epoch-Plato

Text Generation • Updated Apr 22, 2023 • 77

Linus4Lyf/Llama-10epoch-Plato

Text Generation • Updated Apr 22, 2023 • 77

ethzanalytics/dolly-v2-12b-sharded-8bit

Text Generation • Updated Apr 29, 2023 • 17 • 4

ethzanalytics/dolly-v2-7b-sharded-8bit

Text Generation • Updated Jun 28, 2023 • 82 • 1

Linus4Lyf/Llama-10epoch-Plato-3epoch-Beauvoir_The_Second_Sex

Text Generation • Updated Apr 25, 2023 • 5

vvsotnikov/stablelm-7b-sft-v7-epoch-3-8bit

Text Generation • Updated Apr 25, 2023 • 7

Linus4Lyf/Llama-10epoch-Plato-3epoch-Hume_A_Treatise_Of_Human_Nature

Text Generation • Updated Apr 26, 2023 • 75

Linus4Lyf/Llama-10epoch-Plato-3epoch-Kant_Metaphysics_Of_Morals

Text Generation • Updated Apr 26, 2023 • 75 • 1

emrik/bloom7b-vigogne

Text Generation • Updated Apr 26, 2023 • 3

Linus4Lyf/Llama-10epoch-Plato-3epoch-Rousseau_Emile

Text Generation • Updated Apr 27, 2023 • 75

Linus4Lyf/Llama-10epoch-Plato-3epoch-Sina_A_Compendium_On_The_Soul

Text Generation • Updated Apr 27, 2023 • 76

pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit

Summarization • Updated 27 days ago • 123

ethzanalytics/stablelm-tuned-alpha-7b-sharded-8bit

Text Generation • Updated May 4, 2023 • 13 • 2

Sepehrasg/sepi-lora

Text Generation • Updated Apr 28, 2023 • 80

Linus4Lyf/Llama-10epoch-Plato-3epoch-Wollstonecraft_Thoughts_On_The_Education_Of_Daughters

Text Generation • Updated Apr 28, 2023 • 76

ek826/instruct-gpt-j-fp16-8bit

Text Generation • Updated May 18, 2023 • 3