Edit Models filters

Inference status

Misc

4-bit precision

intel/auto-round

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

43

Full-text search

Active filters: intel/auto-round

fbaldassarri/TinyLlama_TinyLlama_v1.1-autoround-int4-gs128-sym

Text Generation • Updated 4 days ago • 2

fbaldassarri/TinyLlama_TinyLlama_v1.1-autoround-int4-gs128-asym

Text Generation • Updated 4 days ago • 4

fbaldassarri/EleutherAI_pythia-31m-autoround-int4-gs128-sym

Text Generation • Updated 4 days ago • 2

fbaldassarri/EleutherAI_pythia-31m-autoround-int4-gs128-asym

Text Generation • Updated 4 days ago • 4

fbaldassarri/EleutherAI_pythia-70m-deduped-autoround-int4-gs128-asym

Text Generation • Updated about 21 hours ago

fbaldassarri/EleutherAI_pythia-70m-deduped-autoround-int4-gs128-sym

Text Generation • Updated about 21 hours ago

fbaldassarri/EleutherAI_pythia-12b-deduped-autoround-int4-gs128-asym

Text Generation • Updated about 20 hours ago

sofya-ai/Meta-Llama-3.1-70B-Instruct-int4-auto-round

Updated about 17 hours ago

fbaldassarri/EleutherAI_pythia-1b-deduped-autoround-int4-gs128-asym

Text Generation • Updated about 3 hours ago

fbaldassarri/EleutherAI_pythia-1b-deduped-autoround-int4-gs128-sym

Text Generation • Updated about 3 hours ago

fbaldassarri/EleutherAI_pythia-160m-deduped-autoround-int4-gs128-asym

Text Generation • Updated about 1 hour ago

fbaldassarri/EleutherAI_pythia-160m-deduped-autoround-int4-gs128-sym

Text Generation • Updated about 1 hour ago

fbaldassarri/EleutherAI_pythia-12b-deduped-autoround-int4-gs128-sym

Text Generation • Updated 39 minutes ago