Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

892

Full-text search

Active filters: compressed-tensors

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-quantized.w8a8

Updated Oct 24, 2024 • 2

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8

Updated Oct 24, 2024 • 2

nm-testing/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Updated Oct 24, 2024 • 5

CalamitousFelicitousness/Llama-3.05-Nemotron-Tenyxchat-Storybreaker-70B-FP8-Dynamic

Updated Oct 25, 2024 • 4

mbayser/granite-20b-functioncalling-FP8-KV

Updated Oct 25, 2024 • 8.87k

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4-e2e

Text Generation • Updated 5 days ago • 147

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4_channel-e2e

Text Generation • Updated 5 days ago • 111

CalamitousFelicitousness/EVA-Qwen2.5-72B-v0.0-FP8-Dynamic

Text Generation • Updated Oct 29, 2024 • 24

nm-testing/paligemma-3b-mix-224-FP8-dynamic

Updated Oct 29, 2024 • 9

yejingfu/nmagic-Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated Oct 31, 2024 • 250k

CalamitousFelicitousness/EVA-Qwen2.5-32B-v0.1-FP8-Dynamic

Text Generation • Updated Oct 31, 2024 • 3

PyrTools/Rocinante-12B-v1.1-FP8-Dynamic

Updated Oct 31, 2024 • 7

PyrTools/Cydonia-22B-v1.2-FP8-Dynamic

Updated Nov 1, 2024 • 1

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W4A16

Text Generation • Updated Nov 5, 2024 • 3

nm-testing/pixtral-12b-FP8-dynamic-all

Updated 13 days ago • 28

SicariusSicariiStuff/TheDrummer_Behemoth-123B-v1.1_FP8

Updated Nov 1, 2024 • 5

nm-testing/Llama-3.2-1B-Instruct-FP8-KV

Updated Nov 1, 2024 • 8.67k

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16

Text Generation • Updated Nov 5, 2024 • 77

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A8

Text Generation • Updated Nov 5, 2024 • 6

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A16

Text Generation • Updated Nov 5, 2024 • 9

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W4A16

Text Generation • Updated Nov 5, 2024 • 5

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W4A16

Text Generation • Updated Nov 5, 2024 • 80

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W8A8

Text Generation • Updated Nov 5, 2024 • 9

stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W8A16

Text Generation • Updated Nov 5, 2024 • 8

Vikhrmodels/vikhr-nemo-12b-W8A8-gptq-jsoncal

Text Generation • Updated Nov 4, 2024 • 38

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W8A8

Text Generation • Updated Nov 5, 2024 • 5

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W8A16

Text Generation • Updated Nov 5, 2024 • 8

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W8A8

Text Generation • Updated Nov 5, 2024 • 7

stan-hua/Meta-Llama-3.1-70B-Instruct-LC-SmoothQuant-RTN-W8A16

Text Generation • Updated Nov 5, 2024 • 8

leon-se/Molmo-7B-D-0924-FP8-Dynamic

Updated Nov 4, 2024 • 8