Edit Models filters

Inference status

Misc

arxiv: 2210.17323

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Mixture of Experts

Models

114

Full-text search

Active filters: 2210.17323

TRAC-MTRY/traclm-v2-7b-instruct-GPTQ

Text Generation • Updated Dec 22, 2023

iproskurina/bloom-1b7-GPTQ-4bit-g128

Text Generation • Updated Sep 24 • 22

iproskurina/bloom-3b-GPTQ-4bit-g128

Text Generation • Updated Sep 24 • 20

iproskurina/bloom-560m-GPTQ-4bit-g128

Text Generation • Updated Sep 24 • 12

iproskurina/bloom-1b1-GPTQ-4bit-g128

Text Generation • Updated Sep 24 • 12

iproskurina/bloom-7b1-GPTQ-4bit-g128

Text Generation • Updated Sep 24 • 37 • 2

iproskurina/opt-350m-GPTQ-4bit-g128

Text Generation • Updated Sep 24 • 19

iproskurina/opt-1.3b-GPTQ-4bit-g128

Text Generation • Updated Sep 24 • 14

iproskurina/opt-2.7b-GPTQ-4bit-g128

Text Generation • Updated Sep 24 • 30

iproskurina/opt-6.7b-GPTQ-4bit-g128

Text Generation • Updated Sep 24 • 19

iproskurina/opt-13b-GPTQ-4bit-g128

Text Generation • Updated Sep 24 • 29

neuralmagic/zephyr-7b-beta-marlin

Text Generation • Updated Mar 6 • 9.58k

neuralmagic/TinyLlama-1.1B-Chat-v1.0-marlin

Text Generation • Updated Mar 6 • 5.71k • 1

neuralmagic/OpenHermes-2.5-Mistral-7B-marlin

Text Generation • Updated Mar 6 • 1.22k • 2

neuralmagic/Nous-Hermes-2-Yi-34B-marlin

Text Generation • Updated Mar 6 • 8 • 5

softmax/Llama-2-70b-chat-hf-marlin

Text Generation • Updated Mar 17 • 657

softmax/falcon-180B-chat-marlin

Text Generation • Updated Mar 21 • 12

smpanaro/Llama-2-7b-NuGPTQ

Text Generation • Updated 28 days ago • 38 • 1

TRAC-MTRY/traclm-v3-7b-instruct-GPTQ

Text Generation • Updated May 2

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 1.11k • 25

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 5.35k • 24

astronomer/Llama-3-8B-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 31 • 2

astronomer/Llama-3-8B-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 55 • 6

SwastikM/Llama-2-7B-Chat-text2code

Text Generation • Updated May 19 • 13 • 4

davidxmle/Llama-3-8B-Instruct-GPTQ-4-Bit-Debug

Text Generation • Updated Apr 30 • 7

IntelLabs/sqft-phi-3-mini-4k-50-base-gptq

Text Generation • Updated 9 days ago • 503 • 1

drbh/flash-attention-pre-compile

IntelLabs/sqft-mistral-7b-v0.3-50-base-gptq

Text Generation • Updated 9 days ago • 102 • 1

neuralmagic/Phi-3-mini-128k-instruct-quantized.w8a16

Text Generation • Updated about 1 month ago • 49

neuralmagic/Phi-3-medium-128k-instruct-quantized.w8a16

Text Generation • Updated about 1 month ago • 8.18k • 2