Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

2

Full-text search

Active filters: AutoAWQ

alokabhishek/Llama-2-7b-chat-hf-4bit-AWQ

Text Generation • Updated Mar 24 • 9 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-4bit-AWQ

Text Generation • Updated Mar 24 • 6 • 1