Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,837

Full-text search

Active filters: awq

TheBloke/Vicuna-7B-CoT-AWQ

Text Generation • Updated Nov 9, 2023 • 30 • 1

TheBloke/FashionGPT-70B-V1.1-AWQ

Text Generation • Updated Nov 9, 2023 • 9 • 3

TheBloke/LLaMA-13b-AWQ

Text Generation • Updated Nov 9, 2023 • 10 • 3

TheBloke/medalpaca-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 11

TheBloke/GPlatty-30B-AWQ

Text Generation • Updated Nov 9, 2023 • 8 • 2

TheBloke/Platypus-30B-AWQ

Text Generation • Updated Nov 9, 2023 • 15 • 2

TheBloke/LLaMA-30b-AWQ

Text Generation • Updated Nov 9, 2023 • 22 • 3

TheBloke/LLaMA-7b-AWQ

Text Generation • Updated Nov 9, 2023 • 17 • 2

TheBloke/VicUnlocked-30B-LoRA-AWQ

Text Generation • Updated Nov 9, 2023 • 20 • 2

TheBloke/hippogriff-30b-chat-AWQ

Text Generation • Updated Nov 9, 2023 • 10 • 1

TheBloke/manticore-13b-chat-pyg-AWQ

Text Generation • Updated Nov 9, 2023 • 10

TheBloke/tulu-30B-AWQ

Text Generation • Updated Nov 9, 2023 • 11

TheBloke/tulu-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 22

casperhansen/tinyllama-1b-awq-gemv

Text Generation • Updated Oct 31, 2023 • 18 • 1

TheBloke/ARIA-70B-V2-AWQ

Text Generation • Updated Nov 9, 2023 • 23 • 3

casperhansen/starcoderbase-1b-awq

Text Generation • Updated Oct 31, 2023 • 12

TheBloke/Falcon-180B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 15 • 8

TheBloke/Xwin-LM-13B-V0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 6

TheBloke/MAmmoTH-Coder-34B-AWQ

Text Generation • Updated Nov 9, 2023 • 11 • 1

TheBloke/MAmmoTH-70B-AWQ

Text Generation • Updated Nov 9, 2023 • 8 • 1

TheBloke/Inkbot-13B-4k-AWQ

Text Generation • Updated Nov 9, 2023 • 8 • 3

TheBloke/Xwin-LM-7B-V0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 2

TheBloke/Xwin-LM-70B-V0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 18 • 14

TheBloke/Buddy-7B-v0.2-AWQ

Text Generation • Updated Nov 9, 2023 • 27 • 2

TheBloke/Airoboros-L2-70b-2.2.1-AWQ

Text Generation • Updated Nov 9, 2023 • 14 • 1

TheBloke/MLewd-ReMM-L2-Chat-20B-AWQ

Text Generation • Updated Nov 9, 2023 • 14 • 6

TheBloke/MLewd-ReMM-L2-Chat-20B-Inverted-AWQ

Text Generation • Updated Nov 9, 2023 • 14 • 2

TheBloke/ALMA-7B-Pretrain-AWQ

Text Generation • Updated Nov 9, 2023 • 8 • 2

TheBloke/ALMA-13B-Pretrain-AWQ

Text Generation • Updated Nov 9, 2023 • 16 • 1

TheBloke/airoboros-c34b-2.2.1-AWQ

Text Generation • Updated Nov 9, 2023 • 20