Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,993

Full-text search

Active filters: awq

TheBloke/MAmmoTH-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 170 • 1

TheBloke/MAmmoTH-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 79

TheBloke/Athena-v2-AWQ

Text Generation • Updated Nov 9, 2023 • 102 • 3

TheBloke/PuddleJumper-13B-V2-AWQ

Text Generation • Updated Nov 9, 2023 • 90 • 1

TheBloke/MXLewd-L2-20B-AWQ

Text Generation • Updated Nov 9, 2023 • 20 • 3

TheBloke/storytime-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 91 • 3

TheBloke/MXLewdMini-L2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 86 • 1

TheBloke/MetaMath-13B-V1.0-AWQ

Text Generation • Updated Nov 9, 2023 • 82 • 1

TheBloke/MAmmoTH-Coder-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 82 • 1

TheBloke/MetaMath-70B-V1.0-AWQ

Text Generation • Updated Nov 9, 2023 • 17 • 1

TheBloke/MetaMath-7B-V1.0-AWQ

Text Generation • Updated Nov 9, 2023 • 80 • 2

TheBloke/Synthia-13B-v1.2-AWQ

Text Generation • Updated Nov 9, 2023 • 83

TheBloke/Synthia-7B-v1.2-AWQ

Text Generation • Updated Nov 9, 2023 • 151

TheBloke/openbuddy-coder-34b-v11-bf16-AWQ

Text Generation • Updated Nov 9, 2023 • 11 • 1

TheBloke/openbuddy-llama2-34b-v11.1-bf16-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 3

poisson-fish/Marcoroni-70B-v1-AWQ

Text Generation • Updated Sep 28, 2023 • 42

TheBloke/vicuna-33B-AWQ

Text Generation • Updated Nov 9, 2023 • 17 • 2

TheBloke/law-LLM-AWQ

Text Generation • Updated Nov 9, 2023 • 82 • 2

TheBloke/U-Amethyst-20B-AWQ

Text Generation • Updated Nov 9, 2023 • 14 • 3

TheBloke/Marcoroni-70B-v1-AWQ

Text Generation • Updated Nov 9, 2023 • 9 • 2

TheBloke/Athena-v3-AWQ

Text Generation • Updated Nov 9, 2023 • 81 • 2

TheBloke/openbuddy-openllama-7B-v12-bf16-AWQ

Text Generation • Updated Nov 9, 2023 • 87

casperhansen/mistral-7b-instruct-v0.1-awq

Text Generation • Updated Oct 31, 2023 • 109 • 2

TheBloke/Emerhyst-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 92 • 4

TheBloke/Emerhyst-20B-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 10

TheBloke/leo-hessianai-13B-chat-bilingual-AWQ

Text Generation • Updated Nov 9, 2023 • 88 • 1

TheBloke/leo-hessianai-13B-chat-AWQ

Text Generation • Updated Nov 9, 2023 • 95

TheBloke/leo-hessianai-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 83

TheBloke/leo-hessianai-7B-chat-bilingual-AWQ

Text Generation • Updated Nov 9, 2023 • 85 • 2

TheBloke/leo-hessianai-7B-chat-AWQ

Text Generation • Updated Nov 9, 2023 • 89 • 1