Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Other with no match

text-embeddings-inference

Models

2,907

Full-text search

Active filters: awq

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 57.8k • 62

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated 11 days ago • 265 • 6

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31 • 13.8k • 17

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated Jun 6 • 155k • 18

internlm/internlm-xcomposer2d5-7b-4bit

Feature Extraction • Updated 3 days ago • 59 • 2

TheBloke/Pygmalion-2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 263 • 5

TheBloke/Mistral-Pygmalion-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 5 • 5

TheBloke/Mistral-7B-SciPhi-32k-AWQ

Text Generation • Updated Nov 9, 2023 • 5 • 4

TheBloke/OpenHermes-2.5-Mistral-7B-16k-AWQ

Text Generation • Updated Nov 16, 2023 • 26 • 4

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 60.7k • 40

ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 12, 2023 • 17.6k • 12

casperhansen/mixtral-instruct-awq

Text Generation • Updated Feb 11 • 8.66k • 40

TheBloke/dolphin-2.6-mistral-7B-AWQ

Text Generation • Updated Dec 28, 2023 • 23 • 5

TheBloke/Nous-Hermes-2-SOLAR-10.7B-AWQ

Text Generation • Updated Jan 2 • 76 • 9

TheBloke/Kunoichi-7B-AWQ

Text Generation • Updated Jan 5 • 3 • 7

TheBloke/Nous-Hermes-2-Mixtral-8x7B-SFT-AWQ

Text Generation • Updated Jan 16 • 37 • 3

nateraw/defog-sqlcoder-70b-alpha-awq

Text Generation • Updated Feb 8 • 7 • 1

MaziyarPanahi/WizardLM-2-7B-AWQ

Text Generation • Updated Apr 15 • 42 • 7

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Apr 16 • 917 • 9

solidrust/Solutus-3x7B-AWQ

Text Generation • Updated Apr 18 • 2 • 1

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Jun 8 • 24.9k • 19

solidrust/Meta-Llama-3-8B-Instruct-hf-AWQ

Text Generation • Updated Apr 22 • 2.66k • 7

Sreenington/Phi-3-mini-4k-instruct-AWQ

Text Generation • Updated May 5 • 965 • 5

julep-ai/dolphin-2.9.1-llama-3-70b-awq

Text Generation • Updated May 23 • 28 • 2

solidrust/Mistral-7B-Instruct-v0.3-AWQ

Text Generation • Updated May 25 • 2.14k • 2

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Jun 6 • 7.23k • 13

anyisalin/L3-70B-Euryale-v2.1-AWQ

Text Generation • Updated 26 days ago • 245 • 2

OliP/Phi-3-mini-128k-instruct-awq

Text Generation • Updated 5 days ago • 69 • 2

emaibb/magnum-72b-v1-awq

Text Generation • Updated 9 days ago • 4 • 1

pankajmathur/orca_mini_v7_7b-AWQ

Text Generation • Updated 7 days ago • 4 • 1