Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,994

Full-text search

Active filters: awq

TheBloke/leo-hessianai-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 79

TheBloke/NexusRaven-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 88 • 4

TheBloke/Synthia-7B-v1.3-AWQ

Text Generation • Updated Nov 9, 2023 • 82 • 7

TheBloke/samantha-mistral-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 82 • 1

TheBloke/samantha-mistral-instruct-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 90 • 1

TheBloke/Pandalyst-7B-V1.1-AWQ

Text Generation • Updated Nov 9, 2023 • 80 • 1

TheBloke/Pandalyst_13B_V1.0-AWQ

Text Generation • Updated Nov 9, 2023 • 83 • 1

TheBloke/Kimiko-Mistral-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 82 • 2

TheBloke/Megamix-A1-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 80 • 1

TheBloke/MegaMix-S1-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 80

TheBloke/MegaMix-T1-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 79

TheBloke/sheep-duck-llama-2-70B-v1.1-AWQ

Text Generation • Updated Nov 9, 2023 • 20 • 4

TheBloke/MythoMakiseMerged-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 83 • 1

TheBloke/UltraRM-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 85 • 1

TheBloke/UltraLM-13B-v2.0-AWQ

Text Generation • Updated Nov 9, 2023 • 80 • 1

TheBloke/em_german_13b_v01-AWQ

Text Generation • Updated Nov 9, 2023 • 272 • 1

TheBloke/em_german_70b_v01-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 1

TheBloke/em_german_7b_v01-AWQ

Text Generation • Updated Nov 9, 2023 • 115 • 2

TheBloke/Mistral-7B-OpenOrca-AWQ

Text Generation • Updated Nov 9, 2023 • 16.8k • 41

TheBloke/Inkbot-13B-8k-0.2-AWQ

Text Generation • Updated Nov 9, 2023 • 88 • 2

TheBloke/Nous-Capybara-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 85 • 2

TheBloke/dolphin-2.0-mistral-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 90 • 7

TheBloke/TinyLlama-1.1B-Chat-v0.3-AWQ

Text Generation • Updated Nov 9, 2023 • 8.88k • 3

TheBloke/TinyLlama-1.1B-python-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 83 • 2

Trelis/TinyLlama-1.1B-Chat-v0.3-AWQ

Text Generation • Updated Oct 3, 2023 • 14

TheBloke/em_german_mistral_v01-AWQ

Text Generation • Updated Nov 9, 2023 • 94 • 6

TheBloke/TinyLlama-1.1B-intermediate-step-480k-1T-AWQ

Text Generation • Updated Nov 9, 2023 • 88 • 2

TheBloke/airoboros-mistral2.2-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 89 • 1

TheBloke/Dans-AdventurousWinds-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 87 • 1

TheBloke/Dans-TotSirocco-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 83 • 1