Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

Mixture of Experts

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

369

Full-text search

Active filters: llama2

TheBloke/Free_Sydney_V2_Mistral_7b-GGUF

Updated Nov 20, 2023 • 521 • 5

TheBloke/Free_Sydney_V2_Mistral_7b-AWQ

Text Generation • Updated Nov 20, 2023 • 4 • 1

TheBloke/Free_Sydney_V2_Mistral_7b-GPTQ

Text Generation • Updated Nov 20, 2023 • 8 • 1

TheBloke/mistral_7b_norobots-GGUF

Updated Nov 20, 2023 • 312 • 2

TheBloke/mistral_7b_norobots-GPTQ

Updated Nov 20, 2023

TheBloke/mistral_7b_norobots-AWQ

Updated Nov 20, 2023

TheBloke/mistral_7b_norobots-fp16

Updated Nov 20, 2023 • 1

bartowski/mistral_7b_norobots-exl2

Text Generation • Updated Nov 21, 2023

bartowski/Free_Sydney_V2_Mistral_7b-exl2

Text Generation • Updated Nov 21, 2023

nvidia/Llama2-70B-SteerLM-Chat

Text Generation • Updated Jan 4 • 23

afrideva/llama2_xs_460M_experimental-GGUF

Text Generation • Updated Nov 23, 2023 • 83

chargoddard/llama-polyglot-13b

Text Generation • Updated Jan 4 • 1.3k • 5

TheBloke/llama-polyglot-13B-GPTQ

Text Generation • Updated Nov 23, 2023 • 17 • 1

TheBloke/llama-polyglot-13B-GGUF

Updated Nov 23, 2023 • 360 • 6

TheBloke/llama-polyglot-13B-AWQ

Text Generation • Updated Nov 23, 2023 • 9

BEE-spoke-data/NanoLlama-GQA-L10-A32_KV8-v13-KI

Text Generation • Updated Mar 4 • 10 • 1

kroonen/Orca-2-GGUF

Updated Nov 28, 2023 • 29

kroonen/neural-chat-7b-v3-1-GGUF

Updated Nov 28, 2023 • 27

afrideva/smol_llama-101M-GQA-GGUF

Text Generation • Updated Nov 28, 2023 • 43

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3 • 13.6k • 8

JLauridsenOrg/StorytellingForKids

Text Generation • Updated Nov 30, 2023 • 9

TheBloke/meditron-70B-GPTQ

Text Generation • Updated Nov 30, 2023 • 1.42k • 4

TheBloke/meditron-70B-AWQ

Text Generation • Updated Nov 30, 2023 • 32 • 5

TheBloke/meditron-70B-GGUF

Text Generation • Updated Nov 30, 2023 • 655 • 19

TheBloke/DiscoLM-120b-AWQ

Text Generation • Updated Dec 2, 2023 • 6 • 2

TheBloke/DiscoLM-120b-GGUF

Text Generation • Updated Dec 2, 2023 • 47 • 3

TheBloke/DiscoLM-120b-GPTQ

Text Generation • Updated Dec 3, 2023 • 25 • 3

amanpreetsingh459/llama-2-7b-chat_q4_quantized_cpp

Updated Dec 10, 2023

TheBloke/DiscoLM-70B-GPTQ

Text Generation • Updated Dec 6, 2023 • 53 • 4

TheBloke/DiscoLM-70B-GGUF

Text Generation • Updated Dec 6, 2023 • 587 • 3