Edit Models filters

text-generation-inference

AutoTrain Compatible

Inference Endpoints

Other with no match

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

18

Full-text search

Active filters: ExLlamaV2

FluffyKaeloky/Euryale-Inverted-L2-70B-exl2-6.0bpw

Text Generation • Updated Nov 30, 2023

Anthonyg5005/rishiraj-meow-10.7B-exl2

Text Generation • Updated May 13

Anthonyg5005/ReMM-v2.2-L2-13B-exl2

Text Generation • Updated 15 days ago • 1 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-5.0-bpw-exl2

Text Generation • Updated Apr 6 • 1 • 1

alokabhishek/Llama-2-7b-chat-hf-5.0-bpw-exl2

Text Generation • Updated Apr 6 • 1 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-4.0-bpw-exl2

Text Generation • Updated Apr 1 • 4 • 1

alokabhishek/Llama-2-7b-chat-hf-4.0-bpw-exl2

Text Generation • Updated Apr 26 • 1 • 1

alokabhishek/Llama-2-7b-chat-hf-8.0-bpw-exl2

Text Generation • Updated Apr 6 • 1 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-8.0-bpw-exl2

Text Generation • Updated Apr 6 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-4.0-bpw-exl2

Text Generation • Updated Apr 26 • 3 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-5.0-bpw-exl2

Text Generation • Updated Apr 26 • 18 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-8.0-bpw-exl2

Text Generation • Updated Apr 26 • 5 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-6.0-bpw-exl2

Text Generation • Updated Apr 26 • 18 • 1

Anthonyg5005/BeyondInfinity-4x7B-exl2-12gb

Text Generation • Updated 15 days ago • 1

alokabhishek/Mistral-7B-Instruct-v0.2-6.0-bpw-exl2

Text Generation • Updated May 9 • 10 • 2

alokabhishek/Llama-2-7b-chat-hf-6.0-bpw-exl2

Text Generation • Updated May 9 • 3 • 1

Anthonyg5005/Qwen1.5-0.5B-Chat-exl2

Text Generation • Updated May 10 • 1

Anthonyg5005/Meta-Llama-Guard-2-8B-exl2

Text Generation • Updated 14 days ago