Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,410

Full-text search

Active filters: meta

ass-a2s/em_german_70b_v01

Text Generation • Updated Nov 19, 2023 • 16 • 1

AzureBlack/GOAT-70B-Storytelling-exl2

Updated Nov 19, 2023

LoneStriker/GOAT-70B-Storytelling-2.4bpw-h6-exl2

Text Generation • Updated Nov 20, 2023 • 6

LoneStriker/GOAT-70B-Storytelling-4.0bpw-h6-exl2

Text Generation • Updated Nov 20, 2023 • 6

LoneStriker/GOAT-70B-Storytelling-3.0bpw-h6-exl2

Text Generation • Updated Nov 20, 2023 • 4

LoneStriker/GOAT-70B-Storytelling-4.65bpw-h6-exl2

Text Generation • Updated Nov 20, 2023 • 10 • 2

W404NET/Llama-2-7b-chat-hf

Text Generation • Updated Nov 20, 2023 • 11

LoneStriker/GOAT-70B-Storytelling-2.6bpw-h6-exl2

Text Generation • Updated Nov 20, 2023 • 6

LoneStriker/GOAT-70B-Storytelling-5.0bpw-h6-exl2

Text Generation • Updated Nov 20, 2023 • 8

LoneStriker/GOAT-70B-Storytelling-6.0bpw-h6-exl2

Text Generation • Updated Nov 20, 2023 • 5

W404NET/Llama-2-13b-chat-hf

Text Generation • Updated Nov 20, 2023 • 11

TheBloke/GOAT-70B-Storytelling-GGUF

Updated Nov 20, 2023 • 644 • 12

TheBloke/GOAT-70B-Storytelling-GPTQ

Text Generation • Updated Nov 20, 2023 • 34 • 4

TheBloke/GOAT-70B-Storytelling-AWQ

Text Generation • Updated Nov 20, 2023 • 20 • 2

e-valente/Llama-2-7B-Chat-GGUF

Text Generation • Updated Nov 26, 2023 • 44 • 1

OpenSistemas/Llama-2-7b-chat-hf

Text Generation • Updated Nov 27, 2023 • 10

davidkim205/komt-mistral-7b-v1-dpo

Text Generation • Updated Nov 29, 2023 • 13 • 8

OpenNMT/Llama-2-7b-hf-ct2-int8

Text Generation • Updated Dec 1, 2023 • 8

Trelis/Mistral-7B-Instruct-v0.1-function-calling-v3

Text Generation • Updated Dec 7, 2023 • 8

trishah/llama-2-7b-hf

Text Generation • Updated Nov 30, 2023 • 15 • 1

OpenNMT/Llama-2-7b-chat-hf-ct2-int8

Text Generation • Updated Dec 1, 2023 • 10

mlx-community/Llama-2-7b-chat-mlx

Text Generation • Updated Dec 20, 2023 • 78 • 84

mlx-community/Llama-2-7b-mlx

Text Generation • Updated Dec 20, 2023 • 63 • 11

mlx-community/CodeLlama-7b-Python-mlx

Text Generation • Updated Feb 27, 2024 • 25 • 10

mlx-community/CodeLlama-7b-mlx

Text Generation • Updated Dec 20, 2023 • 26 • 10

jamesdborin/llama2-7b-chat-4bit-AWQ

Text Generation • Updated Dec 7, 2023 • 67

ujjirox/llama-2-13b-chat

Text Generation • Updated Dec 21, 2023 • 7

SebastianSchramm/LlamaGuard-7b-GPTQ-4bit-128g-actorder_True

Text Generation • Updated Dec 19, 2023 • 83 • 2

wang7776/Llama-2-7b-chat-hf-10-sparsity

Text Generation • Updated Feb 4, 2024 • 1.99k

jamesdborin/llama2-13b-chat-4bit-AWQ

Text Generation • Updated Dec 11, 2023 • 92 • 1