Edit Models filters

Inference status

Misc

arxiv: 2307.09288

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

563

Full-text search

Active filters: 2307.09288

TheBloke/Platypus2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 1

TheBloke/Platypus2-70B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 9 • 1

TheBloke/Stable-Platypus2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 12

TheBloke/Platypus2-70B-AWQ

Text Generation • Updated Nov 9, 2023 • 9 • 1

TheBloke/vicuna-13B-v1.5-16K-AWQ

Text Generation • Updated Nov 9, 2023 • 73 • 1

TheBloke/vicuna-13B-v1.5-AWQ

Text Generation • Updated Nov 9, 2023 • 26 • 1

TheBloke/vicuna-7B-v1.5-16K-AWQ

Text Generation • Updated Nov 9, 2023 • 41 • 1

TheBloke/vicuna-7B-v1.5-AWQ

Text Generation • Updated Nov 9, 2023 • 51 • 4

TheBloke/LlongOrca-7B-16K-AWQ

Text Generation • Updated Nov 9, 2023 • 11 • 1

TheBloke/OpenOrcaxOpenChat-Preview2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 9 • 1

TheBloke/StableBeluga-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 2

TheBloke/StableBeluga-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 10 • 1

TheBloke/StableBeluga2-70B-AWQ

Text Generation • Updated Nov 9, 2023 • 32 • 2

TheBloke/Speechless-Llama2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 21 • 1

TheBloke/Speechless-Llama2-Hermes-Orca-Platypus-WizardLM-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 14 • 4

TheBloke/ARIA-70B-V2-GGUF

Text Generation • Updated Sep 27, 2023 • 474 • 2

TheBloke/ARIA-70B-V2-GPTQ

Text Generation • Updated Sep 27, 2023 • 26 • 4

TheBloke/ARIA-70B-V2-AWQ

Text Generation • Updated Nov 9, 2023 • 20 • 3

Dawoodthouseef/llama2-gguf

Text Generation • Updated Oct 14, 2023 • 40 • 1

mmnga/Xwin-LM-7B-GPTQ-calib-ja-2k

Text Generation • Updated Sep 25, 2023 • 11 • 1

mmnga/Xwin-LM-7B-AWQ-calib-ja-100k

Text Generation • Updated Sep 26, 2023 • 11 • 2

mmnga/ELYZA-japanese-Llama-2-7b-fast-instruct-GPTQ-calib-ja-2k

Text Generation • Updated Sep 26, 2023 • 8 • 3

mindchain/META-LLAMA-Llama-2-7b-chat

Text Generation • Updated Sep 26, 2023

mmnga/ELYZA-japanese-Llama-2-7b-fast-instruct-AWQ-calib-ja-100k

Text Generation • Updated Sep 26, 2023 • 49 • 1

ArnaudHureaux/Llama-2-70b-chat-hf-miniguanaco

Text Generation • Updated Sep 28, 2023 • 12

castorini/rank_vicuna_7b_v1_fp16

Text Generation • Updated Sep 27, 2023 • 1.45k • 3

castorini/rank_vicuna_7b_v1_noda

Text Generation • Updated Sep 27, 2023 • 5

castorini/rank_vicuna_7b_v1_noda_fp16

Text Generation • Updated Sep 27, 2023 • 9

castorini/rank_vicuna_7b_v1

Text Generation • Updated Sep 27, 2023 • 991 • 4

TheBlake/Llama-2-7b

Text Generation • Updated Sep 27, 2023 • 18 • 2