LLM - a OpenVINO Collection

Models
Datasets
Spaces
Posts
Docs
Pricing
Log In
Sign Up

OpenVINO 's Collections

LLM

LLM

updated Aug 14

Collection of OpenVINO optimized LLMs

OpenVINO/phi-2-fp16-ov

Text Generation • Updated Aug 7 • 48 • 1
OpenVINO/phi-2-int8-ov

Text Generation • Updated Aug 7 • 42
OpenVINO/mistral-7b-instruct-v0.1-int8-ov

Text Generation • Updated Aug 7 • 139
OpenVINO/mistral-7b-instruct-v0.1-fp16-ov

Text Generation • Updated Aug 7 • 41
OpenVINO/mistral-7b-instruct-v0.1-int4-ov

Text Generation • Updated Aug 7 • 398
OpenVINO/codegen25-7b-multi-fp16-ov

Text Generation • Updated Aug 7 • 16
OpenVINO/codegen25-7b-multi-int8-ov

Text Generation • Updated Aug 7 • 13 • 1
OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov

Text Generation • Updated Aug 7 • 30 • 3
OpenVINO/Mixtral-8x7B-Instruct-v0.1-int8-ov

Text Generation • Updated Aug 7 • 50 • 2
OpenVINO/notus-7b-v1-fp16-ov

Text Generation • Updated Aug 7 • 4
OpenVINO/notus-7b-v1-int8-ov

Text Generation • Updated Aug 7 • 5
OpenVINO/neural-chat-7b-v3-3-fp16-ov

Text Generation • Updated Aug 7 • 38
OpenVINO/neural-chat-7b-v3-3-int8-ov

Text Generation • Updated Aug 7 • 31
OpenVINO/zephyr-7b-beta-int8-ov

Text Generation • Updated Aug 7 • 5
OpenVINO/zephyr-7b-beta-int4-ov

Text Generation • Updated Aug 7 • 20
OpenVINO/dolly-v2-3b-int4-ov

Text Generation • Updated Aug 7 • 24
OpenVINO/dolly-v2-3b-int8-ov

Text Generation • Updated Aug 7 • 6
OpenVINO/dolly-v2-3b-fp16-ov

Text Generation • Updated Aug 7 • 14
OpenVINO/codegen2-3_7B_P-int4-ov

Text Generation • Updated Aug 7 • 22
OpenVINO/codegen2-3_7B_P-fp16-ov

Text Generation • Updated Aug 7 • 34
OpenVINO/zephyr-7b-beta-fp16-ov

Text Generation • Updated Jul 24 • 4
OpenVINO/codegen2-3_7B_P-int8-ov

Text Generation • Updated Aug 7 • 36 • 1
OpenVINO/TinyLlama-1.1B-Chat-v1.0-fp16-ov

Text Generation • Updated Aug 7 • 72 • 1
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int4-ov

Text Generation • Updated Aug 7 • 626
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int8-ov

Text Generation • Updated Aug 7 • 39
OpenVINO/gpt-neox-20b-int8-ov

Text Generation • Updated Aug 7 • 3
OpenVINO/gpt-neox-20b-fp16-ov

Text Generation • Updated Aug 7 • 5
OpenVINO/gpt-neox-20b-int4-ov

Text Generation • Updated Jul 24 • 9
OpenVINO/gpt-j-6b-int4-ov

Text Generation • Updated Aug 7 • 6
OpenVINO/gpt-j-6b-int8-ov

Text Generation • Updated Aug 7 • 33
OpenVINO/gpt-j-6b-fp16-ov

Text Generation • Updated Aug 7 • 8
OpenVINO/falcon-7b-instruct-int4-ov

Text Generation • Updated Aug 7 • 10
OpenVINO/falcon-7b-instruct-fp16-ov

Text Generation • Updated Aug 7 • 3
OpenVINO/falcon-7b-instruct-int8-ov

Text Generation • Updated Aug 7 • 5
OpenVINO/open_llama_7b_v2-int8-ov

Text Generation • Updated Aug 7 • 88
OpenVINO/open_llama_7b_v2-int4-ov

Text Generation • Updated Aug 7 • 29
OpenVINO/open_llama_7b_v2-fp16-ov

Text Generation • Updated Aug 7 • 25
OpenVINO/open_llama_3b_v2-int8-ov

Text Generation • Updated Aug 7 • 182 • 1
OpenVINO/open_llama_3b_v2-fp16-ov

Text Generation • Updated Aug 7 • 55
OpenVINO/phi-2-int4-ov

Text Generation • Updated Aug 7 • 17 • 1
OpenVINO/neural-chat-7b-v3-3-int4-ov

Text Generation • Updated Aug 7 • 9
OpenVINO/notus-7b-v1-int4-ov

Text Generation • Updated Aug 7 • 8
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int8-ov

Text Generation • Updated Aug 7 • 3
OpenVINO/RedPajama-INCITE-7B-Instruct-fp16-ov

Text Generation • Updated Aug 7 • 16
OpenVINO/RedPajama-INCITE-7B-Instruct-int4-ov

Text Generation • Updated Aug 7 • 9
OpenVINO/RedPajama-INCITE-7B-Chat-int4-ov

Text Generation • Updated Aug 7 • 9
OpenVINO/RedPajama-INCITE-7B-Instruct-int8-ov

Text Generation • Updated Jul 24 • 7
OpenVINO/RedPajama-INCITE-7B-Chat-fp16-ov

Text Generation • Updated Jul 24 • 3
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int4-ov

Text Generation • Updated Aug 7 • 2
OpenVINO/RedPajama-INCITE-7B-Chat-int8-ov

Text Generation • Updated Aug 7 • 9
OpenVINO/RedPajama-INCITE-Chat-3B-v1-fp16-ov

Text Generation • Updated Aug 7 • 7
OpenVINO/dolly-v2-12b-int4-ov

Text Generation • Updated Aug 7 • 7
OpenVINO/dolly-v2-7b-int4-ov

Text Generation • Updated Aug 7 • 9
OpenVINO/dolly-v2-7b-int8-ov

Text Generation • Updated Aug 7 • 31
OpenVINO/dolly-v2-7b-fp16-ov

Text Generation • Updated Aug 7 • 11
OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov

Text Generation • Updated Aug 7 • 322 • 1
OpenVINO/dolly-v2-12b-int8-ov

Text Generation • Updated Aug 7 • 7
OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov

Text Generation • Updated Aug 7 • 260 • 1
OpenVINO/Mistral-7B-Instruct-v0.2-fp16-ov

Text Generation • Updated Aug 7 • 18
OpenVINO/codegen25-7b-multi-int4-ov

Text Generation • Updated Aug 7 • 10
OpenVINO/persimmon-8b-chat-int4-ov

Text Generation • Updated Aug 7 • 6
OpenVINO/persimmon-8b-chat-int8-ov

Text Generation • Updated Aug 7 • 7
OpenVINO/pythia-1.4b-int4-ov

Text Generation • Updated Aug 7 • 26
OpenVINO/pythia-1.4b-int8-ov

Text Generation • Updated Aug 7 • 4
OpenVINO/persimmon-8b-chat-fp16-ov

Text Generation • Updated Aug 7 • 7
OpenVINO/pythia-1.4b-fp16-ov

Text Generation • Updated Aug 7 • 5
OpenVINO/pythia-12b-int4-ov

Text Generation • Updated Jul 24 • 3
OpenVINO/pythia-12b-int8-ov

Text Generation • Updated Jul 24 • 4
OpenVINO/pythia-2.8b-int8-ov

Text Generation • Updated Aug 7 • 2
OpenVINO/pythia-2.8b-int4-ov

Text Generation • Updated Aug 7 • 7
OpenVINO/pythia-12b-fp16-ov

Text Generation • Updated Aug 7 • 6
OpenVINO/pythia-6.9b-int4-ov

Text Generation • Updated Aug 7 • 2
OpenVINO/pythia-6.9b-int8-ov

Text Generation • Updated Aug 7 • 2
OpenVINO/pythia-2.8b-fp16-ov

Text Generation • Updated Aug 7 • 6
OpenVINO/pythia-6.9b-fp16-ov

Text Generation • Updated Aug 7 • 8
OpenVINO/pythia-1b-int4-ov

Text Generation • Updated Aug 7 • 10
OpenVINO/pythia-1b-int8-ov

Text Generation • Updated Aug 7 • 7
OpenVINO/pythia-1b-fp16-ov

Text Generation • Updated Aug 7 • 5
OpenVINO/neural-chat-7b-v1-1-int4-ov

Text Generation • Updated Aug 7 • 19
OpenVINO/neural-chat-7b-v1-1-int8-ov

Text Generation • Updated Aug 7 • 3
OpenVINO/neural-chat-7b-v1-1-fp16-ov

Text Generation • Updated Aug 7 • 1
OpenVINO/Phi-3-medium-4k-instruct-fp16-ov

Text Generation • Updated Aug 20 • 15
OpenVINO/Phi-3-medium-4k-instruct-int4-ov

Text Generation • Updated Aug 20 • 322 • 3
OpenVINO/Phi-3-medium-4k-instruct-int8-ov

Text Generation • Updated Aug 20 • 32
OpenVINO/mpt-7b-int8-ov

Text Generation • Updated Aug 7 • 12
OpenVINO/mpt-7b-fp16-ov

Text Generation • Updated Aug 7 • 16
OpenVINO/starcoder2-15b-int8-ov

Text Generation • Updated Aug 7 • 13
OpenVINO/starcoder2-15b-int4-ov

Text Generation • Updated Aug 7 • 26
OpenVINO/starcoder2-15b-fp16-ov

Text Generation • Updated Aug 7 • 10
OpenVINO/starcoder2-7b-fp16-ov

Text Generation • Updated Aug 7 • 19
OpenVINO/starcoder2-7b-int4-ov

Text Generation • Updated Aug 7 • 15
OpenVINO/starcoder2-7b-int8-ov

Text Generation • Updated Aug 7 • 24
OpenVINO/starcoder2-3b-int4-ov

Text Generation • Updated Aug 7 • 20
OpenVINO/starcoder2-3b-fp16-ov

Text Generation • Updated Aug 7 • 15
OpenVINO/starcoder2-3b-int8-ov

Text Generation • Updated Aug 7 • 26
OpenVINO/Phi-3-mini-4k-instruct-fp16-ov

Text Generation • Updated Aug 20 • 47 • 2
OpenVINO/Phi-3-mini-128k-instruct-fp16-ov

Text Generation • Updated Aug 20 • 54
OpenVINO/Phi-3-mini-128k-instruct-int4-ov

Text Generation • Updated Aug 20 • 546 • 2
OpenVINO/Phi-3-mini-4k-instruct-int4-ov

Text Generation • Updated Aug 20 • 5.49k
OpenVINO/Phi-3-mini-4k-instruct-int8-ov

Text Generation • Updated Aug 20 • 26
OpenVINO/Phi-3-mini-128k-instruct-int8-ov

Text Generation • Updated Aug 20 • 52 • 2
OpenVINO/open_llama_3b_v2-int4-ov

Text Generation • Updated Aug 7 • 14
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-fp16-ov

Updated Aug 14 • 3
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int4-ov

Updated Aug 14
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int8-ov

Updated Aug 14 • 9

Collection guide
Browse collections

Company

© Hugging Face

TOS Privacy About Jobs

Website

Models Datasets Spaces Pricing Docs