LLM - a OpenVINO Collection

Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

OpenVINO 's Collections

Speculative Decoding Draft Models

LLM

LLM

updated 26 days ago

Collection of OpenVINO optimized LLMs

OpenVINO/phi-2-fp16-ov

Text Generation • Updated Nov 5 • 579 • 1
OpenVINO/phi-2-int8-ov

Text Generation • Updated Oct 29 • 51
OpenVINO/mistral-7b-instruct-v0.1-int8-ov

Text Generation • Updated 17 days ago • 941 • 1
OpenVINO/mistral-7b-instruct-v0.1-fp16-ov

Text Generation • Updated Nov 11 • 52
OpenVINO/mistral-7b-instruct-v0.1-int4-ov

Text Generation • Updated Oct 29 • 521
OpenVINO/codegen25-7b-multi-fp16-ov

Text Generation • Updated Nov 5 • 17
OpenVINO/codegen25-7b-multi-int8-ov

Text Generation • Updated Nov 5 • 18 • 1
OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov

Text Generation • Updated Nov 5 • 280 • 4
OpenVINO/Mixtral-8x7B-Instruct-v0.1-int8-ov

Text Generation • Updated Nov 5 • 229 • 3
OpenVINO/notus-7b-v1-fp16-ov

Text Generation • Updated Nov 5 • 16
OpenVINO/notus-7b-v1-int8-ov

Text Generation • Updated Nov 5 • 16
OpenVINO/neural-chat-7b-v3-3-fp16-ov

Text Generation • Updated Nov 5 • 21
OpenVINO/neural-chat-7b-v3-3-int8-ov

Text Generation • Updated Nov 5 • 25
OpenVINO/zephyr-7b-beta-int8-ov

Text Generation • Updated Nov 5 • 20
OpenVINO/zephyr-7b-beta-int4-ov

Text Generation • Updated Nov 5 • 18
OpenVINO/dolly-v2-3b-int4-ov

Text Generation • Updated Nov 5 • 392
OpenVINO/dolly-v2-3b-int8-ov

Text Generation • Updated Nov 5 • 54
OpenVINO/dolly-v2-3b-fp16-ov

Text Generation • Updated Nov 5 • 402
OpenVINO/codegen2-3_7B_P-int4-ov

Text Generation • Updated Nov 5 • 14
OpenVINO/codegen2-3_7B_P-fp16-ov

Text Generation • Updated Nov 5 • 15
OpenVINO/zephyr-7b-beta-fp16-ov

Text Generation • Updated Nov 5 • 17
OpenVINO/codegen2-3_7B_P-int8-ov

Text Generation • Updated Nov 5 • 14 • 1
OpenVINO/TinyLlama-1.1B-Chat-v1.0-fp16-ov

Text Generation • Updated Nov 5 • 408 • 1
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int4-ov

Text Generation • Updated Oct 31 • 495
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int8-ov

Text Generation • Updated Nov 5 • 439
OpenVINO/gpt-neox-20b-int8-ov

Text Generation • Updated Nov 5 • 16
OpenVINO/gpt-neox-20b-fp16-ov

Text Generation • Updated Nov 5 • 26
OpenVINO/gpt-j-6b-int4-ov

Text Generation • Updated Nov 5 • 56
OpenVINO/gpt-j-6b-int8-ov

Text Generation • Updated Nov 5 • 19
OpenVINO/gpt-j-6b-fp16-ov

Text Generation • Updated Nov 5 • 33
OpenVINO/falcon-7b-instruct-int4-ov

Text Generation • Updated Nov 5 • 14
OpenVINO/falcon-7b-instruct-fp16-ov

Text Generation • Updated Nov 5 • 17
OpenVINO/falcon-7b-instruct-int8-ov

Text Generation • Updated Nov 5 • 14
OpenVINO/open_llama_7b_v2-int8-ov

Text Generation • Updated Nov 5 • 22
OpenVINO/open_llama_7b_v2-int4-ov

Text Generation • Updated Nov 5 • 16
OpenVINO/open_llama_7b_v2-fp16-ov

Text Generation • Updated Nov 5 • 40
OpenVINO/open_llama_3b_v2-int8-ov

Text Generation • Updated Oct 29 • 397 • 1
OpenVINO/open_llama_3b_v2-fp16-ov

Text Generation • Updated Nov 5 • 24
OpenVINO/phi-2-int4-ov

Text Generation • Updated Nov 5 • 15 • 1
OpenVINO/neural-chat-7b-v3-3-int4-ov

Text Generation • Updated Nov 5 • 112
OpenVINO/notus-7b-v1-int4-ov

Text Generation • Updated Nov 5 • 37
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int8-ov

Text Generation • Updated Nov 5 • 10
OpenVINO/RedPajama-INCITE-7B-Instruct-fp16-ov

Text Generation • Updated Nov 5 • 32
OpenVINO/RedPajama-INCITE-7B-Instruct-int4-ov

Text Generation • Updated Nov 5 • 13
OpenVINO/RedPajama-INCITE-7B-Chat-int4-ov

Text Generation • Updated Nov 5 • 12
OpenVINO/RedPajama-INCITE-7B-Instruct-int8-ov

Text Generation • Updated Nov 5 • 8
OpenVINO/RedPajama-INCITE-7B-Chat-fp16-ov

Text Generation • Updated Nov 5 • 28
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int4-ov

Text Generation • Updated Nov 5 • 10
OpenVINO/RedPajama-INCITE-7B-Chat-int8-ov

Text Generation • Updated Nov 5 • 14
OpenVINO/RedPajama-INCITE-Chat-3B-v1-fp16-ov

Text Generation • Updated Nov 5 • 23
OpenVINO/dolly-v2-7b-int4-ov

Text Generation • Updated Nov 5 • 22
OpenVINO/dolly-v2-7b-int8-ov

Text Generation • Updated Nov 5 • 15
OpenVINO/dolly-v2-7b-fp16-ov

Text Generation • Updated Nov 5 • 17
OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov

Text Generation • Updated Oct 29 • 678 • 1
OpenVINO/dolly-v2-12b-int8-ov

Text Generation • Updated Nov 5 • 12
OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov

Text Generation • Updated Oct 31 • 445 • 1
OpenVINO/Mistral-7B-Instruct-v0.2-fp16-ov

Text Generation • Updated Nov 5 • 29
OpenVINO/codegen25-7b-multi-int4-ov

Text Generation • Updated Nov 5 • 23
OpenVINO/persimmon-8b-chat-int4-ov

Text Generation • Updated Nov 5 • 11
OpenVINO/persimmon-8b-chat-int8-ov

Text Generation • Updated Nov 5 • 9
OpenVINO/pythia-1.4b-int4-ov

Text Generation • Updated Nov 5 • 8
OpenVINO/pythia-1.4b-int8-ov

Text Generation • Updated Nov 5 • 10
OpenVINO/persimmon-8b-chat-fp16-ov

Text Generation • Updated Nov 5 • 14
OpenVINO/pythia-1.4b-fp16-ov

Text Generation • Updated Nov 5 • 34
OpenVINO/pythia-12b-int8-ov

Text Generation • Updated Nov 5 • 9
OpenVINO/pythia-2.8b-int8-ov

Text Generation • Updated Nov 5 • 10
OpenVINO/pythia-2.8b-int4-ov

Text Generation • Updated Nov 5 • 9
OpenVINO/pythia-12b-fp16-ov

Text Generation • Updated Nov 5 • 20
OpenVINO/pythia-6.9b-int4-ov

Text Generation • Updated Nov 5 • 10
OpenVINO/pythia-6.9b-int8-ov

Text Generation • Updated Nov 5 • 8
OpenVINO/pythia-2.8b-fp16-ov

Text Generation • Updated Nov 5 • 20
OpenVINO/pythia-6.9b-fp16-ov

Text Generation • Updated Nov 5 • 21
OpenVINO/pythia-1b-int4-ov

Text Generation • Updated Nov 5 • 12
OpenVINO/pythia-1b-int8-ov

Text Generation • Updated Nov 5 • 11
OpenVINO/pythia-1b-fp16-ov

Text Generation • Updated Nov 5 • 24
OpenVINO/neural-chat-7b-v1-1-int4-ov

Text Generation • Updated Nov 5 • 15
OpenVINO/neural-chat-7b-v1-1-int8-ov

Text Generation • Updated Nov 5 • 14
OpenVINO/neural-chat-7b-v1-1-fp16-ov

Text Generation • Updated Nov 5 • 22
OpenVINO/Phi-3-medium-4k-instruct-fp16-ov

Text Generation • Updated Nov 5 • 20
OpenVINO/Phi-3-medium-4k-instruct-int4-ov

Text Generation • Updated Oct 29 • 316 • 3
OpenVINO/Phi-3-medium-4k-instruct-int8-ov

Text Generation • Updated Nov 5 • 10
OpenVINO/mpt-7b-int8-ov

Text Generation • Updated Nov 5 • 12
OpenVINO/mpt-7b-fp16-ov

Text Generation • Updated Nov 5 • 16
OpenVINO/starcoder2-15b-int8-ov

Text Generation • Updated Nov 5 • 21
OpenVINO/starcoder2-15b-int4-ov

Text Generation • Updated Nov 5 • 47
OpenVINO/starcoder2-15b-fp16-ov

Text Generation • Updated Nov 5 • 20
OpenVINO/starcoder2-7b-fp16-ov

Text Generation • Updated Nov 5 • 66
OpenVINO/starcoder2-7b-int4-ov

Text Generation • Updated Nov 5 • 47
OpenVINO/starcoder2-7b-int8-ov

Text Generation • Updated Nov 5 • 37
OpenVINO/starcoder2-3b-int4-ov

Text Generation • Updated Nov 5 • 47
OpenVINO/starcoder2-3b-fp16-ov

Text Generation • Updated Nov 5 • 42
OpenVINO/starcoder2-3b-int8-ov

Text Generation • Updated Nov 5 • 45
OpenVINO/Phi-3-mini-4k-instruct-fp16-ov

Text Generation • Updated 26 days ago • 280 • 2
OpenVINO/Phi-3-mini-128k-instruct-fp16-ov

Text Generation • Updated Nov 5 • 197
OpenVINO/Phi-3-mini-128k-instruct-int4-ov

Text Generation • Updated Oct 31 • 370 • 2
OpenVINO/Phi-3-mini-4k-instruct-int4-ov

Text Generation • Updated 26 days ago • 5.68k
OpenVINO/Phi-3-mini-4k-instruct-int8-ov

Text Generation • Updated Nov 5 • 23
OpenVINO/Phi-3-mini-128k-instruct-int8-ov

Text Generation • Updated Nov 5 • 536 • 2
OpenVINO/open_llama_3b_v2-int4-ov

Text Generation • Updated Nov 5 • 38
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-fp16-ov

Updated Nov 5 • 13
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int4-ov

Updated Nov 5 • 11
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int8-ov

Updated Nov 5 • 6
OpenVINO/gemma-2b-it-fp16-ov

Updated Nov 20 • 30
OpenVINO/gemma-2b-it-int8-ov

Updated 26 days ago • 19
OpenVINO/gemma-2b-fp16-ov

Updated Nov 20 • 18
OpenVINO/gemma-2b-int4-ov

Updated Nov 20 • 33
OpenVINO/gemma-2b-it-int4-ov

Updated 26 days ago • 20
OpenVINO/gemma-7b-fp16-ov

Updated Nov 5 • 15
OpenVINO/gemma-7b-int4-ov

Updated Nov 5 • 10
OpenVINO/gemma-7b-int8-ov

Updated Nov 5 • 104
OpenVINO/gemma-7b-it-int8-ov

Updated Nov 5 • 10
OpenVINO/gemma-7b-it-fp16-ov

Updated Nov 5 • 11
OpenVINO/gemma-7b-it-int4-ov

Updated Nov 5 • 13
OpenVINO/bloomz-1b1-fp16-ov

Updated Nov 5 • 11
OpenVINO/bloomz-1b1-int4-ov

Updated Nov 5 • 7
OpenVINO/bloomz-3b-int8-ov

Updated Nov 5 • 11
OpenVINO/bloomz-1b1-int8-ov

Updated Nov 5 • 7
OpenVINO/bloomz-3b-int4-ov

Updated Nov 5 • 6
OpenVINO/bloomz-3b-fp16-ov

Updated Nov 5 • 14
OpenVINO/codegen-2B-multi-int8-ov

Updated Nov 5 • 5
OpenVINO/codegen-2B-multi-fp16-ov

Updated Nov 5 • 12
OpenVINO/codegen-2B-multi-int4-ov

Updated Nov 5 • 5
OpenVINO/codegen-6B-multi-int4-ov

Updated Nov 5 • 6
OpenVINO/codegen-6B-multi-fp16-ov

Updated Nov 5 • 15
OpenVINO/codegen-6B-multi-int8-ov

Updated Nov 5 • 8
OpenVINO/Phi-3.5-mini-instruct-fp16-ov

Updated 26 days ago • 272
OpenVINO/Phi-3.5-mini-instruct-int8-ov

Updated 26 days ago • 227
OpenVINO/Phi-3.5-mini-instruct-int4-ov

Updated 26 days ago • 58 • 3
OpenVINO/gemma-2-9b-it-int4-ov

Updated 26 days ago • 31
OpenVINO/gemma-2-9b-it-int8-ov

Updated 26 days ago • 52
OpenVINO/gemma-2-9b-it-fp16-ov

Updated 26 days ago • 16

Collection guide
Browse collections

Company

TOS Privacy About Jobs

Website

Models Datasets Spaces Pricing Docs