Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

8-bit precision

4-bit precision

text-generation-inference

text-embeddings-inference

Misc with no match

Carbon Emissions

Mixture of Experts

Models

92

Full-text search

Active filters: nncf

anokimchen/sd-turbo-openvino-8bit-no-calibration

Text-to-Image • Updated Aug 7 • 1

anokimchen/sd-turbo-openvino-8bit-GPT4vision-calibrated

Text-to-Image • Updated Aug 7 • 1

NikolayKozloff/MKLLM-7B-Instruct-openvino-4bit

Updated 14 days ago • 6 • 1

NikolayKozloff/MKLLM-7B-Instruct-openvino-8bit

Updated 14 days ago • 4 • 1

echarlaix/distilbert-base-uncased-distilled-squad-openvino-8bit

Question Answering • Updated Jul 31 • 16

emmacall/Phi-3-mini-4k-instruct-openvino-4bit

Text Generation • Updated Aug 15 • 16

riacheruvu/Qwen2-7B-Instruct-openvino-4bit

Text Generation • Updated Aug 8 • 16

riacheruvu/Qwen2-7B-Instruct-openvino-8bit

Text Generation • Updated Aug 8 • 13

fiorezhang/Qwen2-7B-Instruct-openvino-4bit

Text Generation • Updated Aug 14 • 19

malcolmchan/Phi-3-mini-4k-instruct-openvino-8bit

Text Generation • Updated Aug 14 • 21

emmacall/Phi-3-medium-4k-instruct-openvino-4bit

Text Generation • Updated Aug 15 • 19

elucidator8918/Lynx-8B-Instruct-4bit

Text Generation • Updated Aug 16 • 12

AlexKoff88/Phi-3-mini-4k-instruct-openvino-4bit

Text Generation • Updated Sep 3 • 24

AlexKoff88/Phi-3-mini-4k-instruct-openvino-8bit

Text Generation • Updated Sep 3 • 16

yujiepan/llama-2-tiny-3layers-random-openvino-8bit

Text Generation • Updated Sep 4 • 8

yujiepan/mixtral-8xtiny-random-openvino-8bit

Text Generation • Updated Sep 4 • 82

FM-1976/stablelm-zephyr-3b-openvino-4bit

Updated Oct 6 • 15

riacheruvu/phi-2-openvino-8bit

Text Generation • Updated Oct 7 • 11

chgk13/Qwen2-0.5B-openvino-8bit

Text Generation • Updated Oct 14 • 15

AlexKoff88/TinyLlama-1.1B-Chat-v1.0-openvino-4bit

Updated Oct 17 • 2

AlexKoff88/opt-125m-openvino-4bit

Text Generation • Updated Oct 17 • 9

AlexKoff88/Phi-3.5-mini-instruct-openvino-fp16

Text Generation • Updated 14 days ago • 25

AlexKoff88/Phi-3.5-mini-instruct-openvino-4bit

Text Generation • Updated 14 days ago • 26

AlexKoff88/Phi-3.5-mini-instruct-openvino-8bit

Text Generation • Updated 14 days ago • 13

AIFunOver/Phi-3.5-mini-instruct-openvino-fp16

Text Generation • Updated 14 days ago • 12

AIFunOver/Phi-3.5-mini-instruct-openvino-4bit

Text Generation • Updated 14 days ago • 14

AIFunOver/SmolLM2-1.7B-Instruct-openvino-8bit

Text Generation • Updated 14 days ago • 11

AIFunOver/SmolLM2-1.7B-Instruct-openvino-fp16

Text Generation • Updated 14 days ago • 17

AIFunOver/SmolLM2-1.7B-Instruct-openvino-4bit

Text Generation • Updated 14 days ago • 15

AIFunOver/SmolLM2-360M-Instruct-openvino-8bit

Text Generation • Updated 14 days ago • 13