NPU LLM - a EmbeddedLLM Collection

EmbeddedLLM 's Collections

Onnxruntime DirectML GenAI

Onnxruntime CPU GenAI

NPU LLM

OpenVINO Model Server (OVMS)

NPU LLM

updated Sep 3, 2024

microsoft/Phi-3-mini-4k-instruct

Text Generation • Updated Sep 20, 2024 • 910k • • 1.15k
microsoft/Phi-3-mini-128k-instruct

Text Generation • Updated 9 days ago • 110k • • 1.64k
microsoft/Phi-3-medium-4k-instruct

Text Generation • Updated Aug 20, 2024 • 31.7k • 217
microsoft/Phi-3-medium-128k-instruct

Text Generation • Updated Aug 20, 2024 • 16.5k • • 381