amd/Qwen1.5-7B-Chat-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation
•
Updated
•
14
Quark Quantized ONNX LLMs for Ryzen AI 1.3 EA
ONNX Runtime generate() API based models quantized by Quark and optimized for Ryzen AI Strix Point NPU
-
-
amd/Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Updated • 16 -
amd/Llama-2-7b-hf-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 23 -
amd/Meta-Llama-3-8B-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 16 • 1 -
amd/Llama2-7b-chat-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 20 -
amd/Llama-3.1-8B-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 52 • 1 -
amd/Phi-3.5-mini-instruct-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 274 • 1 -
amd/Phi-3-mini-4k-instruct-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 28 • 1