Lemonade How to use amd/Phi-3-mini-4k-instruct-awq-g128-int4-asym-fp16-onnx-hybrid with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/
lemonade pull amd/Phi-3-mini-4k-instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Run and chat with the model (requires XDNA 2 NPU)
lemonade run user.Phi-3-mini-4k-instruct-awq-g128-int4-asym-fp16-onnx-hybrid
List all available models
lemonade list
