OpenVINO IR model with int8 quantization
#2
by
fakezeta
- opened
Hi, I've converted you model to OpenVINO IR format.
Template to use it on LocalAI are added to the README.md file.
is there instructions on how to configure function calling for Heremes-2-Pro with LocalAI?