OpenVINO IR model with int8 quantization

by fakezeta - opened May 2

May 2

Hi, I've converted you model to OpenVINO IR format.
Template to use it on LocalAI are added to the README.md file.

NousResearch org May 15

is there instructions on how to configure function calling for Heremes-2-Pro with LocalAI?

May 15

Support for function calling on transformers Is in this PR with example instruction.

I still haven't had the chance to test it: will report here as soon as possible.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment