Is there any way to convert to onnx??

#11
by szcjoker - opened

Hi, thanks you guys made this repository. fantastic!!!

As this title,
is there any way to convert to onnx,I tried many way, like from safe tensors to pytroch,but can't merge multiple file,then I tried optimum still not work. Try do some local experiment and dev, need onnx format, any path or solution I can try?

Thanks again.

Good day

Hi @szcjoker ,
For converting models to ONNX, you can check out the repository EmbeddedLLM/openchat-3.6-8b-20240522-onnx.
This repository provides a pre-converted ONNX model, and it includes versions optimized for both CPU and DirectML, which might be exactly what you need for your local experiments and development.

Sign up or log in to comment