Is it possible to convert this to ONNX?
#1
by
PaulTheHuman
- opened
Hi, I wondered if it is at all possible to convert this to ONNX format and run it with something like onnxruntime?
It may be a bit difficult if onnx doesn't support the 4bit operations???
idk, youll get help about converting here https://github.com/nomic-ai/gpt4all