gguf
#1
by
Aryanne
- opened
any prevision when there will be gguf support ?
Not sure yet - I think we should be able to release vllm support sometime soon, and we will engage with the community to get support added for other inference engines.
SmerkyG
changed discussion status to
closed