NurtureAI

/

neural-chat-7b-v3-16k-GGUF

like 32

Adding config.json to be able to deploy model using vllm.
VLLM doesn't allow to override config.json as of now. It's an open issue https://github.com/vllm-project/vllm/issues/1542 but until it's fixed adding a config.json fixes the issue.