New NVIDIA models (nvidia/Llama3-70B-SteerLM-Chat, nvidia/Llama3-70B-PPO-Chat, nvidia/Llama3-70B-DPO-Chat )
#98
by
AuriAetherwiing
- opened
Hello! NVIDIA released a bunch of interesting models. I would love to see quants of them
https://huggingface.co/nvidia/Llama3-70B-DPO-Chat
https://huggingface.co/nvidia/Llama3-70B-SteerLM-Chat
https://huggingface.co/nvidia/Llama3-70B-PPO-Chat
Unfortunately, they are all in nvidias proprietary nemo framework format, and as such not supported by llama.cpp. With "open" you mean "vendor lock-in", right? :)
If somebody converts this to transformers format, or support is added in llama.cpp, I am fair game to quantize these, of course :)
mradermacher
changed discussion status to
closed