LLaMA2 34b, or *CodeLLaMA 34b*?
#1
by
CamiloMM
- opened
As far as I'm aware Meta only released a 34b code-focused model of llama2, and fine tunes on it would really struggle with anything other than code tasks.
Unless this is actual 34b and the thing about needing permission to download is because it's non-code 34b?
This one is based on codellama-34b, fine-tuned on generic dialog data.
We also have a version fine-tuned with coding data: openbuddy-coder-34b. However, both models are currently in the early stages of experimentation.