This is amazing model! When is the full release?
I tested this in Russian and it's awesome! It is probably best open source model for Russian language. I'm really looking forward to the full release and send my warmest thanks to the authors🤗
Thanks! Will be releasing in the next week or two.
Also, will be releasing a paper detailing how we made it too.
Finally, this was only DPO'd on less than 100 examples per language (so less than 100 examples of Russian). We're working on a dataset that will 10x this!
Stay tuned :)
Thank you for your reply! Sounds promising, I will be waiting for the full release.
Thanks! Will be releasing in the next week or two.
Also, will be releasing a paper detailing how we made it too.Finally, this was only DPO'd on less than 100 examples per language (so less than 100 examples of Russian). We're working on a dataset that will 10x this!
Stay tuned :)
Hi. Can you also increase the length of the context window?