File size: 1,089 Bytes
7d46e5e 0ca742f c7a9640 0ca742f 8bfce58 42584f8 2e195b5 42584f8 1834a84 610d17d 1834a84 230f751 610d17d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
---
license: cc-by-nc-4.0
---
### TeeZee/Bielik-SOLAR-LIKE-10.7B-Instruct-v0.1 ###
Precise recipe used by Upstage to create [SOLAR](https://huggingface.co/upstage/SOLAR-10.7B-v1.0) was applied to https://huggingface.co/speakleash/Bielik-7B-Instruct-v0.1
*(just merge, no finetuning)
### Results ###
- model is still coherent in Polish language, even without finetuning after merge
- instruct mode works in ooba without issues
- model is censored and aligned
- seems that this model scores highest amongst all versions of original Bielik models, further finetunig should improve results even more.
- on dedicated to Polish speaking LLM leaderboards, its 2nd, just behind instruct version used for this merge, and thats to be expected when applying DUS merge - very small quality loss.
[Polish LLMs leaderboards](https://huggingface.co/spaces/speakleash/open_pl_llm_leaderboard)
- overall it seems like a good base for further finetunig in Polish language.
|