Edit model card

TeeZee/Bielik-SOLAR-LIKE-10.7B-Instruct-v0.1

Precise recipe used by Upstage to create SOLAR was applied to https://huggingface.co/speakleash/Bielik-7B-Instruct-v0.1 *(just merge, no finetuning)

Results

  • model is still coherent in Polish language, even without finetuning after merge

  • instruct mode works in ooba without issues

  • model is censored and aligned

  • seems that this model scores highest amongst all versions of original Bielik models, further finetunig should improve results even more.

    imgage/png

  • on dedicated to Polish speaking LLM leaderboards, its 2nd, just behind instruct version used for this merge, and thats to be expected when applying DUS merge - very small quality loss.

Polish LLMs leaderboards

  • overall it seems like a good base for further finetunig in Polish language.
Downloads last month
5,223
Safetensors
Model size
10.7B params
Tensor type
BF16
·
Inference API
Input a message to start chatting with TeeZee/Bielik-SOLAR-LIKE-10.7B-Instruct-v0.1.
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.

Collection including TeeZee/Bielik-SOLAR-LIKE-10.7B-Instruct-v0.1