Bielik-7B-Instruct-v0.1-EXL2 (5-bit)

This repo contains EXL2 (5-bit) format model files for SpeakLeash's Bielik-7B-Instruct-v0.1.

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Simple Colab notebook for testing: https://colab.research.google.com/drive/1Al9glPVCuOXbtDsks8cMcuzkuu8YDzpg?usp=sharing

Model description:

• Developed by: SpeakLeash
• Language: Polish
• Model type: causal decoder-only
• Quant from: Bielik-7B-Instruct-v0.1
• Finetuned from: Bielik-7B-v0.1
• License: CC BY NC 4.0 (non-commercial use)
• Model ref: speakleash:e38140bea0d48f1218540800bbc67e89

Contact Us

If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.