Bielik-7B-Instruct-v0.1-3bit-HQQ
This repo contains HQQ (3-bit) format model files for SpeakLeash's Bielik-7B-Instruct-v0.1.
DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!
Simple Colab notebook for testing: https://colab.research.google.com/drive/1Al9glPVCuOXbtDsks8cMcuzkuu8YDzpg?usp=sharing
Model description:
- Developed by: SpeakLeash
- Language: Polish
- Model type: causal decoder-only
- Quant from: Bielik-7B-Instruct-v0.1
- Finetuned from: Bielik-7B-v0.1
- License: CC BY NC 4.0 (non-commercial use)
- Model ref: speakleash:e38140bea0d48f1218540800bbc67e89
Contact Us
If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.
- Downloads last month
- 5