Edit model card

Bielik-7B-Instruct-v0.1-3bit-HQQ

This repo contains HQQ (3-bit) format model files for SpeakLeash's Bielik-7B-Instruct-v0.1.

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Simple Colab notebook for testing: https://colab.research.google.com/drive/1Al9glPVCuOXbtDsks8cMcuzkuu8YDzpg?usp=sharing

Model description:

  • Developed by: SpeakLeash
  • Language: Polish
  • Model type: causal decoder-only
  • Quant from: Bielik-7B-Instruct-v0.1
  • Finetuned from: Bielik-7B-v0.1
  • License: CC BY NC 4.0 (non-commercial use)
  • Model ref: speakleash:e38140bea0d48f1218540800bbc67e89

Contact Us

If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.

Downloads last month
7
Inference Examples
Inference API (serverless) has been turned off for this model.

Collection including speakleash/Bielik-7B-Instruct-v0.1-3bit-HQQ