Edit model card

Bielik-7B-Instruct-v0.1-GPTQ

This repo contains GPTQ format model files for SpeakLeash's Bielik-7B-Instruct-v0.1.

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Simple Colab notebook for testing: https://colab.research.google.com/drive/1Al9glPVCuOXbtDsks8cMcuzkuu8YDzpg?usp=sharing

Model description:

  • Developed by: SpeakLeash
  • Language: Polish
  • Model type: causal decoder-only
  • Quant from: Bielik-7B-Instruct-v0.1
  • Finetuned from: Bielik-7B-v0.1
  • License: CC BY NC 4.0 (non-commercial use)
  • Model ref: speakleash:e38140bea0d48f1218540800bbc67e89

Contact Us

If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.

Downloads last month
5,934
Safetensors
Model size
1.2B params
Tensor type
I32
·
FP16
·
Inference API
Input a message to start chatting with speakleash/Bielik-7B-Instruct-v0.1-GPTQ.
Inference API (serverless) has been turned off for this model.