Edit model card

Model Card for Falcon-7B-instruct-NF4

Model Details

This model is a NF4 quantized version of the tiiuae/falcon-7b-instruct model.

  • Developed by: Ted Whooley
  • Library: Transformers, NF4
  • Model type: falcon
  • Model name: Falcon-7B-instruct-NF4
  • Pipeline tag: text-generation
  • Qunatized by: twhoool02
  • Language(s) (NLP): en
  • License: other
Downloads last month
0
Safetensors
Model size
3.71B params
Tensor type
F32
FP16
U8

Quantized from