phi-2-bnb-4bit / README.md
evaldas-leliuga's picture
Added model
e308a25 verified
---
base_model: microsoft/phi-2
license: mit
inference: false
model_creator: Microsoft
model_name: phi-2
quantized_by: Leliuga
pipeline_tag: text-generation
tags:
- phi-2
- arxiv:1910.09700
---
# phi-2 - bnb 4bit
- Model creator: [Microsoft](https://huggingface.co/microsoft)
- Original model: [phi-2](https://huggingface.co/microsoft/phi-2)
## Description
This model is 4bit quantized version of [phi-2](https://huggingface.co/microsoft/phi-2) using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "<|endoftext|>".