phi-2-bnb-4bit / README.md
evaldas-leliuga's picture
Added model
e308a25 verified
metadata
base_model: microsoft/phi-2
license: mit
inference: false
model_creator: Microsoft
model_name: phi-2
quantized_by: Leliuga
pipeline_tag: text-generation
tags:
  - phi-2
  - arxiv:1910.09700

phi-2 - bnb 4bit

Description

This model is 4bit quantized version of phi-2 using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "<|endoftext|>".