Hugging Face's logo

leliuga
/
Phi-3-mini-128k-instruct-bnb-4bit

Text Generation
Transformers
Safetensors
phi3
Phi-3-mini-128k-instruct
conversational
custom_code
text-generation-inference
4-bit precision
bitsandbytes
Model card Files Community
1
Edit model card

Phi-3-mini-128k-instruct - bnb 4bit

Description

This model is 4bit quantized version of Phi-3-mini-128k-instruct using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "<|endoftext|>".

Downloads last month
15
Safetensors
Model size
2.07B params
Tensor type
F32
·
BF16
·
U8
·
Inference Examples
Text Generation
Inference API (serverless) has been turned off for this model.

Model tree for leliuga/Phi-3-mini-128k-instruct-bnb-4bit

Base model

microsoft/Phi-3-mini-128k-instruct
Quantized
(52)
this model

Collection including leliuga/Phi-3-mini-128k-instruct-bnb-4bit