README.md

---
base_model: meta-llama/Llama-2-7b-hf
license: apache-2.0
inference: false
model_creator: Meta
model_name: Llama-2-7b-hf
quantized_by: Leliuga
pipeline_tag: text-generation
tags:
- llama-2
- arxiv:2307.09288
- arxiv:1910.09700
---
# Llama-2-7b-hf - bnb 4bit
- Model creator: [Meta](https://huggingface.co/meta-llama)
- Original model: [Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf)

## Description

This model is 4bit quantized version of [Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) using bitsandbytes. It's designed for fine-tuning! The PAD token is set as UNK.