File size: 757 Bytes
cfe3d0f
 
 
 
2dcad71
cfe3d0f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---
base_model: meta-llama/Meta-Llama-3-8B-Instruct
license: other
license_name: llama3
license_link: https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/raw/main/LICENSE
inference: false
model_creator: Meta
model_name: Meta-Llama-3-8B-Instruct
quantized_by: Leliuga
pipeline_tag: text-generation
tags:
- llama
- llama-3
---
# Meta-Llama-3-8B-Instruct - bnb 4bit
- Model creator: [Meta](https://huggingface.co/meta-llama)
- Original model: [Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)

## Description

This model is 4bit quantized version of [Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) using bitsandbytes. It's designed for fine-tuning! The PAD token is set as UNK.