RichardErkhov/GAI-LLM_-_Llama-3-8B_classification-4bits

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Llama-3-8B_classification - bnb 4bits

• Model creator: https://huggingface.co/GAI-LLM/
• Original model: https://huggingface.co/GAI-LLM/Llama-3-8B_classification/

Original model description:

license: cc-by-nc-4.0 language: - ko library_name: transformers pipeline_tag: text-generation

The license is cc-by-nc-4.0.

GAI-LLM/Llama-3-8B_classification

Model Details

Model Developers Donghoon Oh, Hanmin Myung, SuKyung Park (SK C&C G.AI Eng)

Input Models input text only.

Output Models generate text only.

Model Architecture
GAI-LLM/Llama-3-8B_classification is an auto-regressive language model based on the LLaMA2 transformer architecture.

Base Model [meta-llama/Meta-Llama-3-8B]

Training Dataset

• We combined Open Korean Dateset using mixed-strategy
• We use A100 GPU 80GB * 8, when training.

Model Benchmark

Implementation Code

### GAI-LLM/Llama-3-8B_classification
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

repo = "GAI-LLM/Llama-3-8B_classification"
model = AutoModelForCausalLM.from_pretrained(
        repo,
        return_dict=True,
        torch_dtype=torch.float16,
        device_map='auto'
)
tokenizer = AutoTokenizer.from_pretrained(repo)