petkopetkov's picture
Update README.md
f61b874 verified
metadata
base_model: unsloth/Llama-3.2-3B-Instruct
language:
  - en
  - bg
license: apache-2.0
tags:
  - text-generation-inference
  - transformers
  - llama
  - trl
datasets:
  - petkopetkov/oasst1_bg

Llama3.2-3B-Instruct-Bulgarian

  • Developed by: petkopetkov
  • License: apache-2.0
  • Finetuned from model : unsloth/Llama-3.2-3B-Instruct

Llama-3.2-3B-Instruct finetuned on OASST1 dataset translated to Bulgarian language.

Usage

First, install the Transformers library with:

pip install -U transformers

Run with the pipeline API

import torch
from transformers import pipeline

pipe = pipeline(
    "text-generation",
    model="petkopetkov/Llama3.2-3B-Instruct-bg",
    torch_dtype=torch.bfloat16, 
    device_map="auto"
)

prompt = "Колко е 2 + 2?"

print(pipe(prompt)[0]['generated_text'])