bangla-llama-4bit / README.md
asif00's picture
Update README.md
26afe6e verified
|
raw
history blame
581 Bytes
metadata
language:
  - bn
license: apache-2.0
tags:
  - transformers
  - llama
  - trl
  - sft
base_model: unsloth/llama-3-8b-bnb-4bit
library_name: transformers
pipeline_tag: question-answering

How to use it:

Use a pipeline as a high-level helper

from transformers import pipeline

pipe = pipeline("question-answering", model="asif00/bangla-llama-4bit")

Copy

Load model directly

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("asif00/bangla-llama-4bit") model = AutoModelForCausalLM.from_pretrained("asif00/bangla-llama-4bit")