πŸ‡²πŸ‡² Myanmar AI V3

Myanmar AI V3 α€žα€Šα€Ί Qwen2.5-Coder-1.5B base model ပေါ်တွင် LoRA adapter ဖြင့် fine-tune α€œα€―α€•α€Ία€‘α€¬α€Έα€žα€±α€¬ α€™α€Όα€”α€Ία€™α€¬α€˜α€¬α€žα€¬α€…α€€α€¬α€Έα€‘α€α€½α€€α€Ί Language Model α€–α€Όα€…α€Ία€•α€«α€žα€Šα€Ία‹

πŸ“‹ Model Details

Field Details
Model Name amkyawdev/myanmar-ai-v3
Model Type LoRA Adapter (Fine-tuned)
Base Model Qwen/Qwen2.5-Coder-1.5B-Instruct
Language(s) မြန်မာ (Burmese), English
License MIT License
Developer amkyawdev

πŸ”§ Technical Specifications

Specification Value
Architecture Transformer-based Decoder (Causal LM)
Base Model Params 1.5 Billion
LoRA Rank (r) 16
LoRA Alpha 32
LoRA Dropout 0.05
Target Modules q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
Task Type Causal Language Modeling

πŸš€ Quick Start

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

MODEL_NAME = "amkyawdev/myanmar-ai-v3"
BASE_MODEL = "Qwen/Qwen2.5-Coder-1.5B-Instruct"

# Load tokenizer
tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME)

# Load base model
base_model = AutoModelForCausalLM.from_pretrained(
    BASE_MODEL,
    torch_dtype=torch.float16,
    device_map="auto"
)

# Load LoRA adapter
model = PeftModel.from_pretrained(base_model, MODEL_NAME)

# Generate
text = "မြန်မာနိုင်ငဢထကြောင်း ပြောပါ"
inputs = tokenizer(text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

πŸ“Š Training Data

⚠️ Limitations

  • α€™α€Όα€”α€Ία€™α€¬α€˜α€¬α€žα€¬α€…α€€α€¬α€Έα€–α€Όα€„α€·α€Ί conversation α€•α€Όα€―α€œα€―α€•α€Ία€”α€­α€―α€„α€Ία€•α€«α€žα€Šα€Ί
  • English prompts α€™α€»α€¬α€Έα€€α€­α€―α€œα€Šα€Ία€Έ α€”α€¬α€Έα€œα€Šα€Ία€”α€­α€―α€„α€Ία€•α€«α€žα€Šα€Ί
  • Programming/code generation tasks များထတွက် α€‘α€‘α€°α€Έα€žα€„α€·α€Ία€α€±α€¬α€Ία€•α€«α€žα€Šα€Ί (Base model: Qwen2.5-Coder)

πŸ“ž Contact


Made with ❀️ for the Myanmar AI Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ 1 Ask for provider support

Model tree for amkyawdev/myanmar-ai-v3

Adapter
(119)
this model

Dataset used to train amkyawdev/myanmar-ai-v3

Space using amkyawdev/myanmar-ai-v3 1