Learn1 Model

LoRA fine-tuned model created using the iajitpanday/learn1 dataset.

Model Information

  • Model repository: iajitpanday/learn1-model
  • Base model: Qwen/Qwen2.5-0.5B-Instruct
  • Task: Causal Language Modeling
  • Fine-tuning method: LoRA
  • Dataset: iajitpanday/learn1

Dataset

  • Total examples: 2041
  • Training examples: 1836
  • Validation examples: 205

LoRA Configuration

  • Rank (r): 16
  • LoRA alpha: 32
  • LoRA dropout: 0.05
  • Bias: none

LoRA Target Modules

  • q_proj
  • k_proj
  • v_proj
  • o_proj
  • gate_proj
  • up_proj
  • down_proj

Training Configuration

  • Epochs: 3
  • Training batch size: 2
  • Gradient accumulation steps: 4
  • Learning rate: 2e-4
  • Maximum sequence length: 1024
  • FP16: True
  • Seed: 42

Training Environment

  • GPU: Kaggle Tesla T4
  • PyTorch: 2.10.0+cpu
  • Transformers: 5.0.0

Training Format

Instruction:

instruction

Input:

input

Response:

output

Important

This repository contains the LoRA adapter.

The base model is:

Qwen/Qwen2.5-0.5B-Instruct

Load the base model first and then load this repository as a PEFT/LoRA adapter.

Updated: 2026-10-02

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for iajitpanday/learn1-model

Adapter
(855)
this model