flwrlabs/code-alpaca-20k
Viewer • Updated • 20k • 694 • 2
How to use 42savage/MEGAN-Coder-7B-LoRA with PEFT:
Task type is invalid.
MEGAN Coder 7B is a QLoRA adapter trained from:
Base model: Qwen/Qwen2.5-Coder-7B-Instruct
Training dataset: flwrlabs/code-alpaca-20k
This repository contains parameter-efficient adapter weights rather than a copy of the full base model.
Stage 1 — coding instruction specialization.
The adapter was trained using 4-bit QLoRA with PEFT.
The exact base model and dataset revisions are recorded in
megan_run_metadata.json.
Load the base model separately and attach the adapter using PEFT.