Qwen2.5 PySpark Code Repair

Fine-tuned Qwen2.5-3B-Instruct to repair buggy Databricks PySpark code.

Training Configuration

  • Base model: Qwen/Qwen2.5-3B-Instruct
  • Precision: 4-bit QLoRA
  • LoRA rank: 16, alpha: 32
  • Learning rate: 2e-4
  • Epochs: 1
  • Batch size: 2 (gradient accumulation: 2)
  • Max sequence length: 2048
  • Training samples: 300

Usage

from unsloth import FastLanguageModel

model, tokenizer = FastLanguageModel.from_pretrained(
    model_name="Sivaranjaninit0931/qwen25-pyspark-code-repair",
    max_seq_length=2048,
    load_in_4bit=True,
)

prompt = "Fix this Databricks PySpark Code..."
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(**inputs, max_new_tokens=512)
print(tokenizer.decode(outputs[0]))
Downloads last month
20
GGUF
Model size
3B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support