Method Lora(16 bit) Epochs 2 Batch size 8 Grad Accum 1 Learning rate 0.0001 Optimizer AdamW 8-bit Context length 2048 Warmup steps 2 Packing False weight decay 0.001 seed 3407

LoRA Rank 8 Alpha 16 Dropout 0.05 Variant lora

Uploaded finetuned model

  • Developed by: ChesterProgrammer
  • License: apache-2.0
  • Finetuned from model : DreamFast/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-Safetensor-Benchmark

This qwen3_5 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
44
Safetensors
Model size
9B params
Tensor type
F32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ChesterProgrammer/Custom-Finetuned-Test