Qwentaur-8B-LoRA-r16

Qwen

socius Paper Parameters LoRA Dataset

Qwentaur-8B-LoRA-r16

LoRA adapter for Qwentaur-8B, fine-tuned on the full Psych-101 as part of the LoRA-rank sweep and dataset-size ablation for Small Foundation Models of Human Cognition and Behaviour.

field value
base model unsloth/Qwen3-8B-Base
LoRA rank 16 (alpha = rank, rsLoRA)
data fraction 100% of Psych-101
training 1 epoch, completion-only loss, seed 3407

Load with PEFT on top of unsloth/Qwen3-8B-Base, or evaluate with the project's eval_model.py --backend unsloth.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for socius/Qwentaur-8B-LoRA-r16

Adapter
(11)
this model

Dataset used to train socius/Qwentaur-8B-LoRA-r16

Collection including socius/Qwentaur-8B-LoRA-r16

Paper for socius/Qwentaur-8B-LoRA-r16