Sign-SPIN Gemma2-2B (tau=0.1)

CLL Sign-SPIN (no PairRM). Frozen SFT scorer. S(y')=mean(log p + H) with tau=0.1, clip_bound=5.0, score_agg=mean.

Init: local SFT gemma2_2b_sft_ultrachat200k_20260820_043159/final.

Locked recipe: batch=2, grad_accum=2, lr 5e-7 ite0–1 then 1e-7 ite2–3, beta=0.1, alpha=1.0, n_epochs=2, warmup_ratio=0.1, max_length=1024, prompt 512, 4 iters (ite0..ite3).

Status (2026-09-18): ite0 finished. ite1 in progress: ite1/LATEST at example_counter=128000 of ~199132 (disk full on the 130000 save).

Duplicate LATEST/ snapshots of already-finished iterations are omitted (identical to the iteration root weights).

from transformers import AutoModelForCausalLM
m = AutoModelForCausalLM.from_pretrained("HoangTran223/SignSPIN_Gamma2-2B_0.1", subfolder="ite1/LATEST")

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for HoangTran223/SignSPIN_Gamma2-2B_0.1

Base model

google/gemma-2-2b

Finetuned

(566)

this model