T-SPIN Gemma2-2B (Ultrachat50k)

Repo name uses Gamma2 as requested; the model is Gemma2-2B.

SFT init: HoangTran223/gemma2_2b_sft_ultrachat200k_20260820_043159.

All 4 iterations finished (2 epochs each). LR 5e-7 on ite0–1, 1e-7 on ite2–3. alpha=1.0, beta=0.1 (ite0 used beta=0.0).

Layout:

  • ite0/, ite1/, ite2/, ite3/ finished policies
  • ite0/train.jsonl … ite3/train.jsonl synthetic triplets
  • proto/train.jsonl (y_0)
  • logs/tspin_gemma2.log

Load final policy:

from transformers import AutoModelForCausalLM
m = AutoModelForCausalLM.from_pretrained("HoangTran223/T-SPIN_Gamma2-2B", subfolder="ite3")
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for HoangTran223/T-SPIN_Gamma2-2B

Finetuned
(562)
this model