Gemma-3-1B-IT — Knights-and-Knaves BES

Paper Link: https://arxiv.org/abs/2605.28814

Post-trained model on top of Xkev/gemma-3-1b-it-kk using Bidirectional Evolutionary Search (BES) on the Knights-and-Knaves (K&K) logic-puzzle dataset.

For the SFT cold-start this was initialized from, see Xkev/gemma-3-1b-it-kk.

Training

  • Base model: Xkev/gemma-3-1b-it-kk
  • Dataset: K&K 5k train split
  • Framework: verl main_ppo with a bidirectional goal-tree search agent loop
  • Search: budget=200 rollouts, decompose interval=10, backward model google/gemma-3-1b-it
  • Hyperparameters: lr=1e-6, batch=32, ppo_epochs=1, clip_ratio=0.2, grad_clip=0.3, kl_coef=0, dtype=bf16

Intended use

Research on logical reasoning and post-training. Not intended for general dialog or production.

License

MIT. Base model google/gemma-3-1b-it is governed by Google's Gemma Terms of Use, which still apply transitively to this model.

Downloads last month
19
Safetensors
Model size
1B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Xkev/gemma-3-1b-it-kk-bes

Finetuned
(1)
this model

Dataset used to train Xkev/gemma-3-1b-it-kk-bes

Collection including Xkev/gemma-3-1b-it-kk-bes

Paper for Xkev/gemma-3-1b-it-kk-bes