REAX SN92 generalist entry
Decision model for the REAX (SN92) generalist track, served with the validator's fixed prompt and letter readout (softmax at T=2).
Lineage and modifications (Apache-2.0 sec. 4)
Qwen/Qwen3.8-27B -> vllm-sr/d3@cf15549a78fc52598ddd1951f321c58372bbd64f (Apache-2.0, pplx-format decision model) -> rewritten to the joint readout layout (decision_config v2) -> LoRA r32 trained in joint mode (bidirectional full attention, as the REAX validator serves it). Stage 1 (lr 5e-5, 0.5 epoch): public SN92 specialist train rows, public benchmark TRAIN splits and our own written items. Stage 2 (lr 5e-5, 531 steps of 32 rows), continued from stage 1: public SN92 specialist train, factory and dev rows (decisionmodels/sn92-specialists, CC-BY-4.0) plus the same extras. Merged into the backbone; readout rows A..Z retrained and rescaled for the fixed T=2 readout.
Declared base for the track: Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0. Weights only; no code. Licence: Apache-2.0 (see LICENSE).
- Downloads last month
- 19
Model tree for isomsom/sn92-gen-v3
Base model
Qwen/Qwen3.8-27B