deeprs โ€” LoRA adapters

Every adapter trained for Amplification without Acquisition: what reinforcement learning buys when training a language model to analyse scientific data, and which capability the training spends.

All adapters are LoRA on Qwen/Qwen3-8B unless the name says 14b.

The headline model

tenrl-step150-lora scores 0.994 across all ten public GeneBench-Pro problems โ€” 8 of 10 at exactly 1.000 over 256 rollouts each โ€” where the same base model untrained scores 0.014, and the best published frontier system reaches 36% on that split.

adapter what it is
qwen3-8b-tenfam-lora ten-family SFT, the base of the headline
qwen3-8b-tenfam2-lora independent second seed (0.963 vs 0.959)
tenrl-step150-lora +RL, the 0.994 model
qwen3-8b-lofov-*-lora leave-one-family-out, for the transfer nulls
qwen3-8b-wrangle-*, plainqa-*, causalonly-* the four control corpora
qwen3-8b-*-s2/-s3/... replicate seeds for the variance table

Why all 120 are here

The paper's load-bearing claims are comparisons. The transfer result is that every leave-one-out model scores below the untrained base; the forgetting result compares four corpora; the stability result is that identical corpora give 0.029 or 0.341 depending only on seed. Verifying any of those needs the specific adapter for that arm, so publishing only the winner would leave every negative result unverifiable.

Reproducing

Code, paper draft, and a results index that recomputes every published number: https://github.com/fatebreaker/deeprs โ€” start at CONTINUITY.md.

The problem instances these were trained on are in a separate, access-gated dataset repository; note that re-running the generators does not reproduce them, as the generators were edited after the corpora were built.

Downloads last month
-
Video Preview
loading

Model tree for hieutran81/deeprs-adapters

Finetuned
Qwen/Qwen3-8B
Adapter
(2050)
this model