Configuration Parsing Warning:Invalid JSON for config file config.json

mambarl-m1-sft

A checkpoint from MambaRL: does outcome-only RL extend the effective context-retrieval horizon of a pure Mamba-2 LM, without changing the architecture? No attention is added and the recurrent state is not grown — only what the policy learns to keep in it changes.

Base model: AntonV/mamba2-2.7b-hf
LoRA adapter merged in from checkpoints/M1_sft (targets: in_proj only — PEFT refuses out_proj/conv1d on mamba2 because the fused kernels read those weights directly)
Weights here are merged, so AutoModelForCausalLM.from_pretrained is enough.

Phase 1 (proposal 2.4): generic CoT LoRA SFT on Bespoke-Stratos-17k.

Answers follow a <think>...</think><answer>...</answer> contract.

Downloads last month: 13

Safetensors

Model size

3B params

Tensor type

BF16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Lixing-Li/mambarl-m1-sft

Base model

AntonV/mamba2-2.7b-hf

Adapter

(4)

this model