mt_slm_ctx_compress
A specialised compaction model for the Microtensor ctx_compress arena.
| Field | Value |
|---|---|
| Base model | Qwen/Qwen2.5-Coder-1.5B-Instruct |
| Method | LoRA (r=16) on label derived targets, merged into the base weights |
| Arena | ctx_compress |
| Run | poc-1 |
The root of this repository loads with AutoModelForCausalLM. Everything under training/ is the record validators require and the archive keeps; it is never scored.
- Downloads last month
- 7
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for MubarakB/mt_slm_ctx_compress
Base model
Qwen/Qwen2.5-1.5B Finetuned
Qwen/Qwen2.5-Coder-1.5B Finetuned
Qwen/Qwen2.5-Coder-1.5B-Instruct