ISOM-R1-Reasoning-1.5B-Instruct: 32K System-2 Deliberation Foundation

Bounded-State Recurrent Manifold โ€ข Verified on NVIDIA Tesla T4 Cloud GPU โ€ข Authentic Literature Long-Context Benchmark

DOI LinkedIn Base Context Tesla T4 Space


Overview

ISOM-R1-Reasoning-1.5B-Instruct is a 1.54-billion parameter reasoning model tailored for extended System-2 multi-step deliberation without the memory explosion typical of standard Transformer architectures. At 8K-32K context, standard attention mechanisms allocate gigabytes of memory for key-value caches, triggering CUDA OutOfMemoryError on 15GB GPUs. ISOM applies recurrent state manifold projection, keeping working memory bounded.


Model Primary Architecture Role Base Lineage (Independent Derivative) Total / Active Parameters Max Context Cache Complexity Hardware Target
ISOM-R1-Coder-16B-MoE 160K Bounded Code & MLA MoE DeepSeek-Coder-V2-Lite (Non-Endorsed) 15.71B / 2.36B Active 163,840 (160K) O(1) Bounded Manifold (Architectural Spec) 16GB Cloud / Multi-GPU
ISOM-R1-Enterprise-40B 40B System-2 Foundation Reasoning Falcon-40B (Non-Endorsed) 40.0B Dense 32,768 (32K) O(1) Bounded State (Architectural Spec) Enterprise Multi-GPU (24GB-80GB)
ISOM-R1-Coder-1.5B-Instruct 128K Repository Code Intelligence Qwen2.5-Coder-1.5B-Instruct (Non-Endorsed) 1.54B Dense 131,072 (128K) O(1) Bounded State (Tesla T4 Verified) 8GB Developer Laptops / Edge
ISOM-R1-Reasoning-1.5B-Instruct 32K System-2 Mathematical Deliberation Qwen2.5-1.5B-Instruct (Non-Endorsed) 1.54B Dense 32,768 (32K) O(1) Bounded State (Tesla T4 Verified) 8GB Edge / Consumer GPUs
ISOM-R1-Edge-130M-MoE Unbounded Recurrent Drafter & SSM Standalone Continuous SSM + MoE 134.89M / 58.27M Active Unbounded Recurrence O(1) Recurrent State (0.0469 MB Verified) Ultra-Low Power Edge & CPU

๐Ÿ“Š Audited Empirical Hardware Telemetry (NVIDIA Tesla T4, Kaggle Cloud)

The following benchmark was executed on NVIDIA Tesla T4 (14.56 GB / 14,911.7 MB total VRAM, PyTorch 2.10.0+cu128, CUDA 12.8, Kaggle Cloud) directly comparing Prannesshkva/ISOM-R1-Reasoning-1.5B-Instruct against baseline Qwen/Qwen2-1.5B-Instruct using authentic literary prose (Pride and Prejudice, 728,846 characters, unpadded):

Authentic Literature Long-Context A/B Comparison

Context Length Vanilla Baseline Peak VRAM Vanilla Latency Vanilla Status ISOM Peak VRAM ISOM Allocated Memory ISOM Latency ISOM Status
2,048 tokens 9,140.2 MB 0.72s SUCCESS 9,168.6 MB 8,684.3 MB 0.76s SUCCESS
4,096 tokens 10,619.9 MB 2.09s SUCCESS 9,168.6 MB 8,702.2 MB 1.12s SUCCESS (ISOM 1.9x faster)
8,192 tokens 14,911.7 MB None FAILED (CUDA OOM) 9,168.6 MB 8,814.1 MB 2.20s SUCCESS (Within VRAM)

Key Hardware Findings:

  1. Immediate Memory Wall Crash in Vanilla: Standard attention triggers a fatal CUDA OutOfMemoryError at 8,192 tokens of continuous reasoning, exceeding the 14.9 GB VRAM ceiling of the Tesla T4.
  2. Bounded Execution: ISOM successfully deliberates across 8,192 tokens in 2.20 seconds within a stable 9,168.6 MB footprint.
  3. Throughput Scaling: At 4,096 tokens, ISOM executes in 1.12 seconds versus 2.09 seconds for the baseline (nearly 2x faster).

Quickstart Inference

from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

model_id = "Prannesshkva/ISOM-R1-Reasoning-1.5B-Instruct"

tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.float16,
    device_map="auto",
    trust_remote_code=True
)
model.eval()

prompt = """<|im_start|>user
Let G be a finite group with |G| = 35. Prove that G is cyclic.<|im_end|>
<|im_start|>assistant
<thought>
"""

inputs = tokenizer(prompt, return_tensors="pt").to("cuda")

with torch.no_grad():
    outputs = model.generate(
        **inputs,
        max_new_tokens=512,
        temperature=0.6,
        do_sample=True
    )

print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))

Citation & Licensing

@article{prannessh2026isom_reasoning,
  title={ISOM-R1-Reasoning-1.5B-Instruct: Bounded-Memory Deliberative Reasoning Engine},
  author={Prannessh K.V.A.},
  journal={CERN Zenodo},
  year={2026},
  doi={10.5281/zenodo.22649142},
  url={https://doi.org/10.5281/zenodo.22649142}
}
  • Author & Architect: Prannessh K.V.A.
  • LinkedIn: Prannessh K.V.A.
  • License: Governed by CC BY-NC-ND 4.0 (Non-Commercial Research) & Enterprise Commercial Terms. See LICENSE.


Notice of Non-Endorsement & Independent Lineage

Independent Derivative Work: ISOM-R1-Reasoning-1.5B-Instruct is an independent development engineered solely by Prannessh K.V.A. (Author & Architect). It builds upon Qwen/Qwen2.5-1.5B-Instruct under the Apache 2.0 License. This research is not affiliated with, endorsed by, or sponsored by Alibaba Cloud or the Qwen team. All continuous isometric state operator manifolds, Cayley SO(d) projection operators, and memory-bounding integrations are proprietary contributions of the author.

Downloads last month
1,962
Safetensors
Model size
2B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Prannesshkva/ISOM-R1-Reasoning-1.5B-Instruct

Finetuned
(1820)
this model

Space using Prannesshkva/ISOM-R1-Reasoning-1.5B-Instruct 1