πŸš€ J.A.R.V.I.S. TITAN 14.8B MoE β€” MILESTONE M2 (PHASE 2) TRI-BRID ADAPTER

Official Milestone M2 (Phase 2) weights for the J.A.R.V.I.S. Titan 14.8B DeepSeekMoE + Tri-Brid Memory Architecture, trained natively on Google Cloud TPU v5e-8 using Google Pallas TPU on-chip VMEM kernels.

πŸ›οΈ Tri-Brid Architecture Overview

J.A.R.V.I.S. Titan M2 integrates a 3-tier memory hierarchy across 7 strategic layers ([3, 7, 11, 15, 19, 23, 27]):

  1. Tier 1: Sliding Window Attention (SWA) β€” Standard local attention ($W = 4096$) capturing immediate syntactic and discourse flow.
  2. Tier 2: Salient Exact KV Reservoir ($K_{\text{res}} = 1024$) β€” Verbatim exact key-value buffer preserving past entities, UUIDs, code definitions, and needles.
  3. Tier 3: Titans Neural Long-Term Memory ($d_{\text{mem}} = 3584$) β€” Associative fast-weight neural memory updating via test-time gradient momentum ($\mu = 0.95$, adaptive decay $lpha_t$).
  4. MAG-3 (Memory-Augmented Gating) β€” Adaptive dynamic softmax gating routing forward representations: $$\mathbf{y}t = g{\text{local}} \cdot \text{Attn}(\mathbf{x}t) + g{\text{res}} \cdot \text{Reservoir}(\mathbf{x}t) + g{\text{mem}} \cdot \text{Titans}(\mathbf{x}_t)$$

πŸ“Š Evaluation Matrix (Milestone M2 Certified)

Evaluation Track Context Accuracy / Score Perplexity ($PPL$) Base MoE Baseline
Track 1: Olympiad Math Proofs 1K 100.0% Passed 21.39 40.5
Track 1: Agentic Tool Loops 2K 94.1% Passed 21.65 81.4
Track 1: DeepSeek-R1 Long CoT 4K 100.0% Passed 22.17 345.1
Track 1: Neural Codebase Architecture 8K 62.7% Passed 23.20 6,868.0
Track 1: Repo-Scale RoPE Tracing 16K 100.0% Passed 25.32 3.3M (Collapsed)
Track 1: Scientific Paper Synthesis 32K 100.0% Passed 29.99 485M (Collapsed)
Track 2: Exact Verbatim Retrieval 4K–32K 100.0% Recall β€” 0.0%
Track 3: Multi-Needle Distractor Recall 4K–32K 100.0% Recall β€” 0.0%

πŸ“¦ Model Files

  • jarvis_titan_m2_tribrid_adapter.safetensors: 90.04M parameters across 7 layers (171.76 MB, 105 tensors).
  • adapter_config.json: Hardware-native hyperparameters and layer routing mappings.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for dhanesh-hf/Jarvis-Titan-M2-TriBrid-Adapter

Finetuned
(3)
this model