4BeastsOfApocalypse (35B-A3B Agentic Coder)

4BeastsOfApocalypse is a 4-way Hierarchical SLERP merge of four 35B Mixture-of-Experts (MoE) models, calibrated for autonomous SWE agentic coding, terminal tool use, and complex software refactoring.

Model Blend & Weights

Model	Blend Weight	Specialized Capability
Kwaipilot/KAT-Coder-V2.5-Dev	33%	Autonomous SWE agent, terminal bash execution, multi-file refactoring
Jackrong/Qwopus3.6-35B-A3B-Coder	27%	High-depth algorithmic code synthesis, mathematical precision
Qwen/Qwen-AgentWorld-35B-A3B	22%	Environment interaction, multi-turn tool calling, error self-correction
ornith-ai/Ornith-1.5-35B-A3B	18%	Long-context coherence, logical planning, dialogue adherence

Architecture

• Backbone: Pure Text/Code Sparse MoE (40 layers, 256 routed experts + 1 shared expert).
• Active Parameters: 3B active per token (35B total).
• Attention: Hybrid GatedDeltaNet linear recurrence with periodic standard attention.
• Pure Backbone: Vision and MTP heads have been stripped to ensure maximum text-code density and clean inference.