sprappcom/oaica-35b-malay-coder-260827

Oaica 35B Malay Coder 260827

Formerly: sprappcom/malay35b-katcoder-dare-pqm

DARE-TIES merge of kat-coder (tool-calling / code-focused) into malay35B (Malay-focused CPT+SFT of Qwen3.6-35B-A3B), exported to .pqm for the prism-engine inference server.

License & attribution

This repository distributes a composite work under a dual arrangement:

• Proprietary layer — © 2026 BCZ Singapore Pte Ltd. All rights reserved. The .pqm container format and packaging, the DARE-TIES merge recipe, the Malay continued-pretrain + SFT recipe, and the prism-engine inference server (Rust/CUDA) are proprietary and are not licensed under Apache-2.0.

• Base model weights — Apache-2.0. The underlying weights are a modified, merged derivative of two Apache-2.0 upstreams:

  Component	Source	Copyright	License	Modification
  Backbone + vision tower	Qwen/Qwen3.6-35B-A3B	© 2026 Alibaba Cloud	Apache-2.0	Malay CPT+SFT base; DARE-TIES-merged; weights repacked to .pqm
  Code / tool-calling donor	Kwaipilot/KAT-Coder-V2.5-Dev	© 2026 Kwaipilot / Kuaishou	Apache-2.0	DARE-TIES-merged (weight 0.5, density 0.5); weights repacked to .pqm

  KAT-Coder-V2.5-Dev (the open Apache-2.0 weights, itself Qwen3.6-35B-A3B-based) — not the separate closed API-only "KAT-Coder" product. These base weights remain licensed under Apache-2.0. The full Apache-2.0 license text and per-component attribution are in the NOTICE file in this repo.

This is not an original, trained-from-scratch foundation model — it is a modified, merged derivative of the Apache-2.0 upstreams named above. Use of the base weights is governed by Apache-2.0; use of the proprietary .pqm packaging, the merge/training recipe, and prism-engine requires a separate license from BCZ Singapore Pte Ltd.

Requirements — read before downloading

• Inference engine: .pqm is a proprietary container, not readable by vLLM, llama.cpp, Ollama, or transformers. Runs only on prism-engine (proprietary Rust/CUDA server, not included in this repo). Contact sprappcom for engine access.
• Tokenizer sidecar: .pqm does not embed a tokenizer. Use the malay35b.tok shipped in this repo via PRISMX_TOKENIZER (identical across all malay35B variants).
• Hardware: A100 (sm_80) / Ada-Ampere (sm_86/sm_89) validated. ~19 GB VRAM full residency, or 8 GB with CPU-RAM expert offload.

Merge details

• Base: malay35B
• Donor: kat-coder
• Method: DARE-TIES (mergekit), weight=0.5, density=0.5, normalized
• Text-only merge (no vision tower)

Architecture

• Qwen3.6-35B-A3B MoE, hidden_size=2048, 40 layers (30 Gated DeltaNet + 10 full attention)
• 256 routed experts + 1 shared expert, top-8 routing
• vocab_size=248077

Quantization

Tensor group	Type
token embedding, attn_qkv/attn_output/attn_gate, routed experts (ffn_*_exps)	Q4_K
shared expert (ffn_*_shexp), output.weight	Q6_K
norms, SSM gates	F32

~4.56 BPW. Container ~39.9 GB (routed experts stored raw for CPU-offload support).

Usage

export PRISMX_PQM_STANDALONE=1
export PRISMX_PQM=/path/to/malay35b-katcoder-dare.pqm
export PRISMX_TOKENIZER=/path/to/malay35b.tok
prism_server 0.0.0.0:8080 --max-batch 1 --max-seq 4096
# 8 GB GPU:
prism_server 0.0.0.0:8080 --n-cpu-moe 38 --moe-cache-experts 512 --max-batch 1

Standalone mode always binds 0.0.0.0:8080. OpenAI-compatible /v1/completions and /v1/chat/completions. Use temperature >= 0.15 (greedy decoding can collapse).

Verification

Boot-verified GGUF-free on A100 (sm_80): coherent English and Malay completions, correct arithmetic reasoning, no NaN/garbage output.

Known limitations

• Text-only by default; image input is available via the separate prism-engine vision bridge (see Vision below) — the DARE-TIES merge itself carries no vision weights, but the shared Qwen3.6-35B-A3B backbone is vision-graftable.
• Intermittent sub-word token drop/duplication on some code/arithmetic prompts is a known open issue; validate structured output downstream.

Vision

Vision-capable via the prism-engine vision bridge (Qwen 446M tower + Unix-socket sidecar); proven on this backbone — coherent image grounding. Two-artifact deploy (this .pqm + the vision-bridge sidecar); see the private sprappcom/prism-engine repo. The DARE-TIES merge only touches language weights, so image input uses the external bridge grafting the shared Qwen3.6-35B-A3B vision tower rather than any weights baked into this file.

Integrity

Verified 2026-08-26 by downloading the published bytes back from this repo with plain curl and boot-testing them GGUF-free on an A100 (sm_80) with prism_server (--n-cpu-moe 36 --moe-cache-experts 2048 --max-batch 1, tokenizer malay35b.tok from this repo): 8-prompt gate = drop 0 / cjk 0 / collapse 0, 8/8 correct (3 code parse, 3 math correct, EN + MY prose), plus 2 extra Malay prompts clean.

File	Bytes	SHA-256
malay35b-katcoder-dare.pqm	39869939712	2fd270edaa250f24e73b28d5f112dca5fbc1d6af39a8cf8d7942a67f3e8e2272
malay35b.tok	8944783	md5 136f99be45a393bee123fa4cfda1afcc

Check: sha256sum malay35b-katcoder-dare.pqm must print the hash above.