Configuration Parsing Warning:Config file tokenizer_config.json cannot be fetched (too big)

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Arka v2 Tokenizer (64K) - Fixed Fast Tokenizer

Custom 64K Unigram tokenizer trained for the Arka v2 model, optimized for reasoning, math, and code.

Update: This version correctly implements the Metaspace pre-tokenizer using SentencePieceUnigramTokenizer.from_spm(). Spaces are properly handled, and the token bug has been resolved (V2).

Configuration

Vocab Size: 64000
Context Length: 8192
Algorithm: SentencePiece Unigram + Byte-fallback
Clean-up Spaces: False (Preserves code formatting)
Data Ratio: 60% Edu-Web, 20% Code, 15% Math, 5% StackExchange QA

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support