searchlm-tokenizers

SmolLM2 tokenizer + the four search tags (, , , ), vocab 49,156. -chat variant carries the v4 SFT chat template (IFEval). All searchlm-* model repos use smollm2-search-wiki6m.

Sources on RCP: /mloscratch/homes/ponkshe/search-lm/tokenizers/smollm2-search-wiki6m; /mloscratch/homes/ponkshe/search-lm/tokenizers/smollm2-search-wiki6m-chat; /mloscratch/homes/ponkshe/search-lm/tokenizers/smollm2-360m-search

Pushed 2026-09-15 by ops/push_datasets_to_hf.py. Provenance: Search-LLM EXPERIMENT_PLAN.md / RESULTS.md.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support