Hugging Face model: antalvdb/lib-tokenizer
Author: antalvdb
Created: 2026-02-16 11:32:51
Last modified: 2026-05-16 14:57:12
Likes: 0 | Downloads: 0
Tags: tokenizer, lib, less-is-better, supra-word, cognitively-inspired, en, dataset:MLZoo/edu-fineweb-10B, license:gpl-3.0, region:us
Card metadata:
language: en
tags: tokenizer, lib, less-is-better, supra-word, cognitively-inspired
license: gpl-3.0
datasets: MLZoo/edu-fineweb-10B