Model: damfle/multistral-tokenizer
Author: damfle
Pipeline: token-classification
Tags: code, token-classification, fr, en, zh, dataset:HuggingFaceFW/fineweb, dataset:HuggingFaceFW/fineweb-2, dataset:nick007x/github-code-2025, license:isc, region:us
Card metadata: license: isc
datasets: HuggingFaceFW/fineweb, HuggingFaceFW/fineweb-2, nick007x/github-code-2025
language: fr, en, zh
pipeline_tag: token-classification
tags: code
Likes: 0 | All-time downloads: 0
Created: 2026-01-05 10:29:04