Hugging Face model: procmarco/ita-en-code-bpe-48k
Author: procmarco
Created: 2026-06-30 13:35:41
Last modified: 2026-06-30 16:53:05
Library: tiktoken
Likes: 0 | Downloads: 0
Tags: tiktoken, tokenizer, bpe, italian, english, code, fineweb-2, fineweb-edu, it, en, license:mit, region:us
Card metadata:
license: mit
language: it, en
library_name: tiktoken
tags: tokenizer, bpe, italian, english, code, fineweb-2, fineweb-edu