Hugging Face model: J-Raposo/code-search-net-tokenizer
Author: J-Raposo
Created: 2025-10-30 16:49:16
Last modified: 2025-10-30 17:09:21
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, tokenizer, code, python, byte-level-bpe, gpt2-style, endpoints_compatible, region:us
Card metadata:
library_name: transformers
tags: tokenizer, code, python, byte-level-bpe, gpt2-style