Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Spaces:
xu-song
/
tokenizer-arena
Running

App Files Files Community
1
Fetching metadata from the HF Docker repository...
tokenizer-arena / vocab /gpt2
Ctrl+K
Ctrl+K
  • 2 contributors
History: 2 commits
xu-song's picture
xu-song
add more tokenizer
5425d5d about 1 year ago
  • .gitignore
    4 Bytes
    update over 1 year ago
  • README.md
    1.99 kB
    update over 1 year ago
  • __init__.py
    491 Bytes
    add more tokenizer about 1 year ago
  • test_fairseq_gpt2.py
    413 Bytes
    update over 1 year ago
  • test_hf_gpt2.py
    695 Bytes
    update over 1 year ago
  • vocab.bpe
    456 kB
    update over 1 year ago