Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
stanford-crfm
/
pubmed_gpt_tokenizer
like
1
Model card
Files
Files and versions
Community
9d29e9b
pubmed_gpt_tokenizer
1 contributor
History:
15 commits
J38
experiment with 50k vocab
9d29e9b
over 1 year ago
.gitattributes
1.38 kB
initial commit
almost 2 years ago
merges.txt
510 kB
experiment with 50k vocab
over 1 year ago
tokenizer.json
2.22 MB
experiment with 50k vocab
over 1 year ago
tokenizer_config.json
293 Bytes
add of |endoftext|
over 1 year ago
vocab.json
1.09 MB
experiment with 50k vocab
over 1 year ago