hf-internal-testing
/

fuyu-tiny-tokenizer

Model card Files Files and versions

fuyu-tiny-tokenizer

45.5 kB

Ctrl+K

Ctrl+K

1 contributor

History: 10 commits

hf-transformers-bot's picture

hf-transformers-bot

Update tokenizer_config.json: 760-token vocab with all 256 byte tokens

d2b6739 verified 2 days ago

.gitattributes

1.52 kB
initial commit 2 days ago
config.json

143 Bytes
Update config.json: 760-token vocab with all 256 byte tokens 2 days ago
tokenizer.json

43 kB
Add tiny Fuyu tokenizer fixture for testing 2 days ago
tokenizer_config.json

873 Bytes
Update tokenizer_config.json: 760-token vocab with all 256 byte tokens 2 days ago