Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
nvidia
/
Plan2Align-NV
like
0
Sleeping
App
Files
Files
Community
1
Fetching metadata from the HF Docker repository...
main
Plan2Align-NV
/
laser
/
tools-external
/
moses-tokenizer
/
tokenizer
Ctrl+K
Ctrl+K
3 contributors
History:
1 commit
KuangDW
add laser tool
2aebc50
about 1 month ago
basic-protected-patterns
Safe
178 Bytes
add laser tool
about 1 month ago
deescape-special-chars.perl
Safe
631 Bytes
add laser tool
about 1 month ago
detokenizer.perl
Safe
12.5 kB
add laser tool
about 1 month ago
lowercase.perl
Safe
285 Bytes
add laser tool
about 1 month ago
normalize-punctuation.perl
Safe
1.91 kB
add laser tool
about 1 month ago
remove-non-printing-char.perl
Safe
451 Bytes
add laser tool
about 1 month ago
tokenizer.perl
Safe
16.8 kB
add laser tool
about 1 month ago
