Humair332
/

gpt-style-50k-tokenizer

Model card Files Files and versions

Resources

View closed (0)

feat: map reserved slots → 80 sound/paralinguistic tags

#4 opened 2 months ago by

feat: replace <|reserved_N|> → 80 sound/paralinguistic tags

#3 opened 2 months ago by

feat: inject 80 sound/paralinguistic tags as single added_tokens

#2 opened 2 months ago by

feat: replace reserved tokens with 80 sound/paralinguistic tags

#1 opened 2 months ago by