add task specific tokenizers; add fairseq dictionary for text modality

9215f51

Amirbek commited on Oct 22, 2023