text:   Tokenization",6,"['Excited to share our new work from @GoogleAI and @DeepMind. ""Charformer: Fast Character Transformers via Gradient-based Subword Tokenization (paper: <LINK>) <LINK>', 'We introduce a new inductive bias that learns latent subwords in an e2e fashion. Charformer is fast, often much faster than other byte-level baselines/subword models while achieving very competitive performance. No more building SPMs / re-pretraining for every new task/domain!', ""Charformer works well both on monolingual English standard benchmarks (GLUE) and also multilingual datasets. We also evaluate Charformer on Jigsaw's toxicity detection sets from social media."", 'Joint work with amazing collaborators. @vqctran (co-first author), @seb_ruder (DeepMind), @_jai_gupta @hwchung27 @dara_bahri @pierceqin @sens3 @congyu and @metzlerd.', 'Code link is already in the paper but release ETA should be in about 1 week. :)', ""@christopher Mesh Tensorflow, similar to the T5 library. We're also working on a JAX version which will be released sometime later.""]",21,06,1011