Before revision:  In this paper, we present CANINE, a neural encoder that operates directly on character sequences--without explicit tokenization or vocabulary--and a pre-training strategy with soft inductive biases in place of hard token boundaries.
After revision:  In this paper, we present CANINE, a neural encoder that operates directly on character sequences--without explicit tokenization or vocabulary, and a pre-training strategy with soft inductive biases in place of hard token boundaries.