Before revision:  Most of them are based on the Transformer architecture , which distinguishes tokens with the token position index of the input sequence.
After revision:  Most of them are based on the Transformer architecture . However, it distinguishes sequential tokens only with the token position index of the input sequence.