Before revision:  It is effortlessly implemented as what we call Position Encoding Generator (PEG), which can be seamlessly incorporated into the current transformer framework. Our new model with PEGis named Conditional Position encoding Visual Transformer (CPVT) and can naturally process the input sequences of arbitrary length .
After revision:  It is effortlessly implemented as what we call Position Encoding Generator (PEG), which can be seamlessly incorporated into the current Transformer framework. Built on PEG, we present Conditional Position encoding Visual Transformer (CPVT) and can naturally process the input sequences of arbitrary length .