Before revision:  AR and NAR generation can be uniformly regarded as what extend of previous tokens can be attended to , and BANG bridges AR and NAR generation through designing a novel model structure for large-scale pre-training. A pretrained BANG model can simultaneously support AR, NAR , and semi-NAR generation to meet different requirements.
After revision:  AR and NAR generation can be uniformly regarded as what extend of previous tokens can be attended to , and BANG bridges AR and NAR generation through designing a novel model structure for large-scale pretraining. The pretrained BANG model can simultaneously support AR, NAR , and semi-NAR generation to meet different requirements.