Question: What is different in BERT-gen from standard BERT?
Answer: They use a left-to-right attention mask so that the input tokens can only attend to other input tokens, and the target tokens can only attend to the input tokens and already generated target tokens.