Task: Question Generation
Input (English): Looking at the current WinoGrande leaderboard, it appears that the previous state of the art is based on RoBERTa BIBREF2, which can be characterized as an encoder-only transformer architecture.
Output (English): What is the previous state of the art?