Before revision:  Our analysis shows that PLMs such as BART and T5 achieve  state-of-the-art results in graph-to-text benchmarks without explicitly encoding the graph structure. We also demonstrate that task-adaptive pretraining strategies are beneficial to the target task, improving even furtherthe state of the art in two benchmarks for graph-to-text generation.
After revision:  Our analysis shows that PLMs such as BART and T5 achieve state-of-the-art results and that task-adaptive pretraining strategies are beneficial to the target task, improving even furtherthe state of the art in two benchmarks for graph-to-text generation.