Before revision:  The learned representations of code commits built upon Transformer are then transferred for downstream commit message generation.
After revision:  The learned representations of code commits built upon Transformer are then fine-tuned for downstream commit message generation.