Before revision:  An exception to this trend is the challenging task of coreference resolution, where a sophisticated end-to-end model is appended to a pretrained transformer encoder.
After revision:  An exception to this trend is the challenging task of coreference resolution, where a sophisticated task-specific model is appended to a pretrained transformer encoder.