GitHub repository: IBM/span-selection-pretraining
Primary language: Python
Created: 2019-09-05T01:30:32Z
Description: Code to create pre-training data for a span selection pre-training task inspired by reading comprehension and an effort to avoid encoding general knowledge in the transformer network itself.