GitHub repository: lucidrains/electra-pytorch
Primary language: Python
Created: 2020-08-04T21:38:04Z
Description: A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch