524c0f8 50a1609
1
2
Similar to the other publicly available LSG models, this model was created using the LSG conversion script found here then MLM pretrained on a sample of OSCAR and Bookcorpus: https://github.com/ccdv-ai/convert_checkpoint_to_lsg
