提交Uni-Core初始代码
eb6d243
A simple BERT example
- download data
wget https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-2-v1.zip & unzip wikitext-2-v1.zip
- run
python preprocess.py ./wikitext-2/wiki.train.tokens ./train.lmdb
- run
python preprocess.py ./wikitext-2/wiki.valid.tokens ./valid.lmdb