Irwiny123's picture
提交Uni-Core初始代码
eb6d243

A simple BERT example

  1. download data wget https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-2-v1.zip & unzip wikitext-2-v1.zip
  2. run python preprocess.py ./wikitext-2/wiki.train.tokens ./train.lmdb
  3. run python preprocess.py ./wikitext-2/wiki.valid.tokens ./valid.lmdb