Automatic correction of README.md metadata. Contact website@huggingface.co for any question

Update README.md

Update README.md

Create README.md

Updating logs

Updating logs

Step... (230001/250000 | Loss: 1.7595738172531128, Acc: 0.6519749760627747): 92%|███████████████████▎ | 230248/250000 [111:01:26<10:03:20, 1.83s/it]

Adding dataset stats

Step... (220001/250000 | Loss: 1.7591936588287354, Acc: 0.6520245671272278): 88%|██████████████████▌ | 220518/250000 [106:16:53<14:56:57, 1.83s/it]

Model at 210k steps, mlm acc 0.6509