BERT-IMDB

What is it?

BERT (bert-large-cased) trained for sentiment classification on the IMDB dataset.

Training setting

The model was trained on 80% of the IMDB dataset for sentiment classification for three epochs with a learning rate of 1e-5 with the simpletransformers library. The library uses a learning rate schedule.

Result

The model achieved 90% classification accuracy on the validation set.

Reference

The full experiment is available in the tlr repo.