julien-c HF staff commited on
Commit
3c84a28
1 Parent(s): ca02040

Migrate model card from transformers-repo

Browse files

Read announcement at https://discuss.huggingface.co/t/announcement-all-model-cards-will-be-migrated-to-hf-co-model-repos/2755
Original file history: https://github.com/huggingface/transformers/commits/master/model_cards/lvwerra/bert-imdb/README.md

Files changed (1) hide show
  1. README.md +14 -0
README.md ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # BERT-IMDB
2
+
3
+ ## What is it?
4
+ BERT (`bert-large-cased`) trained for sentiment classification on the [IMDB dataset](https://www.kaggle.com/lakshmi25npathi/imdb-dataset-of-50k-movie-reviews).
5
+
6
+ ## Training setting
7
+
8
+ The model was trained on 80% of the IMDB dataset for sentiment classification for three epochs with a learning rate of `1e-5` with the `simpletransformers` library. The library uses a learning rate schedule.
9
+
10
+ ## Result
11
+ The model achieved 90% classification accuracy on the validation set.
12
+
13
+ ## Reference
14
+ The full experiment is available in the [tlr repo](https://lvwerra.github.io/trl/03-bert-imdb-training/).