FredZhang7 commited on
Commit
11f1de9
1 Parent(s): 2beddd4

update to v3

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -68,16 +68,16 @@ Find the v1 (TensorFlow) model on [this page](https://github.com/FredZhang7/tfjs
68
 
69
  <br>
70
 
71
- | | v2 | v1 |
72
  |----------|----------|----------|
73
  | Base Model | bert-base-multilingual-cased | nlpaueb/legal-bert-small-uncased |
74
  | Base Tokenizer | bert-base-multilingual-cased | bert-base-multilingual-cased |
75
  | Framework | PyTorch | TensorFlow |
76
- | Dataset Size | 2.95M | 2.68M |
77
  | Train Split | 80% English<br>20% English + 100% Multilingual | None |
78
  | English Train Accuracy | 99.4% | N/A (≈97.5%) |
79
- | Other Train Accuracy | 96.5% | 96.6% |
80
- | Final Val Accuracy | 95.0% | 94.6% |
81
  | Languages | 55 | N/A (≈35) |
82
  | Hyperparameters | maxlen=208<br>padding='max_length'<br>batch_size=112<br>optimizer=Adam<br>learning_rate=1e-5<br>loss=BCEWithLogitsLoss() | maxlen=192<br>padding='max_length'<br>batch_size=16<br>optimizer=Adam<br>learning_rate=1e-5<br>loss="binary_crossentropy" |
83
  | Training Stopped | 6/30/2023 | 9/05/2022 |
 
68
 
69
  <br>
70
 
71
+ | | v3 | v1 |
72
  |----------|----------|----------|
73
  | Base Model | bert-base-multilingual-cased | nlpaueb/legal-bert-small-uncased |
74
  | Base Tokenizer | bert-base-multilingual-cased | bert-base-multilingual-cased |
75
  | Framework | PyTorch | TensorFlow |
76
+ | Dataset Size | 3.0M | 2.68M |
77
  | Train Split | 80% English<br>20% English + 100% Multilingual | None |
78
  | English Train Accuracy | 99.4% | N/A (≈97.5%) |
79
+ | Other Train Accuracy | 96.7% | 96.6% |
80
+ | Final Val Accuracy | 95.2% | 94.6% |
81
  | Languages | 55 | N/A (≈35) |
82
  | Hyperparameters | maxlen=208<br>padding='max_length'<br>batch_size=112<br>optimizer=Adam<br>learning_rate=1e-5<br>loss=BCEWithLogitsLoss() | maxlen=192<br>padding='max_length'<br>batch_size=16<br>optimizer=Adam<br>learning_rate=1e-5<br>loss="binary_crossentropy" |
83
  | Training Stopped | 6/30/2023 | 9/05/2022 |