Li commited on
Commit
c2192b3
1 Parent(s): d8e585c

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -0
README.md ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [bioformer-cased-v1.0](https://huggingface.co/bioformers/bioformer-cased-v1.0) fined-tuned on the [MNLI](https://cims.nyu.edu/~sbowman/multinli/) dataset for 2 epochs.
2
+
3
+ The fine-tuning process was performed on two NVIDIA GeForce GTX 1080 Ti GPUs (11GB). The parameters are:
4
+
5
+ ```
6
+ max_seq_length=512
7
+ per_device_train_batch_size=16
8
+ total train batch size (w. parallel, distributed & accumulation) = 32
9
+ learning_rate=3e-5
10
+ ```
11
+
12
+ ## Evaluation results
13
+
14
+ eval_accuracy = 0.803973