gokuls commited on
Commit
8c7d00b
1 Parent(s): 2fbb70c

End of training

Browse files
README.md CHANGED
@@ -1,9 +1,23 @@
1
  ---
2
  tags:
3
  - generated_from_trainer
 
 
 
 
4
  model-index:
5
  - name: model_v1_complete_training_wt_init_48_tiny_freeze_new_ffn_2
6
- results: []
 
 
 
 
 
 
 
 
 
 
7
  ---
8
 
9
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -11,7 +25,10 @@ should probably proofread and complete it, then remove this comment. -->
11
 
12
  # model_v1_complete_training_wt_init_48_tiny_freeze_new_ffn_2
13
 
14
- This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
 
 
 
15
 
16
  ## Model description
17
 
 
1
  ---
2
  tags:
3
  - generated_from_trainer
4
+ datasets:
5
+ - gokuls/wiki_book_corpus_complete_processed_bert_dataset
6
+ metrics:
7
+ - accuracy
8
  model-index:
9
  - name: model_v1_complete_training_wt_init_48_tiny_freeze_new_ffn_2
10
+ results:
11
+ - task:
12
+ name: Masked Language Modeling
13
+ type: fill-mask
14
+ dataset:
15
+ name: gokuls/wiki_book_corpus_complete_processed_bert_dataset
16
+ type: gokuls/wiki_book_corpus_complete_processed_bert_dataset
17
+ metrics:
18
+ - name: Accuracy
19
+ type: accuracy
20
+ value: 0.3842983143791092
21
  ---
22
 
23
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
25
 
26
  # model_v1_complete_training_wt_init_48_tiny_freeze_new_ffn_2
27
 
28
+ This model is a fine-tuned version of [](https://huggingface.co/) on the gokuls/wiki_book_corpus_complete_processed_bert_dataset dataset.
29
+ It achieves the following results on the evaluation set:
30
+ - Loss: 3.7039
31
+ - Accuracy: 0.3843
32
 
33
  ## Model description
34
 
all_results.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 13.8,
3
+ "eval_accuracy": 0.3842983143791092,
4
+ "eval_loss": 3.703929901123047,
5
+ "eval_runtime": 491.0314,
6
+ "eval_samples": 308356,
7
+ "eval_samples_per_second": 627.976,
8
+ "eval_steps_per_second": 3.491,
9
+ "perplexity": 40.60657101301762,
10
+ "train_loss": 4.181136763339477,
11
+ "train_runtime": 190799.4817,
12
+ "train_samples": 5858758,
13
+ "train_samples_per_second": 3070.636,
14
+ "train_steps_per_second": 17.059
15
+ }
eval_results.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 13.8,
3
+ "eval_accuracy": 0.3842983143791092,
4
+ "eval_loss": 3.703929901123047,
5
+ "eval_runtime": 491.0314,
6
+ "eval_samples": 308356,
7
+ "eval_samples_per_second": 627.976,
8
+ "eval_steps_per_second": 3.491,
9
+ "perplexity": 40.60657101301762
10
+ }
logs/events.out.tfevents.1700444446.serv-9220.3432283.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5258ee325d9971f2be9e19ad68801680f1f8e25fe54950fcaea9d1a1f59cb05
3
+ size 369
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 13.8,
3
+ "train_loss": 4.181136763339477,
4
+ "train_runtime": 190799.4817,
5
+ "train_samples": 5858758,
6
+ "train_samples_per_second": 3070.636,
7
+ "train_steps_per_second": 17.059
8
+ }
trainer_state.json ADDED
The diff for this file is too large to render. See raw diff