jasoneden commited on
Commit
1f8989a
1 Parent(s): f39211d

Upload 12 files

Browse files

Working model upload.

README.md CHANGED
@@ -1,3 +1,54 @@
1
  ---
2
- license: bigscience-openrail-m
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: bigscience-bloom-rail-1.0
3
+ tags:
4
+ - generated_from_trainer
5
+ datasets:
6
+ - dataset
7
+ model-index:
8
+ - name: cdcmodel_train02
9
+ results: []
10
  ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # cdcmodel_train02
16
+
17
+ This model is a fine-tuned version of [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) on the dataset dataset.
18
+
19
+ ## Model description
20
+
21
+ More information needed
22
+
23
+ ## Intended uses & limitations
24
+
25
+ More information needed
26
+
27
+ ## Training and evaluation data
28
+
29
+ More information needed
30
+
31
+ ## Training procedure
32
+
33
+ ### Training hyperparameters
34
+
35
+ The following hyperparameters were used during training:
36
+ - learning_rate: 3e-05
37
+ - train_batch_size: 6
38
+ - eval_batch_size: 8
39
+ - seed: 42
40
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
+ - lr_scheduler_type: linear
42
+ - num_epochs: 2.0
43
+ - mixed_precision_training: Native AMP
44
+
45
+ ### Training results
46
+
47
+
48
+
49
+ ### Framework versions
50
+
51
+ - Transformers 4.24.0.dev0
52
+ - Pytorch 1.12.1+cu102
53
+ - Datasets 2.6.1
54
+ - Tokenizers 0.13.1
all_results.json CHANGED
@@ -1,8 +1,19 @@
1
  {
2
- "epoch": 100.0,
3
- "train_loss": 1.9559951608499904,
4
- "train_runtime": 50817.2182,
 
 
 
 
 
 
 
 
 
 
 
5
  "train_samples": 7536,
6
- "train_samples_per_second": 14.83,
7
- "train_steps_per_second": 2.472
8
  }
 
1
  {
2
+ "epoch": 2.0,
3
+ "eval_HasAns_exact": 0.4922874958976042,
4
+ "eval_HasAns_f1": 0.9262843216805502,
5
+ "eval_HasAns_total": 3047,
6
+ "eval_best_exact": 0.4922874958976042,
7
+ "eval_best_exact_thresh": 0.0,
8
+ "eval_best_f1": 0.9262843216805502,
9
+ "eval_best_f1_thresh": 0.0,
10
+ "eval_exact": 0.4922874958976042,
11
+ "eval_f1": 0.9262843216805502,
12
+ "eval_samples": 3229,
13
+ "eval_total": 3047,
14
+ "train_loss": 4.552647050019282,
15
+ "train_runtime": 1011.1429,
16
  "train_samples": 7536,
17
+ "train_samples_per_second": 14.906,
18
+ "train_steps_per_second": 2.484
19
  }
eval_nbest_predictions.json ADDED
The diff for this file is too large to render. See raw diff
 
eval_null_odds.json ADDED
The diff for this file is too large to render. See raw diff
 
eval_predictions.json ADDED
The diff for this file is too large to render. See raw diff
 
eval_results.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 2.0,
3
+ "eval_HasAns_exact": 0.4922874958976042,
4
+ "eval_HasAns_f1": 0.9262843216805502,
5
+ "eval_HasAns_total": 3047,
6
+ "eval_best_exact": 0.4922874958976042,
7
+ "eval_best_exact_thresh": 0.0,
8
+ "eval_best_f1": 0.9262843216805502,
9
+ "eval_best_f1_thresh": 0.0,
10
+ "eval_exact": 0.4922874958976042,
11
+ "eval_f1": 0.9262843216805502,
12
+ "eval_samples": 3229,
13
+ "eval_total": 3047
14
+ }
final_qa_pairs_dev.json ADDED
The diff for this file is too large to render. See raw diff
 
final_qa_pairs_train.json ADDED
The diff for this file is too large to render. See raw diff
 
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b609209a076036c82966856b973da09575d8383ec85f0122239e4fe99a7a7388
3
- size 219289747
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d591b1b4e351c27d7da52d698b9c14835799a9e89793a92448ee2b3994bdc879
3
+ size 218404978