Commit
•
2d10400
1
Parent(s):
5065178
upload
Browse files- .gitattributes +1 -0
- README.md +58 -0
- all_results.json +3 -0
- config.json +3 -0
- eval_nbest_predictions.json +3 -0
- eval_predictions.json +3 -0
- eval_results.json +3 -0
- pytorch_model.bin +3 -0
- runs/May27_14-07-50_splend1d-MS-7B23/1653631725.5519836/events.out.tfevents.1653631725.splend1d-MS-7B23.21712.1 +3 -0
- runs/May27_14-07-50_splend1d-MS-7B23/events.out.tfevents.1653631725.splend1d-MS-7B23.21712.0 +3 -0
- runs/May27_14-09-49_splend1d-MS-7B23/1653631807.9347582/events.out.tfevents.1653631807.splend1d-MS-7B23.21849.1 +3 -0
- runs/May27_14-09-49_splend1d-MS-7B23/events.out.tfevents.1653631807.splend1d-MS-7B23.21849.0 +3 -0
- runs/May27_14-14-57_splend1d-MS-7B23/1653632116.97792/events.out.tfevents.1653632116.splend1d-MS-7B23.21976.1 +3 -0
- runs/May27_14-14-57_splend1d-MS-7B23/events.out.tfevents.1653632116.splend1d-MS-7B23.21976.0 +3 -0
- runs/May27_14-16-13_splend1d-MS-7B23/1653632191.9860606/events.out.tfevents.1653632191.splend1d-MS-7B23.22067.1 +3 -0
- runs/May27_14-16-13_splend1d-MS-7B23/events.out.tfevents.1653632191.splend1d-MS-7B23.22067.0 +3 -0
- runs/May27_14-16-13_splend1d-MS-7B23/events.out.tfevents.1653636277.splend1d-MS-7B23.22067.2 +3 -0
- special_tokens_map.json +3 -0
- spiece.model +3 -0
- tokenizer.json +3 -0
- tokenizer_config.json +3 -0
- train_results.json +3 -0
- trainer_state.json +3 -0
- training_args.bin +3 -0
.gitattributes
CHANGED
@@ -25,3 +25,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
25 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
26 |
*.zstandard filter=lfs diff=lfs merge=lfs -text
|
27 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
25 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
26 |
*.zstandard filter=lfs diff=lfs merge=lfs -text
|
27 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
28 |
+
*.json filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
tags:
|
4 |
+
- generated_from_trainer
|
5 |
+
datasets:
|
6 |
+
- squad
|
7 |
+
model-index:
|
8 |
+
- name: t5_squad
|
9 |
+
results: []
|
10 |
+
---
|
11 |
+
|
12 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
13 |
+
should probably proofread and complete it, then remove this comment. -->
|
14 |
+
|
15 |
+
# t5_squad
|
16 |
+
|
17 |
+
This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the squad dataset, using the extractive method by isolating the encoder only.
|
18 |
+
|
19 |
+
## Model description
|
20 |
+
|
21 |
+
More information needed
|
22 |
+
|
23 |
+
## Intended uses & limitations
|
24 |
+
|
25 |
+
More information needed
|
26 |
+
|
27 |
+
## Training and evaluation data
|
28 |
+
|
29 |
+
More information needed
|
30 |
+
|
31 |
+
## Training procedure
|
32 |
+
|
33 |
+
### Training hyperparameters
|
34 |
+
|
35 |
+
The following hyperparameters were used during training:
|
36 |
+
- learning_rate: 3e-05
|
37 |
+
- train_batch_size: 12
|
38 |
+
- eval_batch_size: 8
|
39 |
+
- seed: 42
|
40 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
41 |
+
- lr_scheduler_type: linear
|
42 |
+
- num_epochs: 3.0
|
43 |
+
|
44 |
+
### Training results
|
45 |
+
|
46 |
+
{
|
47 |
+
"epoch": 3.0,
|
48 |
+
"eval_exact_match": 70.06622516556291,
|
49 |
+
"eval_f1": 80.02993815400357,
|
50 |
+
"eval_samples": 10659
|
51 |
+
}
|
52 |
+
|
53 |
+
### Framework versions
|
54 |
+
|
55 |
+
- Transformers 4.20.0.dev0
|
56 |
+
- Pytorch 1.9.0+cu111
|
57 |
+
- Datasets 1.18.4
|
58 |
+
- Tokenizers 0.11.6
|
all_results.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:69ceb08f38c3feba363ac4fda8b7248c50a977578cb85417eb054541a2ea6c9e
|
3 |
+
size 298
|
config.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d57d9c5068a4ad8d5f53dce3967d9c51c68c393813dcf1155801908a508c58f8
|
3 |
+
size 676
|
eval_nbest_predictions.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:25d3bbd10fd8575df4b3057658a6cd8dc916454db35dbf8c4bebbe7ea4656929
|
3 |
+
size 49177460
|
eval_predictions.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f922c376f810a19f61f662258452d5ad812aa8eec768491a516cfa2830ed4b3e
|
3 |
+
size 594393
|
eval_results.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8f006c53105a4459d113974a41aeef34f303daa00efec041dbdde44f316c144d
|
3 |
+
size 124
|
pytorch_model.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7294a8a5ecc1da9c4b81096fe60f2516f8bee82571e619d8acb67eebf227a402
|
3 |
+
size 141344326
|
runs/May27_14-07-50_splend1d-MS-7B23/1653631725.5519836/events.out.tfevents.1653631725.splend1d-MS-7B23.21712.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ff6b9586fa28a7dd8bcc25005002ef885853efc409cd4ecf2c516abbe22446fb
|
3 |
+
size 5212
|
runs/May27_14-07-50_splend1d-MS-7B23/events.out.tfevents.1653631725.splend1d-MS-7B23.21712.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:54a0e526be59a5ced4d9c968bbb71e1beb02510c5ef90bc669db60f2bf1c0d02
|
3 |
+
size 3550
|
runs/May27_14-09-49_splend1d-MS-7B23/1653631807.9347582/events.out.tfevents.1653631807.splend1d-MS-7B23.21849.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:396fb8e73f9887e81a218aaf88784720a5fcdb6319d0da0f636e9c98ac558909
|
3 |
+
size 5212
|
runs/May27_14-09-49_splend1d-MS-7B23/events.out.tfevents.1653631807.splend1d-MS-7B23.21849.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:383e8999cd7a5dcb82eb0289cb0f384d3c8909a297bf371b4cb5a1fecf1812c0
|
3 |
+
size 3549
|
runs/May27_14-14-57_splend1d-MS-7B23/1653632116.97792/events.out.tfevents.1653632116.splend1d-MS-7B23.21976.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:aec98b92c25b5ad4f8708d73146f2e706a52fbbb318674bdf91ddeed32e2b1ce
|
3 |
+
size 5212
|
runs/May27_14-14-57_splend1d-MS-7B23/events.out.tfevents.1653632116.splend1d-MS-7B23.21976.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a8b24b516af7b48dba902104d0a34eee9a87e8b9126bdc698eecb7e7ec4b36fe
|
3 |
+
size 3549
|
runs/May27_14-16-13_splend1d-MS-7B23/1653632191.9860606/events.out.tfevents.1653632191.splend1d-MS-7B23.22067.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2d52d39044676bc21d98ea11d658ea0fba6c2bf968a0fa3fd5b262083c062e4a
|
3 |
+
size 5212
|
runs/May27_14-16-13_splend1d-MS-7B23/events.out.tfevents.1653632191.splend1d-MS-7B23.22067.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:28332e2e5da368a36654314075e0e277afd1c32b928fbdbe1629641b8aa8673e
|
3 |
+
size 10693
|
runs/May27_14-16-13_splend1d-MS-7B23/events.out.tfevents.1653636277.splend1d-MS-7B23.22067.2
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e02006faca8229a870c95c93e1d242e4c2170c872f4b81efd76cf15b8b0c146a
|
3 |
+
size 194
|
special_tokens_map.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4720c0fddbe4c5991334f85ad7073d9bd0a294a8ba4641a2f8dab614ca825949
|
3 |
+
size 1786
|
spiece.model
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86
|
3 |
+
size 791656
|
tokenizer.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5f0ed8ab5b8cfa9812bb73752f1d80c292e52bcf5a87a144dc9ab2d251056cbb
|
3 |
+
size 2422095
|
tokenizer_config.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:24477ecc3e60b640770e4860c51437de4fd3b3c3b2ca10267ccc4fad3c262c9d
|
3 |
+
size 1924
|
train_results.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3f7442d19eaa1c21143a95f52481a74bdbf62cd497fd884198acdfc9f5506e16
|
3 |
+
size 194
|
trainer_state.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:47f892932d7f463a6749756a4a5b3073e1d5257a6043b30a6e41273481ffb08b
|
3 |
+
size 5839
|
training_args.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ef42f2c620f4536488a6703ffd8371d21e773819ca6bdbc6ea80549ab4413b56
|
3 |
+
size 3247
|