gaunernst commited on
Commit
5c12643
·
1 Parent(s): e4af322

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -19,20 +19,20 @@ Note: it's not clear if these checkpoints have undergone knowledge distillation.
19
 
20
  | |H=128|H=256|H=512|H=768|
21
  |---|:---:|:---:|:---:|:---:|
22
- | **L=2** |**2/128 (BERT-Tiny)**|[2/256][2_256]|[2/512][2_512]|[2/768][2_768]|
23
  | **L=4** |[4/128][4_128]|[4/256 (BERT-Mini)][4_256]|[4/512 (BERT-Small)][4_512]|[4/768][4_768]|
24
  | **L=6** |[6/128][6_128]|[6/256][6_256]|[6/512][6_512]|[6/768][6_768]|
25
  | **L=8** |[8/128][8_128]|[8/256][8_256]|[8/512 (BERT-Medium)][8_512]|[8/768][8_768]|
26
  | **L=10** |[10/128][10_128]|[10/256][10_256]|[10/512][10_512]|[10/768][10_768]|
27
  | **L=12** |[12/128][12_128]|[12/256][12_256]|[12/512][12_512]|[12/768 (BERT-Base, original)][12_768]|
28
 
29
- [2_128]: https://huggingface.co/gaunernst/bert-L2-H128-uncased
30
  [2_256]: https://huggingface.co/gaunernst/bert-L2-H256-uncased
31
  [2_512]: https://huggingface.co/gaunernst/bert-L2-H512-uncased
32
  [2_768]: https://huggingface.co/gaunernst/bert-L2-H768-uncased
33
  [4_128]: https://huggingface.co/gaunernst/bert-L4-H128-uncased
34
- [4_256]: https://huggingface.co/gaunernst/bert-L4-H256-uncased
35
- [4_512]: https://huggingface.co/gaunernst/bert-L4-H512-uncased
36
  [4_768]: https://huggingface.co/gaunernst/bert-L4-H768-uncased
37
  [6_128]: https://huggingface.co/gaunernst/bert-L6-H128-uncased
38
  [6_256]: https://huggingface.co/gaunernst/bert-L6-H256-uncased
@@ -40,7 +40,7 @@ Note: it's not clear if these checkpoints have undergone knowledge distillation.
40
  [6_768]: https://huggingface.co/gaunernst/bert-L6-H768-uncased
41
  [8_128]: https://huggingface.co/gaunernst/bert-L8-H128-uncased
42
  [8_256]: https://huggingface.co/gaunernst/bert-L8-H256-uncased
43
- [8_512]: https://huggingface.co/gaunernst/bert-L8-H512-uncased
44
  [8_768]: https://huggingface.co/gaunernst/bert-L8-H768-uncased
45
  [10_128]: https://huggingface.co/gaunernst/bert-L10-H128-uncased
46
  [10_256]: https://huggingface.co/gaunernst/bert-L10-H256-uncased
 
19
 
20
  | |H=128|H=256|H=512|H=768|
21
  |---|:---:|:---:|:---:|:---:|
22
+ | **L=2** |[**2/128 (BERT-Tiny)**][2_128]|[2/256][2_256]|[2/512][2_512]|[2/768][2_768]|
23
  | **L=4** |[4/128][4_128]|[4/256 (BERT-Mini)][4_256]|[4/512 (BERT-Small)][4_512]|[4/768][4_768]|
24
  | **L=6** |[6/128][6_128]|[6/256][6_256]|[6/512][6_512]|[6/768][6_768]|
25
  | **L=8** |[8/128][8_128]|[8/256][8_256]|[8/512 (BERT-Medium)][8_512]|[8/768][8_768]|
26
  | **L=10** |[10/128][10_128]|[10/256][10_256]|[10/512][10_512]|[10/768][10_768]|
27
  | **L=12** |[12/128][12_128]|[12/256][12_256]|[12/512][12_512]|[12/768 (BERT-Base, original)][12_768]|
28
 
29
+ [2_128]: https://huggingface.co/gaunernst/bert-tiny-uncased
30
  [2_256]: https://huggingface.co/gaunernst/bert-L2-H256-uncased
31
  [2_512]: https://huggingface.co/gaunernst/bert-L2-H512-uncased
32
  [2_768]: https://huggingface.co/gaunernst/bert-L2-H768-uncased
33
  [4_128]: https://huggingface.co/gaunernst/bert-L4-H128-uncased
34
+ [4_256]: https://huggingface.co/gaunernst/bert-mini-uncased
35
+ [4_512]: https://huggingface.co/gaunernst/bert-small-uncased
36
  [4_768]: https://huggingface.co/gaunernst/bert-L4-H768-uncased
37
  [6_128]: https://huggingface.co/gaunernst/bert-L6-H128-uncased
38
  [6_256]: https://huggingface.co/gaunernst/bert-L6-H256-uncased
 
40
  [6_768]: https://huggingface.co/gaunernst/bert-L6-H768-uncased
41
  [8_128]: https://huggingface.co/gaunernst/bert-L8-H128-uncased
42
  [8_256]: https://huggingface.co/gaunernst/bert-L8-H256-uncased
43
+ [8_512]: https://huggingface.co/gaunernst/bert-medium-uncased
44
  [8_768]: https://huggingface.co/gaunernst/bert-L8-H768-uncased
45
  [10_128]: https://huggingface.co/gaunernst/bert-L10-H128-uncased
46
  [10_256]: https://huggingface.co/gaunernst/bert-L10-H256-uncased