ccdv
/

lsg-bart-base-4096-pubmed

text2text-generation

Model card Files Files and versions Community

ccdv commited on May 25, 2022

Commit

6d5851f

•

1 Parent(s): c053e88

readme

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -47,11 +47,11 @@ It achieves the following results on the test set:
 | 4096   | Local        | 128        | 0        | 384        | 47.02 | 21.33 | 28.34 | 43.31 |
 | 4096   | Pooling      | 128        | 4        | 644        | 47.11 | 21.42 | 28.43 | 43.40 |
 | 4096   | Stride       | 128        | 4        | 644        | 47.16 | 21.49 | 28.38 | 43.44 |
-| 4096   | Block Stride | 128        | 4        | 160        | 47.13 | 21.46 | 28.39 | 43.42 |
 | 4096   | Norm         | 128        | 4        | 644        | 47.09 | 21.44 | 28.40 | 43.36 |
 | 4096   | LSH          | 128        | 4        | 644        | 47.11 | 21.41 | 28.41 | 43.42 |
-With blocks of size 32 (lower ressources):
 | Length | Sparse Type  | Block Size | Sparsity | Connexions | R1    | R2    | RL    | RLsum |
 |:------ |:------------ |:---------- |:-------- | :--------- |:----- |:----- |:----- |:----- |

 | 4096   | Local        | 128        | 0        | 384        | 47.02 | 21.33 | 28.34 | 43.31 |
 | 4096   | Pooling      | 128        | 4        | 644        | 47.11 | 21.42 | 28.43 | 43.40 |
 | 4096   | Stride       | 128        | 4        | 644        | 47.16 | 21.49 | 28.38 | 43.44 |
+| 4096   | Block Stride | 128        | 4        | 644        | 47.13 | 21.46 | 28.39 | 43.42 |
 | 4096   | Norm         | 128        | 4        | 644        | 47.09 | 21.44 | 28.40 | 43.36 |
 | 4096   | LSH          | 128        | 4        | 644        | 47.11 | 21.41 | 28.41 | 43.42 |
+With smaller block size (lower ressources):
 | Length | Sparse Type  | Block Size | Sparsity | Connexions | R1    | R2    | RL    | RLsum |
 |:------ |:------------ |:---------- |:-------- | :--------- |:----- |:----- |:----- |:----- |