antoinelouis
/

colbertv2-camembert-L4-mmarcoFR

Sentence Similarity

passage-retrieval

Model card Files Files and versions Community

antoinelouis commited on Mar 11

Commit

b4c344a

•

1 Parent(s): b4fb2d8

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -88,10 +88,10 @@ mean reciprocal rank (MRR) and recall at various cut-offs (R@k).
 | model                                                                                                      | #Param.(↓) |  Size | Dim. | Index | R@1000 | R@500 | R@100 | R@10 | MRR@10 |
 |:-----------------------------------------------------------------------------------------------------------|-----------:|------:|-----:|------:|-------:|------:|------:|-----:|-------:|
-| **colbertv2-camembert-L4-mmarcoFR**                                                                        |        54M | 216MB |   32 |    GB |   91.9 |  90.3 |  81.9 | 56.7 |   32.3 |
-| [FraColBERTv2](https://huggingface.co/bclavie/FraColBERTv2)                                                |       111M | 443MB |  128 |  28GB |        |       |       |      |        |
-| [colbertv1-camembert-base-mmarcoFR](https://huggingface.co/antoinelouis/colbertv1-camembert-base-mmarcoFR) |       111M | 443MB |  128 |  28GB |   89.7 |  88.4 |  80.0 | 54.2 |   29.5 |
-| [biencoder-camembert-base-mmarcoFR](https://huggingface.co/antoinelouis/biencoder-camembert-base-mmarcoFR) |       111M | 443MB |  128 |  28GB |      - |  89.1 |  77.8 | 51.5 |   28.5 |
 NB: Index corresponds to the size of the mMARCO-fr index (8.8M passages) on disk when using ColBERTv2's residual compression mechanism.

 | model                                                                                                      | #Param.(↓) |  Size | Dim. | Index | R@1000 | R@500 | R@100 | R@10 | MRR@10 |
 |:-----------------------------------------------------------------------------------------------------------|-----------:|------:|-----:|------:|-------:|------:|------:|-----:|-------:|
+| **colbertv2-camembert-L4-mmarcoFR**                                                                        |        54M | 0.2GB |   32 |    GB |   91.9 |  90.3 |  81.9 | 56.7 |   32.3 |
+| [FraColBERTv2](https://huggingface.co/bclavie/FraColBERTv2)                                                |       111M | 0.4GB |  128 |  28GB |   90.0 |  88.9 |  81.2 | 57.1 |   32.4 |
+| [colbertv1-camembert-base-mmarcoFR](https://huggingface.co/antoinelouis/colbertv1-camembert-base-mmarcoFR) |       111M | 0.4GB |  128 |  28GB |   89.7 |  88.4 |  80.0 | 54.2 |   29.5 |
+| [biencoder-camembert-base-mmarcoFR](https://huggingface.co/antoinelouis/biencoder-camembert-base-mmarcoFR) |       111M | 0.4GB |  128 |  28GB |      - |  89.1 |  77.8 | 51.5 |   28.5 |
 NB: Index corresponds to the size of the mMARCO-fr index (8.8M passages) on disk when using ColBERTv2's residual compression mechanism.