zhichao-geng commited on
Commit
416b6e6
1 Parent(s): bf7776e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -16
README.md CHANGED
@@ -154,19 +154,14 @@ The above code sample shows an example of neural sparse search. Although there i
154
 
155
  ## Detailed Search Relevance
156
 
157
- | Dataset | [opensearch-neural-sparse-encoding-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v1) | [opensearch-neural-sparse-encoding-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v2-distill) | [opensearch-neural-sparse-encoding-doc-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v1) | [opensearch-neural-sparse-encoding-doc-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill) |
158
- |---------|-------------------------------------------------------------------------|-------------------------------------------------------------------------------------|------------------------------------------------------------------------------|------------------------------------------------------------------------------------------|
159
- | Trec Covid | 0.771 | 0.775 | 0.707 | 0.690 |
160
- | NFCorpus | 0.360 | 0.347 | 0.352 | 0.343 |
161
- | NQ | 0.553 | 0.561 | 0.521 | 0.528 |
162
- | HotpotQA | 0.697 | 0.685 | 0.677 | 0.675 |
163
- | FiQA | 0.376 | 0.374 | 0.344 | 0.357 |
164
- | ArguAna | 0.508 | 0.551 | 0.461 | 0.496 |
165
- | Touche | 0.278 | 0.278 | 0.294 | 0.287 |
166
- | DBPedia | 0.447 | 0.435 | 0.412 | 0.418 |
167
- | SCIDOCS | 0.164 | 0.173 | 0.154 | 0.166 |
168
- | FEVER | 0.821 | 0.849 | 0.743 | 0.818 |
169
- | Climate FEVER | 0.263 | 0.249 | 0.202 | 0.224 |
170
- | SciFact | 0.723 | 0.722 | 0.716 | 0.715 |
171
- | Quora | 0.856 | 0.863 | 0.788 | 0.841 |
172
- | **Average** | **0.524** | **0.528** | **0.490** | **0.504** |
 
154
 
155
  ## Detailed Search Relevance
156
 
157
+ <div style="overflow-x: auto;">
158
+
159
+ | Model | Average | Trec Covid | NFCorpus | NQ | HotpotQA | FiQA | ArguAna | Touche | DBPedia | SCIDOCS | FEVER | Climate FEVER | SciFact | Quora |
160
+ |-------|---------|------------|----------|----|----------|------|---------|--------|---------|---------|-------|---------------|---------|-------|
161
+ | [opensearch-neural-sparse-encoding-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v1) | 0.524 | 0.771 | 0.360 | 0.553 | 0.697 | 0.376 | 0.508 | 0.278 | 0.447 | 0.164 | 0.821 | 0.263 | 0.723 | 0.856 |
162
+ | [opensearch-neural-sparse-encoding-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v2-distill) | 0.528 | 0.775 | 0.347 | 0.561 | 0.685 | 0.374 | 0.551 | 0.278 | 0.435 | 0.173 | 0.849 | 0.249 | 0.722 | 0.863 |
163
+ | [opensearch-neural-sparse-encoding-doc-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v1) | 0.490 | 0.707 | 0.352 | 0.521 | 0.677 | 0.344 | 0.461 | 0.294 | 0.412 | 0.154 | 0.743 | 0.202 | 0.716 | 0.788 |
164
+ | [opensearch-neural-sparse-encoding-doc-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill) | 0.504 | 0.690 | 0.343 | 0.528 | 0.675 | 0.357 | 0.496 | 0.287 | 0.418 | 0.166 | 0.818 | 0.224 | 0.715 | 0.841 |
165
+ | [opensearch-neural-sparse-encoding-doc-v2-mini](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v2-mini) | 0.497 | 0.709 | 0.336 | 0.510 | 0.666 | 0.338 | 0.480 | 0.285 | 0.407 | 0.164 | 0.812 | 0.216 | 0.699 | 0.837 |
166
+
167
+ </div>