zhichao-geng commited on
Commit
288ac4b
1 Parent(s): 327d82f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -16
README.md CHANGED
@@ -126,19 +126,14 @@ The above code sample shows an example of neural sparse search. Although there i
126
 
127
  ## Detailed Search Relevance
128
 
129
- | Dataset | [opensearch-neural-sparse-encoding-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v1) | [opensearch-neural-sparse-encoding-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v2-distill) | [opensearch-neural-sparse-encoding-doc-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v1) | [opensearch-neural-sparse-encoding-doc-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill) |
130
- |---------|-------------------------------------------------------------------------|-------------------------------------------------------------------------------------|------------------------------------------------------------------------------|------------------------------------------------------------------------------------------|
131
- | Trec Covid | 0.771 | 0.775 | 0.707 | 0.690 |
132
- | NFCorpus | 0.360 | 0.347 | 0.352 | 0.343 |
133
- | NQ | 0.553 | 0.561 | 0.521 | 0.528 |
134
- | HotpotQA | 0.697 | 0.685 | 0.677 | 0.675 |
135
- | FiQA | 0.376 | 0.374 | 0.344 | 0.357 |
136
- | ArguAna | 0.508 | 0.551 | 0.461 | 0.496 |
137
- | Touche | 0.278 | 0.278 | 0.294 | 0.287 |
138
- | DBPedia | 0.447 | 0.435 | 0.412 | 0.418 |
139
- | SCIDOCS | 0.164 | 0.173 | 0.154 | 0.166 |
140
- | FEVER | 0.821 | 0.849 | 0.743 | 0.818 |
141
- | Climate FEVER | 0.263 | 0.249 | 0.202 | 0.224 |
142
- | SciFact | 0.723 | 0.722 | 0.716 | 0.715 |
143
- | Quora | 0.856 | 0.863 | 0.788 | 0.841 |
144
- | **Average** | **0.524** | **0.528** | **0.490** | **0.504** |
 
126
 
127
  ## Detailed Search Relevance
128
 
129
+ <div style="overflow-x: auto;">
130
+
131
+ | Model | Average | Trec Covid | NFCorpus | NQ | HotpotQA | FiQA | ArguAna | Touche | DBPedia | SCIDOCS | FEVER | Climate FEVER | SciFact | Quora |
132
+ |-------|---------|------------|----------|----|----------|------|---------|--------|---------|---------|-------|---------------|---------|-------|
133
+ | [opensearch-neural-sparse-encoding-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v1) | 0.524 | 0.771 | 0.360 | 0.553 | 0.697 | 0.376 | 0.508 | 0.278 | 0.447 | 0.164 | 0.821 | 0.263 | 0.723 | 0.856 |
134
+ | [opensearch-neural-sparse-encoding-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-v2-distill) | 0.528 | 0.775 | 0.347 | 0.561 | 0.685 | 0.374 | 0.551 | 0.278 | 0.435 | 0.173 | 0.849 | 0.249 | 0.722 | 0.863 |
135
+ | [opensearch-neural-sparse-encoding-doc-v1](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v1) | 0.490 | 0.707 | 0.352 | 0.521 | 0.677 | 0.344 | 0.461 | 0.294 | 0.412 | 0.154 | 0.743 | 0.202 | 0.716 | 0.788 |
136
+ | [opensearch-neural-sparse-encoding-doc-v2-distill](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill) | 0.504 | 0.690 | 0.343 | 0.528 | 0.675 | 0.357 | 0.496 | 0.287 | 0.418 | 0.166 | 0.818 | 0.224 | 0.715 | 0.841 |
137
+ | [opensearch-neural-sparse-encoding-doc-v2-mini](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v2-mini) | 0.497 | 0.709 | 0.336 | 0.510 | 0.666 | 0.338 | 0.480 | 0.285 | 0.407 | 0.164 | 0.812 | 0.216 | 0.699 | 0.837 |
138
+
139
+ </div>