Spaces:
Runtime error
Runtime error
| <html lang="en"> | |
| <head> | |
| <meta charset="UTF-8" /> | |
| <meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no" /> | |
| <meta http-equiv="x-ua-compatible" content="ie=edge" /> | |
| <title>Material Design for Bootstrap</title> | |
| <!-- Font Awesome --> | |
| <link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.11.2/css/all.css" /> | |
| <!-- Google Fonts Roboto --> | |
| <link rel="stylesheet" href="https://fonts.googleapis.com/css2?family=Roboto:wght@300;400;500;700&display=swap" /> | |
| <!-- MDB --> | |
| <link href="https://cdnjs.cloudflare.com/ajax/libs/mdb-ui-kit/4.0.0/mdb.min.css" rel="stylesheet" /> | |
| <style> | |
| tr.hide-table-padding td { | |
| padding: 0; | |
| } | |
| .expand-button { | |
| position: relative; | |
| } | |
| .accordion-toggle .expand-button:after | |
| { | |
| position: absolute; | |
| left:.75rem; | |
| top: 50%; | |
| transform: translate(0, -50%); | |
| content: '-'; | |
| } | |
| .accordion-toggle.collapsed .expand-button:after | |
| { | |
| content: '+'; | |
| } | |
| </style> | |
| </head> | |
| <body> | |
| <div class="container my-4"> | |
| <div class="table-responsive"> | |
| <table class="table"> | |
| <thead> | |
| <tr> | |
| <th></th> | |
| <th></th> | |
| <th colspan="6"><b>TREC 2021</b></th> | |
| <th colspan="3"><b>dev</b></th> | |
| <th colspan="3"><b>dev2</b></th> | |
| </tr> | |
| <tr> | |
| <th scope="col">#</th> | |
| <th scope="col"></th> | |
| <th scope="col"><br/>MAP@100</th> | |
| <th scope="col">nDCG@10</th> | |
| <th scope="col">MRR@100</th> | |
| <th scope="col">R@100</th> | |
| <th scope="col">R@1K</th> | |
| <th scope="col"></th> | |
| <th scope="col">MRR@100</th> | |
| <th scope="col">R@1K</th> | |
| <th scope="col"></th> | |
| <th scope="col">MRR@100</th> | |
| <th scope="col">R@1K</th> | |
| </tr> | |
| </thead> | |
| <tbody> | |
| <!-- Condition: BM25 original passage (k1=0.9, b=0.4) --> | |
| <tr class="accordion-toggle collapsed" id="row1" data-toggle="collapse" data-parent="#row1" href="#collapse1"> | |
| <td class="expand-button"></td> | |
| <td>BM25 original passage (k1=0.9, b=0.4)</td> | |
| <td>0.1357</td> | |
| <td>0.4458</td> | |
| <td>0.5060</td> | |
| <td>0.3261</td> | |
| <td>0.6149</td> | |
| <td></td> | |
| <td>0.0719</td> | |
| <td>0.5733</td> | |
| <td></td> | |
| <td>0.0802</td> | |
| <td>0.5839</td> | |
| </tr> | |
| <tr class="hide-table-padding"> | |
| <td></td> | |
| <td></td> | |
| <td colspan="11"> | |
| <div id="collapse1" class="collapse in p-3"> | |
| <!-- Tabs navs --> | |
| <ul class="nav nav-tabs mb-3" id="row1-tabs" role="tablist"> | |
| <li class="nav-item" role="presentation"> | |
| <a class="nav-link active" id="row1-tab1-header" data-mdb-toggle="tab" href="#row1-tab1" role="tab" aria-controls="row1-tab1" aria-selected="true">TREC 2021</a> | |
| </li> | |
| <li class="nav-item" role="presentation"> | |
| <a class="nav-link" id="row1-tab2-header" data-mdb-toggle="tab" href="#row1-tab2" role="tab" aria-controls="row1-tab2" aria-selected="false">dev</a> | |
| </li> | |
| <li class="nav-item" role="presentation"> | |
| <a class="nav-link" id="row1-tab3-header" data-mdb-toggle="tab" href="#row1-tab3" role="tab" aria-controls="row1-tab3" aria-selected="false">dev2</a> | |
| </li> | |
| </ul> | |
| <!-- Tabs navs --> | |
| <!-- Tabs content --> | |
| <div class="tab-content" id="row1-content"> | |
| <div class="tab-pane fade show active" id="row1-tab1" role="tabpanel" aria-labelledby="row1-tab1"> | |
| Command to generate run on TREC 2021: | |
| <blockquote> | |
| <pre><code> | |
| python -m pyserini.search.lucene \ | |
| --index msmarco-v2-passage-slim \ | |
| --topics dl21 --output run.dl21.txt \ | |
| --bm25 | |
| </code></pre> | |
| </blockquote> | |
| </div> | |
| <div class="tab-pane fade" id="row1-tab2" role="tabpanel" aria-labelledby="row1-tab2"> | |
| Command to generate run on dev: | |
| <blockquote> | |
| <pre><code> | |
| python -m pyserini.search.lucene \ | |
| --index msmarco-v2-passage-slim \ | |
| --topics msmarco-v2-passage-dev --output run.msmarco-v2-passage-dev.txt \ | |
| --bm25 | |
| </code></pre> | |
| </blockquote> | |
| </div> | |
| <div class="tab-pane fade" id="row1-tab3" role="tabpanel" aria-labelledby="row1-tab3"> | |
| Command to generate run on dev2: | |
| <blockquote> | |
| <pre><code> | |
| python -m pyserini.search.lucene \ | |
| --index msmarco-v2-passage-slim \ | |
| --topics msmarco-v2-passage-dev2 --output run.msmarco-v2-passage-dev2.txt \ | |
| --bm25 | |
| </code></pre> | |
| </blockquote> | |
| </div> | |
| </div> | |
| <!-- Tabs content --> | |
| </div></td> | |
| </tr> | |
| <!-- Condition: BM25 augmented passage (k1=0.9, b=0.4) --> | |
| <tr class="accordion-toggle collapsed" id="row2" data-toggle="collapse" data-parent="#row2" href="#collapse2"> | |
| <td class="expand-button"></td> | |
| <td>BM25 augmented passage (k1=0.9, b=0.4)</td> | |
| <td>0.1357</td> | |
| <td>0.4458</td> | |
| <td>0.5060</td> | |
| <td>0.3261</td> | |
| <td>0.6149</td> | |
| <td></td> | |
| <td>0.0719</td> | |
| <td>0.5733</td> | |
| <td></td> | |
| <td>0.0802</td> | |
| <td>0.5839</td> | |
| </tr> | |
| <tr class="hide-table-padding"> | |
| <td></td> | |
| <td></td> | |
| <td colspan="11"> | |
| <div id="collapse2" class="collapse in p-3"> | |
| <!-- Tabs navs --> | |
| <ul class="nav nav-tabs mb-3" id="row2-tabs" role="tablist"> | |
| <li class="nav-item" role="presentation"> | |
| <a class="nav-link active" id="row2-tab1-header" data-mdb-toggle="tab" href="#row2-tab1" role="tab" aria-controls="row2-tab1" aria-selected="true">TREC 2021</a> | |
| </li> | |
| <li class="nav-item" role="presentation"> | |
| <a class="nav-link" id="row2-tab2-header" data-mdb-toggle="tab" href="#row2-tab2" role="tab" aria-controls="row2-tab2" aria-selected="false">dev</a> | |
| </li> | |
| <li class="nav-item" role="presentation"> | |
| <a class="nav-link" id="row2-tab3-header" data-mdb-toggle="tab" href="#row2-tab3" role="tab" aria-controls="row2-tab3" aria-selected="false">dev2</a> | |
| </li> | |
| </ul> | |
| <!-- Tabs navs --> | |
| <!-- Tabs content --> | |
| <div class="tab-content" id="row2-content"> | |
| <div class="tab-pane fade show active" id="row2-tab1" role="tabpanel" aria-labelledby="row2-tab1"> | |
| Command to generate run on TREC 2021: | |
| <blockquote> | |
| <pre><code> | |
| python -m pyserini.search.lucene \ | |
| --index msmarco-v2-passage-augmented--slim \ | |
| --topics dl21 --output run.dl21.txt \ | |
| --bm25 | |
| </code></pre> | |
| </blockquote> | |
| </div> | |
| <div class="tab-pane fade" id="row2-tab2" role="tabpanel" aria-labelledby="row2-tab2"> | |
| Command to generate run on dev: | |
| <blockquote> | |
| <pre><code> | |
| python -m pyserini.search.lucene \ | |
| --index msmarco-v2-passage-augmented--slim \ | |
| --topics msmarco-v2-passage-dev --output run.msmarco-v2-passage-dev.txt \ | |
| --bm25 | |
| </code></pre> | |
| </blockquote> | |
| </div> | |
| <div class="tab-pane fade" id="row2-tab3" role="tabpanel" aria-labelledby="row2-tab3"> | |
| Command to generate run on dev2: | |
| <blockquote> | |
| <pre><code> | |
| python -m pyserini.search.lucene \ | |
| --index msmarco-v2-passage-augmented--slim \ | |
| --topics msmarco-v2-passage-dev2 --output run.msmarco-v2-passage-dev2.txt \ | |
| --bm25 | |
| </code></pre> | |
| </blockquote> | |
| </div> | |
| </div> | |
| <!-- Tabs content --> | |
| </div></td> | |
| </tr> | |
| </tbody> | |
| </table> | |
| </div> | |
| </div> | |
| <script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/3.4.0/jquery.min.js"></script> | |
| <script src="https://cdnjs.cloudflare.com/ajax/libs/twitter-bootstrap/4.3.1/js/bootstrap.min.js"></script> | |
| <script type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/mdb-ui-kit/4.0.0/mdb.min.js"></script> | |
| </body> | |
| </html> | |