File size: 2,989 Bytes
d6585f5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
<!-- Condition: $model -->
<tr class="accordion-toggle collapsed" id="table${table_cnt}-row${row_cnt}" data-toggle="collapse" data-parent="#table${table_cnt}-row${row_cnt}" href="#table${table_cnt}-collapse${row_cnt}">
<td class="expand-button" style="padding-right:50px"></td>
<td nowrap style="padding-right:100px">$model</td>
<td>$TQA_Top20</td>
<td>$TQA_Top100</td>
<td>$NQ_Top20</td>
<td>$NQ_Top100</td>
</tr>
<tr class="hide-table-padding">
<td></td>
<td></td>
<td colspan="13" style="max-width: 600px">
<div id="table${table_cnt}-collapse${row_cnt}" class="collapse in p-3">

<!-- Tabs navs -->
<ul class="nav nav-tabs mb-3" id="table${table_cnt}-row${row_cnt}-tabs" role="tablist">
  <li class="nav-item" role="presentation">
    <a class="nav-link active" id="table${table_cnt}-row${row_cnt}-tab1-header" data-mdb-toggle="tab" href="#table${table_cnt}-row${row_cnt}-tab1" role="tab" aria-controls="table${table_cnt}-row${row_cnt}-tab1" aria-selected="true" style="text-transform:none">TriviaQA</a>
  </li>
  <li class="nav-item" role="presentation">
    <a class="nav-link" id="table${table_cnt}-row${row_cnt}-tab2-header" data-mdb-toggle="tab" href="#table${table_cnt}-row${row_cnt}-tab2" role="tab" aria-controls="table${table_cnt}-row${row_cnt}-tab2" aria-selected="false" style="text-transform:none">Natural Question</a>
  </li>

</ul>
<!-- Tabs navs -->

<!-- Tabs content -->
<div class="tab-content" id="table${table_cnt}-row${row_cnt}-content">
  <div class="tab-pane fade show active" id="table${table_cnt}-row${row_cnt}-tab1" role="tabpanel" aria-labelledby="table${table_cnt}-row${row_cnt}-tab1">
Command to generate runs:

  <blockquote class="mycode">
<pre><code>$cmd1
</code></pre></blockquote>

  <blockquote class="mycode">
<pre><code>$cmd2
</code></pre></blockquote>

  <blockquote class="mycode">
<pre><code>$cmd3
</code></pre></blockquote>

Fusing the results using RRF
  <blockquote class="mycode">
<pre><code>$fusion_cmd1
</code></pre></blockquote>

Converting from trec into json
  <blockquote class="mycode">
<pre><code>$convert_cmd1
</code></pre></blockquote>


Evaluation commands:

  <blockquote class="mycode">
<pre><code>$eval_cmd1</code></pre>
  </blockquote>

  </div>
  <div class="tab-pane fade" id="table${table_cnt}-row${row_cnt}-tab2" role="tabpanel" aria-labelledby="table${table_cnt}-row${row_cnt}-tab2">
Command to generate runs:

  <blockquote class="mycode">
<pre><code>$cmd4
</code></pre></blockquote>

  <blockquote class="mycode">
<pre><code>$cmd5
</code></pre></blockquote>

  <blockquote class="mycode">
<pre><code>$cmd6
</code></pre></blockquote>

Fusing the results using RRF
  <blockquote class="mycode">
<pre><code>$fusion_cmd2
</code></pre></blockquote>

Converting from trec into json
  <blockquote class="mycode">
<pre><code>$convert_cmd2
</code></pre></blockquote>


Evaluation commands:

  <blockquote class="mycode">
<pre><code>$eval_cmd2</code></pre>
  </blockquote>

  </div>
</div>
<!-- Tabs content -->

</div></td>
</tr>