Commit
•
872779e
1
Parent(s):
fc1c751
Update README.md
Browse files
README.md
CHANGED
|
@@ -101,3 +101,17 @@ The table below shows ROC AUC for three models on small samples of the DEV sets:
|
|
| 101 |
|sick |0.97 |0.99 |0.99 |0.98 |0.96 |
|
| 102 |
|snli |0.95 |0.98 |0.98 |0.99 |0.97 |
|
| 103 |
|terra |0.73 |0.93 |0.93 | | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 101 |
|sick |0.97 |0.99 |0.99 |0.98 |0.96 |
|
| 102 |
|snli |0.95 |0.98 |0.98 |0.99 |0.97 |
|
| 103 |
|terra |0.73 |0.93 |0.93 | | |
|
| 104 |
+
|
| 105 |
+
|
| 106 |
+
|m |add_one_rte|anli_r1|anli_r2|anli_r3|copa|fever|help|iie |imppres|joci|mnli |monli|mpe |scitail|sick|snli|terra|mean |
|
| 107 |
+
|------------------------|-----------|-------|-------|-------|----|-----|----|-----|-------|----|-----|-----|----|-------|----|----|-----|------|
|
| 108 |
+
|n |387 |1000 |1000 |1200 |200 |20474|3355|31232|7661 |939 |19647|269 |1000|2126 |500 |9831|307 |101128|
|
| 109 |
+
|------------------------|-----------|-------|-------|-------|----|-----|----|-----|-------|----|-----|-----|----|-------|----|----|-----|------|
|
| 110 |
+
|tiny/entailment |0.77 |0.59 |0.52 |0.53 |0.53|0.90 |0.81|0.78 |0.93 |0.81|0.82 |0.91 |0.81|0.78 |0.93|0.95|0.67 |0.77 |
|
| 111 |
+
|twoway/entailment |0.89 |0.73 |0.61 |0.62 |0.58|0.96 |0.92|0.87 |0.99 |0.90|0.90 |0.99 |0.91|0.96 |0.97|0.97|0.87 |0.86 |
|
| 112 |
+
|threeway/entailment |0.91 |0.75 |0.61 |0.61 |0.57|0.96 |0.56|0.61 |0.99 |0.90|0.91 |0.67 |0.92|0.84 |0.98|0.98|0.90 |0.80 |
|
| 113 |
+
|vicgalle-xlm/entailment |0.88 |0.79 |0.63 |0.66 |0.57|0.93 |0.56|0.62 |0.77 |0.80|0.90 |0.70 |0.83|0.84 |0.91|0.93|0.93 |0.78 |
|
| 114 |
+
|facebook-bart/entailment|0.51 |0.41 |0.43 |0.47 |0.50|0.74 |0.55|0.57 |0.60 |0.63|0.70 |0.52 |0.56|0.68 |0.67|0.72|0.64 |0.58 |
|
| 115 |
+
|threeway/contradiction | |0.71 |0.64 |0.61 | |0.97 | | |1.00 |0.77|0.92 | |0.89| |0.99|0.98| |0.85 |
|
| 116 |
+
|threeway/neutral | |0.79 |0.70 |0.62 | |0.91 | | |0.99 |0.68|0.86 | |0.79| |0.96|0.96| |0.83 |
|
| 117 |
+
|