Average	Kp20K	Krapivin	Inspec	NUS	SemEval	DUC
Model	5	10	O	M	5	10	O	M	5	10	O	M	5	10	O	M	5	10	O	M	5	10	O	M	5	10	O	M
One2one variants
RNN-O2O-KP20k	23.0	23.6	25.4	2.3	27.8	24.9	28.9	1.5	25.2	23.4	27.0	1.6	25.1	28.2	29.9	3.1	28.8	28.6	31.1	2.5	19.3	23.9	23.2	2.8	11.5	12.7	12.3	2.0
RNN-O2O-KP20k-nocopy	1.6	1.8	1.8	0.4	2.4	2.6	2.5	0.4	2.0	2.0	1.9	0.3	1.0	1.1	1.1	0.2	2.8	3.4	3.2	0.7	1.4	1.9	1.8	0.6	0.0	0.0	0.0	0.0
RNN-O2O-KP20k+MagKP-ALT	24.2	25.2	27.0	2.5	27.2	24.5	28.3	1.6	26.2	24.3	27.9	1.7	27.6	32.8	34.2	3.4	28.9	29.7	31.0	2.6	21.3	23.8	24.4	2.9	13.8	16.1	16.2	2.5
BIGRNN-O2O-KP20k	24.8	25.9	27.9	2.6	29.9	26.7	31.0	1.7	27.9	26.1	29.9	1.9	27.1	32.0	33.8	3.5	30.0	30.6	33.3	2.8	20.7	24.5	24.8	3.2	13.1	15.5	14.5	2.6
BIGRNN-O2O-magKP20k-ALT	24.5	25.6	27.3	2.6	28.0	25.2	29.0	1.7	26.2	24.7	28.1	1.8	28.1	32.8	34.4	3.6	29.3	29.6	31.4	2.8	21.6	24.4	25.0	3.2	14.0	16.8	15.9	2.6
TF-O2O-KP20k	21.3	21.6	23.3	2.2	28.8	25.8	30.0	1.7	25.0	23.4	26.3	1.7	22.0	24.7	26.5	2.9	27.2	27.0	28.9	2.6	18.3	21.8	21.6	2.9	6.3	7.1	6.9	1.2
TF-O2O-KP20k-nocopy	14.4	13.8	15.0	1.4	21.3	19.0	22.2	1.5	18.6	16.6	19.2	1.4	10.4	10.4	11.1	1.2	20.8	21.0	21.9	2.2	14.0	14.7	14.7	2.1	1.2	1.1	1.2	0.2
TF-O2O-KP20k+MagKP-ALT	23.1	23.3	25.4	2.4	28.9	26.0	30.1	1.7	25.9	24.0	27.4	1.8	24.7	27.7	29.9	3.3	28.5	28.4	31.2	2.8	19.7	22.9	22.8	3.1	10.5	11.2	10.6	1.5
One2Seq variants (trained in PRES-Abs)
RNN-O2S-KP20k	22.9	24.7	26.2	8.9	26.2	23.3	26.8	6.7	25.0	23.1	27.3	7.1	28.9	34.7	35.9	13.6	26.4	27.8	28.2	9.7	19.5	24.1	24.2	10.2	11.2	15.0	14.4	6.1
RNN-O2S-KP20k-nocopy	3.7	3.6	3.9	2.3	5.3	4.8	5.6	3.0	4.9	4.5	5.2	2.6	2.4	2.3	2.5	1.5	5.5	5.8	6.3	4.2	3.7	4.1	4.0	2.7	0.0	0.0	0.0	0.0
RNN-O2S-KP20k+MagKP-ALT	21.8	23.9	25.2	9.3	23.7	21.2	24.3	7.0	22.7	22.1	24.8	7.0	28.9	35.7	36.9	14.4	24.8	25.2	25.9	9.0	18.1	22.7	23.2	10.1	12.6	16.7	15.9	8.0
BIGRNN-O2S-KP20k	22.3	23.9	25.5	17.5	25.4	22.9	26.1	13.5	24.0	22.8	26.1	14.4	27.9	33.6	35.0	26.1	26.3	27.4	29.3	20.2	19.5	22.9	23.4	19.0	10.6	14.0	13.3	11.6
BIGRNN-O2S-KP20k+MagKP-ALT	22.4	24.3	25.3	11.9	23.7	21.1	24.1	8.9	23.3	22.0	25.0	8.9	30.1	36.2	36.9	18.0	25.0	26.3	26.8	13.1	18.9	22.9	22.7	12.7	13.6	17.2	16.5	9.5
TF-O2S-KP20k	22.6	23.0	24.6	6.7	28.9	25.8	30.0	6.4	26.3	24.4	28.0	5.9	25.3	28.5	29.7	9.6	27.2	27.6	29.4	8.1	19.2	22.2	21.2	7.3	8.9	9.3	9.4	2.5
TF-O2S-KP20k-nocopy	17.6	16.9	18.6	6.6	25.0	21.9	26.0	7.7	22.6	20.1	23.4	6.9	15.6	15.4	16.6	6.7	24.7	24.0	26.1	9.4	15.3	17.4	16.8	8.2	2.3	2.4	2.4	1.1
TF-O2S-KP20k+MagKP-ALT	25.4	26.5	28.3	6.0	31.3	27.8	32.2	5.2	29.1	26.9	30.8	4.7	27.1	32.4	33.6	9.8	29.8	30.4	31.9	6.3	21.3	24.3	24.7	5.6	14.1	17.1	16.7	4.5
TRANS+One2Seq (trained in PRES-Abs)
MagKP-LN-ONLY	18.6	19.9	20.4	4.3	22.2	20.9	22.4	3.4	20.7	20.1	21.3	3.8	23.2	25.9	27.1	6.2	22.1	24.9	24.9	5.2	15.6	19.2	18.3	5.2	7.9	8.7	8.6	1.9
MagKP-Nsmall-ONLY	16.1	16.9	17.5	7.7	16.4	15.3	16.5	6.6	18.9	18.4	20.1	7.7	24.4	26.0	27.4	12.3	16.9	17.6	17.8	8.1	13.5	16.8	15.9	8.4	6.4	7.2	7.4	3.0
MagKP-Nlarge-ONLY	16.7	17.5	18.1	8.3	16.9	15.7	17.0	7.0	18.9	18.1	19.8	7.6	27.4	29.5	31.2	14.0	18.0	18.6	18.1	8.9	13.6	17.6	17.1	8.9	5.3	5.7	5.6	3.5
MagKP-ONLY	17.0	18.1	18.7	6.0	18.9	17.5	19.1	5.4	19.9	18.8	21.2	5.1	23.0	26.9	27.0	10.6	18.1	19.2	19.4	5.9	13.4	16.4	15.7	5.7	8.7	9.6	9.8	3.2
MagKP-LN-MX	24.1	24.8	26.7	10.1	30.0	26.6	30.9	8.9	27.7	25.4	29.5	8.9	26.7	30.8	32.7	14.3	28.4	29.1	30.3	11.5	19.4	22.7	23.1	10.8	12.1	13.9	13.5	6.5
MagKP-Nsmall-MX	24.2	24.7	26.6	6.5	30.1	26.7	31.0	5.9	28.2	25.2	29.9	5.7	26.8	31.2	32.6	10.3	29.6	29.6	31.0	7.2	19.8	23.5	22.9	6.7	10.7	12.2	12.4	3.3
MagKP-Nlarge-MX	24.3	25.1	26.7	7.5	30.7	27.5	31.6	6.5	28.5	26.7	30.4	6.7	26.3	30.5	32.0	11.9	29.9	29.8	31.3	9.2	19.6	23.5	22.9	7.4	10.9	12.6	12.3	3.2
MagKP-MX	24.7	26.1	27.5	6.0	30.7	27.3	31.6	5.0	28.9	27.1	31.1	5.1	27.2	32.7	33.8	9.4	29.1	30.9	31.3	6.8	20.5	24.6	24.7	5.6	11.6	13.9	12.6	4.1
MagKP-LN-FT	24.9	25.6	27.6	6.6	30.5	27.1	31.6	5.8	29.2	26.3	30.2	5.1	27.0	31.3	32.8	10.0	29.9	30.5	32.0	7.1	20.0	23.2	24.0	6.2	12.7	15.5	15.0	5.3
MagKP-Nsmall-FT	25.4	26.4	28.5	6.2	30.7	27.2	31.5	5.3	29.5	26.5	30.5	4.9	27.9	33.1	35.0	9.8	30.4	30.0	32.7	6.5	20.0	24.0	24.1	5.1	14.2	17.3	17.0	5.5
MagKP-Nlarge-FT	25.8	26.9	29.2	6.2	31.4	27.9	32.2	5.0	30.3	27.6	32.7	4.8	27.4	31.9	33.8	9.2	30.8	31.5	33.6	6.4	20.0	23.9	24.8	5.7	14.9	18.6	18.2	6.0
MagKP-FT	25.7	26.1	28.3	5.9	31.3	27.8	32.2	4.8	29.4	27.1	31.6	5.2	26.9	31.2	32.8	8.7	31.7	30.8	33.5	5.9	21.4	24.2	24.1	5.4	13.7	15.7	15.3	5.2