SlowGuess/NeurIPS_2023_OCR huggingface dataset:
Table 8: The benchmarking results of the feature-based explainable recommender models on jointly predicting the tags for persuasiveness, informativeness and ratings.
Metrics	Persuasiveness	Informativeness	Rating
F1	NDCG	F1	NDCG	RMSE	MAE
EFM	15.69±0.03	12.74±0.07	5.38±0.73	3.94±0.42	1.66±0.00	1.23±0.00
LRPPM	37.32±0.21	23.26±0.09	37.89±0.19	38.37±0.13	1.22±0.00	0.96±0.00
SULM	41.34±0.53	25.68±0.20	42.70±0.50	42.82±0.35	1.67±0.06	1.31±0.05
MTER	35.53±0.21	21.88±0.35	36.22±0.30	36.09±0.61	1.36±0.01	1.09±0.01
AMF	27.67±0.16	17.45±0.15	28.23±0.33	28.57±0.34	2.28±0.00	1.86±0.00
DERM-MLP	38.49±0.15	23.80±0.10	39.14±0.10	39.38±0.10	1.30±0.01	1.06±0.01
DERM-MF	36.84±0.04	22.55±0.05	37.58±0.11	37.44±0.08	1.32±0.00	1.15±0.00
DERM-C	37.85±0.26	23.43±0.21	38.82±0.06	39.10±0.09	1.30±0.01	1.08±0.01
DERM-H	37.47±0.26	23.23±0.22	38.17±0.22	38.32±0.36	1.28±0.00	1.04±0.01
TRDM	32.91±1.06	15.51±0.72	33.01±0.50	25.02±0.37	1.19±0.00	0.94±0.01
TRAL	5.93±0.05	2.61±0.02	6.06±0.06	4.60±0.02	1.29±0.00	1.08±0.00
HPTR	38.68±0.25	23.11±1.20	36.20±4.79	31.40±9.27	2.16±0.71	1.88±0.68
AIRec	38.73±0.10	23.97±0.07	39.43±0.08	39.66±0.09	1.31±0.00	1.08±0.01
HAN-TR	33.32±0.75	16.83±0.53	33.31±0.93	27.72±0.46	1.29±0.02	1.06±0.03
TNAM	5.91±0.05	2.63±0.02	37.47±0.46	37.35±0.58	1.36±0.01	1.17±0.01
BPR-T	33.15±0.22	18.90±0.44	34.05±0.20	31.51±0.26	1.24±0.01	0.99±0.01
Table 9: The benchmarking results of the feature-based explainable recommender models on jointly predicting the tags for persuasiveness, satisfaction and ratings.
Metrics	Persuasiveness	Satisfaction	Rating
F1	NDCG	F1	NDCG	RMSE	MAE
EFM	15.58±0.03	12.84±0.07	4.58±0.45	1.77±0.18	1.66±0.00	1.23±0.00
LRPPM	37.32±0.21	23.26±0.09	36.06±0.14	22.37±0.07	1.22±0.00	0.96±0.00
SULM	41.36±0.56	35.71±0.22	40.15±0.54	24.70±0.18	1.67±0.06	1.31±0.05
MTER	5.83±0.52	2.56±0.18	5.36±0.17	2.23±0.12	2.04±0.68	1.74±0.66
AMF	27.71±0.21	17.52±0.21	26.90±0.18	16.94±0.16	2.28±0.00	1.86±0.00
DERM-MLP	38.37±0.09	23.71±0.12	37.32±0.02	22.87±0.03	1.30±0.01	1.06±0.01
DERM-MF	36.90±0.12	22.63±0.12	35.78±0.10	21.74±0.12	1.32±0.00	1.15±0.00
DERM-C	38.03±0.11	23.60±0.06	36.95±0.10	22.72±0.06	1.31±0.01	1.08±0.00
DERM-H	37.49±0.24	23.32±0.18	36.11±0.29	22.34±0.17	1.29±0.01	1.04±0.01
TRDM	32.57±1.92	15.11±1.21	30.91±1.77	13.86±1.40	1.19±0.00	0.94±0.00
TRAL	5.91±0.05	2.63±0.02	5.89±0.05	2.52±0.01	1.29±0.00	1.08±0.00
HPTR	38.64±0.20	22.93±1.46	32.96±4.03	14.78±4.06	2.16±0.71	1.88±0.68
AIRec	38.69±0.06	23.94±0.05	37.63±0.05	23.08±0.02	1.30±0.01	1.07±0.01
HAN-TR	35.95±2.15	19.75±3.93	34.95±2.02	19.13±3.74	2.09±0.80	1.83±0.75
TNAM	5.91±0.05	2.63±0.02	5.89±0.05	2.52±0.01	1.39±0.02	1.17±0.02
BPR-T	33.07±0.18	18.93±0.48	33.75±0.26	19.57±0.28	1.23±0.00	0.99±0.01
Table 10: The benchmarking results of the feature-based explainable recommender models on jointly predicting the tags for informativeness, satisfaction and ratings.
Metrics	Informativeness	Satisfaction	Rating
F1	NDCG	F1	NDCG	RMSE	MAE
EFM	5.15±0.79	3.75±0.38	4.57±0.54	1.75±0.21	1.66±0.00	1.23±0.00
LRPPM	37.89±0.19	38.37±0.14	36.06±0.14	22.37±0.07	1.22±0.00	0.96±0.00
SULM	42.70±0.49	42.84±0.37	40.12±0.51	24.70±0.17	1.67±0.06	1.31±0.05
MTER	6.13±0.03	4.56±0.18	5.64±0.66	2.37±0.30	2.04±0.68	1.74±0.66
AMF	28.17±0.28	28.53±0.32	26.79±0.06	16.89±0.09	2.28±0.00	1.86±0.00
DERM-MLP	39.23±0.08	39.45±0.02	37.40±0.07	22.93±0.06	1.30±0.01	1.06±0.01
DERM-MF	37.60±0.13	37.49±0.17	35.77±0.16	21.76±0.16	1.32±0.00	1.15±0.00
DERM-C	38.77±0.13	39.08±0.18	36.84±0.23	22.59±0.16	1.30±0.01	1.07±0.01
DERM-H	38.13±0.50	38.45±0.47	36.44±0.28	22.55±0.21	1.27±0.01	1.04±0.01
TRDM	33.15±0.98	25.24±1.92	30.42±1.50	13.83±1.22	1.19±0.00	0.94±0.01
TRAL	6.04±0.06	4.56±0.02	5.84±0.01	2.43±0.08	1.29±0.00	1.08±0.00
HPTR	37.36±3.15	32.22±7.55	35.35±2.93	17.79±3.92	1.81±0.77	1.56±0.72
AIRec	39.46±0.11	39.72±0.07	37.65±0.11	23.13±0.07	1.30±0.00	1.08±0.01
HAN-TR	35.79±3.09	32.11±6.85	34.04±2.94	18.48±4.06	1.31±0.01	1.10±0.02
TNAM	37.01±1.35	37.01±1.33	5.89±0.05	2.52±0.01	1.36±0.01	1.15±0.01
BPR-T	34.11±0.32	31.57±0.50	33.94±0.18	19.75±0.28	1.23±0.00	0.98±0.01
Table 11: The benchmarking results of the feature-based recommender models on jointly predicting the tags for persuasiveness, informativeness and satisfaction and ratings.
Metrics	Persuasiveness	Informativeness	Satisfaction	Rating Prediction
F1	NDCG	F1	NDCG	F1	NDCG	RMSE	MAE
EFM	11.66±0.15	8.52±0.10	4.97±0.61	3.70±0.48	5.33±1.10	2.24±0.62	1.66±0.01	1.23±0.01
LRPPM	37.32±0.24	23.26±0.11	37.94±0.23	38.46±0.18	36.08±0.17	22.35±0.10	1.22±0.00	0.96±0.00
SULM	41.12±0.50	25.35±0.21	42.35±0.45	42.66±0.34	40.00±0.49	24.66±0.16	1.69±0.09	1.33±0.08
MTER	36.16±0.06	22.38±0.15	36.75±0.09	36.94±0.24	34.84±0.09	21.52±0.03	1.34±0.04	1.08±0.03
AMF	27.83±0.37	17.47±0.19	28.35±0.33	28.66±0.34	27.09±0.34	17.03±0.16	2.28±0.00	1.86±0.00
DERM-MLP	38.60±0.08	23.81±0.07	39.33±0.09	39.57±0.05	37.52±0.09	22.97±0.09	1.31±0.02	1.07±0.02
DERM-MF	37.42±0.21	23.16±0.08	38.26±0.13	38.46±0.16	36.60±1.01	22.18±0.19	1.33±0.00	1.16±0.00
DERM-C	38.05±0.22	23.53±0.07	39.03±0.15	39.29±0.11	37.19±0.15	22.79±0.08	1.30±0.01	1.08±0.01
DERM-H	37.64±0.24	23.36±0.18	38.52±0.44	38.83±0.39	36.70±0.40	22.60±0.16	1.28±0.01	1.05±0.02
TRDM	33.50±1.85	15.64±1.83	33.94±1.06	26.47±1.89	31.79±1.17	14.77±1.09	1.19±0.00	0.94±0.01
TRAL	5.88±0.14	2.56±0.04	5.91±0.09	4.48±0.17	35.42±0.20	21.09±0.08	1.29±0.00	1.07±0.00
HPTR	38.82±0.38	22.14±1.49	39.31±0.50	38.01±2.21	37.64±0.26	21.46±1.51	1.77±0.98	1.50±0.93
AIRec	38.89±0.09	23.98±0.05	39.61±0.11	39.82±0.09	37.85±0.05	23.16±0.06	1.30±0.00	1.07±0.01
HAN-TR	37.95±0.63	23.46±0.02	38.65±0.70	39.01±0.39	37.07±0.82	22.74±0.04	1.80±0.67	1.57±0.62
TNAM	37.96±0.13	23.51±0.02	38.74±0.23	38.81±0.17	5.89±0.08	2.44±0.12	1.37±0.01	1.17±0.01
BPR-T	33.41±0.44	19.39±0.48	34.37±0.28	32.15±0.36	34.29±0.15	20.11±0.22	1.24±0.01	1.00±0.02
Table 12: The benchmarking results of the models with natural language explanations in our library. For BLEU and ROUGE, the results are percentage values with "%" omitted. "-" means the evaluation metric is not available for the model.
Metrics	BLEU (%)	ROUGE-1 (%)	ROUGE-2 (%)
B-1	B-4	F1	R	P	F1	R	P
Att2Seq	19.96±0.27	3.25±0.19	22.13±0.27	19.73±0.44	26.40±0.78	5.56±0.08	5.19±0.16	6.26±0.24
NRT	17.67±1.10	2.92±0.65	20.60±0.57	16.04±1.27	30.02±2.40	5.23±0.56	4.20±0.77	7.33±0.42
PETER	17.65±1.18	2.35±0.35	20.00±1.07	15.68±1.62	28.59±1.42	4.99±0.48	3.95±0.58	7.00±0.57