File size: 780 Bytes
256a159 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 |
summarizer = dict(
dataset_abbrs = [
'--------- LEval Exact Match (Acc) ---------', # category
'LEval_coursera',
'LEval_gsm100',
'LEval_quality',
'LEval_tpo',
'LEval_topic_retrieval',
'--------- LEval Gen (ROUGE) ---------', # category
'LEval_financialqa',
'LEval_gov_report_summ',
'LEval_legal_contract_qa',
'LEval_meeting_summ',
'LEval_multidocqa',
'LEval_narrativeqa',
'LEval_nq',
'LEval_news_summ',
'LEval_paper_assistant',
'LEval_patent_summ',
'LEval_review_summ',
'LEval_scientificqa',
'LEval_tvshow_summ'
],
summary_groups=sum([v for k, v in locals().items() if k.endswith('_summary_groups')], []),
)
|