Fact-based Content Weighting for Evaluating Abstractive Summarisation
ACL(2020)
摘要
ive summarisation is notoriously hard to evaluate since standard word-overlap-based metrics are insufficient. We introduce a new evaluation metric which is based on fact-level content weighting, i.e. relating the facts of the document to the facts of the summary. We fol- low the assumption that a good summary will reflect all relevant facts, i.e. the ones present in the ground truth (human-generated refer- ence summary). We confirm this hypothe- sis by showing that our weightings are highly correlated to human perception and compare favourably to the recent manual highlight- based metric of Hardy et al. (2019).
更多查看译文
关键词
abstractive summarisation,content weighting,fact-based
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络