Do Boat and Ocean Suggest Beach? Dialogue Summarization with External Knowledge
doi:10.24432/C5Z30M
TL;DR
We address the problem of out-of-context inference in dialogue summarization, and propose a knowledge-aware model tackling this issue. In human dialogues, utterances do not necessarily carry all the details. As pragmatics studies suggest, humans can infer meaning from the situational context even though the meaning is not literally expressed. It is crucial for natural language processing models to understand such an inference process. In this paper, we address the problem of inferencing Concepts Out of the Dialogue Context (CODC) in the dialogue summarization task. We propose a novel framework comprised of a CODC inference module leveraging external knowledge from WordNet and a knowledge attention module aggregating the inferred knowledge into a neural summarization model. To evaluate the inference capability of different methods, we also propose a new evaluation metric based on CODC. Experiments suggest that current automatic evaluation metrics of natural language generation may not be enough to understand the quality of out-of-context inference in generation results, and our proposed summarization model can provide statistically significant improvements on both CODC inference and traditional automatic evaluation metrics, e.g., CIDEr. Human evaluation of the model's inference ability also demonstrates the superiority of the proposed model.
Citation
@inproceedings{
fang2021do,
title={Do Boat and Ocean Suggest Beach? Dialogue Summarization with External Knowledge},
author={Tianqing Fang and Haojie Pan and Hongming Zhang and Yangqiu Song and Kun Xu and Dong Yu},
booktitle={3rd Conference on Automated Knowledge Base Construction},
year={2021},
url={https://openreview.net/forum?id=AJKd0iIFMDc},
doi={10.24432/C5Z30M}
}