Procedural Reading Comprehension with Attribute-Aware Context Flow
doi:10.24432/C5C883
TL;DR
We present DynaPro, a neural RC model that tracks the states of a process's participants using jointly formulated entity-aware and attribute-aware representations. DynaPro achieves SOTA results on two procedural RC datasets: ProPara and NPN-cooking. Procedural texts often describe processes (e.g., photosynthesis, cooking) that happen over entities (e.g., light, food). In this paper, we introduce an algorithm for procedural reading comprehension by translating the text into a general formalism that represents processes as a sequence of transitions over entity attributes (e.g., location, temperature). Leveraging pre-trained language models, our model obtains entity-aware and attribute-aware representations of the text by joint prediction of entity attributes and their transitions. Our model dynamically obtains contextual encodings of the procedural text exploiting information that is encoded about previous and current states to predict the transition of a certain attribute which can be identified as a spans of texts or from a pre-defined set of classes. Moreover, Our model achieves state of the art on two procedural reading comprehension datasets, namely ProPara and npn-Cooking.
Citation
@inproceedings{
amini2020procedural,
title={Procedural Reading Comprehension with Attribute-Aware Context Flow},
author={Aida Amini and Antoine Bosselut and Bhavana Dalvi and Yejin Choi and Hannaneh Hajishirzi},
booktitle={Automated Knowledge Base Construction},
year={2020},
url={https://openreview.net/forum?id=grnYRcBwjq},
doi={10.24432/C5C883}
}
