… models often generate summaries that are inconsistent with … tion, a document-level Natural Language Inference (NLI) … two standard benchmarks, FALSESUM and SUMMAC. Compared …
… of factualinconsistencies in generated sentences by identifying … For example, given an NLI model M(p, h), source document … -edge NLI based factualinconsistency detection method …
G Luo, W Fan, M Li, Y He, Y Yang… - Findings of the …, 2024 - aclanthology.org
… • Finally, we present a document-level factuality classifier … train a factual consistency classifier using an NLI model as … Realizing the diversity of inconsistencies and the challenges …
… sentence is inconsistent with respect to the document. Entity Error (… The success of the documentlevel approach lies on the fact that … We gratefully acknowledge the support of the UK …
… the task of localizing factual inconsistencies as identifying the set of “… Supervised We apply two recent off-the-shelf NLI models to … For example, the sentences “John missed the train and …
L Xu, Z Su, M Yu, J Xu, JD Choi, J Zhou… - Findings of the …, 2024 - aclanthology.org
… derive stronger Natural Language Inference (NLI) models, we … of generating a binary decision directly. A summary is thus … 50k examples from DocNLI and FalseSum respectively that do …
… examples that are diverse and inconsistent yet plausible. We show that models trained on a Falsesum-augmented NLI … benchmarks for detecting factualinconsistency in summarization. …
Y Li, X Hao, L Li - 2023 4th International Conference on …, 2023 - ieeexplore.ieee.org
… are many factualinconsistencies in the model-generated … levels of granularity, such as document-level and sentence-level. [… Constructing training dataset for classification models in NLI-…
… framework that generatesfactuallyinconsistent summaries … for identifying the factual inconsistencies within generated … to the data generated by FACTCC and FALSESUM and re-train …