Abspyramid: Benchmarking the abstraction ability of language models with a unified entailment graph

Z Wang, H Shi, W Wang, T Fang, H Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Cognitive research indicates that abstraction ability is essential in human intelligence, which
remains under-explored in language models. In this paper, we present AbsPyramid, a …

Entailment graph learning with textual entailment and soft transitivity

Z Chen, Y Feng, D Zhao - arXiv preprint arXiv:2204.03286, 2022 - arxiv.org
Typed entailment graphs try to learn the entailment relations between predicates from text
and model them as edges between predicate nodes. The construction of entailment graphs …

Smoothing entailment graphs with language models

N McKenna, T Li, M Johnson, M Steedman - arXiv preprint arXiv …, 2022 - arxiv.org
The diversity and Zipfian frequency distribution of natural language predicates in corpora
leads to sparsity in Entailment Graphs (EGs) built by Open Relation Extraction (ORE). EGs …

Language models are poor learners of directional inference

T Li, MJ Hosseini, S Weber, M Steedman - arXiv preprint arXiv:2210.04695, 2022 - arxiv.org
We examine LMs' competence of directional predicate entailments by supervised fine-tuning
with prompts. Our analysis shows that contrary to their apparent success on standard NLI …

Absinstruct: Eliciting abstraction ability from llms through explanation tuning with plausibility estimation

Z Wang, W Fan, Q Zong, H Zhang, S Choi… - arXiv preprint arXiv …, 2024 - arxiv.org
Abstraction ability is crucial in human intelligence, which can also benefit various tasks in
NLP study. Existing work shows that LLMs are deficient in abstract ability, and how to …

Multivalent entailment graphs for question answering

N McKenna, L Guillou, MJ Hosseini, SB de Vroe… - arXiv preprint arXiv …, 2021 - arxiv.org
Drawing inferences between open-domain natural language predicates is a necessity for
true language understanding. There has been much progress in unsupervised learning of …

Open-domain contextual link prediction and its complementarity with entailment graphs

MJ Hosseini, SB Cohen, M Johnson… - Findings of the …, 2021 - aclanthology.org
An open-domain knowledge graph (KG) has entities as nodes and natural language
relations as edges, and is constructed by extracting (subject, relation, object) triples from …

Language models for lexical inference in context

M Schmitt, H Schütze - arXiv preprint arXiv:2102.05331, 2021 - arxiv.org
Lexical inference in context (LIiC) is the task of recognizing textual entailment between two
very similar sentences, ie, sentences that only differ in one expression. It can therefore be …

Incorporating temporal information in entailment graph mining

L Guillou, SB De Vroe, MJ Hosseini, M Johnson… - arXiv preprint arXiv …, 2021 - arxiv.org
We present a novel method for injecting temporality into entailment graphs to address the
problem of spurious entailments, which may arise from similar but temporally distinct events …

Aspectuality across genre: A distributional semantics approach

T Kober, M Alikhani, M Stone, M Steedman - arXiv preprint arXiv …, 2020 - arxiv.org
The interpretation of the lexical aspect of verbs in English plays a crucial role for recognizing
textual entailment and learning discourse-level inferences. We show that two elementary …