Recently, the emergence of pre-trained models (PTMs) has brought natural language
processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs …

Adult semantic memory has been traditionally conceptualized as a relatively static memory
system that consists of knowledge about the world, concepts, and symbols. Considerable …

One of the most remarkable properties of word embeddings is the fact that they capture
certain types of semantic and syntactic relationships. Recently, pre-trained language models …

Pretrained language models have been shown to encode relational information, such as the
relations between entities or concepts in knowledge-bases--(Paris, Capital, France) …

A characteristic feature of human semantic cognition is its ability to not only store and
retrieve the properties of concepts observed through experience, but to also facilitate the …

We introduce HyperLex—a data set and evaluation resource that quantifies the extent of the
semantic category membership, that is, type-of relation, also known as hyponymy …

How does first-person sensory experience contribute to knowledge? Contrary to the
suppositions of early empiricist philosophers, people who are born blind know about …

Learning commonsense knowledge from natural language text is nontrivial due to reporting
bias: people rarely state the obvious, eg," My house is bigger than me." However, while …

As the use of deep learning techniques has grown across various fields over the past
decade, complaints about the opaqueness of the black-box models have increased …

Distributional methods have proven to excel at capturing fuzzy, graded aspects of meaning
(Italy is more similar to Spain than to Germany). In contrast, it is difficult to extract the values …