Distributional semantics and linguistic theory

G Boleda - Annual Review of Linguistics, 2020 - annualreviews.org
Distributional semantics provides multidimensional, graded, empirically induced word
representations that successfully capture many aspects of meaning in natural languages, as …

SemEval-2020 task 1: Unsupervised lexical semantic change detection

D Schlechtweg, B McGillivray, S Hengchen… - arXiv preprint arXiv …, 2020 - arxiv.org
Lexical Semantic Change detection, ie, the task of identifying words that change meaning
over time, is a very active research area, with applications in NLP, lexicography, and …

Polysemy—Evidence from Linguistics, Behavioral Science, and Contextualized Language Models

J Haber, M Poesio - Computational Linguistics, 2024 - direct.mit.edu
Polysemy is the type of lexical ambiguity where a word has multiple distinct but related
interpretations. In the past decade, it has been the subject of a great many studies across …

Grounding action descriptions in videos

M Regneri, M Rohrbach, D Wetzel, S Thater… - Transactions of the …, 2013 - direct.mit.edu
Recent work has shown that the integration of visual information into text-based models can
substantially improve model predictions, but so far only visual information extracted from …

Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses

A Garí Soler, M Apidianaki - Transactions of the Association for …, 2021 - direct.mit.edu
Pre-trained language models (LMs) encode rich information about linguistic structure but
their knowledge about lexical polysemy remains unclear. We propose a novel experimental …

From word types to tokens and back: A survey of approaches to word meaning representation and interpretation

M Apidianaki - Computational Linguistics, 2023 - direct.mit.edu
Vector-based word representation paradigms situate lexical meaning at different levels of
abstraction. Distributional and static embedding models generate a single vector per word …

Diachronic usage relatedness (DURel): A framework for the annotation of lexical semantic change

D Schlechtweg, SS Walde, S Eckmann - arXiv preprint arXiv:1804.06517, 2018 - arxiv.org
We propose a framework that extends synchronic polysemy annotation to diachronic
changes in lexical meaning, to counteract the lack of resources for evaluating computational …

When is a bishop not like a rook? When it's like a rabbi! Multi-prototype BERT embeddings for estimating semantic relationships

G Chronis, K Erk - Proceedings of the 24th Conference on …, 2020 - aclanthology.org
This paper investigates contextual language models, which produce token representations,
as a resource for lexical semantics at the word or type level. We construct multi-prototype …

Embedding words and senses together via joint knowledge-enhanced training

M Mancini, J Camacho-Collados, I Iacobacci… - arXiv preprint arXiv …, 2016 - arxiv.org
Word embeddings are widely used in Natural Language Processing, mainly due to their
success in capturing semantic information from massive corpora. However, their creation …

DWUG: A large resource of diachronic word usage graphs in four languages

D Schlechtweg, N Tahmasebi, S Hengchen… - arXiv preprint arXiv …, 2021 - arxiv.org
Word meaning is notoriously difficult to capture, both synchronically and diachronically. In
this paper, we describe the creation of the largest resource of graded contextualized …