A survey of the state of explainable AI for natural language processing

M Danilevsky, K Qian, R Aharonov, Y Katsis… - arXiv preprint arXiv …, 2020 - arxiv.org
Recent years have seen important advances in the quality of state-of-the-art models, but this
has come at the expense of models becoming less interpretable. This survey presents an …

Does BERT make any sense? Interpretable word sense disambiguation with contextualized embeddings

G Wiedemann, S Remus, A Chawla… - arXiv preprint arXiv …, 2019 - arxiv.org
Contextualized word embeddings (CWE) such as provided by ELMo (Peters et al., 2018),
Flair NLP (Akbik et al., 2018), or BERT (Devlin et al., 2019) are a major recent innovation in …

[PDF][PDF] The knowledge acquisition bottleneck problem in multilingual word sense disambiguation

T Pasini - Proceedings of the Twenty-Ninth International …, 2021 - ijcai.org
Abstract Word Sense Disambiguation (WSD) is the task of identifying the meaning of a word
in a given context. It lies at the base of Natural Language Processing as it provides semantic …

Word sense disambiguation for 158 languages using word embeddings only

V Logacheva, D Teslenko, A Shelmanov… - arXiv preprint arXiv …, 2020 - arxiv.org
Disambiguation of word senses in context is easy for humans, but is a major challenge for
automatic approaches. Sophisticated supervised and knowledge-based models were …

An unsupervised word sense disambiguation system for under-resourced languages

D Ustalov, D Teslenko, A Panchenko… - arXiv preprint arXiv …, 2018 - arxiv.org
In this paper, we present Watasense, an unsupervised system for word sense
disambiguation. Given a sentence, the system chooses the most relevant sense of each …

How much does a word weigh? Weighting word embeddings for word sense induction

N Arefyev, P Ermolaev, A Panchenko - arXiv preprint arXiv:1805.09209, 2018 - arxiv.org
The paper describes our participation in the first shared task on word sense induction and
disambiguation for the Russian language RUSSE'2018 (Panchenko et al., 2018). For each …

A framework for enriching lexical semantic resources with distributional semantics

C Biemann, S Faralli, A Panchenko… - Natural Language …, 2018 - cambridge.org
We present an approach to combining distributional semantic representations induced from
text corpora with manually constructed lexical semantic networks. While both kinds of …

Word sense disambiguation by semantic inference

X Wang, X Tang, W Qu, M Gu - 2017 international conference …, 2017 - ieeexplore.ieee.org
This paper proposes an algorithm for unsupervised Word Sense Disambiguation to bypass
the knowledge bottleneck faced by supervised approaches. By simulating the semantic …

Unsupervised Ultra-Fine Entity Typing with Distributionally Induced Word Senses

Ö Sevgili, S Remus, A Jana, A Panchenko… - … Conference on Analysis …, 2023 - Springer
The lack of annotated data is one of the challenging issues in an ultra-fine entity typing,
which is the task to assign semantic types for a given entity mention. Hence, automatic type …

Producing Usable Taxonomies Cheaply and Rapidly at Pinterest Using Discovered Dynamic -Topics

A Mahabal, J Luo, R Huang, M Ellsworth… - arXiv preprint arXiv …, 2023 - arxiv.org
Creating a taxonomy of interests is expensive and human-effort intensive: not only do we
need to identify nodes and interconnect them, in order to use the taxonomy, we must also …