Semantic structure in deep learning

E Pavlick - Annual Review of Linguistics, 2022 - annualreviews.org
Deep learning has recently come to dominate computational linguistics, leading to claims of
human-level performance in a range of language processing tasks. Like much previous …

Explainability for large language models: A survey

H Zhao, H Chen, F Yang, N Liu, H Deng, H Cai… - ACM Transactions on …, 2024 - dl.acm.org
Large language models (LLMs) have demonstrated impressive capabilities in natural
language processing. However, their internal mechanisms are still unclear and this lack of …

Towards faithful model explanation in nlp: A survey

Q Lyu, M Apidianaki, C Callison-Burch - Computational Linguistics, 2024 - direct.mit.edu
End-to-end neural Natural Language Processing (NLP) models are notoriously difficult to
understand. This has given rise to numerous efforts towards model explainability in recent …

From natural language processing to neural databases

J Thorne, M Yazdani, M Saeidi… - Proceedings of the …, 2021 - discovery.ucl.ac.uk
In recent years, neural networks have shown impressive performance gains on long-
standing AI problems, such as answering queries from text and machine translation. These …

Specializing word embeddings (for parsing) by information bottleneck

XL Li, J Eisner - arXiv preprint arXiv:1910.00163, 2019 - arxiv.org
Pre-trained word embeddings like ELMo and BERT contain rich syntactic and semantic
information, resulting in state-of-the-art performance on various tasks. We propose a very …

Voxelwise encoding models show that cerebellar language representations are highly conceptual

A LeBel, S Jain, AG Huth - Journal of Neuroscience, 2021 - Soc Neuroscience
There is a growing body of research demonstrating that the cerebellum is involved in
language understanding. Early theories assumed that the cerebellum is involved in low …

Interpretation of black box nlp models: A survey

S Choudhary, N Chatterjee, SK Saha - arXiv preprint arXiv:2203.17081, 2022 - arxiv.org
An increasing number of machine learning models have been deployed in domains with
high stakes such as finance and healthcare. Despite their superior performances, many …

[HTML][HTML] Predicting semantic similarity between clinical sentence pairs using transformer models: Evaluation and representational analysis

M Ormerod, J Martínez del Rincón… - JMIR Medical …, 2021 - medinform.jmir.org
Background Semantic textual similarity (STS) is a natural language processing (NLP) task
that involves assigning a similarity score to 2 snippets of text based on their meaning. This …

A university map of course knowledge

ZA Pardos, AJH Nam - PloS one, 2020 - journals.plos.org
Knowledge representation has gained in relevance as data from the ubiquitous digitization
of behaviors amass and academia and industry seek methods to understand and reason …

[图书][B] Distributional semantics

A Lenci, M Sahlgren - 2023 - books.google.com
Distributional semantics develops theories and methods to represent the meaning of natural
language expressions, with vectors encoding their statistical distribution in linguistic …