Dissociating language and thought in large language models

K Mahowald, AA Ivanova, IA Blank, N Kanwisher… - Trends in Cognitive …, 2024 - cell.com
Large language models (LLMs) have come closest among all models to date to mastering
human language, yet opinions about their linguistic and cognitive capabilities remain split …

Symbols and grounding in large language models

E Pavlick - … Transactions of the Royal Society A, 2023 - royalsocietypublishing.org
Large language models (LLMs) are one of the most impressive achievements of artificial
intelligence in recent years. However, their relevance to the study of language more broadly …

Challenging big-bench tasks and whether chain-of-thought can solve them

M Suzgun, N Scales, N Schärli, S Gehrmann… - arXiv preprint arXiv …, 2022 - arxiv.org
BIG-Bench (Srivastava et al., 2022) is a diverse evaluation suite that focuses on tasks
believed to be beyond the capabilities of current language models. Language models have …

Promptaid: Prompt exploration, perturbation, testing and iteration using visual analytics for large language models

A Mishra, U Soni, A Arunkumar, J Huang… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) have gained widespread popularity due to their ability to
perform ad-hoc Natural Language Processing (NLP) tasks with a simple natural language …

Grounding large language models in interactive environments with online reinforcement learning

T Carta, C Romac, T Wolf, S Lamprier… - International …, 2023 - proceedings.mlr.press
Recent works successfully leveraged Large Language Models'(LLM) abilities to capture
abstract knowledge about world's physics to solve decision-making problems. Yet, the …

Emergent world representations: Exploring a sequence model trained on a synthetic task

K Li, AK Hopkins, D Bau, F Viégas, H Pfister… - arXiv preprint arXiv …, 2022 - arxiv.org
Language models show a surprising range of capabilities, but the source of their apparent
competence is unclear. Do these networks just memorize a collection of surface statistics, or …

Language models represent space and time

W Gurnee, M Tegmark - arXiv preprint arXiv:2310.02207, 2023 - arxiv.org
The capabilities of large language models (LLMs) have sparked debate over whether such
systems just learn an enormous collection of superficial statistics or a coherent model of the …

Reasoning or reciting? exploring the capabilities and limitations of language models through counterfactual tasks

Z Wu, L Qiu, A Ross, E Akyürek, B Chen… - arXiv preprint arXiv …, 2023 - arxiv.org
The impressive performance of recent language models across a wide range of tasks
suggests that they possess a degree of abstract reasoning skills. Are these skills general …

Meaning without reference in large language models

ST Piantadosi, F Hill - arXiv preprint arXiv:2208.02957, 2022 - arxiv.org
The widespread success of large language models (LLMs) has been met with skepticism
that they possess anything like human concepts or meanings. Contrary to claims that LLMs …

Do large language models know what humans know?

S Trott, C Jones, T Chang, J Michaelov… - Cognitive …, 2023 - Wiley Online Library
Humans can attribute beliefs to others. However, it is unknown to what extent this ability
results from an innate biological endowment or from experience accrued through child …