[图书][B] Grammatical theory: From transformational grammar to constraint-based approaches

S Müller - 2023 - library.oapen.org
language that I used in the German version of this book since many of the phenomena that
will be dealt with cannot be explained with English as the object language. … phrase structure

[PDF][PDF] Modern language models refute Chomsky's approach to language

S Piantadosi - Lingbuzz Preprint, lingbuzz, 2023 - lingbuzz.net
… Virtually all of the structure we see in language can come from learning a good model of
strings, not directly modeling the world. Models therefore show a logically possible dissociation …

Matching lemmas in a bilingual language competence and production model: Evidence from intrasentential code-switching

C Myers-Scotton, JL Jake - The bilingualism reader, 2020 - taylorfrancis.com
… counterpart projecting the frame is that the object pronoun clitic occurs before the inflected
verb in (7) while the object pronoun occurs according to English structural constraints in (9). …

Transformer protein language models are unsupervised structure learners

R Rao, J Meier, T Sercu, S Ovchinnikov, A Rives - Biorxiv, 2020 - biorxiv.org
… -art unsupervised structurelanguage modeling perplexity and unsupervised structure
learning. A similar scaling law has been observed previously for supervised secondary structure

Lack of selectivity for syntax relative to word meanings throughout the language network

E Fedorenko, IA Blank, M Siegelman, Z Mineroff - Cognition, 2020 - Elsevier
… , to dependency structure building and composition, to word-order-related processes—the
general idea of syntax selectivity remains prominent in cognitive neuroscience of language. …

[图书][B] What writers know: The language, process, and structure of written discourse

M Nystrand - 2023 - books.google.com
… investigation of language: The common denominator here is written discourse-its structure
and use, plus the ways in which it is learned. Investigation of the language and structure of …

A hierarchy of linguistic predictions during natural language comprehension

M Heilbron, K Armeni, JM Schoffelen… - Proceedings of the …, 2022 - National Acad Sciences
… Interestingly, such a “highly incremental” account also implies that prediction is hierarchical
in linguistic structure, which is exactly what we find (Fig. 6). Importantly, both possibilities cast …

Llm-pruner: On the structural pruning of large language models

X Ma, G Fang, X Wang - Advances in neural information …, 2023 - proceedings.neurips.cc
… of the language models, especially structural pruning [26]. Structural pruning removes the
… There are several ways to remove the structure, such as l1-dependent pruning [16, 72], first-…

Embeddings from protein language models predict conservation and variant effects

C Marquet, M Heinzinger, T Olenyi, C Dallago… - Human genetics, 2022 - Springer
… Embeddings predicted conservation: First, we established that protein Language Models
(pLMs) capture information correlated with residue conservation without ever seeing any such …

[图书][B] Linguistic structure prediction

NA Smith - 2022 - books.google.com
… We also survey natural language processing problems to which these methods are being
applied, and we address related topics in probabilistic inference, optimization, and …