Representations and generalization in artificial and brain neural networks

Q Li, B Sorscher, H Sompolinsky - Proceedings of the National Academy of …, 2024 - pnas.org
Humans and animals excel at generalizing from limited data, a capability yet to be fully
replicated in artificial intelligence. This perspective investigates generalization in biological …

A statistical mechanics framework for Bayesian deep neural networks beyond the infinite-width limit

R Pacelli, S Ariosto, M Pastore, F Ginelli… - Nature Machine …, 2023 - nature.com
Despite the practical success of deep neural networks, a comprehensive theoretical
framework that can predict practically relevant scores, such as the test accuracy, from …

[HTML][HTML] Resolution of similar patterns in a solvable model of unsupervised deep learning with structured data

A Baroffio, P Rotondo, M Gherardi - Chaos, Solitons & Fractals, 2024 - Elsevier
Empirical data, on which deep learning relies, has substantial internal structure, yet
prevailing theories often disregard this aspect. Recent research has led to the definition of …

Inversion dynamics of class manifolds in deep learning reveals tradeoffs underlying generalization

S Ciceri, L Cassani, M Osella, P Rotondo… - Nature Machine …, 2024 - nature.com
To achieve near-zero training error in a classification problem, the layers of a feed-forward
network have to disentangle the manifolds of data points with different labels to facilitate the …

Simplified derivations for high-dimensional convex learning problems

DG Clark, H Sompolinsky - arXiv preprint arXiv:2412.01110, 2024 - arxiv.org
Statistical physics provides tools for analyzing high-dimensional problems in machine
learning and theoretical neuroscience. These calculations, particularly those using the …

Nonlinear classification of neural manifolds with contextual information

F Mignacco, CN Chou, SY Chung - arXiv preprint arXiv:2405.06851, 2024 - arxiv.org
Understanding how neural systems efficiently process information through distributed
representations is a fundamental challenge at the interface of neuroscience and machine …

Neural Manifold Capacity Captures Representation Geometry, Correlations, and Task-Efficiency Across Species and Behaviors

CN Chou, L Arend, AJ Wakhloo, R Kim, W Slatton… - bioRxiv, 2024 - biorxiv.org
The study of the brain encompasses multiple scales, including temporal, spatial, and
functional aspects. To integrate understanding across these different levels and modalities, it …

Statistical Mechanics of Support Vector Regression

A Canatar, SY Chung - arXiv preprint arXiv:2412.05439, 2024 - arxiv.org
A key problem in deep learning and computational neuroscience is relating the geometrical
properties of neural representations to task performance. Here, we consider this problem for …

Representational learning by optimization of neural manifolds in an olfactory memory network

B Hu, NZ Temiz, CN Chou, P Rupprecht… - bioRxiv, 2024 - biorxiv.org
Higher brain functions depend on experience-dependent representations of relevant
information that may be organized by attractor dynamics or by geometrical modifications of …

Mental Recognition of Objects via Ramsey Sentences: How does the Human Brain Recognize Dog?

A Tozzi - Journal of NeuroPhilosophy, 2023 - jneurophilosophy.com
Dogs display vast phenotypic diversity, including differences in height, skull shape, tail, etc.
Yet, humans are almost always able to quickly recognize a dog, despite no single feature or …