Physics-informed machine learning

GE Karniadakis, IG Kevrekidis, L Lu… - Nature Reviews …, 2021 - nature.com
Despite great progress in simulating multiphysics problems using the numerical
discretization of partial differential equations (PDEs), one still cannot seamlessly incorporate …

Model complexity of deep learning: A survey

X Hu, L Chu, J Pei, W Liu, J Bian - Knowledge and Information Systems, 2021 - Springer
Abstract Model complexity is a fundamental problem in deep learning. In this paper, we
conduct a systematic overview of the latest studies on model complexity in deep learning …

Evaluating large language models in generating synthetic hci research data: a case study

P Hämäläinen, M Tavast, A Kunnari - … of the 2023 CHI Conference on …, 2023 - dl.acm.org
Collecting data is one of the bottlenecks of Human-Computer Interaction (HCI) research.
Motivated by this, we explore the potential of large language models (LLMs) in generating …

Deep neural networks and tabular data: A survey

V Borisov, T Leemann, K Seßler, J Haug… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Heterogeneous tabular data are the most commonly used form of data and are essential for
numerous critical and computationally demanding applications. On homogeneous datasets …

Neural operator: Learning maps between function spaces with applications to pdes

N Kovachki, Z Li, B Liu, K Azizzadenesheli… - Journal of Machine …, 2023 - jmlr.org
The classical development of neural networks has primarily focused on learning mappings
between finite dimensional Euclidean spaces or finite sets. We propose a generalization of …

[图书][B] The principles of deep learning theory

DA Roberts, S Yaida, B Hanin - 2022 - cambridge.org
This textbook establishes a theoretical framework for understanding deep learning models
of practical relevance. With an approach that borrows from theoretical physics, Roberts and …

Deep directly-trained spiking neural networks for object detection

Q Su, Y Chou, Y Hu, J Li, S Mei… - Proceedings of the …, 2023 - openaccess.thecvf.com
Spiking neural networks (SNNs) are brain-inspired energy-efficient models that encode
information in spatiotemporal dynamics. Recently, deep SNNs trained directly have shown …

Understanding plasticity in neural networks

C Lyle, Z Zheng, E Nikishin, BA Pires… - International …, 2023 - proceedings.mlr.press
Plasticity, the ability of a neural network to quickly change its predictions in response to new
information, is essential for the adaptability and robustness of deep reinforcement learning …

The shaped transformer: Attention models in the infinite depth-and-width limit

L Noci, C Li, M Li, B He, T Hofmann… - Advances in …, 2024 - proceedings.neurips.cc
In deep learning theory, the covariance matrix of the representations serves as aproxy to
examine the network's trainability. Motivated by the success of Transform-ers, we study the …

Image sensing with multilayer nonlinear optical neural networks

T Wang, MM Sohoni, LG Wright, MM Stein, SY Ma… - Nature …, 2023 - nature.com
Optical imaging is commonly used for both scientific and technological applications across
industry and academia. In image sensing, a measurement, such as of an object's position or …