Attending to graph transformers

L Müller, M Galkin, C Morris, L Rampášek - arXiv preprint arXiv …, 2023 - arxiv.org
Recently, transformer architectures for graphs emerged as an alternative to established
techniques for machine learning with graphs, such as (message-passing) graph neural …

Faenet: Frame averaging equivariant gnn for materials modeling

AA Duval, V Schmidt… - International …, 2023 - proceedings.mlr.press
Applications of machine learning techniques for materials modeling typically involve
functions that are known to be equivariant or invariant to specific symmetries. While graph …

Artificial intelligence for science in quantum, atomistic, and continuum systems

X Zhang, L Wang, J Helwig, Y Luo, C Fu, Y Xie… - arXiv preprint arXiv …, 2023 - arxiv.org
Advances in artificial intelligence (AI) are fueling a new paradigm of discoveries in natural
sciences. Today, AI has started to advance natural sciences by improving, accelerating, and …

Diffusion models in protein structure and docking

J Yim, H Stärk, G Corso, B Jing… - Wiley …, 2024 - Wiley Online Library
Generative AI is rapidly transforming the frontier of research in computational structural
biology. Indeed, recent successes have substantially advanced protein design and drug …

From 3D point‐cloud data to explainable geometric deep learning: State‐of‐the‐art and future challenges

A Saranti, B Pfeifer, C Gollob… - … : Data Mining and …, 2024 - Wiley Online Library
We present an exciting journey from 3D point‐cloud data (PCD) to the state of the art in
graph neural networks (GNNs) and their evolution with explainable artificial intelligence …

Enhancing geometric representations for molecules with equivariant vector-scalar interactive message passing

Y Wang, T Wang, S Li, X He, M Li, Z Wang… - Nature …, 2024 - nature.com
Geometric deep learning has been revolutionizing the molecular modeling field. Despite the
state-of-the-art neural network models are approaching ab initio accuracy for molecular …

Learning hierarchical protein representations via complete 3d graph networks

L Wang, H Liu, Y Liu, J Kurtin, S Ji - arXiv preprint arXiv:2207.12600, 2022 - arxiv.org
We consider representation learning for proteins with 3D structures. We build 3D graphs
based on protein structures and develop graph networks to learn their representations …

Neural injective functions for multisets, measures and graphs via a finite witness theorem

T Amir, S Gortler, I Avni, R Ravina… - Advances in Neural …, 2024 - proceedings.neurips.cc
Injective multiset functions have a key role in the theoretical study of machine learning on
multisets and graphs. Yet, there remains a gap between the provably injective multiset …

A Hitchhiker's Guide to Geometric GNNs for 3D Atomic Systems

A Duval, SV Mathis, CK Joshi, V Schmidt… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent advances in computational modelling of atomic systems, spanning molecules,
proteins, and materials, represent them as geometric graphs with atoms embedded as …

Is distance matrix enough for geometric deep learning?

Z Li, X Wang, Y Huang… - Advances in Neural …, 2024 - proceedings.neurips.cc
Abstract Graph Neural Networks (GNNs) are often used for tasks involving the 3D geometry
of a given graph, such as molecular dynamics simulation. While incorporating Euclidean …