Diffusion models: A comprehensive survey of methods and applications

L Yang, Z Zhang, Y Song, S Hong, R Xu, Y Zhao… - ACM Computing …, 2023 - dl.acm.org
Diffusion models have emerged as a powerful new family of deep generative models with
record-breaking performance in many applications, including image synthesis, video …

A review of graph neural networks in epidemic modeling

Z Liu, G Wan, BA Prakash, MSY Lau, W Jin - Proceedings of the 30th …, 2024 - dl.acm.org
Since the onset of the COVID-19 pandemic, there has been a growing interest in studying
epidemiological models. Traditional mechanistic models mathematically describe the …

A survey on oversmoothing in graph neural networks

TK Rusch, MM Bronstein, S Mishra - arXiv preprint arXiv:2303.10993, 2023 - arxiv.org
Node features of graph neural networks (GNNs) tend to become more similar with the
increase of the network depth. This effect is known as over-smoothing, which we …

Roformer: Enhanced transformer with rotary position embedding

J Su, M Ahmed, Y Lu, S Pan, W Bo, Y Liu - Neurocomputing, 2024 - Elsevier
Position encoding has recently been shown to be effective in transformer architecture. It
enables valuable supervision for dependency modeling between elements at different …

On neural differential equations

P Kidger - arXiv preprint arXiv:2202.02435, 2022 - arxiv.org
The conjoining of dynamical systems and deep learning has become a topic of great
interest. In particular, neural differential equations (NDEs) demonstrate that neural networks …

A survey on safety-critical driving scenario generation—A methodological perspective

W Ding, C Xu, M Arief, H Lin, B Li… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Autonomous driving systems have witnessed significant development during the past years
thanks to the advance in machine learning-enabled sensing and decision-making …

Graph-coupled oscillator networks

TK Rusch, B Chamberlain… - International …, 2022 - proceedings.mlr.press
Abstract We propose Graph-Coupled Oscillator Networks (GraphCON), a novel framework
for deep learning on graphs. It is based on discretizations of a second-order system of …

Neural temporal walks: Motif-aware representation learning on continuous-time dynamic graphs

M Jin, YF Li, S Pan - Advances in Neural Information …, 2022 - proceedings.neurips.cc
Continuous-time dynamic graphs naturally abstract many real-world systems, such as social
and transactional networks. While the research on continuous-time dynamic graph …

PDE-Net 2.0: Learning PDEs from data with a numeric-symbolic hybrid deep network

Z Long, Y Lu, B Dong - Journal of Computational Physics, 2019 - Elsevier
Partial differential equations (PDEs) are commonly derived based on empirical
observations. However, recent advances of technology enable us to collect and store …

Wireless network intelligence at the edge

J Park, S Samarakoon, M Bennis… - Proceedings of the …, 2019 - ieeexplore.ieee.org
Fueled by the availability of more data and computing power, recent breakthroughs in cloud-
based machine learning (ML) have transformed every aspect of our lives from face …