The emergence of clusters in self-attention dynamics

B Geshkovski, C Letrouit… - Advances in Neural …, 2024 - proceedings.neurips.cc
Viewing Transformers as interacting particle systems, we describe the geometry of learned
representations when the weights are not time-dependent. We show that particles …

[图书][B] Classical and relativistic rational extended thermodynamics of gases

T Ruggeri, M Sugiyama - 2021 - Springer
The book aims to present the recent developments in Rational Extended Thermodynamics
(RET) of gases in both classical and relativistic cases. The RET theory is a …

A quest toward a mathematical theory of the dynamics of swarms

N Bellomo, SY Ha - Mathematical Models and Methods in Applied …, 2017 - World Scientific
This paper addresses some preliminary steps toward the modeling and qualitative analysis
of swarms viewed as living complex systems. The approach is based on the methods of …

Complete cluster predictability of the Cucker–Smale flocking model on the real line

SY Ha, J Kim, J Park, X Zhang - Archive for Rational Mechanics and …, 2019 - Springer
We present the complete predictability of clustering for the Cucker–Smale (C–S) model on
the line. Emergence of multi-cluster flocking is often observed in numerical simulations for …

Emergent dynamics of a thermodynamically consistent particle model

SY Ha, T Ruggeri - Archive for rational mechanics and analysis, 2017 - Springer
We present a thermodynamically consistent particle (TCP) model motivated by the theory of
multi-temperature mixture of fluids in the case of spatially homogeneous processes. The …

[PDF][PDF] Uniform stability of the Cucker-Smale model and its application to the mean-field limit

SY Ha, J Kim, X Zhang - Kinet. Relat. Models, 2018 - pdfs.semanticscholar.org
1. Introduction. Collective behaviors of many-body systems are ubiquitous in the ensemble
of self-propelled particles, eg, flocking of birds, herding of sheep, and synchronicity of …

Emergent behaviors of thermodynamic Cucker--Smale particles

SY Ha, J Kim, T Ruggeri - SIAM journal on mathematical analysis, 2018 - SIAM
We study the flocking dynamics of a generalized Cucker--Smale (CS) model for
thermodynamic particles. The original CS model deals with flocking dynamics of mechanical …

[HTML][HTML] A note on the fixed-time bipartite flocking for nonlinear multi-agent systems

Q Xiao, H Liu, X Wang, Y Huang - Applied Mathematics Letters, 2020 - Elsevier
This work focuses on the fixed-time bipartite flocking control problem for multi-agent
systems. By employing the structurally balanced signed graph theory and a fixed-time …

[HTML][HTML] Time-delay effect on the flocking in an ensemble of thermomechanical Cucker–Smale particles

JG Dong, SY Ha, D Kim, J Kim - Journal of differential equations, 2019 - Elsevier
We study the communication time-delay effect on the emergent dynamics of thermodynamic
Cucker–Smale (TCS) ensemble with temperature as an internal state. In the presence of …

Asymptotic behavior and collision avoidance in the Cucker–Smale model

X Yin, D Yue, Z Chen - IEEE Transactions on Automatic Control, 2019 - ieeexplore.ieee.org
For the long-range-communicated Cucker-Smale (CS) model, asymptotic flocking can be
obtained by taking full use of a key equality about the kinetic energy. However, such …