The emergence of clusters in self-attention dynamics
B Geshkovski, C Letrouit… - Advances in Neural …, 2024 - proceedings.neurips.cc
Viewing Transformers as interacting particle systems, we describe the geometry of learned
representations when the weights are not time-dependent. We show that particles …
representations when the weights are not time-dependent. We show that particles …
[图书][B] Classical and relativistic rational extended thermodynamics of gases
T Ruggeri, M Sugiyama - 2021 - Springer
The book aims to present the recent developments in Rational Extended Thermodynamics
(RET) of gases in both classical and relativistic cases. The RET theory is a …
(RET) of gases in both classical and relativistic cases. The RET theory is a …
A quest toward a mathematical theory of the dynamics of swarms
This paper addresses some preliminary steps toward the modeling and qualitative analysis
of swarms viewed as living complex systems. The approach is based on the methods of …
of swarms viewed as living complex systems. The approach is based on the methods of …
Complete cluster predictability of the Cucker–Smale flocking model on the real line
We present the complete predictability of clustering for the Cucker–Smale (C–S) model on
the line. Emergence of multi-cluster flocking is often observed in numerical simulations for …
the line. Emergence of multi-cluster flocking is often observed in numerical simulations for …
Emergent dynamics of a thermodynamically consistent particle model
We present a thermodynamically consistent particle (TCP) model motivated by the theory of
multi-temperature mixture of fluids in the case of spatially homogeneous processes. The …
multi-temperature mixture of fluids in the case of spatially homogeneous processes. The …
[PDF][PDF] Uniform stability of the Cucker-Smale model and its application to the mean-field limit
1. Introduction. Collective behaviors of many-body systems are ubiquitous in the ensemble
of self-propelled particles, eg, flocking of birds, herding of sheep, and synchronicity of …
of self-propelled particles, eg, flocking of birds, herding of sheep, and synchronicity of …
Emergent behaviors of thermodynamic Cucker--Smale particles
We study the flocking dynamics of a generalized Cucker--Smale (CS) model for
thermodynamic particles. The original CS model deals with flocking dynamics of mechanical …
thermodynamic particles. The original CS model deals with flocking dynamics of mechanical …
[HTML][HTML] A note on the fixed-time bipartite flocking for nonlinear multi-agent systems
Q Xiao, H Liu, X Wang, Y Huang - Applied Mathematics Letters, 2020 - Elsevier
This work focuses on the fixed-time bipartite flocking control problem for multi-agent
systems. By employing the structurally balanced signed graph theory and a fixed-time …
systems. By employing the structurally balanced signed graph theory and a fixed-time …
[HTML][HTML] Time-delay effect on the flocking in an ensemble of thermomechanical Cucker–Smale particles
We study the communication time-delay effect on the emergent dynamics of thermodynamic
Cucker–Smale (TCS) ensemble with temperature as an internal state. In the presence of …
Cucker–Smale (TCS) ensemble with temperature as an internal state. In the presence of …
Asymptotic behavior and collision avoidance in the Cucker–Smale model
X Yin, D Yue, Z Chen - IEEE Transactions on Automatic Control, 2019 - ieeexplore.ieee.org
For the long-range-communicated Cucker-Smale (CS) model, asymptotic flocking can be
obtained by taking full use of a key equality about the kinetic energy. However, such …
obtained by taking full use of a key equality about the kinetic energy. However, such …