The Propensity for Density in Feed-forward Models

N Schoots, A Jackson, A Kholmovia, P McBurney… - ECAI 2024, 2024 - ebooks.iospress.nl
Does the process of training a neural network to solve a task tend to use all of the available
weights even when the task could be solved with fewer weights? To address this question …

Finding Strong Lottery Ticket Networks with Genetic Algorithms

P Altmann, J Schönberger, M Zorn, T Gabor - arXiv preprint arXiv …, 2024 - arxiv.org
According to the Strong Lottery Ticket Hypothesis, every sufficiently large neural network
with randomly initialized weights contains a sub-network which-still with its random weights …