Periodic extrapolative generalisation in neural networks

P Belcak, R Wattenhofer - 2022 IEEE Symposium Series on …, 2022 - ieeexplore.ieee.org
The learning of the simplest possible computational pattern-periodicity-is an open problem
in the research of strong generalisation in neural networks. We formalise the problem of …

Neural Combinatorial Logic Circuit Synthesis from Input-Output Examples

P Belcak, R Wattenhofer - arXiv preprint arXiv:2210.16606, 2022 - arxiv.org
We propose a novel, fully explainable neural approach to synthesis of combinatorial logic
circuits from input-output examples. The carrying advantage of our method is that it readily …

Towards Foundation Models with Mathematical Understanding

P Belcak, R Wattenhofer - ICLR 2023 Workshop on Mathematical …, 2023 - openreview.net
We investigate the ability of transformer models to build representations of integer
sequences that are of utility to tasks where deeper mathematical understanding is needed …