A primer on motion capture with deep learning: principles, pitfalls, and perspectives

A Mathis, S Schneider, J Lauer, MW Mathis - Neuron, 2020 - cell.com
Extracting behavioral measurements non-invasively from video is stymied by the fact that it is
a hard computational problem. Recent advances in deep learning have tremendously …

[HTML][HTML] Measuring and modeling the motor system with machine learning

SB Hausmann, AM Vargas, A Mathis… - Current opinion in …, 2021 - Elsevier
The utility of machine learning in understanding the motor system is promising a revolution
in how to collect, measure, and analyze data. The field of movement science already …

Connectome-constrained deep mechanistic networks predict neural responses across the fly visual system at single-neuron resolution

JK Lappalainen, FD Tschopp, S Prakhya, M McGill… - bioRxiv, 2023 - biorxiv.org
We can now measure the connectivity of every neuron in a neural circuit, but we are still
blind to other biological details, including the dynamical characteristics of each neuron. The …

MouseNet: A biologically constrained convolutional neural network model for the mouse visual cortex

J Shi, B Tripp, E Shea-Brown, S Mihalas… - PLOS Computational …, 2022 - journals.plos.org
Convolutional neural networks trained on object recognition derive inspiration from the
neural architecture of the visual system in mammals, and have been used as models of the …

A leg to stand on: computational models of proprioception

CJ Dallmann, P Karashchuk, BW Brunton… - Current opinion in …, 2021 - Elsevier
Dexterous motor control requires feedback from proprioceptors, internal mechanosensory
neurons that sense the body's position and movement. An outstanding question in …

Learning to learn with feedback and local plasticity

J Lindsey, A Litwin-Kumar - Advances in Neural Information …, 2020 - proceedings.neurips.cc
Interest in biologically inspired alternatives to backpropagation is driven by the desire to
both advance connections between deep learning and neuroscience and address …

Encoding of limb state by single neurons in the cuneate nucleus of awake monkeys

C Versteeg, JM Rosenow… - Journal of …, 2021 - journals.physiology.org
The cuneate nucleus (CN) is among the first sites along the neuraxis where proprioceptive
signals can be integrated, transformed, and modulated. The objective of the study was to …

A computational model of insect campaniform sensilla predicts encoding of forces during walking

NS Szczecinski, CJ Dallmann… - Bioinspiration & …, 2021 - iopscience.iop.org
Control of forces is essential in both animals and walking machines. Insects measure forces
as strains in their exoskeletons via campaniform sensilla (CS). Deformations of cuticular …

[HTML][HTML] K-mixup: Data augmentation for offline reinforcement learning using mixup in a Koopman invariant subspace

J Jang, J Han, J Kim - Expert Systems with Applications, 2023 - Elsevier
In this study, we propose a new data augmentation technique, Koopman-mixup (K-mixup), to
improve the learning stability and final performance of offline reinforcement learning (RL) …

Direct assembly and tuning of dynamical neural networks for kinematics

CK Guie, NS Szczecinski - Conference on Biomimetic and Biohybrid …, 2022 - Springer
It is unknown precisely how the nervous system of invertebrates combines multiple sensory
inputs to calculate more abstract quantities, eg, combining the angle of multiple leg joints to …