Lightning Pose: improved animal pose estimation via semi-supervised learning, Bayesian ensembling and cloud-native open-source tools

D Biderman, MR Whiteway, C Hurwitz, N Greenspan… - Nature …, 2024 - nature.com
Contemporary pose estimation methods enable precise measurements of behavior via
supervised deep learning with hand-labeled video frames. Although effective in many cases …

replicAnt: a pipeline for generating annotated images of animals in complex environments using Unreal Engine

F Plum, R Bulla, HK Beck, N Imirzian… - Nature …, 2023 - nature.com
Deep learning-based computer vision methods are transforming animal behavioural
research. Transfer learning has enabled work in non-model species, but still requires hand …

Ponymation: Learning Articulated 3D Animal Motions from Unlabeled Online Videos

K Sun, D Litvak, Y Zhang, H Li, J Wu, S Wu - European Conference on …, 2025 - Springer
We introduce a new method for learning a generative model of articulated 3D animal
motions from raw, unlabeled online videos. Unlike existing approaches for 3D motion …

Whole-body simulation of realistic fruit fly locomotion with deep reinforcement learning

R Vaxenburg, I Siwanowicz, J Merel, AA Robie… - bioRxiv, 2024 - biorxiv.org
The body of an animal influences how the nervous system produces behavior. Therefore,
detailed modeling of the neural control of sensorimotor behavior requires a detailed model …

Linking cognitive strategy, neural mechanism, and movement statistics in group foraging behaviors

R Urbaniak, M Xie, E Mackevicius - Scientific Reports, 2024 - nature.com
Foraging for food is a rich and ubiquitous animal behavior that involves complex cognitive
decisions, and interactions between different individuals and species. There has been …

UPose3D: Uncertainty-Aware 3D Human Pose Estimation with Cross-View and Temporal Cues

V Davoodnia, S Ghorbani, MA Carbonneau… - … on Computer Vision, 2025 - Springer
We introduce UPose3D, a novel approach for multi-view 3D human pose estimation,
addressing challenges in accuracy and scalability. Our method advances existing pose …

Mask as Supervision: Leveraging Unified Mask Information for Unsupervised 3D Pose Estimation

Y Yang, Y Qiao, X Sun - European Conference on Computer Vision, 2025 - Springer
Automatic estimation of 3D human pose from monocular RGB images is a challenging and
unsolved problem in computer vision. In a supervised manner, approaches heavily rely on …

Application of a novel deep learning–based 3D videography workflow to bat flight

J Håkansson, BL Quinn, AL Shultz… - Annals of the New …, 2024 - Wiley Online Library
Studying the detailed biomechanics of flying animals requires accurate three‐dimensional
coordinates for key anatomical landmarks. Traditionally, this relies on manually digitizing …

Unsupervised 3D Keypoint Discovery with Multi-View Geometry

S Honari, C Zhao, M Salzmann… - … Conference on 3D Vision …, 2024 - ieeexplore.ieee.org
Analyzing and training 3D body posture models depend heavily on the availability of joint
labels that are commonly acquired through laborious manual annotation of body joints or via …

SuperAnimal pretrained pose estimation models for behavioral analysis

S Ye, A Filippova, J Lauer, S Schneider, M Vidal… - Nature …, 2024 - nature.com
Quantification of behavior is critical in diverse applications from neuroscience, veterinary
medicine to animal conservation. A common key step for behavioral analysis is first …