Tracking everything everywhere all at once

Q Wang, YY Chang, R Cai, Z Li… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present a new test-time optimization method for estimating dense and long-range motion
from a video sequence. Prior optical flow or particle video tracking algorithms typically …

Dynamic 3d gaussians: Tracking by persistent dynamic view synthesis

J Luiten, G Kopanas, B Leibe, D Ramanan - arXiv preprint arXiv …, 2023 - arxiv.org
We present a method that simultaneously addresses the tasks of dynamic scene novel-view
synthesis and six degree-of-freedom (6-DOF) tracking of all dense scene elements. We …

Dynamic 3d gaussians: Tracking by persistent dynamic view synthesis

J Luiten, G Kopanas, B Leibe… - … Conference on 3D …, 2024 - ieeexplore.ieee.org
We present a method that simultaneously addresses the tasks of dynamic scene novel-view
synthesis and six degree-of-freedom (6-DOF) tracking of all dense scene elements. We …

[HTML][HTML] Tracking and mapping in medical computer vision: A review

A Schmidt, O Mohareri, S DiMaio, MC Yip… - Medical Image …, 2024 - Elsevier
As computer vision algorithms increase in capability, their applications in clinical systems
will become more pervasive. These applications include: diagnostics, such as colonoscopy …

Videoswap: Customized video subject swapping with interactive semantic point correspondence

Y Gu, Y Zhou, B Wu, L Yu, JW Liu… - Proceedings of the …, 2024 - openaccess.thecvf.com
Current diffusion-based video editing primarily focuses on structure-preserved editing by
utilizing various dense correspondences to ensure temporal consistency and motion …

Dense optical tracking: connecting the dots

G Le Moing, J Ponce, C Schmid - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Recent approaches to point tracking are able to recover the trajectory of any scene point
through a large portion of a video despite the presence of occlusions. They are however too …

Segment anything meets point tracking

F Rajič, L Ke, YW Tai, CK Tang, M Danelljan… - arXiv preprint arXiv …, 2023 - arxiv.org
The Segment Anything Model (SAM) has established itself as a powerful zero-shot image
segmentation model, employing interactive prompts such as points to generate masks. This …

Robotap: Tracking arbitrary points for few-shot visual imitation

M Vecerik, C Doersch, Y Yang… - … on Robotics and …, 2024 - ieeexplore.ieee.org
For robots to be useful outside labs and specialized factories we need a way to teach them
new useful behaviors quickly. Current approaches lack either the generality to onboard new …

Mft: Long-term tracking of every pixel

M Neoral, J Šerých, J Matas - Proceedings of the IEEE/CVF …, 2024 - openaccess.thecvf.com
Abstract We propose MFT--Multi-Flow dense Tracker--a novel method for dense, pixel-level,
long-term tracking. The approach exploits optical flows estimated not only between …

Md-splatting: Learning metric deformation from 4d gaussians in highly deformable scenes

BP Duisterhof, Z Mandi, Y Yao, JW Liu… - arXiv preprint arXiv …, 2023 - arxiv.org
Accurate 3D tracking in highly deformable scenes with occlusions and shadows can
facilitate new applications in robotics, augmented reality, and generative AI. However …