Towards a functional understanding of gaze in goal-directed action

NH Illamperuma, J Fooken - Journal of Neurophysiology, 2024 - journals.physiology.org
Humans have creatively invented many games and sports that require goal-directed action.
We 1 throw, kick, hit, push, or slide objects of all shapes and sizes, aiming to successfully …

GEARS: Generalizable Multi-Purpose Embeddings for Gaze and Hand Data in VR Interactions

P Hallgarten, N Sendhilnathan, T Zhang… - Proceedings of the …, 2024 - dl.acm.org
Machine learning models using users' gaze and hand data to encode user interaction
behavior in VR are often tailored to a single task and sensor set, limiting their applicability in …

AR-in-VR simulator: A toolbox for rapid augmented reality simulation and user research

J Hadnett-Hunter, B Lundell, I Ellison-Taylor… - ACM Symposium on …, 2024 - dl.acm.org
While providing exciting opportunities for spatial computing, current generation augmented
reality (AR) headsets face visual quality and visual comfort issues. Designing headsets that …

A Robotics-Inspired Scanpath Model Reveals the Importance of Uncertainty and Semantic Object Cues for Gaze Guidance in Dynamic Scenes

V Mengers, N Roth, O Brock, K Obermayer… - arXiv preprint arXiv …, 2024 - arxiv.org
How we perceive objects around us depends on what we actively attend to, yet our eye
movements depend on the perceived objects. Still, object segmentation and gaze behavior …

Explainable Interfaces for Rapid Gaze-Based Interactions in Mixed Reality

M Yu, D Harris, I Jones, T Zhang, Y Liu… - arXiv preprint arXiv …, 2024 - arxiv.org
Gaze-based interactions offer a potential way for users to naturally engage with mixed reality
(XR) interfaces. Black-box machine learning models enabled higher accuracy for gaze …

Interactive Mediation Techniques for Error-Aware Gesture Input Systems

R Alghofaili, N Sendhilnathan, T Zhang, T Grossman… - Graphics …, 2024 - dl.acm.org
Input false-positive errors, where a system recognizes an input action that the user did not
perform, have been shown to be particularly costly for user experience. Recent work has …

Implicit gaze research for XR systems

N Sendhilnathan, AS Fernandes, MJ Proulx… - arXiv preprint arXiv …, 2024 - arxiv.org
Although eye-tracking technology is being integrated into more VR and MR headsets, the
true potential of eye tracking in enhancing user interactions within XR settings remains …

Real-World Scanpaths Exhibit Long-Term Temporal Dependencies: Considerations for Contextual AI for AR Applications

CS Burlingham, N Sendhilnathan, X Wu… - Proceedings of the …, 2024 - dl.acm.org
All-day augmented reality (AR) requires contextually-aware artificial intelligence (AI) models
that excel across diverse daily contexts. Eye tracking could be a key source of information …

Neural substrates for saccadic modulation of visual representations in mouse superior colliculus

J Hunt, A Buteau, S Hanson, A Poleg-Polsky, G Felsen - bioRxiv, 2024 - biorxiv.org
How do sensory systems account for stimuli generated by natural behavior? We addressed
this question by examining how an ethologically relevant class of saccades modulates …