Abstract Graphical User Interface (GUI) automation holds significant promise for assisting
users with complex tasks thereby boosting human productivity. Existing works leveraging …

Video creation has become increasingly popular, yet the expertise and effort required for
editing often pose barriers to beginners. In this paper, we explore the integration of large …

Recent advancements in HCI and AI research attempt to support user experience (UX)
practitioners with AI-enabled tools. Despite the potential of emerging models and new …

Graphical User Interface (GUI) automation holds significant promise for assisting users with
complex tasks, thereby boosting human productivity. Existing works leveraging Large …

Autonomous agents that execute human tasks by controlling computers can enhance
human productivity and application accessibility. Yet, progress in this field will be driven by …

Voice command interfaces (VCIs) have gained increasing importance, enabling hands-free
and eyes-free interaction with digital devices. However, the inherent complexity in …

Online GUI navigation on mobile devices has driven a lot of attention recent years since it
contributes to many real-world applications. With the rapid development of large language …

In this work, we introduce a novel approach that equips LLM agents with introspection,
enhancing consistency and adaptability in solving complex tasks. Our approach prompts …