Mobile agents are essential for automating tasks in complex and dynamic mobile
environments. As foundation models evolve, the demands for agents that can adapt in real …

Building a generalist model for user interface (UI) understanding is challenging due to
various foundational issues, such as platform diversity, resolution variation, and data …

Information seeking and integration is a complex cognitive task that consumes enormous
time and effort. Inspired by the remarkable progress of Large Language Models, recent …

This paper investigates the faithfulness of multimodal large language model (MLLM) agents
in the graphical user interface (GUI) environment, aiming to address the research question …

On-device control agents, especially on mobile devices, are responsible for operating
mobile devices to fulfill users' requests, enabling seamless and intuitive interactions …

AI Agents are changing the way work gets done, both in consumer and enterprise domains.
However, the design patterns and architectures to build highly capable agents or multi-agent …

Existing ML benchmarks lack the depth and diversity of annotations needed for evaluating
models on business process management (BPM) tasks. BPM is the practice of documenting …

We present AutoGLM, a new series in the ChatGLM family, designed to serve as foundation
agents for autonomous control of digital devices through Graphical User Interfaces (GUIs) …

Artificial intelligence (AI) methods are poised to revolutionize intellectual work, with
generative AI enabling automation of text analysis, text generation, and simple decision …

This paper introduces a novel mobile phone control architecture, termed``app agents", for
efficient interactions and controls across various Android apps. The proposed Lightweight …