Empowering llm to use smartphone for intelligent task automation

H Wen, Y Li, G Liu, S Zhao, T Yu, TJJ Li, S Jiang… - arXiv preprint arXiv …, 2023 - arxiv.org
Mobile task automation is an attractive technique that aims to enable voice-based hands-
free user interaction with smartphones. However, existing approaches suffer from poor …

Understanding the weakness of large language model agents within a complex android environment

M Xing, R Zhang, H Xue, Q Chen, F Yang… - Proceedings of the 30th …, 2024 - dl.acm.org
Large language models (LLMs) have empowered intelligent agents to execute intricate
tasks within domain-specific software such as browsers and games. However, when applied …

Os-atlas: A foundation action model for generalist gui agents

Z Wu, Z Wu, F Xu, Y Wang, Q Sun, C Jia… - arXiv preprint arXiv …, 2024 - arxiv.org
Existing efforts in building GUI agents heavily rely on the availability of robust commercial
Vision-Language Models (VLMs) such as GPT-4o and GeminiProVision. Practitioners are …

Autodroid: Llm-powered task automation in android

H Wen, Y Li, G Liu, S Zhao, T Yu, TJJ Li… - Proceedings of the 30th …, 2024 - dl.acm.org
Mobile task automation is an attractive technique that aims to enable voice-based hands-
free user interaction with smartphones. However, existing approaches suffer from poor …

Sociodojo: Building lifelong analytical agents with real-world text and time series

J Cheng, P Chin - The Twelfth International Conference on Learning …, 2024 - openreview.net
We introduce SocioDojo, an open-ended lifelong learning environment for developing ready-
to-deploy autonomous agents capable of performing human-like analysis and decision …

AutoDroid-V2: Boosting SLM-based GUI Agents via Code Generation

H Wen, S Tian, B Pavlov, W Du, Y Li, G Chang… - arXiv preprint arXiv …, 2024 - arxiv.org
Large language models (LLMs) have brought exciting new advances to mobile UI agents, a
long-standing research field that aims to complete arbitrary natural language tasks through …

A Mutual Information Duality Algorithm for Multi-Agent Specialization

S Juang, Q Cao, Y Zhou, R Liu, N Zhang, ES Liu - openreview.net
The social behavior change in a population has long been studied as an essential
component of multi-agent learning. The learning of behavioral change not only involves …