Enabling conversational interaction with mobile ui using large language models
Conversational agents show the promise to allow users to interact with mobile devices using
language. However, to perform diverse UI tasks with natural language, developers typically …
language. However, to perform diverse UI tasks with natural language, developers typically …
Anglekindling: Supporting journalistic angle ideation with large language models
News media often leverage documents to find ideas for stories, while being critical of the
frames and narratives present. Developing angles from a document such as a press release …
frames and narratives present. Developing angles from a document such as a press release …
Graphologue: Exploring large language model responses with interactive diagrams
Large language models (LLMs) have recently soared in popularity due to their ease of
access and the unprecedented ability to synthesize text responses to diverse user …
access and the unprecedented ability to synthesize text responses to diverse user …
ID. 8: Co-Creating Visual Stories with Generative AI
Storytelling is an integral part of human culture and significantly impacts cognitive and socio-
emotional development and connection. Despite the importance of interactive visual …
emotional development and connection. Despite the importance of interactive visual …
There and back again: extracting formal domains for controllable neurosymbolic story authoring
Story generators using language models offer the automatic production of highly fluent
narrative content, but they are hard to control and understand, seizing creative tasks that …
narrative content, but they are hard to control and understand, seizing creative tasks that …
Style Vectors for Steering Generative Large Language Model
This research explores strategies for steering the output of large language models (LLMs)
towards specific styles, such as sentiment, emotion, or writing style, by adding style vectors …
towards specific styles, such as sentiment, emotion, or writing style, by adding style vectors …
PDFChatAnnotator: A Human-LLM Collaborative Multi-Modal Data Annotation Tool for PDF-Format Catalogs
The document contains substantial unannotated data, necessitating extensive manual
labeling efforts. To address this issue, we introduce PDFChatAnnotator, a human-LLM …
labeling efforts. To address this issue, we introduce PDFChatAnnotator, a human-LLM …
ContextCam: Bridging Context Awareness with Creative Human-AI Image Co-Creation
The rapid advancement of AI-generated content (AIGC) promises to transform various
aspects of human life significantly. This work particularly focuses on the potential of AIGC to …
aspects of human life significantly. This work particularly focuses on the potential of AIGC to …
Unblind Text Inputs: Predicting Hint-text of Text Input in Mobile Apps via LLM
Mobile apps have become indispensable for accessing and participating in various
environments, especially for low-vision users. Users with visual impairments can use screen …
environments, especially for low-vision users. Users with visual impairments can use screen …
" Mango Mango, How to Let The Lettuce Dry Without A Spinner?'': Exploring User Perceptions of Using An LLM-Based Conversational Assistant Toward Cooking …
The rapid advancement of the Large Language Model (LLM) has created numerous
potentials for integration with conversational assistants (CAs) assisting people in their daily …
potentials for integration with conversational assistants (CAs) assisting people in their daily …