Large-scale text-to-image generation models for visual artists' creative works

HK Ko, G Park, H Jeon, J Jo, J Kim, J Seo - Proceedings of the 28th …, 2023 - dl.acm.org
Large-scale Text-to-image Generation Models (LTGMs)(eg, DALL-E), self-supervised deep
learning models trained on a huge dataset, have demonstrated the capacity for generating …

An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions

J Shi, R Jain, H Doh, R Suzuki, K Ramani - arXiv preprint arXiv …, 2023 - arxiv.org
Generative AI (GenAI) has shown remarkable capabilities in generating diverse and realistic
content across different formats like images, videos, and text. In Generative AI, human …

Too late to be creative? AI-empowered tools in creative processes

AHC Hwang - CHI conference on human factors in computing …, 2022 - dl.acm.org
The present case study examines the product landscape of current AI-empowered co-
creative tools. Specifically, I review literature in both creativity and HCI research and …

Cells, generators, and lenses: Design framework for object-oriented interaction with large language models

TS Kim, Y Lee, M Chang, J Kim - Proceedings of the 36th Annual ACM …, 2023 - dl.acm.org
Large Language Models (LLMs) have become the backbone of numerous writing interfaces
with the goal of supporting end-users across diverse writing tasks. While LLMs reduce the …

Investigating positive and negative qualities of human-in-the-loop optimization for designing interaction techniques

L Chan, YC Liao, GB Mo, JJ Dudley… - Proceedings of the …, 2022 - dl.acm.org
Designers reportedly struggle with design optimization tasks where they are asked to find a
combination of design parameters that maximizes a given set of objectives. In HCI, design …

BO as assistant: Using Bayesian optimization for asynchronously generating design suggestions

Y Koyama, M Goto - Proceedings of the 35th Annual ACM Symposium on …, 2022 - dl.acm.org
Many design tasks involve parameter adjustment, and designers often struggle to find
desirable parameter value combinations by manipulating sliders back and forth. For such a …

Towards practical preferential Bayesian optimization with skew Gaussian processes

S Takeno, M Nomura… - … Conference on Machine …, 2023 - proceedings.mlr.press
We study preferential Bayesian optimization (BO) where reliable feedback is limited to
pairwise comparison called duels. An important challenge in preferential BO, which uses the …

Expressive communication: Evaluating developments in generative models and steering interfaces for music creation

R Louie, J Engel, CZA Huang - … of the 27th International Conference on …, 2022 - dl.acm.org
There is an increasing interest from ML and HCI communities in empowering creators with
better generative models and more intuitive interfaces with which to control them. In music …

Photographic lighting design with photographer-in-the-loop bayesian optimization

K Yamamoto, Y Koyama, Y Ochiai - Proceedings of the 35th annual ACM …, 2022 - dl.acm.org
It is important for photographers to have the best possible lighting configuration at the time of
shooting; otherwise, they need post-processing on images, which may cause artifacts and …

PAGURI: a user experience study of creative interaction with text-to-music models

F Ronchini, L Comanducci, G Perego… - arXiv preprint arXiv …, 2024 - arxiv.org
In recent years, text-to-music models have been the biggest breakthrough in automatic
music generation. While they are unquestionably a showcase of technological progress, it is …