Design guidelines for prompt engineering text-to-image generative models

V Liu, LB Chilton - Proceedings of the 2022 CHI Conference on Human …, 2022 - dl.acm.org
Text-to-image generative models are a new and powerful way to generate visual artwork.
However, the open-ended nature of text as interaction is double-edged; while users can …

A prompt log analysis of text-to-image generation systems

Y Xie, Z Pan, J Ma, L Jie, Q Mei - … of the ACM Web Conference 2023, 2023 - dl.acm.org
Recent developments in large language models (LLM) and generative AI have unleashed
the astonishing capabilities of text-to-image generation systems to synthesize high-quality …

PromptPaint: Steering Text-to-Image Generation Through Paint Medium-like Interactions

JJY Chung, E Adar - Proceedings of the 36th Annual ACM Symposium …, 2023 - dl.acm.org
While diffusion-based text-to-image (T2I) models provide a simple and powerful way to
generate images, guiding this generation remains a challenge. For concepts that are difficult …

Promptify: Text-to-image generation through interactive prompt exploration with large language models

S Brade, B Wang, M Sousa, S Oore… - Proceedings of the 36th …, 2023 - dl.acm.org
Text-to-image generative models have demonstrated remarkable capabilities in generating
high-quality images based on textual prompts. However, crafting prompts that accurately …

Promptmagician: Interactive prompt engineering for text-to-image creation

Y Feng, X Wang, KK Wong, S Wang… - … on Visualization and …, 2023 - ieeexplore.ieee.org
Generative text-to-image models have gained great popularity among the public for their
powerful capability to generate high-quality images based on natural language prompts …

The prompt artists

M Chang, S Druga, AJ Fiannaca, P Vergani… - Proceedings of the 15th …, 2023 - dl.acm.org
This paper examines the art practices, artwork, and motivations of prolific users of the latest
generation of text-to-image models. Through interviews, observations, and a user survey, we …

Initial images: using image prompts to improve subject representation in multimodal ai generated art

H Qiao, V Liu, L Chilton - Proceedings of the 14th Conference on …, 2022 - dl.acm.org
Advances in text-to-image generative models have made it easier for people to create art by
just prompting models with text. However, creating through text leaves users with limited …

Optimizing prompts for text-to-image generation

Y Hao, Z Chi, L Dong, F Wei - Advances in Neural …, 2024 - proceedings.neurips.cc
Well-designed prompts can guide text-to-image models to generate amazing images.
However, the performant prompts are often model-specific and misaligned with user input …

A taxonomy of prompt modifiers for text-to-image generation

J Oppenlaender - Behaviour & Information Technology, 2023 - Taylor & Francis
Text-guided synthesis of images has become enormously popular and online communities
dedicated to text-to-image generation and art generated with Artificial Intelligence (AI) have …

A word is worth a thousand pictures: Prompts as ai design material

C Kulkarni, S Druga, M Chang, A Fiannaca… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent advances in Machine-Learning have led to the development of models that generate
images based on a text description. Such large prompt-based text to image models (TTIs) …