Typology of risks of generative text-to-image models

C Bird, E Ungless, A Kasirzadeh - Proceedings of the 2023 AAAI/ACM …, 2023 - dl.acm.org
This paper investigates the direct risks and harms associated with modern text-to-image
generative models, such as DALL-E and Midjourney, through a comprehensive literature …

Unsafe diffusion: On the generation of unsafe images and hateful memes from text-to-image models

Y Qu, X Shen, X He, M Backes, S Zannettou… - Proceedings of the 2023 …, 2023 - dl.acm.org
State-of-the-art Text-to-Image models like Stable Diffusion and DALLE\cdot2 are
revolutionizing how people generate visual content. At the same time, society has serious …

Social biases through the text-to-image generation lens

R Naik, B Nushi - Proceedings of the 2023 AAAI/ACM Conference on AI …, 2023 - dl.acm.org
Text-to-Image (T2I) generation is enabling new applications that support creators, designers,
and general end users of productivity software by generating illustrative content with high …

Prompting4debugging: Red-teaming text-to-image diffusion models by finding problematic prompts

ZY Chin, CM Jiang, CC Huang, PY Chen… - arXiv preprint arXiv …, 2023 - arxiv.org
Text-to-image diffusion models, eg Stable Diffusion (SD), lately have shown remarkable
ability in high-quality content generation, and become one of the representatives for the …

Self-discovering interpretable diffusion latent directions for responsible text-to-image generation

H Li, C Shen, P Torr, V Tresp… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Diffusion-based models have gained significant popularity for text-to-image generation due
to their exceptional image-generation capabilities. A risk with these models is the potential …

Mma-diffusion: Multimodal attack on diffusion models

Y Yang, R Gao, X Wang, TY Ho… - Proceedings of the …, 2024 - openaccess.thecvf.com
In recent years Text-to-Image (T2I) models have seen remarkable advancements gaining
widespread adoption. However this progress has inadvertently opened avenues for …

Prompt-specific poisoning attacks on text-to-image generative models

S Shan, W Ding, J Passananti, H Zheng… - arXiv preprint arXiv …, 2023 - arxiv.org
Data poisoning attacks manipulate training data to introduce unexpected behaviors into
machine learning models at training time. For text-to-image generative models with massive …

Rickrolling the artist: Injecting backdoors into text encoders for text-to-image synthesis

L Struppek, D Hintersdorf… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
While text-to-image synthesis currently enjoys great popularity among researchers and the
general public, the security of these models has been neglected so far. Many text-guided …

Membership inference attacks against text-to-image generation models

Y Wu, N Yu, Z Li, M Backes, Y Zhang - 2022 - openreview.net
Text-to-image generation models have recently attracted unprecedented attention as they
unlatch imaginative applications in all areas of life. However, developing such models …

How well can text-to-image generative models understand ethical natural language interventions?

H Bansal, D Yin, M Monajatipoor, KW Chang - arXiv preprint arXiv …, 2022 - arxiv.org
Text-to-image generative models have achieved unprecedented success in generating high-
quality images based on natural language descriptions. However, it is shown that these …