Pre-trained language models for text generation: A survey

J Li, T Tang, WX Zhao, JY Nie, JR Wen - ACM Computing Surveys, 2024 - dl.acm.org
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …

A survey on fairness in large language models

Y Li, M Du, R Song, X Wang, Y Wang - arXiv preprint arXiv:2308.10149, 2023 - arxiv.org
Large language models (LLMs) have shown powerful performance and development
prospect and are widely deployed in the real world. However, LLMs can capture social …

The rise and potential of large language model based agents: A survey

Z Xi, W Chen, X Guo, W He, Y Ding, B Hong… - arXiv preprint arXiv …, 2023 - arxiv.org
For a long time, humanity has pursued artificial intelligence (AI) equivalent to or surpassing
the human level, with AI agents considered a promising vehicle for this pursuit. AI agents are …

Unlearning bias in language models by partitioning gradients

C Yu, S Jeoung, A Kasi, P Yu, H Ji - Findings of the Association for …, 2023 - aclanthology.org
Recent research has shown that large-scale pretrained language models, specifically
transformers, tend to exhibit issues relating to racism, sexism, religion bias, and toxicity in …

Benchmarking intersectional biases in NLP

JP Lalor, Y Yang, K Smith, N Forsgren… - Proceedings of the …, 2022 - aclanthology.org
There has been a recent wave of work assessing the fairness of machine learning models in
general, and more specifically, on natural language processing (NLP) models built using …

Causal-debias: Unifying debiasing in pretrained language models and fine-tuning via causal invariant learning

F Zhou, Y Mao, L Yu, Y Yang… - Proceedings of the 61st …, 2023 - aclanthology.org
Demographic biases and social stereotypes are common in pretrained language models
(PLMs), and a burgeoning body of literature focuses on removing the unwanted …

The next generation of machine learning for tracking adaptation texts

AJ Sietsma, JD Ford, JC Minx - Nature Climate Change, 2024 - nature.com
Abstract Machine learning presents opportunities for tracking evidence on climate change
adaptation, including text-based methods from natural language processing. In theory, such …

Trustgpt: A benchmark for trustworthy and responsible large language models

Y Huang, Q Zhang, L Sun - arXiv preprint arXiv:2306.11507, 2023 - arxiv.org
Large Language Models (LLMs) such as ChatGPT, have gained significant attention due to
their impressive natural language processing capabilities. It is crucial to prioritize human …

Adept: A debiasing prompt framework

K Yang, C Yu, YR Fung, M Li, H Ji - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
Several works have proven that finetuning is an applicable approach for debiasing
contextualized word embeddings. Similarly, discrete prompts with semantic meanings have …

Social-group-agnostic bias mitigation via the stereotype content model

A Omrani, AS Ziabari, C Yu, P Golazizian… - Proceedings of the …, 2023 - aclanthology.org
Existing bias mitigation methods require social-group-specific word pairs (eg,“man”–
“woman”) for each social attribute (eg, gender), restricting the bias mitigation to only one …