Active instruction tuning: Improving cross-task generalization by training on prompt sensitive tasks

PN Kung, F Yin, D Wu, KW Chang, N Peng - arXiv preprint arXiv …, 2023 - arxiv.org
Instruction tuning (IT) achieves impressive zero-shot generalization results by training large
language models (LLMs) on a massive amount of diverse tasks with instructions. However …