Eliminating position bias of language models: A mechanistic approach
Position bias has proven to be a prevalent issue of modern language models (LMs), where
the models prioritize content based on its position within the given context. This bias often …
the models prioritize content based on its position within the given context. This bias often …
Superposition Prompting: Improving and Accelerating Retrieval-Augmented Generation
Despite the successes of large language models (LLMs), they exhibit significant drawbacks,
particularly when processing long contexts. Their inference cost scales quadratically with …
particularly when processing long contexts. Their inference cost scales quadratically with …
In-Context Learning with Noisy Labels
In-context learning refers to the emerging ability of large language models (LLMs) to perform
a target task without additional training, utilizing demonstrations of the task. Recent studies …
a target task without additional training, utilizing demonstrations of the task. Recent studies …