Evaluating large language models at evaluating instruction following
As research in large language models (LLMs) continues to accelerate, LLM-based
evaluation has emerged as a scalable and cost-effective alternative to human evaluations …
evaluation has emerged as a scalable and cost-effective alternative to human evaluations …
Robot learning in the era of foundation models: A survey
The proliferation of Large Language Models (LLMs) has s fueled a shift in robot learning
from automation towards general embodied Artificial Intelligence (AI). Adopting foundation …
from automation towards general embodied Artificial Intelligence (AI). Adopting foundation …
Branch-solve-merge improves large language model evaluation and generation
Large Language Models (LLMs) are frequently used for multi-faceted language generation
and evaluation tasks that involve satisfying intricate user constraints or taking into account …
and evaluation tasks that involve satisfying intricate user constraints or taking into account …
Can Large Language Models Understand Real-World Complex Instructions?
Large language models (LLMs) can understand human instructions, showing their potential
for pragmatic applications beyond traditional NLP tasks. However, they still struggle with …
for pragmatic applications beyond traditional NLP tasks. However, they still struggle with …
From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Language Models
It is imperative for Large language models (LLMs) to follow instructions with elaborate
requirements (ie Complex Instructions Following). Yet, it remains under-explored how to …
requirements (ie Complex Instructions Following). Yet, it remains under-explored how to …
Controllable Text Generation in the Instruction-Tuning Era
While most research on controllable text generation has focused on steering base
Language Models, the emerging instruction-tuning and prompting paradigm offers an …
Language Models, the emerging instruction-tuning and prompting paradigm offers an …
Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principles
Recent works leverage LLMs to roleplay realistic social scenarios, aiding novices in
practicing their social skills. However, simulating sensitive interactions, such as in mental …
practicing their social skills. However, simulating sensitive interactions, such as in mental …
Intertwining CP and NLP: The Generation of Unreasonably Constrained Sentences
A Bonlarron, JC Régin - arXiv preprint arXiv:2406.15473, 2024 - arxiv.org
Constrained text generation remains a challenging task, particularly when dealing with hard
constraints. Traditional Natural Language Processing (NLP) approaches prioritize …
constraints. Traditional Natural Language Processing (NLP) approaches prioritize …
Open Sesame? Open Salami! Personalizing Vocabulary Assessment-Intervention for Children via Pervasive Profiling and Bespoke Storybook Generation
Children acquire language by interacting with their surroundings. Due to the different
language environments each child is exposed to, the words they encounter and need in …
language environments each child is exposed to, the words they encounter and need in …
CFBench: A Comprehensive Constraints-Following Benchmark for LLMs
The adeptness of Large Language Models (LLMs) in comprehending and following natural
language instructions is critical for their deployment in sophisticated real-world applications …
language instructions is critical for their deployment in sophisticated real-world applications …