Automated design of agentic systems

S Hu, C Lu, J Clune - arXiv preprint arXiv:2408.08435, 2024 - arxiv.org
Researchers are investing substantial effort in developing powerful general-purpose agents,
wherein Foundation Models are used as modules within agentic systems (eg Chain-of …

Evolution transformer: In-context evolutionary optimization

R Lange, Y Tian, Y Tang - Proceedings of the Genetic and Evolutionary …, 2024 - dl.acm.org
Evolutionary optimization algorithms are often derived from loose biological analogies and
struggle to leverage information obtained during the sequential course of optimization. An …

Discovering Preference Optimization Algorithms with and for Large Language Models

C Lu, S Holt, C Fanconi, AJ Chan, J Foerster… - arXiv preprint arXiv …, 2024 - arxiv.org
Offline preference optimization is a key method for enhancing and controlling the quality of
Large Language Model (LLM) outputs. Typically, preference optimization is approached as …

A Test of the Thermodynamics of Evolution

D Sadasivan, C Cantu, C Marsh, A Graham - arXiv preprint arXiv …, 2024 - arxiv.org
Recent research has extended methods from the fields of thermodynamics and statistical
mechanics into other disciplines. Most notably, one recent work creates a unified theoretical …

Higher Order and Self-Referential Evolution for Population-based Methods

S Coward, C Lu, A Letcher, M Jiang… - … Exploring Meta-Learning … - openreview.net
Due to their simplicity and support of high levels of parallelism, evolutionary algorithms have
regained popularity in machine learning applications such as curriculum generation for …