Sparks of function by de novo protein design

AE Chu, T Lu, PS Huang - Nature biotechnology, 2024 - nature.com
Abstract Information in proteins flows from sequence to structure to function, with each step
causally driven by the preceding one. Protein design is founded on inverting this process …

Generative ai for end-to-end limit order book modelling: A token-level autoregressive generative model of message flow using a deep state space network

P Nagy, S Frey, S Sapora, K Li, A Calinescu… - Proceedings of the …, 2023 - dl.acm.org
Developing a generative model of realistic order flow in financial markets is a challenging
open problem, with numerous applications for market participants. Addressing this, we …

Precision-recall divergence optimization for generative modeling with GANs and normalizing flows

A Verine, B Negrevergne, MS Pydi… - Advances in Neural …, 2024 - proceedings.neurips.cc
Achieving a balance between image quality (precision) and diversity (recall) is a significant
challenge in the domain of generative models. Current state-of-the-art models primarily rely …

On Convergence in Wasserstein Distance and f-divergence Minimization Problems

CT Li, J Zhang, F Farnia - International Conference on …, 2024 - proceedings.mlr.press
The zero-sum game in generative adversarial networks (GANs) for learning the distribution
of observed data is known to reduce to the minimization of a divergence measure between …

Guaranteed optimal generative modeling with maximum deviation from the empirical distribution

E Vardanyan, A Minasyan, S Hunanyan… - arXiv preprint arXiv …, 2023 - arxiv.org
Generative modeling is a widely-used machine learning method with various applications in
scientific and industrial fields. Its primary objective is to simulate new examples drawn from …

BiLD: Bi-directional Logits Difference Loss for Large Language Model Distillation

M Li, F Zhou, X Song - arXiv preprint arXiv:2406.13555, 2024 - arxiv.org
In recent years, large language models (LLMs) have shown exceptional capabilities across
various natural language processing (NLP) tasks. However, such impressive performance …

On the Mode-Seeking Properties of Langevin Dynamics

X Cheng, K Fu, F Farnia - arXiv preprint arXiv:2406.02017, 2024 - arxiv.org
The Langevin Dynamics framework, which aims to generate samples from the score function
of a probability distribution, is widely used for analyzing and interpreting score-based …

Concurrent Density Estimation with Wasserstein Autoencoders: Some Statistical Insights

A Chakrabarty, A Basu, S Das - arXiv preprint arXiv:2312.06591, 2023 - arxiv.org
Variational Autoencoders (VAEs) have been a pioneering force in the realm of deep
generative models. Amongst its legions of progenies, Wasserstein Autoencoders (WAEs) …

Quality and Diversity in Generative Models through the lens of f-divergences

A Verine - 2024 - theses.hal.science
Generative modeling have become an essential tool in machine learning for generating
realistic samples from complex data distributions. Despite significant advancements in …

Statistically Optimal Generative Modeling with Maximum Deviation from the Empirical Distribution

E Vardanyan, S Hunanyan, T Galstyan… - Forty-first International … - openreview.net
This paper explores the problem of generative modeling, aiming to simulate diverse
examples from an unknown distribution based on observed examples. While recent studies …