Sparks of function by de novo protein design
Abstract Information in proteins flows from sequence to structure to function, with each step
causally driven by the preceding one. Protein design is founded on inverting this process …
causally driven by the preceding one. Protein design is founded on inverting this process …
Generative ai for end-to-end limit order book modelling: A token-level autoregressive generative model of message flow using a deep state space network
Developing a generative model of realistic order flow in financial markets is a challenging
open problem, with numerous applications for market participants. Addressing this, we …
open problem, with numerous applications for market participants. Addressing this, we …
Precision-recall divergence optimization for generative modeling with GANs and normalizing flows
Achieving a balance between image quality (precision) and diversity (recall) is a significant
challenge in the domain of generative models. Current state-of-the-art models primarily rely …
challenge in the domain of generative models. Current state-of-the-art models primarily rely …
On Convergence in Wasserstein Distance and f-divergence Minimization Problems
The zero-sum game in generative adversarial networks (GANs) for learning the distribution
of observed data is known to reduce to the minimization of a divergence measure between …
of observed data is known to reduce to the minimization of a divergence measure between …
Guaranteed optimal generative modeling with maximum deviation from the empirical distribution
E Vardanyan, A Minasyan, S Hunanyan… - arXiv preprint arXiv …, 2023 - arxiv.org
Generative modeling is a widely-used machine learning method with various applications in
scientific and industrial fields. Its primary objective is to simulate new examples drawn from …
scientific and industrial fields. Its primary objective is to simulate new examples drawn from …
BiLD: Bi-directional Logits Difference Loss for Large Language Model Distillation
M Li, F Zhou, X Song - arXiv preprint arXiv:2406.13555, 2024 - arxiv.org
In recent years, large language models (LLMs) have shown exceptional capabilities across
various natural language processing (NLP) tasks. However, such impressive performance …
various natural language processing (NLP) tasks. However, such impressive performance …
On the Mode-Seeking Properties of Langevin Dynamics
The Langevin Dynamics framework, which aims to generate samples from the score function
of a probability distribution, is widely used for analyzing and interpreting score-based …
of a probability distribution, is widely used for analyzing and interpreting score-based …
Concurrent Density Estimation with Wasserstein Autoencoders: Some Statistical Insights
Variational Autoencoders (VAEs) have been a pioneering force in the realm of deep
generative models. Amongst its legions of progenies, Wasserstein Autoencoders (WAEs) …
generative models. Amongst its legions of progenies, Wasserstein Autoencoders (WAEs) …
Quality and Diversity in Generative Models through the lens of f-divergences
A Verine - 2024 - theses.hal.science
Generative modeling have become an essential tool in machine learning for generating
realistic samples from complex data distributions. Despite significant advancements in …
realistic samples from complex data distributions. Despite significant advancements in …
Statistically Optimal Generative Modeling with Maximum Deviation from the Empirical Distribution
E Vardanyan, S Hunanyan, T Galstyan… - Forty-first International … - openreview.net
This paper explores the problem of generative modeling, aiming to simulate diverse
examples from an unknown distribution based on observed examples. While recent studies …
examples from an unknown distribution based on observed examples. While recent studies …