Defining levels of automated chemical design
One application area of computational methods in drug discovery is the automated design of
small molecules. Despite the large number of publications describing methods and their …
small molecules. Despite the large number of publications describing methods and their …
A survey on uncertainty reasoning and quantification in belief theory and its application to deep learning
An in-depth understanding of uncertainty is the first step to making effective decisions under
uncertainty. Machine/deep learning (ML/DL) has been hugely leveraged to solve complex …
uncertainty. Machine/deep learning (ML/DL) has been hugely leveraged to solve complex …
A survey of reinforcement learning from human feedback
Reinforcement learning from human feedback (RLHF) is a variant of reinforcement learning
(RL) that learns from human feedback instead of relying on an engineered reward function …
(RL) that learns from human feedback instead of relying on an engineered reward function …
Semantic anomaly detection with large language models
As robots acquire increasingly sophisticated skills and see increasingly complex and varied
environments, the threat of an edge case or anomalous failure is ever present. For example …
environments, the threat of an edge case or anomalous failure is ever present. For example …
Do bayesian neural networks need to be fully stochastic?
We investigate the benefit of treating all the parameters in a Bayesian neural network
stochastically and find compelling theoretical and empirical evidence that this standard …
stochastically and find compelling theoretical and empirical evidence that this standard …
Selectively answering ambiguous questions
Trustworthy language models should abstain from answering questions when they do not
know the answer. However, the answer to a question can be unknown for a variety of …
know the answer. However, the answer to a question can be unknown for a variety of …
Truncation sampling as language model desmoothing
Long samples of text from neural language models can be of poor quality. Truncation
sampling algorithms--like top-$ p $ or top-$ k $--address this by setting some words' …
sampling algorithms--like top-$ p $ or top-$ k $--address this by setting some words' …
Deep ensembles work, but are they necessary?
Ensembling neural networks is an effective way to increase accuracy, and can often match
the performance of individual larger models. This observation poses a natural question …
the performance of individual larger models. This observation poses a natural question …
On the practicality of deterministic epistemic uncertainty
A set of novel approaches for estimating epistemic uncertainty in deep neural networks with
a single forward pass has recently emerged as a valid alternative to Bayesian Neural …
a single forward pass has recently emerged as a valid alternative to Bayesian Neural …
Self-exploring language models: Active preference elicitation for online alignment
Preference optimization, particularly through Reinforcement Learning from Human
Feedback (RLHF), has achieved significant success in aligning Large Language Models …
Feedback (RLHF), has achieved significant success in aligning Large Language Models …