Dataset size and composition impact the reliability of performance benchmarks for peptide-MHC binding predictions

Y Kim, J Sidney, S Buus, A Sette, M Nielsen… - BMC bioinformatics, 2014 - Springer
… Two common approaches to determine prediction performance are cross-validation, in …
performances generated on our last benchmark dataset from 2009 with prediction performances

Automated benchmarking of peptide-MHC class I binding predictions

T Trolle, IG Metushi, JA Greenbaum, Y Kim… - …, 2015 - academic.oup.com
… For each server, an overall ranking score is calculated, summarizing its overall performance
across all MHC molecules, peptide lengths and measurement data types. The ranking score …

Systematically benchmarking peptide-MHC binding predictors: From synthetic to naturally processed epitopes

W Zhao, X Sher - PLoS computational biology, 2018 - journals.plos.org
… We firstly introduced the test set and evaluate the prediction performance of MHC class I
and II tools on the blind test set. The tools include published IEDB methods, MixMHCpred[17], …

An automated benchmarking platform for MHC class II binding prediction methods

M Andreatta, T Trolle, Z Yan, JA Greenbaum… - …, 2018 - academic.oup.com
… an automated platform to benchmark peptide-MHC class II binding prediction tools. The
platform evaluates the absolute and relative predictive performance of all participating tools on …

A comprehensive review and performance evaluation of bioinformatics tools for HLA class I peptide-binding prediction

S Mei, F Li, A Leier, TT Marquez-Lago… - Briefings in …, 2020 - academic.oup.com
performance benchmarking and assessment of currently available, state-of-the-art tools for
predicting peptide … RANKPEP [23] predicts the MHC class I-binding peptides using profile …

Benchmarking predictions of MHC class I restricted T cell epitopes in a comprehensively studied model system

S Paul, NP Croft, AW Purcell, DC Tscharke… - PLoS computational …, 2020 - journals.plos.org
… When evaluating these three approaches, we found that the number of times the peptide
was identified by MS had the best performance with an AUC of 0.674 (AUC of combined score …

A comprehensive analysis of the IEDB MHC class-I automated benchmark

R Trevizani, Z Yan, JA Greenbaum… - Briefings in …, 2022 - academic.oup.com
… of benchmark performance. We highly encourage anyone working on MHC binding predictions
to participate in this benchmark to … This work focuses on peptides bound to MHC class I …

A community resource benchmarking predictions of peptide binding to MHC-I molecules

B Peters, HH Bui, S Frankild, M Nielsen… - PLoS computational …, 2006 - journals.plos.org
… Specifically for the current dataset, we recommend evaluating prediction performance by
the ability to classify peptides into binders and nonbinders at a cutoff of 500 nM. We plan to …

Performance evaluation of MHC class-I binding prediction tools based on an experimentally validated MHCpeptide binding data set

M Bonsack, S Hoppe, J Winter, D Tichy, C Zeller… - Cancer immunology …, 2019 - AACR
… Weekly automated benchmarking is performed … performance evaluation of publicly available
MHC ligand prediction algorithms, based on a newly generated experimental MHCpeptide

Side chain substitution benchmark for peptide/MHC interaction

B Knapp, U Omasits, W Schreiner - Protein Science, 2008 - Wiley Online Library
… the performance of several tools for side-chain prediction within the grooves of peptide-MHC
The workflow of the benchmark is illustrated in Figure 4, and the single steps are described …