Under-sampling strategies for better transformer-based classifications models

M Sawiński, K Wcel, E Ksiżniak - … of the Cross-Language Evaluation Forum …, 2024 - Springer
This paper presents findings from the Check-That! Lab Task 1B-English submission at CLEF
2023. The research developed a method for evaluating the check-worthiness of short …

" Seeing the Big through the Small": Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations?

B Chen, X Wang, S Peng, R Litschko… - arXiv preprint arXiv …, 2024 - arxiv.org
Human label variation (HLV) is a valuable source of information that arises when multiple
human annotators provide different labels for valid reasons. In Natural Language Inference …

Label Convergence: Defining an Upper Performance Bound in Object Recognition through Contradictory Annotations

D Tschirschwitz, V Rodehorst - arXiv preprint arXiv:2409.09412, 2024 - arxiv.org
Annotation errors are a challenge not only during training of machine learning models, but
also during their evaluation. Label variations and inaccuracies in datasets often manifest as …