Measure and improve robustness in NLP models: A survey
As NLP models achieved state-of-the-art performances over benchmarks and gained wide
applications, it has been increasingly important to ensure the safe deployment of these …
applications, it has been increasingly important to ensure the safe deployment of these …
On robustness of prompt-based semantic parsing with large pre-trained language model: An empirical study on codex
Semantic parsing is a technique aimed at constructing a structured representation of the
meaning of a natural-language question. Recent advancements in few-shot language …
meaning of a natural-language question. Recent advancements in few-shot language …
Towards robustness of text-to-SQL models against natural and realistic adversarial table perturbation
The robustness of Text-to-SQL parsers against adversarial perturbations plays a crucial role
in delivering highly reliable applications. Previous studies along this line primarily focused …
in delivering highly reliable applications. Previous studies along this line primarily focused …
Compositional generalization for multi-label text classification: A data-augmentation approach
Despite significant advancements in multi-label text classification, the ability of existing
models to generalize to novel and seldom-encountered complex concepts, which are …
models to generalize to novel and seldom-encountered complex concepts, which are …
Factual: A benchmark for faithful and consistent textual scene graph parsing
Textual scene graph parsing has become increasingly important in various vision-language
applications, including image caption evaluation and image retrieval. However, existing …
applications, including image caption evaluation and image retrieval. However, existing …
The best of both worlds: Combining human and machine translations for multilingual semantic parsing with active learning
Multilingual semantic parsing aims to leverage the knowledge from the high-resource
languages to improve low-resource semantic parsing, yet commonly suffers from the data …
languages to improve low-resource semantic parsing, yet commonly suffers from the data …
Energy-latency attacks to on-device neural networks via sponge poisoning
In recent years, on-device deep learning has gained attention as a means of developing
affordable deep learning applications for mobile devices. However, on-device models are …
affordable deep learning applications for mobile devices. However, on-device models are …
Dr. spider: A diagnostic evaluation benchmark towards text-to-sql robustness
Neural text-to-SQL models have achieved remarkable performance in translating natural
language questions into SQL queries. However, recent studies reveal that text-to-SQL …
language questions into SQL queries. However, recent studies reveal that text-to-SQL …
Improving Generalization in Semantic Parsing by Increasing Natural Language Variation
I Saparina, M Lapata - arXiv preprint arXiv:2402.08666, 2024 - arxiv.org
Text-to-SQL semantic parsing has made significant progress in recent years, with various
models demonstrating impressive performance on the challenging Spider benchmark …
models demonstrating impressive performance on the challenging Spider benchmark …
Enhancing Robustness of AI Offensive Code Generators via Data Augmentation
In this work, we present a method to add perturbations to the code descriptions to create
new inputs in natural language (NL) from well-intentioned developers that diverge from the …
new inputs in natural language (NL) from well-intentioned developers that diverge from the …