A survey on non-autoregressive generation for neural machine translation and beyond

Y Xiao, L Wu, J Guo, J Li, M Zhang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Non-autoregressive (NAR) generation, which is first proposed in neural machine translation
(NMT) to speed up inference, has attracted much attention in both machine learning and …

State-of-the-art generalisation research in NLP: a taxonomy and review

D Hupkes, M Giulianelli, V Dankers, M Artetxe… - arXiv preprint arXiv …, 2022 - arxiv.org
The ability to generalise well is one of the primary desiderata of natural language
processing (NLP). Yet, what'good generalisation'entails and how it should be evaluated is …

Chaining simultaneous thoughts for numerical reasoning

Z Shao, F Huang, M Huang - arXiv preprint arXiv:2211.16482, 2022 - arxiv.org
Given that rich information is hidden behind ubiquitous numbers in text, numerical reasoning
over text should be an essential skill of AI systems. To derive precise equations to solve …

Compositional task-oriented parsing as abstractive question answering

W Zhao, K Arkoudas, W Sun, C Cardie - arXiv preprint arXiv:2205.02068, 2022 - arxiv.org
Task-oriented parsing (TOP) aims to convert natural language into machine-readable
representations of specific tasks, such as setting an alarm. A popular approach to TOP is to …

Retronlu: Retrieval augmented task-oriented semantic parsing

V Gupta, A Shrivastava, A Sagar, A Aghajanyan… - arXiv preprint arXiv …, 2021 - arxiv.org
While large pre-trained language models accumulate a lot of knowledge in their parameters,
it has been demonstrated that augmenting it with non-parametric retrieval-based memory …

Deliberation model for on-device spoken language understanding

D Le, A Shrivastava, P Tomasello, S Kim… - arXiv preprint arXiv …, 2022 - arxiv.org
We propose a novel deliberation-based approach to end-to-end (E2E) spoken language
understanding (SLU), where a streaming automatic speech recognition (ASR) model …

Semantic parsing in task-oriented dialog with recursive insertion-based encoder

E Mansimov, Y Zhang - Proceedings of the aaai conference on artificial …, 2022 - ojs.aaai.org
Abstract We introduce a Recursive INsertion-based Encoder (RINE), a novel approach for
semantic parsing in task-oriented dialog. Our model consists of an encoder network that …

Towards Zero-Shot Multilingual Transfer for Code-Switched Responses

TW Wu, C Zhao, E Chang, Y Shi… - Proceedings of the …, 2023 - aclanthology.org
Recent task-oriented dialog systems have had great success in building English-based
personal assistants, but extending these systems to a global audience is challenging due to …

Retrieve-and-fill for scenario-based task-oriented semantic parsing

A Shrivastava, S Desai, A Gupta, A Elkahky… - arXiv preprint arXiv …, 2022 - arxiv.org
Task-oriented semantic parsing models have achieved strong results in recent years, but
unfortunately do not strike an appealing balance between model size, runtime latency, and …

StructSP: Efficient Fine-tuning of Task-Oriented Dialog System by Using Structure-aware Boosting and Grammar Constraints

T Do, P Nguyen, M Nguyen - Findings of the Association for …, 2023 - aclanthology.org
We have investigated methods utilizing hierarchical structure information representation in
the semantic parsing task and have devised a method that reinforces the semantic …