Multi-task learning in natural language processing: An overview

S Chen, Y Zhang, Q Yang - ACM Computing Surveys, 2024 - dl.acm.org
Deep learning approaches have achieved great success in the field of Natural Language
Processing (NLP). However, directly training deep neural models often suffer from overfitting …

Identifying beneficial task relations for multi-task learning in deep neural networks

J Bingel, A Søgaard - arXiv preprint arXiv:1702.08303, 2017 - arxiv.org
Multi-task learning (MTL) in deep neural networks for NLP has recently received increasing
interest due to some compelling benefits, including its potential to efficiently regularize …

A survey of discourse parsing

J Li, M Liu, B Qin, T Liu - Frontiers of Computer Science, 2022 - Springer
Discourse parsing is an important research area in natural language processing (NLP),
which aims to parse the discourse structure of coherent sentences. In this survey, we …

When is multitask learning effective? semantic sequence prediction under varying data conditions

HM Alonso, B Plank - arXiv preprint arXiv:1612.02251, 2016 - arxiv.org
Multitask learning has been applied successfully to a range of tasks, mostly
morphosyntactic. However, little is known on when MTL works and whether there are data …

Transition-based neural RST parsing with implicit syntax features

N Yu, M Zhang, G Fu - … of the 27th International Conference on …, 2018 - aclanthology.org
Abstract Syntax has been a useful source of information for statistical RST discourse
parsing. Under the neural setting, a common approach integrates syntax by a recursive …

RST discourse parsing with second-stage EDU-level pre-training

N Yu, M Zhang, G Fu, M Zhang - … of the 60th Annual Meeting of …, 2022 - aclanthology.org
Pre-trained language models (PLMs) have shown great potentials in natural language
processing (NLP) including rhetorical structure theory (RST) discourse parsing. Current …

Adversarial learning for discourse rhetorical structure parsing

L Zhang, F Kong, G Zhou - … of the 59th Annual Meeting of the …, 2021 - aclanthology.org
Text-level discourse rhetorical structure (DRS) parsing is known to be challenging due to the
notorious lack of training data. Although recent top-down DRS parsers can better leverage …

How much progress have we made on RST discourse parsing? A replication study of recent results on the RST-DT

M Morey, P Muller, N Asher - Conference on Empirical Methods on …, 2017 - hal.science
This article evaluates purported progress over the past years in RST discourse parsing.
Several studies report a relative error reduction of 24 to 51% on all metrics that authors …

Multi-task learning for argumentation mining in low-resource settings

C Schulz, S Eger, J Daxenberger, T Kahse… - arXiv preprint arXiv …, 2018 - arxiv.org
We investigate whether and where multi-task learning (MTL) can improve performance on
NLP problems related to argumentation mining (AM), in particular argument component …

A top-down neural architecture towards text-level parsing of discourse rhetorical structure

L Zhang, Y Xing, F Kong, P Li, G Zhou - arXiv preprint arXiv:2005.02680, 2020 - arxiv.org
Due to its great importance in deep natural language understanding and various down-
stream applications, text-level parsing of discourse rhetorical structure (DRS) has been …