Deep learning (DL) techniques are proven effective in many challenging tasks, and become
widely-adopted in practice. However, previous work has shown that DL libraries, the basis of …

Question Answering (QA) is an attractive and challenging area in NLP community. There are
diverse algorithms being proposed and various benchmark datasets with different topics and …

Machine Reading Comprehension (MRC) in Natural Language Processing has seen great
progress recently. But almost all the current MRC software is validated with a reference …

ALABI RO, ELMUSRATI M., SAWAZAKI-CALONE I., KOWALSKI LP, HAGLUND C.,
COLETTA RD, MÄKITIE AA, SALO T., ALMANGUSH A. & LEIVO I.(2020),“Comparison of …

Context: Metamorphic testing (MT) has been successfully applied to a wide scope of
software systems. In these applications, the testing results of MT form the basis for drawing …

Deep Learning (DL) components are increasing their presence in safety and mission-critical
software systems. To ensure a high dependability of DL systems, robust verification methods …

Machine learning (ML)-based software systems are rapidly gaining adoption across various
domains, making it increasingly essential to ensure they perform as intended. This report …

Metamorphic testing (MT) was introduced about a quarter of a century ago. It is increasingly
being accepted by researchers and the industry as a useful testing technique. The studies …

Static analyzers reason about the behaviors of programs without executing them and report
issues when they violate pre-defined desirable properties. One of the key limitations of static …

Metamorphic testing, thanks to its high failure-detection effectiveness especially in the
absence of test oracle, has been widely applied in both the traditional context of software …