METTLE: A metamorphic testing approach to assessing and validating unsupervised machine learning systems

X Xie, Z Zhang, TY Chen, Y Liu… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Unsupervised machine learning is the training of an artificial intelligence system using
information that is neither classified nor labeled, with a view to modeling the underlying …

An interleaving guided metamorphic testing approach for concurrent programs

CA Sun, H Dai, N Geng, H Liu, TY Chen, P Wu… - ACM Transactions on …, 2023 - dl.acm.org
Concurrent programs are normally composed of multiple concurrent threads sharing
memory space. These threads are often interleaved, which may lead to some non …

Metamorphic relation automation: Rationale, challenges, and solution directions

E Altamimi, A Elkawakjy, C Catal - Journal of Software …, 2023 - Wiley Online Library
Metamorphic testing addresses the issue of the oracle problem by comparing results
transformation from multiple test executions. The relationship that governs the output …

Perfect is the enemy of test oracle

AR Ibrahimzada, Y Varli, D Tekinoglu… - Proceedings of the 30th …, 2022 - dl.acm.org
Automation of test oracles is one of the most challenging facets of software testing, but
remains comparatively less addressed compared to automated test input generation. Test …

Met-mapf: A metamorphic testing approach for multi-agent path finding algorithms

XY Zhang, Y Liu, P Arcaini, M Jiang… - ACM Transactions on …, 2024 - dl.acm.org
The Multi-Agent Path Finding (MAPF) problem, ie, the scheduling of multiple agents to reach
their destinations, has been widely investigated. Testing MAPF systems is challenging, due …

On the effectiveness of testing sentiment analysis systems with metamorphic testing

M Jiang, TY Chen, S Wang - Information and Software Technology, 2022 - Elsevier
Context: Metamorphic testing (MT) has been successfully applied to a wide scope of
software systems. In these applications, the testing results of MT form the basis for drawing …

Theoretical and empirical analyses of the effectiveness of metamorphic relation composition

K Qiu, Z Zheng, TY Chen… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Metamorphic Relations (MRs) play a key role in determining the fault detection capability of
Metamorphic Testing (MT). As human judgement is required for MR identification, systematic …

Path-directed source test case generation and prioritization in metamorphic testing

C Sun, B Liu, A Fu, Y Liu, H Liu - Journal of Systems and Software, 2022 - Elsevier
Metamorphic testing is a technique that makes use of some necessary properties of the
software under test, termed as metamorphic relations, to construct new test cases, namely …

MR-Scout: Automated Synthesis of Metamorphic Relations from Existing Test Cases

C Xu, V Terragni, H Zhu, J Wu, SC Cheung - ACM Transactions on …, 2024 - dl.acm.org
Metamorphic Testing (MT) alleviates the oracle problem by defining oracles based on
metamorphic relations (MRs) that govern multiple related inputs and their outputs. However …

Metamorphic Relation Generation: State of the Art and Visions for Future Research

R Li, H Liu, PL Poon, D Towey, CA Sun… - arXiv preprint arXiv …, 2024 - arxiv.org
Metamorphic testing has become one mainstream technique to address the notorious oracle
problem in software testing, thanks to its great successes in revealing real-life bugs in a wide …