METTLE: A metamorphic testing approach to assessing and validating unsupervised machine learning systems
Unsupervised machine learning is the training of an artificial intelligence system using
information that is neither classified nor labeled, with a view to modeling the underlying …
information that is neither classified nor labeled, with a view to modeling the underlying …
An interleaving guided metamorphic testing approach for concurrent programs
Concurrent programs are normally composed of multiple concurrent threads sharing
memory space. These threads are often interleaved, which may lead to some non …
memory space. These threads are often interleaved, which may lead to some non …
Metamorphic relation automation: Rationale, challenges, and solution directions
Metamorphic testing addresses the issue of the oracle problem by comparing results
transformation from multiple test executions. The relationship that governs the output …
transformation from multiple test executions. The relationship that governs the output …
Perfect is the enemy of test oracle
AR Ibrahimzada, Y Varli, D Tekinoglu… - Proceedings of the 30th …, 2022 - dl.acm.org
Automation of test oracles is one of the most challenging facets of software testing, but
remains comparatively less addressed compared to automated test input generation. Test …
remains comparatively less addressed compared to automated test input generation. Test …
Met-mapf: A metamorphic testing approach for multi-agent path finding algorithms
The Multi-Agent Path Finding (MAPF) problem, ie, the scheduling of multiple agents to reach
their destinations, has been widely investigated. Testing MAPF systems is challenging, due …
their destinations, has been widely investigated. Testing MAPF systems is challenging, due …
On the effectiveness of testing sentiment analysis systems with metamorphic testing
Context: Metamorphic testing (MT) has been successfully applied to a wide scope of
software systems. In these applications, the testing results of MT form the basis for drawing …
software systems. In these applications, the testing results of MT form the basis for drawing …
Theoretical and empirical analyses of the effectiveness of metamorphic relation composition
Metamorphic Relations (MRs) play a key role in determining the fault detection capability of
Metamorphic Testing (MT). As human judgement is required for MR identification, systematic …
Metamorphic Testing (MT). As human judgement is required for MR identification, systematic …
Path-directed source test case generation and prioritization in metamorphic testing
Metamorphic testing is a technique that makes use of some necessary properties of the
software under test, termed as metamorphic relations, to construct new test cases, namely …
software under test, termed as metamorphic relations, to construct new test cases, namely …
MR-Scout: Automated Synthesis of Metamorphic Relations from Existing Test Cases
Metamorphic Testing (MT) alleviates the oracle problem by defining oracles based on
metamorphic relations (MRs) that govern multiple related inputs and their outputs. However …
metamorphic relations (MRs) that govern multiple related inputs and their outputs. However …
Metamorphic Relation Generation: State of the Art and Visions for Future Research
Metamorphic testing has become one mainstream technique to address the notorious oracle
problem in software testing, thanks to its great successes in revealing real-life bugs in a wide …
problem in software testing, thanks to its great successes in revealing real-life bugs in a wide …