Machine learning testing: Survey, landscapes and horizons

JM Zhang, M Harman, L Ma… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This paper provides a comprehensive survey of techniques for testing machine learning
systems; Machine Learning Testing (ML testing) research. It covers 144 papers on testing …

Real-world machine learning systems: A survey from a data-oriented architecture perspective

C Cabrera, A Paleyes, P Thodoroff… - arXiv preprint arXiv …, 2023 - arxiv.org
Machine Learning models are being deployed as parts of real-world systems with the
upsurge of interest in artificial intelligence. The design, implementation, and maintenance of …

Causality-based neural network repair

B Sun, J Sun, LH Pham, J Shi - … of the 44th International Conference on …, 2022 - dl.acm.org
Neural networks have had discernible achievements in a wide range of applications. The
wide-spread adoption also raises the concern of their dependability and reliability. Similar to …

Causality in configurable software systems

C Dubslaff, K Weis, C Baier, S Apel - Proceedings of the 44th …, 2022 - dl.acm.org
Detecting and understanding reasons for defects and inadvertent behavior in software is
challenging due to their increasing complexity. In configurable software systems, the …

Benchmarking and explaining large language model-based code generation: A causality-centric approach

Z Ji, P Ma, Z Li, S Wang - arXiv preprint arXiv:2310.06680, 2023 - arxiv.org
While code generation has been widely used in various software development scenarios,
the quality of the generated code is not guaranteed. This has been a particular concern in …

Automated classification of overfitting patches with statically extracted code features

H Ye, J Gu, M Martinez, T Durieux… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Automatic program repair (APR) aims to reduce the cost of manually fixing software defects.
However, APR suffers from generating a multitude of overfitting patches, those patches that …

Improving fault localization by integrating value and predicate based causal inference techniques

Y Küçük, TAD Henderson… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
Statistical fault localization (SFL) techniques use execution profiles and success/failure
information from software executions, in conjunction with statistical inference, to …

Unicorn: Reasoning about configurable system performance through the lens of causality

MS Iqbal, R Krishna, MA Javidian, B Ray… - Proceedings of the …, 2022 - dl.acm.org
Modern computer systems are highly configurable, with the total variability space sometimes
larger than the number of atoms in the universe. Understanding and reasoning about the …

Quality of automated program repair on real-world defects

M Motwani, M Soto, Y Brun, R Just… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Automated program repair is a promising approach to reducing the costs of manual
debugging and increasing software quality. However, recent studies have shown that …

[HTML][HTML] Causal reasoning in Software Quality Assurance: A systematic review

L Giamattei, A Guerriero, R Pietrantuono… - Information and Software …, 2024 - Elsevier
Abstract Context: Software Quality Assurance (SQA) is a fundamental part of software
engineering to ensure stakeholders that software products work as expected after release in …