[HTML][HTML] Adaptive data quality scoring operations framework using drift-aware mechanism for industrial applications

F Bayram, BS Ahmed, E Hallin - Journal of Systems and Software, 2024 - Elsevier
Within data-driven artificial intelligence (AI) systems for industrial applications, ensuring the
reliability of the incoming data streams is an integral part of trustworthy decision-making. An …

[HTML][HTML] A Comprehensive Survey on the Societal Aspects of Smart Cities

D Bastos, N Costa, NP Rocha… - Applied Sciences, 2024 - mdpi.com
Smart cities and information and communications technology is a rapidly growing field in
both research and real-world implementation, but it is one that is still new and with many …

Architecting Data-Intensive Applications: From Data Architecture Design to Its Quality Assurance

M Abughazala - arXiv preprint arXiv:2401.12011, 2024 - arxiv.org
Context-The exponential growth of data is becoming a significant concern. Managing this
data has become incredibly challenging, especially when dealing with various sources in …

[PDF][PDF] cuallee: A Python package for data quality checks across multiple DataFrame APIs

H Vazquez, V Grosboillot - Journal of Open Source Software, 2024 - joss.theoj.org
In today's world, where vast amounts of data are generated and collected daily, and where
data heavily influence business, political, and societal decisions, it is crucial to evaluate the …

AI-Driven Frameworks for Enhancing Data Quality in Big Data Ecosystems: Error_Detection, Correction, and Metadata Integration

W Elouataoui - arXiv preprint arXiv:2405.03870, 2024 - arxiv.org
The widespread adoption of big data has ushered in a new era of data-driven decision-
making, transforming numerous industries and sectors. However, the efficacy of these …

Current Challenges of Big Data Quality Management in Big Data Governance: A Literature Review

YA Bena, R Ibrahim, J Mahmood - International Conference of Reliable …, 2023 - Springer
Advent of big data has changed the way data-driven organizations collect, process and
analyses the data. However, considering how data is generated from heterogenous sources …

[HTML][HTML] ISO25000-Related Metrics for Evaluating the Quality of Complex Information Systems

A Stefani, B Vassiliadis - Journal of Computer and Communications, 2023 - scirp.org
Evaluating complex information systems necessitates deep contextual knowledge of
technology, user needs, and quality. The quality evaluation challenges increase with the …

PyDaQu: Python Data Quality Code Generation Based on Data Architecture

M Abughazala, H Muccini… - 2023 ACM/IEEE …, 2023 - ieeexplore.ieee.org
Accurate and dependable data is critical when making crucial business decisions. However,
verifying the accuracy of complex and extensive datasets can be both error-prone and time …

Addressing the Velocity Challenge of Big Data in Radiation Pollution Monitoring: Implementation and Demonstration

H Fadlallah, R Kilany, M Haber… - 2023 IEEE 4th …, 2023 - ieeexplore.ieee.org
Real-time data quality assessment is crucial in processing big data across various
applications. Our previous work introduced BIGQA, a declarative solution based on ISO/IEC …

Active Metadata and Machine Learning based Framework for Enhancing Big Data Quality

W Elouataoui, S El Mendili, Y Gahi - Proceedings of the 7th International …, 2024 - dl.acm.org
The advent of big data has ushered in a new era of opportunities across industries,
facilitating transformative insights and operational enhancements. However, the inherent …