An advanced big data quality framework based on weighted metrics

W Elouataoui, I El Alaoui, S El Mendili… - Big Data and Cognitive …, 2022 - mdpi.com
While big data benefits are numerous, the use of big data requires, however, addressing
new challenges related to data processing, data security, and especially degradation of data …

Quality Anomaly Detection Using Predictive Techniques: An Extensive Big Data Quality Framework for Reliable Data Analysis

E Widad, E Saida, Y Gahi - IEEE Access, 2023 - ieeexplore.ieee.org
The increasing reliance on Big Data analytics has highlighted the critical role of data quality
in ensuring accurate and reliable results. Consequently, organizations aiming to leverage …

An Automated Big Data Quality Anomaly Correction Framework Using Predictive Analysis

W Elouataoui, S El Mendili, Y Gahi - Data, 2023 - mdpi.com
Big data has emerged as a fundamental component in various domains, enabling
organizations to extract valuable insights and make informed decisions. However, ensuring …

An efficient learning based approach for automatic record deduplication with benchmark datasets

M Ravikanth, S Korra, G Mamidisetti, M Goutham… - Scientific Reports, 2024 - nature.com
With technological innovations, enterprises in the real world are managing every iota of data
as it can be mined to derive business intelligence (BI). However, when data comes from …

An exploratory analysis of methods for real-time data deduplication in streaming processes

J Esteves, R Costa, Y Zhou, A Almeida - Proceedings of the 17th ACM …, 2023 - dl.acm.org
Modern stream processing systems typically require ingesting and correlating data from
multiple data sources. However, these sources are out of control and prone to software …

Online Continual Learning Data Quality Framework for Entity Resolution

W Elouataoui, S El Mendili… - 2023 10th International …, 2023 - ieeexplore.ieee.org
If companies have access to more data than ever, integrating such data into a single
platform has become more challenging. One of the main challenges faced for data …

Big Data Quality Anomaly Scoring Framework Using Artificial Intelligence

W Elouataoui, S El Mendili… - 2023 7th IEEE Congress …, 2023 - ieeexplore.ieee.org
As Big Data becomes increasingly essential in decision-making processes, the quality of the
data used is critical. Data quality anomalies can lead to incorrect results, making it essential …

A SYSTEMATIC MAPPING REVIEW ON DATA CLEANING METHODS IN BIG DATA ENVIRONMENTS.

C Keiji Iwata, N Verardi Galegale, M Ito… - IADIS International …, 2024 - search.ebscohost.com
The evolution of information technology combined with artificial intelligence, IoT (Internet of
Things) and robotics has made processes integrated and intelligent. The increased use of …

Active Metadata and Machine Learning based Framework for Enhancing Big Data Quality

W Elouataoui, S El Mendili, Y Gahi - Proceedings of the 7th International …, 2024 - dl.acm.org
The advent of big data has ushered in a new era of opportunities across industries,
facilitating transformative insights and operational enhancements. However, the inherent …

[PDF][PDF] DATA CLEANING IN BIG DATA: A SYSTEMATIC

C Iwata, N Galegale, M Ito, M Azevedo, M Duduchi… - MCCSIS 2024 - pure.tue.nl
This paper aims to conduct a systematic analysis of the literature on existing data cleaning
methods in Big Data. It is a constantly evolving research area due to the growing importance …