Scalable system scheduling for HPC and big data

A Reuther, C Byun, W Arcand, D Bestor… - Journal of Parallel and …, 2018 - Elsevier
In the rapidly expanding field of parallel processing, job schedulers are the “operating
systems” of modern big data architectures and supercomputing systems. Job schedulers …

[HTML][HTML] E-Had: A distributed and collaborative detection framework for early detection of DDoS attacks

NV Patil, CR Krishna, K Kumar, S Behal - Journal of King Saud University …, 2022 - Elsevier
During the past few years, the traffic volume of legitimate traffic and attack traffic has
increased manifolds up to Terabytes per second (Tbps). Because of the processing of such …

ReRe: A lightweight real-time ready-to-go anomaly detection approach for time series

MC Lee, JC Lin, EG Gan - 2020 IEEE 44th Annual Computers …, 2020 - ieeexplore.ieee.org
Anomaly detection is an active research topic in many different fields such as intrusion
detection, network monitoring, system health monitoring, IoT healthcare, etc. However, many …

RePAD: real-time proactive anomaly detection for time series

MC Lee, JC Lin, EG Gran - … and Applications: Proceedings of the 34th …, 2020 - Springer
During the past decade, many anomaly detection approaches have been introduced in
different fields such as network monitoring, fraud detection, and intrusion detection …

Salad: Self-adaptive lightweight anomaly detection for real-time recurrent time series

MC Lee, JC Lin, EG Gran - 2021 IEEE 45th Annual Computers …, 2021 - ieeexplore.ieee.org
Providing a lightweight self-adaptive approach that does not need offline training in advance
and meanwhile is able to detect anomalies in real time could be highly beneficial. Such an …

Designing a MapReduce performance model in distributed heterogeneous platforms based on benchmarking approach

A Gandomi, A Movaghar, M Reshadi… - The Journal of …, 2020 - Springer
MapReduce framework is an effective method for big data parallel processing. Enhancing
the performance of MapReduce clusters, along with reducing their job execution time, is a …

How Far Should We Look Back to Achieve Effective Real-Time Time-Series Anomaly Detection?

MC Lee, JC Lin, EG Gran - International Conference on Advanced …, 2021 - Springer
Anomaly detection is the process of identifying unexpected events or abnormalities in data,
and it has been applied in many different areas such as system monitoring, fraud detection …

[PDF][PDF] Straggler handling approaches in mapreduce framework: a comparative study.

AH Katrawi, R Abdullah, M Anbar… - International Journal of …, 2021 - core.ac.uk
The proliferation of information technology produces a huge amount of data called big data
that cannot be processed by traditional database systems. These Various types of data …

DALC: distributed automatic LSTM customization for fine-grained traffic speed prediction

MC Lee, JC Lin - … Networking and Applications: Proceedings of the 34th …, 2020 - Springer
Over the past decade, several approaches have been introduced for short-term traffic
prediction. However, providing fine-grained traffic prediction for large-scale transportation …

A hard real-time scheduler for Spark on YARN

G Wang, J Xu, R Liu, S Huang - 2018 18th IEEE/ACM …, 2018 - ieeexplore.ieee.org
Apache Spark is a fast and general engine for large-scale data processing using distributed
memory. It provides different deploy modes to meet the needs of different users and Spark …