An analysis of technological frameworks for data streams

F Puentes, MD Pérez-Godoy, P González… - Progress in Artificial …, 2020 - Springer
Progress in Artificial Intelligence, 2020Springer
Real-time data analysis is becoming increasingly important in Big Data environments for
addressing data stream issues. To this end, several technological frameworks have been
developed, both open-source and proprietary, for the analysis of streaming data. This paper
analyzes some open-source technological frameworks available for data streams, detailing
their main characteristics. The objective is to facilitate decisions on which framework to use,
meeting the needs of data mining methods for data streams. In this sense, there are …
Abstract
Real-time data analysis is becoming increasingly important in Big Data environments for addressing data stream issues. To this end, several technological frameworks have been developed, both open-source and proprietary, for the analysis of streaming data. This paper analyzes some open-source technological frameworks available for data streams, detailing their main characteristics. The objective is to facilitate decisions on which framework to use, meeting the needs of data mining methods for data streams. In this sense, there are important factors affecting the choice about which framework is most suitable for this purpose. Some of these factors are the existence of data mining libraries, the available documentation, the maturity of the platform, fault tolerance and processing guarantees, among others. Another decisive factor when choosing a data stream framework is its performance. For this reason, two comparisons have been made: a performance and latency comparison between Spark Streaming, Spark Structured Streaming, Storm, Flink and Samza following the Yahoo Streaming Benchmark methodology, and a comparison between Spark Streaming and Flink with a clustering algorithm for data streaming called streaming K-means.
Springer
以上显示的是最相近的搜索结果。 查看全部搜索结果