From distributed machine learning to federated learning: A survey

J Liu, J Huang, Y Zhou, X Li, S Ji, H Xiong… - … and Information Systems, 2022 - Springer
In recent years, data and computing resources are typically distributed in the devices of end
users, various regions or organizations. Because of laws or regulations, the distributed data …

Multi-objective task and workflow scheduling approaches in cloud computing: a comprehensive review

M Hosseinzadeh, MY Ghafour, HK Hama, B Vo… - Journal of Grid …, 2020 - Springer
Efficient task and workflow scheduling are very important for improving resource
management and reducing power consumption in cloud computing data centers (DCs) …

Federated learning of large language models with parameter-efficient prompt tuning and adaptive optimization

T Che, J Liu, Y Zhou, J Ren, J Zhou, VS Sheng… - arXiv preprint arXiv …, 2023 - arxiv.org
Federated learning (FL) is a promising paradigm to enable collaborative model training with
decentralized data. However, the training process of Large Language Models (LLMs) …

A hybrid genetic algorithm for scientific workflow scheduling in cloud environment

H Aziza, S Krichen - Neural Computing and Applications, 2020 - Springer
Nowadays, we live an unprecedented evolution in cloud computing technology that
coincides with the development of the vast amount of complex interdependent data which …

Heterps: Distributed deep learning with reinforcement learning based scheduling in heterogeneous environments

J Liu, Z Wu, D Feng, M Zhang, X Wu, X Yao… - Future Generation …, 2023 - Elsevier
Deep neural networks (DNNs) exploit many layers and a large number of parameters to
achieve excellent performance. The training process of DNN models generally handles …

Cost-efficient workflow scheduling algorithm for applications with deadline constraint on heterogeneous clouds

X Tang, W Cao, H Tang, T Deng, J Mei… - … on Parallel and …, 2021 - ieeexplore.ieee.org
In recent years, more and more large-scale data processing and computing workflow
applications run on heterogeneous clouds. Such cloud applications with precedence …

Multi-objective scheduling strategy for scientific workflows in cloud environment: A firefly-based approach

M Adhikari, T Amgoth, SN Srirama - Applied Soft Computing, 2020 - Elsevier
Cloud computing is a distributed computing paradigm, that provides infrastructure and
services to the users using the pay-as-you-use billing model. With the increasing demands …

A cloud computing-based modified symbiotic organisms search algorithm (AI) for optimal task scheduling

AA Zubair, SA Razak, MA Ngadi, A Al-Dhaqm… - Sensors, 2022 - mdpi.com
The search algorithm based on symbiotic organisms' interactions is a relatively recent bio-
inspired algorithm of the swarm intelligence field for solving numerical optimization …

Energy-aware cloud workflow applications scheduling with geo-distributed data

X Li, W Yu, R Ruiz, J Zhu - IEEE Transactions on Services …, 2020 - ieeexplore.ieee.org
Electricity prices differ during different time periods and change from place to place. Cloud
workflow applications often require geo-distributed data which is transmitted among …

A cloud resource management framework for multiple online scientific workflows using cooperative reinforcement learning agents

A Asghari, MK Sohrabi, F Yaghmaee - Computer Networks, 2020 - Elsevier
Cloud is a common distributed environment to share strong and available resources to
increase the efficiency of complex and heavy calculations. In return for the cost paid by cloud …