Fs-real: Towards real-world cross-device federated learning

D Chen, D Gao, Y Xie, X Pan, Z Li, Y Li, B Ding… - Proceedings of the 29th …, 2023 - dl.acm.org
Federated Learning (FL) aims to train high-quality models in collaboration with distributed
clients while not uploading their local data, which attracts increasing attention in both …

Fusionai: Decentralized training and deploying llms with massive consumer-level gpus

Z Tang, Y Wang, X He, L Zhang, X Pan, Q Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
The rapid growth of memory and computation requirements of large language models
(LLMs) has outpaced the development of hardware, hindering people who lack large-scale …

Ideal: Toward high-efficiency device-cloud collaborative and dynamic recommendation system

Z Lv, Z Chen, S Zhang, K Kuang, W Zhang, M Li… - arXiv preprint arXiv …, 2023 - arxiv.org
Recommendation systems have shown great potential to solve the information explosion
problem and enhance user experience in various online applications, which recently …

On-device learning for model personalization with large-scale cloud-coordinated domain adaption

Y Yan, C Niu, R Gu, F Wu, S Tang, L Hua… - Proceedings of the 28th …, 2022 - dl.acm.org
Cloud-based learning is currently the mainstream in both academia and industry. However,
the global data distribution, as a mixture of all the users' data distributions, for training a …

Achelous: Enabling Programmability, Elasticity, and Reliability in Hyperscale Cloud Networks

C Wei, X Li, Y Yang, X Jiang, T Xu, B Yang… - Proceedings of the …, 2023 - dl.acm.org
Cloud computing has witnessed tremendous growth, prompting enterprises to migrate to the
cloud for reliable and on-demand computing. Within a single Virtual Private Cloud (VPC) …

Aztr: Aerial video action recognition with auto zoom and temporal reasoning

X Wang, R Xian, T Guan, CM de Melo… - … on Robotics and …, 2023 - ieeexplore.ieee.org
We propose a novel approach for aerial video action recognition. Our method is designed
for videos captured using UAVs and can run on edge or mobile devices. We present a …

V10: Hardware-Assisted NPU Multi-tenancy for Improved Resource Utilization and Fairness

Y Xue, Y Liu, L Nai, J Huang - Proceedings of the 50th Annual …, 2023 - dl.acm.org
Modern cloud platforms have deployed neural processing units (NPUs) like Google Cloud
TPUs to accelerate online machine learning (ML) inference services. To improve the …

Fs-real: A real-world cross-device federated learning platform

D Gao, D Chen, Z Li, Y Xie, X Pan, Y Li, B Ding… - Proceedings of the …, 2023 - dl.acm.org
Federated learning (FL) is a general distributed machine learning paradigm that provides
solutions for tasks where data cannot be shared directly. Due to the difficulties in …

DC-CCL: Device-Cloud Collaborative Controlled Learning for Large Vision Models

Y Ding, C Niu, F Wu, S Tang, C Lyu, G Chen - arXiv preprint arXiv …, 2023 - arxiv.org
Many large vision models have been deployed on the cloud for real-time services.
Meanwhile, fresh samples are continuously generated on the served mobile device. How to …

InferFair: Towards QoS-aware scheduling for performance isolation guarantee in heterogeneous model serving systems

Y Peng, H Peng - Future Generation Computer Systems, 2024 - Elsevier
With the popularity of Deep Neural Network (DNN) models in diverse fields, DNN inference
services have been widely deployed on cloud for resource-limited devices to support …