Serverless federated auprc optimization for multi-party collaborative imbalanced data mining

X Wu, Z Hu, J Pei, H Huang - Proceedings of the 29th ACM SIGKDD …, 2023 - dl.acm.org
To address the big data challenges, serverless multi-party collaborative training has recently
attracted attention in the data mining community, since they can cut down the …

Prometheus: taming sample and communication complexities in constrained decentralized stochastic bilevel learning

Z Liu, X Zhang, P Khanduri, S Lu… - … Conference on Machine …, 2023 - proceedings.mlr.press
In recent years, decentralized bilevel optimization has gained significant attention thanks to
its versatility in modeling a wide range of multi-agent learning problems, such as multi-agent …

On the communication complexity of decentralized bilevel optimization

Y Zhang, MT Thai, J Wu, H Gao - arXiv preprint arXiv:2311.11342, 2023 - arxiv.org
Decentralized bilevel optimization has been actively studied in the past few years since it
has widespread applications in machine learning. However, existing algorithms suffer from …

Decentralized Bilevel Optimization over Graphs: Loopless Algorithmic Update and Transient Iteration Complexity

B Kong, S Zhu, S Lu, X Huang, K Yuan - arXiv preprint arXiv:2402.03167, 2024 - arxiv.org
Stochastic bilevel optimization (SBO) is becoming increasingly essential in machine
learning due to its versatility in handling nested structures. To address large-scale SBO …

DePRL: Achieving Linear Convergence Speedup in Personalized Decentralized Learning with Shared Representations

G Xiong, G Yan, S Wang, J Li - Proceedings of the AAAI Conference on …, 2024 - ojs.aaai.org
Decentralized learning has emerged as an alternative method to the popular parameter-
server framework which suffers from high communication burden, single-point failure and …

DIAMOND: Taming Sample and Communication Complexities in Decentralized Bilevel Optimization

P Qiu, Y Li, Z Liu, P Khanduri, J Liu… - … -IEEE Conference on …, 2023 - ieeexplore.ieee.org
Decentralized bilevel optimization has received increasing attention recently due to its
foundational role in many emerging multi-agent learning paradigms (eg, multi-agent meta …

Personalized decentralized bilevel optimization over stochastic and directed networks

N Terashita, S Hara - 2022 - openreview.net
While personalization in distributed learning has been extensively studied, existing
approaches employ dedicated algorithms to optimize their specific type of parameters (eg …

Decentralized Hyper-Gradient Computation over Time-Varying Directed Networks

N Terashita, S Hara - arXiv preprint arXiv:2210.02129, 2022 - arxiv.org
This paper addresses the communication issues when estimating hyper-gradients in
decentralized federated learning (FL). Hyper-gradients in decentralized FL quantifies how …

A Method for Deductive Failure Analysis with Probabilistic Augmentation: BLIPS-PA

A Mansoor - 2023 - rave.ohiolink.edu
This research can be divided into two aspects: the development of a deductive failure
analysis method for Backwards Logic Inference based Propagation for System analysis …

Prometheus: Endowing Low Sample and Communication Complexities to Constrained Decentralized Stochastic Bilevel Learning

Z Liu, X Zhang, P Khanduri, S Lu, J Liu - openreview.net
In recent years, constrained decentralized stochastic bilevel optimization has become
increasingly important due to its versatility in modeling a wide range of multi-agent learning …