Proceedings

Practical One-Shot Federated Learning for Cross-Silo Setting

Qinbin Li, Bingsheng He, Dawn Song

Download BibTeX Cite

Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence. Main Track. Pages 1484-1490.

https://doi.org/10.24963/ijcai.2021/205

Keywords

  • Data Mining: Federated Learning
  • Machine Learning: Classification

Abstract

Federated learning enables multiple parties to collaboratively learn a model without exchanging their data. While most existing federated learning algorithms need many rounds to converge, one-shot federated learning (i.e., federated learning with a single communication round) is a promising approach to make federated learning applicable in cross-silo setting in practice. However, existing one-shot algorithms only support specific models and do not provide any privacy guarantees, which significantly limit the applications in practice. In this paper, we propose a practical one-shot federated learning algorithm named FedKT. By utilizing the knowledge transfer technique, FedKT can be applied to any classification models and can flexibly achieve differential privacy guarantees. Our experiments on various tasks show that FedKT can significantly outperform the other state-of-the-art federated learning algorithms with a single communication round.

Qinbin Li, Bingsheng He, and Dawn Song. 2021. Practical One-Shot Federated Learning for Cross-Silo Setting. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21. IJCAI, 1484–1490. https://doi.org/10.24963/ijcai.2021/205
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards