{"type":"ScholarlyArticle","title":"Modeling with Homophily Driven Heterogeneous Data in Gossip Learning","authors":[{"name":"Abhirup Ghosh","slug":"abhirup-ghosh","given":"Abhirup","family":"Ghosh","affiliation":"University of Cambridge , UK"},{"name":"Cecilia Mascolo","slug":"cecilia-mascolo","given":"Cecilia","family":"Mascolo","affiliation":"University of Cambridge , UK"}],"abstract":"Training deep learning models on data distributed and local to edge devices such as mobile phones is a prominent recent research direction. In a Gossip Learning (GL) system, each participating device maintains a model trained on its local data and iteratively aggregates it with the models from its neighbours in a communication network. While the fully distributed operation in GL comes with natural advantages over the centralized orchestration in Federated Learning (FL), its convergence becomes particularly slow when the data distribution is heterogeneous and aligns with the clustered structure of the communication network. These characteristics are pervasive across practical applications as people with similar interests (thus producing similar data) tend to create communities.\r\n\r\nThis paper proposes a data-driven neighbor weighting strategy for aggregating the models: this enables faster diffusion of knowledge across the communities in the network and leads to quicker convergence. We augment the method to make it computationally efficient and fair: the devices quickly converge to the same model. We evaluate our model on real and synthetic datasets that we generate using a novel generative model for communication networks with heterogeneous data. Our exhaustive empirical evaluation  verifies that our proposed method attains a faster convergence rate than the baselines. For example, the median test accuracy for a decentralized bird image classifier application reaches 81% with our proposed method within 80 rounds, whereas the baseline only reaches 46%.","doi":"10.24963/ijcai.2023/416","url":"https://ijcai.org/proceedings/2023/416","pdf":"https://ijcai.org/proceedings/2023/0416.pdf","markdown":"https://ijcai.org/proceedings/2023/416.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/416","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Machine Learning","track":"Main Track","number":416,"pages":{"first":3741,"last":3749},"keywords":["Machine Learning: ML: Federated learning"],"videos":[],"references":[{"position":1,"raw":"[Aïvodji et al., 2019] Ulrich Matchi Aïvodji, Sébastien Gambs, and Alexandre Martin. Iotfla: A secured and privacy-preserving smart home architecture implementing federated learning. In 2019 IEEE Security and Privacy Workshops (SPW), pages 175-180. IEEE, 2019.","title":"Iotfla: A secured and privacy-preserving smart home architecture implementing federated learning","authors":"Aïvodji","year":"2019","venue":"2019 IEEE Security and Privacy Workshops (SPW)","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Anguita et al., 2013] Davide Anguita, Alessandro Ghio, Luca Oneto, Xavier Parra Perez, and Jorge Luis Reyes Or- tiz. A public domain dataset for human activity recogni- tion using smartphones. In Proceedings of the 21th in- ternational European symposium on artificial neural net- works, computational intelligence and machine learning, pages 437-442, 2013.","title":"A public domain dataset for human activity recognition using smartphones","authors":"Davide Anguita, Alessandro Ghio, Luca Oneto, Xavier Parra Perez, Jorge Luis, Reyes Ortiz","year":"2013","venue":"Proceedings of the 21th international European symposium on artificial neural networks, computational intelligence and machine learning","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bars et al., 2022] B Le Bars, Aurélien Bellet, Marc Tom- masi, and Anne-Marie Kermarrec. Yes, topology mat- ters in decentralized optimization: Refined convergence and topology learning under heterogeneous data. arXiv preprint arXiv:2204.04452, 2022.","title":"Yes, topology matters in decentralized optimization: Refined convergence and topology learning under heterogeneous data","authors":"Le Bars, Aurélien Bellet, Marc Tommasi, Anne-Marie Kermarrec","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bellet et al., 2021] Aurélien Bellet, Anne-Marie Kermar- rec, and Erick Lavoie. D-cliques: Compensating noni- idness in decentralized federated learning with topology. arXiv preprint arXiv:2104.07365, 2021.","title":"D-cliques: Compensating noniidness in decentralized federated learning with topology","authors":"Aurélien Bellet, Anne-Marie Kermarrec, Erick Lavoie","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Boguná et al., 2004] Marián Boguná, Romualdo Pastor- Satorras, Albert Díaz-Guilera, and Alex Arenas. Mod- els of social networks based on social distance attachment. Physical review E, 70(5):056122, 2004.","title":"Models of social networks based on social distance attachment","authors":"Marián Boguná, Romualdo Pastor-Satorras, Albert Díaz-Guilera, Alex Arenas","year":"2004","venue":"Physical review E","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Dandi et al., 2022] Yatin Dandi, Anastasia Koloskova, Mar- tin Jaggi, and Sebastian U Stich. Data-heterogeneity- aware mixing for decentralized learning. arXiv preprint arXiv:2204.06477, 2022.","title":"Data-heterogeneityaware mixing for decentralized learning","authors":"Yatin Dandi, Anastasia Koloskova, Martin Jaggi, Sebastian U Stich","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Génois and Barrat, 2018] Mathieu Génois and Alain Barrat. Can co-location be used as a proxy for face-to-face con- tacts? EPJ Data Science, 7(1):11, 2018.","title":"Can co-location be used as a proxy for face-to-face contacts?","authors":"Barrat Génois, Mathieu Génois, Alain Barrat","year":"2018","venue":"EPJ Data Science","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Giaretta and Girdzijauskas, 2019] Lodovico Giaretta and Šarūnas Girdzijauskas. Gossip learning: Off the beaten path. In 2019 IEEE International Conference on Big Data (Big Data), pages 1117-1124. IEEE, 2019.","title":"Lodovico Giaretta and Šarūnas Girdzijauskas. Gossip learning: Off the beaten path","authors":"Girdzijauskas Giaretta","year":"2019","venue":"IEEE International Conference on Big Data (Big Data)","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Granovetter, 1973] Mark S Granovetter. The strength of weak ties. American journal of sociology, 78(6):1360- 1380, 1973.","title":"The strength of weak ties","authors":"S Mark, Granovetter","year":"1973","venue":"American journal of sociology","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Hristova et al., 2014] Desislava Hristova, Mirco Musolesi, and Cecilia Mascolo. Keep your friends close and your facebook friends closer: A multiplex network approach to the analysis of offline and online social ties. In Proceed- ings of the International AAAI Conference on Web and So- cial Media, volume 8, pages 206-215, 2014.","title":"Keep your friends close and your facebook friends closer: A multiplex network approach to the analysis of offline and online social ties","authors":"Desislava Hristova, Mirco Musolesi, Cecilia Mascolo","year":"2014","venue":"Proceedings of the International AAAI Conference on Web and Social Media","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Hsieh et al., 2020] Kevin Hsieh, Amar Phanishayee, Onur Mutlu, and Phillip Gibbons. The non-iid data quagmire of decentralized machine learning. In International Con- ference on Machine Learning, pages 4387-4398. PMLR, 2020.","title":"The non-iid data quagmire of decentralized machine learning","authors":"Kevin Hsieh, Amar Phanishayee, Onur Mutlu, Phillip Gibbons","year":"2020","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Kairouz et al., 2021] Peter Kairouz, H Brendan McMa- han, Brendan Avent, Aurélien Bellet, Mehdi Bennis, Ar- jun Nitin Bhagoji, Kallista Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings, et al. Advances and open problems in federated learning. Foundations and Trends® in Machine Learning, 14(1-2):1-210, 2021.","title":"Advances and open problems in federated learning","authors":"Peter Kairouz, Brendan Mcmahan, Brendan Avent, Aurélien Bellet, Mehdi Bennis, Nitin Arjun, Kallista Bhagoji, Zachary Bonawitz, Graham Charles, Rachel Cormode, Cummings","year":"2021","venue":"Foundations and Trends® in Machine Learning","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Karimireddy et al., 2020] Sai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank Reddi, Sebas- tian Stich, and Ananda Theertha Suresh. Scaffold: Stochastic controlled averaging for federated learning. In International Conference on Machine Learning, pages 5132-5143. PMLR, 2020.","title":"Scaffold: Stochastic controlled averaging for federated learning","authors":"Praneeth Sai, Satyen Karimireddy, Mehryar Kale, Sashank Mohri, Sebastian Reddi, Ananda Stich, Suresh Theertha","year":"2020","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Kempe, 2011] David Kempe. Structure and dynamics of in- formation in networks. Lecture Notes, 2011.","title":"Structure and dynamics of information in networks","authors":"David Kempe","year":"2011","venue":"Lecture Notes","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Koloskova et al., 2020] Anastasia Koloskova, Nicolas Loizou, Sadra Boreiri, Martin Jaggi, and Sebastian Stich. A unified theory of decentralized sgd with changing topology and local updates. In International Conference on Machine Learning, pages 5381-5393. PMLR, 2020.","title":"A unified theory of decentralized sgd with changing topology and local updates","authors":"Anastasia Koloskova, Nicolas Loizou, Sadra Boreiri, Martin Jaggi, Sebastian Stich","year":"2020","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Lalitha et al., 2018] Anusha Lalitha, Shubhanshu Shekhar, Tara Javidi, and Farinaz Koushanfar. Fully decentralized federated learning. In Third workshop on Bayesian Deep Learning (NeurIPS), 2018.","title":"Fully decentralized federated learning","authors":"Anusha Lalitha, Shubhanshu Shekhar, Tara Javidi, Farinaz Koushanfar","year":"2018","venue":"Third workshop on Bayesian Deep Learning (NeurIPS)","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Li and Zhan, 2021] Xin-Chun Li and De-Chuan Zhan. Fe- drs: Federated learning with restricted softmax for label distribution non-iid data. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pages 995-1005, 2021.","title":"Fedrs: Federated learning with restricted softmax for label distribution non-iid data","authors":"Zhan ; Xin-Chun Li, De-Chuan Li, Zhan","year":"2021","venue":"Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Li et al., 2019] Xiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang, and Zhihua Zhang. On the convergence of fedavg on non-iid data. arXiv preprint arXiv:1907.02189, 2019.","title":"On the convergence of fedavg on non-iid data","authors":"Xiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang, Zhihua Zhang","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Li et al., 2020] Tian Li, Anit Kumar Sahu, Manzil Zaheer, Maziar Sanjabi, Ameet Talwalkar, and Virginia Smith. Federated optimization in heterogeneous networks. Pro- ceedings of Machine Learning and Systems, 2:429-450, 2020.","title":"Federated optimization in heterogeneous networks","authors":"Tian Li, Anit Kumar Sahu, Manzil Zaheer, Maziar Sanjabi, Ameet Talwalkar, Virginia Smith","year":"2020","venue":"Proceedings of Machine Learning and Systems","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Lian et al., 2017] Xiangru Lian, Ce Zhang, Huan Zhang, Cho-Jui Hsieh, Wei Zhang, and Ji Liu. Can decentral- ized algorithms outperform centralized algorithms? a case study for decentralized parallel stochastic gradient de- scent. Advances in Neural Information Processing Sys- tems, 30, 2017.","title":"Can decentralized algorithms outperform centralized algorithms? a case study for decentralized parallel stochastic gradient descent","authors":"Lian","year":"2017","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Lian et al., 2018] Xiangru Lian, Wei Zhang, Ce Zhang, and Ji Liu. Asynchronous decentralized parallel stochastic gra- dient descent. In International Conference on Machine Learning, pages 3043-3052. PMLR, 2018.","title":"Asynchronous decentralized parallel stochastic gradient descent","authors":"Lian","year":"2018","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Lin et al., 2021] Tao Lin, Sai Praneeth Karimireddy, Sebas- tian U Stich, and Martin Jaggi. Quasi-global momen- tum: Accelerating decentralized deep learning on hetero- geneous data. arXiv preprint arXiv:2102.04761, 2021.","title":"Quasi-global momentum: Accelerating decentralized deep learning on heterogeneous data","authors":"Tao Lin, Praneeth Sai, Sebastian U Karimireddy, Martin Stich, Jaggi","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[McAuley and Leskovec, 2012] Julian McAuley and Jure Leskovec. Image labeling on a network: using social- network metadata for image classification. In European conference on computer vision, pages 828-841. Springer, 2012.","title":"Image labeling on a network: using socialnetwork metadata for image classification","authors":"Leskovec Mcauley, Julian Mcauley, Jure Leskovec","year":"2012","venue":"European conference on computer vision","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[McMahan et al., 2017] Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Ar- cas. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics, pages 1273-1282. PMLR, 2017.","title":"Communication-efficient learning of deep networks from decentralized data","authors":"Brendan Mcmahan, Eider Moore, Daniel Ramage, Seth Hampson, Blaise Aguera Y Arcas","year":"2017","venue":"Artificial intelligence and statistics","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[McPherson et al., 2001] Miller McPherson, Lynn Smith- Lovin, and James M Cook. Birds of a feather: Homophily in social networks. Annual review of sociology, pages 415- 444, 2001.","title":"Birds of a feather: Homophily in social networks","authors":"Mcpherson","year":"2001","venue":"Annual review of sociology","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Neglia et al., 2020] Giovanni Neglia, Chuan Xu, Don Towsley, and Gianmarco Calbi. Decentralized gradient methods: does topology matter? In International Confer- ence on Artificial Intelligence and Statistics, pages 2348- 2358. PMLR, 2020.","title":"Decentralized gradient methods: does topology matter","authors":"Giovanni Neglia, Chuan Xu, Don Towsley, Gianmarco Calbi","year":"2020","venue":"International Conference on Artificial Intelligence and Statistics","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Onnela et al., 2007] Jukka-Pekka Onnela, Jari Saramäki, Jörkki Hyvönen, Gábor Szabó, M Argollo De Menezes, Kimmo Kaski, Albert-László Barabási, and János Kertész. Analysis of a large-scale weighted network of one-to-one human communication. New journal of physics, 9(6):179, 2007.","title":"Analysis of a large-scale weighted network of one-to-one human communication","authors":"Jukka-Pekka Onnela, Jari Saramäki, Jörkki Hyvönen, Gábor Szabó, M Argollo De, Kimmo Menezes, Albert-László Kaski, János Barabási, Kertész","year":"2007","venue":"New journal of physics","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Onoszko et al., 2021] Noa Onoszko, Gustav Karlsson, Olof Mogren, and Edvin Listo Zec. Decentralized federated learning of deep neural networks on non-iid data. arXiv preprint arXiv:2107.08517, 2021.","title":"Decentralized federated learning of deep neural networks on non-iid data","authors":"Onoszko","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Ozella et al., 2021] Laura Ozella, Daniela Paolotti, Guil- herme Lichand, Jorge P Rodríguez, Simon Haenni, John Phuka, Onicio B Leal-Neto, and Ciro Cattuto. Using wear- able proximity sensors to characterize social contact pat- terns in a village of rural malawi. EPJ Data Science, 10(1):46, 2021.","title":"Using wearable proximity sensors to characterize social contact patterns in a village of rural malawi","authors":"Laura Ozella, Daniela Paolotti, Guilherme Lichand, Jorge P Rodríguez, Simon Haenni, John Phuka, B Onicio, Ciro Leal-Neto, Cattuto","year":"2021","venue":"EPJ Data Science","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Pietilänen and Diot, 2012] Anna-Kaisa Pietilänen and Christophe Diot. Dissemination in opportunistic social networks: the role of temporal communities. In Pro- ceedings of the thirteenth ACM international symposium on Mobile Ad Hoc Networking and Computing, pages 165-174, 2012.","title":"Dissemination in opportunistic social networks: the role of temporal communities","authors":"Anna-Kaisa Pietilänen, Christophe Diot","year":"2012","venue":"Proceedings of the thirteenth ACM international symposium on Mobile Ad Hoc Networking and Computing","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Taheri et al., 2020] Hossein Taheri, Aryan Mokhtari, Hamed Hassani, and Ramtin Pedarsani. Quantized push-sum for gossip and decentralized optimization over directed graphs. arXiv preprint arXiv:2002.09964, 2020.","title":"Quantized push-sum for gossip and decentralized optimization over directed graphs","authors":"Hossein Taheri, Aryan Mokhtari, Hamed Hassani, Ramtin Pedarsani","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Talaga and Nowak, 2019] Szymon Talaga and Andrzej Nowak. Homophily as a process generating social networks: insights from social distance attachment model. arXiv preprint arXiv:1907.07055, 2019.","title":"Homophily as a process generating social networks: insights from social distance attachment model","authors":"Szymon Talaga, Andrzej Nowak","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Tan and Le, 2019] Mingxing Tan and Quoc Le. Efficient- net: Rethinking model scaling for convolutional neural networks. In International conference on machine learn- ing, pages 6105-6114. PMLR, 2019.","title":"Efficientnet: Rethinking model scaling for convolutional neural networks","authors":"Le ; Tan, Mingxing Tan, Quoc Le","year":"2019","venue":"International conference on machine learning","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Tang et al., 2018] Hanlin Tang, Xiangru Lian, Ming Yan, Ce Zhang, and Ji Liu. D2: Decentralized training over de- centralized data. In International Conference on Machine Learning, pages 4848-4856. PMLR, 2018.","title":"D2: Decentralized training over decentralized data","authors":"Hanlin Tang, Xiangru Lian, Ming Yan, Ce Zhang, Ji Liu","year":"2018","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Tsitsiklis, 1984] John Nikolas Tsitsiklis. Problems in de- centralized decision making and computation. Technical report, Massachusetts Inst of Tech Cambridge Lab for In- formation and Decision Systems, 1984. [Vanhaesebrouck et al., 2017] Paul Vanhaesebrouck, Aurélien Bellet, and Marc Tommasi. Decentralized col- laborative learning of personalized models over networks. In Artificial Intelligence and Statistics, pages 509-517.","title":"Decentralized collaborative learning of personalized models over networks","authors":"John Nikolas, Tsitsiklis","year":"1984","venue":"Artificial Intelligence and Statistics","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"PMLR, 2017.","title":null,"authors":"Pmlr","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Veličković et al., 2017] Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. Graph attention networks. arXiv preprint arXiv:1710.10903, 2017.","title":"Graph attention networks","authors":"Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, Yoshua Bengio","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Vogels et al., 2021] Thijs Vogels, Lie He, Anastasiia Koloskova, Sai Praneeth Karimireddy, Tao Lin, Sebas- tian U Stich, and Martin Jaggi. Relaysum for decentralized deep learning on heterogeneous data. Advances in Neural Information Processing Systems, 34:28004-28015, 2021.","title":"Relaysum for decentralized deep learning on heterogeneous data","authors":"Thijs Vogels, Lie He, Anastasiia Koloskova, Praneeth Sai, Tao Karimireddy, Sebastian U Lin, Martin Stich, Jaggi","year":"2021","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Vogels et al., 2023] Thijs Vogels, Hadrien Hendrikx, and Martin Jaggi. Beyond spectral gap (extended): The role of the topology in decentralized learning. arXiv preprint arXiv:2301.02151, 2023.","title":"Beyond spectral gap (extended): The role of the topology in decentralized learning","authors":"Thijs Vogels, Hadrien Hendrikx, Martin Jaggi","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Wang et al., 2020] Hongyi Wang, Mikhail Yurochkin, Yuekai Sun, Dimitris Papailiopoulos, and Yasaman Khazaeni. Federated learning with matched averaging. arXiv preprint arXiv:2002.06440, 2020.","title":"Federated learning with matched averaging","authors":"Hongyi Wang, Mikhail Yurochkin, Yuekai Sun, Dimitris Papailiopoulos, Yasaman Khazaeni","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Wang et al., 2021] Lixu Wang, Shichao Xu, Xiao Wang, and Qi Zhu. Addressing class imbalance in federated learning. In Proceedings of the AAAI Conference on Arti- ficial Intelligence, volume 35, pages 10165-10173, 2021.","title":"Addressing class imbalance in federated learning","authors":"Wang","year":"2021","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Warnat-Herresthal et al., 2021] Stefanie Warnat-Herresthal, Hartmut Schultze, Krishnaprasad Lingadahalli Shastry, Sathyanarayanan Manamohan, Saikat Mukherjee, Vishesh Garg, Ravi Sarveswara, Kristian Händler, Peter Pickkers, N Ahmad Aziz, et al. Swarm learning for decentral- ized and confidential clinical machine learning. Nature, 594(7862):265-270, 2021.","title":"Swarm learning for decentralized and confidential clinical machine learning","authors":"Stefanie Warnat-Herresthal, Hartmut Schultze, Krishnaprasad Lingadahalli Shastry, Sathyanarayanan Manamohan, Saikat Mukherjee, Vishesh Garg, Ravi Sarveswara, Kristian Händler, Peter Pickkers, Ahmad Aziz","year":"2021","venue":"Nature","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Xiao et al., 2017] Han Xiao, Kashif Rasul, and Roland Vollgraf. Fashion-mnist: a novel image dataset for bench- marking machine learning algorithms. arXiv preprint arXiv:1708.07747, 2017.","title":"Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms","authors":"Han Xiao, Kashif Rasul, Roland Vollgraf","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[Ying et al., 2021] Bicheng Ying, Kun Yuan, Yiming Chen, Hanbin Hu, Pan Pan, and Wotao Yin. Exponential graph is provably efficient for decentralized deep train- ing. Advances in Neural Information Processing Systems, 34:13975-13987, 2021.","title":"Exponential graph is provably efficient for decentralized deep training","authors":"Ying","year":"2021","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":45,"raw":"[Yuan et al., 2021] Kun Yuan, Yiming Chen, Xinmeng Huang, Yingya Zhang, Pan Pan, Yinghui Xu, and Wotao Yin. Decentlam: Decentralized momentum sgd for large- batch deep training. In Proceedings of the IEEE/CVF In- ternational Conference on Computer Vision, pages 3029- 3039, 2021.","title":"Decentlam: Decentralized momentum sgd for largebatch deep training","authors":"Kun Yuan, Yiming Chen, Xinmeng Huang, Yingya Zhang, Pan Pan, Yinghui Xu, Wotao Yin","year":"2021","venue":"Proceedings of the IEEE/CVF International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[Zheng et al., 2022] Zhaohua Zheng, Yize Zhou, Yilong Sun, Zhang Wang, Boyi Liu, and Keqiu Li. Applications of federated learning in smart cities: recent advances, taxon- omy, and open challenges. Connection Science, 34(1):1- 28, 2022.","title":"Applications of federated learning in smart cities: recent advances, taxonomy, and open challenges","authors":"Zhaohua Zheng, Yize Zhou, Yilong Sun, Zhang Wang, Boyi Liu, Keqiu Li","year":"2022","venue":"Connection Science","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}