Distributed, Parallel, and Cluster Computing

Authors and titles for cs.DC in Jun 2021, skipping first 125

[126]  arXiv:2106.02969 (cross-list from cs.LG) [pdf, other]

Title: FedNL: Making Newton-Type Methods Applicable to Federated Learning

Authors: Mher Safaryan, Rustem Islamov, Xun Qian, Peter Richtárik

Comments: 65 pages, 7 algorithms, 14 figures --- Accepted to ICML 2022

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[127]  arXiv:2106.03211 (cross-list from cs.LG) [pdf, other]

Title: Distributed Learning and its Application for Time-Series Prediction

Authors: Nhuong V. Nguyen, Sybille Legitime

Comments: 8 pages, 10 figures, and 2 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[128]  arXiv:2106.03328 (cross-list from cs.LG) [pdf, other]

Title: Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning

Authors: Jinhyun So, Ramy E. Ali, Basak Guler, Jiantao Jiao, Salman Avestimehr

Journal-ref: AAAI 2023

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[129]  arXiv:2106.03539 (cross-list from cs.SE) [pdf, other]

Title: How to Bake Quantum into Your Pet Petri Nets and Have Your Net Theory Too

Authors: Heinz W. Schmidt

Comments: 24 pages incl. supplementary material in appendix. Accepted for the 15th Symposium and Summer School On Service-Oriented Computing (Submitted 2 April 2021, this https URL). Final revised and authenticated version to appear in Springer CCIS (this https URL)

Subjects: Software Engineering (cs.SE); Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET)

[130]  arXiv:2106.03824 (cross-list from cs.DS) [pdf, other]

Title: Parallel Batch-Dynamic Algorithms for $k$-Core Decomposition and Related Graph Problems

Authors: Quanquan C. Liu, Jessica Shi, Shangdi Yu, Laxman Dhulipala, Julian Shun

Comments: Abstract truncated per arXiv limits; add densest subgraph observation, fix Table 3 typos

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[131]  arXiv:2106.04502 (cross-list from cs.LG) [pdf, other]

Title: Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing

Authors: Mikhail Khodak, Renbo Tu, Tian Li, Liam Li, Maria-Florina Balcan, Virginia Smith, Ameet Talwalkar

Comments: NeurIPS 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[132]  arXiv:2106.04727 (cross-list from cs.DS) [pdf, other]

Title: ParChain: A Framework for Parallel Hierarchical Agglomerative Clustering using Nearest-Neighbor Chain

Authors: Shangdi Yu, Yiqiu Wang, Yan Gu, Laxman Dhulipala, Julian Shun

Subjects: Data Structures and Algorithms (cs.DS); Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[133]  arXiv:2106.04885 (cross-list from cs.CR) [pdf, other]

Title: A Blockchain-Based Trust Management Framework with Verifiable Interactions

Authors: Shantanu Pal, Ambrose Hill, Tahiry Rabehaja, Michael Hitchens

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[134]  arXiv:2106.05001 (cross-list from cs.LG) [pdf, other]

Title: No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Data

Authors: Mi Luo, Fei Chen, Dapeng Hu, Yifan Zhang, Jian Liang, Jiashi Feng

Comments: 22 pages, NeurIPS 2021

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[135]  arXiv:2106.05245 (cross-list from cs.DS) [pdf, other]

Title: Local Algorithms for Finding Densely Connected Clusters

Authors: Peter Macgregor, He Sun

Comments: This work is accepted at ICML'21 for a long presentation

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[136]  arXiv:2106.05463 (cross-list from cs.CR) [pdf, other]

Title: Cross-chain Interaction Model In a Fully Verified Way

Authors: Hong Su

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[137]  arXiv:2106.06150 (cross-list from cs.LG) [pdf, other]

Title: Global Neighbor Sampling for Mixed CPU-GPU Training on Giant Graphs

Authors: Jialin Dong, Da Zheng, Lin F. Yang, Geroge Karypis

Comments: The paper is published in KDD 2021

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[138]  arXiv:2106.06293 (cross-list from cs.NI) [pdf, other]

Title: Acceleration-as-a-μService: A Cloud-native Monte-Carlo Option Pricing Engine on CPUs, GPUs and Disaggregated FPGAs

Authors: Dionysios Diamantopoulos, Raphael Polig, Burkhard Ringlein, Mitra Purandare, Beat Weiss, Christoph Hagleitner, Mark Lantz, Francois Abel

Comments: 3 pages, 6 figures

Subjects: Networking and Internet Architecture (cs.NI); Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[139]  arXiv:2106.06401 (cross-list from cs.LG) [pdf, other]

Title: Decoupled Greedy Learning of CNNs for Synchronous and Asynchronous Distributed Learning

Authors: Eugene Belilovsky (MILA), Louis Leconte (MLIA, CMAP), Lucas Caccia (MILA), Michael Eickenberg, Edouard Oyallon (MLIA)

Comments: arXiv admin note: substantial text overlap with arXiv:1901.08164

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[140]  arXiv:2106.06433 (cross-list from cs.AR) [pdf, other]

Title: FPGA-Based Near-Memory Acceleration of Modern Data-Intensive Applications

Authors: Gagandeep Singh, Mohammed Alser, Damla Senol Cali, Dionysios Diamantopoulos, Juan Gómez-Luna, Henk Corporaal, Onur Mutlu

Comments: This is an extended and updated version of a paper published in IEEE Micro, vol. 41, no. 4, pp. 39-48, 1 July-Aug. 2021

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[141]  arXiv:2106.06445 (cross-list from cs.LG) [pdf, other]

Title: Coded-InvNet for Resilient Prediction Serving Systems

Authors: Tuan Dinh, Kangwook Lee

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[142]  arXiv:2106.06579 (cross-list from cs.LG) [pdf, other]

Title: Federated Learning with Spiking Neural Networks

Authors: Yeshwanth Venkatesha, Youngeun Kim, Leandros Tassiulas, Priyadarshini Panda

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Neural and Evolutionary Computing (cs.NE)

[143]  arXiv:2106.06843 (cross-list from cs.LG) [pdf, ps, other]

Title: Federated Learning on Non-IID Data: A Survey

Authors: Hangyu Zhu, Jinjin Xu, Shiqing Liu, Yaochu Jin

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[144]  arXiv:2106.07094 (cross-list from cs.LG) [pdf, other]

Title: On the Convergence of Differentially Private Federated Learning on Non-Lipschitz Objectives, and with Normalized Client Updates

Authors: Rudrajit Das, Abolfazl Hashemi, Sujay Sanghavi, Inderjit S. Dhillon

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Signal Processing (eess.SP); Optimization and Control (math.OC); Machine Learning (stat.ML)

[145]  arXiv:2106.07155 (cross-list from cs.LG) [pdf, ps, other]

Title: CFedAvg: Achieving Efficient Communication and Fast Convergence in Non-IID Federated Learning

Authors: Haibo Yang, Jia Liu, Elizabeth S. Bentley

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[146]  arXiv:2106.07289 (cross-list from cs.LG) [pdf, other]

Title: Decentralized Personalized Federated Learning for Min-Max Problems

Authors: Ekaterina Borodich, Aleksandr Beznosikov, Abdurakhmon Sadiev, Vadim Sushko, Nikolay Savelyev, Martin Takáč, Alexander Gasnikov

Comments: 33 pages, 3 algorithms, 5 figures, 2 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[147]  arXiv:2106.07578 (cross-list from cs.LG) [pdf, other]

Title: Dynamic Gradient Aggregation for Federated Domain Adaptation

Authors: Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

Comments: arXiv admin note: substantial text overlap with arXiv:2008.02452

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[148]  arXiv:2106.07731 (cross-list from cs.IT) [pdf, ps, other]

Title: Bivariate Polynomial Codes for Secure Distributed Matrix Multiplication

Authors: Burak Hasircioglu, Jesus Gomez-Vilardebo, Deniz Gunduz

Comments: To appear in IEEE Journal on Selected Areas in Communications. arXiv admin note: text overlap with arXiv:2102.08304

Subjects: Information Theory (cs.IT); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[149]  arXiv:2106.07820 (cross-list from cs.LG) [pdf, other]

Title: On Large-Cohort Training for Federated Learning

Authors: Zachary Charles, Zachary Garrett, Zhouyuan Huo, Sergei Shmulyian, Virginia Smith

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[150]  arXiv:2106.07831 (cross-list from cs.CR) [pdf, other]

Title: Efficient Asynchronous Byzantine Agreement without Private Setups

Authors: Yingzi Gao, Yuan Lu, Zhenliang Lu, Qiang Tang, Jing Xu, Zhenfeng Zhang

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[151]  arXiv:2106.07894 (cross-list from cs.AR) [pdf, other]

Title: S2Engine: A Novel Systolic Architecture for Sparse Convolutional Neural Networks

Authors: Jianlei Yang, Wenzhi Fu, Xingzhou Cheng, Xucheng Ye, Pengcheng Dai, Weisheng Zhao

Comments: 13 pages, 17 figures

Journal-ref: IEEE Transactions on Computers, 2021

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[152]  arXiv:2106.08290 (cross-list from cs.IT) [pdf, other]

Title: PolyDot Coded Privacy Preserving Multi-Party Computation at the Edge

Authors: Elahe Vedadi, Yasaman Keshtkarjahromi, Hulya Seferoglu

Comments: 23 pages, 5 figures

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC)

[153]  arXiv:2106.08318 (cross-list from cs.CV) [pdf, other]

Title: Gradient Forward-Propagation for Large-Scale Temporal Video Modelling

Authors: Mateusz Malinowski, Dimitrios Vytiniotis, Grzegorz Swirszcz, Viorica Patraucean, Joao Carreira

Comments: Accepted to CVPR 2021. arXiv admin note: text overlap with arXiv:2001.06232

Subjects: Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Image and Video Processing (eess.IV)

[154]  arXiv:2106.08448 (cross-list from cs.DS) [pdf, other]

Title: Correlation Clustering in Constant Many Parallel Rounds

Authors: Vincent Cohen-Addad, Silvio Lattanzi, Slobodan Mitrović, Ashkan Norouzi-Fard, Nikos Parotsidis, Jakub Tarnawski

Comments: ICML 2021 (long talk)

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[155]  arXiv:2106.08882 (cross-list from cs.LG) [pdf, other]

Title: Robust Training in High Dimensions via Block Coordinate Geometric Median Descent

Authors: Anish Acharya, Abolfazl Hashemi, Prateek Jain, Sujay Sanghavi, Inderjit S. Dhillon, Ufuk Topcu

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC); Machine Learning (stat.ML)

[156]  arXiv:2106.08946 (cross-list from cs.LG) [pdf, other]

Title: FGLP: A Federated Fine-Grained Location Prediction System for Mobile Users

Authors: Xiaopeng Jiang, Shuai Zhao, Guy Jacobson, Rittwik Jana, Wen-Ling Hsu, Manoop Talasila, Syed Anwar Aftab, Yi Chen, Cristian Borcea

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY)

[157]  arXiv:2106.09109 (cross-list from cs.LG) [pdf, other]

Title: QuantumFed: A Federated Learning Framework for Collaborative Quantum Training

Authors: Qi Xia, Qun Li

Comments: Under revision

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[158]  arXiv:2106.09349 (cross-list from cs.CR) [pdf, other]

Title: Blockchain Oracle Design Patterns

Authors: Amirmohammad Pasdar, Zhongli Dong, Young Choon Lee

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[159]  arXiv:2106.09485 (cross-list from cs.IT) [pdf, other]

Title: Secure Multi-Function Computation with Private Remote Sources

Authors: Onur Günlü, Matthieu Bloch, Rafael F. Schaefer

Comments: Shorter version appeared in the IEEE International Symposium on Information Theory 2021

Subjects: Information Theory (cs.IT); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Signal Processing (eess.SP)

[160]  arXiv:2106.09580 (cross-list from cs.GT) [pdf, ps, other]

Title: Optimality and Stability in Federated Learning: A Game-theoretic Approach

Authors: Kate Donahue, Jon Kleinberg

Subjects: Computer Science and Game Theory (cs.GT); Computers and Society (cs.CY); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[161]  arXiv:2106.09922 (cross-list from cs.NE) [pdf, ps, other]

Title: A Fresh Approach to Evaluate Performance in Distributed Parallel Genetic Algorithms

Authors: Tomohiro Harada, Enrique Alba, Gabriel Luque

Comments: 22 pages, submitted to Applied Soft Computing and under review

Subjects: Neural and Evolutionary Computing (cs.NE); Distributed, Parallel, and Cluster Computing (cs.DC)

[162]  arXiv:2106.10022 (cross-list from cs.LG) [pdf, other]

Title: Local AdaGrad-Type Algorithm for Stochastic Convex-Concave Optimization

Authors: Luofeng Liao, Li Shen, Jia Duan, Mladen Kolar, Dacheng Tao

Comments: 42 pages; Accepted to Machine Learning, 2022

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[163]  arXiv:2106.10196 (cross-list from cs.LG) [pdf, other]

Title: Federated Robustness Propagation: Sharing Robustness in Heterogeneous Federated Learning

Authors: Junyuan Hong, Haotao Wang, Zhangyang Wang, Jiayu Zhou

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[164]  arXiv:2106.10207 (cross-list from cs.LG) [pdf, other]

Title: Distributed Deep Learning in Open Collaborations

Authors: Michael Diskin, Alexey Bukhtiyarov, Max Ryabinin, Lucile Saulnier, Quentin Lhoest, Anton Sinitsin, Dmitry Popov, Dmitry Pyrkin, Maxim Kashirin, Alexander Borzunov, Albert Villanova del Moral, Denis Mazur, Ilia Kobelev, Yacine Jernite, Thomas Wolf, Gennady Pekhimenko

Comments: Accepted to Conference on Neural Information Processing Systems (NeurIPS) 2021. 32 pages, 10 figures. Code: this https URL

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[165]  arXiv:2106.10334 (cross-list from cs.PF) [pdf, other]

Title: AutoTune: Improving End-to-end Performance and Resource Efficiency for Microservice Applications

Authors: Michael Alan Chang, Aurojit Panda, Hantao Wang, Yuancheng Tsai, Rahul Balakrishnan, Scott Shenker

Subjects: Performance (cs.PF); Distributed, Parallel, and Cluster Computing (cs.DC)

[166]  arXiv:2106.10515 (cross-list from cs.DB) [pdf, ps, other]

Title: A Generic Distributed Clustering Framework for Massive Data

Authors: Pingyi Luo, Qiang Huang, Anthony K. H. Tung

Comments: 11 pages, 7 figures

Subjects: Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC)

[167]  arXiv:2106.10685 (cross-list from cs.AI) [pdf, other]

Title: MILP, pseudo-boolean, and OMT solvers for optimal fault-tolerant placements of relay nodes in mission critical wireless networks

Authors: Quian Matteo Chen, Alberto Finzi, Toni Mancini, Igor Melatti, Enrico Tronci

Comments: 33 pages, 11 figures

Journal-ref: Fundamenta Informaticae, 174(3-4):229-258, 2020

Subjects: Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Logic in Computer Science (cs.LO); Networking and Internet Architecture (cs.NI)

[168]  arXiv:2106.10692 (cross-list from eess.SY) [pdf, other]

Title: Parallel Statistical Model Checking for Safety Verification in Smart Grids

Authors: T. Mancini, F. Mari, I. Melatti, I. Salvo, E. Tronci, J.K. Gruber, B. Hayes, M. Prodanovic, L. Elmegaard

Comments: 6 pages, 1 figure. In SmartGridComm 2018. IEEE, 2018

Subjects: Systems and Control (eess.SY); Distributed, Parallel, and Cluster Computing (cs.DC)

[169]  arXiv:2106.10707 (cross-list from eess.SY) [pdf, other]

Title: Minimizing Delay in Network Function Visualization with Quantum Computing

Authors: Wenlu Xuan, Zhongqi Zhao, Lei Fan, Zhu Han

Comments: Invited Paper by IEEE MASS 2021

Subjects: Systems and Control (eess.SY); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[170]  arXiv:2106.10796 (cross-list from cs.LG) [pdf, other]

Title: CD-SGD: Distributed Stochastic Gradient Descent with Compression and Delay Compensation

Authors: Enda Yu, Dezun Dong, Yemao Xu, Shuo Ouyang, Xiangke Liao

Comments: 12 pages

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[171]  arXiv:2106.11257 (cross-list from cs.LG) [pdf, other]

Title: Secure Distributed Training at Scale

Authors: Eduard Gorbunov, Alexander Borzunov, Michael Diskin, Max Ryabinin

Comments: Accepted to International Conference on Machine Learning (ICML 2022). 61 pages, 10 figures. The version 4 fixes inaccuracies in the proofs of Lemmas E.2 and E.4. Code: this https URL

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[172]  arXiv:2106.11264 (cross-list from cs.LG) [pdf, other]

Title: Compositional federated learning: Applications in distributionally robust averaging and meta learning

Authors: Feihu Huang, Junyi Li

Comments: 10 pages, 6 figures

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[173]  arXiv:2106.11505 (cross-list from cs.FL) [pdf, ps, other]

Title: Reasoning about Emergence of Collective Memory

Authors: R. Ramanujam (Institute of Mathematical Sciences, Chennai)

Comments: In Proceedings TARK 2021, arXiv:2106.10886

Journal-ref: EPTCS 335, 2021, pp. 269-280

Subjects: Formal Languages and Automata Theory (cs.FL); Distributed, Parallel, and Cluster Computing (cs.DC); Social and Information Networks (cs.SI)

[174]  arXiv:2106.11570 (cross-list from cs.LG) [pdf, other]

Title: FLRA: A Reference Architecture for Federated Learning Systems

Authors: Sin Kit Lo, Qinghua Lu, Hye-Young Paik, Liming Zhu

Comments: Accepted by ECSA 2021

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Software Engineering (cs.SE)

[175]  arXiv:2106.11728 (cross-list from cs.CY) [pdf, ps, other]

Title: Digital Twins, Internet of Things and Mobile Medicine: a Review of Current Platforms to Support Smart Healthcare

Authors: Ivan Volkov, Gleb Radchenko, Andrey Tchernykh

Comments: 16 pages, 3 figures

Subjects: Computers and Society (cs.CY); Distributed, Parallel, and Cluster Computing (cs.DC)