Distributed, Parallel, and Cluster Computing

Authors and titles for cs.DC in Jun 2021, skipping first 110

[111]  arXiv:2106.00003 (cross-list from cs.LG) [pdf, other]

Title: Parallelized Computation and Backpropagation Under Angle-Parametrized Orthogonal Matrices

Authors: Firas Hamze

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[112]  arXiv:2106.00275 (cross-list from cs.LG) [pdf, other]

Title: H-FL: A Hierarchical Communication-Efficient and Privacy-Protected Architecture for Federated Learning

Authors: He Yang

Comments: Accepted by IJCAI 2021, 7pages, 10 figures

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[113]  arXiv:2106.00374 (cross-list from cs.DS) [pdf, other]

Title: Fault-Tolerant Labeling and Compact Routing Schemes

Authors: Michal Dory, Merav Parter

Comments: PODC 2021

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[114]  arXiv:2106.00881 (cross-list from cs.LG) [pdf, other]

Title: Hyperdimensional Computing for Efficient Distributed Classification with Randomized Neural Networks

Authors: Antonello Rosato, Massimo Panella, Denis Kleyko

Comments: 1 table, 5 figures

Journal-ref: 2021 International Joint Conference on Neural Networks (IJCNN)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[115]  arXiv:2106.00999 (cross-list from cs.LG) [pdf, other]

Title: Communication-Efficient Split Learning Based on Analog Communication and Over the Air Aggregation

Authors: Mounssif Krouka, Anis Elgabli, Chaouki ben Issaid, Mehdi Bennis

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[116]  arXiv:2106.01036 (cross-list from cs.DS) [pdf, other]

Title: Ultra-Sparse Near-Additive Emulators

Authors: Michael Elkin, Shaked Matar

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[117]  arXiv:2106.01340 (cross-list from cs.CR) [pdf, ps, other]

Title: Transaction Fee Mechanism Design

Authors: Tim Roughgarden

Comments: Under review at Journal of the ACM. Preliminary version appeared in the 22nd ACM Conference on Economics and Computation (EC '21). This academic paper partially overlaps with the longer general-audience report published as arXiv:2012.00854

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS); Computer Science and Game Theory (cs.GT); Theoretical Economics (econ.TH)

[118]  arXiv:2106.01674 (cross-list from cs.IR) [pdf, other]

Title: JIZHI: A Fast and Cost-Effective Model-As-A-Service System for Web-Scale Online Inference at Baidu

Authors: Hao Liu, Qian Gao, Jiang Li, Xiaochao Liao, Hao Xiong, Guangxing Chen, Wenlin Wang, Guobao Yang, Zhiwei Zha, Daxiang Dong, Dejing Dou, Haoyi Xiong

Comments: Accepted to SIGKDD 2021 applied data science track

Subjects: Information Retrieval (cs.IR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[119]  arXiv:2106.01880 (cross-list from cs.DS) [pdf, ps, other]

Title: Component Stability in Low-Space Massively Parallel Computation

Authors: Artur Czumaj, Peter Davies, Merav Parter

Comments: 45 pages, to appear at PODC 2021

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[120]  arXiv:2106.01894 (cross-list from cs.DS) [pdf, other]

Title: Low-Congestion Shortcuts in Constant Diameter Graphs

Authors: Shimon Kogan, Merav Parter

Comments: To appear in PODC 2021

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[121]  arXiv:2106.02305 (cross-list from cs.LG) [pdf, other]

Title: Local Adaptivity in Federated Learning: Convergence and Consistency

Authors: Jianyu Wang, Zheng Xu, Zachary Garrett, Zachary Charles, Luyang Liu, Gauri Joshi

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[122]  arXiv:2106.02310 (cross-list from cs.LG) [pdf, other]

Title: FedCCEA : A Practical Approach of Client Contribution Evaluation for Federated Learning

Authors: Sung Kuk Shyn, Donghee Kim, Kwangsu Kim

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Computer Science and Game Theory (cs.GT)

[123]  arXiv:2106.02420 (cross-list from cs.NI) [pdf, other]

Title: An Intelligent Resource Reservation for Crowdsourced Live Video Streaming Applications in Geo-Distributed Cloud Environment

Authors: Emna Baccour, Fatima Haouari, Aiman Erbad, Amr Mohamed, Kashif Bilal, Mohsen Guizani, Mounir Hamdi

Comments: Published in IEEE systems journal

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Multimedia (cs.MM)

[124]  arXiv:2106.02679 (cross-list from cs.LG) [pdf, ps, other]

Title: Layered gradient accumulation and modular pipeline parallelism: fast and efficient training of large language models

Authors: Joel Lamy-Poirier

Comments: 22 pages, 8 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[125]  arXiv:2106.02942 (cross-list from cs.DS) [pdf, other]

Title: Time-Optimal Sublinear Algorithms for Matching and Vertex Cover

Authors: Soheil Behnezhad

Comments: This is the full version of a FOCS 2021 paper under the same title

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[126]  arXiv:2106.02969 (cross-list from cs.LG) [pdf, other]

Title: FedNL: Making Newton-Type Methods Applicable to Federated Learning

Authors: Mher Safaryan, Rustem Islamov, Xun Qian, Peter Richtárik

Comments: 65 pages, 7 algorithms, 14 figures --- Accepted to ICML 2022

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[127]  arXiv:2106.03211 (cross-list from cs.LG) [pdf, other]

Title: Distributed Learning and its Application for Time-Series Prediction

Authors: Nhuong V. Nguyen, Sybille Legitime

Comments: 8 pages, 10 figures, and 2 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[128]  arXiv:2106.03328 (cross-list from cs.LG) [pdf, other]

Title: Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning

Authors: Jinhyun So, Ramy E. Ali, Basak Guler, Jiantao Jiao, Salman Avestimehr

Journal-ref: AAAI 2023

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[129]  arXiv:2106.03539 (cross-list from cs.SE) [pdf, other]

Title: How to Bake Quantum into Your Pet Petri Nets and Have Your Net Theory Too

Authors: Heinz W. Schmidt

Comments: 24 pages incl. supplementary material in appendix. Accepted for the 15th Symposium and Summer School On Service-Oriented Computing (Submitted 2 April 2021, this https URL). Final revised and authenticated version to appear in Springer CCIS (this https URL)

Subjects: Software Engineering (cs.SE); Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET)

[130]  arXiv:2106.03824 (cross-list from cs.DS) [pdf, other]

Title: Parallel Batch-Dynamic Algorithms for $k$-Core Decomposition and Related Graph Problems

Authors: Quanquan C. Liu, Jessica Shi, Shangdi Yu, Laxman Dhulipala, Julian Shun

Comments: Abstract truncated per arXiv limits; add densest subgraph observation, fix Table 3 typos

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[131]  arXiv:2106.04502 (cross-list from cs.LG) [pdf, other]

Title: Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing

Authors: Mikhail Khodak, Renbo Tu, Tian Li, Liam Li, Maria-Florina Balcan, Virginia Smith, Ameet Talwalkar

Comments: NeurIPS 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[132]  arXiv:2106.04727 (cross-list from cs.DS) [pdf, other]

Title: ParChain: A Framework for Parallel Hierarchical Agglomerative Clustering using Nearest-Neighbor Chain

Authors: Shangdi Yu, Yiqiu Wang, Yan Gu, Laxman Dhulipala, Julian Shun

Subjects: Data Structures and Algorithms (cs.DS); Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[133]  arXiv:2106.04885 (cross-list from cs.CR) [pdf, other]

Title: A Blockchain-Based Trust Management Framework with Verifiable Interactions

Authors: Shantanu Pal, Ambrose Hill, Tahiry Rabehaja, Michael Hitchens

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[134]  arXiv:2106.05001 (cross-list from cs.LG) [pdf, other]

Title: No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Data

Authors: Mi Luo, Fei Chen, Dapeng Hu, Yifan Zhang, Jian Liang, Jiashi Feng

Comments: 22 pages, NeurIPS 2021

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[135]  arXiv:2106.05245 (cross-list from cs.DS) [pdf, other]

Title: Local Algorithms for Finding Densely Connected Clusters

Authors: Peter Macgregor, He Sun

Comments: This work is accepted at ICML'21 for a long presentation

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)