Distributed, Parallel, and Cluster Computing

Authors and titles for cs.DC in Jun 2021, skipping first 100

[101]  arXiv:2106.15112 [pdf, other]

Title: workload forecasting and resource management models based on machine learning for cloud computing environments

Authors: Deepika Saxena, Ashutosh Kumar Singh

Comments: 17 pages,5 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[102]  arXiv:2106.15151 [pdf, ps, other]

Title: Scalable Traffic Predictive Analysis using GPU in Big Data

Authors: Dalyapraz Dauletbak, Junghoon Heo, Sooyoung Kim, Yeon Pyo Kim, Jongwook Woo

Comments: 5 pages, 2 figures, 5 tables

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[103]  arXiv:2106.15508 [pdf, other]

Title: Efficient State-space Exploration in Massively Parallel Simulation Based Inference

Authors: Sourabh Kulkarni, Csaba Andras Moritz

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[104]  arXiv:2106.15549 [pdf, ps, other]

Title: Distributed Matrix Tiling Using A Hypergraph Labeling Formulation

Authors: Avah Banerjee, Guoli Ding, Maxwell Reeser

Comments: 22 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)

[105]  arXiv:2106.15554 [pdf, other]

Title: Blunting an Adversary Against Randomized Concurrent Programs with Linearizable Implementations

Authors: Hagit Attiya, Constantin Enea, Jennifer L. Welch

Comments: 22 pages Revised version generalizes the class of implementations to which the transformation applies

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[106]  arXiv:2106.15555 [pdf, other]

Title: Validation of a simulation model for FaaS performance benchmarking using predictive validation

Authors: David Ferreira Quaresma, Thiago Emmanuel Pereira, Daniel Fireman

Comments: The final paper of bachelor's degree, 8 pages, 5 figures, 1 table

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[107]  arXiv:2106.15565 [pdf, other]

Title: Flare: Flexible In-Network Allreduce

Authors: Daniele De Sensi, Salvatore Di Girolamo, Saleh Ashkboos, Shigang Li, Torsten Hoefler

Journal-ref: Published in Proceedings of The International Conference for High Performance Computing Networking, Storage, and Analysis (SC '21) (2021)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Hardware Architecture (cs.AR); Networking and Internet Architecture (cs.NI)

[108]  arXiv:2106.15689 [pdf, other]

Title: NEUKONFIG: Reducing Edge Service Downtime When Repartitioning DNNs

Authors: Ayesha Abdul Majeed, Peter Kilpatrick, Ivor Spence, Blesson Varghese

Comments: 10 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[109]  arXiv:2106.16002 [pdf, other]

Title: Distributed Nash Equilibrium Seeking under Quantization Communication

Authors: Ziqin Chen, Ji Ma, Shu Liang, Li Li

Comments: 8 pages, 5 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[110]  arXiv:2106.16064 [pdf, other]

Title: Efficient Sparse Matrix Kernels based on Adaptive Workload-Balancing and Parallel-Reduction

Authors: Guyue Huang, Guohao Dai, Yu Wang, Yufei Ding, Yuan Xie

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[111]  arXiv:2106.00003 (cross-list from cs.LG) [pdf, other]

Title: Parallelized Computation and Backpropagation Under Angle-Parametrized Orthogonal Matrices

Authors: Firas Hamze

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[112]  arXiv:2106.00275 (cross-list from cs.LG) [pdf, other]

Title: H-FL: A Hierarchical Communication-Efficient and Privacy-Protected Architecture for Federated Learning

Authors: He Yang

Comments: Accepted by IJCAI 2021, 7pages, 10 figures

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[113]  arXiv:2106.00374 (cross-list from cs.DS) [pdf, other]

Title: Fault-Tolerant Labeling and Compact Routing Schemes

Authors: Michal Dory, Merav Parter

Comments: PODC 2021

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[114]  arXiv:2106.00881 (cross-list from cs.LG) [pdf, other]

Title: Hyperdimensional Computing for Efficient Distributed Classification with Randomized Neural Networks

Authors: Antonello Rosato, Massimo Panella, Denis Kleyko

Comments: 1 table, 5 figures

Journal-ref: 2021 International Joint Conference on Neural Networks (IJCNN)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[115]  arXiv:2106.00999 (cross-list from cs.LG) [pdf, other]

Title: Communication-Efficient Split Learning Based on Analog Communication and Over the Air Aggregation

Authors: Mounssif Krouka, Anis Elgabli, Chaouki ben Issaid, Mehdi Bennis

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[116]  arXiv:2106.01036 (cross-list from cs.DS) [pdf, other]

Title: Ultra-Sparse Near-Additive Emulators

Authors: Michael Elkin, Shaked Matar

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[117]  arXiv:2106.01340 (cross-list from cs.CR) [pdf, ps, other]

Title: Transaction Fee Mechanism Design

Authors: Tim Roughgarden

Comments: Under review at Journal of the ACM. Preliminary version appeared in the 22nd ACM Conference on Economics and Computation (EC '21). This academic paper partially overlaps with the longer general-audience report published as arXiv:2012.00854

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS); Computer Science and Game Theory (cs.GT); Theoretical Economics (econ.TH)

[118]  arXiv:2106.01674 (cross-list from cs.IR) [pdf, other]

Title: JIZHI: A Fast and Cost-Effective Model-As-A-Service System for Web-Scale Online Inference at Baidu

Authors: Hao Liu, Qian Gao, Jiang Li, Xiaochao Liao, Hao Xiong, Guangxing Chen, Wenlin Wang, Guobao Yang, Zhiwei Zha, Daxiang Dong, Dejing Dou, Haoyi Xiong

Comments: Accepted to SIGKDD 2021 applied data science track

Subjects: Information Retrieval (cs.IR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[119]  arXiv:2106.01880 (cross-list from cs.DS) [pdf, ps, other]

Title: Component Stability in Low-Space Massively Parallel Computation

Authors: Artur Czumaj, Peter Davies, Merav Parter

Comments: 45 pages, to appear at PODC 2021

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[120]  arXiv:2106.01894 (cross-list from cs.DS) [pdf, other]

Title: Low-Congestion Shortcuts in Constant Diameter Graphs

Authors: Shimon Kogan, Merav Parter

Comments: To appear in PODC 2021

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[121]  arXiv:2106.02305 (cross-list from cs.LG) [pdf, other]

Title: Local Adaptivity in Federated Learning: Convergence and Consistency

Authors: Jianyu Wang, Zheng Xu, Zachary Garrett, Zachary Charles, Luyang Liu, Gauri Joshi

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[122]  arXiv:2106.02310 (cross-list from cs.LG) [pdf, other]

Title: FedCCEA : A Practical Approach of Client Contribution Evaluation for Federated Learning

Authors: Sung Kuk Shyn, Donghee Kim, Kwangsu Kim

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Computer Science and Game Theory (cs.GT)

[123]  arXiv:2106.02420 (cross-list from cs.NI) [pdf, other]

Title: An Intelligent Resource Reservation for Crowdsourced Live Video Streaming Applications in Geo-Distributed Cloud Environment

Authors: Emna Baccour, Fatima Haouari, Aiman Erbad, Amr Mohamed, Kashif Bilal, Mohsen Guizani, Mounir Hamdi

Comments: Published in IEEE systems journal

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Multimedia (cs.MM)

[124]  arXiv:2106.02679 (cross-list from cs.LG) [pdf, ps, other]

Title: Layered gradient accumulation and modular pipeline parallelism: fast and efficient training of large language models

Authors: Joel Lamy-Poirier

Comments: 22 pages, 8 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[125]  arXiv:2106.02942 (cross-list from cs.DS) [pdf, other]

Title: Time-Optimal Sublinear Algorithms for Matching and Vertex Cover

Authors: Soheil Behnezhad

Comments: This is the full version of a FOCS 2021 paper under the same title

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[126]  arXiv:2106.02969 (cross-list from cs.LG) [pdf, other]

Title: FedNL: Making Newton-Type Methods Applicable to Federated Learning

Authors: Mher Safaryan, Rustem Islamov, Xun Qian, Peter Richtárik

Comments: 65 pages, 7 algorithms, 14 figures --- Accepted to ICML 2022

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[127]  arXiv:2106.03211 (cross-list from cs.LG) [pdf, other]

Title: Distributed Learning and its Application for Time-Series Prediction

Authors: Nhuong V. Nguyen, Sybille Legitime

Comments: 8 pages, 10 figures, and 2 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[128]  arXiv:2106.03328 (cross-list from cs.LG) [pdf, other]

Title: Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning

Authors: Jinhyun So, Ramy E. Ali, Basak Guler, Jiantao Jiao, Salman Avestimehr

Journal-ref: AAAI 2023

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[129]  arXiv:2106.03539 (cross-list from cs.SE) [pdf, other]

Title: How to Bake Quantum into Your Pet Petri Nets and Have Your Net Theory Too

Authors: Heinz W. Schmidt

Comments: 24 pages incl. supplementary material in appendix. Accepted for the 15th Symposium and Summer School On Service-Oriented Computing (Submitted 2 April 2021, this https URL). Final revised and authenticated version to appear in Springer CCIS (this https URL)

Subjects: Software Engineering (cs.SE); Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET)

[130]  arXiv:2106.03824 (cross-list from cs.DS) [pdf, other]

Title: Parallel Batch-Dynamic Algorithms for $k$-Core Decomposition and Related Graph Problems

Authors: Quanquan C. Liu, Jessica Shi, Shangdi Yu, Laxman Dhulipala, Julian Shun

Comments: Abstract truncated per arXiv limits; add densest subgraph observation, fix Table 3 typos

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[131]  arXiv:2106.04502 (cross-list from cs.LG) [pdf, other]

Title: Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing

Authors: Mikhail Khodak, Renbo Tu, Tian Li, Liam Li, Maria-Florina Balcan, Virginia Smith, Ameet Talwalkar

Comments: NeurIPS 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[132]  arXiv:2106.04727 (cross-list from cs.DS) [pdf, other]

Title: ParChain: A Framework for Parallel Hierarchical Agglomerative Clustering using Nearest-Neighbor Chain

Authors: Shangdi Yu, Yiqiu Wang, Yan Gu, Laxman Dhulipala, Julian Shun

Subjects: Data Structures and Algorithms (cs.DS); Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[133]  arXiv:2106.04885 (cross-list from cs.CR) [pdf, other]

Title: A Blockchain-Based Trust Management Framework with Verifiable Interactions

Authors: Shantanu Pal, Ambrose Hill, Tahiry Rabehaja, Michael Hitchens

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[134]  arXiv:2106.05001 (cross-list from cs.LG) [pdf, other]

Title: No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Data

Authors: Mi Luo, Fei Chen, Dapeng Hu, Yifan Zhang, Jian Liang, Jiashi Feng

Comments: 22 pages, NeurIPS 2021

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[135]  arXiv:2106.05245 (cross-list from cs.DS) [pdf, other]

Title: Local Algorithms for Finding Densely Connected Clusters

Authors: Peter Macgregor, He Sun

Comments: This work is accepted at ICML'21 for a long presentation

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[136]  arXiv:2106.05463 (cross-list from cs.CR) [pdf, other]

Title: Cross-chain Interaction Model In a Fully Verified Way

Authors: Hong Su

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[137]  arXiv:2106.06150 (cross-list from cs.LG) [pdf, other]

Title: Global Neighbor Sampling for Mixed CPU-GPU Training on Giant Graphs

Authors: Jialin Dong, Da Zheng, Lin F. Yang, Geroge Karypis

Comments: The paper is published in KDD 2021

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[138]  arXiv:2106.06293 (cross-list from cs.NI) [pdf, other]

Title: Acceleration-as-a-μService: A Cloud-native Monte-Carlo Option Pricing Engine on CPUs, GPUs and Disaggregated FPGAs

Authors: Dionysios Diamantopoulos, Raphael Polig, Burkhard Ringlein, Mitra Purandare, Beat Weiss, Christoph Hagleitner, Mark Lantz, Francois Abel

Comments: 3 pages, 6 figures

Subjects: Networking and Internet Architecture (cs.NI); Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[139]  arXiv:2106.06401 (cross-list from cs.LG) [pdf, other]

Title: Decoupled Greedy Learning of CNNs for Synchronous and Asynchronous Distributed Learning

Authors: Eugene Belilovsky (MILA), Louis Leconte (MLIA, CMAP), Lucas Caccia (MILA), Michael Eickenberg, Edouard Oyallon (MLIA)

Comments: arXiv admin note: substantial text overlap with arXiv:1901.08164

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[140]  arXiv:2106.06433 (cross-list from cs.AR) [pdf, other]

Title: FPGA-Based Near-Memory Acceleration of Modern Data-Intensive Applications

Authors: Gagandeep Singh, Mohammed Alser, Damla Senol Cali, Dionysios Diamantopoulos, Juan Gómez-Luna, Henk Corporaal, Onur Mutlu

Comments: This is an extended and updated version of a paper published in IEEE Micro, vol. 41, no. 4, pp. 39-48, 1 July-Aug. 2021

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[141]  arXiv:2106.06445 (cross-list from cs.LG) [pdf, other]

Title: Coded-InvNet for Resilient Prediction Serving Systems

Authors: Tuan Dinh, Kangwook Lee

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[142]  arXiv:2106.06579 (cross-list from cs.LG) [pdf, other]

Title: Federated Learning with Spiking Neural Networks

Authors: Yeshwanth Venkatesha, Youngeun Kim, Leandros Tassiulas, Priyadarshini Panda

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Neural and Evolutionary Computing (cs.NE)

[143]  arXiv:2106.06843 (cross-list from cs.LG) [pdf, ps, other]

Title: Federated Learning on Non-IID Data: A Survey

Authors: Hangyu Zhu, Jinjin Xu, Shiqing Liu, Yaochu Jin

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[144]  arXiv:2106.07094 (cross-list from cs.LG) [pdf, other]

Title: On the Convergence of Differentially Private Federated Learning on Non-Lipschitz Objectives, and with Normalized Client Updates

Authors: Rudrajit Das, Abolfazl Hashemi, Sujay Sanghavi, Inderjit S. Dhillon

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Signal Processing (eess.SP); Optimization and Control (math.OC); Machine Learning (stat.ML)

[145]  arXiv:2106.07155 (cross-list from cs.LG) [pdf, ps, other]

Title: CFedAvg: Achieving Efficient Communication and Fast Convergence in Non-IID Federated Learning

Authors: Haibo Yang, Jia Liu, Elizabeth S. Bentley

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[146]  arXiv:2106.07289 (cross-list from cs.LG) [pdf, other]

Title: Decentralized Personalized Federated Learning for Min-Max Problems

Authors: Ekaterina Borodich, Aleksandr Beznosikov, Abdurakhmon Sadiev, Vadim Sushko, Nikolay Savelyev, Martin Takáč, Alexander Gasnikov

Comments: 33 pages, 3 algorithms, 5 figures, 2 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[147]  arXiv:2106.07578 (cross-list from cs.LG) [pdf, other]

Title: Dynamic Gradient Aggregation for Federated Domain Adaptation

Authors: Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

Comments: arXiv admin note: substantial text overlap with arXiv:2008.02452

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[148]  arXiv:2106.07731 (cross-list from cs.IT) [pdf, ps, other]

Title: Bivariate Polynomial Codes for Secure Distributed Matrix Multiplication

Authors: Burak Hasircioglu, Jesus Gomez-Vilardebo, Deniz Gunduz

Comments: To appear in IEEE Journal on Selected Areas in Communications. arXiv admin note: text overlap with arXiv:2102.08304

Subjects: Information Theory (cs.IT); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[149]  arXiv:2106.07820 (cross-list from cs.LG) [pdf, other]

Title: On Large-Cohort Training for Federated Learning

Authors: Zachary Charles, Zachary Garrett, Zhouyuan Huo, Sergei Shmulyian, Virginia Smith

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[150]  arXiv:2106.07831 (cross-list from cs.CR) [pdf, other]

Title: Efficient Asynchronous Byzantine Agreement without Private Setups

Authors: Yingzi Gao, Yuan Lu, Zhenliang Lu, Qiang Tang, Jing Xu, Zhenfeng Zhang

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)