Distributed, Parallel, and Cluster Computing

Authors and titles for cs.DC in Jun 2021, skipping first 75

[76]  arXiv:2106.12429 [pdf, other]

Title: TCEP: Transitions in Operator Placement to Adapt to Dynamic Network Environments

Authors: Manisha Luthra, Boris Koldehofe, Niels Danger, Pascal Weisenburger, Guido Salvaneschi, Ioannis Stavrakakis

Comments: Accepted for publication in Journal of Computer and System Sciences, Special Issue on Algorithmic Theory of Dynamic Networks and its Application

Journal-ref: Journal of Computer and System Sciences, May 2021

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Databases (cs.DB)

[77]  arXiv:2106.12485 [pdf, other]

Title: Particle-In-Cell Simulation using Asynchronous Tasking

Authors: Nicolas Guidotti, Pedro Ceyrat, João Barreto, José Monteiro, Rodrigo Rodrigues, Ricardo Fonseca, Xavier Martorell, Antonio J. Peña

Comments: Published on the 27th European Conference on Parallel and Distributed Computing (Euro-Par 2021)

Journal-ref: Euro-Par 2021: Parallel Processing. Lecture Notes in Computer Science, vol 12820, pp. 482-498

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computational Physics (physics.comp-ph); Plasma Physics (physics.plasm-ph)

[78]  arXiv:2106.12549 [pdf, ps, other]

Title: ESAI: Efficient Split Artificial Intelligence via Early Exiting Using Neural Architecture Search

Authors: Behnam Zeinali, Di Zhuang, J. Morris Chang

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Neural and Evolutionary Computing (cs.NE)

[79]  arXiv:2106.12626 [pdf, other]

Title: Railgun: managing large streaming windows under MAD requirements

Authors: Ana Sofia Gomes, João Oliveirinha, Pedro Cardoso, Pedro Bizarro

Comments: arXiv admin note: text overlap with arXiv:2009.00361

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[80]  arXiv:2106.12863 [pdf, other]

Title: Choice of Parallelism: Multi-GPU Driven Pipeline for Huge Academic Backbone Network

Authors: Ruo Ando, Youki Kadobayashi, Hiroki Takakura

Comments: This is an Accepted Manuscript of an article published by Taylor & Francis Group in the International Journal of Parallel, Emergent & Distributed Systems on 24/06/2021 av lable online: this http URL DOI: 10.1080/17445760.2021.1941009

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[81]  arXiv:2106.12942 [pdf, ps, other]

Title: High Performance Hyperspectral Image Classification using Graphics Processing Units

Authors: Mahmoud Hossam

Comments: Master Thesis, Ain Shams University

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[82]  arXiv:2106.13002 [pdf, other]

Title: Loosely-Stabilizing Phase Clocks and the Adaptive Majority Problem

Authors: Petra Berenbrink, Felix Biermeier, Christopher Hahn, Dominik Kaaser

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[83]  arXiv:2106.13019 [pdf, other]

Title: Stream-based State-Machine Replication

Authors: Laura Lawniczak, Tobias Distler

Comments: 16 pages, extended version of EDCC 2021 paper

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[84]  arXiv:2106.13020 [pdf, other]

Title: Zero-Cost, Arrow-Enabled Data Interface for Apache Spark

Authors: Sebastiaan Alvarez Rodriguez (1), Jayjeet Chakraborty (3), Aaron Chu (2), Ivo Jimenez (2), Jeff LeFevre (2), Carlos Maltzahn (2), Alexandru Uta (1) ((1) Leiden University, (2) UCSC Santa Cruz)

Comments: 6 pages, 6 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[85]  arXiv:2106.13039 [pdf, other]

Title: Low-Latency Federated Learning over Wireless Channels with Differential Privacy

Authors: Kang Wei, Jun Li, Chuan Ma, Ming Ding, Cailian Chen, Shi Jin, Zhu Han, H. Vincent Poor

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[86]  arXiv:2106.13306 [pdf, other]

Title: CEAZ: Accelerating Parallel I/O via Hardware-Algorithm Co-Designed Adaptive Lossy Compression

Authors: Chengming Zhang, Sian Jin, Tong Geng, Jiannan Tian, Ang Li, Dingwen Tao

Comments: 13 pages, 15 figures, 8 tables, accepted by ACM ICS '22

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)

[87]  arXiv:2106.13308 [pdf, other]

Title: Overcoming barriers to scalability in variational quantum Monte Carlo

Authors: Tianchen Zhao, Saibal De, Brian Chen, James Stokes, Shravan Veerapaneni

Comments: ACM/IEEE Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC21)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Disordered Systems and Neural Networks (cond-mat.dis-nn); Quantum Physics (quant-ph)

[88]  arXiv:2106.13465 [pdf, ps, other]

Title: Introducing OpenMP Tasks into the HYDRO Benchmark

Authors: Jérémie Gaidamour (IECL), Dimitri Lecas (IDRIS), Pierre-François Lavallée (IDRIS)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[89]  arXiv:2106.13524 [pdf, ps, other]

Title: Cost-efficient, QoS and Security aware Placement of Smart Farming IoT Applications in Cloud-Fog Infrastructure

Authors: Jagruti Sahoo

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[90]  arXiv:2106.13591 [pdf, ps, other]

Title: The Problem of Distributed Consensus: A Survey

Authors: Stephen Wolfram

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Discrete Mathematics (cs.DM); Cellular Automata and Lattice Gases (nlin.CG)

[91]  arXiv:2106.13645 [pdf, other]

Title: FLASH 1.0: A Software Framework for Rapid Parallel Deployment and Enhancing Host Code Portability in Heterogeneous Computing

Authors: Michael Riera, Masudul Hassan Quraishi, Erfan Bank Tavakoli, Fengbo Ren

Comments: 10 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[92]  arXiv:2106.13859 [pdf, other]

Title: rFaaS: Enabling High Performance Serverless with RDMA and Leases

Authors: Marcin Copik, Konstantin Taranov, Alexandru Calotoiu, Torsten Hoefler

Comments: Accepted for publication in the 2023 International Parallel and Distributed Processing Symposium (IPDPS)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[93]  arXiv:2106.13972 [pdf, ps, other]

Title: Exploring Spatial Indexing for Accelerated Feature Retrieval in HPC

Authors: Margaret Lawson, William Gropp, Jay Lofstead

Comments: Added references

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[94]  arXiv:2106.14079 [pdf, other]

Title: On the Impact of Device-Level Techniques on Energy-Efficiency of Neural Network Accelerators

Authors: Seyed Morteza Nabavinejad, Behzad Salami

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[95]  arXiv:2106.14312 [pdf, other]

Title: An Analysis of Multi-hop Iterative Approximate Byzantine Consensus with Local Communication

Authors: Matthew Ding

Comments: 6 pages. arXiv admin note: text overlap with arXiv:2010.05098

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[96]  arXiv:2106.14332 [pdf, other]

Title: A Case Study of LLVM-Based Analysis for Optimizing SIMD Code Generation

Authors: Joseph Huber, Weile Wei, Giorgis Georgakoudis, Johannes Doerfert, Oscar Hernandez

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Materials Science (cond-mat.mtrl-sci); Hardware Architecture (cs.AR); Computation and Language (cs.CL); Software Engineering (cs.SE)

[97]  arXiv:2106.14347 [pdf, other]

Title: Revelio: ML-Generated Debugging Queries for Distributed Systems

Authors: Pradeep Dogga (1), Karthik Narasimhan (2), Anirudh Sivaraman (3), Shiv Kumar Saini (4), George Varghese (1), Ravi Netravali (2) ((1) UCLA, (2) Princeton University, (3) NYU, (4) Adobe Research, India)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[98]  arXiv:2106.14402 [pdf, other]

Title: Combinatorial BLAS 2.0: Scaling combinatorial algorithms on distributed-memory systems

Authors: Ariful Azad, Oguz Selvitopi, Md Taufique Hussain, John R. Gilbert, Aydin Buluc

Comments: To appear in IEEE Transactions on Parallel and Distributed Systems

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Discrete Mathematics (cs.DM); Performance (cs.PF); Combinatorics (math.CO)

[99]  arXiv:2106.14423 [pdf, other]

Title: Operational Data Analytics in Practice: Experiences from Design to Deployment in Production HPC Environments

Authors: Alessio Netti, Michael Ott, Carla Guillen, Daniele Tafani, Martin Schulz

Comments: Preliminary version of the article

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY)

[100]  arXiv:2106.15048 [pdf, other]

Title: Bottleneck Time Minimization for Distributed Iterative Processes: Speeding Up Gossip-Based Federated Learning on Networked Computers

Authors: Mehrdad Kiamari, Bhaskar Krishnamachari

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[101]  arXiv:2106.15112 [pdf, other]

Title: workload forecasting and resource management models based on machine learning for cloud computing environments

Authors: Deepika Saxena, Ashutosh Kumar Singh

Comments: 17 pages,5 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[102]  arXiv:2106.15151 [pdf, ps, other]

Title: Scalable Traffic Predictive Analysis using GPU in Big Data

Authors: Dalyapraz Dauletbak, Junghoon Heo, Sooyoung Kim, Yeon Pyo Kim, Jongwook Woo

Comments: 5 pages, 2 figures, 5 tables

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[103]  arXiv:2106.15508 [pdf, other]

Title: Efficient State-space Exploration in Massively Parallel Simulation Based Inference

Authors: Sourabh Kulkarni, Csaba Andras Moritz

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[104]  arXiv:2106.15549 [pdf, ps, other]

Title: Distributed Matrix Tiling Using A Hypergraph Labeling Formulation

Authors: Avah Banerjee, Guoli Ding, Maxwell Reeser

Comments: 22 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)

[105]  arXiv:2106.15554 [pdf, other]

Title: Blunting an Adversary Against Randomized Concurrent Programs with Linearizable Implementations

Authors: Hagit Attiya, Constantin Enea, Jennifer L. Welch

Comments: 22 pages Revised version generalizes the class of implementations to which the transformation applies

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[106]  arXiv:2106.15555 [pdf, other]

Title: Validation of a simulation model for FaaS performance benchmarking using predictive validation

Authors: David Ferreira Quaresma, Thiago Emmanuel Pereira, Daniel Fireman

Comments: The final paper of bachelor's degree, 8 pages, 5 figures, 1 table

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[107]  arXiv:2106.15565 [pdf, other]

Title: Flare: Flexible In-Network Allreduce

Authors: Daniele De Sensi, Salvatore Di Girolamo, Saleh Ashkboos, Shigang Li, Torsten Hoefler

Journal-ref: Published in Proceedings of The International Conference for High Performance Computing Networking, Storage, and Analysis (SC '21) (2021)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Hardware Architecture (cs.AR); Networking and Internet Architecture (cs.NI)

[108]  arXiv:2106.15689 [pdf, other]

Title: NEUKONFIG: Reducing Edge Service Downtime When Repartitioning DNNs

Authors: Ayesha Abdul Majeed, Peter Kilpatrick, Ivor Spence, Blesson Varghese

Comments: 10 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[109]  arXiv:2106.16002 [pdf, other]

Title: Distributed Nash Equilibrium Seeking under Quantization Communication

Authors: Ziqin Chen, Ji Ma, Shu Liang, Li Li

Comments: 8 pages, 5 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[110]  arXiv:2106.16064 [pdf, other]

Title: Efficient Sparse Matrix Kernels based on Adaptive Workload-Balancing and Parallel-Reduction

Authors: Guyue Huang, Guohao Dai, Yu Wang, Yufei Ding, Yuan Xie

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[111]  arXiv:2106.00003 (cross-list from cs.LG) [pdf, other]

Title: Parallelized Computation and Backpropagation Under Angle-Parametrized Orthogonal Matrices

Authors: Firas Hamze

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[112]  arXiv:2106.00275 (cross-list from cs.LG) [pdf, other]

Title: H-FL: A Hierarchical Communication-Efficient and Privacy-Protected Architecture for Federated Learning

Authors: He Yang

Comments: Accepted by IJCAI 2021, 7pages, 10 figures

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[113]  arXiv:2106.00374 (cross-list from cs.DS) [pdf, other]

Title: Fault-Tolerant Labeling and Compact Routing Schemes

Authors: Michal Dory, Merav Parter

Comments: PODC 2021

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[114]  arXiv:2106.00881 (cross-list from cs.LG) [pdf, other]

Title: Hyperdimensional Computing for Efficient Distributed Classification with Randomized Neural Networks

Authors: Antonello Rosato, Massimo Panella, Denis Kleyko

Comments: 1 table, 5 figures

Journal-ref: 2021 International Joint Conference on Neural Networks (IJCNN)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[115]  arXiv:2106.00999 (cross-list from cs.LG) [pdf, other]

Title: Communication-Efficient Split Learning Based on Analog Communication and Over the Air Aggregation

Authors: Mounssif Krouka, Anis Elgabli, Chaouki ben Issaid, Mehdi Bennis

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[116]  arXiv:2106.01036 (cross-list from cs.DS) [pdf, other]

Title: Ultra-Sparse Near-Additive Emulators

Authors: Michael Elkin, Shaked Matar

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[117]  arXiv:2106.01340 (cross-list from cs.CR) [pdf, ps, other]

Title: Transaction Fee Mechanism Design

Authors: Tim Roughgarden

Comments: Under review at Journal of the ACM. Preliminary version appeared in the 22nd ACM Conference on Economics and Computation (EC '21). This academic paper partially overlaps with the longer general-audience report published as arXiv:2012.00854

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS); Computer Science and Game Theory (cs.GT); Theoretical Economics (econ.TH)

[118]  arXiv:2106.01674 (cross-list from cs.IR) [pdf, other]

Title: JIZHI: A Fast and Cost-Effective Model-As-A-Service System for Web-Scale Online Inference at Baidu

Authors: Hao Liu, Qian Gao, Jiang Li, Xiaochao Liao, Hao Xiong, Guangxing Chen, Wenlin Wang, Guobao Yang, Zhiwei Zha, Daxiang Dong, Dejing Dou, Haoyi Xiong

Comments: Accepted to SIGKDD 2021 applied data science track

Subjects: Information Retrieval (cs.IR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[119]  arXiv:2106.01880 (cross-list from cs.DS) [pdf, ps, other]

Title: Component Stability in Low-Space Massively Parallel Computation

Authors: Artur Czumaj, Peter Davies, Merav Parter

Comments: 45 pages, to appear at PODC 2021

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[120]  arXiv:2106.01894 (cross-list from cs.DS) [pdf, other]

Title: Low-Congestion Shortcuts in Constant Diameter Graphs

Authors: Shimon Kogan, Merav Parter

Comments: To appear in PODC 2021

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[121]  arXiv:2106.02305 (cross-list from cs.LG) [pdf, other]

Title: Local Adaptivity in Federated Learning: Convergence and Consistency

Authors: Jianyu Wang, Zheng Xu, Zachary Garrett, Zachary Charles, Luyang Liu, Gauri Joshi

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[122]  arXiv:2106.02310 (cross-list from cs.LG) [pdf, other]

Title: FedCCEA : A Practical Approach of Client Contribution Evaluation for Federated Learning

Authors: Sung Kuk Shyn, Donghee Kim, Kwangsu Kim

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Computer Science and Game Theory (cs.GT)

[123]  arXiv:2106.02420 (cross-list from cs.NI) [pdf, other]

Title: An Intelligent Resource Reservation for Crowdsourced Live Video Streaming Applications in Geo-Distributed Cloud Environment

Authors: Emna Baccour, Fatima Haouari, Aiman Erbad, Amr Mohamed, Kashif Bilal, Mohsen Guizani, Mounir Hamdi

Comments: Published in IEEE systems journal

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Multimedia (cs.MM)

[124]  arXiv:2106.02679 (cross-list from cs.LG) [pdf, ps, other]

Title: Layered gradient accumulation and modular pipeline parallelism: fast and efficient training of large language models

Authors: Joel Lamy-Poirier

Comments: 22 pages, 8 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[125]  arXiv:2106.02942 (cross-list from cs.DS) [pdf, other]

Title: Time-Optimal Sublinear Algorithms for Matching and Vertex Cover

Authors: Soheil Behnezhad

Comments: This is the full version of a FOCS 2021 paper under the same title

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[126]  arXiv:2106.02969 (cross-list from cs.LG) [pdf, other]

Title: FedNL: Making Newton-Type Methods Applicable to Federated Learning

Authors: Mher Safaryan, Rustem Islamov, Xun Qian, Peter Richtárik

Comments: 65 pages, 7 algorithms, 14 figures --- Accepted to ICML 2022

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[127]  arXiv:2106.03211 (cross-list from cs.LG) [pdf, other]

Title: Distributed Learning and its Application for Time-Series Prediction

Authors: Nhuong V. Nguyen, Sybille Legitime

Comments: 8 pages, 10 figures, and 2 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[128]  arXiv:2106.03328 (cross-list from cs.LG) [pdf, other]

Title: Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning

Authors: Jinhyun So, Ramy E. Ali, Basak Guler, Jiantao Jiao, Salman Avestimehr

Journal-ref: AAAI 2023

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[129]  arXiv:2106.03539 (cross-list from cs.SE) [pdf, other]

Title: How to Bake Quantum into Your Pet Petri Nets and Have Your Net Theory Too

Authors: Heinz W. Schmidt

Comments: 24 pages incl. supplementary material in appendix. Accepted for the 15th Symposium and Summer School On Service-Oriented Computing (Submitted 2 April 2021, this https URL). Final revised and authenticated version to appear in Springer CCIS (this https URL)

Subjects: Software Engineering (cs.SE); Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET)

[130]  arXiv:2106.03824 (cross-list from cs.DS) [pdf, other]

Title: Parallel Batch-Dynamic Algorithms for $k$-Core Decomposition and Related Graph Problems

Authors: Quanquan C. Liu, Jessica Shi, Shangdi Yu, Laxman Dhulipala, Julian Shun

Comments: Abstract truncated per arXiv limits; add densest subgraph observation, fix Table 3 typos

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[131]  arXiv:2106.04502 (cross-list from cs.LG) [pdf, other]

Title: Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing

Authors: Mikhail Khodak, Renbo Tu, Tian Li, Liam Li, Maria-Florina Balcan, Virginia Smith, Ameet Talwalkar

Comments: NeurIPS 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[132]  arXiv:2106.04727 (cross-list from cs.DS) [pdf, other]

Title: ParChain: A Framework for Parallel Hierarchical Agglomerative Clustering using Nearest-Neighbor Chain

Authors: Shangdi Yu, Yiqiu Wang, Yan Gu, Laxman Dhulipala, Julian Shun

Subjects: Data Structures and Algorithms (cs.DS); Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[133]  arXiv:2106.04885 (cross-list from cs.CR) [pdf, other]

Title: A Blockchain-Based Trust Management Framework with Verifiable Interactions

Authors: Shantanu Pal, Ambrose Hill, Tahiry Rabehaja, Michael Hitchens

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[134]  arXiv:2106.05001 (cross-list from cs.LG) [pdf, other]

Title: No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Data

Authors: Mi Luo, Fei Chen, Dapeng Hu, Yifan Zhang, Jian Liang, Jiashi Feng

Comments: 22 pages, NeurIPS 2021

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[135]  arXiv:2106.05245 (cross-list from cs.DS) [pdf, other]

Title: Local Algorithms for Finding Densely Connected Clusters

Authors: Peter Macgregor, He Sun

Comments: This work is accepted at ICML'21 for a long presentation

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[136]  arXiv:2106.05463 (cross-list from cs.CR) [pdf, other]

Title: Cross-chain Interaction Model In a Fully Verified Way

Authors: Hong Su

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[137]  arXiv:2106.06150 (cross-list from cs.LG) [pdf, other]

Title: Global Neighbor Sampling for Mixed CPU-GPU Training on Giant Graphs

Authors: Jialin Dong, Da Zheng, Lin F. Yang, Geroge Karypis

Comments: The paper is published in KDD 2021

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[138]  arXiv:2106.06293 (cross-list from cs.NI) [pdf, other]

Title: Acceleration-as-a-μService: A Cloud-native Monte-Carlo Option Pricing Engine on CPUs, GPUs and Disaggregated FPGAs

Authors: Dionysios Diamantopoulos, Raphael Polig, Burkhard Ringlein, Mitra Purandare, Beat Weiss, Christoph Hagleitner, Mark Lantz, Francois Abel

Comments: 3 pages, 6 figures

Subjects: Networking and Internet Architecture (cs.NI); Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[139]  arXiv:2106.06401 (cross-list from cs.LG) [pdf, other]

Title: Decoupled Greedy Learning of CNNs for Synchronous and Asynchronous Distributed Learning

Authors: Eugene Belilovsky (MILA), Louis Leconte (MLIA, CMAP), Lucas Caccia (MILA), Michael Eickenberg, Edouard Oyallon (MLIA)

Comments: arXiv admin note: substantial text overlap with arXiv:1901.08164

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[140]  arXiv:2106.06433 (cross-list from cs.AR) [pdf, other]

Title: FPGA-Based Near-Memory Acceleration of Modern Data-Intensive Applications

Authors: Gagandeep Singh, Mohammed Alser, Damla Senol Cali, Dionysios Diamantopoulos, Juan Gómez-Luna, Henk Corporaal, Onur Mutlu

Comments: This is an extended and updated version of a paper published in IEEE Micro, vol. 41, no. 4, pp. 39-48, 1 July-Aug. 2021

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[141]  arXiv:2106.06445 (cross-list from cs.LG) [pdf, other]

Title: Coded-InvNet for Resilient Prediction Serving Systems

Authors: Tuan Dinh, Kangwook Lee

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[142]  arXiv:2106.06579 (cross-list from cs.LG) [pdf, other]

Title: Federated Learning with Spiking Neural Networks

Authors: Yeshwanth Venkatesha, Youngeun Kim, Leandros Tassiulas, Priyadarshini Panda

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Neural and Evolutionary Computing (cs.NE)

[143]  arXiv:2106.06843 (cross-list from cs.LG) [pdf, ps, other]

Title: Federated Learning on Non-IID Data: A Survey

Authors: Hangyu Zhu, Jinjin Xu, Shiqing Liu, Yaochu Jin

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[144]  arXiv:2106.07094 (cross-list from cs.LG) [pdf, other]

Title: On the Convergence of Differentially Private Federated Learning on Non-Lipschitz Objectives, and with Normalized Client Updates

Authors: Rudrajit Das, Abolfazl Hashemi, Sujay Sanghavi, Inderjit S. Dhillon

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Signal Processing (eess.SP); Optimization and Control (math.OC); Machine Learning (stat.ML)

[145]  arXiv:2106.07155 (cross-list from cs.LG) [pdf, ps, other]

Title: CFedAvg: Achieving Efficient Communication and Fast Convergence in Non-IID Federated Learning

Authors: Haibo Yang, Jia Liu, Elizabeth S. Bentley

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[146]  arXiv:2106.07289 (cross-list from cs.LG) [pdf, other]

Title: Decentralized Personalized Federated Learning for Min-Max Problems

Authors: Ekaterina Borodich, Aleksandr Beznosikov, Abdurakhmon Sadiev, Vadim Sushko, Nikolay Savelyev, Martin Takáč, Alexander Gasnikov

Comments: 33 pages, 3 algorithms, 5 figures, 2 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[147]  arXiv:2106.07578 (cross-list from cs.LG) [pdf, other]

Title: Dynamic Gradient Aggregation for Federated Domain Adaptation

Authors: Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

Comments: arXiv admin note: substantial text overlap with arXiv:2008.02452

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[148]  arXiv:2106.07731 (cross-list from cs.IT) [pdf, ps, other]

Title: Bivariate Polynomial Codes for Secure Distributed Matrix Multiplication

Authors: Burak Hasircioglu, Jesus Gomez-Vilardebo, Deniz Gunduz

Comments: To appear in IEEE Journal on Selected Areas in Communications. arXiv admin note: text overlap with arXiv:2102.08304

Subjects: Information Theory (cs.IT); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[149]  arXiv:2106.07820 (cross-list from cs.LG) [pdf, other]

Title: On Large-Cohort Training for Federated Learning

Authors: Zachary Charles, Zachary Garrett, Zhouyuan Huo, Sergei Shmulyian, Virginia Smith

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[150]  arXiv:2106.07831 (cross-list from cs.CR) [pdf, other]

Title: Efficient Asynchronous Byzantine Agreement without Private Setups

Authors: Yingzi Gao, Yuan Lu, Zhenliang Lu, Qiang Tang, Jing Xu, Zhenfeng Zhang

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[151]  arXiv:2106.07894 (cross-list from cs.AR) [pdf, other]

Title: S2Engine: A Novel Systolic Architecture for Sparse Convolutional Neural Networks

Authors: Jianlei Yang, Wenzhi Fu, Xingzhou Cheng, Xucheng Ye, Pengcheng Dai, Weisheng Zhao

Comments: 13 pages, 17 figures

Journal-ref: IEEE Transactions on Computers, 2021

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[152]  arXiv:2106.08290 (cross-list from cs.IT) [pdf, other]

Title: PolyDot Coded Privacy Preserving Multi-Party Computation at the Edge

Authors: Elahe Vedadi, Yasaman Keshtkarjahromi, Hulya Seferoglu

Comments: 23 pages, 5 figures

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC)

[153]  arXiv:2106.08318 (cross-list from cs.CV) [pdf, other]

Title: Gradient Forward-Propagation for Large-Scale Temporal Video Modelling

Authors: Mateusz Malinowski, Dimitrios Vytiniotis, Grzegorz Swirszcz, Viorica Patraucean, Joao Carreira

Comments: Accepted to CVPR 2021. arXiv admin note: text overlap with arXiv:2001.06232

Subjects: Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Image and Video Processing (eess.IV)

[154]  arXiv:2106.08448 (cross-list from cs.DS) [pdf, other]

Title: Correlation Clustering in Constant Many Parallel Rounds

Authors: Vincent Cohen-Addad, Silvio Lattanzi, Slobodan Mitrović, Ashkan Norouzi-Fard, Nikos Parotsidis, Jakub Tarnawski

Comments: ICML 2021 (long talk)

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[155]  arXiv:2106.08882 (cross-list from cs.LG) [pdf, other]

Title: Robust Training in High Dimensions via Block Coordinate Geometric Median Descent

Authors: Anish Acharya, Abolfazl Hashemi, Prateek Jain, Sujay Sanghavi, Inderjit S. Dhillon, Ufuk Topcu

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC); Machine Learning (stat.ML)

[156]  arXiv:2106.08946 (cross-list from cs.LG) [pdf, other]

Title: FGLP: A Federated Fine-Grained Location Prediction System for Mobile Users

Authors: Xiaopeng Jiang, Shuai Zhao, Guy Jacobson, Rittwik Jana, Wen-Ling Hsu, Manoop Talasila, Syed Anwar Aftab, Yi Chen, Cristian Borcea

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY)

[157]  arXiv:2106.09109 (cross-list from cs.LG) [pdf, other]

Title: QuantumFed: A Federated Learning Framework for Collaborative Quantum Training

Authors: Qi Xia, Qun Li

Comments: Under revision

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[158]  arXiv:2106.09349 (cross-list from cs.CR) [pdf, other]

Title: Blockchain Oracle Design Patterns

Authors: Amirmohammad Pasdar, Zhongli Dong, Young Choon Lee

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[159]  arXiv:2106.09485 (cross-list from cs.IT) [pdf, other]

Title: Secure Multi-Function Computation with Private Remote Sources

Authors: Onur Günlü, Matthieu Bloch, Rafael F. Schaefer

Comments: Shorter version appeared in the IEEE International Symposium on Information Theory 2021

Subjects: Information Theory (cs.IT); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Signal Processing (eess.SP)

[160]  arXiv:2106.09580 (cross-list from cs.GT) [pdf, ps, other]

Title: Optimality and Stability in Federated Learning: A Game-theoretic Approach

Authors: Kate Donahue, Jon Kleinberg

Subjects: Computer Science and Game Theory (cs.GT); Computers and Society (cs.CY); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[161]  arXiv:2106.09922 (cross-list from cs.NE) [pdf, ps, other]

Title: A Fresh Approach to Evaluate Performance in Distributed Parallel Genetic Algorithms

Authors: Tomohiro Harada, Enrique Alba, Gabriel Luque

Comments: 22 pages, submitted to Applied Soft Computing and under review

Subjects: Neural and Evolutionary Computing (cs.NE); Distributed, Parallel, and Cluster Computing (cs.DC)

[162]  arXiv:2106.10022 (cross-list from cs.LG) [pdf, other]

Title: Local AdaGrad-Type Algorithm for Stochastic Convex-Concave Optimization

Authors: Luofeng Liao, Li Shen, Jia Duan, Mladen Kolar, Dacheng Tao

Comments: 42 pages; Accepted to Machine Learning, 2022

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[163]  arXiv:2106.10196 (cross-list from cs.LG) [pdf, other]

Title: Federated Robustness Propagation: Sharing Robustness in Heterogeneous Federated Learning

Authors: Junyuan Hong, Haotao Wang, Zhangyang Wang, Jiayu Zhou

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[164]  arXiv:2106.10207 (cross-list from cs.LG) [pdf, other]

Title: Distributed Deep Learning in Open Collaborations

Authors: Michael Diskin, Alexey Bukhtiyarov, Max Ryabinin, Lucile Saulnier, Quentin Lhoest, Anton Sinitsin, Dmitry Popov, Dmitry Pyrkin, Maxim Kashirin, Alexander Borzunov, Albert Villanova del Moral, Denis Mazur, Ilia Kobelev, Yacine Jernite, Thomas Wolf, Gennady Pekhimenko

Comments: Accepted to Conference on Neural Information Processing Systems (NeurIPS) 2021. 32 pages, 10 figures. Code: this https URL

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[165]  arXiv:2106.10334 (cross-list from cs.PF) [pdf, other]

Title: AutoTune: Improving End-to-end Performance and Resource Efficiency for Microservice Applications

Authors: Michael Alan Chang, Aurojit Panda, Hantao Wang, Yuancheng Tsai, Rahul Balakrishnan, Scott Shenker

Subjects: Performance (cs.PF); Distributed, Parallel, and Cluster Computing (cs.DC)

[166]  arXiv:2106.10515 (cross-list from cs.DB) [pdf, ps, other]

Title: A Generic Distributed Clustering Framework for Massive Data

Authors: Pingyi Luo, Qiang Huang, Anthony K. H. Tung

Comments: 11 pages, 7 figures

Subjects: Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC)

[167]  arXiv:2106.10685 (cross-list from cs.AI) [pdf, other]

Title: MILP, pseudo-boolean, and OMT solvers for optimal fault-tolerant placements of relay nodes in mission critical wireless networks

Authors: Quian Matteo Chen, Alberto Finzi, Toni Mancini, Igor Melatti, Enrico Tronci

Comments: 33 pages, 11 figures

Journal-ref: Fundamenta Informaticae, 174(3-4):229-258, 2020

Subjects: Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Logic in Computer Science (cs.LO); Networking and Internet Architecture (cs.NI)

[168]  arXiv:2106.10692 (cross-list from eess.SY) [pdf, other]

Title: Parallel Statistical Model Checking for Safety Verification in Smart Grids

Authors: T. Mancini, F. Mari, I. Melatti, I. Salvo, E. Tronci, J.K. Gruber, B. Hayes, M. Prodanovic, L. Elmegaard

Comments: 6 pages, 1 figure. In SmartGridComm 2018. IEEE, 2018

Subjects: Systems and Control (eess.SY); Distributed, Parallel, and Cluster Computing (cs.DC)

[169]  arXiv:2106.10707 (cross-list from eess.SY) [pdf, other]

Title: Minimizing Delay in Network Function Visualization with Quantum Computing

Authors: Wenlu Xuan, Zhongqi Zhao, Lei Fan, Zhu Han

Comments: Invited Paper by IEEE MASS 2021

Subjects: Systems and Control (eess.SY); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[170]  arXiv:2106.10796 (cross-list from cs.LG) [pdf, other]

Title: CD-SGD: Distributed Stochastic Gradient Descent with Compression and Delay Compensation

Authors: Enda Yu, Dezun Dong, Yemao Xu, Shuo Ouyang, Xiangke Liao

Comments: 12 pages

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[171]  arXiv:2106.11257 (cross-list from cs.LG) [pdf, other]

Title: Secure Distributed Training at Scale

Authors: Eduard Gorbunov, Alexander Borzunov, Michael Diskin, Max Ryabinin

Comments: Accepted to International Conference on Machine Learning (ICML 2022). 61 pages, 10 figures. The version 4 fixes inaccuracies in the proofs of Lemmas E.2 and E.4. Code: this https URL

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[172]  arXiv:2106.11264 (cross-list from cs.LG) [pdf, other]

Title: Compositional federated learning: Applications in distributionally robust averaging and meta learning

Authors: Feihu Huang, Junyi Li

Comments: 10 pages, 6 figures

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[173]  arXiv:2106.11505 (cross-list from cs.FL) [pdf, ps, other]

Title: Reasoning about Emergence of Collective Memory

Authors: R. Ramanujam (Institute of Mathematical Sciences, Chennai)

Comments: In Proceedings TARK 2021, arXiv:2106.10886

Journal-ref: EPTCS 335, 2021, pp. 269-280

Subjects: Formal Languages and Automata Theory (cs.FL); Distributed, Parallel, and Cluster Computing (cs.DC); Social and Information Networks (cs.SI)

[174]  arXiv:2106.11570 (cross-list from cs.LG) [pdf, other]

Title: FLRA: A Reference Architecture for Federated Learning Systems

Authors: Sin Kit Lo, Qinghua Lu, Hye-Young Paik, Liming Zhu

Comments: Accepted by ECSA 2021

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Software Engineering (cs.SE)

[175]  arXiv:2106.11728 (cross-list from cs.CY) [pdf, ps, other]

Title: Digital Twins, Internet of Things and Mobile Medicine: a Review of Current Platforms to Support Smart Healthcare

Authors: Ivan Volkov, Gleb Radchenko, Andrey Tchernykh

Comments: 16 pages, 3 figures

Subjects: Computers and Society (cs.CY); Distributed, Parallel, and Cluster Computing (cs.DC)