Information Theory

Authors and titles for cs.IT in Jun 2021, skipping first 225

[226]  arXiv:2106.04876 (cross-list from cs.CR) [pdf, other]

Title: Recovering AES Keys with a Deep Cold Boot Attack

Authors: Itamar Zimerman, Eliya Nachmani, Lior Wolf

Comments: Accepted to ICML 2021

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT); Machine Learning (cs.LG)

[227]  arXiv:2106.04984 (cross-list from cs.AI) [pdf, other]

Title: Information Avoidance and Overvaluation in Sequential Decision Making under Epistemic Constraints

Authors: Shuo Li, Matteo Pozzi

Comments: submitted to Rel. Eng. Sys. Saf

Subjects: Artificial Intelligence (cs.AI); Information Theory (cs.IT); Multiagent Systems (cs.MA); Systems and Control (eess.SY)

[228]  arXiv:2106.05232 (cross-list from cs.LG) [pdf, ps, other]

Title: Realizing GANs via a Tunable Loss Function

Authors: Gowtham R. Kurri, Tyler Sypherd, Lalitha Sankar

Comments: Extended version of a paper accepted to ITW 2021. 8 pages, 2 figures

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[229]  arXiv:2106.06095 (cross-list from cs.LG) [pdf, other]

Title: Sparse Bayesian Learning via Stepwise Regression

Authors: Sebastian Ament, Carla Gomes

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Optimization and Control (math.OC); Computation (stat.CO); Machine Learning (stat.ML)

[230]  arXiv:2106.06530 (cross-list from cs.LG) [pdf, other]

Title: Label Noise SGD Provably Prefers Flat Global Minimizers

Authors: Alex Damian, Tengyu Ma, Jason D. Lee

Comments: 57 pages, 5 figures, NeurIPS 2021

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Optimization and Control (math.OC); Machine Learning (stat.ML)

[231]  arXiv:2106.06815 (cross-list from cs.LG) [pdf, ps, other]

Title: Quantifying the Conceptual Error in Dimensionality Reduction

Authors: Tom Hanika, Johannes Hirth

Comments: 14 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[232]  arXiv:2106.06836 (cross-list from cs.NI) [pdf, other]

Title: Cox Models for Vehicular Networks: SIR Performance and Equivalence

Authors: Jeya Pradha Jeyaraj, Martin Haenggi

Comments: 15 pages, 11 figures

Journal-ref: in IEEE Transactions on Wireless Communications, vol. 20, no. 1, pp. 171-185, Jan. 2021

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[233]  arXiv:2106.07528 (cross-list from cs.CR) [pdf, other]

Title: On the Trust and Trust Modelling for the Future Fully-Connected Digital World: A Comprehensive Study

Authors: Hannah Lim Jing Ting, Xin Kang, Tieyan Li, Haiguang Wang, Cheng-Kang Chu

Comments: Under Review

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT)

[234]  arXiv:2106.07724 (cross-list from cs.LG) [pdf, other]

Title: An Exponential Improvement on the Memorization Capacity of Deep Threshold Networks

Authors: Shashank Rajput, Kartik Sreenivasan, Dimitris Papailiopoulos, Amin Karbasi

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[235]  arXiv:2106.07785 (cross-list from cs.CR) [pdf, ps, other]

Title: Multivariate Public Key Cryptosystem from Sidon Spaces

Authors: Netanel Raviv, Ben Langton, Itzhak Tamo

Comments: Appeared in Public-Key Cryptography - PKC 2021, 24th IACR International Conference on Practice and Theory of Public Key Cryptography

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT)

[236]  arXiv:2106.09375 (cross-list from cs.IR) [pdf, other]

Title: Recovery under Side Constraints

Authors: Khaled Ardah, Martin Haardt, Tianyi Liu, Frederic Matter, Marius Pesavento, Marc E. Pfetsch

Subjects: Information Retrieval (cs.IR); Information Theory (cs.IT)

[237]  arXiv:2106.09683 (cross-list from cs.LG) [pdf, other]

Title: PAC-Bayes, MAC-Bayes and Conditional Mutual Information: Fast rate bounds that handle general VC classes

Authors: Peter Grünwald, Thomas Steinke, Lydia Zakynthinou

Comments: 24 pages, accepted for publication at COLT 2021

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[238]  arXiv:2106.10252 (cross-list from cs.LG) [pdf, other]

Title: Less is More: Feature Selection for Adversarial Robustness with Compressive Counter-Adversarial Attacks

Authors: Emre Ozfatura, Muhammad Zaid Hameed, Kerem Ozfatura, Deniz Gunduz

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[239]  arXiv:2106.10800 (cross-list from cs.LG) [pdf, other]

Title: Lossy Compression for Lossless Prediction

Authors: Yann Dubois, Benjamin Bloem-Reddy, Karen Ullrich, Chris J. Maddison

Comments: Accepted at NeurIPS 2021

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[240]  arXiv:2106.11438 (cross-list from cs.LG) [pdf, other]

Title: Instance-Optimal Compressed Sensing via Posterior Sampling

Authors: Ajil Jalal, Sushrut Karmalkar, Alexandros G. Dimakis, Eric Price

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[241]  arXiv:2106.11784 (cross-list from cs.NI) [pdf, other]

Title: The Interplay of Reconfigurable Intelligent Surfaces and Mobile Edge Computing in Future Wireless Networks: A Win-Win Strategy to 6G

Authors: Mithun Mukherjee, Vikas Kumar, Mian Guo, Daniel Benevides da Costa, Ertugrul Basar, Zhiguo Ding

Subjects: Networking and Internet Architecture (cs.NI); Emerging Technologies (cs.ET); Information Theory (cs.IT)

[242]  arXiv:2106.12498 (cross-list from cs.LG) [pdf, other]

Title: Universal Consistency of Deep Convolutional Neural Networks

Authors: Shao-Bo Lin, Kaidong Wang, Yao Wang, Ding-Xuan Zhou

Comments: 9pages, 4 figures

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[243]  arXiv:2106.13385 (cross-list from cs.SI) [pdf, other]

Title: Trends, Politics, Sentiments, and Misinformation: Understanding People's Reactions to COVID-19 During its Early Stages

Authors: Omar Abdel Wahab, Ali Mustafa, André Bertrand Abisseck Bamatakina

Comments: 13 pages, 6 figures

Subjects: Social and Information Networks (cs.SI); Information Theory (cs.IT)

[244]  arXiv:2106.13414 (cross-list from cs.DS) [pdf, other]

Title: The Price of Tolerance in Distribution Testing

Authors: Clément L. Canonne, Ayush Jain, Gautam Kamath, Jerry Li

Comments: Added a result on instance-optimal testing, and further discussion in the introduction

Subjects: Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Probability (math.PR); Statistics Theory (math.ST); Machine Learning (stat.ML)

[245]  arXiv:2106.14993 (cross-list from cs.LG) [pdf, other]

Title: Modularity in Reinforcement Learning via Algorithmic Independence in Credit Assignment

Authors: Michael Chang, Sidhant Kaushik, Sergey Levine, Thomas L. Griffiths

Comments: Long Presentation at the Thirty-eighth International Conference on Machine Learning (ICML) 2021. 21 pages, 11 figures. v2: updated acknowledgments. v3: clarified that the internal function nodes of the credit assignment mechanism are not considered O(1)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[246]  arXiv:2106.15013 (cross-list from cs.LG) [pdf, other]

Title: Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstruction

Authors: Dominik Stöger, Mahdi Soltanolkotabi

Comments: 83 pages; published in NeurIPS 2021; corrected inaccuracies in the proofs of Lemma 9.5 and Theorem 9.6

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Optimization and Control (math.OC); Statistics Theory (math.ST); Machine Learning (stat.ML)

[247]  arXiv:2106.15844 (cross-list from cs.GT) [pdf, other]

Title: Bounded rationality for relaxing best response and mutual consistency: The Quantal Hierarchy model of decision-making

Authors: Benjamin Patrick Evans, Mikhail Prokopenko

Comments: 31 pages, 20 figures

Subjects: Computer Science and Game Theory (cs.GT); Artificial Intelligence (cs.AI); Information Theory (cs.IT); General Economics (econ.GN)

[248]  arXiv:2106.00514 (cross-list from math.PR) [pdf, ps, other]

Title: Entropy and the Discrete Central Limit Theorem

Authors: Lampros Gavalakis, Ioannis Kontoyiannis

Comments: 15 pages

Subjects: Probability (math.PR); Information Theory (cs.IT)

[249]  arXiv:2106.00765 (cross-list from quant-ph) [pdf, other]

Title: Connectivity constrains quantum codes

Authors: Nouédyn Baspin, Anirudh Krishna

Journal-ref: Quantum 6, 711 (2022)

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[250]  arXiv:2106.00885 (cross-list from stat.ML) [pdf, ps, other]

Title: Robustifying Algorithms of Learning Latent Trees with Vector Variables

Authors: Fengzhuo Zhang, Vincent Y. F. Tan

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)