Machine Learning

Authors and titles for stat.ML in Nov 2021

[1]  arXiv:2111.00034 [pdf, other]

Title: Neural Networks as Kernel Learners: The Silent Alignment Effect

Authors: Alexander Atanasov, Blake Bordelon, Cengiz Pehlevan

Comments: 29 pages, 15 figures. Added additional experiments and expanded the derivations in the appendix

Journal-ref: ICLR 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[2]  arXiv:2111.00043 [pdf, other]

Title: Multivariate rank via entropic optimal transport: sample efficiency and generative modeling

Authors: Shoaib Bin Masud, Matthew Werenski, James M. Murphy, Shuchin Aeron

Comments: 46 pages, 10 figures. Replacement note: Substantial revision over V2: Title change, first authors contribution change, new improved theoretical results relaxing compactness assumptions

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[3]  arXiv:2111.00047 [pdf, other]

Title: Robust and efficient change point detection using novel multivariate rank-energy GoF test

Authors: Shoaib Bin Masud, Shuchin Aeron

Comments: 6 pages, 1 figure

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP)

[4]  arXiv:2111.00137 [pdf, other]

Title: Efficient Inference Without Trading-off Regret in Bandits: An Allocation Probability Test for Thompson Sampling

Authors: Nina Deliu, Joseph J. Williams, Sofia S. Villar

Comments: 32 pages including supplementary material

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Methodology (stat.ME)

[5]  arXiv:2111.00590 [pdf, other]

Title: Laplacian Constrained Precision Matrix Estimation: Existence and High Dimensional Consistency

Authors: Eduardo Pavez

Comments: The 25th International Conference on Artificial Intelligence and Statistics (AISTATS) 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP)

[6]  arXiv:2111.00639 [pdf, other]

Title: End-to-End Learning of Deep Kernel Acquisition Functions for Bayesian Optimization

Authors: Tomoharu Iwata

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[7]  arXiv:2111.00740 [pdf, other]

Title: Learning linear non-Gaussian directed acyclic graph with diverging number of nodes

Authors: Ruixuan Zhao, Xin He, Junhui Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[8]  arXiv:2111.00745 [pdf, other]

Title: Uncertainty quantification for ptychography using normalizing flows

Authors: Agnimitra Dasgupta, Zichao Wendy Di

Comments: Accepted at the Fourth Workshop on Machine Learning for Physical Sciences, NeurIPS 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[9]  arXiv:2111.00790 [pdf, ps, other]

Title: Dynamic Pricing and Demand Learning on a Large Network of Products: A PAC-Bayesian Approach

Authors: N. Bora Keskin, David Simchi-Levi, Prem Talwai

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[10]  arXiv:2111.00841 [pdf, other]

Title: Free Probability for predicting the performance of feed-forward fully connected neural networks

Authors: Reda Chhaibi, Tariq Daouda, Ezechiel Kahn

Comments: 20 pages, many figures ; v1: Preliminary version ; v2: Added numerical benchmarks, and changed presentation; v3: Accepted in Neurips2022

Journal-ref: Advances in Neural Information Processing Systems (NeurIPS), Vol 35, 2439--2450, 2022

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Optimization and Control (math.OC); Probability (math.PR)

[11]  arXiv:2111.00924 [pdf, ps, other]

Title: PCA-based Multi Task Learning: a Random Matrix Approach

Authors: Malik Tiomoko, Romain Couillet, Frédéric Pascal

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[12]  arXiv:2111.01104 [pdf, other]

Title: NOTMAD: Estimating Bayesian Networks with Sample-Specific Structures and Parameters

Authors: Ben Lengerich, Caleb Ellington, Bryon Aragam, Eric P. Xing, Manolis Kellis

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[13]  arXiv:2111.01348 [pdf, other]

Title: Faster Algorithms for Learning Convex Functions

Authors: Ali Siahkamari, Durmus Alp Emre Acar, Christopher Liao, Kelly Geyer, Venkatesh Saligrama, Brian Kulis

Comments: 21 pages, 3 figures. Proceedings of the 39 th International Conference on Machine Learning, Baltimore, Maryland, USA, PMLR 162, 2022. Copy- right 2022 by the author(s)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[14]  arXiv:2111.01361 [pdf, other]

Title: Outlier-Robust Optimal Transport: Duality, Structure, and Statistical Analysis

Authors: Sloan Nietert, Rachel Cummings, Ziv Goldfeld

Comments: updated to match AISTATS publication

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[15]  arXiv:2111.01409 [pdf, other]

Title: Efficient Learning of the Parameters of Non-Linear Models using Differentiable Resampling in Particle Filters

Authors: Conor Rosato, Vincent Beraud, Paul Horridge, Thomas B. Schön, Simon Maskell

Comments: 35 pages, 10 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[16]  arXiv:2111.01560 [pdf, other]

Title: Efficient Learning of Quadratic Variance Function Directed Acyclic Graphs via Topological Layers

Authors: Wei Zhou, Xin He, Wei Zhong, Junhui Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[17]  arXiv:2111.01692 [pdf, other]

Title: Efficient Hierarchical Bayesian Inference for Spatio-temporal Regression Models in Neuroimaging

Authors: Ali Hashemi, Yijing Gao, Chang Cai, Sanjay Ghosh, Klaus-Robert Müller, Srikantan S. Nagarajan, Stefan Haufe

Comments: Accepted to the 35th Conference on Neural Information Processing Systems (NeurIPS 2021)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Signal Processing (eess.SP); Applications (stat.AP)

[18]  arXiv:2111.01721 [pdf, ps, other]

Title: Bayes-Newton Methods for Approximate Bayesian Inference with PSD Guarantees

Authors: William J. Wilkinson, Simo Särkkä, Arno Solin

Comments: Code for methods and experiments: this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[19]  arXiv:2111.01767 [pdf, other]

Title: Regularization for Shuffled Data Problems via Exponential Family Priors on the Permutation Group

Authors: Zhenbang Wang, Emanuel Ben-David, Martin Slawski

Comments: 25 pages, 5 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[20]  arXiv:2111.01768 [pdf, other]

Title: Nearly Optimal Algorithms for Level Set Estimation

Authors: Blake Mason, Romain Camilleri, Subhojyoti Mukherjee, Kevin Jamieson, Robert Nowak, Lalit Jain

Comments: 9 pages + appendices. 6 Figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[21]  arXiv:2111.01786 [pdf, other]

Title: A Recommendation System to Enhance Midwives' Capacities in Low-Income Countries

Authors: Anna Guitart, Afsaneh Heydari, Eniola Olaleye, Jelena Ljubicic, Ana Fernández del Río, África Periáñez, Lauren Bellhouse

Journal-ref: NeurIPS Machine Learning in Public Health workshop (MLPH 2021), 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[22]  arXiv:2111.02218 [pdf, other]

Title: From global to local MDI variable importances for random forests and when they are Shapley values

Authors: Antonio Sutera, Gilles Louppe, Van Anh Huynh-Thu, Louis Wehenkel, Pierre Geurts

Journal-ref: 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Sydney, Australia

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[23]  arXiv:2111.02302 [pdf, other]

Title: Selecting the number of clusters, clustering models, and algorithms. A unifying approach based on the quadratic discriminant score

Authors: Luca Coraggio, Pietro Coretto

Comments: Supplemental materials are included at the end of the paper

Journal-ref: Journal of Multivariate Analysis, Vol. 196, p. 105181

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[24]  arXiv:2111.02329 [pdf, other]

Title: Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoods

Authors: Desi R. Ivanova, Adam Foster, Steven Kleinegesse, Michael U. Gutmann, Tom Rainforth

Comments: 33 pages, 8 figures. Published as a conference paper at NeurIPS 2021

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Computation (stat.CO)

[25]  arXiv:2111.02458 [pdf, other]

Title: Perturb-and-max-product: Sampling and learning in discrete energy-based models

Authors: Miguel Lazaro-Gredilla, Antoine Dedieu, Dileep George

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[26]  arXiv:2111.02592 [pdf, other]

Title: Conformal prediction for text infilling and part-of-speech prediction

Authors: Neil Dey, Jing Ding, Jack Ferrell, Carolina Kapper, Maxwell Lovig, Emiliano Planchon, Jonathan P Williams

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[27]  arXiv:2111.02702 [pdf, other]

Title: Local-Global MCMC kernels: the best of both worlds

Authors: Sergey Samsonov, Evgeny Lagutin, Marylou Gabrié, Alain Durmus, Alexey Naumov, Eric Moulines

Comments: arXiv admin note: text overlap with arXiv:1111.5421 by other authors

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[28]  arXiv:2111.02802 [pdf, other]

Title: Distributed Sparse Feature Selection in Communication-Restricted Networks

Authors: Hanie Barghi, Amir Najafi, Seyed Abolfazl Motahari

Comments: Submitted to IEEE Transactions on Signal Processing, 14 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[29]  arXiv:2111.02842 [pdf, other]

Title: Adversarial Attacks on Graph Classification via Bayesian Optimisation

Authors: Xingchen Wan, Henry Kenlay, Binxin Ru, Arno Blaas, Michael A. Osborne, Xiaowen Dong

Comments: NeurIPS 2021. 11 pages, 8 figures, 2 tables (24 pages, 17 figures, 8 tables including references and appendices)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[30]  arXiv:2111.03029 [pdf, other]

Title: Causal inference with imperfect instrumental variables

Authors: Nikolai Miklin, Mariami Gachechiladze, George Moreno, Rafael Chaves

Comments: 13 pages, 2 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Quantum Physics (quant-ph)

[31]  arXiv:2111.03140 [pdf, other]

Title: Multi-Objective Constrained Optimization for Energy Applications via Tree Ensembles

Authors: Alexander Thebelt, Calvin Tsay, Robert M. Lee, Nathan Sudermann-Merx, David Walz, Tom Tranter, Ruth Misener

Comments: 36 pages, 8 figures, 5 tables

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Optimization and Control (math.OC)

[32]  arXiv:2111.03179 [pdf, other]

Title: Community detection in censored hypergraph

Authors: Mingao Yuan, Bin Zhao, Xiaofeng Zhao

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[33]  arXiv:2111.03282 [pdf, other]

Title: Recurrent Neural Networks for Learning Long-term Temporal Dependencies with Reanalysis of Time Scale Representation

Authors: Kentaro Ohno, Atsutoshi Kumagai

Comments: 8 pages, 5 figures, IEEE ICBK 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[34]  arXiv:2111.03289 [pdf, ps, other]

Title: Improved Regret Analysis for Variance-Adaptive Linear Bandits and Horizon-Free Linear Mixture MDPs

Authors: Yeoneung Kim, Insoon Yang, Kwang-Sung Jun

Comments: accepted to neurips'22

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[35]  arXiv:2111.03290 [pdf, other]

Title: Maillard Sampling: Boltzmann Exploration Done Optimally

Authors: Jie Bian, Kwang-Sung Jun

Comments: accepted to AISTATS'22

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[36]  arXiv:2111.03447 [pdf, other]

Title: Contextual Bayesian optimization with binary outputs

Authors: Tristan Fauvel, Matthew Chalk

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[37]  arXiv:2111.03949 [pdf, other]

Title: Deep Neyman-Scott Processes

Authors: Chengkuan Hong, Christian R. Shelton

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[38]  arXiv:2111.04513 [pdf, ps, other]

Title: Clustering and Structural Robustness in Causal Diagrams

Authors: Santtu Tikka, Jouni Helske, Juha Karvanen

Comments: This is the version published in JMLR

Journal-ref: Journal of Machine Learning Research, 24(195):1-32, 2023

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[39]  arXiv:2111.04558 [pdf, other]

Title: Fast and Scalable Spike and Slab Variable Selection in High-Dimensional Gaussian Processes

Authors: Hugh Dance, Brooks Paige

Comments: Accepted at the 25th International Conference on Artificial Intelligence and Statistics (AISTATS 2022)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[40]  arXiv:2111.04597 [pdf, other]

Title: Neyman-Pearson Multi-class Classification via Cost-sensitive Learning

Authors: Ye Tian, Yang Feng

Comments: 53 pages, 6 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[41]  arXiv:2111.04609 [pdf, ps, other]

Title: A Private and Computationally-Efficient Estimator for Unbounded Gaussians

Authors: Gautam Kamath, Argyris Mouzakis, Vikrant Singhal, Thomas Steinke, Jonathan Ullman

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (cs.LG)

[42]  arXiv:2111.04658 [pdf, other]

Title: Consistent Sufficient Explanations and Minimal Local Rules for explaining regression and classification models

Authors: Salim I. Amoukou, Nicolas J.B Brunel

Comments: Accepted at the 36th Conference on Neural Information Processing Systems (NeurIPS 2022)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[43]  arXiv:2111.04805 [pdf, other]

Title: Solution to the Non-Monotonicity and Crossing Problems in Quantile Regression

Authors: Resve A. Saleh, A.K.Md. Ehsanes Saleh

Comments: 8 pages, 14 figures, IEEE conference format

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[44]  arXiv:2111.04871 [pdf, other]

Title: Query-augmented Active Metric Learning

Authors: Yujia Deng, Yubai Yuan, Haoda Fu, Annie Qu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[45]  arXiv:2111.04906 [pdf, other]

Title: The Role of Adaptive Optimizers for Honest Private Hyperparameter Selection

Authors: Shubhankar Mohapatra, Sajin Sasy, Xi He, Gautam Kamath, Om Thakkar

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[46]  arXiv:2111.05123 [pdf, ps, other]

Title: Gated Linear Model induced U-net for surrogate modeling and uncertainty quantification

Authors: Sai Krishna Mendu, Souvik Chakraborty

Comments: 21 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[47]  arXiv:2111.05198 [pdf, other]

Title: Harmless interpolation in regression and classification with structured features

Authors: Andrew D. McRae, Santhosh Karnik, Mark A. Davenport, Vidya Muthukumar

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[48]  arXiv:2111.05300 [pdf, other]

Title: Double Control Variates for Gradient Estimation in Discrete Latent Variable Models

Authors: Michalis K. Titsias, Jiaxin Shi

Comments: AISTATS 2022. Source code: this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[49]  arXiv:2111.05366 [pdf, other]

Title: Graph Matching via Optimal Transport

Authors: Ali Saad-Eldin, Benjamin D. Pedigo, Carey E. Priebe, Joshua T. Vogelstein

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Combinatorics (math.CO)

[50]  arXiv:2111.05458 [pdf, other]

Title: Which priors matter? Benchmarking models for learning latent dynamics

Authors: Aleksandar Botev, Andrew Jaegle, Peter Wirnsberger, Daniel Hennes, Irina Higgins

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)