Machine Learning

Authors and titles for stat.ML in May 2021

[1]  arXiv:2105.00026 [pdf, other]

Title: Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencoder

Authors: Clément Chadebec, Elina Thibeau-Sutre, Ninon Burgos, Stéphanie Allassonnière

Comments: accepted to IEEE transactions on pattern analysis and machine intelligence (TPAMI)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[2]  arXiv:2105.00211 [pdf, other]

Title: Autoregressive Hidden Markov Models with partial knowledge on latent space applied to aero-engines prognostics

Authors: Pablo Juesas, Emmanuel Ramasso, Sébastien Drujont, Vincent Placet

Journal-ref: European Conference of the PHM Society 2016, selected for extended version in IJPHM

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Methodology (stat.ME)

[3]  arXiv:2105.00233 [pdf, ps, other]

Title: Matrix completion based on Gaussian parameterized belief propagation

Authors: Koki Okajima, Yoshiyuki Kabashima

Comments: 21 pages, 7 figures

Subjects: Machine Learning (stat.ML); Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG)

[4]  arXiv:2105.00262 [pdf, other]

Title: One-pass Stochastic Gradient Descent in Overparametrized Two-layer Neural Networks

Authors: Jiaming Xu, Hanjing Zhu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[5]  arXiv:2105.00351 [pdf, other]

Title: Lattice Paths for Persistent Diagrams

Authors: Moo K. Chung, Hernando Ombao

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Biomolecules (q-bio.BM)

[6]  arXiv:2105.00455 [pdf, other]

Title: Synthesized Difference in Differences

Authors: Eric V. Strobl, Thomas A. Lasko

Comments: Accepted to ACM BCB 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[7]  arXiv:2105.00581 [pdf, other]

Title: Robust Sample Weighting to Facilitate Individualized Treatment Rule Learning for a Target Population

Authors: Rui Chen, Jared D. Huling, Guanhua Chen, Menggang Yu

Comments: Biometrika, in press

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[8]  arXiv:2105.01029 [pdf, other]

Title: Initialization and Regularization of Factorized Neural Layers

Authors: Mikhail Khodak, Neil Tenenholtz, Lester Mackey, Nicolò Fusi

Comments: ICLR 2021 camera-ready, amended due to error pointed out in arXiv:2209.13569v1 (amendment shown in blue)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[9]  arXiv:2105.01136 [pdf, other]

Title: Learning Good State and Action Representations via Tensor Decomposition

Authors: Chengzhuo Ni, Yaqi Duan, Munther Dahleh, Anru Zhang, Mengdi Wang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[10]  arXiv:2105.01441 [pdf, other]

Title: Distributive Justice and Fairness Metrics in Automated Decision-making: How Much Overlap Is There?

Authors: Matthias Kuppler, Christoph Kern, Ruben L. Bach, Frauke Kreuter

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[11]  arXiv:2105.01463 [pdf, other]

Title: On the Sample Complexity of Rank Regression from Pairwise Comparisons

Authors: Berkan Kadioglu, Peng Tian, Jennifer Dy, Deniz Erdogmus, Stratis Ioannidis

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[12]  arXiv:2105.01536 [pdf, other]

Title: Abstraction-Guided Truncations for Stationary Distributions of Markov Population Models

Authors: Michael Backenköhler, Luca Bortolussi, Gerrit Großmann, Verena Wolf

Comments: arXiv admin note: text overlap with arXiv:2010.10096

Subjects: Machine Learning (stat.ML); Systems and Control (eess.SY); Quantitative Methods (q-bio.QM)

[13]  arXiv:2105.01637 [pdf, other]

Title: Implicit differentiation for fast hyperparameter selection in non-smooth convex learning

Authors: Quentin Bertrand, Quentin Klopfenstein, Mathurin Massias, Mathieu Blondel, Samuel Vaiter, Alexandre Gramfort, Joseph Salmon

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[14]  arXiv:2105.01650 [pdf, other]

Title: Stochastic gradient descent with noise of machine learning type. Part I: Discrete time analysis

Authors: Stephan Wojtowytsch

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[15]  arXiv:2105.01783 [pdf, other]

Title: Nonparametric Trace Regression in High Dimensions via Sign Series Representation

Authors: Chanwoo Lee, Lexin Li, Hao Helen Zhang, Miaoyan Wang

Comments: 66 pages, 10 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[16]  arXiv:2105.02337 [pdf, ps, other]

Title: Non-asymptotic analysis and inference for an outlyingness induced winsorized mean

Authors: Yijun Zuo

Comments: 16 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[17]  arXiv:2105.02344 [pdf, other]

Title: Policy Learning with Adaptively Collected Data

Authors: Ruohan Zhan, Zhimei Ren, Susan Athey, Zhengyuan Zhou

Comments: Improved the upper bound; added simulations

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Econometrics (econ.EM)

[18]  arXiv:2105.02487 [pdf, other]

Title: High-dimensional Functional Graphical Model Structure Learning via Neighborhood Selection Approach

Authors: Boxin Zhao, Percy S. Zhai, Y. Samuel Wang, Mladen Kolar

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[19]  arXiv:2105.02522 [pdf, other]

Title: Neural graphical modelling in continuous-time: consistency guarantees and algorithms

Authors: Alexis Bellot, Kim Branson, Mihaela van der Schaar

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS)

[20]  arXiv:2105.02569 [pdf, ps, other]

Title: Machine Collaboration

Authors: Qingfeng Liu, Yang Feng

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Econometrics (econ.EM)

[21]  arXiv:2105.02816 [pdf, ps, other]

Title: Semidefinite Programming for Community Detection with Side Information

Authors: Mohammad Esmaeili, Hussein Metwaly Saad, Aria Nosratinia

Comments: 15 pages

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[22]  arXiv:2105.02831 [pdf, other]

Title: The layer-wise L1 Loss Landscape of Neural Nets is more complex around local minima

Authors: Peter Hinz

Comments: 4 pages, 5 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[23]  arXiv:2105.03153 [pdf, other]

Title: Pairwise Fairness for Ordinal Regression

Authors: Matthäus Kleindessner, Samira Samadi, Muhammad Bilal Zafar, Krishnaram Kenthapadi, Chris Russell

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[24]  arXiv:2105.03173 [pdf, other]

Title: Use of High Dimensional Modeling for automatic variables selection: the best path algorithm

Authors: Luigi Riso

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[25]  arXiv:2105.03248 [pdf, ps, other]

Title: Parameter Priors for Directed Acyclic Graphical Models and the Characterization of Several Probability Distributions

Authors: Dan Geiger, David Heckerman

Comments: This version has improved pointers to the literature. arXiv admin note: substantial text overlap with arXiv:1301.6697

Journal-ref: The Annals of Statistics, 30: 1412-1440, 2002

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[26]  arXiv:2105.03308 [pdf, other]

Title: Geometric convergence of elliptical slice sampling

Authors: Viacheslav Natarovskii, Daniel Rudolf, Björn Sprungk

Comments: 13 pages, 2 figures, Accepted in the Proceedings of the 38th International Conference on Machine Learning

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[27]  arXiv:2105.03361 [pdf, other]

Title: What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theory

Authors: Rahul Parhi, Robert D. Nowak

Journal-ref: SIAM Journal on Mathematics of Data Science, vol. 4, no. 2, pp. 464-489, 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[28]  arXiv:2105.03425 [pdf, other]

Title: Kernel Two-Sample Tests for Manifold Data

Authors: Xiuyuan Cheng, Yao Xie

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[29]  arXiv:2105.03584 [pdf, other]

Title: Adaptive Latent Space Tuning for Non-Stationary Distributions

Authors: Alexander Scheinker, Frederick Cropp, Sergio Paiagua, Daniele Filippetto

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Accelerator Physics (physics.acc-ph)

[30]  arXiv:2105.03863 [pdf, other]

Title: Towards Theoretical Understandings of Robust Markov Decision Processes: Sample Complexity and Asymptotics

Authors: Wenhao Yang, Liangyu Zhang, Zhihua Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[31]  arXiv:2105.04001 [pdf, other]

Title: Bayesian Kernelised Test of (In)dependence with Mixed-type Variables

Authors: Alessio Benavoli, Cassio de Campos

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[32]  arXiv:2105.04046 [pdf, other]

Title: A likelihood approach to nonparametric estimation of a singular distribution using deep generative models

Authors: Minwoo Chae, Dongha Kim, Yongdai Kim, Lizhen Lin

Comments: 42 pages, 13 figures, 1 table

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[33]  arXiv:2105.04087 [pdf, other]

Title: Latency Analysis of Consortium Blockchained Federated Learning

Authors: Pengcheng Ren, Tongjiang Yan

Subjects: Machine Learning (stat.ML); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[34]  arXiv:2105.04211 [pdf, other]

Title: SigGPDE: Scaling Sparse Gaussian Processes on Sequential Data

Authors: Maud Lemercier, Cristopher Salvi, Thomas Cass, Edwin V. Bonilla, Theodoros Damoulas, Terry Lyons

Comments: Published at ICML 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[35]  arXiv:2105.04242 [pdf, other]

Title: T-EMDE: Sketching-based global similarity for cross-modal retrieval

Authors: Barbara Rychalska, Mikolaj Wieczorek, Jacek Dabrowski

Comments: 10 pages,5 figures, 4 tables, 1 code snippet

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[36]  arXiv:2105.04290 [pdf, other]

Title: Meta-Cal: Well-controlled Post-hoc Calibration by Ranking

Authors: Xingchen Ma, Matthew B. Blaschko

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[37]  arXiv:2105.04379 [pdf, other]

Title: Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Bounds

Authors: Steven Kleinegesse, Michael U. Gutmann

Comments: Under review

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[38]  arXiv:2105.04404 [pdf, other]

Title: Topological Uncertainty: Monitoring trained neural networks through persistence of activation graphs

Authors: Théo Lacombe (DATASHAPE), Yuichi Ike, Mathieu Carriere, Frédéric Chazal, Marc Glisse, Yuhei Umeda

Journal-ref: 2021 International Joint Conference on Artificial Intelligence, Aug 2021, Montr{\'e}al, Canada

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[39]  arXiv:2105.04448 [pdf, other]

Title: Scaffolding Simulations with Deep Learning for High-dimensional Deconvolution

Authors: Anders Andreassen, Patrick T. Komiske, Eric M. Metodiev, Benjamin Nachman, Adi Suresh, Jesse Thaler

Comments: 6 pages, 1 figure, 1 table

Journal-ref: ICLR simDL workshop 2021 (https://simdl.github.io/files/12.pdf)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); High Energy Physics - Experiment (hep-ex); High Energy Physics - Phenomenology (hep-ph); Data Analysis, Statistics and Probability (physics.data-an)

[40]  arXiv:2105.04504 [pdf, other]

Title: Deep Neural Networks as Point Estimates for Deep Gaussian Processes

Authors: Vincent Dutordoir, James Hensman, Mark van der Wilk, Carl Henrik Ek, Zoubin Ghahramani, Nicolas Durrande

Comments: 35th Conference on Neural Information Processing Systems (NeurIPS 2021)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[41]  arXiv:2105.04646 [pdf, other]

Title: Deeply-Debiased Off-Policy Interval Estimation

Authors: Chengchun Shi, Runzhe Wan, Victor Chernozhukov, Rui Song

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[42]  arXiv:2105.04816 [pdf, other]

Title: Spectral risk-based learning using unbounded losses

Authors: Matthew J. Holland, El Mehdi Haress

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[43]  arXiv:2105.04854 [pdf, other]

Title: Improving Molecular Graph Neural Network Explainability with Orthonormalization and Induced Sparsity

Authors: Ryan Henderson, Djork-Arné Clevert, Floriane Montanari

Comments: Fixed typo and reference

Journal-ref: Proceedings of the 38th International Conference on Machine Learning, PMLR 139:4203-4213, 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[44]  arXiv:2105.04920 [pdf, other]

Title: More Powerful Conditional Selective Inference for Generalized Lasso by Parametric Programming

Authors: Vo Nguyen Le Duy, Ichiro Takeuchi

Journal-ref: Journal of Machine Learning Research 23.300 (2022): 1-37

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[45]  arXiv:2105.04979 [pdf, other]

Title: Surrogate assisted active subspace and active subspace assisted surrogate -- A new paradigm for high dimensional structural reliability analysis

Authors: Navaneeth N., Souvik Chakraborty

Comments: 19 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[46]  arXiv:2105.05031 [pdf, other]

Title: Gradient flow encoding with distance optimization adaptive step size

Authors: Kyriakos Flouris, Anna Volokitin, Gustav Bredell, Ender Konukoglu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Computation (stat.CO)

[47]  arXiv:2105.05115 [pdf, ps, other]

Title: Analysis of One-Hidden-Layer Neural Networks via the Resolvent Method

Authors: Vanessa Piccolo, Dominik Schröder

Comments: Final version, NeurIPS 2021. 22 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[48]  arXiv:2105.05146 [pdf, other]

Title: A Twin Neural Model for Uplift

Authors: Mouloud Belbahri, Olivier Gandouet, Alejandro Murua, Vahid Partovi Nia

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[49]  arXiv:2105.05489 [pdf, other]

Title: Multiscale Invertible Generative Networks for High-Dimensional Bayesian Inference

Authors: Shumao Zhang, Pengchuan Zhang, Thomas Y. Hou

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Computation (stat.CO)

[50]  arXiv:2105.05648 [pdf, other]

Title: Look-Ahead Screening Rules for the Lasso

Authors: Johan Larsson

Comments: EYSM 2021 short paper; 6 pages, 2 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)