We gratefully acknowledge support from
the Simons Foundation and member institutions.


New submissions

[ total of 6 entries: 1-6 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Mon, 24 Jan 22

[1]  arXiv:2201.08659 [pdf, other]
Title: Unity Smoothing for Handling Inconsistent Evidence in Bayesian Networks and Unity Propagation for Faster Inference
Subjects: Machine Learning (cs.LG); Computation (stat.CO)

We propose Unity Smoothing (US) for handling inconsistencies between a Bayesian network model and new unseen observations. We show that prediction accuracy, using the junction tree algorithm with US is comparable to that of Laplace smoothing. Moreover, in applications were sparsity of the data structures is utilized, US outperforms Laplace smoothing in terms of memory usage. Furthermore, we detail how to avoid redundant calculations that must otherwise be performed during the message passing scheme in the junction tree algorithm which we refer to as Unity Propagation (UP). Experimental results shows that it is always faster to exploit UP on top of the Lauritzen-Spigelhalter message passing scheme for the junction tree algorithm.

[2]  arXiv:2201.08712 [pdf, other]
Title: Improved Random Features for Dot Product Kernels
Comments: 71 pages
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

Dot product kernels, such as polynomial and exponential (softmax) kernels, are among the most widely used kernels in machine learning, as they enable modeling the interactions between input features, which is crucial in applications like computer vision, natural language processing, and recommender systems. We make several novel contributions for improving the efficiency of random feature approximations for dot product kernels, to make these kernels more useful in large scale learning. First, we present a generalization of existing random feature approximations for polynomial kernels, such as Rademacher and Gaussian sketches and TensorSRHT, using complex-valued random features. We show empirically that the use of complex features can significantly reduce the variances of these approximations. Second, we provide a theoretical analysis for understanding the factors affecting the efficiency of various random feature approximations, by deriving closed-form expressions for their variances. These variance formulas elucidate conditions under which certain approximations (e.g., TensorSRHT) achieve lower variances than others (e.g, Rademacher sketch), and conditions under which the use of complex features leads to lower variances than real features. Third, by using these variance formulas, which can be evaluated in practice, we develop a data-driven optimization approach to random feature approximations for general dot product kernels, which is also applicable to the Gaussian kernel. We describe the improvements brought by these contributions with extensive experiments on a variety of tasks and datasets.

Replacements for Mon, 24 Jan 22

[3]  arXiv:2104.08198 (replaced) [pdf, ps, other]
Title: Multilevel Bootstrap Particle Filter
Comments: 29 pages, 1 figure
Subjects: Computation (stat.CO)
[4]  arXiv:2201.08044 (replaced) [pdf, ps, other]
Title: Metropolis Augmented Hamiltonian Monte Carlo
Authors: Guangyao Zhou
Comments: Symposium on Advances in Approximate Bayesian Inference (AABI) 2022
Subjects: Computation (stat.CO)
[5]  arXiv:2105.13440 (replaced) [pdf, other]
Title: Non-negative matrix factorization algorithms greatly improve topic model fits
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)
[6]  arXiv:2110.14822 (replaced) [pdf, other]
Title: Efficient Algorithms and Implementation of a Semiparametric Joint Model for Longitudinal and Competing Risks Data: With Applications to Massive Biobank Data
Comments: Accepted on Computational and Mathematical Methods in Medicine
Subjects: Methodology (stat.ME); Computation (stat.CO)
[ total of 6 entries: 1-6 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, stat, recent, 2201, contact, help  (Access key information)