References & Citations
Statistics > Computation
Title: A Block Minorization--Maximization Algorithm for Heteroscedastic Regression
(Submitted on 15 Mar 2016 (v1), last revised 30 May 2016 (this version, v2))
Abstract: The computation of the maximum likelihood (ML) estimator for heteroscedastic regression models is considered. The traditional Newton algorithms for the problem require matrix multiplications and inversions, which are bottlenecks in modern Big Data contexts. A new Big Data-appropriate minorization--maximization (MM) algorithm is considered for the computation of the ML estimator. The MM algorithm is proved to generate monotonically increasing sequences of likelihood values and to be convergent to a stationary point of the log-likelihood function. A distributed and parallel implementation of the MM algorithm is presented and the MM algorithm is shown to have differing time complexity to the Newton algorithm. Simulation studies demonstrate that the MM algorithm improves upon the computation time of the Newton algorithm in some practical scenarios where the number of observations is large.
Submission history
From: Hien Nguyen [view email][v1] Tue, 15 Mar 2016 09:40:29 GMT (408kb,D)
[v2] Mon, 30 May 2016 08:42:09 GMT (481kb,D)
Link back to: arXiv, form interface, contact.