Data Structures and Algorithms
New submissions
[ showing up to 2000 entries per page: fewer | more ]
New submissions for Thu, 27 Jan 22
- [1] arXiv:2201.10684 [pdf, other]
-
Title: Stochastic diagonal estimation: probabilistic bounds and an improved algorithmComments: 40 pagesSubjects: Data Structures and Algorithms (cs.DS); Numerical Analysis (math.NA); Probability (math.PR)
We study the problem of estimating the diagonal of an implicitly given matrix $A$. For such a matrix we have access to an oracle that allows us to evaluate the matrix vector product $Av$. For random variable $v$ drawn from an appropriate distribution, this may be used to return an estimate of the diagonal of the matrix $A$. Whilst results exist for probabilistic guarantees relating to the error of estimates of the trace of $A$, no such results have yet been derived for the diagonal. We analyse the number of queries $s$ required to guarantee that with probability at least $1-\delta$ the estimates of the relative error of the diagonal entries is at most $\varepsilon$. We extend this analysis to the 2-norm of the difference between the estimate and the diagonal of $A$. We prove, discuss and experiment with bounds on the number of queries $s$ required to guarantee a probabilistic bound on the estimates of the diagonal by employing Rademacher and Gaussian random variables. Two sufficient upper bounds on the minimum number of query vectors are proved, extending the work of Avron and Toledo [JACM 58(2)8, 2011], and later work of Roosta-Khorasani and Ascher [FoCM 15, 1187-1212, 2015]. We find that, generally, there is little difference between the two, with convergence going as $O(\log(1/\delta)/\varepsilon^2)$ for individual diagonal elements. However for small $s$, we find that the Rademacher estimator is superior. These results allow us to then extend the ideas of Meyer, Musco, Musco and Woodruff [SOSA, 142-155, 2021], suggesting algorithm Diag++, to speed up the convergence of diagonal estimation from $O(1/\varepsilon^2)$ to $O(1/\varepsilon)$ and make it robust to the spectrum of any positive semi-definite matrix $A$.
Cross-lists for Thu, 27 Jan 22
- [2] arXiv:2201.10638 (cross-list from math.NA) [pdf, ps, other]
-
Title: Sketching Matrix Least Squares via Leverage Scores EstimatesComments: This is detailed and standalone derivation of a result that already appears in (arXiv:2006.16438, Appendix A). arXiv admin note: substantial text overlap with arXiv:2006.16438Subjects: Numerical Analysis (math.NA); Data Structures and Algorithms (cs.DS)
We consider the matrix least squares problem of the form $\| \mathbf{A} \mathbf{X}-\mathbf{B} \|_F^2$ where the design matrix $\mathbf{A} \in \mathbb{R}^{N \times r}$ is tall and skinny with $N \gg r$. We propose to create a sketched version $\| \tilde{\mathbf{A}}\mathbf{X}-\tilde{\mathbf{B}} \|_F^2$ where the sketched matrices $\tilde{\mathbf{A}}$ and $\tilde{\mathbf{B}}$ contain weighted subsets of the rows of $\mathbf{A}$ and $\mathbf{B}$, respectively. The subset of rows is determined via random sampling based on leverage score estimates for each row. We say that the sketched problem is $\epsilon$-accurate if its solution $\tilde{\mathbf{X}}_{\rm \text{opt}} = \text{argmin } \| \tilde{\mathbf{A}}\mathbf{X}-\tilde{\mathbf{B}} \|_F^2$ satisfies $\|\mathbf{A}\tilde{\mathbf{X}}_{\rm \text{opt}}-\mathbf{B} \|_F^2 \leq (1+\epsilon) \min \| \mathbf{A}\mathbf{X}-\mathbf{B} \|_F^2$ with high probability. We prove that the number of samples required for an $\epsilon$-accurate solution is $O(r/(\beta \epsilon))$ where $\beta \in (0,1]$ is a measure of the quality of the leverage score estimates.
- [3] arXiv:2201.10758 (cross-list from cs.GT) [pdf, ps, other]
-
Title: An Efficient Approximation Algorithm for the Colonel Blotto GameAuthors: Daniel BeagleholeSubjects: Computer Science and Game Theory (cs.GT); Discrete Mathematics (cs.DM); Data Structures and Algorithms (cs.DS); Multiagent Systems (cs.MA)
In the storied Colonel Blotto game, two colonels allocate $a$ and $b$ troops, respectively, to $k$ distinct battlefields. A colonel wins a battle if they assign more troops to that particular battle, and each colonel seeks to maximize their total number of victories.
Despite the problem's formulation in 1921, the first polynomial-time algorithm to compute Nash equilibrium (NE) strategies for this game was discovered only quite recently. In 2016, \cite{ahmadinejad_dehghani_hajiaghayi_lucier_mahini_seddighin_2019} formulated a breakthrough algorithm to compute NE strategies for the Colonel Blotto game in computational complexity $O(k^{14}\max\{a,b\}^{13})$, receiving substantial media coverage (e.g. \cite{Insider}, \cite{NSF}, \cite{ScienceDaily}). As of this work, this is the only known algorithm (to our knowledge) for the Colonel Blotto game with general parameters.
In this work, we present the first known algorithm to compute $\eps$-approximate NE strategies in the two-player Colonel Blotto game in runtime $\widetilde{O}(\eps^{-4} k^8 \max\{a,b\})$ for arbitrary settings of these parameters. Moreover, this algorithm is the first known efficient algorithm to compute approximate coarse correlated equilibrium strategies in the multiplayer Colonel Blotto game (when there are more than two colonels) with runtime $\widetilde{O}(\ell \eps^{-4} k^8 \max\{a,b\} + \ell^2 \eps^{-2} k^3 \max\{a,b\})$. Prior to this work, no polynomial-time algorithm was known to compute exact or approximate equilibrium (in any sense) strategies for multiplayer Colonel Blotto with arbitrary parameters. Our algorithm computes these approximate equilibria by implicitly performing multiplicative weights update over the exponentially many strategies available to each player.
Replacements for Thu, 27 Jan 22
- [4] arXiv:1910.00868 (replaced) [pdf, other]
-
Title: Advice Complexity of Adaptive Priority AlgorithmsSubjects: Data Structures and Algorithms (cs.DS)
- [5] arXiv:2201.08005 (replaced) [pdf]
-
Title: FreSCo: Mining Frequent Patterns in Simplicial ComplexesComments: To appear at The Web Conference 2022Subjects: Data Structures and Algorithms (cs.DS); Social and Information Networks (cs.SI)
- [6] arXiv:2004.12063 (replaced) [pdf, ps, other]
-
Title: Hardness of Random Optimization Problems for Boolean Circuits, Low-Degree Polynomials, and Langevin DynamicsComments: 41 pages; v1 is the conference paper "Low-Degree Hardness of Random Optimization Problems" (FOCS 2020); v2 is a journal version which adds circuit lower bounds for max independent set, based on ideas from our note arXiv:2109.01342Subjects: Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS); Mathematical Physics (math-ph); Probability (math.PR); Machine Learning (stat.ML)
- [7] arXiv:2105.06357 (replaced) [pdf, other]
-
Title: On Minimizing the Number of Running Buffers for Tabletop RearrangementComments: Updated funding support informationSubjects: Robotics (cs.RO); Data Structures and Algorithms (cs.DS)
- [8] arXiv:2107.04423 (replaced) [pdf, other]
-
Title: Multiaccurate Proxies for Downstream FairnessAuthors: Emily Diana, Wesley Gill, Michael Kearns, Krishnaram Kenthapadi, Aaron Roth, Saeed Sharifi-MalvajerdiSubjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS)
- [9] arXiv:2109.04025 (replaced) [pdf, other]
-
Title: Improved Hardness of BDD and SVP Under Gap-(S)ETHComments: ITCS 2022Subjects: Computational Complexity (cs.CC); Cryptography and Security (cs.CR); Data Structures and Algorithms (cs.DS)
- [10] arXiv:2109.04623 (replaced) [pdf, other]
-
Title: ReLU Regression with Massart NoiseSubjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)
- [11] arXiv:2111.06267 (replaced) [pdf, ps, other]
-
Title: The Harmless Set ProblemSubjects: Computational Complexity (cs.CC); Discrete Mathematics (cs.DM); Data Structures and Algorithms (cs.DS)
- [12] arXiv:2201.10408 (replaced) [pdf, other]
-
Title: Beyond the Frontier: Fairness Without Accuracy LossSubjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Data Structures and Algorithms (cs.DS)
[ showing up to 2000 entries per page: fewer | more ]
Disable MathJax (What is MathJax?)
Links to: arXiv, form interface, find, cs, recent, 2201, contact, help (Access key information)