We gratefully acknowledge support from
the Simons Foundation and member institutions.

Optimization and Control

New submissions

[ total of 29 entries: 1-29 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Mon, 20 Mar 23

[1]  arXiv:2303.09611 [pdf, other]
Title: Decentralized Riemannian natural gradient methods with Kronecker-product approximations
Comments: 17 pages
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG)

With a computationally efficient approximation of the second-order information, natural gradient methods have been successful in solving large-scale structured optimization problems. We study the natural gradient methods for the large-scale decentralized optimization problems on Riemannian manifolds, where the local objective function defined by the local dataset is of a log-probability type. By utilizing the structure of the Riemannian Fisher information matrix (RFIM), we present an efficient decentralized Riemannian natural gradient descent (DRNGD) method. To overcome the communication issue of the high-dimension RFIM, we consider a class of structured problems for which the RFIM can be approximated by a Kronecker product of two low-dimension matrices. By performing the communications over the Kronecker factors, a high-quality approximation of the RFIM can be obtained in a low cost. We prove that DRNGD converges to a stationary point with the best-known rate of $\mathcal{O}(1/K)$. Numerical experiments demonstrate the efficiency of our proposed method compared with the state-of-the-art ones. To the best of our knowledge, this is the first Riemannian second-order method for solving decentralized manifold optimization problems.

[2]  arXiv:2303.09647 [pdf, other]
Title: Anomaly Search Over Many Sequences With Switching Costs
Comments: 6 pages, 4 figures
Subjects: Optimization and Control (math.OC); Robotics (cs.RO); Signal Processing (eess.SP)

This paper considers the quickest search problem to identify anomalies among large numbers of data streams. These streams can model, for example, disjoint regions monitored by a mobile robot. A particular challenge is a version of the problem in which the experimenter must suffer a cost each time the data stream being sampled changes, such as the time the robot must spend moving between regions. In this paper, we propose an algorithm which accounts for switching costs by varying a confidence threshold that governs when the algorithm switches to a new data stream. Our main contributions are easily computable approximations for both the optimal value of this threshold and the optimal value of the parameter that determines when a stream must be re-sampled. Further, we empirically show (i) a uniform improvement for switching costs of interest and (ii) roughly equivalent performance for small switching costs when comparing to the closest available algorithm.

[3]  arXiv:2303.09667 [pdf, other]
Title: An invitation to quantum mean-field filtering and control
Subjects: Optimization and Control (math.OC); Mathematical Physics (math-ph); Probability (math.PR); Quantum Physics (quant-ph)

Following the Kolokoltsov's work [14], we will present an extension of mean-field control theory in quantum framework. In particular such an extension is done naturally by considering the Belavkin quantum filtering and control theory in a mean-field setting. The state dynamics is described by a controlled Belavkin equation of McKean-Vlasov type, and we prove the well-posedness of the equation under imperfect measurements records and also the propagation of chaos for perfect measurements. Also, we apply particle methods to simulate the mean-field equation and we suggest its application in a stabilizing feedback control.

[4]  arXiv:2303.09738 [pdf, other]
Title: Computing one-bit compressive sensing via zero-norm regularized DC loss model and its surrogate
Subjects: Optimization and Control (math.OC)

One-bit compressed sensing is very popular in signal processing and communications due to its low storage costs and low hardware complexity, but it is a challenging task to recover the signal by using the one-bit information. In this paper, we propose a zero-norm regularized smooth difference of convexity (DC) loss model and derive a family of equivalent nonconvex surrogates covering the MCP and SCAD surrogates as special cases. Compared to the existing models, the new model and its SCAD surrogate have better robustness. To compute their $\tau$-stationary points, we develop a proximal gradient algorithm with extrapolation and establish the convergence of the whole iterate sequence. Also, the convergence is proved to have a linear rate under a mild condition by studying the KL property of exponent 0 of the models. Numerical comparisons with several state-of-art methods show that in terms of the quality of solution, the proposed model and its SCAD surrogate are remarkably superior to the $\ell_p$-norm regularized models, and are comparable even superior to those sparsity constrained models with the true sparsity and the sign flip ratio as inputs.

[5]  arXiv:2303.09793 [pdf, ps, other]
Title: Robust Analysis of Almost Sure Convergence of Zeroth-Order Mirror Descent Algorithm
Subjects: Optimization and Control (math.OC)

This letter presents an almost sure convergence of the zeroth-order mirror descent algorithm. The algorithm admits non-smooth convex functions and a biased oracle which only provides noisy function value at any desired point. We approximate the subgradient of the objective function using Nesterov's Gaussian Approximation (NGA) with certain alternations suggested by some practical applications. We prove an almost sure convergence of the iterates' function value to the neighbourhood of optimal function value, which can not be made arbitrarily small, a manifestation of a biased oracle. This letter ends with a concentration inequality, which is a finite time analysis that predicts the likelihood that the function value of the iterates is in the neighbourhood of the optimal value at any finite iteration.

[6]  arXiv:2303.09881 [pdf, other]
Title: On a Frank-Wolfe Approach for Abs-smooth Functions
Subjects: Optimization and Control (math.OC)

We propose an algorithm which appears to be the first bridge between the fields of conditional gradient methods and abs-smooth optimization. Our nonsmooth nonconvex problem setting is motivated by machine learning, since the broad class of abs-smooth functions includes, for instance, the squared $\ell_2$-error of a neural network with ReLU or hinge loss activation. To overcome the nonsmoothness in our problem, we propose a generalization to the traditional Frank-Wolfe gap and prove that first-order minimality is achieved when it vanishes. We derive a convergence rate for our algorithm which is {\em identical} to the smooth case. Although our algorithm necessitates the solution of a subproblem which is more challenging than the smooth case, we provide an efficient numerical method for its partial solution, and we identify several applications where our approach fully solves the subproblem. Numerical and theoretical convergence is demonstrated, yielding several conjectures.

[7]  arXiv:2303.09927 [pdf, other]
Title: Integrated investment, retrofit and abandonment planning of energy systems with short-term and long-term uncertainty using enhanced Benders decomposition
Subjects: Optimization and Control (math.OC)

We propose the REORIENT (REnewable resOuRce Investment for the ENergy Transition) model for energy systems planning with the following novelties: (1) integrating capacity expansion, retrofit and abandonment planning, and (2) using multi-horizon stochastic mixed-integer linear programming with short-term and long-term uncertainty. We apply the model to the European energy system considering: (a) investment in new hydrogen infrastructures, (b) capacity expansion of the European power system, (c) retrofitting oil and gas infrastructures in the North Sea region for hydrogen production and distribution, and abandoning existing infrastructures, and (d) long-term uncertainty in oil and gas prices and short-term uncertainty in time series parameters. We utilise the special structure of multi-horizon stochastic programming and propose an enhanced Benders decomposition to solve the model efficiently. We first conduct a sensitivity analysis on retrofitting costs of oil and gas infrastructures. We then compare the REORIENT model with a conventional investment planning model regarding costs and investment decisions. Finally, the computational performance of the algorithm is presented. The results show that: (1) when the retrofitting cost is below 20% of the cost of building new ones, retrofitting is economical for most of the existing pipelines, (2) platform clusters keep producing oil due to the massive profit, and the clusters are abandoned in the last investment stage, (3) compared with a traditional investment planning model, the REORIENT model yields 24% lower investment cost in the North Sea region, and (4) the enhanced Benders algorithm is up to 6.8 times faster than the reference algorithm.

[8]  arXiv:2303.09980 [pdf, other]
Title: A fast continuous time approach for non-smooth convex optimization using Tikhonov regularization technique
Subjects: Optimization and Control (math.OC)

In this manuscript we would like to address the classical optimization problem of minimizing a proper, convex and lower semicontinuous function via the second order in time dynamics, combining viscous and Hessian-driven damping with a Tikhonov regularization technique. In our analysis we heavily exploit the Moreau envelope of the objective function and its properties as well as Tikhonov properties, which we extend to a nonsmooth case. We introduce the setting, which at the same time guarantees the fast convergence of the function (and Moreau envelope) values and strong convergence of the trajectories of the system to a minimal norm solution -- the element of the minimal norm of all the minimizers of the objective. Moreover, we deduce the precise rates of convergence of the values for the particular choice of parameter function. Various numerical examples are also included as an illustration of the theoretical results.

[9]  arXiv:2303.10006 [pdf, ps, other]
Title: Transient Performance of MPC for Tracking
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)

We analyse the closed-loop performance of a model predictive control (MPC) for tracking formulation with artificial references. It has been shown that such a scheme guarantees closed-loop stability and recursive feasibility for any reference, even if it is unreachable or time-varying. The basic idea is to consider an artificial reference as an additional decision variable and to formulate generalised terminal ingredients with respect to it. In addition, its offset is penalised in the MPC optimisation problem, leading to closed-loop convergence to the best reachable reference. In this paper, we provide a transient performance bound on the closed loop using MPC for tracking. We employ mild assumptions on the offset cost and scale it with the prediction horizon. In this case, an increasing horizon in MPC for tracking recovers the infinite horizon optimal solution.

[10]  arXiv:2303.10025 [pdf, other]
Title: Optimizing the Marketing of Flexibility for a Virtual Battery in Day-Ahead and Balancing Markets: A Rolling Horizon Case Study
Comments: 29 pages, 13 figures, 1 table
Subjects: Optimization and Control (math.OC)

Industrial electricity consumers with flexible demand can profit by adjusting their load to short-term prices and by providing balancing services to the grid. Markets which support this kind of short-term position adjustment are the day-ahead market and balancing markets. We propose a formulation for a combined optimization model that computes an optimal distribution of flexibility between the balancing and day-ahead markets. The optimal solution also includes the specific bids for the day-ahead and balancing markets. Besides the expected profits of each market and their individual bidding languages, our model also takes their different roles in a continuous marketing of flexibility into account. To prevent overrating short-term profits we introduce a variable penalty term that adds a cost to unfavorable load schedules. We evaluate the optimization model in a rolling horizon case study based on the setting of a virtual battery at TRIMET SE, which is derived from a flexible aluminum electrolysis process. For such a battery we compute a daily optimal split of flexibility and trading decisions based on data in the period 04/2021 - 03/2022. We show that the optimal split is more profitable than using only one market or a fixed split between the markets.

[11]  arXiv:2303.10081 [pdf, other]
Title: Verification and Synthesis of Robust Control Barrier Functions: Multilevel Polynomial Optimization and Semidefinite Relaxation
Comments: 18 pages, 2 figures
Subjects: Optimization and Control (math.OC); Robotics (cs.RO); Systems and Control (eess.SY)

We study the problem of verification and synthesis of robust control barrier functions (CBF) for control-affine polynomial systems with bounded additive uncertainty and convex polynomial constraints on the control. We first formulate robust CBF verification and synthesis as multilevel polynomial optimization problems (POP), where verification optimizes -- in three levels -- the uncertainty, control, and state, while synthesis additionally optimizes the parameter of a chosen parametric CBF candidate. We then show that, by invoking the KKT conditions of the inner optimizations over uncertainty and control, the verification problem can be simplified as a single-level POP and the synthesis problem reduces to a min-max POP. This reduction leads to multilevel semidefinite relaxations. For the verification problem, we apply Lasserre's hierarchy of moment relaxations. For the synthesis problem, we draw connections to existing relaxation techniques for robust min-max POP, which first use sum-of-squares programming to find increasingly tight polynomial lower bounds to the unknown value function of the verification POP, and then call Lasserre's hierarchy again to maximize the lower bounds. Both semidefinite relaxations guarantee asymptotic global convergence to optimality. We provide an in-depth study of our framework on the controlled Van der Pol Oscillator, both with and without additive uncertainty.

[12]  arXiv:2303.10101 [pdf, other]
Title: Bounds on polarization problems on compact sets via mixed integer programming
Comments: 20 pages, 4 figures
Subjects: Optimization and Control (math.OC); Metric Geometry (math.MG)

Finding point configurations, that yield the maximum polarization (Chebyshev constant) is gaining interest in the field of geometric optimization. In the present article, we study the problem of unconstrained maximum polarization on compact sets. In particular, we discuss necessary conditions for local optimality, such as that a locally optimal configuration is always contained in the convex hull of the respective darkest points. Building on this, we propose two sequences of mixed-integer linear programs in order to compute lower and upper bounds on the maximal polarization, where the lower bound is constructive. Moreover, we prove the convergence of these sequences towards the maximal polarization.

Cross-lists for Mon, 20 Mar 23

[13]  arXiv:2303.09557 (cross-list from math.PR) [pdf]
Title: A nested hierarchy of second order upper bounds on system failure probability
Comments: copyright 2022. This manuscript version is made available under the CC-BY-NC-ND 4.0 license this https URL
Journal-ref: Probabilistic Engineering Mechanics, Elsevier, Volume 70, October 2022, 103335
Subjects: Probability (math.PR); Optimization and Control (math.OC)

For a coherent, binary system made up of binary elements, the exact failure probability requires knowledge of statistical dependence of all orders among the minimal cut sets. Since dependence among the cut sets beyond the second order is generally difficult to obtain, second order bounds on system failure probability have practical value. The upper bound is conservative by definition and can be adopted in reliability based decision making. In this paper we propose a new hierarchy of m-level second order upper bounds, Bm : the well-known Kounias-Vanmarcke-Hunter-Ditlevsen (KVHD) bound - the current standard for upper bounds using second order joint probabilities - turns out to be the weakest member of this family (m = 1). We prove that Bm is non-increasing with level m in every ordering of the cut sets, and derive conditions under which Bm+1 is strictly less than Bm for any m and any ordering. We also derive conditions under which the optimal level m bound is strictly less than the optimal level m + 1 bound, and show that this improvement asymptotically achieves a probability of 1 as long as the second order joint probabilities are only constrained by the pair of corresponding first order probabilities. Numerical examples show that our second order upper bounds can yield tighter values than previously achieved and in every case exhibit considerable less scatter across the entire n! orderings of the cut sets compared to KVHD bounds. Our results therefore may lead to more efficient identification of the optimal upper bound when coupled with existing linear programming and tree search based approaches.

[14]  arXiv:2303.09960 (cross-list from cs.LG) [pdf, ps, other]
Title: Stochastic Submodular Maximization via Polynomial Estimators
Comments: 23 pages, accepted to 27th Pasific-Asian Conference on Knowledge Discovery and Data Mining
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC)

In this paper, we study stochastic submodular maximization problems with general matroid constraints, that naturally arise in online learning, team formation, facility location, influence maximization, active learning and sensing objective functions. In other words, we focus on maximizing submodular functions that are defined as expectations over a class of submodular functions with an unknown distribution. We show that for monotone functions of this form, the stochastic continuous greedy algorithm attains an approximation ratio (in expectation) arbitrarily close to $(1-1/e) \approx 63\%$ using a polynomial estimation of the gradient. We argue that using this polynomial estimator instead of the prior art that uses sampling eliminates a source of randomness and experimentally reduces execution time.

[15]  arXiv:2303.10024 (cross-list from eess.SY) [pdf, ps, other]
Title: Counter-example guided inductive synthesis of control Lyapunov functions for uncertain systems
Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)

We propose a counter-example guided inductive synthesis (CEGIS) scheme for the design of control Lyapunov functions and associated state-feedback controllers for linear systems affected by parametric uncertainty with arbitrary shape. In the CEGIS framework, a learner iteratively proposes a candidate control Lyapunov function and a tailored controller by solving a linear matrix inequality (LMI) feasibility problem, while a verifier either falsifies the current candidate by producing a counter-example to be considered at the next iteration, or it certifies that the tentative control Lyapunov function actually enjoys such feature. We investigate the Lipschitz continuity property of the global optimization problem solved by the verifier, which is key to establish the convergence of our method in a finite number of iterations. Numerical simulations confirm the effectiveness of the proposed approach.

[16]  arXiv:2303.10028 (cross-list from cs.CG) [pdf, other]
Title: Connectivity with uncertainty regions given as line segments
Comments: 29 pages, 7 figures
Subjects: Computational Geometry (cs.CG); Data Structures and Algorithms (cs.DS); Optimization and Control (math.OC)

For a set $Q$ of points in the plane and a real number $\delta \ge 0$, let $\mathbb{G}_\delta(Q)$ be the graph defined on $Q$ by connecting each pair of points at distance at most $\delta$.
We consider the connectivity of $\mathbb{G}_\delta(Q)$ in the best scenario when the location of a few of the points is uncertain, but we know for each uncertain point a line segment that contains it. More precisely, we consider the following optimization problem: given a set $P$ of $n-k$ points in the plane and a set $S$ of $k$ line segments in the plane, find the minimum $\delta\ge 0$ with the property that we can select one point $p_s\in s$ for each segment $s\in S$ and the corresponding graph $\mathbb{G}_\delta ( P\cup \{ p_s\mid s\in S\})$ is connected. It is known that the problem is NP-hard. We provide an algorithm to compute exactly an optimal solution in $O(f(k) n \log n)$ time, for a computable function $f(\cdot)$. This implies that the problem is FPT when parameterized by $k$. The best previous algorithm is using $O((k!)^k k^{k+1}\cdot n^{2k})$ time and computes the solution up to fixed precision.

[17]  arXiv:2303.10030 (cross-list from cs.IT) [pdf, ps, other]
Title: How robust is randomized blind deconvolution via nuclear norm minimization against adversarial noise?
Subjects: Information Theory (cs.IT); Machine Learning (cs.LG); Signal Processing (eess.SP); Optimization and Control (math.OC)

In this paper, we study the problem of recovering two unknown signals from their convolution, which is commonly referred to as blind deconvolution. Reformulation of blind deconvolution as a low-rank recovery problem has led to multiple theoretical recovery guarantees in the past decade due to the success of the nuclear norm minimization heuristic. In particular, in the absence of noise, exact recovery has been established for sufficiently incoherent signals contained in lower-dimensional subspaces. However, if the convolution is corrupted by additive bounded noise, the stability of the recovery problem remains much less understood. In particular, existing reconstruction bounds involve large dimension factors and therefore fail to explain the empirical evidence for dimension-independent robustness of nuclear norm minimization. Recently, theoretical evidence has emerged for ill-posed behavior of low-rank matrix recovery for sufficiently small noise levels. In this work, we develop improved recovery guarantees for blind deconvolution with adversarial noise which exhibit square-root scaling in the noise level. Hence, our results are consistent with existing counterexamples which speak against linear scaling in the noise level as demonstrated for related low-rank matrix recovery problems.

[18]  arXiv:2303.10154 (cross-list from cs.NE) [pdf, other]
Title: Epigenetics Algorithms: Self-Reinforcement-Attention mechanism to regulate chromosomes expression
Comments: submitted for GECCO conference
Subjects: Neural and Evolutionary Computing (cs.NE); Machine Learning (cs.LG); Optimization and Control (math.OC)

Genetic algorithms are a well-known example of bio-inspired heuristic methods. They mimic natural selection by modeling several operators such as mutation, crossover, and selection. Recent discoveries about Epigenetics regulation processes that occur "on top of" or "in addition to" the genetic basis for inheritance involve changes that affect and improve gene expression. They raise the question of improving genetic algorithms (GAs) by modeling epigenetics operators. This paper proposes a new epigenetics algorithm that mimics the epigenetics phenomenon known as DNA methylation. The novelty of our epigenetics algorithms lies primarily in taking advantage of attention mechanisms and deep learning, which fits well with the genes enhancing/silencing concept. The paper develops theoretical arguments and presents empirical studies to exhibit the capability of the proposed epigenetics algorithms to solve more complex problems efficiently than has been possible with simple GAs; for example, facing two Non-convex (multi-peaks) optimization problems as presented in this paper, the proposed epigenetics algorithm provides good performances and shows an excellent ability to overcome the lack of local optimum and thus find the global optimum.

[19]  arXiv:2303.10165 (cross-list from cs.LG) [pdf, other]
Title: Optimal Horizon-Free Reward-Free Exploration for Linear Mixture MDPs
Comments: 37 pages, 1 figure, 2 tables
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

We study reward-free reinforcement learning (RL) with linear function approximation, where the agent works in two phases: (1) in the exploration phase, the agent interacts with the environment but cannot access the reward; and (2) in the planning phase, the agent is given a reward function and is expected to find a near-optimal policy based on samples collected in the exploration phase. The sample complexities of existing reward-free algorithms have a polynomial dependence on the planning horizon, which makes them intractable for long planning horizon RL problems. In this paper, we propose a new reward-free algorithm for learning linear mixture Markov decision processes (MDPs), where the transition probability can be parameterized as a linear combination of known feature mappings. At the core of our algorithm is uncertainty-weighted value-targeted regression with exploration-driven pseudo-reward and a high-order moment estimator for the aleatoric and epistemic uncertainties. When the total reward is bounded by $1$, we show that our algorithm only needs to explore $\tilde O( d^2\varepsilon^{-2})$ episodes to find an $\varepsilon$-optimal policy, where $d$ is the dimension of the feature mapping. The sample complexity of our algorithm only has a polylogarithmic dependence on the planning horizon and therefore is ``horizon-free''. In addition, we provide an $\Omega(d^2\varepsilon^{-2})$ sample complexity lower bound, which matches the sample complexity of our algorithm up to logarithmic factors, suggesting that our algorithm is optimal.

Replacements for Mon, 20 Mar 23

[20]  arXiv:2202.01229 (replaced) [pdf, ps, other]
Title: Data-Driven Behaviour Estimation in Parametric Games
Comments: 8 pages, 4 figures, 1 tables + 1 appendix
Subjects: Optimization and Control (math.OC); Computer Science and Game Theory (cs.GT); Multiagent Systems (cs.MA); Systems and Control (eess.SY)
[21]  arXiv:2206.04113 (replaced) [pdf, other]
Title: Push--Pull with Device Sampling
Comments: In IEEE Transactions on Automatic Control
Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
[22]  arXiv:2209.02096 (replaced) [pdf, other]
Title: Passively-Safe and Robust Multi-Agent Optimal Control with Application to Distributed Space Systems
Comments: Submitted to AIAA Journal of Guidance, Control and Dynamics
Subjects: Optimization and Control (math.OC)
[23]  arXiv:2209.12078 (replaced) [pdf, other]
Title: On the Convergence Rates of A Nash Equilibrium Seeking Algorithm in Potential Games with Information Delays
Subjects: Optimization and Control (math.OC)
[24]  arXiv:2303.07450 (replaced) [pdf, other]
Title: ZO-JADE: Zeroth-order Curvature-Aware Multi-Agent Convex Optimization
Comments: Minor updates, without substantial variations in the content. We mainly changed the abstract and moved the statement of Theorem 1 to the Main Result section
Subjects: Optimization and Control (math.OC); Dynamical Systems (math.DS)
[25]  arXiv:2303.07824 (replaced) [pdf, other]
Title: Linear-quadratic mean-field-type difference games with coupled affine inequality constraints
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
[26]  arXiv:2303.07885 (replaced) [pdf, other]
Title: Optimal Role Assignment for Multiplayer Reach-Avoid Differential Games in 3D Space
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
[27]  arXiv:2303.09454 (replaced) [pdf, other]
Title: Towards CO2 valorization in a multi remote renewable energy hub framework
Subjects: Optimization and Control (math.OC)
[28]  arXiv:2209.07040 (replaced) [pdf, other]
Title: Learning-Based Adaptive Control for Stochastic Linear Systems with Input Constraints
Comments: 16 pages, 2 figures, accepted at IEEE Control Systems Letters
Subjects: Systems and Control (eess.SY); Machine Learning (cs.LG); Optimization and Control (math.OC)
[29]  arXiv:2303.00055 (replaced) [pdf, other]
Title: Learning time-scales in two-layers neural networks
Comments: 54 pages, 9 figures
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)
[ total of 29 entries: 1-29 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, math, recent, 2303, contact, help  (Access key information)