Optimization and Control
New submissions
[ showing up to 2000 entries per page: fewer  more ]
New submissions for Mon, 20 Mar 23
 [1] arXiv:2303.09611 [pdf, other]

Title: Decentralized Riemannian natural gradient methods with Kroneckerproduct approximationsComments: 17 pagesSubjects: Optimization and Control (math.OC); Machine Learning (cs.LG)
With a computationally efficient approximation of the secondorder information, natural gradient methods have been successful in solving largescale structured optimization problems. We study the natural gradient methods for the largescale decentralized optimization problems on Riemannian manifolds, where the local objective function defined by the local dataset is of a logprobability type. By utilizing the structure of the Riemannian Fisher information matrix (RFIM), we present an efficient decentralized Riemannian natural gradient descent (DRNGD) method. To overcome the communication issue of the highdimension RFIM, we consider a class of structured problems for which the RFIM can be approximated by a Kronecker product of two lowdimension matrices. By performing the communications over the Kronecker factors, a highquality approximation of the RFIM can be obtained in a low cost. We prove that DRNGD converges to a stationary point with the bestknown rate of $\mathcal{O}(1/K)$. Numerical experiments demonstrate the efficiency of our proposed method compared with the stateoftheart ones. To the best of our knowledge, this is the first Riemannian secondorder method for solving decentralized manifold optimization problems.
 [2] arXiv:2303.09647 [pdf, other]

Title: Anomaly Search Over Many Sequences With Switching CostsComments: 6 pages, 4 figuresSubjects: Optimization and Control (math.OC); Robotics (cs.RO); Signal Processing (eess.SP)
This paper considers the quickest search problem to identify anomalies among large numbers of data streams. These streams can model, for example, disjoint regions monitored by a mobile robot. A particular challenge is a version of the problem in which the experimenter must suffer a cost each time the data stream being sampled changes, such as the time the robot must spend moving between regions. In this paper, we propose an algorithm which accounts for switching costs by varying a confidence threshold that governs when the algorithm switches to a new data stream. Our main contributions are easily computable approximations for both the optimal value of this threshold and the optimal value of the parameter that determines when a stream must be resampled. Further, we empirically show (i) a uniform improvement for switching costs of interest and (ii) roughly equivalent performance for small switching costs when comparing to the closest available algorithm.
 [3] arXiv:2303.09667 [pdf, other]

Title: An invitation to quantum meanfield filtering and controlSubjects: Optimization and Control (math.OC); Mathematical Physics (mathph); Probability (math.PR); Quantum Physics (quantph)
Following the Kolokoltsov's work [14], we will present an extension of meanfield control theory in quantum framework. In particular such an extension is done naturally by considering the Belavkin quantum filtering and control theory in a meanfield setting. The state dynamics is described by a controlled Belavkin equation of McKeanVlasov type, and we prove the wellposedness of the equation under imperfect measurements records and also the propagation of chaos for perfect measurements. Also, we apply particle methods to simulate the meanfield equation and we suggest its application in a stabilizing feedback control.
 [4] arXiv:2303.09738 [pdf, other]

Title: Computing onebit compressive sensing via zeronorm regularized DC loss model and its surrogateSubjects: Optimization and Control (math.OC)
Onebit compressed sensing is very popular in signal processing and communications due to its low storage costs and low hardware complexity, but it is a challenging task to recover the signal by using the onebit information. In this paper, we propose a zeronorm regularized smooth difference of convexity (DC) loss model and derive a family of equivalent nonconvex surrogates covering the MCP and SCAD surrogates as special cases. Compared to the existing models, the new model and its SCAD surrogate have better robustness. To compute their $\tau$stationary points, we develop a proximal gradient algorithm with extrapolation and establish the convergence of the whole iterate sequence. Also, the convergence is proved to have a linear rate under a mild condition by studying the KL property of exponent 0 of the models. Numerical comparisons with several stateofart methods show that in terms of the quality of solution, the proposed model and its SCAD surrogate are remarkably superior to the $\ell_p$norm regularized models, and are comparable even superior to those sparsity constrained models with the true sparsity and the sign flip ratio as inputs.
 [5] arXiv:2303.09793 [pdf, ps, other]

Title: Robust Analysis of Almost Sure Convergence of ZerothOrder Mirror Descent AlgorithmSubjects: Optimization and Control (math.OC)
This letter presents an almost sure convergence of the zerothorder mirror descent algorithm. The algorithm admits nonsmooth convex functions and a biased oracle which only provides noisy function value at any desired point. We approximate the subgradient of the objective function using Nesterov's Gaussian Approximation (NGA) with certain alternations suggested by some practical applications. We prove an almost sure convergence of the iterates' function value to the neighbourhood of optimal function value, which can not be made arbitrarily small, a manifestation of a biased oracle. This letter ends with a concentration inequality, which is a finite time analysis that predicts the likelihood that the function value of the iterates is in the neighbourhood of the optimal value at any finite iteration.
 [6] arXiv:2303.09881 [pdf, other]

Title: On a FrankWolfe Approach for Abssmooth FunctionsSubjects: Optimization and Control (math.OC)
We propose an algorithm which appears to be the first bridge between the fields of conditional gradient methods and abssmooth optimization. Our nonsmooth nonconvex problem setting is motivated by machine learning, since the broad class of abssmooth functions includes, for instance, the squared $\ell_2$error of a neural network with ReLU or hinge loss activation. To overcome the nonsmoothness in our problem, we propose a generalization to the traditional FrankWolfe gap and prove that firstorder minimality is achieved when it vanishes. We derive a convergence rate for our algorithm which is {\em identical} to the smooth case. Although our algorithm necessitates the solution of a subproblem which is more challenging than the smooth case, we provide an efficient numerical method for its partial solution, and we identify several applications where our approach fully solves the subproblem. Numerical and theoretical convergence is demonstrated, yielding several conjectures.
 [7] arXiv:2303.09927 [pdf, other]

Title: Integrated investment, retrofit and abandonment planning of energy systems with shortterm and longterm uncertainty using enhanced Benders decompositionAuthors: Hongyu Zhang, Ignacio E. Grossmann, Brage Rugstad Knudsen, Ken McKinnon, Rodrigo Garcia Nava, Asgeir TomasgardSubjects: Optimization and Control (math.OC)
We propose the REORIENT (REnewable resOuRce Investment for the ENergy Transition) model for energy systems planning with the following novelties: (1) integrating capacity expansion, retrofit and abandonment planning, and (2) using multihorizon stochastic mixedinteger linear programming with shortterm and longterm uncertainty. We apply the model to the European energy system considering: (a) investment in new hydrogen infrastructures, (b) capacity expansion of the European power system, (c) retrofitting oil and gas infrastructures in the North Sea region for hydrogen production and distribution, and abandoning existing infrastructures, and (d) longterm uncertainty in oil and gas prices and shortterm uncertainty in time series parameters. We utilise the special structure of multihorizon stochastic programming and propose an enhanced Benders decomposition to solve the model efficiently. We first conduct a sensitivity analysis on retrofitting costs of oil and gas infrastructures. We then compare the REORIENT model with a conventional investment planning model regarding costs and investment decisions. Finally, the computational performance of the algorithm is presented. The results show that: (1) when the retrofitting cost is below 20% of the cost of building new ones, retrofitting is economical for most of the existing pipelines, (2) platform clusters keep producing oil due to the massive profit, and the clusters are abandoned in the last investment stage, (3) compared with a traditional investment planning model, the REORIENT model yields 24% lower investment cost in the North Sea region, and (4) the enhanced Benders algorithm is up to 6.8 times faster than the reference algorithm.
 [8] arXiv:2303.09980 [pdf, other]

Title: A fast continuous time approach for nonsmooth convex optimization using Tikhonov regularization techniqueAuthors: Mikhail KarapetyantsSubjects: Optimization and Control (math.OC)
In this manuscript we would like to address the classical optimization problem of minimizing a proper, convex and lower semicontinuous function via the second order in time dynamics, combining viscous and Hessiandriven damping with a Tikhonov regularization technique. In our analysis we heavily exploit the Moreau envelope of the objective function and its properties as well as Tikhonov properties, which we extend to a nonsmooth case. We introduce the setting, which at the same time guarantees the fast convergence of the function (and Moreau envelope) values and strong convergence of the trajectories of the system to a minimal norm solution  the element of the minimal norm of all the minimizers of the objective. Moreover, we deduce the precise rates of convergence of the values for the particular choice of parameter function. Various numerical examples are also included as an illustration of the theoretical results.
 [9] arXiv:2303.10006 [pdf, ps, other]

Title: Transient Performance of MPC for TrackingSubjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
We analyse the closedloop performance of a model predictive control (MPC) for tracking formulation with artificial references. It has been shown that such a scheme guarantees closedloop stability and recursive feasibility for any reference, even if it is unreachable or timevarying. The basic idea is to consider an artificial reference as an additional decision variable and to formulate generalised terminal ingredients with respect to it. In addition, its offset is penalised in the MPC optimisation problem, leading to closedloop convergence to the best reachable reference. In this paper, we provide a transient performance bound on the closed loop using MPC for tracking. We employ mild assumptions on the offset cost and scale it with the prediction horizon. In this case, an increasing horizon in MPC for tracking recovers the infinite horizon optimal solution.
 [10] arXiv:2303.10025 [pdf, other]

Title: Optimizing the Marketing of Flexibility for a Virtual Battery in DayAhead and Balancing Markets: A Rolling Horizon Case StudyComments: 29 pages, 13 figures, 1 tableSubjects: Optimization and Control (math.OC)
Industrial electricity consumers with flexible demand can profit by adjusting their load to shortterm prices and by providing balancing services to the grid. Markets which support this kind of shortterm position adjustment are the dayahead market and balancing markets. We propose a formulation for a combined optimization model that computes an optimal distribution of flexibility between the balancing and dayahead markets. The optimal solution also includes the specific bids for the dayahead and balancing markets. Besides the expected profits of each market and their individual bidding languages, our model also takes their different roles in a continuous marketing of flexibility into account. To prevent overrating shortterm profits we introduce a variable penalty term that adds a cost to unfavorable load schedules. We evaluate the optimization model in a rolling horizon case study based on the setting of a virtual battery at TRIMET SE, which is derived from a flexible aluminum electrolysis process. For such a battery we compute a daily optimal split of flexibility and trading decisions based on data in the period 04/2021  03/2022. We show that the optimal split is more profitable than using only one market or a fixed split between the markets.
 [11] arXiv:2303.10081 [pdf, other]

Title: Verification and Synthesis of Robust Control Barrier Functions: Multilevel Polynomial Optimization and Semidefinite RelaxationComments: 18 pages, 2 figuresSubjects: Optimization and Control (math.OC); Robotics (cs.RO); Systems and Control (eess.SY)
We study the problem of verification and synthesis of robust control barrier functions (CBF) for controlaffine polynomial systems with bounded additive uncertainty and convex polynomial constraints on the control. We first formulate robust CBF verification and synthesis as multilevel polynomial optimization problems (POP), where verification optimizes  in three levels  the uncertainty, control, and state, while synthesis additionally optimizes the parameter of a chosen parametric CBF candidate. We then show that, by invoking the KKT conditions of the inner optimizations over uncertainty and control, the verification problem can be simplified as a singlelevel POP and the synthesis problem reduces to a minmax POP. This reduction leads to multilevel semidefinite relaxations. For the verification problem, we apply Lasserre's hierarchy of moment relaxations. For the synthesis problem, we draw connections to existing relaxation techniques for robust minmax POP, which first use sumofsquares programming to find increasingly tight polynomial lower bounds to the unknown value function of the verification POP, and then call Lasserre's hierarchy again to maximize the lower bounds. Both semidefinite relaxations guarantee asymptotic global convergence to optimality. We provide an indepth study of our framework on the controlled Van der Pol Oscillator, both with and without additive uncertainty.
 [12] arXiv:2303.10101 [pdf, other]

Title: Bounds on polarization problems on compact sets via mixed integer programmingComments: 20 pages, 4 figuresSubjects: Optimization and Control (math.OC); Metric Geometry (math.MG)
Finding point configurations, that yield the maximum polarization (Chebyshev constant) is gaining interest in the field of geometric optimization. In the present article, we study the problem of unconstrained maximum polarization on compact sets. In particular, we discuss necessary conditions for local optimality, such as that a locally optimal configuration is always contained in the convex hull of the respective darkest points. Building on this, we propose two sequences of mixedinteger linear programs in order to compute lower and upper bounds on the maximal polarization, where the lower bound is constructive. Moreover, we prove the convergence of these sequences towards the maximal polarization.
Crosslists for Mon, 20 Mar 23
 [13] arXiv:2303.09557 (crosslist from math.PR) [pdf]

Title: A nested hierarchy of second order upper bounds on system failure probabilityComments: copyright 2022. This manuscript version is made available under the CCBYNCND 4.0 license this https URLJournalref: Probabilistic Engineering Mechanics, Elsevier, Volume 70, October 2022, 103335Subjects: Probability (math.PR); Optimization and Control (math.OC)
For a coherent, binary system made up of binary elements, the exact failure probability requires knowledge of statistical dependence of all orders among the minimal cut sets. Since dependence among the cut sets beyond the second order is generally difficult to obtain, second order bounds on system failure probability have practical value. The upper bound is conservative by definition and can be adopted in reliability based decision making. In this paper we propose a new hierarchy of mlevel second order upper bounds, Bm : the wellknown KouniasVanmarckeHunterDitlevsen (KVHD) bound  the current standard for upper bounds using second order joint probabilities  turns out to be the weakest member of this family (m = 1). We prove that Bm is nonincreasing with level m in every ordering of the cut sets, and derive conditions under which Bm+1 is strictly less than Bm for any m and any ordering. We also derive conditions under which the optimal level m bound is strictly less than the optimal level m + 1 bound, and show that this improvement asymptotically achieves a probability of 1 as long as the second order joint probabilities are only constrained by the pair of corresponding first order probabilities. Numerical examples show that our second order upper bounds can yield tighter values than previously achieved and in every case exhibit considerable less scatter across the entire n! orderings of the cut sets compared to KVHD bounds. Our results therefore may lead to more efficient identification of the optimal upper bound when coupled with existing linear programming and tree search based approaches.
 [14] arXiv:2303.09960 (crosslist from cs.LG) [pdf, ps, other]

Title: Stochastic Submodular Maximization via Polynomial EstimatorsComments: 23 pages, accepted to 27th PasificAsian Conference on Knowledge Discovery and Data MiningSubjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC)
In this paper, we study stochastic submodular maximization problems with general matroid constraints, that naturally arise in online learning, team formation, facility location, influence maximization, active learning and sensing objective functions. In other words, we focus on maximizing submodular functions that are defined as expectations over a class of submodular functions with an unknown distribution. We show that for monotone functions of this form, the stochastic continuous greedy algorithm attains an approximation ratio (in expectation) arbitrarily close to $(11/e) \approx 63\%$ using a polynomial estimation of the gradient. We argue that using this polynomial estimator instead of the prior art that uses sampling eliminates a source of randomness and experimentally reduces execution time.
 [15] arXiv:2303.10024 (crosslist from eess.SY) [pdf, ps, other]

Title: Counterexample guided inductive synthesis of control Lyapunov functions for uncertain systemsSubjects: Systems and Control (eess.SY); Optimization and Control (math.OC)
We propose a counterexample guided inductive synthesis (CEGIS) scheme for the design of control Lyapunov functions and associated statefeedback controllers for linear systems affected by parametric uncertainty with arbitrary shape. In the CEGIS framework, a learner iteratively proposes a candidate control Lyapunov function and a tailored controller by solving a linear matrix inequality (LMI) feasibility problem, while a verifier either falsifies the current candidate by producing a counterexample to be considered at the next iteration, or it certifies that the tentative control Lyapunov function actually enjoys such feature. We investigate the Lipschitz continuity property of the global optimization problem solved by the verifier, which is key to establish the convergence of our method in a finite number of iterations. Numerical simulations confirm the effectiveness of the proposed approach.
 [16] arXiv:2303.10028 (crosslist from cs.CG) [pdf, other]

Title: Connectivity with uncertainty regions given as line segmentsComments: 29 pages, 7 figuresSubjects: Computational Geometry (cs.CG); Data Structures and Algorithms (cs.DS); Optimization and Control (math.OC)
For a set $Q$ of points in the plane and a real number $\delta \ge 0$, let $\mathbb{G}_\delta(Q)$ be the graph defined on $Q$ by connecting each pair of points at distance at most $\delta$.
We consider the connectivity of $\mathbb{G}_\delta(Q)$ in the best scenario when the location of a few of the points is uncertain, but we know for each uncertain point a line segment that contains it. More precisely, we consider the following optimization problem: given a set $P$ of $nk$ points in the plane and a set $S$ of $k$ line segments in the plane, find the minimum $\delta\ge 0$ with the property that we can select one point $p_s\in s$ for each segment $s\in S$ and the corresponding graph $\mathbb{G}_\delta ( P\cup \{ p_s\mid s\in S\})$ is connected. It is known that the problem is NPhard. We provide an algorithm to compute exactly an optimal solution in $O(f(k) n \log n)$ time, for a computable function $f(\cdot)$. This implies that the problem is FPT when parameterized by $k$. The best previous algorithm is using $O((k!)^k k^{k+1}\cdot n^{2k})$ time and computes the solution up to fixed precision.  [17] arXiv:2303.10030 (crosslist from cs.IT) [pdf, ps, other]

Title: How robust is randomized blind deconvolution via nuclear norm minimization against adversarial noise?Subjects: Information Theory (cs.IT); Machine Learning (cs.LG); Signal Processing (eess.SP); Optimization and Control (math.OC)
In this paper, we study the problem of recovering two unknown signals from their convolution, which is commonly referred to as blind deconvolution. Reformulation of blind deconvolution as a lowrank recovery problem has led to multiple theoretical recovery guarantees in the past decade due to the success of the nuclear norm minimization heuristic. In particular, in the absence of noise, exact recovery has been established for sufficiently incoherent signals contained in lowerdimensional subspaces. However, if the convolution is corrupted by additive bounded noise, the stability of the recovery problem remains much less understood. In particular, existing reconstruction bounds involve large dimension factors and therefore fail to explain the empirical evidence for dimensionindependent robustness of nuclear norm minimization. Recently, theoretical evidence has emerged for illposed behavior of lowrank matrix recovery for sufficiently small noise levels. In this work, we develop improved recovery guarantees for blind deconvolution with adversarial noise which exhibit squareroot scaling in the noise level. Hence, our results are consistent with existing counterexamples which speak against linear scaling in the noise level as demonstrated for related lowrank matrix recovery problems.
 [18] arXiv:2303.10154 (crosslist from cs.NE) [pdf, other]

Title: Epigenetics Algorithms: SelfReinforcementAttention mechanism to regulate chromosomes expressionComments: submitted for GECCO conferenceSubjects: Neural and Evolutionary Computing (cs.NE); Machine Learning (cs.LG); Optimization and Control (math.OC)
Genetic algorithms are a wellknown example of bioinspired heuristic methods. They mimic natural selection by modeling several operators such as mutation, crossover, and selection. Recent discoveries about Epigenetics regulation processes that occur "on top of" or "in addition to" the genetic basis for inheritance involve changes that affect and improve gene expression. They raise the question of improving genetic algorithms (GAs) by modeling epigenetics operators. This paper proposes a new epigenetics algorithm that mimics the epigenetics phenomenon known as DNA methylation. The novelty of our epigenetics algorithms lies primarily in taking advantage of attention mechanisms and deep learning, which fits well with the genes enhancing/silencing concept. The paper develops theoretical arguments and presents empirical studies to exhibit the capability of the proposed epigenetics algorithms to solve more complex problems efficiently than has been possible with simple GAs; for example, facing two Nonconvex (multipeaks) optimization problems as presented in this paper, the proposed epigenetics algorithm provides good performances and shows an excellent ability to overcome the lack of local optimum and thus find the global optimum.
 [19] arXiv:2303.10165 (crosslist from cs.LG) [pdf, other]

Title: Optimal HorizonFree RewardFree Exploration for Linear Mixture MDPsComments: 37 pages, 1 figure, 2 tablesSubjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)
We study rewardfree reinforcement learning (RL) with linear function approximation, where the agent works in two phases: (1) in the exploration phase, the agent interacts with the environment but cannot access the reward; and (2) in the planning phase, the agent is given a reward function and is expected to find a nearoptimal policy based on samples collected in the exploration phase. The sample complexities of existing rewardfree algorithms have a polynomial dependence on the planning horizon, which makes them intractable for long planning horizon RL problems. In this paper, we propose a new rewardfree algorithm for learning linear mixture Markov decision processes (MDPs), where the transition probability can be parameterized as a linear combination of known feature mappings. At the core of our algorithm is uncertaintyweighted valuetargeted regression with explorationdriven pseudoreward and a highorder moment estimator for the aleatoric and epistemic uncertainties. When the total reward is bounded by $1$, we show that our algorithm only needs to explore $\tilde O( d^2\varepsilon^{2})$ episodes to find an $\varepsilon$optimal policy, where $d$ is the dimension of the feature mapping. The sample complexity of our algorithm only has a polylogarithmic dependence on the planning horizon and therefore is ``horizonfree''. In addition, we provide an $\Omega(d^2\varepsilon^{2})$ sample complexity lower bound, which matches the sample complexity of our algorithm up to logarithmic factors, suggesting that our algorithm is optimal.
Replacements for Mon, 20 Mar 23
 [20] arXiv:2202.01229 (replaced) [pdf, ps, other]

Title: DataDriven Behaviour Estimation in Parametric GamesComments: 8 pages, 4 figures, 1 tables + 1 appendixSubjects: Optimization and Control (math.OC); Computer Science and Game Theory (cs.GT); Multiagent Systems (cs.MA); Systems and Control (eess.SY)
 [21] arXiv:2206.04113 (replaced) [pdf, other]

Title: PushPull with Device SamplingComments: In IEEE Transactions on Automatic ControlSubjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
 [22] arXiv:2209.02096 (replaced) [pdf, other]

Title: PassivelySafe and Robust MultiAgent Optimal Control with Application to Distributed Space SystemsComments: Submitted to AIAA Journal of Guidance, Control and DynamicsSubjects: Optimization and Control (math.OC)
 [23] arXiv:2209.12078 (replaced) [pdf, other]

Title: On the Convergence Rates of A Nash Equilibrium Seeking Algorithm in Potential Games with Information DelaysSubjects: Optimization and Control (math.OC)
 [24] arXiv:2303.07450 (replaced) [pdf, other]

Title: ZOJADE: Zerothorder CurvatureAware MultiAgent Convex OptimizationComments: Minor updates, without substantial variations in the content. We mainly changed the abstract and moved the statement of Theorem 1 to the Main Result sectionSubjects: Optimization and Control (math.OC); Dynamical Systems (math.DS)
 [25] arXiv:2303.07824 (replaced) [pdf, other]

Title: Linearquadratic meanfieldtype difference games with coupled affine inequality constraintsSubjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
 [26] arXiv:2303.07885 (replaced) [pdf, other]

Title: Optimal Role Assignment for Multiplayer ReachAvoid Differential Games in 3D SpaceSubjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
 [27] arXiv:2303.09454 (replaced) [pdf, other]

Title: Towards CO2 valorization in a multi remote renewable energy hub frameworkSubjects: Optimization and Control (math.OC)
 [28] arXiv:2209.07040 (replaced) [pdf, other]

Title: LearningBased Adaptive Control for Stochastic Linear Systems with Input ConstraintsComments: 16 pages, 2 figures, accepted at IEEE Control Systems LettersSubjects: Systems and Control (eess.SY); Machine Learning (cs.LG); Optimization and Control (math.OC)
 [29] arXiv:2303.00055 (replaced) [pdf, other]

Title: Learning timescales in twolayers neural networksComments: 54 pages, 9 figuresSubjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)
[ showing up to 2000 entries per page: fewer  more ]
Disable MathJax (What is MathJax?)
Links to: arXiv, form interface, find, math, recent, 2303, contact, help (Access key information)