We gratefully acknowledge support from
the Simons Foundation and member institutions.

Optimization and Control

New submissions

[ total of 55 entries: 1-55 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Tue, 22 Sep 20

[1]  arXiv:2009.09062 [pdf, ps, other]
Title: Economic inexact restoration for derivative-free expensive function minimization and applications
Subjects: Optimization and Control (math.OC)

The Inexact Restoration approach has proved to be an adequate tool for handling the problem of minimizing an expensive function within an arbitrary feasible set by using different degrees of precision in the objective function. The Inexact Restoration framework allows one to obtain suitable convergence and complexity results for an approach that rationally combines low- and high-precision evaluations. In the present research, it is recognized that many problems with expensive objective functions are nonsmooth and, sometimes, even discontinuous. Having this in mind, the Inexact Restoration approach is extended to the nonsmooth or discontinuous case. Although optimization phases that rely on smoothness cannot be used in this case, basic convergence and complexity results are recovered. A derivative-free optimization phase is defined and the subproblems that arise at this phase are solved using a regularization approach that take advantage of different notions of stationarity. The new methodology is applied to the problem of reproducing a controlled experiment that mimics the failure of a dam.

[2]  arXiv:2009.09135 [pdf, other]
Title: Resource-Aware Discretization of Accelerated Optimization Flows
Subjects: Optimization and Control (math.OC)

This paper tackles the problem of discretizing accelerated optimization flows while retaining their convergence properties. Inspired by the success of resource-aware control in developing efficient closed-loop feedback implementations on digital systems, we view the last sampled state of the system as the resource to be aware of. The resulting variable-stepsize discrete-time algorithms retain by design the desired decrease of the Lyapunov certificate of their continuous-time counterparts. Our algorithm design employs various concepts and techniques from resource-aware control that, in the present context, have interesting parallelisms with the discrete-time implementation of optimization algorithms. These include derivative- and performance-based triggers to monitor the evolution of the Lyapunov function as a way of determining the algorithm stepsize, exploiting sampled information to enhance algorithm performance, and employing high-order holds using more accurate integrators of the original dynamics. Throughout the paper, we illustrate our approach on a newly introduced continuous-time dynamics termed heavy-ball dynamics with displaced gradient, but the ideas proposed here have broad applicability to other globally asymptotically stable flows endowed with a Lyapunov certificate.

[3]  arXiv:2009.09264 [pdf, ps, other]
Title: Distributionally Robust Variance Minimization: Tight Variance Bounds over $f$-Divergence Neighborhoods
Authors: Jeremiah Birrell
Comments: 19 pages
Subjects: Optimization and Control (math.OC); Probability (math.PR)

Distributionally robust optimization (DRO) is a widely used framework for optimizing objective functionals in the presence of both randomness and model-form uncertainty. A key step in the practical solution of many DRO problems is a tractable reformulation of the optimization over the chosen model ambiguity set, which is generally infinite dimensional. Previous works have solved this problem in the case where the objective functional is an expected value. In this paper we study objective functionals that are the sum of an expected value and a variance penalty term. We prove that the corresponding variance-penalized DRO problem over an $f$-divergence neighborhood can be reformulated as a finite-dimensional convex optimization problem. This result also provides tight uncertainty quantification bounds on the variance.

[4]  arXiv:2009.09366 [pdf, other]
Title: Multipliers for nonlinearities with monotone bounds
Comments: 9 pages, 6 figures
Subjects: Optimization and Control (math.OC)

We consider Lurye (sometimes written Lur'e) systems whose nonlinear operator is characterised by a possibly multivalued nonlinearity that is bounded above and below by monotone functions. Stability can be established using a sub-class of the Zames-Falb multipliers. The result generalises similar approaches in the literature. Appropriate multipliers can be found using convex searches. Because the multipliers can be used for multivalued nonlinearities they can be applied after loop transformation. We illustrate the power of the new mutlipliers with two examples, one in continuous time and one in discrete time: in the first the approach is shown to outperform available stability tests in the literature; in the second we focus on the special case for asymmetric saturation with important consequences for systems with non-zero steady state exogenous signals.

[5]  arXiv:2009.09419 [pdf, other]
Title: Generalized Mittag-Leffler stability of fractional impulsive differential system
Subjects: Optimization and Control (math.OC)

This paper establishes sufficient conditions for Generalized Mittag-Leffler stability of a class of impulsive fractional differential system with Hilfer order. The analysis extends through both, instantaneous and non-instantaneous impulsive conditions. The theory utilizes continuous Lyapunov functions, to ascertain the stability conditions. An example is given discussing for various ranges.

[6]  arXiv:2009.09554 [pdf, other]
Title: Chance-Constrained Optimal Covariance Steering with Iterative Risk Allocation
Subjects: Optimization and Control (math.OC)

This paper extends the optimal covariance steering problem for linear stochastic systems subject to chance constraints to account for optimal risk allocation. Previous works have assumed a uniform risk allocation to cast the optimal control problem as a semi-definite program (SDP), which can be solved efficiently using standard SDP solvers. We adopt an Iterative Risk Allocation (IRA) formalism, which uses a two-stage approach to solve the optimal risk allocation problem for covariance steering. The upper-stage of IRA optimizes the risk, which is proved to be a convex problem, while the lower-stage optimizes the controller with the new constraints. This is done iteratively so as to find the optimal risk allocation that achieves the lowest total cost. The proposed framework results in solutions that tend to maximize the terminal covariance, while still satisfying the chance constraints, thus leading to less conservative solutions than previous methodologies. We also introduce two novel convex relaxation methods to approximate quadratic chance constraints as second-order cone constraints. We finally demonstrate the approach to a spacecraft rendezvous problem and compare the results.

[7]  arXiv:2009.09650 [pdf]
Title: Exploring Collaborative and Multidisciplinary Aircraft Optimization through the AGILE Academy Challenge -- A case study for an aircraft auxiliary solar power system
Comments: 19th astronautics conference of the Canadian Aeronautics and Space Institute, Jun 2019, Laval, Canada
Subjects: Optimization and Control (math.OC)

Reduction in aircraft emission is a main driver for the development of more efficient aircraft and enabling technologies are reaching operational maturity. Aircraft manufacturers need an efficient product development process to capture these emergent technologies and develop new aircraft concepts in order to stay competitive. Presently, the aircraft development process is cross organizational, and harnesses distributed, heterogeneous knowledge and expertise. Large scale multidisciplinary studies, involving disciplinary experts and specific tools are required to evaluate different aircraft concepts. These MultiDisciplinary Aircraft Optimization (MDAO) processes are difficult to deploy as they involve cross-organizational collaboration and harmonization of processes, tools and even vocabulary. Moreover, difficulties in collaborative decision making, reconfiguration and integration of new requirements and competencies often precludes the development of an optimal solution within the available time. To address these challenges, the AGILE project is an effort within the European Union funded Horizon 2020 project to reduce aircraft development time by developing tools and processes that enable efficient, collaborative aircraft design. This paper presents the work performed as part of the AGILE academy challenge where students were tasked with developing and solving an aircraft MDAO problem using the AGILE toolchain. Each team consisted of students from various universities around the globe and had expertise in multiple design domains. An MDAO study is presented that utilizes the AGILE toolchain to investigate the feasibility of implementing an auxiliary solar power system on a baseline aircraft. The steps performed are: (1) definition of a multidisciplinary design problem, (2) development of collaborative workflow and (3) optimization using surrogate models. Through the case study, a novel technology concept is investigated and the efficacy of the AGILE toolchain in facilitating a MDAO is analyzed.

[8]  arXiv:2009.09864 [pdf, ps, other]
Title: Indefinite Linear Quadratic Mean Field Social Control Problems with Multiplicative Noise
Comments: arXiv admin note: text overlap with arXiv:1904.07522
Subjects: Optimization and Control (math.OC)

This paper studies uniform stabilization and social optimality for linear quadratic (LQ) mean field control problems with multiplicative noise, where agents are coupled via dynamics and individual costs. The state and control weights in cost functionals are not limited to be positive semi-definite. This leads to an indefinite LQ mean field control problem, which may still be well-posed due to deep nature of multiplicative noise. We first obtain a set of forward-backward stochastic differential equations (FBSDEs) from variational analysis, and construct a feedback control by decoupling the FBSDEs. By using solutions to two Riccati equations, we design a set of decentralized control laws, which is further shown to be asymptotically social optimal. Some equivalent conditions are given for uniform stabilization of the systems with the help of linear matrix inequalities. A numerical example is given to illustrate the effectiveness of the proposed control laws.

[9]  arXiv:2009.09894 [pdf, other]
Title: Mean-field optimal control for biological pattern formation
Subjects: Optimization and Control (math.OC); Analysis of PDEs (math.AP); Numerical Analysis (math.NA)

We propose a mean-field optimal control problem for the parameter identification of a given pattern. The cost functional is based on the Wasserstein distance between the probability measures of the modeled and the desired patterns. The first-order optimality conditions corresponding to the optimal control problem are derived using a Lagrangian approach on the mean-field level. Based on these conditions we propose a gradient descent method to identify relevant parameters such as angle of rotation and force scaling which may be spatially inhomogeneous. We discretize the first-order optimality conditions in order to employ the algorithm on the particle level. Moreover, we prove a rate for the convergence of the controls as the number of particles used for the discretization tends to infinity. Numerical results for the spatially homogeneous case demonstrate the feasibility of the approach.

[10]  arXiv:2009.09908 [pdf, other]
Title: Zeroth-Order Algorithms for Smooth Saddle-Point Problems
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG)

In recent years, the importance of saddle-point problems in machine learning has increased. This is due to the popularity of GANs. In this paper, we solve stochastic smooth (strongly) convex-concave saddle-point problems using zeroth-order oracles. Theoretical analysis shows that in the case when the optimization set is a simplex, we lose only $\log n$ times in the stochastic convergence term. The paper also provides an approach to solving saddle-point problems, when the oracle for one of the variables has zero order, and for the second - first order. Subsequently, we implement zeroth-order and 1/2th-order methods to solve practical problems.

Cross-lists for Tue, 22 Sep 20

[11]  arXiv:2009.09043 (cross-list from cs.LG) [pdf, other]
Title: Cross-Entropy Method Variants for Optimization
Authors: Robert J. Moss
Comments: 9 pages, 6 figures, code available at this https URL
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

The cross-entropy (CE) method is a popular stochastic method for optimization due to its simplicity and effectiveness. Designed for rare-event simulations where the probability of a target event occurring is relatively small, the CE-method relies on enough objective function calls to accurately estimate the optimal parameters of the underlying distribution. Certain objective functions may be computationally expensive to evaluate, and the CE-method could potentially get stuck in local minima. This is compounded with the need to have an initial covariance wide enough to cover the design space of interest. We introduce novel variants of the CE-method to address these concerns. To mitigate expensive function calls, during optimization we use every sample to build a surrogate model to approximate the objective function. The surrogate model augments the belief of the objective function with less expensive evaluations. We use a Gaussian process for our surrogate model to incorporate uncertainty in the predictions which is especially helpful when dealing with sparse data. To address local minima convergence, we use Gaussian mixture models to encourage exploration of the design space. We experiment with evaluation scheduling techniques to reallocate true objective function calls earlier in the optimization when the covariance is the largest. To test our approach, we created a parameterized test objective function with many local minima and a single global minimum. Our test function can be adjusted to control the spread and distinction of the minima. Experiments were run to stress the cross-entropy method variants and results indicate that the surrogate model-based approach reduces local minima convergence using the same number of function evaluations.

[12]  arXiv:2009.09055 (cross-list from eess.SY) [pdf, other]
Title: Prediction and Optimal Feedback Steering of Probability Density Functions for Safe Automated Driving
Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)

We propose a stochastic prediction-control framework to promote safety in automated driving by directly controlling the joint state probability density functions (PDFs) subject to the vehicle dynamics via trajectory-level state feedback. To illustrate the main ideas, we focus on a multi-lane highway driving scenario although the proposed framework can be adapted to other contexts. The computational pipeline consists of a PDF prediction layer, followed by a PDF control layer. The prediction layer performs moving horizon nonparametric forecasts for the ego and the non-ego vehicles' stochastic states, and thereby derives safe target PDF for the ego. The latter is based on the forecasted collision probabilities, and promotes the probabilistic safety for the ego. The PDF control layer designs a feedback that optimally steers the joint state PDF subject to the controlled ego dynamics while satisfying the endpoint PDF constraints. Our computation for the PDF prediction layer leverages the structure of the controlled Liouville PDE to evolve the joint PDF values, as opposed to empirically approximating the PDFs. Our computation for the PDF control layer leverages the differential flatness structure in vehicle dynamics. We harness recent theoretical and algorithmic advances in optimal mass transport, and the Schr\"{o}dinger bridge. The numerical simulations illustrate the efficacy of the proposed framework.

[13]  arXiv:2009.09100 (cross-list from eess.SY) [pdf, other]
Title: Safety-Critical Kinematic Control of Robotic Systems
Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)

Over the decades, kinematic controllers have proven to be practically useful for applications like set-point and trajectory tracking in robotic systems. To this end, we formulate a novel safety-critical paradigm for kinematic control in this paper. In particular, we extend the methodology of control barrier functions (CBFs) to kinematic equations governing robotic systems. We demonstrate a purely kinematic implementation of a velocity-based CBF, and subsequently introduce a formulation that guarantees safety at the level of dynamics. This is achieved through a new form CBFs that incorporate kinetic energy with the classical forms, thereby minimizing model dependence and conservativeness. The approach is then extended to underactuated systems. This method and the purely kinematic implementation are demonstrated in simulation on two robotic platforms: a 6-DOF robotic manipulator, and a cart-pole system.

[14]  arXiv:2009.09288 (cross-list from cs.DS) [pdf, ps, other]
Title: On combinatorial optimization for dominating sets (literature survey, new models)
Authors: Mark Sh. Levin
Comments: 17 pages, figures 6, table 5
Subjects: Data Structures and Algorithms (cs.DS); Artificial Intelligence (cs.AI); Optimization and Control (math.OC)

The paper focuses on some versions of connected dominating set problems: basic problems and multicriteria problems. A literature survey on basic problem formulations and solving approaches is presented. The basic connected dominating set problems are illustrated by simplifyed numerical examples. New integer programming formulations of dominating set problems (with multiset estimates) are suggested.

[15]  arXiv:2009.09334 (cross-list from cs.AI) [pdf]
Title: Quantifying Uncertainty in Risk Assessment using Fuzzy Theory
Subjects: Artificial Intelligence (cs.AI); Optimization and Control (math.OC)

Risk specialists are trying to understand risk better and use complex models for risk assessment, while many risks are not yet well understood. The lack of empirical data and complex causal and outcome relationships make it difficult to estimate the degree to which certain risk types are exposed. Traditional risk models are based on classical set theory. In comparison, fuzzy logic models are built on fuzzy set theory and are useful for analyzing risks with insufficient knowledge or inaccurate data. Fuzzy logic systems help to make large-scale risk management frameworks more simple. For risks that do not have an appropriate probability model, a fuzzy logic system can help model the cause and effect relationships, assess the level of risk exposure, rank key risks in a consistent way, and consider available data and experts'opinions. Besides, in fuzzy logic systems, some rules explicitly explain the connection, dependence, and relationships between model factors. This can help identify risk mitigation solutions. Resources can be used to mitigate risks with very high levels of exposure and relatively low hedging costs. Fuzzy set and fuzzy logic models can be used with Bayesian and other types of method recognition and decision models, including artificial neural networks and decision tree models. These developed models have the potential to solve difficult risk assessment problems. This research paper explores areas in which fuzzy logic models can be used to improve risk assessment and risk decision making. We will discuss the methodology, framework, and process of using fuzzy logic systems in risk assessment.

[16]  arXiv:2009.09431 (cross-list from math.ST) [pdf, other]
Title: Lagrangian and Hamiltonian Mechanics for Probabilities on the Statistical Manifold
Comments: 39 pages, 5 figures
Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); High Energy Physics - Theory (hep-th); Optimization and Control (math.OC); Machine Learning (stat.ML)

We provide an Information-Geometric formulation of Classical Mechanics on the Riemannian manifold of probability distributions, which is an affine manifold endowed with a dually-flat connection. In a non-parametric formalism, we consider the full set of positive probability functions on a finite sample space, and we provide a specific expression for the tangent and cotangent spaces over the statistical manifold, in terms of a Hilbert bundle structure that we call the Statistical Bundle. In this setting, we compute velocities and accelerations of a one-dimensional statistical model using the canonical dual pair of parallel transports and define a coherent formalism for Lagrangian and Hamiltonian mechanics on the bundle. Finally, in a series of examples, we show how our formalism provides a consistent framework for accelerated natural gradient dynamics on the probability simplex, paving the way for direct applications in optimization, game theory and neural networks.

[17]  arXiv:2009.09472 (cross-list from eess.SY) [pdf, other]
Title: Multi-Objective Optimization of Distribution Networks via Daily Reconfiguration
Subjects: Systems and Control (eess.SY); Dynamical Systems (math.DS); Optimization and Control (math.OC)

This paper presents a comprehensive approach to improve the daily performance of an active distribution network (ADN), which includes renewable resources and responsive load (RL), using distributed network reconfiguration (DNR). Optimization objectives in this work can be described as (i) reducing active losses, (ii) improving the voltage profile, (iii) improving the network reliability, and (iv) minimizing distribution network operation costs. The suggested approach takes into account the probability of renewable resource failure, given the information collected from their initial state at the beginning of every day, in solving the optimization problem. Furthermore, solar radiation variations are estimated based on past historical data and the impact of the performance of renewable sources such as photovoltaic (PV) is determined hourly based on the Markov model. Since the number of reconfiguration scenarios is very high, stochastic DNR (SDNR) based on the probability distance method is employed to shrink the scenarios set. At the final stage, an improved crow search algorithm (ICSA) is introduced to find the optimal scenario. The effectiveness of the suggested method is verified for the IEEE 33-bus radial distribution system as a case study.

[18]  arXiv:2009.09498 (cross-list from eess.IV) [pdf, other]
Title: Distributed optimization with tunable learned priors for robust ptycho-tomography
Subjects: Image and Video Processing (eess.IV); Optimization and Control (math.OC)

Joint ptycho-tomography is a powerful computational imaging framework to recover the refractive properties of a 3D object while relaxing the requirements for probe overlap that is common in conventional phase retrieval. We use an augmented Lagrangian scheme for formulating the constrained optimization problem and employ an alternating direction method of multipliers (ADMM) for the joint solution. ADMM allows the problem to be split into smaller and computationally more manageable subproblems: ptychographic phase retrieval, tomographic reconstruction, and regularization of the solution. We extend our ADMM framework with plug-and-play (PnP) denoisers by replacing the regularization subproblem with a general denoising operator based on machine learning. While the PnP framework enables integrating such learned priors as denoising operators, tuning of the denoiser prior remains challenging. To overcome this challenge, we propose a tuning parameter to control the effect of the denoiser and to accelerate the solution. In our simulations, we demonstrate that our proposed framework with parameter tuning and learned priors generates high-quality reconstructions under limited and noisy measurement data.

[19]  arXiv:2009.09511 (cross-list from eess.SY) [pdf, other]
Title: Safety-Critical Online Control with Adversarial Disturbances
Comments: Paper accepted to the Conference on Decision and Control (CDC), 2020
Subjects: Systems and Control (eess.SY); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Optimization and Control (math.OC)

This paper studies the control of safety-critical dynamical systems in the presence of adversarial disturbances. We seek to synthesize state-feedback controllers to minimize a cost incurred due to the disturbance, while respecting a safety constraint. The safety constraint is given by a bound on an H-inf norm, while the cost is specified as an upper bound on the H-2 norm of the system. We consider an online setting where costs at each time are revealed only after the controller at that time is chosen. We propose an iterative approach to the synthesis of the controller by solving a modified discrete-time Riccati equation. Solutions of this equation enforce the safety constraint. We compare the cost of this controller with that of the optimal controller when one has complete knowledge of disturbances and costs in hindsight. We show that the regret function, which is defined as the difference between these costs, varies logarithmically with the time horizon. We validate our approach on a process control setup that is subject to two kinds of adversarial attacks.

[20]  arXiv:2009.09623 (cross-list from cs.CC) [pdf, other]
Title: The Complexity of Constrained Min-Max Optimization
Subjects: Computational Complexity (cs.CC); Machine Learning (cs.LG); Optimization and Control (math.OC)

Despite its important applications in Machine Learning, min-max optimization of nonconvex-nonconcave objectives remains elusive. Not only are there no known first-order methods converging even to approximate local min-max points, but the computational complexity of identifying them is also poorly understood. In this paper, we provide a characterization of the computational complexity of the problem, as well as of the limitations of first-order methods in constrained min-max optimization problems with nonconvex-nonconcave objectives and linear constraints.
As a warm-up, we show that, even when the objective is a Lipschitz and smooth differentiable function, deciding whether a min-max point exists, in fact even deciding whether an approximate min-max point exists, is NP-hard. More importantly, we show that an approximate local min-max point of large enough approximation is guaranteed to exist, but finding one such point is PPAD-complete. The same is true of computing an approximate fixed point of Gradient Descent/Ascent.
An important byproduct of our proof is to establish an unconditional hardness result in the Nemirovsky-Yudin model. We show that, given oracle access to some function $f : P \to [-1, 1]$ and its gradient $\nabla f$, where $P \subseteq [0, 1]^d$ is a known convex polytope, every algorithm that finds a $\varepsilon$-approximate local min-max point needs to make a number of queries that is exponential in at least one of $1/\varepsilon$, $L$, $G$, or $d$, where $L$ and $G$ are respectively the smoothness and Lipschitzness of $f$ and $d$ is the dimension. This comes in sharp contrast to minimization problems, where finding approximate local minima in the same setting can be done with Projected Gradient Descent using $O(L/\varepsilon)$ many queries. Our result is the first to show an exponential separation between these two fundamental optimization problems.

[21]  arXiv:2009.09778 (cross-list from eess.SY) [pdf, ps, other]
Title: Computation of Parameter Dependent Robust Invariant Sets for LPV Models with Guaranteed Performance
Comments: 32 pages, 5 figures
Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)

This paper presents an iterative algorithm to compute a Robust Control Invariant (RCI) set, along with an invariance-inducing control law, for Linear Parameter-Varying (LPV) systems. As the real-time measurements of the scheduling parameters are typically available, in the presented formulation, we allow the RCI set description along with the invariance-inducing controller to be scheduling parameter dependent. The considered formulation thus leads to parameter-dependent conditions for the set invariance, which are replaced by sufficient Linear Matrix Inequality (LMI) conditions via Polya's relaxation. These LMI conditions are then combined with a novel volume maximization approach in a Semidefinite Programming (SDP) problem, which aims at computing the desirably large RCI set. In addition to ensuring invariance, it is also possible to guarantee performance within the RCI set by imposing a chosen quadratic performance level as an additional constraint in the SDP problem. The reported numerical example shows that the presented iterative algorithm can generate invariant sets which are larger than the maximal RCI sets computed without exploiting scheduling parameter information.

[22]  arXiv:2009.09835 (cross-list from cs.LG) [pdf, other]
Title: Hybrid Stochastic-Deterministic Minibatch Proximal Gradient: Less-Than-Single-Pass Optimization with Nearly Optimal Generalization
Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Optimization and Control (math.OC); Machine Learning (stat.ML)

Stochastic variance-reduced gradient (SVRG) algorithms have been shown to work favorably in solving large-scale learning problems. Despite the remarkable success, the stochastic gradient complexity of SVRG-type algorithms usually scales linearly with data size and thus could still be expensive for huge data. To address this deficiency, we propose a hybrid stochastic-deterministic minibatch proximal gradient (HSDMPG) algorithm for strongly-convex problems that enjoys provably improved data-size-independent complexity guarantees. More precisely, for quadratic loss $F(\theta)$ of $n$ components, we prove that HSDMPG can attain an $\epsilon$-optimization-error $\mathbb{E}[F(\theta)-F(\theta^*)]\leq\epsilon$ within $\mathcal{O}\Big(\frac{\kappa^{1.5}\epsilon^{0.75}\log^{1.5}(\frac{1}{\epsilon})+1}{\epsilon}\wedge\Big(\kappa \sqrt{n}\log^{1.5}\big(\frac{1}{\epsilon}\big)+n\log\big(\frac{1}{\epsilon}\big)\Big)\Big)$ stochastic gradient evaluations, where $\kappa$ is condition number. For generic strongly convex loss functions, we prove a nearly identical complexity bound though at the cost of slightly increased logarithmic factors. For large-scale learning problems, our complexity bounds are superior to those of the prior state-of-the-art SVRG algorithms with or without dependence on data size. Particularly, in the case of $\epsilon=\mathcal{O}\big(1/\sqrt{n}\big)$ which is at the order of intrinsic excess error bound of a learning model and thus sufficient for generalization, the stochastic gradient complexity bounds of HSDMPG for quadratic and generic loss functions are respectively $\mathcal{O} (n^{0.875}\log^{1.5}(n))$ and $\mathcal{O} (n^{0.875}\log^{2.25}(n))$, which to our best knowledge, for the first time achieve optimal generalization in less than a single pass over data. Extensive numerical results demonstrate the computational advantages of our algorithm over the prior ones.

[23]  arXiv:2009.09946 (cross-list from cs.GT) [pdf, other]
Title: Optimal Targeting in Super-Modular Games
Subjects: Computer Science and Game Theory (cs.GT); Multiagent Systems (cs.MA); Systems and Control (eess.SY); Optimization and Control (math.OC)

We study an optimal targeting problem for super-modular games with binary actions and finitely many players. The considered problem consists in the selection of a subset of players of minimum size such that, when the actions of these players are forced to a controlled value while the others are left to repeatedly play a best response action, the system will converge to the greatest Nash equilibrium of the game. Our main contributions consist in showing that the problem is NP-complete and in proposing an efficient iterative algorithm with provable convergence properties for its solution. We discuss in detail the special case of network coordination games and its relation with the notion of cohesiveness. Finally, we show with simulations the strength of our approach with respect to naive heuristics based on classical network centrality measures.

[24]  arXiv:2009.10020 (cross-list from eess.SY) [pdf, other]
Title: Imitation dynamics in population games on community networks
Comments: 12 pages, 5 figures. Under review
Subjects: Systems and Control (eess.SY); Computer Science and Game Theory (cs.GT); Dynamical Systems (math.DS); Optimization and Control (math.OC)

We study the asymptotic behavior of deterministic, continuous-time imitation dynamics for population games over networks. The basic assumption of this learning mechanism -- encompassing the replicator dynamics -- is that players belonging to a single population exchange information through pairwise interactions, whereby they get aware of the actions played by the other players and the corresponding rewards. Using this information, they can revise their current action, imitating the one of the players they interact with. The pattern of interactions regulating the learning process is determined by a community structure. First, the set of equilibrium points of such network imitation dynamics is characterized. Second, for the class of potential games and for undirected and connected community networks, global asymptotic convergence is proved. In particular, our results guarantee convergence to a Nash equilibrium from every fully supported initial population state in the special case when the Nash equilibria are isolated and fully supported. Examples and numerical simulations are offered to validate the theoretical results and counterexamples are discussed for scenarios when the assumptions on the community structure are not verified.

[25]  arXiv:2009.10049 (cross-list from q-bio.PE) [pdf, other]
Title: Optimal Drug Regimen and Combined Drug Therapy and its Efficacy in the Treatment of COVID-19 : An Within-Host Modeling Study
Comments: 16 pages, 13 figures
Subjects: Populations and Evolution (q-bio.PE); Dynamical Systems (math.DS); Optimization and Control (math.OC)

The COVID-19 pandemic has resulted in more than 30.35 million infections and 9, 50, 625 deaths in 212 countries over the last few months. Different drug intervention acting at multiple stages of pathogenesis of COVID-19 can substantially reduce the infection induced mortality. The current within-host mathematical modeling studies deals with the optimal drug regimen and the efficacy of combined therapy in treatment of COVID-19. The drugs/interventions considered include Arbidol, Remdesivir, Inteferon (INF) and Lopinavir/Ritonavir. It is concluded that these drug interventions when administered individually or in combination reduce the infected cells and viral load. Four scenarios involving administration of single drug intervention, two drug interventions, three drug interventions and all the four have been discussed. In all these scenarios the optimal drug regimen is proposed based on two methods. In the first method these medical interventions are modeled as control interventions and a corresponding objective function and optimal control problem is formulated. In this setting the optimal drug regimen is proposed. Later using the the comparative effectiveness method the optimal drug regimen is proposed based on basic reproduction number and viral load. The average infected cell count and viral load decreased the most when all the four interventions were applied together. On the other hand the average susceptible cell count decreased the best when Arbidol alone was administered. The basic reproduction number and viral count decreased the best when all the four interventions were applied together reinstating the fact obtained earlier in the optimal control setting. These findings may help physicians with decision making in treatment of life-threatening COVID-19 pneumonia.

Replacements for Tue, 22 Sep 20

[26]  arXiv:1802.09022 (replaced) [pdf, other]
Title: An Accelerated Method for Derivative-Free Smooth Stochastic Convex Optimization
Subjects: Optimization and Control (math.OC); Computational Complexity (cs.CC)
[27]  arXiv:1804.02394 (replaced) [pdf, other]
Title: An Accelerated Directional Derivative Method for Smooth Stochastic Convex Optimization
Comments: arXiv admin note: text overlap with arXiv:1802.09022
Subjects: Optimization and Control (math.OC); Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS)
[28]  arXiv:1806.10868 (replaced) [pdf, other]
Title: A Two-Step Pre-Processing for Semidefinite Programming
Journal-ref: The 59th Conference on Decision and Control (CDC 2020)
Subjects: Optimization and Control (math.OC); Numerical Analysis (math.NA)
[29]  arXiv:1901.06976 (replaced) [pdf, other]
Title: Admissibility of solution estimators for stochastic optimization
Subjects: Optimization and Control (math.OC); Statistics Theory (math.ST)
[30]  arXiv:1901.09233 (replaced) [pdf, other]
Title: Optimal majority threshold in a stochastic environment
Authors: Vitaly Malyshev
Comments: 21 pages, 10 figures
Subjects: Optimization and Control (math.OC)
[31]  arXiv:1902.10288 (replaced) [pdf, other]
Title: Clustering, factor discovery and optimal transport
Comments: Improved clarity of presentation
Subjects: Optimization and Control (math.OC); Statistics Theory (math.ST)
[32]  arXiv:1904.01368 (replaced) [pdf, ps, other]
Title: Consensus and Flocking in a Class of Cucker-Smale Systems under Communication Failures
Subjects: Optimization and Control (math.OC)
[33]  arXiv:1905.05660 (replaced) [pdf, ps, other]
Title: Finitely Convergent Deterministic and Stochastic Iterative Methods for Solving Convex Feasibility Problems
Subjects: Optimization and Control (math.OC)
[34]  arXiv:1906.01981 (replaced) [pdf, ps, other]
Title: Understanding Distributional Ambiguity via Non-robust Chance Constraint
Comments: 8 pages, 3 figures, Accepted for publication in ICAIF 2020
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Portfolio Management (q-fin.PM); Risk Management (q-fin.RM); Machine Learning (stat.ML)
[35]  arXiv:2001.00665 (replaced) [pdf, ps, other]
Title: Decentralized Langevin Dynamics
Subjects: Optimization and Control (math.OC); Information Theory (cs.IT)
[36]  arXiv:2001.08826 (replaced) [pdf, other]
Title: An $O(s^r)$-Resolution ODE Framework for Discrete-Time Optimization Algorithms and Applications to the Linear Convergence of Minimax Problems
Authors: Haihao Lu
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG)
[37]  arXiv:2002.12599 (replaced) [pdf, other]
Title: Computing mixed strategies equilibria in presence of switching costs by the solution of nonconvex QP problems
Subjects: Optimization and Control (math.OC)
[38]  arXiv:2004.03069 (replaced) [pdf, other]
Title: Nonparametric Estimation of Uncertainty Sets for Robust Optimization
Comments: 8 pages, 2 figures
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG)
[39]  arXiv:2005.02112 (replaced) [pdf, ps, other]
Title: Remote state estimation problem: towards the data-rate limit along the avenue of the second Lyapunov method
Subjects: Optimization and Control (math.OC); Dynamical Systems (math.DS)
[40]  arXiv:2005.07264 (replaced) [pdf, other]
Title: Fireshape: a shape optimization toolbox for Firedrake
Comments: 17 pages, 13 figures, 6 listings
Subjects: Optimization and Control (math.OC); Numerical Analysis (math.NA)
[41]  arXiv:2006.16781 (replaced) [pdf, ps, other]
Title: On the strong concavity of the dual function of an optimization problem
Authors: Vincent Guigues
Comments: arXiv admin note: text overlap with arXiv:1805.11732
Subjects: Optimization and Control (math.OC)
[42]  arXiv:2007.05809 (replaced) [pdf, other]
Title: Partial Pole Placement via Delay Action: A Python Software for Delayed Feedback Stabilizing Design
Subjects: Optimization and Control (math.OC)
[43]  arXiv:2007.15350 (replaced) [pdf, other]
Title: A deep learning algorithm for the stable manifolds of the Hamilton-Jacobi equations
Authors: Guoyuan Chen
Comments: Some mathematically rigorous asymptotic analysis is added in Section 3; Section 5 in the previous version is removed; The references and citations are revised
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
[44]  arXiv:2009.02638 (replaced) [pdf, ps, other]
Title: Exact SDP relaxations of quadratically constrained quadratic programs with forest structures
Subjects: Optimization and Control (math.OC)
[45]  arXiv:2009.04906 (replaced) [pdf, other]
Title: Linearly Convergent Gradient-Free Methods for Minimization of Symmetric Parabolic Approximation
Subjects: Optimization and Control (math.OC)
[46]  arXiv:1807.07476 (replaced) [pdf, other]
Title: Minimizing convex quadratic with variable precision conjugate gradients
Subjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
[47]  arXiv:1809.01572 (replaced) [pdf, ps, other]
Title: A Safe Computational Framework for Integer Programming applied to Chvátal's Conjecture
Subjects: Combinatorics (math.CO); Optimization and Control (math.OC)
[48]  arXiv:1903.08966 (replaced) [pdf, ps, other]
Title: A unified framework of SAGE and SONC polynomials and its duality theory
Comments: Revised version, 27 pages
Subjects: Algebraic Geometry (math.AG); Optimization and Control (math.OC)
[49]  arXiv:1909.04762 (replaced) [pdf, ps, other]
Title: A parametric version of LLL and some consequences: parametric shortest and closest vector problems
Comments: 20 pages. Accepted for publication in SIAM Journal on Discrete Mathematics. Revised title and opening paragraphs, slightly modified statement of Theorem 1.4, added explanation of some steps in Section 3, and implemented various minor improvements suggested by anonymous referees
Subjects: Combinatorics (math.CO); Optimization and Control (math.OC)
[50]  arXiv:1911.11167 (replaced) [pdf, ps, other]
Title: Manifold Gradient Descent Solves Multi-Channel Sparse Blind Deconvolution Provably and Efficiently
Authors: Laixi Shi, Yuejie Chi
Comments: submitted
Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Signal Processing (eess.SP); Optimization and Control (math.OC)
[51]  arXiv:2004.01298 (replaced) [pdf, other]
Title: Trajectory Optimization for Nonlinear Multi-Agent Systems using Decentralized Learning Model Predictive Control
Comments: 8 pages, 2 figures, submitted to Conference on Decision and Control 2020
Subjects: Systems and Control (eess.SY); Machine Learning (cs.LG); Optimization and Control (math.OC)
[52]  arXiv:2004.04355 (replaced) [pdf, other]
Title: Sensor placement minimizing the state estimation mean square error: Performance guarantees of greedy solutions
Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)
[53]  arXiv:2006.06889 (replaced) [src]
Title: Fast Objective and Duality Gap Convergence for Nonconvex-Strongly-Concave Min-Max Problems
Comments: There is critical error on the report of experimental results
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)
[54]  arXiv:2009.08111 (replaced) [pdf, other]
Title: The relationship between dynamic programming and active inference: the discrete, finite-horizon case
Subjects: Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Neurons and Cognition (q-bio.NC)
[55]  arXiv:2009.08433 (replaced) [pdf, other]
Title: On the global controllability of scalar conservation laws with boundary and source controls
Comments: 22 pages, 5 figures
Subjects: Analysis of PDEs (math.AP); Optimization and Control (math.OC)
[ total of 55 entries: 1-55 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, math, recent, 2009, contact, help  (Access key information)