Optimization and Control
New submissions
[ showing up to 2000 entries per page: fewer  more ]
New submissions for Tue, 22 Sep 20
 [1] arXiv:2009.09062 [pdf, ps, other]

Title: Economic inexact restoration for derivativefree expensive function minimization and applicationsSubjects: Optimization and Control (math.OC)
The Inexact Restoration approach has proved to be an adequate tool for handling the problem of minimizing an expensive function within an arbitrary feasible set by using different degrees of precision in the objective function. The Inexact Restoration framework allows one to obtain suitable convergence and complexity results for an approach that rationally combines low and highprecision evaluations. In the present research, it is recognized that many problems with expensive objective functions are nonsmooth and, sometimes, even discontinuous. Having this in mind, the Inexact Restoration approach is extended to the nonsmooth or discontinuous case. Although optimization phases that rely on smoothness cannot be used in this case, basic convergence and complexity results are recovered. A derivativefree optimization phase is defined and the subproblems that arise at this phase are solved using a regularization approach that take advantage of different notions of stationarity. The new methodology is applied to the problem of reproducing a controlled experiment that mimics the failure of a dam.
 [2] arXiv:2009.09135 [pdf, other]

Title: ResourceAware Discretization of Accelerated Optimization FlowsSubjects: Optimization and Control (math.OC)
This paper tackles the problem of discretizing accelerated optimization flows while retaining their convergence properties. Inspired by the success of resourceaware control in developing efficient closedloop feedback implementations on digital systems, we view the last sampled state of the system as the resource to be aware of. The resulting variablestepsize discretetime algorithms retain by design the desired decrease of the Lyapunov certificate of their continuoustime counterparts. Our algorithm design employs various concepts and techniques from resourceaware control that, in the present context, have interesting parallelisms with the discretetime implementation of optimization algorithms. These include derivative and performancebased triggers to monitor the evolution of the Lyapunov function as a way of determining the algorithm stepsize, exploiting sampled information to enhance algorithm performance, and employing highorder holds using more accurate integrators of the original dynamics. Throughout the paper, we illustrate our approach on a newly introduced continuoustime dynamics termed heavyball dynamics with displaced gradient, but the ideas proposed here have broad applicability to other globally asymptotically stable flows endowed with a Lyapunov certificate.
 [3] arXiv:2009.09264 [pdf, ps, other]

Title: Distributionally Robust Variance Minimization: Tight Variance Bounds over $f$Divergence NeighborhoodsAuthors: Jeremiah BirrellComments: 19 pagesSubjects: Optimization and Control (math.OC); Probability (math.PR)
Distributionally robust optimization (DRO) is a widely used framework for optimizing objective functionals in the presence of both randomness and modelform uncertainty. A key step in the practical solution of many DRO problems is a tractable reformulation of the optimization over the chosen model ambiguity set, which is generally infinite dimensional. Previous works have solved this problem in the case where the objective functional is an expected value. In this paper we study objective functionals that are the sum of an expected value and a variance penalty term. We prove that the corresponding variancepenalized DRO problem over an $f$divergence neighborhood can be reformulated as a finitedimensional convex optimization problem. This result also provides tight uncertainty quantification bounds on the variance.
 [4] arXiv:2009.09366 [pdf, other]

Title: Multipliers for nonlinearities with monotone boundsComments: 9 pages, 6 figuresSubjects: Optimization and Control (math.OC)
We consider Lurye (sometimes written Lur'e) systems whose nonlinear operator is characterised by a possibly multivalued nonlinearity that is bounded above and below by monotone functions. Stability can be established using a subclass of the ZamesFalb multipliers. The result generalises similar approaches in the literature. Appropriate multipliers can be found using convex searches. Because the multipliers can be used for multivalued nonlinearities they can be applied after loop transformation. We illustrate the power of the new mutlipliers with two examples, one in continuous time and one in discrete time: in the first the approach is shown to outperform available stability tests in the literature; in the second we focus on the special case for asymmetric saturation with important consequences for systems with nonzero steady state exogenous signals.
 [5] arXiv:2009.09419 [pdf, other]

Title: Generalized MittagLeffler stability of fractional impulsive differential systemSubjects: Optimization and Control (math.OC)
This paper establishes sufficient conditions for Generalized MittagLeffler stability of a class of impulsive fractional differential system with Hilfer order. The analysis extends through both, instantaneous and noninstantaneous impulsive conditions. The theory utilizes continuous Lyapunov functions, to ascertain the stability conditions. An example is given discussing for various ranges.
 [6] arXiv:2009.09554 [pdf, other]

Title: ChanceConstrained Optimal Covariance Steering with Iterative Risk AllocationSubjects: Optimization and Control (math.OC)
This paper extends the optimal covariance steering problem for linear stochastic systems subject to chance constraints to account for optimal risk allocation. Previous works have assumed a uniform risk allocation to cast the optimal control problem as a semidefinite program (SDP), which can be solved efficiently using standard SDP solvers. We adopt an Iterative Risk Allocation (IRA) formalism, which uses a twostage approach to solve the optimal risk allocation problem for covariance steering. The upperstage of IRA optimizes the risk, which is proved to be a convex problem, while the lowerstage optimizes the controller with the new constraints. This is done iteratively so as to find the optimal risk allocation that achieves the lowest total cost. The proposed framework results in solutions that tend to maximize the terminal covariance, while still satisfying the chance constraints, thus leading to less conservative solutions than previous methodologies. We also introduce two novel convex relaxation methods to approximate quadratic chance constraints as secondorder cone constraints. We finally demonstrate the approach to a spacecraft rendezvous problem and compare the results.
 [7] arXiv:2009.09650 [pdf]

Title: Exploring Collaborative and Multidisciplinary Aircraft Optimization through the AGILE Academy Challenge  A case study for an aircraft auxiliary solar power systemAuthors: Andrew Jeyaraj, Florian Sanchez, Paul Earnest, Ezhil Murugesan, Rémy Priem (ISAESUPAERO), Susan LiscouetHankeComments: 19th astronautics conference of the Canadian Aeronautics and Space Institute, Jun 2019, Laval, CanadaSubjects: Optimization and Control (math.OC)
Reduction in aircraft emission is a main driver for the development of more efficient aircraft and enabling technologies are reaching operational maturity. Aircraft manufacturers need an efficient product development process to capture these emergent technologies and develop new aircraft concepts in order to stay competitive. Presently, the aircraft development process is cross organizational, and harnesses distributed, heterogeneous knowledge and expertise. Large scale multidisciplinary studies, involving disciplinary experts and specific tools are required to evaluate different aircraft concepts. These MultiDisciplinary Aircraft Optimization (MDAO) processes are difficult to deploy as they involve crossorganizational collaboration and harmonization of processes, tools and even vocabulary. Moreover, difficulties in collaborative decision making, reconfiguration and integration of new requirements and competencies often precludes the development of an optimal solution within the available time. To address these challenges, the AGILE project is an effort within the European Union funded Horizon 2020 project to reduce aircraft development time by developing tools and processes that enable efficient, collaborative aircraft design. This paper presents the work performed as part of the AGILE academy challenge where students were tasked with developing and solving an aircraft MDAO problem using the AGILE toolchain. Each team consisted of students from various universities around the globe and had expertise in multiple design domains. An MDAO study is presented that utilizes the AGILE toolchain to investigate the feasibility of implementing an auxiliary solar power system on a baseline aircraft. The steps performed are: (1) definition of a multidisciplinary design problem, (2) development of collaborative workflow and (3) optimization using surrogate models. Through the case study, a novel technology concept is investigated and the efficacy of the AGILE toolchain in facilitating a MDAO is analyzed.
 [8] arXiv:2009.09864 [pdf, ps, other]

Title: Indefinite Linear Quadratic Mean Field Social Control Problems with Multiplicative NoiseComments: arXiv admin note: text overlap with arXiv:1904.07522Subjects: Optimization and Control (math.OC)
This paper studies uniform stabilization and social optimality for linear quadratic (LQ) mean field control problems with multiplicative noise, where agents are coupled via dynamics and individual costs. The state and control weights in cost functionals are not limited to be positive semidefinite. This leads to an indefinite LQ mean field control problem, which may still be wellposed due to deep nature of multiplicative noise. We first obtain a set of forwardbackward stochastic differential equations (FBSDEs) from variational analysis, and construct a feedback control by decoupling the FBSDEs. By using solutions to two Riccati equations, we design a set of decentralized control laws, which is further shown to be asymptotically social optimal. Some equivalent conditions are given for uniform stabilization of the systems with the help of linear matrix inequalities. A numerical example is given to illustrate the effectiveness of the proposed control laws.
 [9] arXiv:2009.09894 [pdf, other]

Title: Meanfield optimal control for biological pattern formationSubjects: Optimization and Control (math.OC); Analysis of PDEs (math.AP); Numerical Analysis (math.NA)
We propose a meanfield optimal control problem for the parameter identification of a given pattern. The cost functional is based on the Wasserstein distance between the probability measures of the modeled and the desired patterns. The firstorder optimality conditions corresponding to the optimal control problem are derived using a Lagrangian approach on the meanfield level. Based on these conditions we propose a gradient descent method to identify relevant parameters such as angle of rotation and force scaling which may be spatially inhomogeneous. We discretize the firstorder optimality conditions in order to employ the algorithm on the particle level. Moreover, we prove a rate for the convergence of the controls as the number of particles used for the discretization tends to infinity. Numerical results for the spatially homogeneous case demonstrate the feasibility of the approach.
 [10] arXiv:2009.09908 [pdf, other]

Title: ZerothOrder Algorithms for Smooth SaddlePoint ProblemsSubjects: Optimization and Control (math.OC); Machine Learning (cs.LG)
In recent years, the importance of saddlepoint problems in machine learning has increased. This is due to the popularity of GANs. In this paper, we solve stochastic smooth (strongly) convexconcave saddlepoint problems using zerothorder oracles. Theoretical analysis shows that in the case when the optimization set is a simplex, we lose only $\log n$ times in the stochastic convergence term. The paper also provides an approach to solving saddlepoint problems, when the oracle for one of the variables has zero order, and for the second  first order. Subsequently, we implement zerothorder and 1/2thorder methods to solve practical problems.
Crosslists for Tue, 22 Sep 20
 [11] arXiv:2009.09043 (crosslist from cs.LG) [pdf, other]

Title: CrossEntropy Method Variants for OptimizationAuthors: Robert J. MossComments: 9 pages, 6 figures, code available at this https URLSubjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)
The crossentropy (CE) method is a popular stochastic method for optimization due to its simplicity and effectiveness. Designed for rareevent simulations where the probability of a target event occurring is relatively small, the CEmethod relies on enough objective function calls to accurately estimate the optimal parameters of the underlying distribution. Certain objective functions may be computationally expensive to evaluate, and the CEmethod could potentially get stuck in local minima. This is compounded with the need to have an initial covariance wide enough to cover the design space of interest. We introduce novel variants of the CEmethod to address these concerns. To mitigate expensive function calls, during optimization we use every sample to build a surrogate model to approximate the objective function. The surrogate model augments the belief of the objective function with less expensive evaluations. We use a Gaussian process for our surrogate model to incorporate uncertainty in the predictions which is especially helpful when dealing with sparse data. To address local minima convergence, we use Gaussian mixture models to encourage exploration of the design space. We experiment with evaluation scheduling techniques to reallocate true objective function calls earlier in the optimization when the covariance is the largest. To test our approach, we created a parameterized test objective function with many local minima and a single global minimum. Our test function can be adjusted to control the spread and distinction of the minima. Experiments were run to stress the crossentropy method variants and results indicate that the surrogate modelbased approach reduces local minima convergence using the same number of function evaluations.
 [12] arXiv:2009.09055 (crosslist from eess.SY) [pdf, other]

Title: Prediction and Optimal Feedback Steering of Probability Density Functions for Safe Automated DrivingSubjects: Systems and Control (eess.SY); Optimization and Control (math.OC)
We propose a stochastic predictioncontrol framework to promote safety in automated driving by directly controlling the joint state probability density functions (PDFs) subject to the vehicle dynamics via trajectorylevel state feedback. To illustrate the main ideas, we focus on a multilane highway driving scenario although the proposed framework can be adapted to other contexts. The computational pipeline consists of a PDF prediction layer, followed by a PDF control layer. The prediction layer performs moving horizon nonparametric forecasts for the ego and the nonego vehicles' stochastic states, and thereby derives safe target PDF for the ego. The latter is based on the forecasted collision probabilities, and promotes the probabilistic safety for the ego. The PDF control layer designs a feedback that optimally steers the joint state PDF subject to the controlled ego dynamics while satisfying the endpoint PDF constraints. Our computation for the PDF prediction layer leverages the structure of the controlled Liouville PDE to evolve the joint PDF values, as opposed to empirically approximating the PDFs. Our computation for the PDF control layer leverages the differential flatness structure in vehicle dynamics. We harness recent theoretical and algorithmic advances in optimal mass transport, and the Schr\"{o}dinger bridge. The numerical simulations illustrate the efficacy of the proposed framework.
 [13] arXiv:2009.09100 (crosslist from eess.SY) [pdf, other]

Title: SafetyCritical Kinematic Control of Robotic SystemsSubjects: Systems and Control (eess.SY); Optimization and Control (math.OC)
Over the decades, kinematic controllers have proven to be practically useful for applications like setpoint and trajectory tracking in robotic systems. To this end, we formulate a novel safetycritical paradigm for kinematic control in this paper. In particular, we extend the methodology of control barrier functions (CBFs) to kinematic equations governing robotic systems. We demonstrate a purely kinematic implementation of a velocitybased CBF, and subsequently introduce a formulation that guarantees safety at the level of dynamics. This is achieved through a new form CBFs that incorporate kinetic energy with the classical forms, thereby minimizing model dependence and conservativeness. The approach is then extended to underactuated systems. This method and the purely kinematic implementation are demonstrated in simulation on two robotic platforms: a 6DOF robotic manipulator, and a cartpole system.
 [14] arXiv:2009.09288 (crosslist from cs.DS) [pdf, ps, other]

Title: On combinatorial optimization for dominating sets (literature survey, new models)Authors: Mark Sh. LevinComments: 17 pages, figures 6, table 5Subjects: Data Structures and Algorithms (cs.DS); Artificial Intelligence (cs.AI); Optimization and Control (math.OC)
The paper focuses on some versions of connected dominating set problems: basic problems and multicriteria problems. A literature survey on basic problem formulations and solving approaches is presented. The basic connected dominating set problems are illustrated by simplifyed numerical examples. New integer programming formulations of dominating set problems (with multiset estimates) are suggested.
 [15] arXiv:2009.09334 (crosslist from cs.AI) [pdf]

Title: Quantifying Uncertainty in Risk Assessment using Fuzzy TheoryAuthors: Hengameh FakhravarSubjects: Artificial Intelligence (cs.AI); Optimization and Control (math.OC)
Risk specialists are trying to understand risk better and use complex models for risk assessment, while many risks are not yet well understood. The lack of empirical data and complex causal and outcome relationships make it difficult to estimate the degree to which certain risk types are exposed. Traditional risk models are based on classical set theory. In comparison, fuzzy logic models are built on fuzzy set theory and are useful for analyzing risks with insufficient knowledge or inaccurate data. Fuzzy logic systems help to make largescale risk management frameworks more simple. For risks that do not have an appropriate probability model, a fuzzy logic system can help model the cause and effect relationships, assess the level of risk exposure, rank key risks in a consistent way, and consider available data and experts'opinions. Besides, in fuzzy logic systems, some rules explicitly explain the connection, dependence, and relationships between model factors. This can help identify risk mitigation solutions. Resources can be used to mitigate risks with very high levels of exposure and relatively low hedging costs. Fuzzy set and fuzzy logic models can be used with Bayesian and other types of method recognition and decision models, including artificial neural networks and decision tree models. These developed models have the potential to solve difficult risk assessment problems. This research paper explores areas in which fuzzy logic models can be used to improve risk assessment and risk decision making. We will discuss the methodology, framework, and process of using fuzzy logic systems in risk assessment.
 [16] arXiv:2009.09431 (crosslist from math.ST) [pdf, other]

Title: Lagrangian and Hamiltonian Mechanics for Probabilities on the Statistical ManifoldComments: 39 pages, 5 figuresSubjects: Statistics Theory (math.ST); Information Theory (cs.IT); High Energy Physics  Theory (hepth); Optimization and Control (math.OC); Machine Learning (stat.ML)
We provide an InformationGeometric formulation of Classical Mechanics on the Riemannian manifold of probability distributions, which is an affine manifold endowed with a duallyflat connection. In a nonparametric formalism, we consider the full set of positive probability functions on a finite sample space, and we provide a specific expression for the tangent and cotangent spaces over the statistical manifold, in terms of a Hilbert bundle structure that we call the Statistical Bundle. In this setting, we compute velocities and accelerations of a onedimensional statistical model using the canonical dual pair of parallel transports and define a coherent formalism for Lagrangian and Hamiltonian mechanics on the bundle. Finally, in a series of examples, we show how our formalism provides a consistent framework for accelerated natural gradient dynamics on the probability simplex, paving the way for direct applications in optimization, game theory and neural networks.
 [17] arXiv:2009.09472 (crosslist from eess.SY) [pdf, other]

Title: MultiObjective Optimization of Distribution Networks via Daily ReconfigurationSubjects: Systems and Control (eess.SY); Dynamical Systems (math.DS); Optimization and Control (math.OC)
This paper presents a comprehensive approach to improve the daily performance of an active distribution network (ADN), which includes renewable resources and responsive load (RL), using distributed network reconfiguration (DNR). Optimization objectives in this work can be described as (i) reducing active losses, (ii) improving the voltage profile, (iii) improving the network reliability, and (iv) minimizing distribution network operation costs. The suggested approach takes into account the probability of renewable resource failure, given the information collected from their initial state at the beginning of every day, in solving the optimization problem. Furthermore, solar radiation variations are estimated based on past historical data and the impact of the performance of renewable sources such as photovoltaic (PV) is determined hourly based on the Markov model. Since the number of reconfiguration scenarios is very high, stochastic DNR (SDNR) based on the probability distance method is employed to shrink the scenarios set. At the final stage, an improved crow search algorithm (ICSA) is introduced to find the optimal scenario. The effectiveness of the suggested method is verified for the IEEE 33bus radial distribution system as a case study.
 [18] arXiv:2009.09498 (crosslist from eess.IV) [pdf, other]

Title: Distributed optimization with tunable learned priors for robust ptychotomographySubjects: Image and Video Processing (eess.IV); Optimization and Control (math.OC)
Joint ptychotomography is a powerful computational imaging framework to recover the refractive properties of a 3D object while relaxing the requirements for probe overlap that is common in conventional phase retrieval. We use an augmented Lagrangian scheme for formulating the constrained optimization problem and employ an alternating direction method of multipliers (ADMM) for the joint solution. ADMM allows the problem to be split into smaller and computationally more manageable subproblems: ptychographic phase retrieval, tomographic reconstruction, and regularization of the solution. We extend our ADMM framework with plugandplay (PnP) denoisers by replacing the regularization subproblem with a general denoising operator based on machine learning. While the PnP framework enables integrating such learned priors as denoising operators, tuning of the denoiser prior remains challenging. To overcome this challenge, we propose a tuning parameter to control the effect of the denoiser and to accelerate the solution. In our simulations, we demonstrate that our proposed framework with parameter tuning and learned priors generates highquality reconstructions under limited and noisy measurement data.
 [19] arXiv:2009.09511 (crosslist from eess.SY) [pdf, other]

Title: SafetyCritical Online Control with Adversarial DisturbancesComments: Paper accepted to the Conference on Decision and Control (CDC), 2020Subjects: Systems and Control (eess.SY); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Optimization and Control (math.OC)
This paper studies the control of safetycritical dynamical systems in the presence of adversarial disturbances. We seek to synthesize statefeedback controllers to minimize a cost incurred due to the disturbance, while respecting a safety constraint. The safety constraint is given by a bound on an Hinf norm, while the cost is specified as an upper bound on the H2 norm of the system. We consider an online setting where costs at each time are revealed only after the controller at that time is chosen. We propose an iterative approach to the synthesis of the controller by solving a modified discretetime Riccati equation. Solutions of this equation enforce the safety constraint. We compare the cost of this controller with that of the optimal controller when one has complete knowledge of disturbances and costs in hindsight. We show that the regret function, which is defined as the difference between these costs, varies logarithmically with the time horizon. We validate our approach on a process control setup that is subject to two kinds of adversarial attacks.
 [20] arXiv:2009.09623 (crosslist from cs.CC) [pdf, other]

Title: The Complexity of Constrained MinMax OptimizationSubjects: Computational Complexity (cs.CC); Machine Learning (cs.LG); Optimization and Control (math.OC)
Despite its important applications in Machine Learning, minmax optimization of nonconvexnonconcave objectives remains elusive. Not only are there no known firstorder methods converging even to approximate local minmax points, but the computational complexity of identifying them is also poorly understood. In this paper, we provide a characterization of the computational complexity of the problem, as well as of the limitations of firstorder methods in constrained minmax optimization problems with nonconvexnonconcave objectives and linear constraints.
As a warmup, we show that, even when the objective is a Lipschitz and smooth differentiable function, deciding whether a minmax point exists, in fact even deciding whether an approximate minmax point exists, is NPhard. More importantly, we show that an approximate local minmax point of large enough approximation is guaranteed to exist, but finding one such point is PPADcomplete. The same is true of computing an approximate fixed point of Gradient Descent/Ascent.
An important byproduct of our proof is to establish an unconditional hardness result in the NemirovskyYudin model. We show that, given oracle access to some function $f : P \to [1, 1]$ and its gradient $\nabla f$, where $P \subseteq [0, 1]^d$ is a known convex polytope, every algorithm that finds a $\varepsilon$approximate local minmax point needs to make a number of queries that is exponential in at least one of $1/\varepsilon$, $L$, $G$, or $d$, where $L$ and $G$ are respectively the smoothness and Lipschitzness of $f$ and $d$ is the dimension. This comes in sharp contrast to minimization problems, where finding approximate local minima in the same setting can be done with Projected Gradient Descent using $O(L/\varepsilon)$ many queries. Our result is the first to show an exponential separation between these two fundamental optimization problems.  [21] arXiv:2009.09778 (crosslist from eess.SY) [pdf, ps, other]

Title: Computation of Parameter Dependent Robust Invariant Sets for LPV Models with Guaranteed PerformanceComments: 32 pages, 5 figuresSubjects: Systems and Control (eess.SY); Optimization and Control (math.OC)
This paper presents an iterative algorithm to compute a Robust Control Invariant (RCI) set, along with an invarianceinducing control law, for Linear ParameterVarying (LPV) systems. As the realtime measurements of the scheduling parameters are typically available, in the presented formulation, we allow the RCI set description along with the invarianceinducing controller to be scheduling parameter dependent. The considered formulation thus leads to parameterdependent conditions for the set invariance, which are replaced by sufficient Linear Matrix Inequality (LMI) conditions via Polya's relaxation. These LMI conditions are then combined with a novel volume maximization approach in a Semidefinite Programming (SDP) problem, which aims at computing the desirably large RCI set. In addition to ensuring invariance, it is also possible to guarantee performance within the RCI set by imposing a chosen quadratic performance level as an additional constraint in the SDP problem. The reported numerical example shows that the presented iterative algorithm can generate invariant sets which are larger than the maximal RCI sets computed without exploiting scheduling parameter information.
 [22] arXiv:2009.09835 (crosslist from cs.LG) [pdf, other]

Title: Hybrid StochasticDeterministic Minibatch Proximal Gradient: LessThanSinglePass Optimization with Nearly Optimal GeneralizationSubjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Optimization and Control (math.OC); Machine Learning (stat.ML)
Stochastic variancereduced gradient (SVRG) algorithms have been shown to work favorably in solving largescale learning problems. Despite the remarkable success, the stochastic gradient complexity of SVRGtype algorithms usually scales linearly with data size and thus could still be expensive for huge data. To address this deficiency, we propose a hybrid stochasticdeterministic minibatch proximal gradient (HSDMPG) algorithm for stronglyconvex problems that enjoys provably improved datasizeindependent complexity guarantees. More precisely, for quadratic loss $F(\theta)$ of $n$ components, we prove that HSDMPG can attain an $\epsilon$optimizationerror $\mathbb{E}[F(\theta)F(\theta^*)]\leq\epsilon$ within $\mathcal{O}\Big(\frac{\kappa^{1.5}\epsilon^{0.75}\log^{1.5}(\frac{1}{\epsilon})+1}{\epsilon}\wedge\Big(\kappa \sqrt{n}\log^{1.5}\big(\frac{1}{\epsilon}\big)+n\log\big(\frac{1}{\epsilon}\big)\Big)\Big)$ stochastic gradient evaluations, where $\kappa$ is condition number. For generic strongly convex loss functions, we prove a nearly identical complexity bound though at the cost of slightly increased logarithmic factors. For largescale learning problems, our complexity bounds are superior to those of the prior stateoftheart SVRG algorithms with or without dependence on data size. Particularly, in the case of $\epsilon=\mathcal{O}\big(1/\sqrt{n}\big)$ which is at the order of intrinsic excess error bound of a learning model and thus sufficient for generalization, the stochastic gradient complexity bounds of HSDMPG for quadratic and generic loss functions are respectively $\mathcal{O} (n^{0.875}\log^{1.5}(n))$ and $\mathcal{O} (n^{0.875}\log^{2.25}(n))$, which to our best knowledge, for the first time achieve optimal generalization in less than a single pass over data. Extensive numerical results demonstrate the computational advantages of our algorithm over the prior ones.
 [23] arXiv:2009.09946 (crosslist from cs.GT) [pdf, other]

Title: Optimal Targeting in SuperModular GamesSubjects: Computer Science and Game Theory (cs.GT); Multiagent Systems (cs.MA); Systems and Control (eess.SY); Optimization and Control (math.OC)
We study an optimal targeting problem for supermodular games with binary actions and finitely many players. The considered problem consists in the selection of a subset of players of minimum size such that, when the actions of these players are forced to a controlled value while the others are left to repeatedly play a best response action, the system will converge to the greatest Nash equilibrium of the game. Our main contributions consist in showing that the problem is NPcomplete and in proposing an efficient iterative algorithm with provable convergence properties for its solution. We discuss in detail the special case of network coordination games and its relation with the notion of cohesiveness. Finally, we show with simulations the strength of our approach with respect to naive heuristics based on classical network centrality measures.
 [24] arXiv:2009.10020 (crosslist from eess.SY) [pdf, other]

Title: Imitation dynamics in population games on community networksComments: 12 pages, 5 figures. Under reviewSubjects: Systems and Control (eess.SY); Computer Science and Game Theory (cs.GT); Dynamical Systems (math.DS); Optimization and Control (math.OC)
We study the asymptotic behavior of deterministic, continuoustime imitation dynamics for population games over networks. The basic assumption of this learning mechanism  encompassing the replicator dynamics  is that players belonging to a single population exchange information through pairwise interactions, whereby they get aware of the actions played by the other players and the corresponding rewards. Using this information, they can revise their current action, imitating the one of the players they interact with. The pattern of interactions regulating the learning process is determined by a community structure. First, the set of equilibrium points of such network imitation dynamics is characterized. Second, for the class of potential games and for undirected and connected community networks, global asymptotic convergence is proved. In particular, our results guarantee convergence to a Nash equilibrium from every fully supported initial population state in the special case when the Nash equilibria are isolated and fully supported. Examples and numerical simulations are offered to validate the theoretical results and counterexamples are discussed for scenarios when the assumptions on the community structure are not verified.
 [25] arXiv:2009.10049 (crosslist from qbio.PE) [pdf, other]

Title: Optimal Drug Regimen and Combined Drug Therapy and its Efficacy in the Treatment of COVID19 : An WithinHost Modeling StudyAuthors: Bishal Chhetri, Vijay M. Bhagat, D. K. K. Vamsi, Ananth V S, Bhanu Prakadh, Swapna Muthuswamy, Pradeep Deshmukh, Carani B SanjeeviComments: 16 pages, 13 figuresSubjects: Populations and Evolution (qbio.PE); Dynamical Systems (math.DS); Optimization and Control (math.OC)
The COVID19 pandemic has resulted in more than 30.35 million infections and 9, 50, 625 deaths in 212 countries over the last few months. Different drug intervention acting at multiple stages of pathogenesis of COVID19 can substantially reduce the infection induced mortality. The current withinhost mathematical modeling studies deals with the optimal drug regimen and the efficacy of combined therapy in treatment of COVID19. The drugs/interventions considered include Arbidol, Remdesivir, Inteferon (INF) and Lopinavir/Ritonavir. It is concluded that these drug interventions when administered individually or in combination reduce the infected cells and viral load. Four scenarios involving administration of single drug intervention, two drug interventions, three drug interventions and all the four have been discussed. In all these scenarios the optimal drug regimen is proposed based on two methods. In the first method these medical interventions are modeled as control interventions and a corresponding objective function and optimal control problem is formulated. In this setting the optimal drug regimen is proposed. Later using the the comparative effectiveness method the optimal drug regimen is proposed based on basic reproduction number and viral load. The average infected cell count and viral load decreased the most when all the four interventions were applied together. On the other hand the average susceptible cell count decreased the best when Arbidol alone was administered. The basic reproduction number and viral count decreased the best when all the four interventions were applied together reinstating the fact obtained earlier in the optimal control setting. These findings may help physicians with decision making in treatment of lifethreatening COVID19 pneumonia.
Replacements for Tue, 22 Sep 20
 [26] arXiv:1802.09022 (replaced) [pdf, other]

Title: An Accelerated Method for DerivativeFree Smooth Stochastic Convex OptimizationSubjects: Optimization and Control (math.OC); Computational Complexity (cs.CC)
 [27] arXiv:1804.02394 (replaced) [pdf, other]

Title: An Accelerated Directional Derivative Method for Smooth Stochastic Convex OptimizationComments: arXiv admin note: text overlap with arXiv:1802.09022Subjects: Optimization and Control (math.OC); Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS)
 [28] arXiv:1806.10868 (replaced) [pdf, other]

Title: A TwoStep PreProcessing for Semidefinite ProgrammingJournalref: The 59th Conference on Decision and Control (CDC 2020)Subjects: Optimization and Control (math.OC); Numerical Analysis (math.NA)
 [29] arXiv:1901.06976 (replaced) [pdf, other]

Title: Admissibility of solution estimators for stochastic optimizationSubjects: Optimization and Control (math.OC); Statistics Theory (math.ST)
 [30] arXiv:1901.09233 (replaced) [pdf, other]

Title: Optimal majority threshold in a stochastic environmentAuthors: Vitaly MalyshevComments: 21 pages, 10 figuresSubjects: Optimization and Control (math.OC)
 [31] arXiv:1902.10288 (replaced) [pdf, other]

Title: Clustering, factor discovery and optimal transportComments: Improved clarity of presentationSubjects: Optimization and Control (math.OC); Statistics Theory (math.ST)
 [32] arXiv:1904.01368 (replaced) [pdf, ps, other]

Title: Consensus and Flocking in a Class of CuckerSmale Systems under Communication FailuresSubjects: Optimization and Control (math.OC)
 [33] arXiv:1905.05660 (replaced) [pdf, ps, other]

Title: Finitely Convergent Deterministic and Stochastic Iterative Methods for Solving Convex Feasibility ProblemsSubjects: Optimization and Control (math.OC)
 [34] arXiv:1906.01981 (replaced) [pdf, ps, other]

Title: Understanding Distributional Ambiguity via Nonrobust Chance ConstraintComments: 8 pages, 3 figures, Accepted for publication in ICAIF 2020Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Portfolio Management (qfin.PM); Risk Management (qfin.RM); Machine Learning (stat.ML)
 [35] arXiv:2001.00665 (replaced) [pdf, ps, other]

Title: Decentralized Langevin DynamicsAuthors: Vyacheslav KungurtsevSubjects: Optimization and Control (math.OC); Information Theory (cs.IT)
 [36] arXiv:2001.08826 (replaced) [pdf, other]

Title: An $O(s^r)$Resolution ODE Framework for DiscreteTime Optimization Algorithms and Applications to the Linear Convergence of Minimax ProblemsAuthors: Haihao LuSubjects: Optimization and Control (math.OC); Machine Learning (cs.LG)
 [37] arXiv:2002.12599 (replaced) [pdf, other]

Title: Computing mixed strategies equilibria in presence of switching costs by the solution of nonconvex QP problemsSubjects: Optimization and Control (math.OC)
 [38] arXiv:2004.03069 (replaced) [pdf, other]

Title: Nonparametric Estimation of Uncertainty Sets for Robust OptimizationComments: 8 pages, 2 figuresSubjects: Optimization and Control (math.OC); Machine Learning (cs.LG)
 [39] arXiv:2005.02112 (replaced) [pdf, ps, other]

Title: Remote state estimation problem: towards the datarate limit along the avenue of the second Lyapunov methodSubjects: Optimization and Control (math.OC); Dynamical Systems (math.DS)
 [40] arXiv:2005.07264 (replaced) [pdf, other]

Title: Fireshape: a shape optimization toolbox for FiredrakeComments: 17 pages, 13 figures, 6 listingsSubjects: Optimization and Control (math.OC); Numerical Analysis (math.NA)
 [41] arXiv:2006.16781 (replaced) [pdf, ps, other]

Title: On the strong concavity of the dual function of an optimization problemAuthors: Vincent GuiguesComments: arXiv admin note: text overlap with arXiv:1805.11732Subjects: Optimization and Control (math.OC)
 [42] arXiv:2007.05809 (replaced) [pdf, other]

Title: Partial Pole Placement via Delay Action: A Python Software for Delayed Feedback Stabilizing DesignAuthors: Islam Boussaada, Guilherme Mazanti, SilviuIulian Niculescu, Julien Huynh, Franck Sim, Matthieu ThomasSubjects: Optimization and Control (math.OC)
 [43] arXiv:2007.15350 (replaced) [pdf, other]

Title: A deep learning algorithm for the stable manifolds of the HamiltonJacobi equationsAuthors: Guoyuan ChenComments: Some mathematically rigorous asymptotic analysis is added in Section 3; Section 5 in the previous version is removed; The references and citations are revisedSubjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
 [44] arXiv:2009.02638 (replaced) [pdf, ps, other]

Title: Exact SDP relaxations of quadratically constrained quadratic programs with forest structuresSubjects: Optimization and Control (math.OC)
 [45] arXiv:2009.04906 (replaced) [pdf, other]

Title: Linearly Convergent GradientFree Methods for Minimization of Symmetric Parabolic ApproximationSubjects: Optimization and Control (math.OC)
 [46] arXiv:1807.07476 (replaced) [pdf, other]

Title: Minimizing convex quadratic with variable precision conjugate gradientsSubjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
 [47] arXiv:1809.01572 (replaced) [pdf, ps, other]

Title: A Safe Computational Framework for Integer Programming applied to Chvátal's ConjectureSubjects: Combinatorics (math.CO); Optimization and Control (math.OC)
 [48] arXiv:1903.08966 (replaced) [pdf, ps, other]

Title: A unified framework of SAGE and SONC polynomials and its duality theoryComments: Revised version, 27 pagesSubjects: Algebraic Geometry (math.AG); Optimization and Control (math.OC)
 [49] arXiv:1909.04762 (replaced) [pdf, ps, other]

Title: A parametric version of LLL and some consequences: parametric shortest and closest vector problemsComments: 20 pages. Accepted for publication in SIAM Journal on Discrete Mathematics. Revised title and opening paragraphs, slightly modified statement of Theorem 1.4, added explanation of some steps in Section 3, and implemented various minor improvements suggested by anonymous refereesSubjects: Combinatorics (math.CO); Optimization and Control (math.OC)
 [50] arXiv:1911.11167 (replaced) [pdf, ps, other]

Title: Manifold Gradient Descent Solves MultiChannel Sparse Blind Deconvolution Provably and EfficientlyComments: submittedSubjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Signal Processing (eess.SP); Optimization and Control (math.OC)
 [51] arXiv:2004.01298 (replaced) [pdf, other]

Title: Trajectory Optimization for Nonlinear MultiAgent Systems using Decentralized Learning Model Predictive ControlComments: 8 pages, 2 figures, submitted to Conference on Decision and Control 2020Subjects: Systems and Control (eess.SY); Machine Learning (cs.LG); Optimization and Control (math.OC)
 [52] arXiv:2004.04355 (replaced) [pdf, other]

Title: Sensor placement minimizing the state estimation mean square error: Performance guarantees of greedy solutionsSubjects: Systems and Control (eess.SY); Optimization and Control (math.OC)
 [53] arXiv:2006.06889 (replaced) [src]

Title: Fast Objective and Duality Gap Convergence for NonconvexStronglyConcave MinMax ProblemsComments: There is critical error on the report of experimental resultsSubjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)
 [54] arXiv:2009.08111 (replaced) [pdf, other]

Title: The relationship between dynamic programming and active inference: the discrete, finitehorizon caseSubjects: Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Neurons and Cognition (qbio.NC)
 [55] arXiv:2009.08433 (replaced) [pdf, other]

Title: On the global controllability of scalar conservation laws with boundary and source controlsComments: 22 pages, 5 figuresSubjects: Analysis of PDEs (math.AP); Optimization and Control (math.OC)
[ showing up to 2000 entries per page: fewer  more ]
Disable MathJax (What is MathJax?)
Links to: arXiv, form interface, find, math, recent, 2009, contact, help (Access key information)