We gratefully acknowledge support from
the Simons Foundation and member institutions.

Optimization and Control

New submissions

[ total of 26 entries: 1-26 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Thu, 26 Jan 23

[1]  arXiv:2301.10269 [pdf, ps, other]
Title: Exact controllability for wave equation on general quantum graphs with non-smooth controls
Subjects: Optimization and Control (math.OC)

In this paper we study the exact controllability problem for the wave equation on a finite metric graph with the Kirchhoff-Neumann matching conditions. Among all vertices and edges we choose certain active vertices and edges, and give a constructive proof that the wave equation on the graph is exactly controllable if $H^1(0,T)'$ Neumann controllers are placed at the active vertices and $L^2(0,T)$ Dirichlet controllers are placed at the active edges. The proofs for the shape and velocity controllability are purely dynamical, while the proof for the exact controllability utilizes both dynamical and moment method approaches. The control time for this construction is determined by the chosen orientation and path decomposition of the graph.

[2]  arXiv:2301.10301 [pdf, other]
Title: A kernel formula for regularized Wasserstein proximal operators
Subjects: Optimization and Control (math.OC); Numerical Analysis (math.NA)

We study a class of regularized proximal operators in Wasserstein-2 space. We derive their solutions by kernel integration formulas. We obtain the Wasserstein proximal operator using a pair of forward-backward partial differential equations consisting of a continuity equation and a Hamilton-Jacobi equation with a terminal time potential function and an initial time density function. We regularize the PDE pair by adding forward and backward Laplacian operators. We apply Hopf-Cole type transformations to rewrite these regularized PDE pairs into forward-backward heat equations. We then use the fundamental solution of the heat equation to represent the regularized Wasserstein proximal with kernel integral formulas. Numerical examples show the effectiveness of kernel formulas in approximating the Wasserstein proximal operator.

[3]  arXiv:2301.10332 [pdf, other]
Title: Square distance functions are Polyak-Łojasiewicz and vice-versa
Comments: 8 pages, 2 figures
Subjects: Optimization and Control (math.OC)

This short note gathers known results to state that the squared distance function to a (nonconvex) closed set of an Euclidean space is Polyak-{\L}ojasiewicz. As a fuzzy reciprocate, we also recall that every Polyak-{\L}ojasiewicz function can be bounded from below by the squared distance function to its set of minimizers.

[4]  arXiv:2301.10355 [pdf, other]
Title: An ADMM numerical approach in shape optimization setting for geometric inverse problems
Comments: 11 pages; results were first presented at CoMFoS22: Mathematical Aspects of Continuum Mechanics 2023
Subjects: Optimization and Control (math.OC)

We propose in this note the application of the alternating direction method of multipliers in shape optimization framework for solving geometric inverse problems. We present some preliminary results illustrating the applicability and efficiency of the method by testing it to some shape detection problems with the focus on unknown inclusions with pronounced concavities and under noisy data. Examples are given in two and three dimensions.

[5]  arXiv:2301.10553 [pdf, other]
Title: Modeling of mouse experiments suggests that optimal anti-hormonal treatment for breast cancer is diet-dependent
Comments: 44 pages, 21 figures
Subjects: Optimization and Control (math.OC)

Estrogen receptor positive breast cancer is frequently treated with anti-hormonal treatment such as aromatase inhibitors (AI). Interestingly, a high body mass index has been shown to have a negative impact on AI efficacy, most likely due to disturbances in steroid metabolism and adipokine production. Here, we propose a mathematical model based on a system of ordinary differential equations to investigate the effect of high-fat diet on tumor growth. We inform the model with data from mouse experiments, where the animals are fed with high-fat or control (normal) diet. By incorporating AI treatment with drug resistance into the model and by solving optimal control problems we found differential responses for control and high-fat diet. To the best of our knowledge, this is the first attempt to model optimal anti-hormonal treatment for breast cancer in the presence of drug resistance. Our results underline the importance of considering high-fat diet and obesity as factors influencing clinical outcomes during anti-hormonal therapies in breast cancer patients.

[6]  arXiv:2301.10580 [pdf, other]
Title: A Mathematical Programming approach to Overlapping community detection by cluster's Shapley value
Subjects: Optimization and Control (math.OC)

We propose a new model to detect the overlapping communities of a network that is based on cooperative games and mathematical programming. More specifically, communities are defined as stable coalitions of a weighted graph community game and they are revealed as the optimal solution of a mixed-integer linear programming problem. Exact optimal solutions are obtained for small and medium sized instances and and it is shown that they provide useful information about the network structure, improving on previous contributions. Next, a heuristic algorithm is developed to solve the largest instances and used to compare two variations of the objective function.

[7]  arXiv:2301.10594 [pdf]
Title: A Discussion on Nonlinear Quadratic Control and Sontag's Formula
Comments: 5 pages; Technical Report TRAC-8, Number 1, January 2023
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)

The quadratic optimal state feedback (LQR) is one of the most popular designs for linear systems and succeeds via the solution of the algebraic Riccati equation. The situation is different in the case of non-linear systems: the Riccati equation is then replaced by the Hamilton Jacobi Bellman equation (HJB), the solution of which is generally difficult. A compromise can be the so-called Inverse Optimal Control, a form of which is Sontag's formula [1]; here the minimized cost function follows from the feedback law chosen, not vice versa. Using Sontag's formula in the variant according to Freeman and Primbs [2, 9], the actually minimized cost function is given in the following sections, including cases when it reduces to the quadratic cost. Also some remarks and thoughts are presented for discussion.

[8]  arXiv:2301.10637 [pdf, ps, other]
Title: Bit-complexity estimates in geometric programming, and application to the polynomial-time computation of the spectral radius of nonnegative tensors
Comments: 26 pages
Subjects: Optimization and Control (math.OC); Computational Complexity (cs.CC)

We show that the spectral radius of nonnegative tensors can be approximated within $\varepsilon$ error in polynomial time. This implies that the maximum of a nonnegative homogeneous $d$-form in the unit ball with respect to $d$-H\"older norm can be approximated in polynomial time. These results are deduced by establishing bit-size estimates for the near-minimizers of functions given by suprema of finitely many log-Laplace transforms of discrete nonnegative measures on $\mathbb{R}^n$. Hence, some known upper bounds for the clique number of hypergraphs are polynomially computable.

[9]  arXiv:2301.10703 [pdf, ps, other]
Title: A Sequential Deep Learning Algorithm for Sampled Mixed-integer Optimisation Problems
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG)

Mixed-integer optimisation problems can be computationally challenging. Here, we introduce and analyse two efficient algorithms with a specific sequential design that are aimed at dealing with sampled problems within this class. At each iteration step of both algorithms, we first test the feasibility of a given test solution for each and every constraint associated with the sampled optimisation at hand, while also identifying those constraints that are violated. Subsequently, an optimisation problem is constructed with a constraint set consisting of the current basis -- namely the smallest set of constraints that fully specifies the current test solution -- as well as constraints related to a limited number of the identified violating samples. We show that both algorithms exhibit finite-time convergence towards the optimal solution. Algorithm 2 features a neural network classifier that notably improves the computational performance compared to Algorithm 1. We establish quantitatively the efficacy of these algorithms by means of three numerical tests: robust optimal power flow, robust unit commitment, and robust random mixed-integer linear program.

Cross-lists for Thu, 26 Jan 23

[10]  arXiv:2301.10244 (cross-list from cs.AI) [pdf]
Title: On solving decision and risk management problems subject to uncertainty
Comments: 12 pages
Subjects: Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Probability (math.PR)

Uncertainty is a pervasive challenge in decision and risk management and it is usually studied by quantification and modeling. Interestingly, engineers and other decision makers usually manage uncertainty with strategies such as incorporating robustness, or by employing decision heuristics. The focus of this paper is then to develop a systematic understanding of such strategies, determine their range of application, and develop a framework to better employ them.
Based on a review of a dataset of 100 decision problems, this paper found that many decision problems have pivotal properties, i.e. properties that enable solution strategies, and finds 14 such properties. Therefore, an analyst can first find these properties in a given problem, and then utilize the strategies they enable. Multi-objective optimization methods could be used to make investment decisions quantitatively. The analytical complexity of decision problems can also be scored by evaluating how many of the pivotal properties are available. Overall, we find that in the light of pivotal properties, complex problems under uncertainty frequently appear surprisingly tractable.

[11]  arXiv:2301.10310 (cross-list from math.AP) [pdf, ps, other]
Title: Infinite memory effects on the stability of Biharmonic Schrödinger equation
Subjects: Analysis of PDEs (math.AP); Optimization and Control (math.OC)

This paper deals with the stabilization of the linear Biharmonic Schr\"odinger equation in an $n$-dimensional open bounded domain under Dirichlet-Neumann boundary conditions considering three infinite memory terms as damping mechanisms. We show that depending on the smoothness of initial data and the arbitrary growth at infinity of the kernel function, this class of solution goes to zero with a polynomial decay rate like $t^{-n}$ depending on assumptions about the kernel function associated with the infinite memory terms.

[12]  arXiv:2301.10384 (cross-list from cs.RO) [pdf, other]
Title: Search-Based Task and Motion Planning for Hybrid Systems: Agile Autonomous Vehicles
Comments: Accepted to the journal Engineering Applications of Artificial Intelligence; 19 pages, 18 figures, code: this https URL arXiv admin note: text overlap with arXiv:1907.07825
Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Optimization and Control (math.OC)

To achieve optimal robot behavior in dynamic scenarios we need to consider complex dynamics in a predictive manner. In the vehicle dynamics community, it is well know that to achieve time-optimal driving on low surface, the vehicle should utilize drifting. Hence many authors have devised rules to split circuits and employ drifting on some segments. These rules are suboptimal and do not generalize to arbitrary circuit shapes (e.g., S-like curves). So, the question "When to go into which mode and how to drive in it?" remains unanswered. To choose the suitable mode (discrete decision), the algorithm needs information about the feasibility of the continuous motion in that mode. This makes it a class of Task and Motion Planning (TAMP) problems, which are known to be hard to solve optimally in real-time. In the AI planning community, search methods are commonly used. However, they cannot be directly applied to TAMP problems due to the continuous component. Here, we present a search-based method that effectively solves this problem and efficiently searches in a highly dimensional state space with nonlinear and unstable dynamics. The space of the possible trajectories is explored by sampling different combinations of motion primitives guided by the search. Our approach allows to use multiple locally approximated models to generate motion primitives (e.g., learned models of drifting) and effectively simplify the problem without losing accuracy. The algorithm performance is evaluated in simulated driving on a mixed-track with segments of different curvatures (right and left). Our code is available at https://git.io/JenvB

[13]  arXiv:2301.10499 (cross-list from cs.LG) [pdf, other]
Title: A Provable Splitting Approach for Symmetric Nonnegative Matrix Factorization
Comments: Accepted for publication in IEEE Transactions on Knowledge and Data Engineering. This paper significantly extends a preliminary conference version [1]. We have 1) the new accelerated SymHALS (A-SymHALS) algorithm, 2) a new unified convergence analysis framework, and 3) a new adaptive strategy for updating the penalty parameter $\lambda$ to avoid hyper-parameter tuning. arXiv admin note: text overlap with arXiv:1811.05642
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

The symmetric Nonnegative Matrix Factorization (NMF), a special but important class of the general NMF, has found numerous applications in data analysis such as various clustering tasks. Unfortunately, designing fast algorithms for the symmetric NMF is not as easy as for its nonsymmetric counterpart, since the latter admits the splitting property that allows state-of-the-art alternating-type algorithms. To overcome this issue, we first split the decision variable and transform the symmetric NMF to a penalized nonsymmetric one, paving the way for designing efficient alternating-type algorithms. We then show that solving the penalized nonsymmetric reformulation returns a solution to the original symmetric NMF. Moreover, we design a family of alternating-type algorithms and show that they all admit strong convergence guarantee: the generated sequence of iterates is convergent and converges at least sublinearly to a critical point of the original symmetric NMF. Finally, we conduct experiments on both synthetic data and real image clustering to support our theoretical results and demonstrate the performance of the alternating-type algorithms.

[14]  arXiv:2301.10737 (cross-list from cs.LG) [pdf, other]
Title: Distributed Control of Partial Differential Equations Using Convolutional Reinforcement Learning
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

We present a convolutional framework which significantly reduces the complexity and thus, the computational effort for distributed reinforcement learning control of dynamical systems governed by partial differential equations (PDEs). Exploiting translational invariances, the high-dimensional distributed control problem can be transformed into a multi-agent control problem with many identical, uncoupled agents. Furthermore, using the fact that information is transported with finite velocity in many cases, the dimension of the agents' environment can be drastically reduced using a convolution operation over the state space of the PDE. In this setting, the complexity can be flexibly adjusted via the kernel width or by using a stride greater than one. Moreover, scaling from smaller to larger systems -- or the transfer between different domains -- becomes a straightforward task requiring little effort. We demonstrate the performance of the proposed framework using several PDE examples with increasing complexity, where stabilization is achieved by training a low-dimensional deep deterministic policy gradient agent using minimal computing resources.

Replacements for Thu, 26 Jan 23

[15]  arXiv:2010.04684 (replaced) [pdf, ps, other]
Title: $L_1$-norm regularized $L_1$-norm best-fit line problem
Subjects: Optimization and Control (math.OC)
[16]  arXiv:2110.04926 (replaced) [pdf, ps, other]
Title: Convergence of Random Reshuffling Under The Kurdyka-Łojasiewicz Inequality
Comments: Accepted for publication in SIAM Journal on Optimization
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG)
[17]  arXiv:2110.06756 (replaced) [pdf, ps, other]
Title: Asymptotic linear convergence of fully-corrective generalized conditional gradient methods
Comments: 50 pages, 3 figures
Subjects: Optimization and Control (math.OC)
[18]  arXiv:2204.03968 (replaced) [pdf, other]
Title: Machine Learning architectures for price formation models
Subjects: Optimization and Control (math.OC)
[19]  arXiv:2210.06543 (replaced) [pdf, other]
Title: A General Stochastic Optimization Framework for Convergence Bidding
Subjects: Optimization and Control (math.OC); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Signal Processing (eess.SP)
[20]  arXiv:2212.02748 (replaced) [pdf, other]
Title: An Online Newton's Method for Time-varying Linear Equality Constraints
Comments: Version takes into account reviewer comments. The contributions have been clarified. The assumptions regarding the variation of optima have been clarified. The figures have more explicit labeling of the axes. Several small typos were addressed including problems with parentheses and unnecessary lines
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
[21]  arXiv:2301.05932 (replaced) [pdf, other]
Title: On continuation and convex Lyapunov functions
Comments: 16 pages, comments are welcome. V2: fixed 1 typo
Subjects: Optimization and Control (math.OC); Dynamical Systems (math.DS)
[22]  arXiv:2301.09161 (replaced) [pdf, ps, other]
Title: Multiparametric robust solutions for combinatorial problems with parameterized locally budgeted uncertainty
Authors: Alejandro Crema
Comments: 26 pages including 7 tables and 4 appendices
Subjects: Optimization and Control (math.OC)
[23]  arXiv:2010.01171 (replaced) [pdf, other]
Title: Data-Driven Certification of Neural Networks with Random Input Noise
Comments: IEEE Transactions on Control of Network Systems, 2022. This work is a merge of arXiv:2010.01171v1 and arXiv:2010.07532
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)
[24]  arXiv:2010.07532 (replaced) [src]
Title: Certifying Neural Network Robustness to Random Input Noise from Samples
Comments: This paper has been superseded by arXiv:2010.01171 (merged from arXiv:2010.01171v1 and arXiv:2010.07532)
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)
[25]  arXiv:2202.12927 (replaced) [pdf, other]
Title: A blob method for inhomogeneous diffusion with applications to multi-agent control and sampling
Comments: 56 pages, 8 figures
Subjects: Analysis of PDEs (math.AP); Machine Learning (cs.LG); Numerical Analysis (math.NA); Optimization and Control (math.OC)
[26]  arXiv:2204.07261 (replaced) [pdf, other]
Title: Convergence and Implicit Regularization Properties of Gradient Descent for Deep Residual Networks
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)
[ total of 26 entries: 1-26 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, math, recent, 2301, contact, help  (Access key information)