Optimization and Control
New submissions
[ showing up to 1000 entries per page: fewer | more ]
New submissions for Thu, 28 Mar 24
- [1] arXiv:2403.18044 [pdf, other]
-
Title: Deep polytopic autoencoders for low-dimensional linear parameter-varying approximations and nonlinear feedback designComments: 9 pages, 6 figures, 2 tablesSubjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Dynamical Systems (math.DS); Numerical Analysis (math.NA); Fluid Dynamics (physics.flu-dyn)
Polytopic autoencoders provide low-dimensional parametrizations of states in a polytope. For nonlinear PDEs, this is readily applied to low-dimensional linear parameter-varying (LPV) approximations as they have been exploited for efficient nonlinear controller design via series expansions of the solution to the state-dependent Riccati equation. In this work, we develop a polytopic autoencoder for control applications and show how it outperforms standard linear approaches in view of LPV approximations of nonlinear systems and how the particular architecture enables higher order series expansions at little extra computational effort. We illustrate the properties and potentials of this approach to computational nonlinear controller design for large-scale systems with a thorough numerical study.
- [2] arXiv:2403.18091 [pdf, ps, other]
-
Title: The Flying Sidekick Traveling Salesman Problem with Multiple Drops: A Simple and Effective Heuristic ApproachAuthors: Sarah K. Schaumann, Abhishake Kundu, Juan C. Pina-Pardo, Matthias Winkenbach, Ricardo A. Gatica, Stephan M. Wagner, Timothy I. MatisSubjects: Optimization and Control (math.OC)
We study the Flying Sidekick Traveling Salesman Problem with Multiple Drops (FSTSP-MD), a multi-modal last-mile delivery model where a single truck and a single drone cooperatively deliver customer packages. In the FSTSP-MD, the drone can be launched from the truck to deliver multiple packages before it returns to the truck for a new delivery operation. The FSTSP-MD aims to find the synchronized truck and drone delivery routes that minimize the completion time of the delivery process. We develop a simple and effective heuristic approach based on an order-first, split-second scheme. This heuristic combines standard local search and diversification techniques with a novel shortest-path problem that finds FSTSP-MD solutions in polynomial time. We show that our heuristic consistently outperforms state-of-the-art heuristics developed for the FSTSP-MD and the FSTSP (i.e., the single-drop case) through extensive numerical experiments. We also show that the FSTSP-MD substantially reduces completion times compared to a traditional truck-only delivery system. Several managerial insights are described regarding the effects of drone capacity, drone speed, drone flight endurance, and customer distribution.
- [3] arXiv:2403.18124 [pdf, other]
-
Title: Stochastic Finite Volume Method for Uncertainty Management in Gas Pipeline Network FlowsSubjects: Optimization and Control (math.OC); Computation (stat.CO)
Natural gas consumption by users of pipeline networks is subject to increasing uncertainty that originates from the intermittent nature of electric power loads serviced by gas-fired generators. To enable computationally efficient optimization of gas network flows subject to uncertainty, we develop a finite volume representation of stochastic solutions of hyperbolic partial differential equation (PDE) systems on graph-connected domains with nodal coupling and boundary conditions. The representation is used to express the physical constraints in stochastic optimization problems for gas flow allocation subject to uncertain parameters. The method is based on the stochastic finite volume approach that was recently developed for uncertainty quantification in transient flows represented by hyperbolic PDEs on graphs. In this study, we develop optimization formulations for steady-state gas flow over actuated transport networks subject to probabilistic constraints. In addition to the distributions for the physical solutions, we examine the dual variables that are produced by way of the optimization, and interpret them as price distributions that quantify the financial volatility that arises through demand uncertainty modeled in an optimization-driven gas market mechanism. We demonstrate the computation and distributional analysis using a single-pipe example and a small test network.
- [4] arXiv:2403.18130 [pdf, other]
-
Title: Generalized Maximum Entropy Differential Dynamic ProgrammingComments: 7 pages, 5 figures, This paper is for CDC 2024Subjects: Optimization and Control (math.OC); Information Theory (cs.IT)
We present a sampling-based trajectory optimization method derived from the maximum entropy formulation of Differential Dynamic Programming with Tsallis entropy. This method can be seen as a generalization of the legacy work with Shannon entropy, which leads to a Gaussian optimal control policy for exploration during optimization. With the Tsallis entropy, the optimal control policy takes the form of $q$-Gaussian, which further encourages exploration with its heavy-tailed shape. Moreover, in our formulation, the exploration variance, which was scaled by a fixed constant inverse temperature in the original formulation with Shannon entropy, is automatically scaled based on the value function of the trajectory. Due to this property, our algorithms can promote exploration when necessary, that is, the cost of the trajectory is high, rather than using the same scaling factor. The simulation results demonstrate the properties of the proposed algorithm described above.
- [5] arXiv:2403.18131 [pdf, other]
-
Title: Convergence of Iterative Quadratic Programming for Robust Fixed-Endpoint Transfer of Bilinear SystemsSubjects: Optimization and Control (math.OC); Quantum Physics (quant-ph)
We present a computational method for open-loop minimum-norm control synthesis for fixed-endpoint transfer of bilinear ensemble systems that are indexed by two continuously varying parameters. We suppose that one ensemble parameter scales the homogeneous, linear part of the dynamics, and the second parameter scales the effect of the applied control inputs on the inhomogeneous, bilinear dynamics. This class of dynamical systems is motivated by robust quantum control pulse synthesis, where the ensemble parameters correspond to uncertainty in the free Hamiltonian and inhomogeneity in the control Hamiltonian, respectively. Our computational method is based on polynomial approximation of the ensemble state in parameter space and discretization of the evolution equations in the time domain using a product of matrix exponentials corresponding to zero-order hold controls over the time intervals. The dynamics are successively linearized about control and trajectory iterates to formulate a sequence of quadratic programs for computing perturbations to the control that successively improve the objective until the iteration converges. We use a two-stage computation to first ensure transfer to the desired terminal state, and then minimize the norm of the control function. The method is demonstrated for the canonical uniform transfer problem for the Bloch system that appears in nuclear magnetic resonance, as well as the matter-wave splitting problem for the Raman-Nath system that appears in ultra-cold atom interferometry.
- [6] arXiv:2403.18155 [pdf, other]
-
Title: An inexact infeasible arc-search interior-point method for linear programming problemsComments: 25 pages, 3 figuresSubjects: Optimization and Control (math.OC); Numerical Analysis (math.NA)
Inexact interior-point methods (IPMs) are a type of interior-point methods that inexactly solve the linear equation system for obtaining the search direction. On the other hand,arc-search IPMs approximate the central path with an ellipsoidal arc obtained by solving two linear equation systems in each iteration, while conventional line-search IPMs solve one linear system, therefore, the improvement due to the inexact solutions of the linear equation systems can be more beneficial in arc-search IPMs than conventional IPMs. In this paper, we propose an inexact infeasible arc-search interior-point method.We establish that the proposed method is a polynomial-time algorithm through its convergence analysis. The numerical experiments with the conjugate gradient method show that the proposed method can reduce the number of iterations compared to an existing method for benchmark problems; the numbers of iterations are reduced to two-thirds for more than 70% of the problems.
- [7] arXiv:2403.18213 [pdf, other]
-
Title: Long-Term Mine Planning with Large Neighbourhood SearchSubjects: Optimization and Control (math.OC)
We present a Large Neighbourhood Search based approach for solving complex long-term open-pit mine planning problems. An initial feasible solution, generated by a sliding windows heuristic, is improved through repeated solves of a restricted mixed integer program. Each iteration leaves only a subset of the variables in our planning model free to take on new values. We form these subsets through the use of a novel path-based neighbourhood structure, and neighbourhood formation strategies that exploit the structure of the planning model. We show that our method is able to find near-optimal solutions to problems that cannot be solved by an off-the-shelf solver in a reasonable time, or with reasonable computational resources.
- [8] arXiv:2403.18284 [pdf, other]
-
Title: A new dual spectral projected gradient method for log-determinant semidefinite programming with hidden clustering structuresComments: 21 pages, 3 figuresSubjects: Optimization and Control (math.OC)
In this paper, we propose a new efficient method for a sparse Gaussian graphical model with hidden clustering structures by extending a dual spectral projected gradient (DSPG) method proposed by Nakagaki et al.~(2020). We establish the global convergence of the proposed method to an optimal solution, and we show that the projection onto the feasible region can be solved with a low computational complexity by the use of the pool-adjacent-violators algorithm. Numerical experiments on synthesis data and real data demonstrate the efficiency of the proposed method. The proposed method takes 0.91 seconds to achieve a similar solution to the direct application of the DSPG method which takes 4361 seconds.
- [9] arXiv:2403.18297 [pdf, other]
-
Title: A Mean Field Game of Sequential TestingComments: 51 pages, 3 figuresSubjects: Optimization and Control (math.OC); Probability (math.PR)
We introduce a mean field game for a family of filtering problems related to the classic sequential testing of the drift of a Brownian motion. To the best of our knowledge this work presents the first treatment of mean field filtering games with stopping and an unobserved common noise in the literature. We show that the game is well-posed, characterize the solution, and establish the existence of an equilibrium under certain assumptions. We also perform numerical studies for several examples of interest.
- [10] arXiv:2403.18320 [pdf, other]
-
Title: Online Prediction for Streaming Tensor Time SeriesSubjects: Optimization and Control (math.OC)
Real-time prediction plays a vital role in various control systems, such as traffic congestion control and wireless channel resource allocation. In these scenarios, the predictor usually needs to track the evolution of the latent statistical patterns in the modern high-dimensional streaming time series continuously and quickly, which presents new challenges for traditional prediction methods. This paper proposes a novel algorithm based on tensor factorization to predict streaming tensor time series online. The proposed algorithm updates the predictor in a low-complexity online manner to adapt to the time-evolving data. Additionally, an automatically adaptive version of the algorithm is presented to mitigate the negative impact of stale data. Simulation results demonstrate that our proposed methods achieve prediction accuracy similar to that of conventional offline tensor prediction methods, while being much faster than them during long-term online prediction. Therefore, our proposed algorithm provides an effective and efficient solution for the online prediction of streaming tensor time series.
- [11] arXiv:2403.18363 [pdf, other]
-
Title: Computing safe bicycle routes -- Berechnung sicherer FahrradwegeComments: 13 pages in GermanSubjects: Optimization and Control (math.OC)
The safety of streets is difficult to quantify numerically. However, it is possible to sort streets regarding their safety into ordered categories, like safe, neutral and unsafe. In this paper we model the computation of safe bicycle routes as an optimization problem with ordinal coefficients. We describe an appropriate optimality concept for ordinal optimization problems and introduce a solution strategy for ordinal routing problems. Furthermore, we introduce a concept to incorporate safety preferences by introducing weights such that longer path with a higher safety rating are preferred. We apply the concept of ordinal routing to compute safe bicycle routes in Stuttgart, Germany, based on dates from OpenStreetMaps. We show that the choice of the weights does not only represent the trade-off of safety vs. path length, but has also an impact on the number of alternative solutions and thus on the computation time.
--
Die Sicherheit von Wegen ist nur eingeschr\"ankt messbar und daher schwierig zu quantifizieren. Dahingegen ist es verh\"altnism\"a{\ss}ig leicht Wege bez\"uglich ihrer Sicherheit in geordnete Kategorien, wie beispielsweise sicher, neutral und gef\"ahrlich einzuordnen. In diesem Beitrag werden Optimierungsprobleme mit geordneten Kategorien formuliert und Optimalit\"at f\"ur diese definiert. Daraus wird eine L\"osungsstrategie f\"ur solche Probleme abgeleitet. Dar\"uber hinaus wird erkl\"art, wie die Abgrenzung zwischen den Kategorien erh\"oht werden kann, sodass l\"angere aber daf\"ur sicherere Wege mit Hilfe von Gewichten berechnet werden k\"onnen. Diese theoretischen Ergebnisse werden in der Praxis angewendet und es werden auf Grundlage von Daten von OpenStreetMaps sichere Fahrradwege in Stuttgart berechnet. Dabei zeigt sich, dass eine gute Wahl der Gewichte zu weniger L\"osungen und k\"urzeren Rechenzeiten f\"uhrt. - [12] arXiv:2403.18386 [pdf, other]
-
Title: Distributed Feedback Optimization of Linear Multi-agent SystemsComments: 8 pages, 4 figuresSubjects: Optimization and Control (math.OC)
Feedback optimization is an increasingly popular control paradigm to optimize dynamical systems, accounting for control objectives that concern the system's operation at steady-state. Existing feedback optimization techniques heavily rely on centralized system and controller architectures, and thus suffer from scalability and privacy issues when systems become large-scale. In this paper, we propose and study a distributed architecture for feedback optimization, in which each agent updates its local control state by combining the average of its neighbors with a local negative-gradient step. Under convexity and smoothness assumptions, we establish convergence of the control method to a fixed point. By reinforcing the assumptions to restricted strong convexity of the cost, we show that our algorithm converges linearly to a neighborhood of the optimal point, where the size of the neighborhood depends on the choice of the stepsize. Simulations corroborate the theoretical results.
- [13] arXiv:2403.18400 [pdf, ps, other]
-
Title: Reweighted Quasi Norm Regularized Low-Rank Factorization for Matrix Robust PCASubjects: Optimization and Control (math.OC)
Robust Principal Component Analysis (RPCA) and its associated non-convex relaxation methods constitute a significant component of matrix completion problems, wherein matrix factorization strategies effectively reduce dimensionality and enhance computational speed. However, some non-convex factorization forms lack theoretical guarantees. This paper proposes a novel strategy in non-convex quasi-norm representation, introducing a method to obtain weighted matrix quasi-norm factorization forms. Especially, explicit bilinear factor matrix factorization formulations for the weighted logarithmic norm and weighted Schatten-$q$ quasi norms with $q=1, 1/2, 2/3$ are provided, along with the establishment of corresponding matrix completion models. An Alternating Direction Method of Multipliers (ADMM) framework algorithm is employed for solving, and convergence results of the algorithm are presented.
- [14] arXiv:2403.18528 [pdf, other]
-
Title: Limited Attention Allocation in a Stochastic Linear Quadratic System with Multiplicative NoiseSubjects: Optimization and Control (math.OC); Mathematical Finance (q-fin.MF)
This study addresses limited attention allocation in a stochastic linear quadratic system with multiplicative noise. Our approach enables strategic resource allocation to enhance noise estimation and improve control decisions. We provide analytical optimal control and propose a numerical method for optimal attention allocation. Additionally, we apply our ffndings to dynamic mean-variance portfolio selection, showing effective resource allocation across time periods and factors, providing valuable insights for investors.
- [15] arXiv:2403.18556 [pdf, other]
-
Title: Numerical optimisation of Dirac eigenvaluesComments: 19 pages, 26 figuresSubjects: Optimization and Control (math.OC); Mathematical Physics (math-ph); Analysis of PDEs (math.AP); Spectral Theory (math.SP)
Motivated by relativistic materials, we develop a numerical scheme to support existing or state new conjectures in the spectral optimisation of eigenvalues of the Dirac operator, subject to infinite-mass boundary conditions. We study the optimality of the regular polygon (respectively, disk) among all polygons of a given number of sides (respectively, arbitrary sets), subject to area or perimeter constraints. We consider the three lowest positive eigenvalues and their ratios. Roughly, we find results analogous to known or expected for the Dirichlet Laplacian, except for the third eigenvalue which does not need to be minimised by the regular polygon (respectively, the disk) for all masses. In addition to the numerical results, a new, mass-dependent upper bound to the lowest eigenvalue in rectangles is proved and its extension to arbitrary quadrilaterals is conjectured.
- [16] arXiv:2403.18557 [pdf, other]
-
Title: Stability Properties of the Impulsive Goodwin's Oscillator in 1-cycleComments: submitted to IEEE CDC 2024Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
The Impulsive Goodwin's Oscillator (IGO) is a mathematical model of a hybrid closed-loop system. It arises by closing a special kind of continuous linear positive time-invariant system with impulsive feedback, which employs both amplitude and frequency pulse modulation. The structure of IGO precludes the existence of equilibria, and all its solutions are oscillatory. With its origin in mathematical biology, the IGO also presents a control paradigm useful in a wide range of applications, in particular dosing of chemicals and medicines. Since the pulse modulation feedback mechanism introduces significant nonlinearity and non-smoothness in the closedloop dynamics, conventional controller design methods fail to apply. However, the hybrid dynamics of IGO reduce to a nonlinear, time-invariant discrete-time system, exhibiting a one-to-one correspondence between periodic solutions of the original IGO and those of the discrete-time system. The paper proposes a design approach that leverages the linearization of the equivalent discrete-time dynamics in the vicinity of a fixed point. A simple and efficient local stability condition of the 1-cycle in terms of the characteristics of the amplitude and frequency modulation functions is obtained.
- [17] arXiv:2403.18618 [pdf, ps, other]
-
Title: Accelerating preconditioned ADMM via degenerate proximal point mappingsSubjects: Optimization and Control (math.OC)
In this paper, we aim to accelerate a preconditioned alternating direction method of multipliers (pADMM), whose proximal terms are convex quadratic functions, for solving linearly constrained convex optimization problems. To achieve this, we first reformulate the pADMM into a form of proximal point method (PPM) with a positive semidefinite preconditioner which can be degenerate due to the lack of strong convexity of the proximal terms in the pADMM. Then we accelerate the pADMM by accelerating the reformulated degenerate PPM (dPPM). Specifically, we first propose an accelerated dPPM by integrating the Halpern iteration and the fast Krasnosel'ski\u{i}-Mann iteration into it, achieving asymptotic $o(1/k)$ and non-asymptotic $O(1/k)$ convergence rates. Subsequently, building upon the accelerated dPPM, we develop an accelerated pADMM algorithm that exhibits both asymptotic $o(1/k)$ and non-asymptotic $O(1/k)$ nonergodic convergence rates concerning the Karush-Kuhn-Tucker residual and the primal objective function value gap. Preliminary numerical experiments validate the theoretical findings, demonstrating that the accelerated pADMM outperforms the pADMM in solving convex quadratic programming problems.
- [18] arXiv:2403.18707 [pdf, other]
-
Title: Connections between Reachability and Time OptimalityComments: Submitted to AutomaticaSubjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
This paper presents the concept of an equivalence relation between the set of optimal control problems. By leveraging this concept, we show that the boundary of the reachability set can be constructed by the solutions of time optimal problems. Alongside, a more generalized equivalence theorem is presented together. The findings facilitate the use of solution structures from a certain class of optimal control problems to address problems in corresponding equivalent classes. As a byproduct, we state and prove the construction methods of the reachability sets of three-dimensional curves with prescribed curvature bound. The findings are twofold: Firstly, we prove that any boundary point of the reachability set, with the terminal direction taken into account, can be accessed via curves of H, CSC, CCC, or their respective subsegments, where H denotes a helicoidal arc, C a circular arc with maximum curvature, and S a straight segment. Secondly, we show that any boundary point of the reachability set, without considering the terminal direction, can be accessed by curves of CC, CS, or their respective subsegments. These findings extend the developments presented in literature regarding planar curves, or Dubins car dynamics, into spatial curves in $\mathbb{R}^3$. For higher dimensions, we confirm that the problem of identifying the reachability set of curvature bounded paths subsumes the well-known Markov-Dubins problem. These advancements in understanding the reachability of curvature bounded paths in $\mathbb{R}^3$ hold significant practical implications, particularly in the contexts of mission planning problems and time optimal guidance.
- [19] arXiv:2403.18744 [pdf, other]
-
Title: A nonsmooth Frank-Wolfe algorithm through a dual cutting-plane approachSubjects: Optimization and Control (math.OC)
An extension of the Frank-Wolfe Algorithm (FWA), also known as Conditional Gradient algorithm, is proposed. In its standard form, the FWA allows to solve constrained optimization problems involving $\beta$-smooth cost functions, calling at each iteration a Linear Minimization Oracle. More specifically, the oracle solves a problem obtained by linearization of the original cost function. The algorithm designed and investigated in this article, named Dualized Level-Set (DLS) algorithm, extends the FWA and allows to address a class of nonsmooth costs, involving in particular support functions. The key idea behind the construction of the DLS method is a general interpretation of the FWA as a cutting-plane algorithm, from the dual point of view. The DLS algorithm essentially results from a dualization of a specific cutting-plane algorithm, based on projections on some level sets. The DLS algorithm generates a sequence of primal-dual candidates, and we prove that the corresponding primal-dual gap converges with a rate of $O(1/\sqrt{t})$.
- [20] arXiv:2403.18767 [pdf, other]
-
Title: The best approximation pair problem relative to two subsets in a normed spaceSubjects: Optimization and Control (math.OC); Functional Analysis (math.FA); Metric Geometry (math.MG)
In the classical best approximation pair (BAP) problem, one is given two nonempty, closed, convex and disjoint subsets in a finite- or an infinite-dimensional Hilbert space, and the goal is to find a pair of points, each from each subset, which realizes the distance between the subsets. This problem, which has a long history, has found applications in science and technology. We discuss the problem in more general normed spaces and with possibly non-convex subsets, and focus our attention on the issues of uniqueness and existence of the solution to the problem. To the best of our knowledge these fundamental issues have not received much attention. In particular, we present several sufficient geometric conditions for the (at most) uniqueness of a BAP relative to these subsets. These conditions are related to the structure of the boundaries of the subsets, their relative orientation, and the structure of the unit sphere of the space. In addition, we present many sufficient conditions for the existence of a BAP, possibly without convexity . Our results allow us to significantly extend the horizon of the recent alternating simultaneous Halpern-Lions-Wittmann-Bauschke (A-S-HLWB) algorithm [Censor, Mansour and Reem, The alternating simultaneous Halpern-Lions-Wittmann-Bauschke algorithm for finding the best approximation pair for two disjoint intersections of convex sets, arXiv:2304.09600 (2023)] for solving the BAP problem.
Cross-lists for Thu, 28 Mar 24
- [21] arXiv:2403.17963 (cross-list from math.NA) [pdf, other]
-
Title: A better compression driver? CutFEM 3D shape optimization taking viscothermal losses into accountSubjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
The compression driver, the standard sound source for midrange acoustic horns, contains a cylindrical compression chamber connected to the horn throat through a system of channels known as a phase plug. The main challenge in the design of the phase plug is to avoid resonance and interference phenomena. The complexity of these phenomena makes it difficult to carry out this design task manually, particularly when the phase-plug channels are radially oriented. Therefore, we employ an algorithmic technique that combines numerical solutions of the governing equations with a gradient-based optimization algorithm that can deform the walls of the phase plug. A particular modeling challenge here is that viscothermal losses cannot be ignored, due to narrow chambers and slits in the device. Fortunately, a recently developed, accurate, but computationally inexpensive boundary-layer model is applicable. We use this model, a level-set geometry description, and the Cut Finite Element technique to avoid mesh changes when the geometry is modified by the optimization algorithm. Moreover, the shape calculus needed to compute derivatives for the optimization algorithm is carried out in the fully discrete case. Applying these techniques, the algorithm was able to successfully design the shape of a set of radially-directed phase plugs so that the final frequency response surprisingly closely matches the ideal response, derived by a lumped circuit model where wave interference effects are not accounted for. This result may serve to resuscitate the radial phase plug design, rarely used in today's commercial compression drivers.
- [22] arXiv:2403.18149 (cross-list from cs.RO) [pdf, other]
-
Title: Code Generation for Conic Model-Predictive Control on Microcontrollers with TinyMPCComments: Submitted to CDC, 2024. First two authors contributed equallySubjects: Robotics (cs.RO); Systems and Control (eess.SY); Optimization and Control (math.OC)
Conic constraints appear in many important control applications like legged locomotion, robotic manipulation, and autonomous rocket landing. However, current solvers for conic optimization problems have relatively heavy computational demands in terms of both floating-point operations and memory footprint, making them impractical for use on small embedded devices. We extend TinyMPC, an open-source, high-speed solver targeting low-power embedded control applications, to handle second-order cone constraints. We also present code-generation software to enable deployment of TinyMPC on a variety of microcontrollers. We benchmark our generated code against state-of-the-art embedded QP and SOCP solvers, demonstrating a two-order-of-magnitude speed increase over ECOS while consuming less memory. Finally, we demonstrate TinyMPC's efficacy on the Crazyflie, a lightweight, resource-constrained quadrotor with fast dynamics. TinyMPC and its code-generation tools are publicly available at https://tinympc.org.
- [23] arXiv:2403.18164 (cross-list from eess.SY) [pdf, other]
-
Title: Incentive Designs for Learning Agents to Stabilize Coupled Exogenous SystemsComments: 8 pages, 3 figuresSubjects: Systems and Control (eess.SY); Dynamical Systems (math.DS); Optimization and Control (math.OC)
We consider a large population of learning agents noncooperatively selecting strategies from a common set, influencing the dynamics of an exogenous system (ES) we seek to stabilize at a desired equilibrium. Our approach is to design a dynamic payoff mechanism capable of shaping the population's strategy profile, thus affecting the ES's state, by offering incentives for specific strategies within budget limits. Employing system-theoretic passivity concepts, we establish conditions under which a payoff mechanism can be systematically constructed to ensure the global asymptotic stabilization of the ES's equilibrium. In comparison to previous approaches originally studied in the context of the so-called epidemic population games, the method proposed here allows for more realistic epidemic models and other types of ES, such as predator-prey dynamics. Stabilization is established with the support of a Lyapunov function, which provides useful bounds on the transients.
- [24] arXiv:2403.18166 (cross-list from eess.SY) [pdf, other]
-
Title: Incentive-Compatible Vertiport Reservation in Advanced Air Mobility: An Auction-Based ApproachComments: 26 pages, 2 figures, 1 tableSubjects: Systems and Control (eess.SY); Multiagent Systems (cs.MA); Theoretical Economics (econ.TH); Optimization and Control (math.OC)
The rise of advanced air mobility (AAM) is expected to become a multibillion-dollar industry in the near future. Market-based mechanisms are touted to be an integral part of AAM operations, which comprise heterogeneous operators with private valuations. In this work, we study the problem of designing a mechanism to coordinate the movement of electric vertical take-off and landing (eVTOL) aircraft, operated by multiple operators each having heterogeneous valuations associated with their fleet, between vertiports, while enforcing the arrival, departure, and parking constraints at vertiports. Particularly, we propose an incentive-compatible and individually rational vertiport reservation mechanism that maximizes a social welfare metric, which encapsulates the objective of maximizing the overall valuations of all operators while minimizing the congestion at vertiports. Additionally, we improve the computational tractability of designing the reservation mechanism by proposing a mixed binary linear programming approach that is based on constructing network flow graph corresponding to the underlying problem.
- [25] arXiv:2403.18176 (cross-list from cs.LG) [pdf, other]
-
Title: Mistake, Manipulation and Margin Guarantees in Online Strategic ClassificationSubjects: Machine Learning (cs.LG); Computer Science and Game Theory (cs.GT); Optimization and Control (math.OC)
We consider an online strategic classification problem where each arriving agent can manipulate their true feature vector to obtain a positive predicted label, while incurring a cost that depends on the amount of manipulation. The learner seeks to predict the agent's true label given access to only the manipulated features. After the learner releases their prediction, the agent's true label is revealed. Previous algorithms such as the strategic perceptron guarantee finitely many mistakes under a margin assumption on agents' true feature vectors. However, these are not guaranteed to encourage agents to be truthful. Promoting truthfulness is intimately linked to obtaining adequate margin on the predictions, thus we provide two new algorithms aimed at recovering the maximum margin classifier in the presence of strategic agent behavior. We prove convergence, finite mistake and finite manipulation guarantees for a variety of agent cost structures. We also provide generalized versions of the strategic perceptron with mistake guarantees for different costs. Our numerical study on real and synthetic data demonstrates that the new algorithms outperform previous ones in terms of margin, number of manipulation and number of mistakes.
- [26] arXiv:2403.18184 (cross-list from physics.app-ph) [pdf, other]
-
Title: Topology Optimization for the Full-Cell Design of Porous Electrodes in Electrochemical Energy Storage DevicesAuthors: Hanyu Li, Giovanna Bucci, Nicholas W. Brady, Nicholas R. Cross, Victoria M. Ehlinger, Tiras Y. Lin, Miguel Salazar de Troya, Daniel Tortorelli, Marcus A. Worsley, Thomas RoySubjects: Applied Physics (physics.app-ph); Optimization and Control (math.OC)
In this paper, we introduce a density-based topology optimization framework to design porous electrodes for maximum energy storage. We simulate the full cell with a model that incorporates electronic potential, ionic potential, and electrolyte concentration. The system consists of three materials, namely pure liquid electrolyte and the porous solids of the anode and cathode, for which we determine the optimal placement. We use separate electronic potentials to model each electrode, which allow interdigitated designs. As the result, a penalization is required to ensure that the anode and cathode do not touch, i.e. causing a short circuit. We compare multiple 2D designs generated for different fixed conditions, e.g. material properties. A 3D design with complex channel and interlocking structure is also created. All optimized designs are far superior to the traditional monolithic electrode design with respect to energy storage metrics. We observe up to 750% increase in energy storage for cases with slow effective ionic diffusion within the porous electrode.
- [27] arXiv:2403.18235 (cross-list from eess.SY) [pdf, other]
-
Title: An Execution-time-certified QP Algorithm for $\ell_1$ penalty-based Soft-constrained MPCComments: 6 pagesSubjects: Systems and Control (eess.SY); Optimization and Control (math.OC)
Providing an execution time certificate and handling possible infeasibility in closed-loop are two pressing requirements of Model Predictive Control (MPC). To simultaneously meet these two requirements, this paper uses $\ell_1$ penalty-based soft-constrained MPC formulation and innovatively transforms the resulting non-smooth QP into a box-constrained QP, which is solved by our previously proposed direct and execution-time certified algorithm with only dimension-dependent (data-independent) and exact number of iterations [1]. This approach not only overcomes the limitation of our previously proposed algorithm [1], only applicable to input-constrained MPC, but also enjoys exact recovery feature (exactly recover the same solution when the original problem is feasible) of $\ell_1$ penalty-based soft-constrained MPC formulation without suffering numerical difficulty of the resulting non-smoothness. Other various real-time QP applications, not limited to MPC, will also benefit from our QP algorithm with execution-time certificate and global feasibility.
- [28] arXiv:2403.18285 (cross-list from math.NA) [pdf, other]
-
Title: Stability and convergence of the penalty formulation for nonlinear magnetostaticsSubjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
The magnetostatic field distribution in a nonlinear medium amounts to the unique minimizer of the magnetic coenergy over all fields that can be generated by the same current. This is a nonlinear saddlepoint problem whose numerical solution can in principle be achieved by mixed finite element methods and appropriate nonlinear solvers. The saddlepoint structure, however, makes the solution cumbersome. A remedy is to split the magnetic field into a known source field and the gradient of a scalar potential which is governed by a convex minimization problem. The penalty approach avoids the use of artificial potentials and Lagrange multipliers and leads to an unconstrained convex minimization problem involving a large parameter. We provide a rigorous justification of the penalty approach by deriving error estimates for the approximation due to penalization. We further highlight the close connections to the Lagrange-multiplier and scalar potential approach. The theoretical results are illustrated by numerical tests for a typical benchmark problem
- [29] arXiv:2403.18368 (cross-list from math.FA) [pdf, other]
-
Title: The Mercer-Young Theorem for Matrix-Valued Kernels on Separable Metric SpacesComments: 12 pages, 2 figuresSubjects: Functional Analysis (math.FA); Optimization and Control (math.OC)
We generalize the characterization theorem going back to Mercer and Young, which states that a symmetric and continuous kernel is positive definite if and only if it is integrally positive definite. More precisely, we extend the result from real-valued kernels on compact intervals to matrix-valued kernels on separable metric spaces. We also demonstrate the applications of the generalized theorem to the field of convex optimization.
- [30] arXiv:2403.18398 (cross-list from eess.SY) [pdf, ps, other]
-
Title: Adaptive Economic Model Predictive Control for linear systems with performance guaranteesComments: 8 pages, 3 figures, submitted to IEEE CDC 2024Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)
We present a model predictive control (MPC) formulation to directly optimize economic criteria for linear constrained systems subject to disturbances and uncertain model parameters. The proposed formulation combines a certainty equivalent economic MPC with a simple least-squares parameter adaptation. For the resulting adaptive economic MPC scheme, we derive strong asymptotic and transient performance guarantees. We provide a numerical example involving building temperature control and demonstrate performance benefits of online parameter adaptation.
- [31] arXiv:2403.18517 (cross-list from cs.LG) [pdf, other]
-
Title: Efficient Algorithms for Regularized Nonnegative Scale-invariant Low-rank Approximation ModelsSubjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Optimization and Control (math.OC)
Regularized nonnegative low-rank approximations such as sparse Nonnegative Matrix Factorization or sparse Nonnegative Tucker Decomposition are an important branch of dimensionality reduction models with enhanced interpretability. However, from a practical perspective, the choice of regularizers and regularization coefficients, as well as the design of efficient algorithms, is challenging because of the multifactor nature of these models and the lack of theory to back these choices. This paper aims at improving upon these issues. By studying a more general model called the Homogeneous Regularized Scale-Invariant, we prove that the scale-invariance inherent to low-rank approximation models causes an implicit regularization with both unexpected beneficial and detrimental effects. This observation allows to better understand the effect of regularization functions in low-rank approximation models, to guide the choice of the regularization hyperparameters, and to design balancing strategies to enhance the convergence speed of dedicated optimization algorithms. Some of these results were already known but restricted to specific instances of regularized low-rank approximations. We also derive a generic Majorization Minimization algorithm that handles many regularized nonnegative low-rank approximations, with convergence guarantees. We showcase our contributions on sparse Nonnegative Matrix Factorization, ridge-regularized Canonical Polyadic decomposition and sparse Nonnegative Tucker Decomposition.
- [32] arXiv:2403.18527 (cross-list from math.NA) [pdf, other]
-
Title: Wirtinger gradient descent methods for low-dose Poisson phase retrievalSubjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
The problem of phase retrieval has many applications in the field of optical imaging. Motivated by imaging experiments with biological specimens, we primarily consider the setting of low-dose illumination where Poisson noise plays the dominant role. In this paper, we discuss gradient descent algorithms based on different loss functions adapted to data affected by Poisson noise, in particular in the low-dose regime. Starting from the maximum log-likelihood function for the Poisson distribution, we investigate different regularizations and approximations of the problem to design an algorithm that meets the requirements that are faced in applications. In the course of this, we focus on low-count measurements. For all suggested loss functions, we study the convergence of the respective gradient descent algorithms to stationary points and find constant step sizes that guarantee descent of the loss in each iteration. Numerical experiments in the low-dose regime are performed to corroborate the theoretical observations.
- [33] arXiv:2403.18552 (cross-list from math.NA) [pdf, other]
-
Title: Generalized convergence of the deep BSDE method: a step towards fully-coupled FBSDEs and applications in stochastic controlComments: 25 pages, 3 figures, 1 tableSubjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
We are concerned with high-dimensional coupled FBSDE systems approximated by the deep BSDE method of Han et al. (2018). It was shown by Han and Long (2020) that the errors induced by the deep BSDE method admit a posteriori estimate depending on the loss function, whenever the backward equation only couples into the forward diffusion through the Y process. We generalize this result to fully-coupled drift coefficients, and give sufficient conditions for convergence under standard assumptions. The resulting conditions are directly verifiable for any equation. Consequently, unlike in earlier theory, our convergence analysis enables the treatment of FBSDEs stemming from stochastic optimal control problems. In particular, we provide a theoretical justification for the non-convergence of the deep BSDE method observed in recent literature, and present direct guidelines for when convergence can be guaranteed in practice. Our theoretical findings are supported by several numerical experiments in high-dimensional settings.
- [34] arXiv:2403.18571 (cross-list from eess.SY) [pdf, ps, other]
-
Title: Bootstrapping Guarantees: Stability and Performance Analysis for Dynamic Encrypted ControlSubjects: Systems and Control (eess.SY); Cryptography and Security (cs.CR); Optimization and Control (math.OC)
Encrypted dynamic controllers that operate for an unlimited time have been a challenging subject of research. The fundamental difficulty is the accumulation of errors and scaling factors in the internal state during operation. Bootstrapping, a technique commonly employed in fully homomorphic cryptosystems, can be used to avoid overflows in the controller state but can potentially introduce significant numerical errors. In this paper, we analyze dynamic encrypted control with explicit consideration of bootstrapping. By recognizing the bootstrapping errors occurring in the controller's state as an uncertainty in the robust control framework, we can provide stability and performance guarantees for the whole encrypted control system. Further, the conservatism of the stability and performance test is reduced by using a lifted version of the control system.
- [35] arXiv:2403.18705 (cross-list from cs.LG) [pdf, other]
-
Title: Conditional Wasserstein Distances with Applications in Bayesian OT Flow MatchingComments: This paper supersedes arXiv:2310.13433Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)
In inverse problems, many conditional generative models approximate the posterior measure by minimizing a distance between the joint measure and its learned approximation. While this approach also controls the distance between the posterior measures in the case of the Kullback--Leibler divergence, this is in general not hold true for the Wasserstein distance. In this paper, we introduce a conditional Wasserstein distance via a set of restricted couplings that equals the expected Wasserstein distance of the posteriors. Interestingly, the dual formulation of the conditional Wasserstein-1 flow resembles losses in the conditional Wasserstein GAN literature in a quite natural way. We derive theoretical properties of the conditional Wasserstein distance, characterize the corresponding geodesics and velocity fields as well as the flow ODEs. Subsequently, we propose to approximate the velocity fields by relaxing the conditional Wasserstein distance. Based on this, we propose an extension of OT Flow Matching for solving Bayesian inverse problems and demonstrate its numerical advantages on an inverse problem and class-conditional image generation.
Replacements for Thu, 28 Mar 24
- [36] arXiv:2302.01421 (replaced) [pdf, other]
-
Title: Follower Agnostic Methods for Stackelberg GamesComments: 31 pagesSubjects: Optimization and Control (math.OC); Artificial Intelligence (cs.AI); Computer Science and Game Theory (cs.GT); Dynamical Systems (math.DS)
- [37] arXiv:2307.00975 (replaced) [pdf, other]
-
Title: Fast Convergence of Inertial Multiobjective Gradient-like Systems with Asymptotic Vanishing DampingComments: 25 pages, 3 FiguresSubjects: Optimization and Control (math.OC)
- [38] arXiv:2309.02032 (replaced) [pdf, other]
-
Title: A novel strong duality-based reformulation for trilevel infrastructure models in energy systems developmentComments: 22 pages, 4 figuresSubjects: Optimization and Control (math.OC)
- [39] arXiv:2312.07394 (replaced) [pdf, other]
-
Title: On model predictive control with sampled-data input for output tracking with prescribed performanceSubjects: Optimization and Control (math.OC)
- [40] arXiv:2401.03244 (replaced) [pdf, other]
-
Title: Artificial Intelligence for Operations Research: Revolutionizing the Operations Research ProcessSubjects: Optimization and Control (math.OC); Artificial Intelligence (cs.AI)
- [41] arXiv:2403.06708 (replaced) [pdf, ps, other]
-
Title: Tikhonov Regularization for Stochastic Non-Smooth Convex Optimization in Hilbert SpacesComments: 34 pages, 2 tables. arXiv admin note: text overlap with arXiv:2207.02750Subjects: Optimization and Control (math.OC)
- [42] arXiv:2403.14396 (replaced) [pdf, ps, other]
-
Title: Infinite horizon McKean-Vlasov FBSDEs and applications to mean field control problemsSubjects: Optimization and Control (math.OC); Probability (math.PR)
- [43] arXiv:2403.17850 (replaced) [pdf, ps, other]
-
Title: A Mixed-Integer Linear Program to create the shifts in a supermarketSubjects: Optimization and Control (math.OC)
- [44] arXiv:2201.06180 (replaced) [pdf, other]
-
Title: Nonlinear Control Allocation: A Learning Based ApproachComments: submitted to IEEE Conference on Decision and Control (CDC), 2024Subjects: Systems and Control (eess.SY); Artificial Intelligence (cs.AI); Optimization and Control (math.OC)
- [45] arXiv:2208.02767 (replaced) [pdf, other]
-
Title: Parabolic PDE-constrained optimal control under uncertainty with entropic risk measure using quasi-Monte Carlo integrationSubjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
- [46] arXiv:2210.11634 (replaced) [pdf, other]
-
Title: A Polynomial-time Algorithm for the Large Scale of Airplane Refueling ProblemComments: 18 pages, 2 figuresSubjects: Data Structures and Algorithms (cs.DS); Optimization and Control (math.OC)
- [47] arXiv:2307.16075 (replaced) [pdf, ps, other]
-
Title: Redesigning Large-Scale Multimodal Transit Networks with Shared Autonomous Mobility ServicesComments: 48 pages, 18 figures, accepted for publication in Transportation Research Part C: Emerging Technologies, and presentation in the 25th International Symposium on Transportation and Traffic Theory (ISTTT25)Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)
- [48] arXiv:2308.06822 (replaced) [pdf, other]
-
Title: Approximate and Weighted Data Reconstruction Attack in Federated LearningSubjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Optimization and Control (math.OC)
- [49] arXiv:2312.12558 (replaced) [pdf, other]
-
Title: Sample Efficient Reinforcement Learning with Partial Dynamics KnowledgeComments: Published in the 38th Annual AAAI Conference on Artificial IntelligenceSubjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)
- [50] arXiv:2402.11800 (replaced) [pdf, other]
-
Title: Stochastic Approximation with Delayed Updates: Finite-Time Rates under Markovian SamplingAuthors: Arman Adibi, Nicolo Dal Fabbro, Luca Schenato, Sanjeev Kulkarni, H. Vincent Poor, George J. Pappas, Hamed Hassani, Aritra MitraComments: Accepted to the 27th International Conference on Artificial Intelligence and Statistics (AISTATS) 2024!Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA); Systems and Control (eess.SY); Optimization and Control (math.OC)
- [51] arXiv:2403.00465 (replaced) [pdf, other]
-
Title: Polyamorous SchedulingComments: v2: stronger and simplified hardness-of-approximation results, corrected constant in layering approximation algorithmSubjects: Data Structures and Algorithms (cs.DS); Social and Information Networks (cs.SI); Optimization and Control (math.OC)
[ showing up to 1000 entries per page: fewer | more ]
Disable MathJax (What is MathJax?)
Links to: arXiv, form interface, find, math, recent, 2403, contact, help (Access key information)