We gratefully acknowledge support from
the Simons Foundation and member institutions.

Optimization and Control

New submissions

[ total of 24 entries: 1-24 ]
[ showing up to 500 entries per page: fewer | more ]

New submissions for Thu, 25 Apr 24

[1]  arXiv:2404.15359 [pdf, ps, other]
Title: Dynamically Iterated Filters: A unified framework for improved iterated filtering and smoothing
Comments: 12 pages. Submitted to Journal of Advances in Information Fusion for possible publication
Subjects: Optimization and Control (math.OC)

Typical iterated filters, such as the iterated extended Kalman filter (IEKF), iterated unscented Kalman filter (IUKF), and iterated posterior linearization filter (IPLF), have been developed to improve the linearization point (or density) of the likelihood linearization in the well-known extended Kalman filter (EKF) and unscented Kalman filter (UKF). A shortcoming of typical iterated filters is that they do not treat the linearization of the transition model of the system. To remedy this shortcoming, we introduce dynamically iterated filters (DIFs), a unified framework for iterated linearization-based nonlinear filters that deals with nonlinearities in both the transition model and the likelihood, thereby constituting a generalization of the aforementioned iterated filters. We further establish a relationship between the general DIF and the approximate iterated Rauch-Tung-Striebel smoother. This relationship allows for a Gauss-Newton interpretation, which in turn enables explicit step-size correction, leading to damped versions of the DIFs. The developed algorithms, both damped and non-damped, are numerically demonstrated in three examples, showing superior mean-squared error as well as improved parameter tuning robustness as compared to the analogous standard iterated filters.

[2]  arXiv:2404.15570 [pdf, other]
Title: Air-taxi trajectory optimization with aerodynamic and motor models
Subjects: Optimization and Control (math.OC)

Many air-taxi concepts are capable of vertical takeoff and landing, enabling them to fly to and from urban locations. An important capability for these air taxis is the transition between hover and forward flight. We propose a robust methodology for computing optimal takeoff and transition trajectories using surrogate models trained on data from physics-based models. The use of surrogate models reduces the computational complexity and improves the robustness of the trajectory optimization algorithm. We demonstrate the versatility and robustness of the proposed methodology by applying it to 12 trajectory optimization problems that involve air-taxi takeoff and outbound transition. These trajectories are representative of real air-taxi operations, with a variety of constraints derived, in part, from proposed mission requirements.

[3]  arXiv:2404.15571 [pdf, ps, other]
Title: A note on the generalised Hessian of the least squares associated with systems of linear inequalities
Authors: M.V. Dolgopolik
Subjects: Optimization and Control (math.OC)

The goal of this note is to point out an erroneous formula for the generalised Hessian of the least squares associated with a system of linear inequalities, that was given in the paper "A finite Newton method for classification" by O.L. Mangasarian (Optim. Methods Softw. 17: 913--929, 2002) and reproduced multiple times in other publications. We also provide sufficient contiditions for the validity of Mangasarian's formula and show that Slater's condition guarantees that some particular elements from the set defined by Mangasarian belong to the generalised Hessian of the corresponding function.

[4]  arXiv:2404.15581 [pdf, ps, other]
Title: Decentralized Exchangeable Stochastic Dynamic Teams in Continuous-time, their Mean-Field Limits and Optimality of Symmetric Policies
Subjects: Optimization and Control (math.OC)

We study a class of stochastic exchangeable teams comprising a finite number of decision makers (DMs) as well as their mean-field limits involving infinite numbers of DMs. In the finite population regime, we study exchangeable teams under the centralized information structure. For the infinite population setting, we study exchangeable teams under the decentralized mean-field information sharing. The paper makes the following main contributions: i) For finite population exchangeable teams, we establish the existence of a randomized optimal policy that is exchangeable (permutation invariant) and Markovian; ii) As our main result in the paper, we show that a sequence of exchangeable optimal policies for finite population settings converges to a conditionally symmetric (identical), independent, and decentralized randomized policy for the infinite population problem, which is globally optimal for the infinite population problem. This result establishes the existence of a symmetric, independent, decentralized optimal randomized policy for the infinite population problem. Additionally, this proves the optimality of the limiting measure-valued MDP for the representative DM; iii) Finally, we show that symmetric, independent, decentralized optimal randomized policies are approximately optimal for the corresponding finite-population team with a large number of DMs under the centralized information structure. Our paper thus establishes the relation between the controlled McKean-Vlasov dynamics and the optimal infinite population decentralized stochastic control problem (without an apriori restriction of symmetry in policies of individual agents), for the first time, to our knowledge.

[5]  arXiv:2404.15688 [pdf, ps, other]
Title: Observer-Based Realization of Control Systems
Subjects: Optimization and Control (math.OC)

Lebesgue-type of dynamic control systems and dimension-keeping semi-tensor product (DK-STP) of matrices are introduced. Using bridge matrices, the DK-STP is used to construct approximated observer-based realization (OR) of linear control systems, as Lebesgue-type control systems, are proposed. A necessary and sufficient condition for the OR-system to have exactly same observer dynamics is obtained. When the exact OR-system does not exist, the extended OR-system, which contains observers of the original system as part of its state variables, is presented. Moreover, the (minimum) feedback (extended) OR-system is also constructed, and its relationship with Kalman's minimum realization is revealed. Finally, the technique developed for linear control systems has been extended to affine nonlinear control systems. The purpose of OR-system is to provide a new technique to deal with large scale complex systems.

[6]  arXiv:2404.15710 [pdf, other]
Title: Stability and Bounded Real Lemmas of Discrete-Time MJLSs with the Markov Chain on a Borel Space
Subjects: Optimization and Control (math.OC)

In this paper, exponential stability of discrete-time Markov jump linear systems (MJLSs) with the Markov chain on a Borel space $(\Theta, \mathcal{B}(\Theta))$ is studied, and bounded real lemmas (BRLs) are given. The work generalizes the results from the previous literature that considered only the Markov chain taking values in a countable set to the scenario of an uncountable set and provides unified approaches for describing exponential stability and $H_{\infty}$ performance of MJLSs. This paper covers two kinds of exponential stabilities: one is exponential mean-square stability with conditioning (EMSSy-C), and the other is exponential mean-square stability (EMSSy). First, based on the infinite-dimensional operator theory, the equivalent conditions for determining these two kinds of stabilities are shown respectively by the exponentially stable evolutions generated by the corresponding bounded linear operators on different Banach spaces, which turn out to present the spectral criteria of EMSSy-C and EMSSy. Furthermore, the relationship between these two kinds of stabilities is discussed. Moreover, some easier-to-check criteria are established for EMSSy-C of MJLSs in terms of the existence of uniformly positive definite solutions of Lyapunov-type equations or inequalities. In addition, BRLs are given separately in terms of the existence of solutions of the $\Theta$-coupled difference Riccati equation for the finite horizon case and algebraic Riccati equation for the infinite horizon case, which facilitates the $H_{\infty}$ analysis of MJLSs with the Markov chain on a Borel space.

Cross-lists for Thu, 25 Apr 24

[7]  arXiv:2404.15302 (cross-list from eess.SP) [pdf, other]
Title: Robust Phase Retrieval by Alternating Minimization
Subjects: Signal Processing (eess.SP); Optimization and Control (math.OC); Statistics Theory (math.ST)

We consider a least absolute deviation (LAD) approach to the robust phase retrieval problem that aims to recover a signal from its absolute measurements corrupted with sparse noise. To solve the resulting non-convex optimization problem, we propose a robust alternating minimization (Robust-AM) derived as an unconstrained Gauss-Newton method. To solve the inner optimization arising in each step of Robust-AM, we adopt two computationally efficient methods for linear programs. We provide a non-asymptotic convergence analysis of these practical algorithms for Robust-AM under the standard Gaussian measurement assumption. These algorithms, when suitably initialized, are guaranteed to converge linearly to the ground truth at an order-optimal sample complexity with high probability while the support of sparse noise is arbitrarily fixed and the sparsity level is no larger than $1/4$. Additionally, through comprehensive numerical experiments on synthetic and image datasets, we show that Robust-AM outperforms existing methods for robust phase retrieval offering comparable theoretical performance

[8]  arXiv:2404.15546 (cross-list from math.CO) [pdf, ps, other]
Title: Modular Forms in Combinatorial Optimization
Authors: Varsha Gupta
Subjects: Combinatorics (math.CO); Optimization and Control (math.OC)

Combinatorial optimization problems, such as the Asymmetric Traveling Salesman Problem (ATSP), find applications across various domains including logistics, genome sequencing, and robotics. Despite their extensive applications, there have not been significant advancements in deriving optimal solutions for these problems. The lack of theoretical understanding owing to the complex structure of these problems has hindered the development of sophisticated algorithms. This paper proposes an unconventional approach by translating the ATSP into the complex domain, revealing an intrinsic modular nature of the problem. Furthermore, we have exploited modularity conditions to gain deeper insights into both unconstrained and constrained optimal solutions. The theoretical framework laid out in this paper can lead to important results at the intersection of combinatorial optimization and number theory.

[9]  arXiv:2404.15617 (cross-list from cs.LG) [pdf, other]
Title: DPO: Differential reinforcement learning with application to optimal configuration search
Comments: 24 pages, 1 figure, 2 tables
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Statistics Theory (math.ST)

Reinforcement learning (RL) with continuous state and action spaces remains one of the most challenging problems within the field. Most current learning methods focus on integral identities such as value functions to derive an optimal strategy for the learning agent. In this paper, we instead study the dual form of the original RL formulation to propose the first differential RL framework that can handle settings with limited training samples and short-length episodes. Our approach introduces Differential Policy Optimization (DPO), a pointwise and stage-wise iteration method that optimizes policies encoded by local-movement operators. We prove a pointwise convergence estimate for DPO and provide a regret bound comparable with current theoretical works. Such pointwise estimate ensures that the learned policy matches the optimal path uniformly across different steps. We then apply DPO to a class of practical RL problems which search for optimal configurations with Lagrangian rewards. DPO is easy to implement, scalable, and shows competitive results on benchmarking experiments against several popular RL methods.

[10]  arXiv:2404.15797 (cross-list from math.ST) [pdf, other]
Title: Optimal Experimental Design for Large-Scale Inverse Problems via Multi-PDE-constrained Optimization
Comments: 29 pages, 8 figures
Subjects: Statistics Theory (math.ST); Optimization and Control (math.OC)

Accurate parameter dependent electro-chemical numerical models for lithium-ion batteries are essential in industrial application. The exact parameters of each battery cell are unknown and a process of estimation is necessary to infer them. The parameter estimation generates an accurate model able to reproduce real cell data. The field of optimal input/experimental design deals with creating the experimental settings facilitating the estimation problem. Here we apply two different input design algorithms that aim at maximizing the observability of the true, unknown parameters: in the first algorithm, we design the applied current and the starting voltage. This lets the algorithm collect information on different states of charge, but requires long experimental times (60 000 s). In the second algorithm, we generate a continuous current, composed of concatenated optimal intervals. In this case, the experimental time is shorter (7000 s) and numerical experiments with virtual data give an even better accuracy results, but experiments with real battery data reveal that the accuracy could decrease hundredfold. As the design algorithms are built independent of the model, the same results and motivation are applicable to more complex battery cell models and, moreover, to other applications.

Replacements for Thu, 25 Apr 24

[11]  arXiv:2108.09497 (replaced) [pdf, other]
Title: Internal and String Stability of an Observer-based Controller for Vehicle Platooning under the MPF Topology
Subjects: Optimization and Control (math.OC)
[12]  arXiv:2210.09564 (replaced) [pdf, other]
Title: Input Regularization for Integer Optimal Control in BV with Applications to Control of Poroelastic and Poroviscoelastic Systems
Subjects: Optimization and Control (math.OC)
[13]  arXiv:2303.16659 (replaced) [pdf, other]
Title: Safe Zeroth-Order Optimization Using Quadratic Local Approximations
Comments: arXiv admin note: text overlap with arXiv:2211.02645
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
[14]  arXiv:2304.09600 (replaced) [pdf, other]
Title: The alternating simultaneous Halpern-Lions-Wittmann-Bauschke algorithm for finding the best approximation pair for two disjoint intersections of convex sets
Comments: Accepted for publication in the Journal of Approximation Theory, corrections of various inaccuracies (mainly in the notation of some operators) and better presentations of certain parts following the referees' reports, slight improvements to some items (e.g., Lemma 30, Lemma 32, Algorithm 1, Figure 1), added the following: Remark 31, Section 7, addresses, a few references and thanks
Subjects: Optimization and Control (math.OC); Functional Analysis (math.FA); Numerical Analysis (math.NA)
[15]  arXiv:2306.10564 (replaced) [pdf, other]
Title: On stability and state-norm estimation of switched systems under restricted switching
Authors: Atreyee Kundu
Comments: 17 pages, 4 figures. Longer version of a manuscript under review. arXiv admin note: text overlap with arXiv:2207.07764
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
[16]  arXiv:2309.09819 (replaced) [pdf, ps, other]
Title: Projection-based Prediction-Correction Method for Distributed Consensus Optimization
Authors: Han Long
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
[17]  arXiv:2311.01957 (replaced) [pdf, ps, other]
Title: Distributed online constrained convex optimization with event-triggered communication
Comments: 12 pages, 3 figures
Subjects: Optimization and Control (math.OC); Multiagent Systems (cs.MA)
[18]  arXiv:2403.18284 (replaced) [pdf, other]
Title: A new dual spectral projected gradient method for log-determinant semidefinite programming with hidden clustering structures
Comments: 21 pages, 3 figures
Subjects: Optimization and Control (math.OC)
[19]  arXiv:2404.13228 (replaced) [pdf, other]
Title: Optimal Acceleration for Minimax and Fixed-Point Problems is Not Unique
Subjects: Optimization and Control (math.OC)
[20]  arXiv:2311.18736 (replaced) [pdf, other]
Title: Controlgym: Large-Scale Control Environments for Benchmarking Reinforcement Learning Algorithms
Comments: 25 pages, 16 figures
Subjects: Systems and Control (eess.SY); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (cs.LG); Optimization and Control (math.OC)
[21]  arXiv:2401.15482 (replaced) [pdf, other]
Title: Unsupervised Solution Operator Learning for Mean-Field Games via Sampling-Invariant Parametrizations
Subjects: Machine Learning (cs.LG); Computer Science and Game Theory (cs.GT); Optimization and Control (math.OC)
[22]  arXiv:2403.15959 (replaced) [pdf, other]
Title: Risk-Calibrated Human-Robot Interaction via Set-Valued Intent Prediction
Comments: Website with additional information, videos, and code: this https URL
Subjects: Robotics (cs.RO); Systems and Control (eess.SY); Optimization and Control (math.OC)
[23]  arXiv:2404.06023 (replaced) [pdf, other]
Title: Prelimit Coupling and Steady-State Convergence of Constant-stepsize Nonsmooth Contractive SA
Comments: ACM SIGMETRICS 2024. 71 pages, 3 figures
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Probability (math.PR)
[24]  arXiv:2404.08136 (replaced) [pdf, other]
Title: Exponentially Weighted Moving Models
Subjects: Computation (stat.CO); Signal Processing (eess.SP); Optimization and Control (math.OC); Computational Finance (q-fin.CP); Machine Learning (stat.ML)
[ total of 24 entries: 1-24 ]
[ showing up to 500 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, math, recent, 2404, contact, help  (Access key information)