We gratefully acknowledge support from
the Simons Foundation and member institutions.

Optimization and Control

New submissions

[ total of 22 entries: 1-22 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Thu, 27 Jan 22

[1]  arXiv:2201.10626 [pdf, ps, other]
Title: Vaidya's method for convex stochastic optimization in small dimension
Comments: 9 pages, in Russian
Subjects: Optimization and Control (math.OC)

This paper considers a general problem of convex stochastic optimization in a relatively low-dimensional space (e.g., 100 variables). It is known that for deterministic convex optimization problems of small dimensions, the fastest convergence is achieved by the center of gravity type methods (e.g., Vaidya's cutting plane method). For stochastic optimization problems, the question of whether Vaidya's method can be used comes down to the question of how it accumulates inaccuracy in the subgradient. The recent result of the authors states that the errors do not accumulate on iterations of Vaidya's method, which allows proposing its analog for stochastic optimization problems. The primary technique is to replace the subgradient in Vaidya's method with its probabilistic counterpart (the arithmetic mean of the stochastic subgradients). The present paper implements the described plan, which ultimately leads to an effective (if parallel computations for batching are possible) method for solving convex stochastic optimization problems in relatively low-dimensional spaces.

[2]  arXiv:2201.10678 [pdf, other]
Title: Multi-stage Stochastic Programming Methods for Adaptive Disaster Relief Logistics Planning
Subjects: Optimization and Control (math.OC)

We consider a logistics planning problem of prepositioning relief items in preparation for an impending hurricane landfall. This problem is modeled as a multiperiod network flow problem where the objective is to minimize the logistics cost of operating the network and the penalty for unsatisfied demand. We assume that the demand for relief items can be derived from the hurricane's predicted intensity and landfall location, which evolves according to a Markov chain. We consider this problem in two different settings, depending on whether the time of landfall is assumed to be deterministic (and known a priori) or random. For the former case, we introduce a fully adaptive multi-stage stochastic programming (MSP) model that allows the decision-maker to adjust the prepositioning decisions, sequentially, over multiple stages, as the hurricane's characteristics become clearer. For the latter case, we extend the MSP model with a random number of stages introduced in Guigues (2021), to the case where the underlying stochastic process is assumed to be stage-wise dependent. We benchmark the performance of the MSP models with other approximation policies such as the static and rolling-horizon two-stage stochastic programming approaches. Our numerical results provide key insight into the value of MSP, in disaster relief logistics planning.

[3]  arXiv:2201.10689 [pdf, ps, other]
Title: Revisiting Rockafellar's Theorem on Relative Interiors of Convex Graphs with Applications to Convex Generalized Differentiation
Subjects: Optimization and Control (math.OC)

In this paper we revisit a theorem by Rockafellar on representing the relative interior of the graph of a convex set-valued mapping in terms of the relative interior of its domain and function values. Then we apply this theorem to provide a simple way to prove many calculus rules of generalized differentiation of set-valued mappings and nonsmooth functions in finite dimensions. These results improve upon those in [14] by replacing the relative interior qualifications on graphs with qualifications on domains and/or ranges.

[4]  arXiv:2201.10731 [pdf, other]
Title: A fast-solved model for energy-efficient train control based on convex optimization
Comments: 10 pages, 5 figures
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)

In modern rail transportation, energy-efficient train control (EETC) is concerned with the optimal train speed trajectory or control strategies to achieve the minimum energy cost under various operation and traction constraints. This paper proposes an EETC model based on convex optimization so that the model can be rapidly solved by convex optimization algorithms. The high computational efficiency and robustness of the convex model can be verified by comparing the results achieved by the method proposed by this paper and other mainstream mathematical programming methods including mixed-integer linear programming (MILP) and Radau pseudospectral method (RPM). Based on the characteristics of convex optimization, the proposed method boasts more significant advantages over its counterparts in terms of computational efficiency in the promising online applications for automatic train control systems of various types of rail transportation.

[5]  arXiv:2201.10827 [pdf, other]
Title: Incorporate Day-ahead Robustness and Real-time Incentives for Electricity Market Design
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)

In this paper, we propose a two-stage electricity market framework to explore the participation of distributed energy resources (DERs) in a day-ahead (DA) market and a real-time (RT) market. The objective is to determine the optimal bidding strategies of the aggregated DERs in the DA market and generate online incentive signals for DER-owners to optimize the social welfare taking into account network operational constraints. Distributionally robust optimization is used to explicitly incorporate data-based statistical information of renewable forecasts into the supply/demand decisions in the DA market. We evaluate the conservativeness of bidding strategies distinguished by different risk aversion settings. In the RT market, a bi-level time-varying optimization problem is proposed to design the online incentive signals to tradeoff the RT imbalance penalty for distribution system operators (DSOs) and the costs of individual DER-owners. This enables tracking their optimal dispatch to provide fast balancing services, in the presence of time-varying network states while satisfying the voltage regulation requirement. Simulation results on both DA wholesale market and RT balancing market demonstrate the necessity of this two-stage design, and its robustness to uncertainties, the performance of convergence, the tracking ability, and the feasibility of the resulting network operations.

[6]  arXiv:2201.11003 [pdf, other]
Title: A distributed generalized Nash equilibrium seeking algorithm based on extremum seeking control
Authors: Feng Xiao, Xin Cai, Bo Wei
Comments: 9 pages, 4 figures
Subjects: Optimization and Control (math.OC)

In this paper, a distributed non-model based seeking algorithm which combines the extremum seeking control (ESC) jointly with learning algorithms is proposed to seek a generalized Nash equilibrium (GNE) for a class of noncooperative games with coupled equality constraint. The strategy of each agent is restricted by both the coupled inter-agent constraint and local inequality constraints. Thanks to the ESC, it is unnecessary to know the specific expressions of agents' cost functions and local constraints and to know the strategies of other agents for the implementation of the proposed GNE seeking algorithm. To deal with the coupled constraints, only the Lagrange multiplier is transmitted among agents with some prior information about the coupled constraints. Moreover, a diminishing dither signal is designed in the seeking algorithm to remove undesirable steady-state oscillations. The non-local convergence of the designed seeking algorithm is analyzed via the singular perturbation theory, averaging analysis and Lyapunov stability theory. Numerical examples are given to verify the effectiveness of our proposed method.

[7]  arXiv:2201.11019 [pdf, other]
Title: Demand Management for Peak to Average Ratio Minimization via Intraday Block Pricing
Comments: 11 pages, 7 figures, 2 tables
Subjects: Optimization and Control (math.OC)

Price based demand response schemes may significantly improve power system efficiency. Additionally, it is desired that such schemes yield improved power operation, by reducing the peak consumption. This paper proposes the Intraday Block Pricing (IBP) scheme, aiming to promote effective demand response among consumers by charging their electricity usage based on intraday time-slots. To design the prices associated with the proposed scheme, we formulate a bilevel optimization problem that aims to minimize the Peak-to-Average Ratio (PAR) and simultaneously benefit the consumers and the utility company. The bilevel problem is converted into a single-level Mathematical Program with Equilibrium Constraints (MPEC). The resulting MPEC is non-convex and includes nonlinear constraints. Hence, to obtain a solution, it is relaxed into a Mixed Integer Linear Program by dealing with all nonlinearities. To evaluate the conservativeness of the proposed approach, a lower bound to the cost of the original bilevel problem is obtained. The applicability of the proposed scheme is demonstrated with simulations on various case studies, which exhibit a significant reduction in PAR and economic gains for the utility company and consumers. Furthermore, simulation results show that the solutions of the original and relaxed problems are equivalent, demonstrating the effectiveness of the proposed solution approach.

[8]  arXiv:2201.11053 [pdf, ps, other]
Title: Improved Maximum Likelihood Estimation of ARMA Models
Comments: 11 pages
Subjects: Optimization and Control (math.OC); Computation (stat.CO)

In this paper we propose a new optimization model for maximum likelihood estimation of causal and invertible ARMA models. Through a set of numerical experiments we show how our proposed model outperforms, both in terms of quality of the fitted model as well as in the computational time, the classical estimation procedure based on Jones reparametrization. We also propose a regularization term in the model and we show how this addition improves the out of sample quality of the fitted model. This improvement is achieved thanks to an increased penalty on models close to the non causality or non invertibility boundary.

Cross-lists for Thu, 27 Jan 22

[9]  arXiv:2201.10590 (cross-list from math.ST) [pdf, other]
Title: Supervised learning of sheared distributions using linearized optimal transport
Subjects: Statistics Theory (math.ST); Optimization and Control (math.OC); Machine Learning (stat.ML)

In this paper we study supervised learning tasks on the space of probability measures. We approach this problem by embedding the space of probability measures into $L^2$ spaces using the optimal transport framework. In the embedding spaces, regular machine learning techniques are used to achieve linear separability. This idea has proved successful in applications and when the classes to be separated are generated by shifts and scalings of a fixed measure. This paper extends the class of elementary transformations suitable for the framework to families of shearings, describing conditions under which two classes of sheared distributions can be linearly separated. We furthermore give necessary bounds on the transformations to achieve a pre-specified separation level, and show how multiple embeddings can be used to allow for larger families of transformations. We demonstrate our results on image classification tasks.

[10]  arXiv:2201.10762 (cross-list from math.PR) [pdf, ps, other]
Title: Mean Field Game Master Equations with Anti-monotonicity Conditions
Comments: 27 pages. arXiv admin note: text overlap with arXiv:2101.12362
Subjects: Probability (math.PR); Analysis of PDEs (math.AP); Optimization and Control (math.OC)

It is well known that the monotonicity condition, either in Lasry-Lions sense or in displacement sense, is crucial for the global well-posedness of mean field game master equations, as well as for the uniqueness of mean field equilibria and solutions to mean field game systems. In the literature, the monotonicity conditions are always taken in a fixed direction. In this paper we propose a new type of monotonicity condition in the opposite direction, which we call the anti-monotonicity condition, and establish the global well-posedness for mean field game master equations with nonseparable Hamiltonians. Our anti-monotonicity condition allows our data to violate both the Lasry-Lions monotonicity and the displacement monotonicity conditions.

[11]  arXiv:2201.10923 (cross-list from q-bio.GN) [pdf, other]
Title: Fast, Flexible, and Exact Minimum Flow Decompositions via ILP
Subjects: Genomics (q-bio.GN); Combinatorics (math.CO); Optimization and Control (math.OC)

Minimum flow decomposition (MFD) (the problem of finding a minimum set of paths that perfectly decomposes a flow) is a classical problem in Computer Science, and variants of it are powerful models in multiassembly problems in Bioinformatics (e.g. RNA assembly). However, because this problem and its variants are NP-hard, practical multiassembly tools either use heuristics or solve simpler, polynomial-time solvable versions of the problem, which may yield solutions that are not mini-mal or do not perfectly decompose the flow. Many RNA assemblers also use integer linear programming(ILP) formulations of such practical variants, having the major limitation they need to encode all the potentially exponentially many solution paths. Moreover, the only exact solver for MFD does not scale to large instances and cannot be efficiently generalized to practical MFD variants. In this work, we provide the first practical ILP formulation for MFD (and thus the first fast and exact solver for MFD), based on encoding all of the exponentially many solution paths using only a quadratic number of variables. On both simulated and real flow graphs, our approach solves any instance in under 13 seconds. We also show that our ILP formulation can be easily and efficiently adapted for many practical variants, such as incorporating longer or paired-end reads or minimizing flow errors. We hope that our results can remove the current tradeoff between the complexity of a multi assembly model and its tractability and can lie at the core of future practical RNA assembly tools.

[12]  arXiv:2201.11066 (cross-list from cs.LG) [pdf, other]
Title: Server-Side Stepsizes and Sampling Without Replacement Provably Help in Federated Optimization
Comments: 26 pages, 3 tables, 2 figures, 1 algorithm, conference paper
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

We present a theoretical study of server-side optimization in federated learning. Our results are the first to show that the widely popular heuristic of scaling the client updates with an extra parameter is very useful in the context of Federated Averaging (FedAvg) with local passes over the client data. Each local pass is performed without replacement using Random Reshuffling, which is a key reason we can show improved complexities. In particular, we prove that whenever the local stepsizes are small, and the update direction is given by FedAvg in conjunction with Random Reshuffling over all clients, one can take a big leap in the obtained direction and improve rates for convex, strongly convex, and non-convex objectives. In particular, in non-convex regime we get an enhancement of the rate of convergence from $\mathcal{O}\left(\varepsilon^{-3}\right)$ to $\mathcal{O}\left(\varepsilon^{-2}\right)$. This result is new even for Random Reshuffling performed on a single node. In contrast, if the local stepsizes are large, we prove that the noise of client sampling can be controlled by using a small server-side stepsize. To the best of our knowledge, this is the first time that local steps provably help to overcome the communication bottleneck. Together, our results on the advantage of large and small server-side stepsizes give a formal justification for the practice of adaptive server-side optimization in federated learning. Moreover, we consider a variant of our algorithm that supports partial client participation, which makes the method more practical.

Replacements for Thu, 27 Jan 22

[13]  arXiv:2010.06331 (replaced) [pdf, other]
Title: Structure-Preserving Model Reduction for Dissipative Mechanical Systems
Comments: 21 pages, 8 figures
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY); Numerical Analysis (math.NA)
[14]  arXiv:2101.09621 (replaced) [pdf, other]
Title: Online Adjoint Methods for Optimization of PDEs
Subjects: Optimization and Control (math.OC); Analysis of PDEs (math.AP)
[15]  arXiv:2106.10665 (replaced) [pdf, other]
Title: Distributed Banach-Picard Iteration: Application to Distributed EM and Distributed PCA
Comments: 13 pages, 2 figures
Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC)
[16]  arXiv:2107.01948 (replaced) [pdf, other]
Title: Eigenvalues of Autocovariance Matrix: A Practical Method to Identify the Koopman Eigenfrequencies
Subjects: Optimization and Control (math.OC)
[17]  arXiv:2107.10123 (replaced) [pdf, other]
Title: Convergence rates for the Heavy-Ball continuous dynamics for non-convex optimization, under Polyak-Łojasiewicz condition
Subjects: Optimization and Control (math.OC)
[18]  arXiv:2109.02384 (replaced) [pdf, other]
Title: Explicit construction of the minimum error variance estimator for stochastic LTI state-space systems
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Dynamical Systems (math.DS); Machine Learning (stat.ML)
[19]  arXiv:2102.08685 (replaced) [pdf, ps, other]
Title: Deviation inequalities for stochastic approximation by averaging
Comments: 36 pages
Subjects: Probability (math.PR); Optimization and Control (math.OC); Machine Learning (stat.ML)
[20]  arXiv:2102.12264 (replaced) [pdf, other]
Title: The non-positive circuit weight problem in parametric graphs: a solution based on dioid theory
Comments: 25 pages, 4 figures, revised version. Proof of Proposition 6 corrected
Subjects: Combinatorics (math.CO); Systems and Control (eess.SY); Optimization and Control (math.OC)
[21]  arXiv:2110.15911 (replaced) [pdf, other]
Title: Physics-informed linear regression is competitive with two Machine Learning methods in residential building MPC
Comments: 17 pages, 11 Figures, submitted to Applied Energy
Journal-ref: Applied Energy 310 (2020) 118491
Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Optimization and Control (math.OC)
[22]  arXiv:2201.09406 (replaced) [src]
Title: Power Forward Performance in Semimartingale Markets with Stochastic Integrated Factors
Comments: This work was intended as a replacement of arXiv:1811.11899 and any subsequent updates will appear there
Subjects: Portfolio Management (q-fin.PM); Optimization and Control (math.OC); Probability (math.PR)
[ total of 22 entries: 1-22 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, math, recent, 2201, contact, help  (Access key information)