Optimization and Control
New submissions
[ showing up to 2000 entries per page: fewer  more ]
New submissions for Thu, 27 Jan 22
 [1] arXiv:2201.10626 [pdf, ps, other]

Title: Vaidya's method for convex stochastic optimization in small dimensionComments: 9 pages, in RussianSubjects: Optimization and Control (math.OC)
This paper considers a general problem of convex stochastic optimization in a relatively lowdimensional space (e.g., 100 variables). It is known that for deterministic convex optimization problems of small dimensions, the fastest convergence is achieved by the center of gravity type methods (e.g., Vaidya's cutting plane method). For stochastic optimization problems, the question of whether Vaidya's method can be used comes down to the question of how it accumulates inaccuracy in the subgradient. The recent result of the authors states that the errors do not accumulate on iterations of Vaidya's method, which allows proposing its analog for stochastic optimization problems. The primary technique is to replace the subgradient in Vaidya's method with its probabilistic counterpart (the arithmetic mean of the stochastic subgradients). The present paper implements the described plan, which ultimately leads to an effective (if parallel computations for batching are possible) method for solving convex stochastic optimization problems in relatively lowdimensional spaces.
 [2] arXiv:2201.10678 [pdf, other]

Title: Multistage Stochastic Programming Methods for Adaptive Disaster Relief Logistics PlanningSubjects: Optimization and Control (math.OC)
We consider a logistics planning problem of prepositioning relief items in preparation for an impending hurricane landfall. This problem is modeled as a multiperiod network flow problem where the objective is to minimize the logistics cost of operating the network and the penalty for unsatisfied demand. We assume that the demand for relief items can be derived from the hurricane's predicted intensity and landfall location, which evolves according to a Markov chain. We consider this problem in two different settings, depending on whether the time of landfall is assumed to be deterministic (and known a priori) or random. For the former case, we introduce a fully adaptive multistage stochastic programming (MSP) model that allows the decisionmaker to adjust the prepositioning decisions, sequentially, over multiple stages, as the hurricane's characteristics become clearer. For the latter case, we extend the MSP model with a random number of stages introduced in Guigues (2021), to the case where the underlying stochastic process is assumed to be stagewise dependent. We benchmark the performance of the MSP models with other approximation policies such as the static and rollinghorizon twostage stochastic programming approaches. Our numerical results provide key insight into the value of MSP, in disaster relief logistics planning.
 [3] arXiv:2201.10689 [pdf, ps, other]

Title: Revisiting Rockafellar's Theorem on Relative Interiors of Convex Graphs with Applications to Convex Generalized DifferentiationSubjects: Optimization and Control (math.OC)
In this paper we revisit a theorem by Rockafellar on representing the relative interior of the graph of a convex setvalued mapping in terms of the relative interior of its domain and function values. Then we apply this theorem to provide a simple way to prove many calculus rules of generalized differentiation of setvalued mappings and nonsmooth functions in finite dimensions. These results improve upon those in [14] by replacing the relative interior qualifications on graphs with qualifications on domains and/or ranges.
 [4] arXiv:2201.10731 [pdf, other]

Title: A fastsolved model for energyefficient train control based on convex optimizationComments: 10 pages, 5 figuresSubjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
In modern rail transportation, energyefficient train control (EETC) is concerned with the optimal train speed trajectory or control strategies to achieve the minimum energy cost under various operation and traction constraints. This paper proposes an EETC model based on convex optimization so that the model can be rapidly solved by convex optimization algorithms. The high computational efficiency and robustness of the convex model can be verified by comparing the results achieved by the method proposed by this paper and other mainstream mathematical programming methods including mixedinteger linear programming (MILP) and Radau pseudospectral method (RPM). Based on the characteristics of convex optimization, the proposed method boasts more significant advantages over its counterparts in terms of computational efficiency in the promising online applications for automatic train control systems of various types of rail transportation.
 [5] arXiv:2201.10827 [pdf, other]

Title: Incorporate Dayahead Robustness and Realtime Incentives for Electricity Market DesignSubjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
In this paper, we propose a twostage electricity market framework to explore the participation of distributed energy resources (DERs) in a dayahead (DA) market and a realtime (RT) market. The objective is to determine the optimal bidding strategies of the aggregated DERs in the DA market and generate online incentive signals for DERowners to optimize the social welfare taking into account network operational constraints. Distributionally robust optimization is used to explicitly incorporate databased statistical information of renewable forecasts into the supply/demand decisions in the DA market. We evaluate the conservativeness of bidding strategies distinguished by different risk aversion settings. In the RT market, a bilevel timevarying optimization problem is proposed to design the online incentive signals to tradeoff the RT imbalance penalty for distribution system operators (DSOs) and the costs of individual DERowners. This enables tracking their optimal dispatch to provide fast balancing services, in the presence of timevarying network states while satisfying the voltage regulation requirement. Simulation results on both DA wholesale market and RT balancing market demonstrate the necessity of this twostage design, and its robustness to uncertainties, the performance of convergence, the tracking ability, and the feasibility of the resulting network operations.
 [6] arXiv:2201.11003 [pdf, other]

Title: A distributed generalized Nash equilibrium seeking algorithm based on extremum seeking controlComments: 9 pages, 4 figuresSubjects: Optimization and Control (math.OC)
In this paper, a distributed nonmodel based seeking algorithm which combines the extremum seeking control (ESC) jointly with learning algorithms is proposed to seek a generalized Nash equilibrium (GNE) for a class of noncooperative games with coupled equality constraint. The strategy of each agent is restricted by both the coupled interagent constraint and local inequality constraints. Thanks to the ESC, it is unnecessary to know the specific expressions of agents' cost functions and local constraints and to know the strategies of other agents for the implementation of the proposed GNE seeking algorithm. To deal with the coupled constraints, only the Lagrange multiplier is transmitted among agents with some prior information about the coupled constraints. Moreover, a diminishing dither signal is designed in the seeking algorithm to remove undesirable steadystate oscillations. The nonlocal convergence of the designed seeking algorithm is analyzed via the singular perturbation theory, averaging analysis and Lyapunov stability theory. Numerical examples are given to verify the effectiveness of our proposed method.
 [7] arXiv:2201.11019 [pdf, other]

Title: Demand Management for Peak to Average Ratio Minimization via Intraday Block PricingComments: 11 pages, 7 figures, 2 tablesSubjects: Optimization and Control (math.OC)
Price based demand response schemes may significantly improve power system efficiency. Additionally, it is desired that such schemes yield improved power operation, by reducing the peak consumption. This paper proposes the Intraday Block Pricing (IBP) scheme, aiming to promote effective demand response among consumers by charging their electricity usage based on intraday timeslots. To design the prices associated with the proposed scheme, we formulate a bilevel optimization problem that aims to minimize the PeaktoAverage Ratio (PAR) and simultaneously benefit the consumers and the utility company. The bilevel problem is converted into a singlelevel Mathematical Program with Equilibrium Constraints (MPEC). The resulting MPEC is nonconvex and includes nonlinear constraints. Hence, to obtain a solution, it is relaxed into a Mixed Integer Linear Program by dealing with all nonlinearities. To evaluate the conservativeness of the proposed approach, a lower bound to the cost of the original bilevel problem is obtained. The applicability of the proposed scheme is demonstrated with simulations on various case studies, which exhibit a significant reduction in PAR and economic gains for the utility company and consumers. Furthermore, simulation results show that the solutions of the original and relaxed problems are equivalent, demonstrating the effectiveness of the proposed solution approach.
 [8] arXiv:2201.11053 [pdf, ps, other]

Title: Improved Maximum Likelihood Estimation of ARMA ModelsComments: 11 pagesSubjects: Optimization and Control (math.OC); Computation (stat.CO)
In this paper we propose a new optimization model for maximum likelihood estimation of causal and invertible ARMA models. Through a set of numerical experiments we show how our proposed model outperforms, both in terms of quality of the fitted model as well as in the computational time, the classical estimation procedure based on Jones reparametrization. We also propose a regularization term in the model and we show how this addition improves the out of sample quality of the fitted model. This improvement is achieved thanks to an increased penalty on models close to the non causality or non invertibility boundary.
Crosslists for Thu, 27 Jan 22
 [9] arXiv:2201.10590 (crosslist from math.ST) [pdf, other]

Title: Supervised learning of sheared distributions using linearized optimal transportSubjects: Statistics Theory (math.ST); Optimization and Control (math.OC); Machine Learning (stat.ML)
In this paper we study supervised learning tasks on the space of probability measures. We approach this problem by embedding the space of probability measures into $L^2$ spaces using the optimal transport framework. In the embedding spaces, regular machine learning techniques are used to achieve linear separability. This idea has proved successful in applications and when the classes to be separated are generated by shifts and scalings of a fixed measure. This paper extends the class of elementary transformations suitable for the framework to families of shearings, describing conditions under which two classes of sheared distributions can be linearly separated. We furthermore give necessary bounds on the transformations to achieve a prespecified separation level, and show how multiple embeddings can be used to allow for larger families of transformations. We demonstrate our results on image classification tasks.
 [10] arXiv:2201.10762 (crosslist from math.PR) [pdf, ps, other]

Title: Mean Field Game Master Equations with Antimonotonicity ConditionsComments: 27 pages. arXiv admin note: text overlap with arXiv:2101.12362Subjects: Probability (math.PR); Analysis of PDEs (math.AP); Optimization and Control (math.OC)
It is well known that the monotonicity condition, either in LasryLions sense or in displacement sense, is crucial for the global wellposedness of mean field game master equations, as well as for the uniqueness of mean field equilibria and solutions to mean field game systems. In the literature, the monotonicity conditions are always taken in a fixed direction. In this paper we propose a new type of monotonicity condition in the opposite direction, which we call the antimonotonicity condition, and establish the global wellposedness for mean field game master equations with nonseparable Hamiltonians. Our antimonotonicity condition allows our data to violate both the LasryLions monotonicity and the displacement monotonicity conditions.
 [11] arXiv:2201.10923 (crosslist from qbio.GN) [pdf, other]

Title: Fast, Flexible, and Exact Minimum Flow Decompositions via ILPSubjects: Genomics (qbio.GN); Combinatorics (math.CO); Optimization and Control (math.OC)
Minimum flow decomposition (MFD) (the problem of finding a minimum set of paths that perfectly decomposes a flow) is a classical problem in Computer Science, and variants of it are powerful models in multiassembly problems in Bioinformatics (e.g. RNA assembly). However, because this problem and its variants are NPhard, practical multiassembly tools either use heuristics or solve simpler, polynomialtime solvable versions of the problem, which may yield solutions that are not minimal or do not perfectly decompose the flow. Many RNA assemblers also use integer linear programming(ILP) formulations of such practical variants, having the major limitation they need to encode all the potentially exponentially many solution paths. Moreover, the only exact solver for MFD does not scale to large instances and cannot be efficiently generalized to practical MFD variants. In this work, we provide the first practical ILP formulation for MFD (and thus the first fast and exact solver for MFD), based on encoding all of the exponentially many solution paths using only a quadratic number of variables. On both simulated and real flow graphs, our approach solves any instance in under 13 seconds. We also show that our ILP formulation can be easily and efficiently adapted for many practical variants, such as incorporating longer or pairedend reads or minimizing flow errors. We hope that our results can remove the current tradeoff between the complexity of a multi assembly model and its tractability and can lie at the core of future practical RNA assembly tools.
 [12] arXiv:2201.11066 (crosslist from cs.LG) [pdf, other]

Title: ServerSide Stepsizes and Sampling Without Replacement Provably Help in Federated OptimizationComments: 26 pages, 3 tables, 2 figures, 1 algorithm, conference paperSubjects: Machine Learning (cs.LG); Optimization and Control (math.OC)
We present a theoretical study of serverside optimization in federated learning. Our results are the first to show that the widely popular heuristic of scaling the client updates with an extra parameter is very useful in the context of Federated Averaging (FedAvg) with local passes over the client data. Each local pass is performed without replacement using Random Reshuffling, which is a key reason we can show improved complexities. In particular, we prove that whenever the local stepsizes are small, and the update direction is given by FedAvg in conjunction with Random Reshuffling over all clients, one can take a big leap in the obtained direction and improve rates for convex, strongly convex, and nonconvex objectives. In particular, in nonconvex regime we get an enhancement of the rate of convergence from $\mathcal{O}\left(\varepsilon^{3}\right)$ to $\mathcal{O}\left(\varepsilon^{2}\right)$. This result is new even for Random Reshuffling performed on a single node. In contrast, if the local stepsizes are large, we prove that the noise of client sampling can be controlled by using a small serverside stepsize. To the best of our knowledge, this is the first time that local steps provably help to overcome the communication bottleneck. Together, our results on the advantage of large and small serverside stepsizes give a formal justification for the practice of adaptive serverside optimization in federated learning. Moreover, we consider a variant of our algorithm that supports partial client participation, which makes the method more practical.
Replacements for Thu, 27 Jan 22
 [13] arXiv:2010.06331 (replaced) [pdf, other]

Title: StructurePreserving Model Reduction for Dissipative Mechanical SystemsAuthors: Rebekka S. Beddig, Peter Benner, Ines Dorschky, Timo Reis, Paul Schwerdtner, Matthias Voigt, Steffen W. R. WernerComments: 21 pages, 8 figuresSubjects: Optimization and Control (math.OC); Systems and Control (eess.SY); Numerical Analysis (math.NA)
 [14] arXiv:2101.09621 (replaced) [pdf, other]

Title: Online Adjoint Methods for Optimization of PDEsSubjects: Optimization and Control (math.OC); Analysis of PDEs (math.AP)
 [15] arXiv:2106.10665 (replaced) [pdf, other]

Title: Distributed BanachPicard Iteration: Application to Distributed EM and Distributed PCAComments: 13 pages, 2 figuresSubjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC)
 [16] arXiv:2107.01948 (replaced) [pdf, other]

Title: Eigenvalues of Autocovariance Matrix: A Practical Method to Identify the Koopman EigenfrequenciesSubjects: Optimization and Control (math.OC)
 [17] arXiv:2107.10123 (replaced) [pdf, other]

Title: Convergence rates for the HeavyBall continuous dynamics for nonconvex optimization, under PolyakŁojasiewicz conditionSubjects: Optimization and Control (math.OC)
 [18] arXiv:2109.02384 (replaced) [pdf, other]

Title: Explicit construction of the minimum error variance estimator for stochastic LTI statespace systemsSubjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Dynamical Systems (math.DS); Machine Learning (stat.ML)
 [19] arXiv:2102.08685 (replaced) [pdf, ps, other]

Title: Deviation inequalities for stochastic approximation by averagingComments: 36 pagesSubjects: Probability (math.PR); Optimization and Control (math.OC); Machine Learning (stat.ML)
 [20] arXiv:2102.12264 (replaced) [pdf, other]

Title: The nonpositive circuit weight problem in parametric graphs: a solution based on dioid theoryComments: 25 pages, 4 figures, revised version. Proof of Proposition 6 correctedSubjects: Combinatorics (math.CO); Systems and Control (eess.SY); Optimization and Control (math.OC)
 [21] arXiv:2110.15911 (replaced) [pdf, other]

Title: Physicsinformed linear regression is competitive with two Machine Learning methods in residential building MPCAuthors: Felix Bünning, Benjamin Huber, Adrian Schalbetter, Ahmed Aboudonia, Mathias Hudoba de Badyn, Philipp Heer, Roy S. Smith, John LygerosComments: 17 pages, 11 Figures, submitted to Applied EnergyJournalref: Applied Energy 310 (2020) 118491Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Optimization and Control (math.OC)
 [22] arXiv:2201.09406 (replaced) [src]

Title: Power Forward Performance in Semimartingale Markets with Stochastic Integrated FactorsComments: This work was intended as a replacement of arXiv:1811.11899 and any subsequent updates will appear thereSubjects: Portfolio Management (qfin.PM); Optimization and Control (math.OC); Probability (math.PR)
[ showing up to 2000 entries per page: fewer  more ]
Disable MathJax (What is MathJax?)
Links to: arXiv, form interface, find, math, recent, 2201, contact, help (Access key information)